JP2006174258A - Program, stereoscopic image producing device, and stereoscopic image displaying device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To reduce color fringes generated in an oblique direction caused by the oblique disposition of a lenticular lens etc. and an array pattern of a color filter. <P>SOLUTION: In pixel arrays each corresponding to pixel lines disposed at predetermined intervals among pixel lines constituted of pixels connected in a line direction, a stereoscopic image is generated by performing a specific luminance value setting process which makes a luminance value relating to a primary color of the whole pixel array corresponding to a specific primary color when the primary color different periodically is specified from one of corresponding pixel lines as a predetermined luminance value. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention provides a three-dimensional virtual space to be displayed on a stereoscopic image display device comprising a display element group composed of sub-pixels and optical means composed of optical unit elements that give directivity to each sub-pixel of the display element group. The present invention relates to a program for generating a stereoscopic image, a stereoscopic image generation device, and a stereoscopic image display device.

2. Description of the Related Art In recent years, stereoscopic image display apparatuses that realize binocular parallax by intentionally generating binocular parallax are known (see, for example, Patent Document 1). As a stereoscopic image display device, a device using a lenticular lens or a device using a parallax barrier is known.
JP 2004-78086 A

  The lenticular lens is a lens in which one surface is formed in a planar shape and the other surface is formed in a shape in which saddle-shaped irregularities are connected, or a lens array optically equivalent to this. In the method using a lenticular lens, first, a right-eye image and a left-eye image are prepared, and the prepared images are divided into vertical (or horizontal) stripes, which are alternately arranged. And by refracting the light emitted from each pixel displaying the synthesized image by the lenticular lens, the right eye image is converged to the right eye position, and the left eye image is converged to the left eye. Yes.

  A parallax barrier is a plate that shields light and has many slit-shaped holes that are barrier openings for transmitting light, and the pitch of each slit corresponds to multiple pixels. In addition, the slits give directivity to the light emitted from each pixel. Thereby, it becomes possible to make an observer recognize a stereoscopic video image similarly to the method using a lenticular lens. Here, the stereoscopic image described in this specification indicates an image (video) formed in the observer's cerebrum by binocular parallax, and the stereoscopic image is an image displayed on a display screen ( Image).

  The above-described stereoscopic image display device is configured using a display panel such as a liquid crystal. However, since the display panel is configured by arranging pixels in a lattice pattern, it is possible to prevent transmission of unnecessary light between the pixels. A black matrix is formed in a lattice shape. Here, when a lenticular lens or the like is provided on the display panel, it is known that moire occurs due to the lattice fringes formed by the black matrix being emphasized by the lenticular lens or the like. Therefore, in order to suppress this moire, a lenticular lens is arranged obliquely with respect to the display panel (that is, the black matrix) (hereinafter referred to as “oblique arrangement”), so that moire caused by lattice fringes is generated. There is a known method of reducing the barrier opening (in the case of a parallax barrier, the barrier openings are arranged obliquely).

  On the other hand, a stereoscopic image display device capable of color display has a dedicated color filter for each of the three primary colors R (red), G (green), and B (blue) to realize color display. In particular, there is known a method using a color filter in which an R pixel portion, a G pixel portion, and a B pixel portion are sequentially repeated on one display panel to form a stripe arrangement.

  In a stereoscopic image display device including such a color filter, when a stereoscopic image is selected in a strip shape by a lenticular lens or the like and separated into images of individual viewpoints, each of the display panels is displayed according to the arrangement pattern of the color filters. It is known that the color of a pixel is generated as a color stripe. This is because when a lenticular lens or the like is used as an optical means, the lens color is enlarged by the lens on the focus line corresponding to each viewpoint (line focus of each lens), and the enlarged pixel color is constant. By being repeated at a cycle (corresponding to the arrangement of color filters), recognition is possible with the spatial resolution of the human eye, and it is recognized as a color stripe.

  As described above, when the lenticular lens and the parallax barrier are arranged obliquely, it is possible to reduce the occurrence of moire due to the black matrix lattice stripes. However, the color stripes caused by the color filter still appear on the screen and appear obliquely, so that there is a problem that they are more disturbing and are observed.

  An object of the present invention is to suppress color stripes generated in an oblique direction due to an oblique arrangement of a lenticular lens or the like and an arrangement pattern of color filters.

The first invention for solving the above-described problems is
A display element group in which pixels composed of a plurality of sub-pixels that emit light of different primary colors are arranged in a grid pattern, and sub-pixels in the same column emit the same primary color, and a three-dimensional stereoscopic display displayed on the display element group An image to be displayed on a stereoscopic image display device including optical means configured by arranging optical unit elements for separating a visual image into images for each viewpoint obliquely with respect to the arrangement direction of the sub-pixels. A program for causing a computer to generate a stereoscopic image composed of pixels representing the display colors of the pixels by luminance values of the respective primary colors,
In a pixel column corresponding to each pixel column at predetermined intervals among pixel columns composed of pixels connected in the column direction, a specific primary color when a different primary color is periodically specified from the corresponding pixel column one by one. This is a program for causing the computer to function as image generation means for generating a stereoscopic image by performing a specific luminance value setting process in which the luminance value corresponding to the primary color of the entire corresponding pixel row is a predetermined luminance value.

The tenth invention is
A display element group in which pixels composed of a plurality of sub-pixels that emit light of different primary colors are arranged in a grid pattern, and sub-pixels in the same column emit the same primary color, and a three-dimensional stereoscopic display displayed on the display element group An image to be displayed on a stereoscopic image display device including optical means configured by arranging optical unit elements for separating a visual image into images for each viewpoint obliquely with respect to the arrangement direction of the sub-pixels. A stereoscopic image generation device configured to generate a stereoscopic image composed of pixels representing the display color of the pixel by the luminance value of each primary color,
In a pixel column corresponding to each pixel column at predetermined intervals among pixel columns composed of pixels connected in the column direction, a specific primary color when a different primary color is periodically specified from the corresponding pixel column one by one. A stereoscopic image generation apparatus comprising image generation means for generating a stereoscopic image by performing a specific luminance value setting process in which a luminance value for the primary color of the entire corresponding pixel row is set to a predetermined luminance value. is there.

The nineteenth invention
A display element group in which pixels composed of a plurality of sub-pixels that emit light of different primary colors are arranged in a grid pattern, and sub-pixels in the same column emit the same primary color, and a three-dimensional stereoscopic display displayed on the display element group An optical unit configured to divide a visual image into an image for each viewpoint and arranged obliquely with respect to the arrangement direction of the sub-pixels, and the display color of the pixel is a luminance of each primary color A stereoscopic image display device that displays a stereoscopic image composed of pixels represented by values,
In a pixel column corresponding to each pixel column at predetermined intervals among pixel columns composed of pixels connected in the column direction, a specific primary color when a different primary color is periodically specified from the corresponding pixel column one by one. A stereoscopic image display device comprising image generation means for generating a stereoscopic image by performing a specific luminance value setting process in which a luminance value for the primary color of the corresponding entire pixel row is set to a predetermined luminance value. is there.

  According to the first, tenth, or nineteenth invention, in the pixel columns corresponding to the pixel columns at predetermined intervals among the pixel columns composed of pixels connected in the column direction, In order to generate a stereoscopic image by performing a specific luminance value setting process in which the luminance value for the primary color corresponding to the specific primary color corresponding to the specific primary color when periodically different primary colors are specified is set to a predetermined luminance value. By arranging the means obliquely with respect to the arrangement direction of the subpixels, it is possible to suppress the color stripes in the oblique direction generated in the video.

The second invention is the program of the first invention,
The image generation means is a program for causing the computer to function so as to generate a stereoscopic image by performing the specific luminance value setting process on the original image of the stereoscopic image.

An eleventh aspect of the invention is a stereoscopic image generating apparatus according to the tenth aspect of the invention,
The stereoscopic image generation apparatus, wherein the image generation unit performs the specific luminance value setting process on an original image of a stereoscopic image.

A twentieth invention is a stereoscopic image display device according to the nineteenth invention,
The image generation means generates a stereoscopic image by performing the specific luminance setting process on the original image of the stereoscopic image generated by the stereoscopic image generation device, and displays the stereoscopic image on the display element group. A stereoscopic image display device characterized in that

  According to the second, eleventh or twentieth invention, since the stereoscopic image can be generated by performing the specific brightness setting process on the original image, the process of generating the original image and generating the stereoscopic image Can be distributed to reduce the processing load.

The third invention is the program of the first invention,
It is a program for causing the computer to function so that the image generation means has an original image generation means for generating the original image.

A twelfth invention is a stereoscopic image generating device according to the tenth invention,
The stereoscopic image generating apparatus, wherein the image generating means includes original image generating means for generating the original image.

  According to the third or twelfth invention, an image can also be generated in advance.

The fourth invention is the program of any one of the first to third inventions,
The image generation means is a program for causing the computer to function so as to perform the specific luminance value setting process using the predetermined luminance value as a constant luminance value.

A thirteenth invention is the stereoscopic image generating device according to any one of the tenth to twelfth inventions,
The stereoscopic image generation apparatus, wherein the image generation unit performs the specific luminance value setting process with the predetermined luminance value as a constant luminance value.

A twenty-first invention is a stereoscopic image display device according to the nineteenth or twentieth invention,
The stereoscopic image display device, wherein the image generation means performs the specific luminance value setting process with the predetermined luminance value as a constant luminance value.

  According to the fourth, thirteenth or twenty-first aspect of the present invention, it is possible to suppress diagonal color fringes while suppressing a decrease in overall brightness and resolution of an image displayed on the display element group. Also, by making the predetermined luminance value a constant luminance value, the calculation load in the specific luminance setting process can be reduced.

The fifth invention is the program of the second or third invention,
The specific luminance value setting process is performed so that the image generation means uses a luminance value obtained by multiplying a luminance value for the primary color to be changed in the original image by a certain reduction rate as a luminance value for the primary color to be changed. A program for causing the computer to function as it is performed.

A fourteenth invention is a stereoscopic image generating device according to the eleventh or twelfth invention,
The specific luminance value setting process is performed so that the image generation means uses a luminance value obtained by multiplying a luminance value for the primary color to be changed in the original image by a certain reduction rate as a luminance value for the primary color to be changed. This is a stereoscopic image generation device characterized by performing.

A twenty-second invention is a stereoscopic image display device according to the nineteenth or twentieth invention,
The specific luminance value setting process is performed so that the image generation means uses a luminance value obtained by multiplying a luminance value for the primary color to be changed in the original image by a certain reduction rate as a luminance value for the primary color to be changed. This is a stereoscopic image display device that is characterized in that it performs.

  According to the fifth, fourteenth, or twenty-second invention, the luminance value can be changed in accordance with the luminance value of the specific primary color in the original image. Color fringes can be suppressed.

The sixth invention is the program of the second, third or fifth invention,
The image generation means performs control to distribute the amount of change in the luminance value of the primary color changed by the specific luminance value setting process to a pixel column adjacent to the pixel column, and suppress a variation in the sum of luminance values. A program for causing the computer to function so as to have distributed control means.

A fifteenth aspect of the invention is a stereoscopic image generating apparatus according to the eleventh, twelfth or fourteenth aspect of the invention,
Dispersion control in which the image generation unit performs control to disperse the amount of change in the luminance value of the primary color changed by the specific luminance setting process in a pixel column adjacent to the pixel column, and to suppress variation in the sum of luminance values A stereoscopic image generating apparatus characterized by comprising means.

A twenty-third invention is a stereoscopic image display device according to the nineteenth, twentieth or twenty-second invention,
Dispersion control in which the image generation unit performs control to disperse the amount of change in the luminance value of the primary color changed by the specific luminance setting process in a pixel column adjacent to the pixel column, and to suppress variation in the sum of luminance values A stereoscopic image display device characterized by comprising means.

  According to the sixth, fifteenth or twenty-third aspect of the present invention, even if the luminance value of the specific primary color is changed by the specific luminance setting process, the sum of the luminance values as the entire image does not vary, so the brightness of the entire image Color stripes in an oblique direction can be suppressed without reducing the thickness.

The seventh invention is the program of the second, third or fifth invention,
The dispersion control means provides the computer with a luminance value of the same primary color as that of the primary color of the pixel column adjacent to the pixel column, for the amount of change of the luminance value for the primary color changed by the specific luminance value setting process. It is a program to make it function.

A sixteenth aspect of the invention is a stereoscopic image generating apparatus according to the eleventh, twelfth or fourteenth aspect of the invention,
Dispersion control in which the image generation unit distributes the amount of change in the luminance value for the primary color changed by the specific luminance setting process so as to cover the luminance value of the primary color of the primary color adjacent to the pixel row A stereoscopic image generating apparatus characterized by comprising means.

A twenty-fourth invention is a stereoscopic image display device according to the nineteenth, twentieth or twenty-second invention,
Dispersion control in which the image generation unit distributes the amount of change in the luminance value for the primary color changed by the specific luminance setting process so as to cover the luminance value of the primary color of the primary color adjacent to the pixel row A stereoscopic image display device characterized by comprising means.

  According to the seventh, sixteenth, or twenty-fourth invention, since the luminance value for the specific primary color can be held at the luminance value of the same primary color as that of the adjacent primary pixel, the brightness and resolution of the entire image are reduced. Without causing the color fringes in the oblique direction to be suppressed.

The eighth invention is the program of the seventh invention,
The dispersion control unit covers the amount of change in the brightness value for the primary color changed by the specific brightness value setting process with a ratio based on the ratio of the brightness value of the primary color and the primary color of the pixel row adjacent to the pixel row. Is a program for causing the computer to function.

A seventeenth aspect of the invention is a stereoscopic image generating device of the sixteenth aspect of the invention,
The dispersion control means covers the amount of change in the luminance value for the primary color changed by the specific luminance setting process with a ratio based on the ratio between the primary color and the primary color luminance value of the pixel column adjacent to the pixel column. Is a stereoscopic image generating apparatus characterized by

A twenty-fifth aspect of the invention is the stereoscopic image display device of the twenty-fourth aspect of the invention,
The dispersion control means covers the amount of change in the luminance value for the primary color changed by the specific luminance setting process with a ratio based on the ratio between the primary color and the primary color luminance value of the pixel column adjacent to the pixel column. Is a stereoscopic image display device characterized by

  According to the eighth, seventeenth, or twenty-fifth invention, the luminance value of the specific primary color is distributed according to the ratio of the luminance value of the primary color and the primary color of the pixel column adjacent to the pixel row of the specific primary color. It is possible to maintain the color distribution ratio of the primary color with the primary color as the center. Thereby, it is possible to suppress color stripes in an oblique direction without reducing the brightness and contrast of the entire image.

The ninth invention is the program of any one of the first to eighth inventions,
The optical means may be a lenticular lens, a stair lenticular lens, a parallax barrier, or a stair parallax barrier.

An eighteenth aspect of the invention is the stereoscopic image generating device according to any one of the tenth to seventeenth aspects of the invention,
The optical means may be a lenticular lens, a stair lenticular lens, a parallax barrier, or a stair parallax barrier.

A twenty-sixth invention is the stereoscopic image display device according to any one of the nineteenth to twenty-fifth inventions,
The optical means is a stereoscopic image display device characterized by a lenticular lens, a stair lenticular lens, a parallax barrier, and a stair parallax barrier.

  According to the ninth, eighteenth, or twenty-fifth invention, it is possible to suppress oblique color fringes generated in a stereoscopic image realized by various optical means.

  According to the present invention, the color in the oblique direction generated in the video viewed through the optical means arranged obliquely with respect to the arrangement direction of the sub-pixels constituting the display element group that displays the stereoscopic image. It is possible to provide a high-quality stereoscopic image by suppressing stripes.

  Hereinafter, an embodiment to which the present invention is applied will be described with reference to FIGS. In addition, although the case where a flat liquid crystal display (liquid crystal panel) is used as an image display means of a stereoscopic image display device is described as an example, the application of the present invention is not necessarily limited to this case. In addition, various types of lens plates installed in the stereoscopic image display device are conceivable. In the following, a lenticular lens plate is used as the lens plate.

  In addition, some lenticular lens plates have irregularities on both sides, but the lenticular lens plate handled in the present embodiment is a lens plate with one surface having irregularities and the other surface being substantially planar, The concavo-convex surface is assumed to be a continuous array of semi-cylindrical or optically equivalent microlenses (unit lenses constituting a lenticular lens plate). Hereinafter, the lenticular lens plate is simply referred to as a lens plate, and the microlens (unit lens) is simply referred to as a lens.

  The display may be of any type as long as it is capable of color display in which pixels whose emission colors are determined are arranged in a grid and can be stereoscopically viewed by combining the above optical means. . For example, a color filter type liquid crystal display, a plasma display, an inorganic EL (Electroluminescence) display, an organic EL display, or the like can be considered. Furthermore, even if a color filter is not used, it is possible to use a single color such as red (R), green (G), and blue (B) as in an organic EL display or LED (Light Emitting Diode) display in which single color light emitting elements are arranged. Any display provided with a light emitting element is applicable. Below, it demonstrates as what uses a liquid crystal display as a display.

[principle]
1. First, a stereoscopic image display apparatus will be described. For the sake of simplicity of explanation, a binocular stereoscopic image display device will be described as an example. Here, the twin-lens type means a display type that displays different images in two directivity directions in the stereoscopic image display device.

  FIG. 1 is a diagram schematically showing a vertical cross section with respect to a display surface of a binocular stereoscopic image display device 1. More precisely, FIG. 1 is a diagram showing a cross section perpendicular to the image display surface in the horizontal direction of the display surface of the stereoscopic image display device 500, that is, parallel to a straight line including both eyes of the observer.

  According to FIG. 1, the stereoscopic image display device 500 mainly includes the lens plate 10, the display panel 30, and the backlight 30. The lens plate 10, the display panel 30, and the backlight 40 are plate-like bodies, and are arranged in parallel to each other. The backlight 40 emits light, which passes through the display panel 30 and the lens plate 10 and travels out of the stereoscopic image display device 1. That is, the observer sees an image displayed on the display panel 30 through the lens plate 10.

  The lens plate 10 is designed such that the lens pitch x (lateral width; length in the width direction of the microlens) of each lens (microlens) corresponds to two subpixels, and the uneven surface 10a of the lens is displayed. It arrange | positions so that the display surface of the panel 30 may be opposed. In order to realize a stereoscopic image with the stereoscopic image display device 1 shown in FIG. 1, generally, the distance between the lens plate 10 and the display panel 30 is made to coincide with the focal length of each lens of the lens plate 10. In other words, the lens plate 10 and the display panel 30 are arranged so that the focal plane of each lens is positioned in the vicinity of the display surface of the display panel 30. By setting in this way, each sub-pixel of the display panel 30 is enlarged to the same width as the lens pitch by each lens of the lens plate 10. Each lens functions to give directivity to light emitted from each sub-pixel of the display panel 30.

  The display panel 30 is configured by disposing the color filter 20 on a liquid crystal panel 35. As shown in FIG. 3, the color filter 20 is a stripe-arranged color filter composed of three primary colors of light, red, green, and blue, and the same color is arranged for each column. The light emitted from each subpixel of the liquid crystal panel 35 passes through the color filter 20 of each subpixel, and is colored red (R), green (G), and blue (B) and emitted to the lens plate 10. Is done.

  Here, with reference to FIG. 2, the image recognized by the parallax of the left eye and the right eye will be described. FIG. 2 is a diagram schematically showing a partial cross section of the lens plate 10 and the display panel 30, and the distance between the lens plate 10 and the liquid crystal panel 35 matches the focal length f of each lens of the lens plate 10. This shows the state that has been caused. Note that the color filter 20 is not shown for the sake of simplicity.

  Referring to FIG. 2, the liquid crystal panel 35 has subpixels px1, px2, px3, px4, px5, px6,. The lens pitch x of each lens of the lens plate 10 corresponds to 2 subpixels as described above. In such an arrangement, when the stereoscopic image display device 100 is viewed at an ideal distance E and the lens 14 is viewed from the left eye L, the focal point of the lens 14 is located at the sub-pixel px4. The subpixel px4 appears to be enlarged.

  On the other hand, when the lens 14 is viewed from the right eye R, since the focal point of the lens 14 is located at the subpixel px3, the subpixel px3 appears to expand on one surface of the lens 14. In this way, by setting the focal point of each lens of the lens plate 10 in the vicinity of the display surface of the liquid crystal panel 35, different images can be recognized (that is, become images) to both eyes of the observer.

  In the above description, the binocular stereoscopic image display device has been described as an example.

  By the way, in a general stereoscopic image display device, in order to suppress the occurrence of moiré, the lens pitch direction (micrometer) of the lens plate with respect to the arrangement in the column direction (horizontal scanning direction; scanning line direction) of the sub-pixels of the display panel. The lens is arranged so that the connecting direction of the lenses forms an angle θ. This will be described in detail with reference to FIG.

  FIG. 4 is a plan view for explaining the positional relationship between the display panel 30 provided with the stripe-arranged color filter 20 and the five-lens lens plate. Hereinafter, although the color filter 20 will be described as having a stripe arrangement, it is only necessary that the RGB sub-pixels be arranged in a predetermined (constant) order in the row direction and the column direction. It may be a rectangle array.

  Lines A1, A2 and A3 in FIG. 4 are lines showing the positions of the end portions of the lenses of the lens plate 10 disposed above the display panel 30 (front of the hand in FIG. 4). The end portion of the lens is a valley portion of the lens such as 10b or 10c in the lens plate 10 shown in FIG. 1 and refers to a boundary portion of the lens. Also, the length in the row direction (horizontal scanning direction) of one pixel made up of three subpixels (pixel width for one pixel; also called the pixel pitch in the row direction) is p, and the sub for the pixel width for one pixel The width of one microlens of the lens plate parallel to the pixel row direction is L, and Lp = (5/6) p.

  Note that the parentheses in each pixel in the figure indicate the number of each viewpoint. In the following description, each subpixel of the liquid crystal panel 35 is distinguished (R11, G11, B11,...) By the color of the color filter 20 disposed in each subpixel.

In FIG. 4, the lens plate 10 is disposed obliquely so that the lens pitch direction forms an angle θ with respect to the column direction of the sub-pixels of the display panel 30. (In FIG. 4, the angle formed by the row direction of the display panel 30 and the boundary line of the microlens of the lens plate 10 is described as θ, which is synonymous). Specifically, the lens plate 10 is arranged so that the end of the lens is positioned above the diagonal line of the rectangle including the subpixel R11 and the subpixel R12 (line A1). In the present embodiment, one subpixel of the display panel 30 has a ratio of the length in the row direction to the length in the column direction (vertical scanning line direction; signal line direction) is 1: 3, and thus the subpixels R11 and R12. The ratio of the length in the row direction and the length in the column direction of the rectangle combined is 1: 6. That is, θ = tan ⁻¹ (1/6) ≈9.5 °. Accordingly, the lens plate 10 is arranged such that the lens pitch direction of the lens plate 10 forms an angle θ = 9.5 ° with respect to the arrangement in the row direction of the sub-pixels of the display panel 30.

  As described above, the lens pitch direction of the lens plate 10 is inclined with respect to the arrangement in the row direction of the sub-pixels of the display panel 30 (in other words, the lens plate with respect to the column direction of the display panel 30). 10), the moire generated in the stereoscopic image when viewed by the observer through the lens plate 10 can be dispersed and made inconspicuous. However, it has been found that, due to the inclination of the lens plate 10, the color of each sub-pixel is continuously enlarged in the oblique direction, so that color stripes in the oblique direction are generated. The generation of this color stripe will be described.

2. Principle of Color Stripe Generation First, an image projected by a five-lens lens will be described with reference to FIG. FIG. 5 is a diagram schematically illustrating a vertical cross section of one pixel of the display panel 30 and the lens L10 which is one of the lenses constituting the lens plate. The display panel 30 includes a red subpixel R11, a green subpixel G11, and a blue subpixel B11.

  First, FIG. 5A illustrates a state in which the lens is viewed from the upper left position of the lens L10 when viewed from the observer (hereinafter, referred to as “first viewpoint” as appropriate). 5B shows a position from above the lens L10 as viewed from the observer (hereinafter referred to as “third viewpoint” as appropriate), and FIG. FIG. 4 illustrates a state in which the lens is viewed from the position of “fifth viewpoint” as appropriate.

  As shown in FIG. 5A, when the observer views the lens L10 from the position of the first viewpoint, the focal point of the lens L10 is located at the point F10 on the red subpixel R11. The red color of the point F10 is enlarged and projected. Further, as shown in FIG. 5B, when the observer looks at the lens L10 from the position of the third viewpoint, the focus of the lens L10 is located at the point F12 on the green subpixel G11, so that the lens L10 Is displayed with the green color of the point F12 enlarged. Further, as shown in FIG. 5C, when the observer views the lens L10 from the position of the fifth viewpoint, the focal point of the lens L10 is located at a point F14 on the blue subpixel B11. Is enlarged and projected at the point F14.

  Here, an individual viewpoint video (an image viewed from one viewpoint) when the observer sees from the third viewpoint will be described with reference to FIGS. 6 and 7. FIG. 6 is an enlarged view of a part of the display panel 30. Straight lines A1, A2 and A3 indicate lens end portions of the respective lenses constituting the lens plate. Dotted lines C1 and C2 are lines indicating the focal position of each lens (hereinafter referred to as “focus line” as appropriate), and coincide with the center line of each lens. For example, as shown in FIG. 6, the focus line of the lens L12 is indicated by a dotted line C1, and the individual viewpoint video from the third viewpoint is an image in which the point on the dotted line C1 is projected on the lens L12.

  Here, an image in which a point on the dotted line C1 is projected by the lens L12 will be described. First, in the section from the point T10 to the point T12 on the dotted line C1, the dotted line C1 passes over the green subpixel G11 and the subpixel G12. Accordingly, in the lens L12, a section extending from the point T10 to the point T12 is projected with green being spread in the lens vertical direction. Specifically, at the position of the point T18, the green color spreads in the range from the lens end A1 to the lens end A2 (the range of the thick double arrow line in the figure) and is projected on the lens L12. Here, when one subpixel is enlarged to the lens width of the lens plate, the subpixel width is recognized as an image enlarged by 2.5 times.

  Subsequently, in the section from the point T12 to the point T14 on the dotted line C1, the dotted line C1 passes over the blue subpixels B12 and B13. Therefore, in the lens L12, in the section from the point T12 to the point T14, blue is spread and projected in the lens vertical direction.

  Similarly, an image in which a point on the dotted line C2 is projected by the lens L14 will be described. First, in the section from the point T20 to the point T22 on the dotted line C2, the dotted line C2 passes over the red subpixel R21. Therefore, in the lens L14, a red color is projected and projected in a section from the point T20 to the point T22. Subsequently, in a section from the point T22 to the point T24 on the dotted line C2, the dotted line C2 passes over the subpixel G21, the subpixel G22, and the subpixel G23 that are colored green. Therefore, in the lens L14, green is projected in the lens vertical direction in the section from the point T22 to the point T24. Further, in the section from the point T24 to the point 26 on the dotted line C2, the dotted line C2 passes over the blue subpixel B23. Accordingly, in the lens L14, in the section from the point T24 to the point T26, the blue color is projected and expanded in the lens vertical direction. Similarly, the sub-pixels that are the focal positions of the respective lenses are similarly displayed on each lens in an enlarged manner.

  FIG. 7 is a diagram (a third viewpoint individual viewpoint image) showing an image projected on the lens plate. As shown in FIG. 7, in the section from T10 to T12, the sub-pixels G11 and G12 are projected on the lens plate, and a green image is recognized. Further, in the section from T22 to T24, the sub-pixels G21, G22, and G23 are projected and projected on the lens plate, whereby a green image is recognized. Further, in the section from T32 to T34, the sub-pixels G32 and G33 are spread and projected on the lens plate, whereby a green image is recognized. In this way, when some of the sub-pixels of the same color are connected while being overlapped, diagonal color stripes are generated. That is, by arranging the lens pitch direction of the lens plate at an angle θ, the sub-pixels of the same color constituting different columns of the color filter 20 are visualized by being connected in the image, and are As a result of the pixels being magnified several times, these color fringes exceed the spatial resolution of the human eye and become recognized.

  FIG. 8 is a diagram showing an individual viewpoint video in a wider range than the individual viewpoint video in FIG. 7. In FIG. 8, for example, a dark color stripe (blue subpixel) is projected on a line connecting T1 and T2, and a bright color stripe (green subpixel) is next to the line connecting T3 and T4. It is projected. These color fringes are periodically projected on the entire lens plate 10 and are recognized as diagonal color fringes on the entire image, resulting in a reduction in image quality.

3. Principle of color fringe suppression <Method 1>
Therefore, a method of providing an image in which color stripes are suppressed by the stereoscopic image generation apparatus 100 to which the present invention is applied will be described. As described above, it has been found that color stripes are generated when subpixels of the same color are enlarged and connected in an oblique direction. In view of this, the present inventors have found a method for suppressing color fringes by controlling so that sub-pixels of the same color are not continuously lit in a straight line. This will be described in detail with reference to FIG.

  FIG. 9A is a diagram schematically showing arbitrary three pixels px1 to px3 adjacent to the left and right in the display panel 30, and each pixel px1 to px3 includes three subpixels rn to corresponding to each color of RGB. bn (n is 1 to 3). From each of the three pixels, one of the RGB colors is selected as a specific primary color, a sub-pixel corresponding to the specific primary color (hereinafter referred to as “specific sub-pixel”) is determined, and the luminance value of the specific sub-pixel is determined. Is set to 0 to display a stereoscopic image. That is, as shown in FIG. 9A, the left pixel px1 has red (R) as the specific primary color, the luminance value of the subpixel r1 corresponding to red is set to 0, and the central pixel px2 has green (G ) As a specific primary color, the luminance value of the specific subpixel g2 corresponding to green is set to 0, and the right pixel px3 has blue (B) as the specific primary color and the luminance value of the specific subpixel b3 corresponding to blue is set to 0. Set to. FIG. 9B is a diagram illustrating an example when the change of the luminance value is applied to the entire display panel 30. According to FIG. 9B, when the specific primary color is continuously selected in the sub-scanning direction (vertical direction of the image), the luminance value of the specific sub-pixel belonging to the same column is continuously set to 0 in the column direction. Is set.

  FIG. 10 is a diagram schematically showing images displayed on the lens plate before and after setting the luminance value for the specific subpixel. FIG. 10A shows an individual viewpoint image projected before setting the luminance value, and diagonal color stripes appear from the upper left to the lower right in the entire image. On the other hand, FIG. 10B is an individual viewpoint image that is displayed after setting the luminance value. When the luminance value of a specific subpixel is set to 0 at a constant period, a sequence of subpixels of the same color is generated. It is divided and it becomes difficult to recognize the color stripes.

  As described above, according to the method 1, any one of the RGB colors included in each pixel is periodically set as the specific primary color, and the luminance value for the specific primary color of the entire sub-pixel array corresponding to the specific primary color is set to 0. Then, by displaying the stereoscopic image, it is possible to provide an image in which the color stripes in the oblique direction are suppressed. Further, according to this method, since a calculation load is not applied, processing can be performed at high speed.

<Method 2>
In the method 1 described above, since the stereoscopic image is displayed by setting the luminance value for the specific subpixel among the three subpixels constituting one pixel to 0, the brightness of the entire image is 2/3. In addition, the color information of the stereoscopic image is discarded, so that there is a problem that the resolution is lowered. Therefore, in Method 2, by setting the luminance value for the specific sub-pixel according to the color information of the stereoscopic image that is the original image generated in advance, the color fringes are reduced while suppressing the decrease in brightness and resolution. Let Hereinafter, this will be described in detail with reference to FIG.

  FIG. 11 is a diagram illustrating an example in which the luminance value for a specific subpixel is changed according to the luminance value of the subpixel of the stereoscopic image that is the original image. As shown in FIG. 11A, in method 2, a specific subpixel is determined by the same method as method 1, and a predetermined number (for example, 1/2) is added to the luminance value in the original image of the determined specific subpixel. Is obtained as the luminance value of the specific sub-pixel. That is, the luminance values of the specific subpixel r1 of the pixel px1, the specific subpixel g2 of the pixel px2, and the specific subpixel b3 of the pixel px3 are each changed to ½ of the original image. FIG. 11B is a diagram showing a case where the present invention is applied to the entire display panel 30. As shown in FIG. 11B, in the display panel 30, the specific primary colors are continuously determined in the sub-scanning direction, whereby the luminance value of the specific sub-pixels of the same color continuous in the column direction is changed to ½. Is done.

  As described above, according to Method 2, any one of the RGB colors included in each pixel is periodically set as a specific primary color, and the luminance value is changed by a value obtained by multiplying the specific primary color by a certain reduction rate. To do. Thereby, it is possible to suppress color fringes while suppressing a decrease in the overall brightness and resolution of the image as compared with Method 1. Further, according to this method, the calculation load can be reduced, so that processing can be performed at high speed.

<Method 3>
In the method 2 described above, although the color fringes can be reduced while suppressing the decrease in the brightness and resolution of the entire image as compared with the method 1, the brightness and the resolution are slightly decreased. Therefore, in the method 3, the luminance value of the specific subpixel in the stereoscopic image as the original image is distributed to the subpixels of the same color as the specific primary color among the adjacent pixels, and the change amount of the luminance value is changed to the subpixel of the same color. As a result, the color fringes are reduced without reducing the brightness and suppressing the reduction in resolution. With reference to FIG. 12, a method of changing the luminance value will be described in detail.

  FIG. 12A is a diagram schematically showing arbitrary five pixels px1 to px5 adjacent to the left and right in the display panel 30. FIG. Here, a case will be described in which the luminance value is changed for specific subpixels of the three pixels px2 to px4 arranged in the center. According to FIG. 12A, specific subpixels r2, g3, and b4 are set from the three pixels px2 to px4, respectively, and the luminance values for the specific subpixels r2, g3, and b4 are of the same color belonging to adjacent pixels on the left and right. Distributed to sub-pixels. For example, the luminance value of the specific subpixel r2 of the pixel px2 is distributed to the subpixel r1 of the same color belonging to the pixel px1 adjacent to the left side and the subpixel r3 of the same color belonging to the pixel px3 adjacent to the right side. . Here, the distributed luminance values are distributed in accordance with the ratio of the luminance values of the subpixel r1 and the subpixel r3.

  FIG. 12B is a schematic diagram when only the luminance value for the specific sub-pixel is distributed to adjacent pixels. For example, the luminance value for the specific subpixel r2 is distributed to the subpixels r1 and r3 as Δr1 and Δr3, respectively, and the luminance value for the specific subpixel r2 is changed to zero. Further, by adding the distributed luminance value ((b) in the figure) and the luminance value (c (c)) for each subpixel, the changed luminance value (d (d)) for each subpixel is added. )) Is required.

This will be specifically described. First, the luminance value of the specific subpixel before the luminance value change (original image) is set to s ₀ (n), and the luminance value of the subpixel of the same color among the left adjacent pixels is set to s ₀ (n−1) S ₀ (n + 1) is the luminance value of the same color sub-pixel. Further, if the luminance value of the specific sub-pixel after the luminance value change is s ₁ (n) and the luminance value of the sub-pixel of the same color among the adjacent pixels is s ₁ (n−1) and s ₁ (n + 1), respectively. The difference Δs (n−1), Δs (n + 1) between the luminance values of the sub-pixels before and after the luminance value change is defined by the following equation.
Δs (n−1) = s ₁ (n−1) −s ₀ (n−1) (1)
Δs (n + 1) = s ₁ (n + 1) −s ₀ (n + 1) (2)

Further, since it is assumed that the sum of the luminance values of the sub-pixels of the same color in the three pixels does not change before and after the luminance value change, the following expression is satisfied.
s ₁ (n) + Δs (n−1) + Δs (n + 1) = s ₀ (n) (3)
Furthermore, since it is assumed that the luminance value ratio does not change before and after the luminance value change in the subpixels adjacent to the specific subpixel, the following equation is satisfied.
s ₀ (n−1): s ₀ (n + 1) = s ₁ (n−1): s ₁ (n + 1) (4)
Δs (n−1): Δs (n + 1) = s ₀ (n−1): s ₀ (n + 1) (5)
Then, in order to set the luminance value of the specific subpixel after the luminance value is changed to 0, s ₁ (n) = 0
Is obtained. Substituting this into the above equations (3) and (5) gives the following equation.
Δs (n−1) = s ₀ (n) × s ₀ (n−1) / {s ₀ (n−1) + s ₀ (n + 1)} (6a)
Δs (n + 1) = s ₀ (n) × s ₀ (n + 1) / {s ₀ (n−1) + s ₀ (n + 1)} (6b)

As described above, when the luminance value for the specific subpixel is distributed to the subpixels of the same color of the adjacent pixels, the luminance value s ₀ (n) of the specific subpixel and the luminance values s ₀ ( n−1), s ₀ (n + 1) are obtained, and by substituting these values into the above formulas (6a) and (6b), the value Δs (n−1), Δs (n + 1) is obtained. Then, by adding the obtained values Δs (n−1) and Δs (n + 1) to the luminance values s ₀ (n−1) and s ₀ (n + 1) of the subpixels before the change, the subpixels after the change Luminance values s ₁ (n−1) and s ₁ (n + 1) can be calculated.

A specific example will be described with reference to FIG. As shown in FIG. 13, in three adjacent pixels, R of the pixel px2 is a specific primary color, the luminance value of the specific subpixel r2 is 50%, and the left and right adjacent subpixels r1 (n−1) of the same color ) And r3 (corresponding to n + 1) are 40% and 60%, respectively. Substituting these into the above formulas (6a) and (6b),
Δs (n−1) = 50 × 40 / (40 + 60) = 20%
Δs (n + 1) = 50 × 60 / (40 + 60) = 30%
As shown below, the luminance values of the changed subpixels r1 and r3 are obtained.
s ₁ (n−1) = 40 + 20 = 60%
s ₁ (n + 1) = 60 + 30 = 90%
When the luminance values of the subpixels of the same color in the left and right adjacent pixels are all 0%, the luminance value of the specific subpixel is equally divided and distributed to the left and right subpixels.

In addition, the luminance value of the subpixels adjacent to the left and right may be large, and the luminance value of the changed subpixel may exceed 100%, that is, the luminance value that can be displayed on the display panel 30 may be exceeded. In such a case, the portion exceeding 100% is rounded down and the luminance value is set to 100%. A specific example will be described with reference to FIG. In the three adjacent pixels, when R of the central pixel is a specific primary color, the luminance value of the specific subpixel is 60%, and the luminance values of the right and left adjacent subpixels are 50% and 70%, respectively. Suppose there was. Substituting these into the above formulas (6a) and (6b),
Δs (n−1) = 60 × 50 / (50 + 70) = 25%
Δs (n + 1) = 60 × 70 / (50 + 70) = 35%
Thus, the luminance value of each subpixel after the change is as shown below.
s ₁ (n-1) = 50 + 25 = 75%
s ₁ (n + 1) = 70 + 35 = 105%
In this case, the portion exceeding 100% is rounded down and set to 100%. If it exceeds 100%, the luminance value of the specific subpixel may be multiplied in advance by a certain reduction rate, and the luminance value of the specific subpixel after the decrease may be distributed and changed to adjacent pixels.

  As described above, according to the method 3, when the luminance value of the specific subpixel is distributed to the subpixels of the same color of the adjacent pixels, the luminance value is changed so that the sum of the amount of change of the luminance value does not fluctuate. Therefore, color fringes can be reduced without reducing the overall brightness or resolution of the video. Further, when the luminance value of the specific subpixel is distributed, the luminance value of the specific subpixel is distributed in accordance with the ratio of the luminance values of the two subpixels that are the distribution destinations. Can be held. Thereby, deterioration of image quality can be reduced.

<Display example>
FIGS. 15 to 17 show an example of an image displayed on the lens plate when a stereoscopic image is displayed on the display panel 30 by the method described above. FIG. 15A is a diagram illustrating an image before the luminance value is changed for comparison, and FIG. 15B is a diagram illustrating an image in which the luminance value is changed by the method 1. As shown in FIG. 15A, in the video before the luminance value is changed, the color stripes are generated in an oblique straight line from the upper left to the lower right. On the other hand, as shown in FIG. 15B, the video after changing the luminance value is a video in which the influence of the color stripes is reduced.

  FIG. 16A is a diagram illustrating an image before the luminance value is changed for comparison, and FIG. 16B is a diagram illustrating an image in which the luminance value is changed by the method 2. As shown in FIG. 16B, the image after the luminance value is changed is an image in which the influence of the color fringes is reduced as compared with FIG. Further, when compared with the image shown in FIG. 15B, that is, when compared with the method 1, it is understood that the luminance is improved and the image is brighter.

  FIG. 17A is a diagram illustrating an image before the luminance value is changed for comparison, and FIG. 17B is a diagram illustrating an image in which the luminance value is changed by the method 3. As shown in FIG. 17B, the image after the luminance value is changed is an image in which the influence of the color stripes is reduced compared to FIG. Further, when compared with the images shown in FIGS. 15B and 16B, that is, when compared with the methods 1 and 2, the overall luminance is improved, and the image is bright. Recognize.

[Function configuration]
Next, a functional configuration of the stereoscopic image generation apparatus according to the present embodiment will be described. FIG. 18 is a block diagram illustrating an example of an internal configuration of the stereoscopic image generation apparatus 100. According to FIG. 18, the stereoscopic image generation device 100 includes an input unit 200, a processing unit 300, and a storage unit 400, and executes a stereoscopic image generation process to generate a stereoscopic image, The generated stereoscopic image is displayed on the stereoscopic image display device 500.

  The input unit 200 is for inputting various operations, and an operation signal input from the input unit 200 is output to the processing unit 300.

  The processing unit 300 performs various processes such as control of the entire stereoscopic image generation device, instructions to each functional unit in the image generation device, image processing, sound processing, and the like based on programs and data stored in the storage unit 400. I do. The function of this processing unit is realized by hardware such as various processors (CPU, DSP, etc.), ASIC (gate array, etc.), and a given program. The processing unit 300 includes a game calculation unit 310 and an image generation unit 320 as main functional units.

  The game calculation unit 310 executes various game processes for realizing various games based on an operation signal input from the input unit 200, a game program read from the storage unit 400, and the like. The game processing includes, for example, processing for setting a game space by arranging virtual cameras and objects in a three-dimensional virtual space, object motion control based on an input signal input from the input unit 200, calculation of a game result, and the like.

  The image generation unit 320 performs processing for generating an image viewed from the viewpoint of the virtual camera in the game space set by the game calculation unit 310. The image generated at this time is a frame image every 1/60 seconds (that is, every field unit in the NTSC system). The image generation unit 320 includes a stereoscopic image generation unit 321 and a luminance value setting processing unit 322 as main functional units. The stereoscopic image generation unit 321 performs stereoscopic viewing according to the stereoscopic image generation processing program 411. The image generation process is executed to generate stereoscopic image data as an original image, and this is stored in the storage unit 400 as stereoscopic image data 421. Further, the luminance value setting processing unit 322 executes display image generation processing and luminance value setting processing on the stereoscopic image data 421 serving as the original image according to the display image generation processing program 412 and the luminance value setting processing program 413, Display image data in which the luminance value is changed by setting the luminance value of the subpixel is generated, and this is stored in the storage unit 400 as display image data 422.

  In the storage unit 400, a system program for realizing various functions for controlling the stereoscopic image generation apparatus 100 in an integrated manner, a game program for executing game processing, and a program necessary for executing image generation processing And the generated image data and the like are stored. The storage unit 400 is realized by an information storage medium such as various IC memories, a hard disk, a CD-ROM, an MO, and a DVD.

  Specifically, the storage unit 400 includes various programs 410 such as a stereoscopic image generation processing program 411, a display image generation processing program 412, and a luminance value setting processing program 413, stereoscopic image data 421, display image data 422, and a specific primary color. Various data 420 such as definition data 423 and object data 424 is stored.

  The stereoscopic image generation processing program 411, the display image generation processing program 412, and the luminance value setting processing program 413 are programs for causing the image generation unit 320 to function as the stereoscopic image generation unit 321 and the luminance value setting processing unit 322, respectively. . The brightness value setting process program 413 includes programs corresponding to the brightness value setting processes 1 to 3, respectively.

  The stereoscopic image data 421 is an image in which a game image at the viewpoint of the virtual camera is generated as a stereoscopic image in the game space by the stereoscopic image generation unit 321, and each subpixel of the display panel 30 and each lens of the lens plate. Based on the positional relationship, the individual viewpoint images for each directivity direction are synthesized in sub-pixel units. The stereoscopic image data 421 is image data that is an original image of the display image data 422.

  The display image data 422 is image data generated by changing the brightness value of the stereoscopic image data 421 by executing the display image generation process in the brightness value setting processing unit 322.

  The specific primary color definition data 423 is data that defines a correspondence relationship between a specific primary color that specifies a different primary color periodically and a pixel of the stereoscopic image data 421. With reference to FIG. 19A, a data configuration example of the specific primary color definition data 423 will be described. As shown in FIG. 19A, the specific primary color definition data 423 stores the relative positions (for example, px1, px2,...) Of the pixels in the stereoscopic image data 421 and the specific primary colors in association with each other. .

  Specifically, in the pattern 1 defined in the uppermost row, the specific primary colors are in the order of RGB corresponding to the relative positions where pixels in one line of the stereoscopic image data 421 are defined as px1, px2,. It is defined periodically. That is, in one line of the stereoscopic image data 421, the specific primary color of the leftmost pixel px1 is R, the specific primary color of the second pixel px2 from the left end is G, and the specific primary color of the third pixel px3 from the left end is B. A plurality of patterns are defined in the specific primary color definition data 423, and various patterns are alternatively applied according to the stereoscopic image data 421. Alternatively, different patterns may be applied depending on each line of the stereoscopic image data 421.

  Depending on the pattern to be defined, there may not be a specific primary color in a certain pixel, and two or more specific primary colors may be defined. For example, in the case of the pattern shown in FIG. 20A, the specific primary color of px1 is R, the specific primary color of px2 is G, and the specific primary color of px3 is B, but the specific primary color of px4 does not exist. 20B, the specific primary colors px1 are R and B, the specific primary colors px2 are G, the specific primary colors px3 are R and B, and the specific primary colors px4 are G. . In order to reproduce such a pattern, in place of the specific primary color definition data 423, table data 4231 indicating whether or not specific processing is performed in units of subpixels as shown in FIG. 19B is prepared. The processing may be performed while referring to the table data 4231.

  For example, as shown in FIG. 19B, in the table data 4231, the relative position (for example, sx1, sx2,...) Of the subpixel in the stereoscopic image data 421 and whether the subpixel is subjected to specific processing. Information indicating whether or not (for example, ON, OFF) is stored in association with each other. Specifically, when the pattern 1 defined at the top is applied to the stereoscopic image data 421, the leftmost subpixel sx1 is subjected to specific processing, and the second subpixel sx2 from the leftmost is subjected to specific processing. Is not performed, and the specific processing is not performed on the third subpixel sx3 from the left end.

  Returning to FIG. 18, the object data 424 is data related to each object placed in the game space by the game calculation unit 310. In addition to modeling data and color information for defining the object, data related to the light source, virtual camera, and the like. including.

  The stereoscopic image display device 500 is a stereoscopic display provided with a lenticular lens formed of a liquid crystal display device or the like. The observer views the stereoscopic image displayed on the display unit through the lenticular lens as a stereoscopic video.

[Process flow]
The flow of processing in this embodiment will be described.
FIG. 21 is a flowchart for explaining the display image generation process in the present embodiment. First, the display image generation process will be described with reference to FIG. The display image generation process is a process realized by the luminance value setting processing unit 322 reading and executing the display image generation processing program 412 in the storage unit 400. In executing the display image generation process, the luminance value setting processing unit 321 allows the user to input stereoscopic image data 422 that is an original image for generating display image data (step A1), and a method of changing the luminance value (For example, the above methods 1 to 3) are selected (step A2).

  Next, the head line of the input stereoscopic image data 422 is designated as a readout line (step A3), and luminance value setting processes 1 to 3 are executed according to the selected luminance value changing method (steps A4 to A6). ). Details of the luminance value setting processes 1 to 3 will be described later. When the luminance value setting processes 1 to 3 are executed, it is determined whether or not the next line is present in the stereoscopic image data 422 (step A7). If there is a next line (step A7; YES), the next line is determined. The line is designated as a readout line (step A8), and the luminance value setting processes 1 to 3 are repeated. On the other hand, when there is no next line in the stereoscopic image data 422 (step A; NO), that is, when the luminance value setting process is performed for all the lines of the stereoscopic image data 422, the display image generation process ends.

  FIG. 22 is a flowchart for explaining the brightness value setting process 1 executed when the method 1 is selected in step A2 of FIG. The luminance value setting process 1 is realized by the luminance value setting processing unit 322 reading out and executing the luminance value setting processing program 412 in the storage unit 400, and is repeated for each line of one frame image as a processing unit. Executed. That is, the stereoscopic image data 421 is read for each line and the luminance value setting process 1 is repeatedly executed to generate one frame of display image data 422. Here, the luminance value setting process 1 is a process for setting the luminance value by the method 1 described above. In the following, “1 pixel” in the display panel 30 is set to “1 pixel” in the stereoscopic image data 421, and image data for one pixel (the luminance value of each sub-pixel constituting the pixel) is referred to as “pixel data”. ".

  In executing the luminance value setting process 1, the luminance value setting processing unit 321 reads image data for one line from the stereoscopic image data 421 (step S1), and acquires pixel data for one pixel from the read one line. (Step S2). Next, the specific primary color definition data 423 stored in the storage unit 400 is acquired, and the specific primary color is determined based on the specific primary color definition data 423 and the relative position of the read pixel (pixel data) in the stereoscopic image data 421. Determine (step S3).

  Subsequently, the luminance value of the specific subpixel corresponding to the specific primary color is set to 0 (step S4). Then, it is determined whether or not there is a next adjacent pixel in the image data for one line read from the stereoscopic image data 421 (step S5), and if there is a next adjacent pixel (step S5; YES). Then, the process proceeds to step S2, and the above-described process is repeatedly executed. On the other hand, when there is no next adjacent pixel (step S5; NO), that is, when the luminance value of the specific subpixel is changed for all the pixels in the line for one line of the stereoscopic image data 421, this The brightness value setting process 1 ends.

  FIG. 23 is a flowchart for explaining the luminance value setting process 2 in the present embodiment. The brightness value setting process 2 is realized by the brightness value setting processing unit 322 reading and executing the brightness value setting processing program 412 in the storage unit 400 when the method 2 is selected in step A2 of FIG. It is a process and is repeatedly executed for each line of one frame image as a processing unit. That is, the stereoscopic image data 421 is read for each line and the luminance value setting process 2 is repeatedly executed to generate one frame of display image data 422. Here, the luminance value setting process 2 is a process for realizing the method 2 described above.

  In the luminance value setting process 2, the luminance value setting processing unit 321 reads out image data for one line from the stereoscopic image data 421 (step S11), and acquires pixel data for one pixel (step S12). Next, the specific primary color definition data 423 stored in the storage unit 400 is acquired, and the specific primary color is determined based on the specific primary color definition data 423 and the relative position of the read pixel (pixel data) in the stereoscopic image data 421. Determine (step S13).

  Subsequently, the luminance value of the specific subpixel corresponding to the specific primary color is acquired (step S14), and the value obtained by multiplying the luminance value of the specific subpixel by 1/2 is set as the luminance value of the specific subpixel. (Step S15). Then, in the stereoscopic image data 421, it is determined whether or not there is a next adjacent pixel (step S16). If there is a next adjacent pixel (step S16; YES), the process proceeds to step S2 and described above. Repeat the above process. On the other hand, when there is no next adjacent pixel (step S16; NO), that is, when the luminance value is changed for all pixels in the line for one line of the stereoscopic image data 421, this luminance value setting process 2 is finished.

  FIG. 24 is a flowchart for explaining the luminance value setting process 3 in the present embodiment. The luminance value setting process 3 is realized by the luminance value setting processing unit 322 reading out and executing the luminance value setting processing program 412 in the storage unit 400 when the method 3 is selected in step A2 of FIG. It is a process and is repeatedly executed for each line of one frame image as a processing unit. That is, the stereoscopic image data 421 is read for each line and the luminance value setting process 3 is repeatedly executed, thereby generating one frame of display image data 422. Here, the luminance value setting process 3 corresponds to the process of the method 3 described above.

  In the luminance value setting process 3, the luminance value setting processing unit 321 reads out image data for one line from the stereoscopic image data 421 (step S21), and acquires pixel data for three consecutive pixels (step S22). Next, the specific primary color definition data 423 stored in the storage unit 400 is acquired, and the central pixel of the three pixels is determined based on the specific primary color definition data 423 and the relative position of the read pixel in the stereoscopic image data. A specific primary color is determined (step S23).

  Subsequently, the luminance value of the specific subpixel is acquired from the central pixel (step S24), and the luminance value of the subpixel having the same color as the specific primary color is acquired from the pixels adjacent to the left and right (step S25). Furthermore, the luminance value setting processing unit 322 changes the subpixels of the same color based on the luminance values of the specific subpixels, the luminance values of the subpixels of the same color, and the above formulas (6a) and (6b). A luminance value is calculated (step S26). Then, the luminance value of the subpixel of the same color is set to the calculated value, and the luminance value of the specific subpixel is set to 0 (step S27).

  Next, in the stereoscopic image data 421, it is determined whether or not there is the next three adjacent pixels shifted by one pixel from the three pixels to be processed (step S28). S28; YES), the process proceeds to step S22, and the above-described processing is repeated. On the other hand, when there is no next three adjacent pixels (step S28; NO), that is, when the luminance value is changed for all pixels in the line for one line of the stereoscopic image data 421, this luminance value setting is performed. Processing 3 ends.

[Hardware configuration]
Next, an example of a hardware configuration for realizing the stereoscopic image generation apparatus 100 in the present embodiment will be described with reference to FIG. In an electronic device 601 shown in FIG. 25, a CPU 600, a RAM 610, a ROM 620, an information storage medium 630, an input device 640, and an image generation IC 650 are connected to each other via a system bus 670 so as to be able to input and output data. In addition, the stereoscopic image display device 500 is connected to the image generation IC 650.

  The CPU 600 controls the entire apparatus and performs various data processing according to a program stored in the information storage medium 630, a system program stored in the ROM 620 (initialization information of the apparatus main body, etc.), a signal input by the input apparatus 640, and the like. Do.

  The RAM 610 is a storage unit used as a work area of the CPU 600, and stores a given content in the ROM 620 and the information storage medium 630, a calculation result of the CPU 600, and the like. Further, the RAM 610 stores image information created by the CPU 600, a frame buffer for storing stereoscopic image data 421 for one frame generated by the image generation IC 650, and display image data 422 for one field. A field buffer is provided. The ROM 620 stores information necessary for controlling the activation and operation of the electronic device 601.

  The information storage medium 630 mainly stores programs, image data, sound data, play data, and the like. This information storage medium 630 constitutes a part of the storage unit 400 shown in FIG. When what implements the present embodiment is a computer system, the information storage medium 630 is a CD-ROM, DVD, hard disk, or the like as an information storage medium for storing the brightness value setting processing program 412 or the like.

  The input device 640 is a device for inputting various operations, and the function is realized by hardware such as a lever, a button, and a housing. The control device 1022 corresponds to the input unit 200 shown in FIG.

  The image generation IC 650 is an integrated circuit that generates pixel information based on information sent from the ROM 620, the RAM 610, the information storage medium 630, and the like according to instructions from the CPU 600. The generated display signal is connected to the electronic device 601. The image is output to the stereoscopic image display device 500. The stereoscopic image display device 500 is realized by a CRT, LCD, ELD, PDP, HMD, or the like, and corresponds to the stereoscopic image display device 500 shown in FIG.

[Modification]
The preferred embodiments of the present invention have been described above, but the present invention is not limited to those described above, and can be changed as appropriate without departing from the spirit of the invention. Hereinafter, modified examples will be described.

1. Method of changing luminance value [1-1. Method 1a]
A modification of Method 1 will be described.
In the method 1 described above, when the specific primary color is determined from each of the three adjacent pixels, the specific primary color is determined according to the order of RGB. However, the specific primary color determination order is not limited to this. Can be determined in any order. FIG. 26 is a diagram illustrating an example when the specific primary colors are determined in a different order from the method 1. According to FIG. 26, specific primary colors are specified periodically in the order of BGR from arbitrary three pixels px1 to px3 adjacent to the left and right in the display panel 30, and the luminance value of the specific subpixel corresponding to the specific primary color is set to 0. To do. FIG. 26B is a diagram illustrating an example when the change of the luminance value is applied to the entire display panel 30. According to FIG. 26B, the specific primary color is continuously selected in the sub-scanning direction, whereby the luminance value of the specific sub-pixel is continuously changed to 0 in the column direction.

  FIG. 27 is a diagram schematically showing images displayed on the lens plate before and after the luminance value is changed. FIG. 27A shows an individual viewpoint image projected before the luminance value is changed, and diagonal color stripes appear in the entire image from the upper left toward the lower right. On the other hand, FIG. 27B is an individual viewpoint video that is displayed after the luminance value is changed. According to FIG. 27B, when the luminance value of the sub-pixel is changed to 0 at a constant period, the series of sub-pixels of the same color is divided, and the striped pattern is difficult to recognize.

  Here, the specific primary color and the specific subpixel are determined by the correspondence relationship between the specific primary color set in the specific primary color definition data 423 described above and the subpixel of the stereoscopic image data 421. By doing so, the order of specific primary colors specified periodically can be changed. The specific primary color definition data 423 displays a setting screen that can be arbitrarily selected and set by the user in addition to the optimum specific primary color pattern being set by default, and the specific primary color set on this setting screen is displayed. The luminance value setting processes 1 to 3 may be performed according to the order.

  Thereby, suppression of color fringes can be realized by changing the luminance value by a suitable method according to the properties of the stereoscopic image data (for example, luminance, contrast, resolution, etc.).

[1-2. Method 1b]
Next, another modification of the method 1 will be described. In the method 1 described above, when a specific primary color is determined from each of adjacent three pixels, the specific primary color is determined in the order of RGB, and the luminance value of the specific subpixel corresponding to the specific primary color of the same color is sub-scanned. Although the case where the value is continuously 0 in the direction, that is, the column direction has been described as an example, the luminance value may be changed by a method in which the specific primary color is not continued in the column direction. For example, as shown in FIG. 28, the specific primary colors in the first column are periodically determined in the order of RGB, the specific primary colors in the second column are periodically determined in the order of BRG, and the specific primary colors in the third column are in the order of GBR. Determine periodically. In other words, the luminance value of the specific subpixel corresponding to the specific primary color may be changed by shifting the RGB order by one pixel for each row.

[1-3. Method 1c]
Furthermore, another modification of the method 1 will be described. In Method 1 described above, suppression of color fringes is realized by changing the luminance value of a specific subpixel to 0. However, the luminance value is not limited to 0, and may be a certain luminance value. For example, FIG. 29 shows an example in which the luminance value of a specific subpixel is changed to a constant luminance value. FIG. 29A is an example in which the luminance value of the specific sub-pixel is changed to 0%, and FIG. 29B is an example in which the luminance value of the specific sub-pixel is changed to 50%. ) Is an example in which the luminance value of the specific sub-pixel is changed to 100%.

  According to the method 1c, since the luminance value of the specific sub-pixel is held at a certain ratio, it is possible to reduce color fringes while suppressing a decrease in the brightness of the entire video. In addition to the optimal brightness value set by default as a constant brightness value, a setting screen that can be arbitrarily selected and set by the user is displayed, and the brightness value is set according to the brightness value set on this setting screen. Processing 1 is performed.

  Further, as a method for realizing the methods 1, 1a to 1c, the luminance value may be changed in a software manner by changing the luminance value of the sub-pixel as described above. About 1a and 1b, you may implement | achieve in hardware by making the part corresponding to the specific subpixel of the color filter provided in the display panel 30 opaque. According to this method, since it is possible to reduce color fringes without applying any calculation load to the processing unit 300, high-speed processing can be realized.

[1-4. Method 2a]
A modification of Method 2 will be described. In the method 2 described above, the case where the luminance value is changed by setting the luminance value of the specific sub-pixel to a value obtained by multiplying by 1/2 as a constant reduction rate has been described as an example. Of course, the value is not limited to ½. Therefore, the luminance value of the specific subpixel can be changed to a low value by multiplying the luminance value of the specific subpixel by a value less than 1, and the luminance value of the specific subpixel can be multiplied by a value of 1 or more. You may change the luminance value of a pixel highly. Also, in the methods 2 and 2a, the luminance value may be changed by software, but by setting a portion corresponding to a specific subpixel of the color filter provided in the display panel 30 to a predetermined transmittance, It may be realized in hardware.

[1-5. Method 3a]
A modification of Method 3 will be described. In Method 3 described above, the luminance value of the specific subpixel is distributed to the subpixels of the same color as the specific primary color among the adjacent pixels on the left and right, and the luminance value for the changed subpixel exceeds 100%. Although the case where the value is set to be 100% has been described as an example, the above example is an example, and the luminance value of the specific sub-pixel can be distributed by various other methods. For example, when there is a subpixel whose luminance value after change exceeds 100%, the luminance value to be distributed may be corrected based on the luminance value of the subpixel. This will be specifically described.

(1) When s ₁ (n−1) ≧ s ₁ (n + 1) When s ₁ (n−1) is 100%, the following equation (7a) is obtained.
Δs (n−1) = 100−s ₀ (n−1) (7a)
From equation (5) above,
Δs (n + 1) = Δs (n−1) × s ₀ (n + 1) / s ₀ (n−1) (8a)
From equations (3) and (7a) above,
s ₁ (n) = s ₀ (n) −Δs (n−1) −Δs (n + 1) (9a)
Is obtained.
Then, by adding the obtained luminance value differences Δs (n−1) and Δs (n + 1) to the luminance values s ₀ (n−1) and s ₀ (n + 1) before the change, the luminance value after the change is obtained. s ₁ (n−1) and s ₁ (n + 1) are obtained.

(2) When s ₁ (n−1) ≦ s ₁ (n + 1) When s ₁ (n + 1) is 100%, the following equation (7b) is obtained.
Δs (n + 1) = 100−s ₀ (n + 1) (7b)
From equation (5) above,
Δs (n−1) = Δs (n + 1) × s ₀ (n−1) / s ₀ (n + 1) (8b)
From equations (3) and (7b) above,
s ₁ (n) = s ₀ (n) −Δs (n−1) −Δs (n + 1) (9b)
Is obtained.
Then, by adding the obtained differences Δs (n + 1) and Δs (n−1) to the luminance values s ₀ (n + 1) and s ₀ (n−1) before the change, the luminance value s after the change is obtained. ₁ (n + 1), s ₁ (n-1) are obtained.

Accordingly, when the luminance value of the specific subpixel is distributed to the subpixels of the same color as the specific primary color among the adjacent pixels, the luminance value of the specific subpixel is determined when the luminance value for the subpixel does not exceed 100%. When s ₁ (n) and luminance values s ₁ (n−1) and s ₁ (n + 1) of the same color are obtained and one of the luminance values exceeds 100%, the luminance value s of the specific subpixel before the change ₀ (n) and the luminance values s ₀ (n−1), s ₀ (n + 1) of the sub-pixels of the same color and the above-described equations (7) to (9), The luminance value s ₁ (n) and the luminance values s ₁ (n−1) and s ₁ (n + 1) of the subpixels of the same color can be calculated.

A specific description will be given with reference to FIG. As shown in FIG. 30, in the adjacent three pixels, when R of the pixel px2 is a specific primary color, the luminance value in the original image of the specific subpixel r2 is 60%, and the specific primary color among the left and right adjacent pixels The luminance values in the original image of sub-pixels r1 (corresponding to n-1) and r3 (corresponding to n + 1) of the same color are 70% and 50%, respectively. Substituting these into the above formulas (6a) and (6b),
Δs (n−1) = 60 × 70 / (50 + 70) = 35%
Δs (n + 1) = 60 × 50 / (50 + 70) = 25%
Thus, the luminance value after the change is as shown below, and one exceeds 100%.
s ₁ (n−1) = 70 + 35 = 105%
s ₁ (n + 1) = 50 + 25 = 75%

Here, since s ₁ (n−1) ≧ s ₁ (n + 1), assuming that s ₁ (n−1) is 100%, from the above equation (7a),
Δs (n−1) = 100−70% = 30% (corresponding to Δr1 in the figure)
From the above formula (8a),
Δs (n + 1) = 30 × 50/70 = 21% (corresponding to Δr3 in the figure)
Furthermore, from the above equation (9a)
s ₁ (n) = 60-30-21 = 9% (corresponding to r ₁ 2 in the figure)
Then, Δs (n−1) and Δs (n + 1) are added to the original luminance values s ₀ (n−1) and s ₀ (n + 1) to obtain the changed luminance value.
s ₁ (n−1) = 70 + 30 = 100% (corresponding to r1 + Δr1 in the figure)
s ₁ (n + 1) = 50 + 21 = 71% (corresponding to r3 + Δr3 in the figure)

  As described above, when the luminance value after the change for the sub-pixel exceeds 100%, the luminance value of the sub-pixel having the maximum luminance value is set to be 100%, and the specific primary color among the adjacent pixels is set. The luminance value of the specific subpixel is distributed according to the ratio of the pixel values of the subpixels of the same color. The remaining luminance values that could not be distributed to the left and right subpixels are held as the luminance values of the specific subpixels. As a result, the sum of the amount of change in the brightness value does not change in the entire image, so the brightness of the entire image is not lost, and the ratio of the brightness values after the change of the left and right subpixels is the same ratio as before the change. can do. Therefore, it is possible to reduce color fringes while suppressing a decrease in brightness and resolution.

2. Lens Plate In the present embodiment, the stereoscopic image display device 500 using the lenticular lens arranged obliquely has been described. However, the optical means is not limited to this, and for example, a microscopic aiming at the same effect as the oblique arrangement is provided. A stair lenticular lens in which lens groups are arranged in a staircase, or an optically equivalent parallax barrier or stair parallax barrier may be used. Hereinafter, each case will be described with reference to the drawings.

[2-1. Stair lenticular lens]
First, the case where it comprises a staircase lenticular lens is demonstrated. Here, the stair lenticular lens is a column direction (vertical scanning) in which micro lens groups having a lens pitch direction connected in parallel to the row direction (horizontal scanning direction) of the display panel 30 are shifted by a predetermined amount in the horizontal scanning direction. It means a lenticular lens arranged in the direction). As described above, the unit lenses are arranged in a staircase pattern, so that the microlens group is obliquely formed with respect to the display panel 30 in which the subpixels are arranged in a grid pattern and the color filter 20 in which the respective primary colors are arranged in a stripe pattern. It becomes optically equivalent to the above-mentioned oblique lenticular lens.

  FIG. 31 is a diagram showing an example of a state when the staircase lenticular lens 12 is arranged on the display panel. As shown in FIG. 31, in the stair lenticular lens 12, the microlens group connected in the row direction is shifted in the row direction by a ratio of 1/5 of the lens width (the length obtained by dividing the lens width by the number of viewpoints). The lenticular lenses are sequentially arranged in the row direction. Here, in the staircase lenticular lens 12 shown in this figure, one microlens group corresponds to one row of pixels, but is not limited to this, and the microlens group includes a plurality of rows (for example, 2 rows). Of course, the length in the column direction of the micro lens group may be set to the length in the column direction of a plurality of pixels.

  A dotted line portion in FIG. 31 indicates a focus line of each microlens. In the stereoscopic video display device, the color at the position of the focus line of each microlens is enlarged and displayed on the entire lens surface. FIG. 32 is an image of an individual viewpoint image projected on the stair lenticular lens. When paying attention to the dotted line shown in FIG. 31, the same color is arranged from the upper left to the lower right, so that color stripes are generated in an oblique direction.

  Even in the case where color stripes in the oblique direction occur in the image displayed on the stereoscopic image display device 500 using such a stair lenticular lens, the luminance value of the specific subpixel is set according to the various methods described above. By changing, it is possible to suppress the color stripes of the visually recognized video.

[2-2. Parallax barrier]
Next, a case where a parallax barrier is used will be described. As for the parallax barrier, the configuration of the parallax barrier itself is a known one, and a detailed description thereof is omitted. However, as a constituent member of the parallax barrier, there is a liquid crystal panel, for example. Specifically, one liquid crystal panel constitutes a display panel together with a color filter, and the other liquid crystal panel constitutes a barrier panel without being provided with a color filter. Here, the case where the present invention is applied to an oblique parallax barrier and a staircase parallax barrier will be described as an example.

[2-2-1. Diagonal parallax barrier]
First, a case where the parallax barrier is disposed obliquely will be described. FIG. 33 shows a state in which the parallax barrier is disposed at a position away from the display panel by a predetermined distance and the barrier opening is positioned obliquely with respect to the column direction (vertical scanning direction) of the display panel. FIG. In practice, the parallax barrier is disposed on one surface of the display panel, but for convenience of explanation, one parallax barrier (hereinafter referred to as “unit barrier”) P10 for one barrier opening (P12). Only shows. That is, the unit barrier P10 is connected in the row direction (horizontal direction) to constitute the entire barrier.

  FIG. 34 is an image of the individual viewpoint video displayed on the oblique parallax barrier. A black portion in FIG. 34 is a light shielding barrier portion that is shielded by the unit barrier P10. Paying attention to the dotted line shown in the figure, the same color is arranged from the upper left to the lower right, so that color stripes are generated in an oblique direction.

  Even in the case where color stripes in the oblique direction occur in the image displayed on the stereoscopic image display device 500 in which such a parallax barrier is disposed obliquely, the luminance value of the specific subpixel is determined according to the various methods described above. By changing, it is possible to suppress color stripes in the visually recognized video.

[2-1-2. Stair parallax barrier]
Next, a case where a staircase parallax barrier is used will be described. FIG. 35 shows a step parameter in which the barrier openings P12b of the unit barriers are parallel to the column direction of the display panel, and barrier groups connected in the row direction are shifted by a predetermined amount in the row direction and arranged in the column direction. It is the schematic which shows the lux unit barrier P10b. FIG. 35 is a schematic diagram illustrating a state where the display panel is disposed at a predetermined distance from the display panel, and is a diagram illustrating only three unit barriers adjacent in the column direction for convenience of explanation. In the staircase parallax barrier shown in the figure, one barrier group corresponds to one row of pixels. However, the present invention is not limited to this, and the barrier group includes a plurality of rows (for example, two rows, three rows). Of course, the length of the barrier group in the column direction may be set to the length of the plurality of pixels in the column direction.

  FIG. 36 is an image of the individual viewpoint video projected on the staircase parallax barrier. When paying attention to the dotted line shown in FIG. 36, the same color is arranged from the upper left to the lower right, so that color stripes are generated in an oblique direction.

  Even when diagonal stripes occur in the video displayed on the stereoscopic image display device 500 in which such parallax barriers are arranged in a staircase pattern, depending on the various methods described above, By changing the luminance value, it is possible to suppress the color stripes of the visually recognized image.

  Note that the parallax barrier has a smaller light emitting area that is visible when compared to the lenticular lens, and thus the generated color stripes are less noticeable than the lenticular lens. However, since the brightness of the entire screen, that is, the video of one viewpoint (individual viewpoint) becomes dark, a method of increasing the brightness of the backlight is used to bring the brightness of the entire screen closer to the original state. There are many cases. In this case, the light that has passed through the parallax barrier appears to spread to the surroundings due to the wraparound characteristic, and as a result, the color stripes also become conspicuous.

3. Multi-eye system The above-described stereoscopic image display apparatus 500 has been described using a configuration including the five-lens lenticular lens (and the corresponding stair lenticular lens, parallax barrier, and stair parallax barrier) shown in FIG. Of course, the lenticular lens or the like is not limited to a five-lens type.

  For example, FIG. 37 is a plan view when a seven-lens lenticular lens is disposed on the display panel 30. The numbers in each pixel indicate viewpoint numbers. Here, the width of one microlens of the lens plate parallel to the row direction of the subpixel with respect to the pixel width of one pixel is Lp, and Lp = (7/6) p.

  FIG. 38 is a diagram schematically showing images displayed on the lens plate before and after setting the luminance value for the specific subpixel when the seven-lens lenticular lens shown in FIG. 37 is used. FIG. 38A shows an individual viewpoint image that is projected before setting the luminance value, and diagonal color stripes appear in the entire image from the upper left to the lower right. On the other hand, FIG. 38B is an individual viewpoint image that is displayed after the luminance value is set by the method 1 described above. According to FIG. 38B, by setting the luminance value of the specific subpixel to 0 at a constant period, a series of subpixels of the same color is divided, and it is difficult to recognize the color stripes. Thus, even when a seven-lens lenticular lens is used, the effect of improving the image quality can be exhibited.

4). Stereoscopic Image Display Device In the above-described embodiment, the stereoscopic image generation device 100 executes the luminance value setting processes 1 to 3 to change the luminance value of the stereoscopic image data 421 and display image data 422. However, the present invention is not limited to this. For example, by providing a display control device in the stereoscopic image display device 500, the above-described luminance value setting processing programs 1 to 3 are provided. It may be configured to execute and realize the present invention.

  FIG. 39 is a diagram illustrating a main configuration of the stereoscopic image display apparatus 500. According to FIG. 39, the stereoscopic image display device 500 includes a display panel 510 and a display control device 520, and the display control device 520 includes a processing unit 521 and a storage unit 522. In addition, the storage unit 522 stores a luminance value setting processing program 522a and specific primary color definition data 522b. The brightness value setting processing program 522a and the specific primary color definition data 522b are the same as the program and data stored in the storage unit 400 described above.

  Specifically, the processing unit 521 acquires the stereoscopic image data 421 read from the stereoscopic image generation device 100 and reads any one of the brightness value setting processing programs 1 to 3 from the storage unit 522. Then, any one of the luminance value setting processes 1 to 3 is executed to generate display image data 422. Then, the generated display image data is output to the display panel 510. The display panel 510 drives the subpixels corresponding to each color based on the display image data to display a stereoscopic image.

  Thereby, since the stereoscopic image display apparatus 500 can execute the brightness value setting processes 1 to 3, the processing load of the stereoscopic image generation apparatus 100 can be reduced and the processing speed can be improved.

FIG. 3 is a vertical sectional view with respect to the display surface of the binocular stereoscopic image display device. The figure for demonstrating the difference between the position which looks at a lens board, and the visible sub pixel. The figure for demonstrating a color filter. The top view when a lens board is arrange | positioned above a display panel. The figure for demonstrating the sub pixel projected on a lens by the position of a viewpoint. The top view when a lens board is arrange | positioned above a display panel. The figure for demonstrating an individual viewpoint image | video. The figure which imaged the individual viewpoint image | video in the case of using a color filter. (a) The figure explaining the example which changes the luminance value of a specific subpixel by the method 1, (b) The figure which shows the example which applied the change of the luminance value of the specific subpixel by the method 1 to the whole display panel. The figure explaining the individual viewpoint image | video at the time of changing a luminance value by the method 1. FIG. (A) The figure explaining the example which changes the luminance value of a specific subpixel by the method 2, (b) The figure which shows the example which applied the change of the luminance value of the specific subpixel by the method 2 to the whole display panel. FIG. 10 is a diagram for explaining an example in which the luminance value of a specific subpixel is changed by Method 3. FIG. 6 is a diagram for explaining a specific example in which the luminance value of a specific subpixel is changed by Method 3. The figure explaining the modification of the method 3. FIG. (A) The figure which shows the image | video before changing a luminance value, (b) The figure which shows the image | video which changed the luminance value by the method 1. FIG. (A) The figure which shows the image | video before changing a luminance value, (b) The figure which shows the image | video which changed the luminance value by the method 2. FIG. (A) The figure which shows the image | video before changing a luminance value (b) The figure which shows the image | video which changed the luminance value by the method 3. The figure which shows an example of the functional block of the stereoscopic vision image generation apparatus in this Embodiment. (A) The figure which shows the data structural example of specific primary color definition data 423, (b) The figure which shows the data structural example of the table data 4231 which defined the sub pixel in which a specific process is performed. (A) The figure which shows the example of a pattern of the sub pixel in which a specific process is performed, (b) The figure which shows the example of a pattern of the sub pixel in which a specific process is performed. The flowchart which shows a display image generation process. The flowchart which shows the luminance value setting process 1. FIG. The flowchart which shows the luminance value setting process 2. FIG. 10 is a flowchart showing luminance value setting processing 3; The figure which shows an example of the structure of the hardware which can implement | achieve this Embodiment. The figure explaining the example which changes the luminance value of a specific subpixel by the method 1a which is a modification of the method 1. FIG. The figure explaining the individual viewpoint image | video at the time of changing a luminance value by the method 1a. The figure explaining the example which changes the luminance value of a specific subpixel by the method 1b which is a modification of the method 1. FIG. The figure explaining the example which changes the luminance value of a specific subpixel by the method 1c which is a modification of the method 1. FIG. The figure explaining the specific example which changes the luminance value of a specific subpixel by the method 3a which is a modification of the method 3. FIG. The top view when a staircase lenticular lens is arrange | positioned above a display panel. The figure which imaged the individual viewpoint image by the stair lenticular lens. The top view when a diagonal parallax barrier is arrange | positioned above a display panel. The figure which imaged the individual viewpoint image | video by a diagonal parallax barrier. The top view when arrange | positioning a staircase parallax barrier above a display panel. The figure which imaged the individual viewpoint image by the stair parallax barrier. The figure for demonstrating arrange | positioning a 7 eye type | mold lenticular lens to a display panel. (A) In a 7 eye type lenticular lens, the figure which shows the image | video before changing a luminance value, (b) The figure which shows the image | video which changed the luminance value by the method 1. FIG. The figure which shows an example of the functional block of a stereoscopic vision image display apparatus.

Explanation of symbols

DESCRIPTION OF SYMBOLS 100 Stereoscopic image generation apparatus 200 Input part 300 Processing part 310 Game calculating part 320 Image generation part 321 Stereoscopic image generation part 322 Luminance value setting process part 400 Storage part 410 Program 411 Stereoscopic image generation process program 412 Display image generation process program 413 Brightness value setting processing program 420 Data 421 Stereoscopic image data 422 Display image data 423 Specific primary color definition data 424 Object data 500 Stereoscopic image display device 510 Display panel 520 Display control device 521 Processing unit 522 Storage unit 522a Brightness value setting processing program 522b Specific primary color definition data

Claims (26)

A display element group in which pixels composed of a plurality of sub-pixels that emit light of different primary colors are arranged in a grid pattern, and sub-pixels in the same column emit the same primary color, and a three-dimensional stereoscopic display displayed on the display element group An image to be displayed on a stereoscopic image display device including optical means configured by arranging optical unit elements for separating a visual image into images for each viewpoint obliquely with respect to the arrangement direction of the sub-pixels. A program for causing a computer to generate a stereoscopic image composed of pixels representing the display colors of the pixels by luminance values of the respective primary colors,
In a pixel column corresponding to each pixel column at predetermined intervals among pixel columns composed of pixels connected in the column direction, a specific primary color when a different primary color is periodically specified from the corresponding pixel column one by one. A program for causing the computer to function as image generation means for generating a stereoscopic image by performing a specific luminance value setting process in which a luminance value for the primary color of the entire corresponding pixel row is set to a predetermined luminance value. The program according to claim 1,
A program for causing the computer to function so that the image generation unit generates a stereoscopic image by performing the specific luminance value setting process on the original image of the stereoscopic image. The program according to claim 1,
A program for causing the computer to function so that the image generation means has original image generation means for generating the original image. The program according to any one of claims 1 to 3,
A program for causing the computer to function so that the image generation unit performs the specific luminance value setting process with the predetermined luminance value as a constant luminance value. The program according to claim 2 or 3,
The specific luminance value setting process is performed so that the image generation means uses a luminance value obtained by multiplying a luminance value for the primary color to be changed in the original image by a certain reduction rate as a luminance value for the primary color to be changed. A program for operating the computer to perform. The program according to claim 2, 3 or 5,
The image generation means performs control to distribute the amount of change in the luminance value of the primary color changed by the specific luminance value setting process to a pixel column adjacent to the pixel column, and suppress a variation in the sum of luminance values. A program for causing the computer to function so as to have distributed control means. The program according to claim 2, 3 or 5,
The dispersion control means provides the computer with a luminance value of the same primary color as that of the primary color of the pixel column adjacent to the pixel column, for the amount of change of the luminance value for the primary color changed by the specific luminance value setting process. A program to make it work. The program according to claim 7,
The dispersion control unit covers the amount of change in the brightness value for the primary color changed by the specific brightness value setting process with a ratio based on the ratio of the brightness value of the primary color and the primary color of the pixel row adjacent to the pixel row. Program for causing the computer to function. A program according to any one of claims 1 to 8,
The optical means may be a lenticular lens, a stair lenticular lens, a parallax barrier, or a stair parallax barrier. A display element group in which pixels composed of a plurality of sub-pixels that emit light of different primary colors are arranged in a grid pattern, and sub-pixels in the same column emit the same primary color, and a three-dimensional stereoscopic display displayed on the display element group An image to be displayed on a stereoscopic image display device including optical means configured by arranging optical unit elements for separating a visual image into images for each viewpoint obliquely with respect to the arrangement direction of the sub-pixels. A stereoscopic image generation device configured to generate a stereoscopic image composed of pixels representing the display color of the pixel by the luminance value of each primary color,
In a pixel column corresponding to each pixel column at predetermined intervals among pixel columns composed of pixels connected in the column direction, a specific primary color when a different primary color is periodically specified from the corresponding pixel column one by one. A stereoscopic image generation apparatus, comprising: an image generation unit configured to generate a stereoscopic image by performing a specific luminance value setting process in which a luminance value for the primary color of the entire corresponding pixel row is set to a predetermined luminance value. The stereoscopic image generation device according to claim 10,
The stereoscopic image generation apparatus, wherein the image generation unit performs the specific luminance value setting process on an original image of a stereoscopic image. The stereoscopic image generation device according to claim 10,
The stereoscopic image generating apparatus, wherein the image generating means includes original image generating means for generating the original image. The stereoscopic image generation device according to any one of claims 10 to 12,
The stereoscopic image generation apparatus, wherein the image generation unit performs the specific luminance value setting process with the predetermined luminance value as a constant luminance value. The stereoscopic image generation device according to claim 11 or 12,
The specific luminance value setting process is performed so that the image generation means uses a luminance value obtained by multiplying a luminance value for the primary color to be changed in the original image by a certain reduction rate as a luminance value for the primary color to be changed. A stereoscopic image generating apparatus characterized by performing the processing. The stereoscopic image generating device according to claim 11, 12 or 14,
Dispersion control in which the image generation unit performs control to disperse the amount of change in the luminance value of the primary color changed by the specific luminance setting process in a pixel column adjacent to the pixel column, and to suppress variation in the sum of luminance values A stereoscopic image generating apparatus characterized by comprising means. The stereoscopic image generating device according to claim 11, 12 or 14,
Dispersion control in which the image generation unit distributes the amount of change in the luminance value for the primary color changed by the specific luminance setting process so as to cover the luminance value of the primary color of the primary color adjacent to the pixel row A stereoscopic image generating apparatus characterized by comprising means. The stereoscopic image generation device according to claim 16,
The dispersion control means covers the amount of change in the luminance value for the primary color changed by the specific luminance setting process with a ratio based on the ratio between the primary color and the primary color luminance value of the pixel column adjacent to the pixel column. A stereoscopic image generating apparatus characterized by the above. The stereoscopic image generation device according to any one of claims 10 to 17,
The stereoscopic image generating apparatus, wherein the optical means is a lenticular lens, a stair lenticular lens, a parallax barrier, or a stair parallax barrier. A display element group in which pixels composed of a plurality of sub-pixels that emit light of different primary colors are arranged in a grid pattern, and sub-pixels in the same column emit the same primary color, and a three-dimensional stereoscopic display displayed on the display element group An optical unit configured to divide a visual image into an image for each viewpoint and arranged obliquely with respect to the arrangement direction of the sub-pixels, and the display color of the pixel is a luminance of each primary color A stereoscopic image display device that displays a stereoscopic image composed of pixels represented by values,
In a pixel column corresponding to each pixel column at predetermined intervals among pixel columns composed of pixels connected in the column direction, a specific primary color when a different primary color is periodically specified from the corresponding pixel column one by one. A stereoscopic image display apparatus, comprising: an image generation unit configured to generate a stereoscopic image by performing a specific luminance value setting process in which a luminance value for the primary color of the entire corresponding pixel row is set to a predetermined luminance value. The stereoscopic image display device according to claim 19,
The image generation means generates a stereoscopic image by performing the specific luminance setting process on the original image of the stereoscopic image generated by the stereoscopic image generation device, and displays the stereoscopic image on the display element group. A stereoscopic image display device characterized in that The stereoscopic image display device according to claim 19 or 20,
The stereoscopic image display device, wherein the image generation unit performs the specific luminance value setting process with the predetermined luminance value as a constant luminance value. The stereoscopic image display device according to claim 19 or 20,
The specific luminance value setting process is performed so that the image generation means uses a luminance value obtained by multiplying a luminance value for the primary color to be changed in the original image by a certain reduction rate as a luminance value for the primary color to be changed. A stereoscopic image display device characterized in that the display is performed. The stereoscopic image display device according to claim 19, 20 or 22,
Dispersion control in which the image generation unit performs control to disperse the amount of change in the luminance value of the primary color changed by the specific luminance setting process in a pixel column adjacent to the pixel column, and to suppress variation in the sum of luminance values A stereoscopic image display apparatus characterized by comprising means. The stereoscopic image display device according to claim 19, 20 or 22,
Dispersion control in which the image generation unit distributes the amount of change in the luminance value for the primary color changed by the specific luminance setting process so as to cover the luminance value of the primary color of the primary color adjacent to the pixel row A stereoscopic image display apparatus characterized by comprising means. A stereoscopic image display device according to claim 24,
The dispersion control means covers the amount of change in the luminance value for the primary color changed by the specific luminance setting process with a ratio based on the ratio between the primary color and the primary color luminance value of the pixel column adjacent to the pixel column. A stereoscopic image display device characterized by the above. The stereoscopic image display device according to any one of claims 19 to 25,
The stereoscopic image display device, wherein the optical means is a lenticular lens, a stair lenticular lens, a parallax barrier, or a stair parallax barrier.