JP2010119066A - Stereoscopic image display system, and parallax image generating apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To enable an observer to recognize a stereoscopic image regardless of visual line direction from a prescribed observation position. <P>SOLUTION: In an stereoscopic image display system for enabling an observer to recognize a stereoscopic image by displaying a parallax image, each picture element or region displays a parallax image having parallax in a tangential direction or a parallel direction of a symmetric figure whose center is an observation position set at a prescribed position on a plane wherein the parallax image is displayed. Picture elements PX1, PX2 inside the parallax image may have parallax in tangential directions DP1, DP2 of a point passing through the picture elements PX1, PX2 when drawing a circle C1 passing through the PX1, PX2 with a center of an observation position PV set at a prescribed position on a plane where the parallax image is displayed. <P>COPYRIGHT: (C)2010,JPO&INPIT

Description

  The present invention relates to a stereoscopic image display system that allows a viewer to recognize a stereoscopic image by displaying a parallax image, and a parallax image generation device that generates a parallax image.

  Since the human eyes are several centimeters apart, the images obtained with the right and left eyes are misaligned. The human brain recognizes the depth using this position shift as a clue. In other words, by adjusting the positional deviation amount of the image to be copied to both eyes, the brain can be made to recognize the pseudo depth. Using this binocular parallax, various methods for causing the brain to recognize a planar image as a stereoscopic image have been put into practical use. Broadly classified, there are a glasses method and a naked eye method. The glasses method includes a shutter glasses method, a polarized glasses method, an anaglyph glasses method, and the naked eye methods include a parallax barrier method and a lenticular lens method.

  FIG. 1 is a diagram (part 1) schematically illustrating parallax directions DP <b> 1 and DP <b> 2 of a parallax image displayed in a flat display area 10 and a line-of-sight direction DV from an observer H according to the prior art. In FIG. 1, the flat display area 10 is formed horizontally with respect to the ground. In the flat display area 10, a right-eye image and a left-eye image (hereinafter, collectively referred to as a parallax image as appropriate) having a predetermined positional deviation amount are displayed temporally or spatially divided. For example, see Patent Document 1). Here, since the direction of the parallax of the parallax image displayed in the flat display area 10 will be discussed, the display method of the parallax image is not limited. The flat display area 10 may be a display, a screen, a floor or a ceiling.

  In the example of FIG. 1, the parallax directions DP <b> 1 and DP <b> 2 of the parallax image displayed in the flat display area 10 are the same in all pixels, and are set in a direction parallel to the longitudinal direction of the flat display area 10. ing. Here, the direction of the parallax of the parallax image refers to the direction of a line passing through corresponding pixels or regions of the right-eye image and the left-eye image. When the direction of the parallax and the direction of the line passing through the right eye viewpoint VR and the left eye viewpoint VL of the observer H (hereinafter referred to as the direction between both eyes as appropriate) are parallel or substantially parallel, the observer H is parallax. The image can be recognized as a stereoscopic image. Conversely, when the two directions are not parallel or substantially parallel, the observer H cannot recognize the parallax image as a stereoscopic image. Here, the fact that there is no parallel relationship means that there is a parallax component orthogonal to a plane including three points of the right eye viewpoint, the left eye viewpoint, and the gazing point.

In the example of FIG. 1, the direction between both eyes when the observer H at a predetermined observation position faces the line-of-sight direction DV and the direction of parallax are parallel, and the observer H recognizes a stereoscopic image. can do. When the parallax image is displayed perpendicularly or substantially perpendicular to the ground plane, the direction between the eyes does not change greatly even if the observation position or the line-of-sight direction of the observer changes. This is because an observer usually does not view an image perpendicular or substantially perpendicular to the ground plane with a large tilt of his head. Therefore, when a parallax image is displayed perpendicularly or substantially perpendicularly to the ground, even if the parallax direction is constant for all pixels, no major problem occurs.
JP-A-10-56654

  However, when the parallax image is displayed horizontally or substantially horizontally with respect to the ground plane, the direction between both eyes varies greatly depending on the viewing direction of the observer. In particular, when the size of the parallax image is large, it greatly changes.

  FIG. 2 is a diagram (part 2) schematically illustrating the parallax directions DP1 and DP2 of the parallax image displayed in the flat display area 10 and the line-of-sight direction DV from the viewer H according to the prior art. FIG. 2 shows a state in which the viewing direction DV of the observer H in FIG. 1 is rotated about 90 ° counterclockwise as viewed from the observer H. In this state, the direction of the parallax and the direction between the eyes of the observer H are substantially perpendicular, and the observer H cannot recognize the stereoscopic image.

  The present invention has been made in view of such circumstances, and an object of the present invention is to provide a technique that allows an observer to recognize a stereoscopic image regardless of the line-of-sight direction from a predetermined observation position.

  A stereoscopic image display system according to an aspect of the present invention is a stereoscopic image display system that allows a viewer to recognize a stereoscopic image by displaying a parallax image, and each pixel or region is on a plane on which the parallax image is displayed. A parallax image having parallax in the tangential direction or parallel direction of the symmetrical figure with the observation position set at the predetermined position as the center is displayed.

  Yet another embodiment of the present invention is a parallax image generating device. This apparatus is on an observation position setting unit that sets an observation position at a predetermined position on the first plane on which a parallax image is to be displayed, and on a second plane positioned at a predetermined height from the first plane. A binocular viewpoint straight line that passes through a reference point located at a height from the position and is parallel or substantially parallel to a vertical line on the first plane with respect to a line segment connecting the target pixel on the first plane and the observation position, A viewpoint setting unit that sets a right-eye viewpoint and a left-eye viewpoint at two points that are located at a predetermined interval and are equally spaced from the reference point, and a right-eye line of sight that passes through the right-eye viewpoint and the target pixel, and left The pixel value of the right eye image of the target pixel is obtained by calculating the pixel value of each intersection of the surface of the object existing on the left eye line of sight passing through the eye viewpoint and the target pixel, and the right eye line of sight and the left eye line of sight. A pixel value acquisition unit for acquiring values and pixel values of a left eye image; Equipped with a.

  It should be noted that any combination of the above-described constituent elements and a conversion of the expression of the present invention between a method, an apparatus, a system, a recording medium, a computer program, etc. are also effective as an aspect of the present invention.

  According to the present invention, a stereoscopic image can be recognized by an observer regardless of the line-of-sight direction from a predetermined observation position.

  FIG. 3 is a diagram (simulated drawing) of the parallax direction of the parallax image displayed in the flat display area 10 and the right eye viewpoint VR and the left eye viewpoint VL of the observer according to the embodiment of the present invention. 1). FIG. 3 shows an example in which the observation position PV is set at the center of the flat display area 10. The observer stands at the observation position PV and sees the parallax image displayed in the flat display area 10. Although the observer's head is not depicted in FIG. 3, the observer faces the left front direction of FIG. 3 and looks at the gazing point PR diagonally lower left from the right eye viewpoint VR and the left eye viewpoint VL. The direction is a diagonally lower left direction.

  In this case, the direction between the eyes of the observer is a direction perpendicular on the horizontal plane with respect to the left-downward straight line passing through the observation position PV and the gazing point PR. Therefore, when the direction and the parallax direction DP of the gazing point PR coincide with each other or substantially coincide with each other, the observer can recognize the gazing point PR that is diagonally lower left as the stereoscopic pixel.

  FIG. 4 is a diagram schematically illustrating the parallax direction of the parallax image displayed in the flat display area 10 and the viewer's right eye viewpoint VR and left eye viewpoint VL according to the embodiment of the present invention (part 2). ). 4 also shows an example in which the observation position PV is set at the center of the flat display area 10 as in FIG. In FIG. 4, the observer turns to the right front of FIG. 4 and is looking at the gazing point PR diagonally lower right from the right eye viewpoint VR and the left eye viewpoint VL, and the line-of-sight direction is the diagonally lower right direction.

  In this case, the direction between the eyes of the observer is a direction perpendicular to the right-down straight line passing through the observation position PV and the gazing point PR on the horizontal plane. Therefore, when the direction and the parallax direction DP of the gazing point PR are matched or substantially matched, the observer can recognize the gazing point PR on the lower right as a stereoscopic pixel.

  Thus, each pixel or region in the parallax image displayed horizontally with respect to the ground plane needs to have a parallax in a different direction depending on the line-of-sight direction from the predetermined observation position. In other words, when the direction between both eyes changes greatly due to a change in the line-of-sight direction from a predetermined observation position, each pixel or region has a parallax in a direction determined individually according to the positional relationship with the predetermined observation position. It is necessary to have.

  Regardless of the line-of-sight direction from a predetermined observation position, in order for the observer to recognize a stereoscopic image, each pixel or region needs to have a parallax in the horizontal direction or the substantially horizontal direction when viewed from the predetermined observation position. . More specifically, when a straight line is drawn for each pixel or region from the observation position set at a predetermined position on the plane on which the parallax image is displayed, each pixel or region is relative to the straight line. It is necessary to have parallax in the vertical direction or substantially vertical direction.

Hereinafter, an algorithm for determining the direction of parallax in each pixel or region in the parallax image will be described.
FIG. 5 is a diagram for explaining a first algorithm for determining the direction of parallax according to the embodiment. FIG. 5 shows an example in which the observation position PV is set at the center of the flat display area 10. In the first algorithm, a pixel in a parallax image passes through the pixel when a circle passing through the pixel is drawn around an observation position set at a predetermined position on a plane on which the parallax image is displayed. Has parallax in the tangential direction.

  For example, the pixels PX1 and PX2 have parallax in the tangential directions DP1 and DP2 of the points passing through the pixels PX1 and PX2 on the circle C1 passing through the pixels PX1 and PX2 with the observation position PV as the central point. By using this first algorithm, it is possible to generate an ideal parallax image in which the direction of parallax and the direction between both eyes are parallel in all pixels.

  FIG. 6 is a diagram for explaining a second algorithm for determining the direction of parallax according to the embodiment. FIG. 6 also shows an example in which the observation position PV is set at the center of the flat display area 10. In the second algorithm, a pixel in a parallax image is the pixel when an ellipse passing through the pixel is drawn around an observation position set at a predetermined position on a plane on which the parallax image is displayed. It has parallax in the tangential direction of a point on the passing curve or in the direction parallel to the straight line passing through the pixel. That is, when the point passing through the pixel is on the circumference of the ellipse, the tangential direction of the point is the direction of parallax, and when the point passing through the pixel is on the side of the ellipse, The direction parallel to the direction of parallax is taken as the direction of parallax.

  For example, the pixels PX1 and PX2 have parallax in the tangential directions DP1 and DP2 of the points passing through the pixels PX1 and PX2 on the ellipse C2 passing through the pixels PX1 and PX2 with the observation position PV as the center point. In the second algorithm, the observation position can have a certain width. That is, the observation position can be enlarged in the longitudinal direction of the oval ring. In the example of FIG. 6, even when the parallax image is viewed from a position that has moved to some extent in the longitudinal direction of the flat display region 10 from the central point of the flat display region 10, the observer recognizes the same three-dimensional image as when viewed from the central point. can do. Therefore, when a plurality of persons stand at the observation position having the width, the plurality of persons can simultaneously recognize the same stereoscopic image.

  FIG. 7 is a diagram for explaining a third algorithm for determining the direction of parallax according to the embodiment. FIG. 7 also shows an example in which the observation position PV is set at the center of the flat display region 10. In the third algorithm, a pixel in a parallax image is the pixel when a regular polygon passing through the pixel is drawn around an observation position set at a predetermined position on a plane on which the parallax image is displayed. It has parallax in the direction parallel to the passing side.

  FIG. 7 shows an example in which a regular octagon is drawn. In the example of drawing a regular octagon, the flat display area 10 is divided into eight areas R1 to R8. Pixels R1 to R8 in each region have parallax in the same direction. In FIG. 7, a pixel PX has a parallax in a direction DP parallel to a side passing through the pixel PX of a regular octagon C3 passing through the pixel PX with the observation position PV as a central point.

  In the third algorithm, the direction of the parallax may be adjusted in units of regions, so that the effort for generating the parallax image can be reduced as compared with the case of adjusting the direction of parallax in units of pixels. In particular, it is possible to greatly reduce the trouble of generating the parallax image with a real image instead of a computer graphic image. A specific method for generating the parallax image will be described later.

  Note that even if the direction of parallax and the direction between both eyes do not exactly match, the observer can recognize the parallax image as a stereoscopic image, and the direction is 20 to 45 ° (the parallel component is the main component). The range can be recognized as a three-dimensional image even if they are shifted by a certain amount.

Hereinafter, a configuration example of the stereoscopic image display system will be described. First, an example in which the shutter glasses method is adopted will be described.
FIG. 8 is a diagram showing a first configuration example of a stereoscopic image display system 500 that adopts the shutter glasses method according to the embodiment of the present invention. The stereoscopic image display system 500 includes a projector 100 and shutter glasses 200. The flat display area 10 may be a dedicated screen installed on the floor or the floor itself. The observation position PV is set to a position in front of the center of the flat display area 10. The observation position PV is preferably set to a position where the shadow of the observer due to the light projected from the projector 100 does not appear in the flat display area 10.

  The projector 100 projects the right-eye image and the left-eye image constituting the parallax image onto the flat display area 10 in a time division manner. That is, the right-eye image and the left-eye image are alternately displayed in the flat display area 10, and only one of the right-eye image and the left-eye image is displayed at a certain moment.

  The shutter glasses 200 are worn on both eyes of the observer. The shutter glasses 200 selectively or alternately block the left eye field and the right eye field in synchronization with the switching of the right eye image and the left eye image by the projector 100. That is, when the right-eye image is displayed in the flat display area 10, the right-eye view is released to block the left-eye view, and when the left-eye image is displayed in the flat display area 10, the left-eye view is displayed. Release the field of view and block the field of view of the right eye.

More specific description will be given below.
FIG. 9 is a block diagram showing a configuration of projector 100 and shutter glasses 200 of FIG. Projector 100 includes a parallax image input unit 110, a synchronization signal generation unit 120, an image switching unit 130, a projection unit 140, and a synchronization signal transmission unit 150. The shutter glasses 200 include a synchronization signal receiving unit 210, a shutter control unit 220, a left eye shutter 230, and a right eye shutter 240.

  The parallax image input unit 110 inputs the parallax image to the image switching unit 130. The synchronization signal generation unit 120 generates a synchronization signal for switching between the right-eye image and the left-eye image that constitutes the parallax image. For example, a 120 Hz clock signal is generated. The synchronization signal generation unit 120 inputs the generated synchronization signal to the image switching unit 130 and the synchronization signal transmission unit 150. The image switching unit 130 alternately selects the image for the right eye and the image for the left eye input from the parallax image input unit 110 according to the synchronization signal input from the synchronization signal generation unit 120 to the projection unit 140. input.

  The projection unit 140 projects the right-eye image and the left-eye image input from the image switching unit 130 onto the flat display area 10. The synchronization signal transmission unit 150 transmits the synchronization signal input from the synchronization signal generation unit 120 to the shutter glasses 200 (more specifically, the synchronization signal reception unit 210) via a predetermined wireless channel or wired channel. For example, short-range wireless communication using a 2.4 GHz frequency band may be employed.

  The synchronization signal receiving unit 210 receives the synchronization signal transmitted from the synchronization signal transmitting unit 150 and inputs it to the shutter control unit 220. The shutter control unit 220 controls the left-eye shutter 230 and the right-eye shutter 240 in accordance with the synchronization signal input from the synchronization signal receiving unit 210. Specifically, the left-eye shutter 230 and the right-eye shutter 240 are alternately opened and closed according to the synchronization signal. The left-eye shutter 230 and the right-eye shutter 240 are configured by a liquid crystal shutter or the like, and open and close according to a control signal from the shutter control unit 220. Specifically, when the left eye shutter 230 is open, the right eye shutter 240 is closed, and when the right eye shutter 240 is open, the left eye shutter 230 is closed.

  FIG. 10 is a diagram illustrating a second configuration example of a stereoscopic image display system 500 employing the shutter glasses method according to the embodiment of the present invention. FIG. 11 is a diagram showing a third configuration example of a stereoscopic image display system 500 that adopts the shutter glasses method according to the embodiment of the present invention. 10 and 11, the shutter glasses 200 are omitted.

  In the second configuration example and the third configuration example, a plurality of projectors are used. The plurality of projectors project a partial image corresponding to the parallax image in each area when the planar display area for displaying the parallax image is divided into a plurality of areas. More specifically, each of the plurality of projectors displays the partial right-eye image and the partial left-eye image corresponding to the allocated area of the right-eye image and the left-eye image that constitute the parallax image. Alternately project onto the area. The plurality of projectors are synchronized, and all the projectors project a partial right-eye image or a partial left-eye image at a certain moment. Therefore, the entire right eye image or the entire left eye image is displayed in the flat display area 10 at a certain moment. The shutter glasses 200 alternately block the left-eye view and the right-eye view in synchronization with switching between the entire right-eye image and the entire left-eye image projected by a plurality of projectors.

  In the second configuration example shown in FIG. 10, two projectors (first projector 100a and second projector 100b) are used. The flat display area 10 is divided into two equal parts in the longitudinal direction and is divided into a first area Ra and a second area Rb. Similarly, the parallax image is also bisected at the same cut end, and is divided into a partial parallax image for the first region Ra and a partial parallax image for the second region Rb. The first projector 100a and the second projector 100b are respectively installed on both sides of the flat display area 10 in the longitudinal direction. The observation position PV is set in front of the center of the flat display area 10.

  The first projector 100a alternately displays a partial right-eye image and a partial left-eye image for the first region in the first region Ra. The second projector 100b alternately displays a partial right-eye image and a partial left-eye image for the second region in the second region Rb. The first projector 100a and the second projector 100b are synchronized with respect to which of the partial right-eye image and the partial left-eye image should be projected.

  In the third configuration example shown in FIG. 11, four projectors (first projector 100a, second projector 100b, third projector 100c, and fourth projector 100d) are used. The flat display area 10 is divided into four equal crosses and is divided into a first area Ra, a second area Rb, a third area Rc, and a fourth area Rd. Similarly, the parallax image is also divided into four equal parts at the same cut, and the partial parallax image for the first region Ra, the partial parallax image for the second region Rb, the partial parallax image for the third region Rc, and the Rd for the fourth region. The image is divided into partial parallax images.

  The first projector 100a, the second projector 100b, the third projector 100c, and the fourth projector 100d are installed so as to surround the flat display area 10. More specifically, the first projector 100a is installed in contact with the outer side of the first area Ra. The same applies to the second projector 100b, the third projector 100c, and the fourth projector 100d. In FIG. 11, the first projector 100a is installed at a position facing the third projector 100c in contact with the outer longitudinal side.

  The first projector 100a alternately displays a partial right-eye image and a partial left-eye image for the first region in the first region Ra. The same applies to the second projector 100b, the third projector 100c, and the fourth projector 100d. The first projector 100a, the second projector 100b, the third projector 100c, and the fourth projector 100d are synchronized with respect to which of the partial right-eye image and the partial left-eye image should be projected.

  In a stereoscopic image display system employing the shutter glasses method, a stereoscopic image can be displayed without reducing resolution by dividing the right-eye image and the left-eye image temporally rather than spatially. In addition, a large-sized stereoscopic image can be displayed by using a plurality of projectors. Further, by using a plurality of projectors as shown in FIG. 11, even when the observation position PV is set at the center of the flat display area 10, it is possible to suppress the occurrence of a shadow of an observer at that position.

  FIG. 12 is a diagram illustrating a configuration example of a stereoscopic image display system 500 that adopts the polarized glasses method according to the embodiment of the present invention. Here, the circular polarized glasses method will be described as an example. The stereoscopic image display system 500 includes a display 300, a circularly polarizing plate 310, and circularly polarizing glasses 400. In FIG. 12, the observation position PV is set at the center of the front side. The display 300, for example, a plasma display or a liquid crystal display displays a parallax image in which a right-eye image and a left-eye image are spatially combined. For example, the right eye image is displayed in the odd-numbered columns of the scanning lines, and the left eye image is displayed in the even-numbered columns.

  The circularly polarizing plate 310 is provided on the display surface side of the display 300. A film may be attached to the display surface of the display 300. The circularly polarizing plate 310 converts light emitted from the display 300 into circularly polarized light. More specifically, the light beam emitted from the odd-numbered column of the scanning line is converted into a right-circularly polarized light beam, and the light beam emitted from the even-numbered column is converted into a left-circularly polarized light beam. That is, the phase of the light beam of the right eye image and the phase of the light beam of the left eye image are reversed.

  In the circularly polarized glasses 400, a right eye filter that passes a right circularly polarized component is provided in the right eye frame, and a left eye filter that passes a left circularly polarized component is provided in the left eye frame. By wearing this circularly polarized glasses 400, the observer can see the right-eye image with the right eye and the left-eye image with the left eye, and can recognize a stereoscopic image.

  A stereoscopic image display system employing a polarized glasses system can faithfully reproduce a color image as compared to a system employing an anaglyph glasses system. In addition, by adopting the circular polarization method, it is possible to recognize a stereoscopic image even if the observer's head is tilted to some extent.

  FIG. 13 is a diagram illustrating a configuration example of a stereoscopic image display system 500 that employs a parallax barrier system according to an embodiment of the present invention. The stereoscopic image display system 500 includes a display 600 and a parallax barrier 610. In FIG. 13, the observation position PV is set at the center of the front side. In FIG. 13, the flat display area 10 is divided into three areas R1 to R3. The first region R1 is a triangular region having two apexes on the right side of the flat display region 10 and the observation position PV as apexes. The second region R2 is a triangular region having two vertexes on the far side of the flat display region 10 and the observation position PV as vertices. The third region R3 is a triangular region having two vertices on the left side of the flat display region 10 and the observation position PV as vertices.

  The display 600 displays a parallax image in which a right-eye image and a left-eye image are spatially combined. In this parallax image, the direction of parallax is different for each region. In FIG. 13, for each of the regions R1 to R3, the parallax direction is set in a direction orthogonal to the stripe direction.

  The parallax barrier 610 is provided on the display surface side of the display 600. The parallax barrier 610 is formed by alternately arranging barriers and apertures. In FIG. 13, barriers and apertures in the same direction as the stripe direction are alternately arranged for each of the regions R1 to R3. The parallax barrier 610 acts so that the pixels of the right-eye image cannot be seen from the left eye located at the distance so that the pixels of the left-eye image cannot be seen from the right eye located at a specific distance from the display 600. To do.

  A similar situation can be created by using a lenticular lens instead of the parallax barrier 610. FIG. 13 shows an example of so-called two-viewpoint display that displays two viewpoint images, a right-eye image and a left-eye image, but multi-viewpoint display that displays more viewpoint images may be used. Is possible. The parallax barrier separates the direction in which the four images are visible, and acts so that when one eye is looking at an image, the other image is not visible. In the stereoscopic image display system employing the Parallax barrier system, glasses are not required and the system can be simplified.

Next, a method for generating the above-described parallax image will be described.
FIG. 14 is a block diagram showing a configuration of parallax image generating apparatus 700 according to the embodiment of the present invention. The parallax image generation device 700 includes an observation position setting unit 710, a viewpoint setting unit 720, and a pixel value acquisition unit 730. These configurations can be realized in hardware by any computer's CPU, memory, and other LSIs, and in software, they are realized by programs loaded into the memory. Draw functional blocks. Therefore, those skilled in the art will understand that these functional blocks can be realized in various forms by hardware only, software only, or a combination thereof.

  FIG. 15 is a diagram (No. 1) illustrating a process of generating a parallax image by the parallax image generating device 700 according to the embodiment of the present invention. Hereinafter, an example of generating a parallax image from an original image including a predetermined object generated by computer graphics will be described with reference to FIG.

  The observation position setting unit 710 sets the observation position PV at a predetermined position on the first plane where the parallax image is to be displayed. Here, the first plane is a projection surface of the parallax image. The observation position PV can be set at an arbitrary position on the first plane by the designer. The observation position PV may be inside or outside the region where the parallax image is displayed.

  The viewpoint setting unit 720 sets the right eye viewpoint VR and the left eye viewpoint VL on the binocular viewpoint straight line L1. The binocular viewpoint straight line L1 is on the second plane located at a predetermined height H from the first plane, and passes through the reference point PS located at the height H from the observation position PV. The binocular viewpoint straight line L1 is parallel or substantially parallel to the vertical line L3 on the first plane with respect to the line segment L2 connecting the target pixel PX on the first plane and the observation position PV. The height H can be arbitrarily set by the designer. For example, the height H may be set to a height at which both eyes in a state where an average height person stands upright.

  The viewpoint setting unit 720 sets the right-eye viewpoint VR and the left-eye viewpoint VL at two points that are located at a predetermined interval on the binocular viewpoint straight line L1 and are equally spaced from the reference point PS. . The distance between the two points can also be arbitrarily set by the designer. For example, the distance between the two points may be set to an average distance between both eyes of a person.

  The pixel value acquisition unit 730 is an object that exists on the right eye line of sight L4 passing through the right eye viewpoint VR and the target pixel PX and on the left eye line of sight L5 passing through the left eye viewpoint VL and the target pixel PX. The pixel values of the intersections P4 and P5 of the surface of the OB, the right eye line of sight line L4, and the left eye line of sight line L5 are set as the pixel value of the right eye image and the left eye image of the target image PX. Obtained as a pixel value. By acquiring these pixel values for all pixels, a right-eye image and a left-eye image can be generated. Note that the pixel value is acquired based on the same principle when the object OB is not behind the projection plane when viewed from the right eye viewpoint VR and the left eye viewpoint VL but is present in front of the projection plane. Can do.

  When generating a parallax image to which the first algorithm is applied as illustrated in FIG. 5, the viewpoint setting unit 720 needs to draw a binocular viewpoint straight line L1 in parallel with the vertical line L3 for all pixels. On the other hand, when generating a parallax image to which the third algorithm is applied as illustrated in FIG. 7, the viewpoint setting unit 720 can fix the direction of the binocular viewpoint straight line L1 in units of divided areas. The right eye viewpoint VR and the left eye viewpoint VL can be fixed. In this case, it is possible to reduce the amount of calculation for generating the parallax image, and to speed up the generation process.

  The example of generating a parallax image using computer graphics has been described so far, but the same can be considered when generating a real parallax image. For example, when a parallax image to which the third algorithm is applied is generated in a live-action manner, the right-eye viewpoint VR and the left-eye viewpoint VL are photographed for each divided area and photographed for each area. What is necessary is just to synthesize | combine the image of a viewpoint. If the boundaries of images from different viewpoints can be smoothly synthesized, the synthesis method is not satisfactory. For example, panoramic synthesis can be used.

  FIG. 16 is a diagram (part 2) illustrating a process of generating a parallax image by the parallax image generation device 700 according to the embodiment of the present invention. FIG. 16 is an example of generating parallax images of four viewpoints (first viewpoint V1, second viewpoint V2, third viewpoint V3, and fourth viewpoint V4) for one image PX.

  The pixel value acquisition unit 730 includes objects OB on the first line of sight line L41 passing through the first viewpoint V1 and the target pixel PX and on the second line of sight line L42 passing through the second viewpoint V2 and the target pixel PX. Pixel values of intersections P41 and P42 between the surface and the first line of sight line L41 and the second line of sight line L42 are acquired.

  Similarly, the pixel value acquisition unit 730 exists on the third line of sight line L43 passing through the third viewpoint V3 and the target pixel PX and on the fourth line of sight line L44 passing through the fourth viewpoint V4 and the target pixel PX. Pixel values of intersections P43 and P44 between the surface of the object OB and the third visual line L43 and the fourth visual line L44 are acquired. Thus, the pixel value acquisition unit 730 can acquire pixel values from the four viewpoints of the target image PX.

  As described above, according to the present embodiment, by displaying parallax images having different parallax directions in units of pixels or regions, a stereoscopic image can be displayed to an observer regardless of the line-of-sight direction from a predetermined observation position. Can be recognized. In particular, it is suitable for applications that display large-sized stereoscopic images on a screen or display installed on the floor or ceiling.

  In addition, by displaying the image of the ground or the sky as the parallax image according to the present embodiment, it is also suitable for an application for viewing a stereoscopic image displayed in all directions while changing the line-of-sight direction from a fixed position. For example, it is suitable for an application that displays the entire stadium where a baseball or soccer game is played, a three-dimensional planetarium, a three-dimensional environment image, and the like in all directions. In addition, by using a technique for switching the viewpoint, it can be used for an application in which a stereoscopic virtual radio control of an automobile or an airplane is moved around an observer and an image from the radio control is viewed.

  The present invention has been described based on some embodiments. It is understood by those skilled in the art that these embodiments are exemplifications, and that various modifications can be made to combinations of the respective constituent elements and processing processes, and such modifications are also within the scope of the present invention. By the way.

  In the stereoscopic image display system 500 employing the glasses method, a sensor for detecting the position of the head of the observer is mounted on the glasses, and the position of the parallax image is detected by detecting the position of the head with the sensor. Can be switched to the position detected by the sensor. As described with reference to FIG. 16, parallax images from a plurality of viewpoints may be prepared in advance, and parallax images from viewpoints corresponding to the detected positions may be selected and displayed. In this case, the observer can continue to recognize the stereoscopic image even if the observation position is changed, and the observer can move freely.

  In the stereoscopic image display system 500 that employs the shutter glasses method, a plurality of observers at different observation positions can recognize a stereoscopic image. For example, by displaying two sets of parallax images in a time-sharing manner, two observers at different observation positions can recognize a stereoscopic image. More specifically, the first right-eye image, the first left-eye image, the second right-eye image, and the second left-eye image are displayed in a time-sharing manner, and shutter glasses worn by one observer. Occludes both eyes during the period when the second right-eye image and the second left-eye image are displayed, blocks the left eye during the period during which the first right-eye image is displayed, and the first left-eye image Control to block the right eye during the displayed period. The shutter glasses worn by the other observer block both eyes during the period when the first right-eye image and the first left-eye image are displayed, and the left eye during the second right-eye image is displayed. And controls to block the right eye during the period in which the second left-eye image is displayed.

It is the figure (the 1) which drew the parallax direction of the parallax image displayed in a plane display area | region based on a prior art, and the gaze direction from an observer. It is the figure (the 2) which drew the parallax direction of the parallax image displayed in a plane display area, and the gaze direction from an observer based on a prior art. FIG. 6 is a diagram (No. 1) schematically illustrating a parallax direction of a parallax image displayed in a flat display area, a viewer's right eye viewpoint, and a left eye viewpoint according to an embodiment of the present invention. It is the figure (the 2) which drew the direction of the parallax of the parallax image displayed on a plane display area, and the observer's right-eye viewpoint and left-eye viewpoint based on embodiment of the present invention. It is a figure for demonstrating the 1st algorithm for determining the direction of parallax based on embodiment. It is a figure for demonstrating the 2nd algorithm for determining the direction of parallax based on embodiment. It is a figure for demonstrating the 3rd algorithm for determining the direction of parallax based on Embodiment. It is a figure which shows the 1st structural example of the stereo image display system which employ | adopted the shutter glasses system based on embodiment of this invention. It is a block diagram which shows the structure of the projector and shutter glasses of FIG. It is a figure which shows the 2nd structural example of the stereo image display system which employ | adopted the shutter glasses system based on embodiment of this invention. It is a figure which shows the 3rd structural example of the stereo image display system which employ | adopted the shutter glasses system based on embodiment of this invention. It is a figure which shows the structural example of the stereo image display system which employ | adopted the polarized glasses system based on embodiment of this invention. It is a figure which shows the structural example of the stereo image display system which employ | adopted the parallax barrier system based on embodiment of this invention. It is a block diagram which shows the structure of the parallax image generation apparatus which concerns on embodiment of this invention. It is FIG. (1) which shows the process which produces | generates a parallax image with the parallax image generation apparatus which concerns on embodiment of this invention. It is FIG. (2) which shows the process which produces | generates a parallax image with the parallax image generation apparatus which concerns on embodiment of this invention.

Explanation of symbols

  10 plane display area, 100 projector, 100a first projector, 100b second projector, 100c third projector, 100d fourth projector, 110 parallax image input unit, 120 synchronization signal generation unit, 130 image switching unit, 140 projection unit, 150 Synchronization signal transmission unit, 200 shutter glasses, 210 synchronization signal reception unit, 220 shutter control unit, 230 left eye shutter, 240 right eye shutter, 300 display, 310 circular polarizing plate, 400 circular polarization glasses, 500 stereoscopic image display system , 600 display, 610 parallax barrier, 700 parallax image generation device, 710 observation position setting unit, 720 viewpoint setting unit, and 730 pixel value acquisition unit.

Claims (6)

A stereoscopic image display system that allows a viewer to recognize a stereoscopic image by displaying a parallax image,
Each pixel or region displays a parallax image having parallax in a tangential direction or parallel direction of a symmetric figure centered on an observation position set at a predetermined position on a plane on which the parallax image is displayed. A featured stereoscopic image display system.   Pixels in the parallax image are in a tangential direction of a point passing through the pixel when a circle passing through the pixel is drawn around an observation position set at a predetermined position on a plane on which the parallax image is displayed. The stereoscopic image display system according to claim 1, wherein the stereoscopic image display system has parallax.   A pixel in the parallax image is on a curve passing through the pixel when an ellipse passing through the pixel is drawn around an observation position set at a predetermined position on a plane on which the parallax image is displayed. The stereoscopic image display system according to claim 1, wherein a parallax image having parallax is displayed in a tangential direction of a point or in a direction parallel to a straight line passing through the pixel.   A pixel in the parallax image is parallel to a side passing through the pixel when a regular polygon passing through the pixel is drawn around an observation position set at a predetermined position on a plane on which the parallax image is displayed. The stereoscopic image display system according to claim 1, wherein the stereoscopic image display system has parallax in various directions.   5. The projector according to claim 1, further comprising: a plurality of projectors that project partial images corresponding to the parallax images in the respective areas when the planar display area for displaying the parallax images is divided into a plurality of areas. The three-dimensional image display system in any one. An observation position setting unit that sets an observation position at a predetermined position on the first plane on which the parallax image is to be displayed;
It is on a second plane located at a predetermined height from the first plane, passes through a reference point located at the height from the observation position, and connects the target pixel on the first plane and the observation position. A right eye viewpoint and a left eye are positioned at two points on the binocular viewpoint straight line that are parallel or substantially parallel to the vertical line on the first plane with respect to the line segment, and at equal intervals from the reference point. A viewpoint setting unit for setting an eye viewpoint;
The surface of the object existing on the right eye line of sight passing through the right eye viewpoint and the target pixel and on the left eye line of sight passing through the left eye viewpoint and the target pixel, the right eye line of sight and the left eye A pixel value acquisition unit that acquires the pixel value of each intersection with the line of sight as the pixel value of the right-eye image and the pixel value of the left-eye image of the target pixel;
A parallax image generating device comprising:

Images