JP2008146221A - Image display system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an image display system which easily provides a three-dimensional view according to a three-dimensional motion parallax. <P>SOLUTION: The image display system comprises: an image display unit 1 for displaying a three-dimensional view on the basis of a beam regenerating process; imaging cameras 2A and 2B and relative position calculation section 3 for detecting a three-dimensional position (view point position) of the eyes 21 of an observer 20; an image signal source input section 4 for entering basic image information displayed on the image display unit 1; and a displayed image creation section 5 for creating images corresponding to respective view point positions. The image corresponding to the relative view point position of the observer 20, namely, the image corresponding to the motion parallax is displayed in the image display unit 1 by operating it at real time. The three-dimensional view according to the complete three-dimensional motion parallax as well as convergence is easily realized even in the image display unit 1 which reappears the motion parallax only in the horizontal direction on the by the beam regeneration process. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to an image display system that realizes stereoscopic image display.

  2. Description of the Related Art Conventionally, 3DCG (3 Dimensional Computer Graphics) technology is known in which an object in a virtual three-dimensional space is projected onto a plane and drawn by computer computation. In 3DCG, the display device that is the final output destination is two-dimensional (2D), but 3DCG has information (object shape, position, intensity / position of light source, etc.) at the time of creation in three dimensions (3D). It is. However, a stereoscopic effect called so-called stereoscopic vision cannot be obtained by simply displaying 3DCG on a normal two-dimensional image display device (liquid crystal display monitor, projection display, etc.).

  As a method for realizing stereoscopic vision, there is a method using binocular parallax. As a typical example, there is a binocular stereoscopic display device that separately displays images (parallax images) having parallax between the left eye and the right eye using dedicated glasses. For example, there is known a technique for realizing stereoscopic vision by observing two parallax images having different polarization directions separately by polarizing glasses for the left eye and the right eye (see Patent Document 1). In addition, there is a method of switching and displaying the left-eye image and the right-eye image in a time-sharing manner using dedicated glasses having an electronic shutter such as a liquid crystal shutter. In addition, a lenticular method and a parallax barrier method are known for performing stereoscopic display using binocular parallax with the naked eye without using dedicated glasses (see Patent Document 2). In the lenticular method, a plurality of cylindrical lenticular lenses are arranged on the image display surface, so that the light beam forming the left eye image and the light beam forming the right eye image are emitted in different directions and binocular parallax. Is intended to be obtained. In the parallax barrier method, the pixels for displaying the left-eye image and the pixels for displaying the right-eye image are alternately arranged in the horizontal direction, and the light beam for the left-eye image and the light beam for the right-eye image are arranged on the front side. A parallax barrier having a slit-shaped opening for separating the two is disposed.

In these three-dimensional display methods, a physically three-dimensional image is not at the intended position. For example, a left-eye image and a right-eye image exist on a two-dimensional display surface, and the position is always Present at a certain position. For this reason, convergence and adjustment that are physiological reactions of the visual system are not particularly linked, and eye strain associated therewith is a problem. On the other hand, there is a technique called a light beam reproduction method for performing stereoscopic display by reproducing a situation equivalent to a light wave from an actual three-dimensional object with light beams (see Patent Document 3). In the light ray reproduction method, for example, a large number of projection means for projecting spatially modulated light are arranged, and projection light with different angles is projected on the screen from each projection means, so that an arbitrary point can be projected from a plurality of directions. Multiple images are formed. A stereoscopic image by the ray reconstruction method is an image in which images from a plurality of directions are multiplexed at an arbitrary point. Similar to when viewing a three-dimensional object in the real world, an arbitrary point can be seen depending on the viewing position. Is different. According to the light beam reproduction technique, it is possible to provide a stereoscopic image with very little eye strain by generating an image with a light beam that is effective for focus adjustment and binocular convergence angle adjustment as a visual function. . In addition, it is possible to continuously provide image changes accompanying the movement of the viewpoint position.
JP-A-1-315730 Japanese Patent Laid-Open No. 10-234057 Special table 2003-530606 gazette

  However, in the conventional glasses method and lenticular method using binocular parallax, the image information presented to the observer is the same regardless of whether the head (viewpoint) is stationary or moved. is there. For this reason, even if the viewpoint is stationary, the image does not change when the viewpoint is moved even if it looks three-dimensional without a sense of incongruity, that is, motion parallax cannot be realized. For this reason, there is a problem that it feels unnatural when the viewpoint is moved. On the other hand, Patent Document 2 includes a viewpoint position detecting unit that detects movement of the viewpoint position of the observer, a stereoscopic display using a lenticular method, and a stereoscopic camera that captures a parallax image displayed on the stereoscopic display. A method has been proposed in which the effect of motion parallax is obtained by rotating the stereoscopic display according to the movement of the observer's viewpoint and rotating the stereoscopic camera to change the image displayed on the stereoscopic display. . However, this method requires a mechanism for moving the stereoscopic display and the stereoscopic camera in real time in accordance with the movement of the observer's viewpoint position, which complicates the configuration. Also, with this method, only horizontal rotational movement is possible, so vertical motion parallax cannot be realized. In order to realize the vertical motion parallax, a mechanism for moving and controlling the stereoscopic display and the stereoscopic camera in the vertical direction is required, which further complicates the configuration and is difficult to realize.

  On the other hand, in the light beam reproduction method, a situation equivalent to a light wave from an actual three-dimensional object is reproduced by light beams. In principle, motion parallax can be realized in all three dimensions of the horizontal, vertical, and depth directions. However, in order to realize motion parallax in all three dimensions by the light beam reproduction method, it is necessary to scatter light beams corresponding to light waves from all three dimensions at high density on the space. For this purpose, for example, it is necessary to arrange a large number of projection means at a high density, which causes problems such as an increase in the overall size of the apparatus and a decrease in light utilization efficiency, which is difficult to realize in practice. Therefore, in general, only the motion parallax in the horizontal direction is generally realized, and the motion parallax is not realized in the vertical direction. Therefore, when the viewpoint is moved, it sometimes feels unnatural. For example, when the viewpoint is fixed, a stereoscopic effect due to the convergence angle of both eyes can be realized. Even when the viewpoint moves in the horizontal direction, since the light beam is reproduced in the horizontal direction, motion parallax is normally reproduced within the range of the viewing angle of the apparatus. However, since the light beam is not normally reproduced in the vertical direction, when the viewpoint moves in the vertical direction, the motion parallax is not reproduced, and thus the display object appears to move in the opposite direction. For the same reason, when the viewpoint position moves in the depth direction, the aspect ratio of the object may appear to change, which also causes a problem of giving the observer an unnatural feeling.

  The present invention has been made in view of such problems, and an object of the present invention is to provide an image display system capable of easily realizing stereoscopic vision by three-dimensional motion parallax.

  An image display system according to a first aspect of the present invention includes a two-dimensional image display device, a detection unit that detects a three-dimensional position of an observer's eye, and a two-dimensional image based on a detection result of the detection unit. Relative position calculation means for calculating the relative viewpoint position of the observer with respect to the display device, and image generation means for generating an image corresponding to the relative viewpoint position as an image to be displayed on the two-dimensional image display device. Is.

  In the image display system according to the first aspect of the present invention, an image corresponding to the relative viewpoint position of the observer with respect to the two-dimensional image display device, that is, an image corresponding to motion parallax is displayed on the two-dimensional image display device. The In the image display system according to the first aspect, a two-dimensional image corresponding to motion parallax is displayed. Thereby, for example, using a normal two-dimensional image display device that does not display a binocular parallax image, motion parallax can be realized, and pseudo three-dimensional display (image display corresponding to a three-dimensional viewpoint position) is possible. .

  An image display system according to a second aspect of the present invention includes an image display device that displays an image for the left eye and an image for the right eye on both eyes of the observer, and a three-dimensional position of the eyes of the observer. Detecting means for detecting, relative position calculating means for calculating the relative viewpoint positions of the left eye and right eye of the observer with respect to the image display device based on the detection result of the detecting means, and depending on the relative viewpoint position Image generating means for generating a left eye image and a right eye image to be displayed on the image display device.

  In the image display system according to the second aspect of the present invention, in an image display device capable of stereoscopic viewing using binocular parallax, an image according to the relative viewpoint position of the observer's eyes with respect to the image display device, That is, an image corresponding to motion parallax is displayed. Accordingly, in addition to binocular parallax, motion parallax can be realized, and more natural stereoscopic vision including convergence can be realized as compared with a conventional stereoscopic display device using binocular parallax.

  An image display system according to a third aspect of the present invention includes an image display device that displays a three-dimensional image by a light beam reproduction method, a detection unit that detects a three-dimensional position of an observer's eye, Based on the detection result, relative position calculation means for calculating the relative viewpoint position of the observer with respect to the image display device, and image generation for generating an image corresponding to the relative viewpoint position as an image to be displayed on the image display device Means.

  In the image display system according to the third aspect of the present invention, in an image display device capable of stereoscopic display by the light beam reproduction method, an image corresponding to the viewpoint position of the observer relative to the image display device, that is, motion parallax is supported. The image to be displayed is displayed. As a result, for example, even in an image display device that reproduces motion parallax only in the horizontal direction by the light beam reproduction method, motion parallax in the vertical direction can be realized, which is more natural than a stereoscopic display device by a conventional light beam reproduction method. Stereoscopic view can be realized.

  According to the image display system of the first aspect of the present invention, an image corresponding to the observer's relative viewpoint position with respect to the two-dimensional image display device, that is, a two-dimensional image corresponding to motion parallax is displayed in two-dimensional images. Since the image is displayed on the apparatus, for example, using a normal two-dimensional image display apparatus that does not display a binocular parallax image, it is possible to easily realize a stereoscopic view based on a three-dimensional motion parallax.

  According to the image display system according to the second aspect of the present invention, in an image display device capable of stereoscopic viewing using binocular parallax, the image display device corresponds to the relative viewpoint position of the observer's eyes with respect to the image display device. Since the image, that is, the image corresponding to the motion parallax is displayed, compared with the conventional stereoscopic display device using the binocular parallax, the stereoscopic vision by the three-dimensional motion parallax can be easily realized, and the congestion is included. A more natural stereoscopic view can be performed.

  According to the image display system of the third aspect of the present invention, in an image display device capable of stereoscopic display by the light beam reproduction method, an image according to the relative viewpoint position of the observer with respect to the image display device, that is, motion parallax. For example, even an image display device that reproduces motion parallax only in the horizontal direction by the light beam reproduction method can realize motion parallax in the vertical direction, and is completely three-dimensional motion. Stereoscopic viewing with parallax can be easily realized. Thereby, a more natural stereoscopic view can be realized as compared with a stereoscopic display device by a conventional light beam reproduction method.

Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[First Embodiment]

  FIG. 1 shows a configuration example of an image display system according to the first embodiment of the present invention. This image display system includes an image display device 1 that displays a three-dimensional image by a light beam reproduction method, photographing cameras 2A and 2B for detecting a three-dimensional position (viewpoint position) of an eye 21 of an observer 20, and A relative position calculation unit 3, an image signal source input unit 4 that inputs basic image information to be displayed on the image display device 1, and a display image generation unit 5 that generates an image according to the viewpoint position are provided.

  The image display device 1 has a screen 11 on the front surface and a plurality of projection units 10 inside as shown in FIG. The screen 11 is configured to diffuse light more widely in the vertical direction than in the horizontal direction. A plurality of projection units 10 are arranged in the horizontal direction. In addition, a mirror 12 that reflects light is disposed on the inner side surface of the image display device 1. The plurality of projection units 10 function independently of each other. Although not shown, a light source, a spatial light modulator such as a liquid crystal display device that modulates light from the light source according to a given image signal, and the spatial light modulation A projection optical system for projecting the light modulated by the instrument toward the screen 11. In the image display device 1, as shown in FIG. 3, projection light LP having different angles in the horizontal direction is projected from each projection unit 10 to an arbitrary position of the screen 11. As a result, images from a plurality of directions are multiply formed at an arbitrary point. Thereby, a parallax image having motion parallax in the horizontal direction is displayed to the observer 20. A more detailed display principle of the stereoscopic image by the image display device 1 will be described later.

  The photographing cameras 2A and 2B have, for example, a CCD (Charge Coupled Device) image sensor, and photograph the head of the observer 20 in real time. The reason why two photographing cameras 2A and 2B are installed is to detect a three-dimensional viewpoint position by the principle of triangulation. Three or more photographing cameras 2A and 2B may be installed. Imaging signals from the imaging cameras 2A and 2B are output to the relative position calculation unit 3.

  The relative position calculation unit 3 detects a three-dimensional viewpoint position based on the imaging results of the imaging cameras 2A and 2B. For example, the relative position calculation unit 3 detects the positions of the right eye 21R and the left eye 21L of the observer 20, and detects the midpoint 22 (see FIG. 6) as the viewpoint position. In this case, the detection of the right eye 21R and the left eye 21L can be performed by image processing, for example. For example, there is a method of detecting the right eye 21R and the left eye 21L by comparing a template of a human face image prepared in advance with a face image of the observer 20 actually taken. Further, the photographing cameras 2A and 2B are provided with means for irradiating infrared rays or the like so that the observer 20 is irradiated with infrared rays or the like and the eyeball positions of the right eye 21R and the left eye 21L are detected directly from the reflected light. Also good.

  The relative position calculation unit 3 also calculates a relative viewpoint position with respect to the image display device 1 based on the detected viewpoint position. More specifically, for example, the center position (X0, Y0, Z0) of the screen 11 of the image display device 1 is set as the reference coordinates (0, 0, 0), and the coordinates (X1, Y1, Z1) of the viewpoint position relative thereto are set. The relative viewpoint position is calculated. The relative position calculation unit 3 has information on the installation positions of the photographing cameras 2A and 2B and information on the arrangement position of the screen 11 in advance.

The relative position calculation unit 3 includes a CPU (Central Processing Unit), a ROM (Read Only Memory), and a RAM (Random Access Memory), and the CPU executes a predetermined calculation program stored in the ROM using the RAM as a working area. By doing so, the calculation for the above-mentioned relative position detection is performed.
In the present embodiment, the photographing cameras 2A and 2B and the relative position calculation unit 3 correspond to a specific example of “detection unit” in the present invention, and the relative position calculation unit 3 corresponds to “relative position calculation unit” in the present invention. This corresponds to a specific example.

  The image signal source input unit 4 provides basic image information to be displayed on the image display device 1. The image signal source input unit 4 has a recording medium such as a magnetic recording medium or an optical recording medium, and stores the image information. For example, a stereoscopic image to be displayed on the image display device 1 is captured in advance from a plurality of directions by a photographing device, image information necessary for stereoscopic image display is prepared, and stored in a recording medium. Note that image information created by 3DCG may be used instead of actually captured. The image signal source input unit 4 provides image information necessary for arithmetic processing for performing a three-dimensional display of a display object within the viewing angle of the image display device 1.

  The display image generation unit 5 generates an image corresponding to the relative viewpoint position calculated by the relative position calculation unit 3 as an image to be displayed on the image display device 1. The display image generation unit 5 includes a CPU, a ROM, and a RAM, and the CPU generates an image by executing an image processing program stored in the ROM using the RAM as a working area. The display image generation unit 5 follows a change in the relative viewpoint position and generates an image to be displayed on the image display device 1 by performing a rendering process using a 3DCG rendering technique in real time as needed. .

An operation for displaying a stereoscopic image in the above system configuration will be described.
First, the basic principle of stereoscopic image display by the light beam reproduction method in the image display apparatus 1 will be described mainly with reference to FIG. In FIG. 2, image information for n sheets (a plurality of sheets) necessary for stereoscopic image display is prepared, and a stereoscopic image display mode using the image information for n sheets is schematically shown. For example, projection light is projected toward the screen 11 from one projection unit 10m of the projection unit 10 as indicated by arrows m1 to m5. Note that the light reflected by the mirror 12 disposed on the side surface is also incident on the screen 11 as indicated by an arrow m1 ′.

  The screen 11 is configured to have a minute predetermined diffusion angle in the horizontal direction, and the horizontal angle at which the light indicated by m1 ′, m2 to m5 passes through the screen 11 is held substantially constant. Here, the light indicated by the arrows m1 ′ and m2 to m5 projected from one projection unit 10m is a part of the plurality of pieces of image information P1 to Pn constituting the stereoscopic image divided in the vertical direction. The image information P2m to Pnm is displayed. This is because the screen 11 has a large diffusion angle in the vertical direction and a small predetermined diffusion angle in the horizontal direction, so information from one projection unit 10m is almost vertical. This is because it is diffused only in the direction and appears as a vertical line display. That is, assuming that the position of the screen 11 through which the light indicated by the arrows m1 ′ and m2 to m5 passes is a unit pixel, the vertical line constituting the stereoscopic image from the unit pixel extending in the vertical direction toward the eye 21 of the observer 20 The image information P2m to Pnm is emitted. In this case, the display information of the unit pixel adjacent to the screen 11 receives the display information from the adjacent projection unit in the eye 21. Therefore, by allowing necessary information from the plurality of projection units 10 to enter the eye 21, an image on the screen 11 that is observed by the left and right eyes 21 within the horizontal viewing angle can be obtained from the plurality of projection units. 10 appears as a composite image of vertical line display. In this case, if the screen 11 has a minute diffusion angle of, for example, less than about 1 ° in the horizontal direction, a good three-dimensional image can be obtained without generating a gap between these vertical lines displayed by each projection unit 10. Image display can be performed.

  The stereoscopic display image displayed on the image display device 1 based on the basic principle described above realizes only the motion parallax in the horizontal direction. That is, the image display device 1 itself does not support display of motion parallax in the vertical direction (Y direction) and the depth direction (Z direction). However, in the present embodiment, the image information itself given to each projection unit 10 of the image display device 1 is also changed corresponding to the motion parallax in the vertical direction and the depth direction (in real time according to the movement of the viewpoint position). As a result, it is possible to display a stereoscopic image corresponding to motion parallax in all three dimensions. An image corresponding to the motion parallax in all three dimensions is generated by the display image generation unit 5.

  The display image generation unit 5 generates an image corresponding to the motion parallax by performing a rendering process using a 3DCG rendering technique. For example, the rendering process is performed for each frame of an image displayed on the image display device 1. In the 3DCG rendering technology, a virtual camera is set, and an image that should be taken by the virtual camera is generated. The display image generation unit 5 uses the position of the virtual camera as the viewpoint position calculated by the relative position calculation unit 3, and generates an image that should be taken by the virtual camera. For example, as shown in FIG. 5, when the viewpoint position changes by a predetermined amount or more from (X1, Y1, Z1) to (X1 ± ΔX, Y1 ± ΔY, Z1 ± ΔY) (ΔX, ΔY, ΔY is For each of the movement amounts in the X, Y, and Z directions, the display image generation unit 5 generates an image corresponding to the change amount by rendering processing. That is, the display image generation unit 5 should set the viewpoint position (X1 ± ΔX, Y1 ± ΔY, Z1 ± ΔY) after the change to the position of the virtual camera and be photographed by the virtual camera. Generate an image. Thus, an image corresponding to motion parallax in the vertical direction (Y direction) and the depth direction (Z direction) is generated.

  Thus, specifically, for example, when the viewpoint position changes obliquely upward from the reference position (X0, Y0, Z0) of the screen 11 of the image display device 1, as shown in FIG. When the viewed image is displayed and, conversely, the viewpoint position changes obliquely below the reference position (X0, Y0, Z0), the image viewed obliquely from below is displayed as shown in FIG. . This is an example of a case where a rectangular parallelepiped-shaped stereoscopic image is displayed and the front of the rectangular parallelepiped is visible when viewed from the front of the screen 11. By performing such display, vertical motion parallax can also be reproduced.

As described above, according to the image display system according to the present embodiment, in the image display device 1 capable of stereoscopic display by the light beam reproduction method, the image display device 1 corresponds to the relative viewpoint position of the observer 20. Since the image corresponding to the motion parallax is calculated and displayed in real time, the image display device 1 that reproduces the motion parallax only in the horizontal direction by the light ray reproduction method is not only congested but also completely In addition, stereoscopic viewing by three-dimensional motion parallax can be easily realized. Thereby, a more natural stereoscopic view can be realized as compared with a stereoscopic display device by a conventional light beam reproduction method. Further, in the stereoscopic display based on the ray reproduction method, there is a problem that the aspect ratio of the object appears to change when the viewpoint position moves in the depth direction. Since the display image is changed according to the above, the problem is automatically solved.
[Second Embodiment]

  Next, a second embodiment of the present invention will be described. Note that components that are substantially the same as those of the image display system according to the first embodiment are denoted by the same reference numerals, and description thereof is omitted as appropriate.

  In the first embodiment, the case where the display device is a stereoscopic image display device based on the light beam reproduction method has been described as an example. However, in this embodiment, an image is separated using dedicated glasses, The present invention relates to a binocular stereoscopic display device that separately displays images having a parallax between the eyes and the right eye (parallax images). As dedicated glasses, there is a method using polarized glasses. In this case, the image display device 1 in FIG. 1 displays a left-eye image and a right-eye image having different polarization directions. The observer 20 observes the left eye image and the right eye image separately through the polarized glasses. Although the image itself displayed on the image display device 1 is a two-dimensional image, stereoscopic images using binocular parallax are displayed by separately displaying parallax images (parallax images) for the left eye and the right eye. Is realized. Note that a method using dedicated glasses equipped with an electronic shutter may be used. In this case, the image display device 1 displays the left-eye image and the right-eye image by switching in a time-sharing manner. The observer 20 observes the image for the left eye and the image for the right eye separately through time-division through dedicated glasses, thereby realizing stereoscopic viewing using binocular parallax.

  In the present embodiment, the image signal source input unit 4 provides basic image information to be displayed on the image display device 1. In the present embodiment, the image signal source input unit 4 provides only the image information necessary for the stereoscopic calculation by the stereoscopic display device. In the present embodiment, the relative position calculation unit 3 separately detects the three-dimensional viewpoint positions of both eyes of the observer 20 based on the imaging results of the imaging cameras 2A and 2B. The relative position calculation unit 3 also calculates the relative viewpoint positions of the left eye and the right eye with respect to the image display device 1 based on the detected viewpoint position. In this case, the use of the dedicated glasses 30 as shown in FIG. 7 facilitates detection of the viewpoint position. The dedicated glasses 30 are provided with a mark 31 for detecting the viewpoint position. The mark 31 has a higher contrast than that of the human eye and has a specific shape with a clear outline. Providing such a mark 31 makes it easy for the relative position calculation unit 3 to detect the left and right viewpoint positions by image processing.

  Further, in the present embodiment, the display image generation unit 5 displays an image corresponding to the relative binocular viewpoint position calculated by the relative position calculation unit 3 on the image display device 1 and the left-eye image. Generated as an image for the right eye. Here, an image displayed on a general binocular stereoscopic display device does not correspond to motion parallax at all. That is, even if the viewpoint position of the observer 20 changes, the image displayed on the display device does not change. On the other hand, in the present embodiment, the image information itself given to the image display device 1 is changed corresponding to the motion parallax in the horizontal direction, the vertical direction, and the depth direction (changes in real time according to the movement of the viewpoint position). ) As a result, stereoscopic images corresponding to motion parallax can be displayed in all three-dimensional directions. The display image generation unit 5 generates images for the left eye and the right eye corresponding to the motion parallax for all three dimensions.

According to the image display system according to the present embodiment, in an image display apparatus capable of stereoscopic viewing using binocular parallax, an image corresponding to the relative viewpoint position of the observer's eyes with respect to the image display apparatus, that is, motion An image corresponding to the parallax is displayed. Accordingly, in addition to binocular parallax, motion parallax can be realized, and more natural stereoscopic vision including convergence can be realized as compared with a conventional stereoscopic display device using binocular parallax.
[Third Embodiment]

  Next, a third embodiment of the present invention will be described. Note that components that are substantially the same as those of the image display system according to the first or second embodiment are denoted by the same reference numerals, and description thereof is omitted as appropriate.

  In the present embodiment, a two-dimensional image display device is used as the image display device 1. That is, a display device such as a general liquid crystal display monitor is used as the image display device 1 instead of a special display device for stereoscopic viewing. In the present embodiment, the image signal source input unit 4 provides basic image information to be displayed on the image display device 1.

  In the present embodiment, as in the first embodiment, the relative position calculation unit 3 uses, for example, the midpoint 22 (see FIG. 6) of the right eye 21R and the left eye 21L of the observer 20 as the viewpoint position. To detect. The relative position calculation unit 3 also calculates a viewpoint position relative to the image display device 1 based on the detected viewpoint position.

  In the present embodiment, the display image generation unit 5 generates an image corresponding to the relative viewpoint position calculated by the relative position calculation unit 3 as a two-dimensional image to be displayed on the image display device 1. Here, an image displayed on a general two-dimensional image display device does not correspond to motion parallax at all. That is, even if the viewpoint position of the observer 20 changes, the image displayed on the display device does not change. On the other hand, in the present embodiment, the image information itself given to the image display device 1 is changed corresponding to the motion parallax in the horizontal direction, the vertical direction, and the depth direction (changes in real time according to the movement of the viewpoint position). ) As a result, stereoscopic images corresponding to motion parallax can be displayed in all three-dimensional directions. An image corresponding to the motion parallax in all three dimensions is generated by the display image generation unit 5.

According to the image display system according to the present embodiment, an image corresponding to the relative viewpoint position of the observer 20 with respect to the two-dimensional image display device, that is, an image corresponding to motion parallax is displayed on the two-dimensional image display device. . Thereby, for example, using a normal two-dimensional image display device that does not display a binocular parallax image, motion parallax can be realized, and pseudo three-dimensional display (image display corresponding to a three-dimensional viewpoint position) is possible. .
[Other embodiments]

  The present invention is not limited to the above embodiments, and various modifications can be made. For example, in the second embodiment, a method for realizing binocular parallax using dedicated glasses has been described. However, binocular parallax can be performed with the naked eye without using dedicated glasses such as a lenticular method or a parallax barrier method. The present invention can be applied even if the stereoscopic display is realized. Also in this case, the display image generation unit 5 generates an image corresponding to the binocular viewpoint position calculated by the relative position calculation unit 3 as a left-eye image and a right-eye image to be displayed on the image display device 1. By doing so, motion parallax can be realized.

1 is an overall configuration diagram illustrating a configuration example of an image display system according to a first embodiment of the present invention. It is explanatory drawing which shows the internal structure of the image display apparatus by a light beam reproduction method, and the principle of an image display. It is explanatory drawing which shows the principle of the image display by a light ray reproduction method. It is explanatory drawing which shows an example of the image produced | generated according to a viewpoint position. It is explanatory drawing which shows the relative positional relationship of a viewpoint position and the screen of an image display apparatus. It is explanatory drawing of the viewpoint position detected in the image display system which concerns on the 1st Embodiment of this invention. It is a block diagram which shows an example of the exclusive spectacles used with the image display system which concerns on the 2nd Embodiment of this invention.

Explanation of symbols

  DESCRIPTION OF SYMBOLS 1 ... Image display apparatus, 2A, 2B ... Shooting camera, 3 ... Relative position calculation part, 4 ... Image signal source input part, 5 ... Display image generation part, 10 ... Projection part, 11 ... Screen, 12 ... Mirror, 20 ... Observer, 21 ... eyes, 30 ... dedicated glasses, 31 ... landmark.

Claims (11)

A two-dimensional image display device;
Detection means for detecting the three-dimensional position of the eye of the observer;
A relative position calculating means for calculating a relative viewpoint position of the observer with respect to the two-dimensional image display device based on a detection result of the detecting means;
An image display system comprising: an image generation unit configured to generate an image corresponding to the relative viewpoint position as an image to be displayed on the two-dimensional image display device. The detection means includes a plurality of photographing means for photographing the observer, and the relative position calculation means calculates the relative viewpoint position based on the images of the observer photographed by the plurality of photographing means. The image display system according to claim 1, wherein: 2. The image according to claim 1, wherein the image generation unit generates an image to be displayed on the two-dimensional image display device by performing a rendering process at any time following the change in the relative viewpoint position. Display system. An image display device that displays an image for the left eye and an image for the right eye on both eyes of the observer;
Detecting means for detecting a three-dimensional position of both eyes of the observer;
Relative position calculation means for calculating relative viewpoint positions of the left and right eyes of the observer with respect to the image display device based on the detection result of the detection means;
An image display system comprising: an image generation unit configured to generate an image corresponding to the relative viewpoint position as the left-eye image and the right-eye image displayed on the image display device. The detection means includes a plurality of photographing means for photographing the observer, and the relative position calculation means calculates the relative viewpoint position based on the images of the observer photographed by the plurality of photographing means. The image display system according to claim 4, wherein: 5. The image display system according to claim 4, wherein the image generation unit generates an image to be displayed on the image display device by performing a rendering process at any time following the change in the relative viewpoint position. . Stereoscopic glasses for separating the image from the image display device into the left-eye image and the right-eye image in both eyes of an observer,
The image display system according to claim 4, wherein the stereoscopic glasses are provided with a mark for the detection unit to detect the positions of both eyes of the observer. An image display device for displaying a three-dimensional image by a light beam reproduction method;
Detection means for detecting the three-dimensional position of the eye of the observer;
A relative position calculating means for calculating a relative viewpoint position of the observer with respect to the image display device based on a detection result of the detecting means;
An image display system comprising: an image generation unit configured to generate an image corresponding to the relative viewpoint position as an image to be displayed on the image display device. The detection means includes a plurality of photographing means for photographing the observer, and the relative position calculation means calculates the relative viewpoint position based on the images of the observer photographed by the plurality of photographing means. The image display system according to claim 8. The image display system according to claim 8, wherein the image generation unit generates an image to be displayed on the image display device by performing a rendering process at any time following the change in the relative viewpoint position. . The image display device includes a plurality of projection means for projecting spatially modulated light, and a screen on which the projection light from the plurality of projection means is projected. The image display system according to claim 8, wherein the image is displayed.

Images