JP2005026772A - Method and apparatus of displaying stereoscopic video image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a method and an apparatus of displaying a stereoscopic video image which are capable of appropriately displaying contents having a common resolution on displays having different screen sizes while using a reproducing lens array of the same lens spacing. <P>SOLUTION: An image photographed by a camera 100 (CAM 01) is displayed on a region A01 of a two-dimensional display 200, and an image photographed by a camera 100 (CAM 02) is displayed on a region A02 of the two-dimensional display 200. The display image is constituted without allowing the regions A01 and A02 or the regions A01 and A11 to be adjacent, so that interpolation regions (B01, C01, D01) are provided therebetween. <P>COPYRIGHT: (C)2005,JPO&NCIPI

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to a stereoscopic image display method and a stereoscopic image display device, and relates to an IP (Integral Photography) type three-dimensional display capable of stereoscopic viewing with the naked eye.
[0002]
[Prior art]
In recent years, research and development of three-dimensional (3D) displays that display objects in three dimensions has become active due to advances in display devices centered on liquid crystals and digital signal processing technology using computers, and 3D displays and 3D televisions compatible with personal computers have appeared. Applications are progressing rapidly.
Many display methods have been proposed for 3D displays, but can be broadly divided into 3D display methods that require special glasses and 3D displays without glasses.
[0003]
For 3D displays that require special glasses, the anaglyph method for viewing with 3D photographs and 3D movies and the red / blue glasses that have been used for a long time, the polarization filter method often used in expositions, and the visual Purflich effect There is a density difference method using. In addition, a head-mounted display, which is a goggle-type stereoscopic video display device, and a time-division stereoscopic television system using a liquid crystal shutter as a stereoscopic television have been put into practical use and are used in various fields.
[0004]
On the other hand, many 3D display systems without glasses have been proposed so far. Typical methods include a parallax stereogram, a parallax panoramagram, and a lenticular screen method. These were all used in the field of stereoscopic photography, but recently, research into application to stereoscopic television has become active, and high-quality stereoscopic video display has become possible.
Recently, several new 3D display systems without glasses have been proposed. In particular, stereoscopic photography technology called IP (Integral Photography: Integral Photography, or Integrated Imaging) published in 1908 by Lippmann is a visual factor that produces stereoscopic effects, such as “convergence”, “regulation”, Since all four factors of “binocular parallax” and “motion parallax” can be satisfied, application to an ideal three-dimensional display is expected (see, for example, Non-Patent Document 1). The IP acquires the depth information of an object using a two-dimensionally arranged lens array (also referred to as a fly-eye lens, eyelid lens, compound eye lens, etc.). It was after the 1980s that research and development for practical application became active due to the difficulty of manufacturing arrays.
[0005]
One of the initial proposals for putting IP technology into practical use is the “XYZ plotter” by the present applicant (see, for example, Patent Document 1). In the recording, at the time of recording, the light intensity distribution of the three-dimensional object input as numerical data is output to a point light source on a movable XYZ stage and scanned, so that the three-dimensional object is scanned in real space. While expressing as a locus of points, the three-dimensional object is imaged as a group of multi-viewpoint images (called element images) viewed through each lens by a fly-eye lens and recorded on a photographic plate. At the time of reproduction, each element image group formed by the lens array is formed in space by illuminating the element image group, which has been subjected to appropriate development processing, from behind. At this time, since the path of the light beam is reversible, each light beam is reproduced at the position of the original point light source trajectory, and the observer integrates each image of the element image group with the eye and smoothes it. As a result, it can be recognized as an image of a three-dimensional object floating in the space. The three-dimensional image obtained by the proposal was a still image, but the research of the inventor pioneered the path to medical application (see, for example, Non-Patent Document 2), and a patented invention that enables application to surgery. Has also been proposed (see, for example, Patent Document 2).
[0006]
In the 1990s, a technique for generating a moving image by IP was proposed by replacing the recording by a conventional photographic plate with electronic technology (see, for example, Patent Document 3). Furthermore, by the same inventor's hand, each image is transmitted to the liquid crystal display in real time while taking an image of the subject using a gradient index lens array (also referred to as a GRIN lens array) and a high-vision camera to obtain a group of element images. The image was successfully displayed and imaged in space with a fly-eye lens, and the feasibility of 3D television broadcasting by the IP system was shown (for example, see Non-Patent Document 3).
At present, because the pixel spacing of the image sensor and display element is coarse, the resolution of the obtained stereoscopic image is low, and it has not been put to practical use, but due to the advancement of high definition display technology accelerated by modern nanotechnology, It is expected that an IP type three-dimensional display will be put to practical use in the not too distant future.
[0007]
[Patent Document 1]
Japanese Patent No. 1897532
[0008]
[Patent Document 2]
Japanese Patent No. 2856052
[0009]
[Patent Document 3]
JP 08-289329 A
[0010]
[Non-Patent Document 1]
Takayoshi Ohkoshi, “Three Dimensional Image Engineering”, Asakura Shoten (1991)
[0011]
[Non-Patent Document 2]
M.M. Iwahara, Y .; NISHI, N.I. SUZUKI, Med. Imag. Tech. Vol. 11 No. 5 December 1993 "Touchable Organic Image in the Air by Using 3-D Plotter"
[0012]
[Non-Patent Document 3]
B. Javidi, F.A. Okano Editors, “Three-Dimensional Television, Video, and Display Technologies” Springer-Verlag (2002), P101-P123.
[0013]
[Problems to be solved by the invention]
Now, the (horizontal) resolution of the stereoscopic video reproduced by the IP method according to each of the above-mentioned documents varies depending on the distance from the observer, and becomes maximum when the image is in the vicinity of the fly-eye lens. As shown in FIG. 11, such maximum resolution is determined by the lens interval Pe of the fly-eye lens 300 and the viewing distance (that is, the distance between the fly-eye lens and the observer) L. If this is expressed as β (number of lines per unit viewing angle), there is a relationship of β = L / 2Pe. From this equation, it can be seen that if the resolution β is constant, the viewing distance L and the lens interval Pe are in a proportional relationship.
[0014]
Here, if the viewing distance L is defined as a minimum distance that does not matter about the structure of the fly-eye lens, the viewing distance L is proportional to the screen size of the display. Therefore, the lens interval Pe is proportional to the screen size. In other words, if the height of the screen is H, the relationship Pe∝H is established, and it is necessary to prepare fly-eye lenses with different lens intervals according to the screen size.
[0015]
However, in consideration of the difficulty in manufacturing a fly-eye lens, it is preferable that the lens interval of the fly-eye lens is common even for displays having different screen sizes.
However, there are various display sizes such as televisions, theater systems, personal computers, personal digital assistants, etc. If a common lens array is used for displays with different screen sizes, it is natural that the screen size is different. If it is small, there is a problem that the resolution of the stereoscopic video becomes insufficient.
[0016]
Further, in order to prevent such inconvenience, it is only necessary to prepare a content with a resolution corresponding to the screen size to be used. However, in order to prepare content with a resolution according to the screen size, there is a problem that a bidirectional connection is required to acquire the size information of the display of each home when performing television broadcasting or Internet distribution. It was.
[0017]
The present invention has been made in view of the above points, and it is possible to appropriately display content having a common resolution on a display having a different screen size while using a reproduction lens array having the same lens interval. It is an object to provide a stereoscopic video display method and a stereoscopic video display device.
[0018]
[Means for Solving the Problems]
In order to solve the above problems, the present invention comprises the following means 1) to 2).
That is,
1) At the time of imaging, the subject was divided and imaged by the cameras installed on the substantially focal planes of the eyes of the compound eye-shaped stereoscopic image capturing lens, and the divided images acquired by the imaging were assembled. An image group is displayed on a two-dimensional display, and at the time of reproduction, a reproduction lens having the same configuration as the stereoscopic image photographing lens, or an eye having the same size as each eye is arranged in a compound eye shape, and at the time of imaging. A stereoscopic image that enables stereoscopic viewing of the subject by forming an image of the image group displayed on the two-dimensional display by using a reproducing lens having an external shape with the same ratio as the external size of the stereoscopic image capturing lens to be used. In the video display method,
Capturing a captured image portion corresponding to each of the eyes of the compound eye constituting the stereoscopic image capturing lens;
Generating a plurality of interpolated image portions based on the captured image portions;
Subdividing the imaging region portion corresponding to each eye to generate the display image by arranging the captured image portion and the plurality of interpolation image portions;
Displaying the generated display image on a two-dimensional display;
And having the reproduction lens of the same pitch formed into a size corresponding to the size of the two-dimensional display when the display image displayed on the two-dimensional display is formed by the reproduction lens. A featured stereoscopic image display method.
2) At the time of imaging, the subject is divided and imaged by moving the camera on the substantially focal plane of each eye of the compound eye-shaped stereoscopic image capturing lens, and the divided images acquired by the imaging are assembled. An image group is displayed on a two-dimensional display, and at the time of reproduction, a reproduction lens having the same configuration as the stereoscopic image photographing lens, or an eye having the same size as each eye is arranged in a compound eye shape, and at the time of imaging. A stereoscopic image that enables stereoscopic viewing of the subject by forming an image of the image group displayed on the two-dimensional display by using a reproducing lens having an external shape with the same ratio as the external size of the stereoscopic image capturing lens to be used. In a stereoscopic video display device for stereoscopic video used for video display,
Illumination means for illuminating the object;
Imaging means for forming an image of scattered light from the object by the illumination means on an imaging device;
Moving means for moving the imaging means in order to obtain captured image portions corresponding to the respective eyes of the compound eye constituting the stereoscopic image photographing lens;
Interpolated image part generating means for generating a plurality of interpolated image parts based on the captured image part;
Signal processing means for generating a display image by subdividing the imaging region portion corresponding to each eye and arranging the captured image portion and the plurality of interpolation image portions;
Planar display means for displaying the display image obtained from the signal processing means;
Imaging means for imaging light rays of the display image radiated by the flat display means in real space, and the imaging means has a reproduction lens of the same pitch according to the size of the flat display means. A stereoscopic image display device characterized by forming an image with a size.
[0019]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, preferred embodiments of the stereoscopic image display method and stereoscopic image display apparatus according to the present invention will be described.
FIG. 1 is a diagram showing an arrangement of element images applied to the present embodiment. The two-dimensional display 200 shown in the figure has multi-viewpoint images Amn, Bmn, Cmn, Dmn (m, m) taken by a plurality of cameras 100 (CAMmn where m, n = 0, 1, 2, 3...). n = 0, 1, 2, 3,...) are displayed. As the two-dimensional display 200, a high-definition display such as an LCD, organic EL, or LCOS projector is used. The camera 100 uses a combination of a fly-eye lens 300 and a video camera when shooting a real image, that is, a three-dimensional object 50 in a real space. In this embodiment, the camera 100 is on a virtual space using CG (computer graphics). Consider a virtual camera 100 that captures light rays from the three-dimensional object 50.
An image captured by the camera (CAM00) is displayed in the area A00 of the two-dimensional display 200. On the other hand, the image captured by the camera (CAM01) is displayed in the area A01 of the two-dimensional display 200. Similarly, an image taken by a camera (CAMij) (where i, j = 0,1,2,3...) Is an area Aij (i, j = 0,1,2,3) of the two-dimensional display 200. ...) is displayed.
In this embodiment, the regions Aij and Ai + 1, j or the regions Aij and Ai, j + 1 are not adjacent to each other, and an interpolation region (Bij, Cij, Dij) for displaying an image different from Aij is provided between them. Yes.
[0020]
FIG. 2 is a diagram showing a conventional arrangement of element images. In the conventional arrangement of element images, the element image Aij captured by the camera 100 is displayed as it is on the two-dimensional display 200a. Then, as shown in FIG. 10, for 200b or 200c having different display sizes, the size of the element image Aij is set to the display size in order to display a stereoscopic image with the same resolution at the optimum viewing distance. It is necessary to change in proportion. As a result, the size of the element lens Lij (shown in FIG. 7) that constitutes the fly-eye lens 300 that forms these element images Aij must also be changed.
[0021]
FIG. 3 is a diagram illustrating a configuration of a stereoscopic video display device applied to the present embodiment. The stereoscopic image display apparatus shown in the figure includes a light source 10, a three-dimensional object 50, a camera 100, a two-dimensional display 200, a fly-eye lens 300, and a three-dimensional object reproduction image 500.
The light source 10 illuminates the three-dimensional object 50, and the scattered light enters the lens of the camera 100. The camera 100 is a camera that can photograph the three-dimensional object 50 from a plurality of viewpoints. Specifically, it may be a camera equipped with a compound eye lens or a single camera that can move to a plurality of viewpoints. Also, a plurality of monocular lens cameras may be used. The two-dimensional display 200 is an element that displays a list of images (element images Aij) obtained by viewing the three-dimensional object 50 taken from the camera 100 from different angles. The fly-eye lens 300 is an optical element that projects each of the element images Aij displayed on the two-dimensional display 200 onto a real space using a lens. A reproduced image 500 of a three-dimensional object is an aggregate of element images projected by such an optical element and formed as a real image (or a virtual image).
[0022]
FIG. 4 is a flowchart showing an algorithm for generating an element image applied to this embodiment. In step S1, modeling of the three-dimensional object 50 is performed. This is generally performed using three-dimensional CG creation software called a modeler. Next, in step S2, a scene file is created. A scene refers to the entire scene created by 3D CG. In addition to the three-dimensional object 50 (object) created in step S1, the scene requires at least three elements of the light source 10 and the camera 100. In determining these coordinate systems, the relative positional relationship between the three-dimensional object 50 and the camera 100 is the same as that of a display system (two-dimensional display 200, fly-eye lens 300, three-dimensional object reproduction image 500) described later. It should be noted that Therefore, if the relative positional relationship between the three-dimensional object 50 and the camera 100 is set too far, the reproduced image 500 of the three-dimensional object is reproduced away from the fly-eye lens 300 during display. Therefore, there arises a problem that the image is deteriorated. Therefore, the coordinates of the three-dimensional object 50 are determined so that the reproduced image 500 of the three-dimensional object is within the range of the area without image degradation determined by the system design.
[0023]
When the creation of the scene file is finished, in step S3, the camera is moved to the viewpoint position CAMij (ij = 0, 1, 2,...) At an angle at which the three-dimensional object 50 is to be photographed. Also, the rendering conditions such as the output file size and file format are set.
[0024]
When the setting of the camera position and other rendering conditions is completed, scene rendering is started in step S4. Specifically, the light ray incident on the set camera position is calculated by ray tracing (ray ray tracing method). When the rendering of the desired image size is completed, the element image Aij (ij = 0, 1, 2,...) Is output as a file in step S5. The processing from step S3 to step S5 is repeated until shooting is completed at all viewpoints (No in step S6).
[0025]
When shooting of all viewpoints is completed (Yes in step S6), new element images Bij, Cij, and Dij are converted from the acquired element images by image conversion Bij = MAij, Cij = MAij, Dij = MAij (M is a conversion matrix). Convert. When M is a unit matrix, Aij = Bij = Cij = Dij (step S7). In step S8, these element images are jointed (connected). This process is repeated until the joint of all the element images is completed (No in step S9). Finally (Yes in step S9), when all the element images are connected, the arrangement of the element images shown in FIG. 1 is obtained. .
[0026]
FIG. 5 is a conceptual diagram showing an imaging system of a stereoscopic video display apparatus applied to the present embodiment. The imaging system shown in the figure is a system constructed in a virtual XYZ space, and includes a light source 10, a three-dimensional object (cone) 50a, a three-dimensional object (cube) 50b, a three-dimensional object (sphere) 50c, and a camera. 100.
[0027]
The light source 10 is for illuminating the three-dimensional objects 50a to 50c. Various types of light sources such as point light sources, surface light sources, and spotlights can be created. Imaging by ray tracing (ray tracing method) described below is performed by tracing a light ray incident on the camera in the direction of the light source 10.
[0028]
The three-dimensional objects 50a to 50c are composed of a shape and a texture (texture). The three-dimensional object (cone) 50a has a cone shape and a marble texture. On the other hand, the three-dimensional object (cube) 50b has a cubic shape and a texture of wood. The three-dimensional object (cube) 50c is a metal having a spherical shape and a glossy texture. The textures of these three-dimensional objects are so-called solid models that have information inside and are filled with contents.
[0029]
The camera 100 is composed of a total of nine cameras: CAM00, CAM01, CAM02, CAM10, CAM11, CAM12, CAM20, CAM21, and CAM22. Here, only nine cameras are shown for convenience, but in reality, more cameras are used. It is only necessary to use the number of cameras equal to the (horizontal) resolution of the stereoscopic video to be displayed later. For example, when it is desired to display the same resolution as high-definition broadcasting (the number of effective pixels: horizontal 1920 pixels × vertical 1080 pixels), 1920 horizontal cameras and 1080 vertical cameras are used. Alternatively, one camera (CAM00) may be moved in parallel in the horizontal and vertical directions to perform shooting 1920 times horizontal × 1080 times vertical.
[0030]
Each of these cameras takes an image with a certain point as a gazing point. For example, FIG. 5 shows a state where all the cameras CAM00 to CAM01 are gazing at the tip of the cone. If it does so, the image which looked at the tip of a cone from nine angles of up and down, right and left can be photoed, and the depth information on three-dimensional object 50a can be acquired.
[0031]
Photographing is performed by ray tracing (ray tracing method). The light incident on the camera is a light beam that is scattered at the tip of the cone among the light rays emitted from the light source 10 and enters the entrance pupil of the camera. Therefore, it is not necessary to calculate all of the light emitted from the light source 10, and it is performed by tracing the light beam incident on the camera in the reverse direction. The number of rays to be traced is determined by the resolution of the display system to be displayed later (particularly, the resolution of the element image to be displayed per lens). For example, when the two-dimensional display 200 capable of displaying 100 × 100 pixels per lens is used, 100 × 100 = 10000 rays are traced per camera even in imaging.
[0032]
FIG. 6 is a conceptual diagram showing a display system applied to this embodiment. The display system shown in the figure includes a two-dimensional display 200 and a fly-eye lens 300. Further, in the figure, a reproduction image 500a of a three-dimensional object (cone) displayed by the display system, a reproduction image 500b of a three-dimensional object (cube), a reproduction image 500c of a three-dimensional object (sphere), and a human eye 400 are shown. Is shown.
[0033]
The two-dimensional display 200 displays the element images (Aij) captured by the plurality of cameras (CAMij) described above in a matrix. The arrangement is performed according to the rules shown in FIG. 1 or 2 as described above. Further, at the time of display, the size of each element image should be matched with the size of the element lens Lij (i, j = 0, 1, 2,...) (Shown in FIG. 7) of the lens array 300. is required.
[0034]
The fly-eye lens 300 is an optical element for forming each element image (Aij) displayed on the two-dimensional display 200 as a real image (or virtual image) in real space. A pinhole array, a GRIN lens array, or the like can be used as long as it has an imaging function, instead of a refractive lens such as a convex lens array as shown. The pinhole array is promising because it can be digitized if a liquid crystal display (LCD) or the like is used. However, it is known that there is a loss of light amount and there is a problem in high resolution. Since the GRIN lens array can form an erect image, if it is used for imaging a three-dimensional object in real space, the problem of so-called false images and crosstalk between adjacent lenses can be solved. Further, by forming a diffractive optical element on the surface of the refractive lens, it is possible to manufacture a lens that is made of a single material but has reduced chromatic aberration.
[0035]
Note that an air layer is preferably provided between the two-dimensional display 200 and the fly-eye lens 300 as shown in FIG. As a result, the relative distance between the two can be adjusted, and the reproduced images 500a to 500c of the three-dimensional object can be displayed as real images as shown in the figure (when it is larger than the effective focal length of the fly-eye lens 300), or the display This is because a virtual image can be displayed on the other side of the lens (in the case where it is smaller than the effective focal length of the fly-eye lens 300).
[0036]
FIG. 7 is a perspective view of a fly-eye lens 300 applied to this embodiment. The fly-eye lens shown in the figure is illustrated as a lens array having 5 × 5 element lenses for convenience, but actually, a larger number of lens arrays are used. The number of element lenses (Lij) may be the same as the number of (stereoscopic) resolutions of stereoscopic images to be displayed later. For example, when it is desired to display at the same resolution as the high-definition broadcast, 1920 horizontal and 1080 vertical element lenses are used.
[0037]
In this embodiment, the aperture shape of the element lens is a square. This is to make it coincide with the aperture shape of the pixel of the two-dimensional display 200. Compared with the case where the aperture shape is circular, not only can the loss of light amount be reduced, but also the system design can be simplified.
The surface shape of the fly-eye lens is determined as follows. That is, the light beam from the element image Aij is obtained by the ray tracing method, and the lens shape is determined so that the spot diameter focused at a desired position is as small as possible. The reasons for increasing the spot diameter include Seidel's five aberrations (spherical aberration, coma aberration, astigmatism, field curvature, distortion aberration) related to monochromatic aberration. Surface curvature is dominant. Optimization design is performed so that each aberration is balanced.
Regarding chromatic aberration, materials having different refractive indexes may be combined, or the chromatic aberration may be canceled using the dispersion characteristics of the diffractive optical element described above.
[0038]
FIG. 8 is a diagram illustrating a three-dimensional object in a virtual space applied to the present embodiment. The three-dimensional object (cone) 50a has a marble texture, and the three-dimensional object (cube) 50b has a wood texture. The three-dimensional object (sphere) has a metal texture. These three-dimensional objects are ordinary ray tracing software and are called primitives prepared in advance. Solid models with various shapes can be created by combining primitives.
[0039]
FIG. 9 is a diagram showing an element image displayed on the two-dimensional display applied to the present embodiment. These are arrangements of element images Aij obtained by imaging the above-described three-dimensional object with the camera 100. In this embodiment, since the F-number of the camera lens is as large as about 6, the field of view is narrow, so that it can be seen that only a part of each element image is captured. When the F-number is reduced and wide-angle shooting is performed by shortening the focal length of the lens or increasing the diameter of the element lens Lij, more information is captured in the element image Aij, The viewing zone angle can also be enlarged, but is more susceptible to lens aberrations.
[0040]
In the present embodiment, the description is limited to the three-dimensional CG based on ray tracing. However, the present invention is not limited to this, and can be applied to other rendering methods. Such signal processing can also be applied when shooting with a video camera.
[0041]
【The invention's effect】
As described above in detail, the present invention can use a lens array with the same lens interval for displays of different screen sizes, and can appropriately display content with a common resolution. There is an effect.
[Brief description of the drawings]
FIG. 1 is a diagram showing an arrangement of element images applied to this embodiment.
FIG. 2 is a diagram showing a conventional arrangement of element images.
FIG. 3 is a diagram illustrating a configuration of a stereoscopic video display device applied to the present embodiment.
FIG. 4 is a flowchart showing an algorithm for generating an element image applied to this embodiment.
FIG. 5 is a conceptual diagram illustrating an imaging system of a stereoscopic video display device applied to the present embodiment.
FIG. 6 is a conceptual diagram showing a display system applied to this embodiment.
FIG. 7 is a perspective view of a fly-eye lens applied to the present embodiment.
FIG. 8 is a diagram illustrating a three-dimensional object in a virtual space applied to the present embodiment.
FIG. 9 is a diagram showing an element image displayed on a two-dimensional display applied to the embodiment.
FIG. 10 is a diagram showing a conventional arrangement of element images.
FIG. 11 is a diagram for explaining the principle of IP.
[Explanation of symbols]
10 Light source
50 3D objects
50a 3D object (cone)
50b 3D object (cube)
50c 3D pig land (sphere)
100 cameras
200 2D display
300 Fly's eye lens
400 eyes
500 Reconstructed image of 3D object
500a Reconstructed image of 3D object (cone)
500b Reconstructed image of 3D object (cube)
500c Reconstructed image of 3D object (sphere)
Aij element image
Lij element lens
CAMij camera

Claims (2)

At the time of imaging, a group of images obtained by dividing each subject by a camera installed on a substantially focal plane of each eye of the compound eye-shaped stereoscopic image capturing lens and collecting the divided images acquired by the imaging Is displayed on a two-dimensional display, and at the time of reproduction, the reproduction lens having the same configuration as that of the stereoscopic image photographing lens, or an eye having the same size as each eye is arranged in a compound eye shape and used for imaging. Stereoscopic image display that enables stereoscopic viewing of the subject by forming the image group displayed on the two-dimensional display using a reproducing lens having an external shape with the same ratio as the external dimension of the stereoscopic image capturing lens In the method
Capturing a captured image portion corresponding to each of the eyes of the compound eye constituting the stereoscopic image capturing lens;
Generating a plurality of interpolated image portions based on the captured image portions;
Subdividing the imaging region portion corresponding to each eye to generate the display image by arranging the captured image portion and the plurality of interpolation image portions;
Displaying the generated display image on a two-dimensional display;
And having the reproduction lens of the same pitch formed into a size corresponding to the size of the two-dimensional display when the display image displayed on the two-dimensional display is formed by the reproduction lens. A featured stereoscopic image display method. At the time of imaging, an image group in which the subject is divided and imaged by moving the camera on the substantially focal plane of each eye of the compound eye-shaped stereoscopic image capturing lens, and the divided images acquired by the imaging are collected. Is displayed on a two-dimensional display, and at the time of reproduction, the reproduction lens having the same configuration as that of the stereoscopic image photographing lens, or an eye having the same size as each eye is arranged in a compound eye shape and used for imaging. Stereoscopic image display that enables stereoscopic viewing of the subject by forming the image group displayed on the two-dimensional display using a reproducing lens having an external shape with the same ratio as the external dimension of the stereoscopic image capturing lens In the stereoscopic video display device for stereoscopic video used for
Illumination means for illuminating the object;
Imaging means for forming an image of scattered light from the object by the illumination means on an imaging device;
Moving means for moving the imaging means in order to obtain captured image portions corresponding to the respective eyes of the compound eye constituting the stereoscopic image photographing lens;
Interpolated image part generating means for generating a plurality of interpolated image parts based on the captured image part;
Signal processing means for generating a display image by subdividing the imaging region portion corresponding to each eye and arranging the captured image portion and the plurality of interpolation image portions;
Planar display means for displaying the display image obtained from the signal processing means;
Imaging means for imaging light rays of the display image radiated by the flat display means in real space, and the imaging means has a reproduction lens of the same pitch according to the size of the flat display means. A stereoscopic image display device characterized by forming an image with a size.

Images