JP2003319418A - Method and device for displaying stereoscopic image - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a stereoscopic image display device that can display stereoscopic images to the user of the device without incongruity even when the direction of the line of sight of the user changes. <P>SOLUTION: This stereoscopic image display device comprises an image fetching section 11 which fetches curved-surface images photographed by dividing omniazimuth directions, an image selecting section 13 which selects curved- surface images for left and right eyes in accordance with the direction (b) of the line of sight of the user from among the plurality of curved-surface images fetched by means of the fetching section 11, and an image developing section 21 which develops the curved-surface images for left- and right-eyes selected by means of the selecting section 13 into planar images. This device also comprises an image segmenting range deciding section 22 which decides the image segmenting range for displaying the planar images, so that the parallax interval of the distance between display centers of the planar images may become equal to the distance between the photographed centers of the images, regardless of the direction of the line of sight of the user and an image output section 23 which outputs the images for left and right eyes segmented by means of the deciding section 22 to a stereoscopic image output section 15. <P>COPYRIGHT: (C)2004,JPO

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereo image display method and a stereo image display device.

[0002]

2. Description of the Related Art Conventionally, as a method of stereoscopically viewing the entire circumference of 360 degrees, there is a method of rotating two camera devices having different viewpoints for taking an image.
A mechanism for rotating 60 degrees is required, which makes the device itself complicated and increases the cost.

As a solution to such a drawback, there is one disclosed in Japanese Patent Application Laid-Open No. 11-220758. This stereo image display method generates a 360-degree panoramic image based on captured images taken in a plurality of directions, and measures the panoramic image in advance for a plurality of different viewpoints so that the observer can specify it. This realizes a stereoscopic view in the line-of-sight direction.

[0004]

According to the above display method, the camera device to be used is selected according to the line-of-sight direction to obtain a panoramic image, but the images taken by the two camera devices are displayed. If the line-of-sight direction changes at that time, the line-of-sight interval when displaying a stereo image changes, so a correct stereo image cannot be obtained, and if the line-of-sight direction changes continuously, the image to be viewed feels strange. There is a problem.

Therefore, it is an object of the present invention to provide a stereo image display method and a stereo image display device capable of displaying a stereo image without a feeling of strangeness even when the line-of-sight direction is changed.

[0006]

In order to solve the above-mentioned problems, the stereo image display method according to claim 1 of the present invention comprises:
This is a method of displaying a stereo image in an arbitrary line-of-sight direction by using two images out of the images captured by dividing the omnidirectional image, first by dividing the omnidirectional image and capturing the captured curved surface image, The curved images for the left eye and the right eye are developed into plane images according to the line-of-sight direction, respectively, and when these two plane images are displayed next, the parallax interval, which is the distance between the display centers, does not depend on the line-of-sight direction. The image cutout range for display in each of the plane images is determined so as to be equal to the distance between the photographing centers of the plane images, and then the cutout left-eye image and right-eye image are displayed in the image display unit. This is a method of displaying as a stereo image.

In the stereo image display method according to the second aspect of the present invention, among the images photographed by dividing all directions,
A method for displaying a stereo image in an arbitrary line-of-sight direction using two images, which is obtained by dividing a omnidirectional image and capturing a captured curved surface image, and then, according to the direction of the line of sight, two curved surfaces for the left eye and the right eye. Select an image, then expand the selected left-eye and right-eye curved images to a plane image respectively, and then when displaying both plane images, the parallax interval that is the distance between the display centers is Regardless of direction
The image cutout range for display in each of the plane images is determined so as to be equal to the distance between the photographing centers of the two plane images, and then the cutout left-eye image and right-eye image are displayed on the image display unit. It is a method of displaying as a stereo image.

The stereo image display method according to a third aspect of the present invention is the stereo image display method according to the second aspect, wherein when determining the image cut-out range, the reference straight line connecting the photographing centers is orthogonal. An image cutout with a predetermined width from both plane images with a correction distance δ shown by the following formula based on the intersection angle θ between the reference direction line This is a method of moving each range outward.

Δ = d (1-cos θ) / 2 (however, d
Indicates the distance between the photographing centers of both plane images) Furthermore, the stereo image display apparatus according to claim 5 of the present invention uses two images of the images photographed by dividing the azimuth in any direction to determine an arbitrary line of sight. A device for displaying a stereo image in all directions, which is an image capturing unit that captures a curved surface image that is captured in all azimuths, and a curved surface image captured by this image capturing unit Image development unit that develops into a two-dimensional image for the left and right eyes, and when displaying these two-dimensional images, the parallax interval, which is the distance between the display centers, is set to the distance between the photographing centers of the two-dimensional images regardless of the line-of-sight direction. The image cut-out range determination unit that determines the image cut-out range for display in each of the planar images and the left-eye and right-eye images cut out by the image cut-out range determination unit are stereoscopically arranged so as to be equal. On the image display It is composed of an image output unit for outputting.

According to a sixth aspect of the present invention, there is provided a stereo image display device, in which an image taken by dividing an omnidirectional image is
A device for displaying a stereo image in an arbitrary line-of-sight direction using two captured images, which is an image capturing unit that captures a curved surface image captured in all azimuths and captured by this image capturing unit. From a plurality of curved surface images, an image selection unit that selects a curved image for the left eye and a curved image for the right eye according to the direction of the line of sight,
An image development unit that develops the left-eye and right-eye curved surface images selected by the image selection unit into two-dimensional images and a parallax interval that is the distance between the display centers when displaying these two-dimensional images. An image cutout range determination unit that determines an image cutout range for display in each of the two plane images so that the distance is equal to the shooting center distance between the two plane images regardless of the direction, and the image cutout range determination unit. The left-eye image and the right-eye image cut out in (3) are configured by an image output unit for outputting to the stereo image display unit.

A stereo image display device according to a seventh aspect of the present invention is a stereoscopic image display device according to the sixth aspect, in which the image cutout range determining section is a reference direction line orthogonal to a reference straight line connecting the photographing centers. And a correction distance δ shown by the following equation based on an angle of intersection θ with a designated straight line passing through the midpoint of the reference straight line and including the line-of-sight direction, and outside the image cutout ranges cut out with a predetermined width from both plane images. It was designed to be moved to.

Δ = d (1-cos θ) / 2 (however, d
Represents the distance between the photographing centers of both plane images) Furthermore, the stereo image display device according to claim 8 of the present invention is the stereo image display device according to claim 7,
When the designated straight line does not pass through the midpoint of the reference straight line and shifts to one of the shooting center sides, a shift correction amount according to the shift amount is added to the correction distance of the image cutout range. Is.

According to the above-mentioned constitutions, the images taken by dividing the azimuth in all directions are taken in, the images are developed into the left-eye and right-eye two-dimensional images according to the line-of-sight direction, and then the respective two-dimensional images are predetermined. When cropping with the width, the image cropping range is moved outside so that the distance between the display centers that narrows according to the direction of the line of sight becomes the original line-of-sight distance, that is, the distance between the shooting centers. Therefore, when the omnidirectional image is displayed as a stereo image in an arbitrary line-of-sight direction, it can be displayed without a sense of discomfort.

[0014]

BEST MODE FOR CARRYING OUT THE INVENTION A stereo image display device and a stereo image display method according to a first embodiment of the present invention will be described below with reference to FIGS.

This stereo image display device displays an omnidirectional image and also displays a stereo image (stereoscopic image) in an arbitrary line-of-sight direction. In the present embodiment, four omnidirectional camera devices are provided.

First, a schematic structure of the omnidirectional camera device will be described. As shown in FIG. 1, the omnidirectional camera device 1 includes an image pickup section 2 having an image pickup element such as a CCD and one of the bilobed hyperboloids S arranged at a predetermined position in front of the image pickup section 2. The reflecting mirror unit 3 having the reflecting surface of the curved surface S ₁ is provided, and the image forming unit 2 is arranged such that the image forming position thereof is at the focal point of the other hyperboloid S ₂ .

In this camera device 1, as shown by the arrow a, the image of the object W seen from the focal point F ₁ (0,0, f) of _one hyperboloid S ₁ is the hyperboloid S _{2 of the} other. Focus of F ₂ (0,
The image is picked up by the image pickup unit 2 arranged at 0, -f). However, in FIG. 1, the center point O of the biplane hyperboloid S
Is the origin (0,0,0) of the x-y-z coordinate system, and the central optical axis in the omnidirectional camera device 1 is aligned with the z axis. Note that, in FIG. 1, the direction orthogonal to the paper surface is the x-axis.

Hereinafter, a stereo image display device using such an omnidirectional camera device 1 will be described in detail.
As shown in FIG. 2, this stereo image display device includes four omnidirectional camera devices (hereinafter referred to as camera devices) 1 (1) which are arranged on the same radius R centered on a predetermined reference point K.
A to 1D), an image capturing unit 11 for capturing a captured image captured by each of these camera devices 1, a desired direction of the omnidirectional image, that is, a reference coordinate axis (for example, y in FIG. 2).
The line-of-sight direction acquisition unit 12 that acquires (recognizes) the line-of-sight direction b having a predetermined angle α (referred to as the line-of-sight angle) with respect to the axis, and the line-of-sight angle α from the line-of-sight direction acquisition unit 12 An image selection unit 13 that selects two left-eye and right-eye camera devices 1 suitable for α, that is, a left-eye image image and a right-eye image image, and each image pickup selected by the image selection unit 13. A left-eye and right-eye image generation unit 14 (14A, 14B) that performs predetermined processing on the image to generate image data for stereo image display,
A stereo image display unit 15 that displays the stereo image by inputting the image data generated by both the image generation units 14.
It consists of and. It should be noted that in FIG. 2, the second camera device 1B and the fourth camera device 1D are shown on the x-axis as the first camera device 1B and the fourth camera device 1D.
The camera device 1A and the third camera device 1C are located on the y-axis, and the axis orthogonal to the paper surface is the z-axis.
For example, a head mounted display is used as the stereo image display unit 15, and the head mounted display inputs a desired line-of-sight direction, that is, a line-of-sight angle α by detecting eye movement. A line-of-sight direction input means capable of performing the above-mentioned line-of-sight direction input means is provided.
The line-of-sight angle α is input to.

First, the selection process in the image selection unit 13 will be described. In the image selection unit 13, the line-of-sight angle α (azimuth, xy
It is a clockwise angle from the y-axis on the plane), and which camera device 1 to use the captured image is selected based on the following equations (1) and (2). The expression (1) is an expression for selecting an image (camera device) for the left eye, and the expression (2) is an expression for selecting an image (camera device) for the right eye. The suffixes L of the symbols shown below represent the left eye side, and R represents the right eye side.

[0020]

[Equation 1] For example, if the line-of-sight angle α is 60 degrees, the value of C _L for the left eye is 1, the image captured from the first camera device 1 (1A) is selected, and the value of C _R for the right eye at this time is 2, the photographed image from the second camera device 1 (1B) is selected.

Next, the left-eye and right-eye image generators 14 (14A, 14B) will be described. Since both image generators have the same structure, only one of them will be described. That is, each image generation unit 14 is expanded by the image expansion unit 21 that expands the omnidirectional curved surface image captured in the donut shape (cylindrical shape) by the camera device 1 into a planar image, and the image expansion unit 21. An image cut-out range determination unit 22 that determines a cut-out image cut-out range according to the line-of-sight direction b by inputting a plane image, and a stereo image display unit that displays the image cut out by the image cut-out range determination unit 22 And an image output unit 23 for outputting to 15.

Next, the expansion processing in the image expansion unit 21 will be described. In the image developing unit 21, as shown in FIG. 3, the curved surface image captured by the camera device 1 on the x-y-z coordinate system is viewed using the coordinate conversion formula of the following formula (3). Image expansion is performed on a plane image on a plane M in the uv coordinate system that is orthogonal to the direction b and has its intersection as the center.

[0023]

[Equation 2] However, in the equation (3), α is the intersection angle of the projection line on the plane N in the line-of-sight direction b and the y-axis, and β is the focus F ₁ (0, 0,
It is the elevation angle in the line-of-sight direction b with respect to the plane N perpendicular to the z-axis passing through f).

Next, the processing in the image cutout range determining section 23 will be described. Usually, when a human sees an object, he / she feels based on the size of the parallax angle.
Therefore, even when a stereo image is obtained using images captured by two camera devices, the parallax angle (also referred to as parallax)
Need to consider.

That is, when the distance from the camera device to the object to be photographed is fixed to a constant value L (when the viewing angle is constant), the distance between the two camera devices (distance between the photographing centers, hereinafter referred to as the parallax interval). Say) also needs to be constant, so when viewing the image from any direction,
If this parallax interval is kept constant, it is possible to continuously recognize stereo images without feeling discomfort.

The parallax interval will be described below. Here, a description will be given for the projection, but basically the description will be made using the same positional relationship as in the case of photographing (the position of the camera device, but more precisely, the position of the reflection mirror section). Therefore, the symbols used when shooting are used as they are.

That is, as shown in FIG. 4, the line-of-sight direction b
In the case where the indicating straight line B including the two projection devices T and T passes through the midpoint C which is the center between the projection devices T and T on the reference straight line D connecting the centers of the two projection devices T and is orthogonal to each other, When an image is projected by T, T, the interval between the images projected by both the projection devices T, T becomes a parallax interval d which is a distance between photographing centers, and there is no problem in obtaining a stereo image, but as shown in FIG. In the case where the indicated straight line B intersects the reference direction line E that passes through the midpoint C of the reference straight line D but is orthogonal to the reference straight line D at a predetermined angle (hereinafter referred to as the line-of-sight deviation angle) θ. , The parallax interval becomes narrower from d to d (1-cos θ), and a stereoscopic image when the line-of-sight direction b is orthogonal to the reference straight line D is uncomfortable. That is, when the line-of-sight direction b is changed with respect to the reference direction line E that passes through the midpoint C and is orthogonal to the reference straight line D, there is no continuity between the stereo images displayed.

In order to eliminate such discontinuity, the image cut-out range determining section 22 does not depend on the line-of-sight direction b.
The correction process is always performed so that the parallax interval is constant.

Next, this correction process will be described. As shown in FIG. 5, when the line-of-sight direction b has a predetermined angle θ with respect to the reference direction line E, the distance d between the two projection devices T and T becomes d × cos θ and becomes narrower as described above. .

Therefore, the difference between the two, Δd = d (1-cos
The processing is performed so that each half (1/2) of α) is moved (shifted) outside the range cut out from the captured image.

For example, focusing on the projection device T _L for the left eye, the projected range, that is, the cut-out range is originally W.
When divided into both sides, the range is −W / 2 to + W / 2, while the range is shifted outward by d (1-cosα) / 2 minutes {-W / 2−d (1-cosα ) / 2} ~
The range is + W / 2-d (1-cosα) / 2}.
Of course, also in the projection device T _R for the right eye, similarly, d
(1-cos α) / 2 minutes each shifted outward {-
W / 2 + d (1-cosα) / 2} to + W / 2 + d (1
-Cos α) / 2}.

Also, regarding the distance to the projection plane of the image at this time, the distance from the intermediate reference straight line D'that passes through the midpoint C between the two projection devices T _L and T _R and is orthogonal to the instruction straight line B is predetermined. The distance L (so that the viewing angle is constant) is increased by d × sin α / 2 minutes for the left eye side and d × sin α / 2 for the right eye side.
The image is cut out so that it becomes closer by the amount. That is, the size of the image to be cut out is increased or decreased by the change in the distance in the front-back direction with respect to the projection plane.

In the above-mentioned structure, the four camera devices 1 (1A to 1D) are always used to take images in all directions, and the curved surface image taken with each of the camera devices 1 is taken by the image capturing section 11. When the line-of-sight direction b is input to the line-of-sight direction acquisition unit 12 from the line-of-sight direction input means provided in the head-mounted display that is the stereo image display unit 15, the line-of-sight direction b from here.
That is, the line-of-sight angle α is input to the image selection unit 13, where the line-of-sight direction b is based on the equations (1) and (2).
Two camera devices 1 suitable for capturing an image in are selected.

Then, the curved surface images from both camera devices 1 and 1 selected by the image selection unit 13 are coordinate conversion formula (3).
Is expanded into a predetermined plane image. Next, the line-of-sight deviation angle θ, which is the intersection angle of the designated straight line B including the line-of-sight direction b with respect to the reference direction line E in both camera devices 1 and 1, is obtained, and as described above, the image cut-out range determination unit 22 determines. By the correction processing based on the line-of-sight deviation angle θ, the cut-out range of the developed image is determined so that the parallax interval is constant.

The developed image determined by the image cut-out range determination unit 22 is passed through the image output unit 23 and is mounted on the head mount.
The stereo image is sent to the stereo image display unit 15 such as a display and the stereo image is displayed.

As described above, the four curved surface images photographed by the four omnidirectional camera devices are input, and the optimal curved surface images from the two camera devices according to the predetermined viewing direction are selected. The selected left-eye and right-eye curved images are developed into a plane image for projection, and then, when each plane image is cut out with a predetermined width according to the viewing angle, it becomes narrow according to the line-of-sight direction. Since the distance between the display centers is moved to the original line-of-sight distance, that is, the distance between the image-capturing centers, the image cutout range is moved to the outside, so that the omnidirectional image is stereo imaged in an arbitrary line-of-sight direction. When displaying as, it can be displayed without a feeling of strangeness.

Next, a stereo image display device and a stereo image display method according to the second embodiment of the present invention will be described with reference to FIG. In the first embodiment, the reference start point of the instruction line including the line-of-sight direction is the midpoint of the reference line connecting the two camera devices. However, in the second embodiment, the reference start point of the reference line is four. The starting point is the center point where the camera device is arranged.

The second embodiment differs from the first embodiment only in the method of correcting the line-of-sight deviation angle, and therefore, description will be given focusing on this part. That is, as shown in FIG. 6, one end of the instruction straight line B including the line-of-sight direction b is
The four camera devices 1 are located at a reference point K which is the center of the four camera devices 1 arranged on the circumference.

In this case, the reference direction line E passing through the midpoint C of the reference line D connecting the camera devices 1 and 1 and the pointing line B.
Letting θ be the angle of intersection with, ie, the line-of-sight deviation angle, the midpoint C, which is the starting point of the reference direction line in the case described in the first embodiment, and the pointing straight line B and the reference straight line D in this case intersect. The distance h from the intersection G is represented by the following equation (4).

[0040]

[Equation 3] However, d is the distance between the imaging centers.
Is the distance between.

That is, in the second embodiment, the first
The correction distance δ obtained in the embodiment of
The distance represented by the formula, that is, the shift correction amount h is added as a line-of-sight shift amount to the cut-out range of the left-eye and right-eye images and moved.

For example, referring to FIG. 6, the first camera device 1
When A is for the left eye and the second camera device 1B is for the right eye, the line-of-sight direction is shifted to the right, so the cutout range of each image is
The shift correction amount h is moved to the right.

By performing such correction, even when the line-of-sight direction passes through the centers of the four camera devices,
When the omnidirectional image is displayed as a stereo image in an arbitrary line-of-sight direction, it can be displayed without a sense of discomfort.

In the above description, the line-of-sight deviation is corrected. For example, the ratio r of the line-of-sight distance d between the first camera device 1A and the intersection G to the intersection G is calculated. The ratio [r (for left eye) and (1-r) (for right eye)] may be used for correction. For example, when moving the image for the left eye, [d
When moving the image for the right eye by r (1-cos θ) / 2] and moving the image for the right eye, [d · (1-r)]
-(1-cos θ) / 2] may be moved outward.

By the way, in each of the above embodiments,
Although the head mounted display has been described as the stereo image display unit, a screen or the like capable of displaying a stereo image may of course be used.

Further, in each of the above-described embodiments, as the line-of-sight direction input means, the one capable of recognizing the line-of-sight direction by the movement of the eyeball has been described. It is also possible to input using the obtained data.

Further, in each of the above embodiments, the omnidirectional camera device having the hyperbolic reflection mirror portion has been described, but the omnidirectional camera device is not limited to the hyperbolic surface and may be, for example, a parabolic or spherical reflection mirror portion. It may be.

Further, in each of the above-mentioned embodiments, the image photographed by the omnidirectional camera device is inputted, but the photographed image is recorded beforehand in the recording means such as a hard disk, and this recording is carried out. The created image can be directly input to the image capturing unit.

Further, in each of the above embodiments, four camera devices are arranged at equal intervals on the same radius, that is, on the circumference, but they may be arranged, for example, in an elliptical shape at predetermined intervals. .

Further, although four camera devices are used in the above embodiment, the number may be three, five or more, and two camera devices may be used. Good.

[0051]

As described above, according to the configuration of the stereo image display method and the stereo image display device of the present invention, the images taken by dividing the omni-direction are captured, and the images for the left eye and the right eye corresponding to the direction of the line of sight are taken. After cutting out each plane image with a predetermined width after expanding to a plane image, the display center distance narrowed according to the line-of-sight direction becomes the original line-of-sight interval, that is, the shooting center distance, Since the image cutout range is moved to the outside, the omnidirectional image can be displayed without a sense of discomfort when it is displayed as a stereo image in an arbitrary line-of-sight direction.

[Brief description of drawings]

FIG. 1 is a main-portion cross-sectional view of a camera device in a stereo image display device according to a first embodiment of the present invention.

FIG. 2 is a block diagram showing a schematic overall configuration of the stereo image display device.

FIG. 3 is a perspective view illustrating image development in the stereo image display device.

FIG. 4 is a diagram illustrating an image cutout range in the stereo image display device.

FIG. 5 is a diagram illustrating an image cutout range in the stereo image display device.

FIG. 6 is a diagram illustrating an arrangement state of a camera device and an image cutout range in a stereo image display device according to a second embodiment of the present invention.

[Explanation of symbols]

b Line of sight B indicating straight line C middle point D reference straight line E Reference direction line 1 Omnidirectional camera device 2 Imaging unit 3 Reflection mirror section 11 Image capture unit 12 Gaze direction acquisition unit 13 Image selection section 14 Image generation processing unit 15 Stereo image display section 21 Image development section 22 Image cutout range determination unit 23 Image output section

   ─────────────────────────────────────────────────── ─── Continued front page    (72) Inventor Hiroshi Ishiguro             No.5 Rinku Port North, Tajiri-cho, Sennan-gun, Osaka Prefecture             Ground 17-4-066 F-term (reference) 5C061 AA06 AA21 AB04 AB12 AB18

Claims (8)

[Claims] 1. Out of images taken by dividing all directions, 2
A method of displaying a stereo image in an arbitrary line-of-sight direction using two images. First, after dividing the omnidirectional image and capturing the captured curved surface image,
The curved images for the left eye and the right eye are developed into plane images according to the line-of-sight direction, and when these two plane images are displayed next, the parallax interval, which is the distance between the display centers, does not depend on the line-of-sight direction. The image cutout range for display in each of the plane images is determined so as to be equal to the distance between the shooting centers of the plane images, and the cutout left-eye image and right-eye image are then displayed in the image display unit. A stereo image display method characterized by displaying as a stereo image. 2. Out of the images photographed by dividing all directions, 2
A method of displaying a stereo image in an arbitrary line-of-sight direction using two images, and after capturing a curved surface image that is taken in all azimuth directions, two curved surface images for the left eye and the right eye depending on the direction of the line of sight. Then, expand the selected left-eye and right-eye curved images to a plane image respectively, and then when displaying both plane images, the parallax interval, which is the distance between the display centers, is Irrespective of, so as to be equal to the distance between the shooting centers of the two plane images, respectively determine the image cutout range for display in each of the plane images, and then the left-eye image and the right-eye image cut out, A stereo image display method characterized by displaying as a stereo image on an image display unit. 3. An intersection angle .theta. Between a reference direction line orthogonal to a reference straight line connecting the photographing centers and an instruction straight line passing through the midpoint of the reference straight line and including the line-of-sight direction when determining the image cutout range.
The stereo image display method according to claim 2, wherein the image cut-out ranges cut out with a predetermined width from the two plane images are respectively moved outward by a correction distance δ represented by the following equation based on. δ = d (1-cos θ) / 2 (where d is the distance between the imaging centers of both plane images) 4. When the pointing straight line is shifted to one of the photographing center sides without passing through the midpoint of the reference straight line, a shift correction amount corresponding to the shift amount is added to the correction distance of the image cutout range. The stereo image display method according to claim 3, wherein the stereo image display method is added. 5. Two of the images taken by dividing all directions
A device for displaying a stereo image in an arbitrary line-of-sight direction using two images, and an image capturing unit that captures a curved surface image captured in all directions and a curved surface image captured by this image capturing unit. , An image development unit that develops into a left-eye and right-eye plane image according to the line-of-sight direction, and when displaying both plane images, the parallax interval, which is the distance between the display centers, is independent of the line-of-sight direction. An image cutout range determination unit that determines an image cutout range for display in each of the planar images and a left eye that is cut out by the image cutout range determination unit so as to be equal to the distance between the photographing centers of the planar images. Image display unit for outputting images for right and right eyes to a stereo image display unit. 6. Out of images taken by dividing all directions, 2
A device for displaying a stereo image in an arbitrary line-of-sight direction by using one captured image, including an image capturing unit that captures a curved surface image captured in all directions and a plurality of images captured by this image capturing unit. From the curved image of
An image selection unit that selects a curved image for the left eye and a curved image for the right eye according to the line-of-sight direction, and an image expansion unit that develops the curved image for the left eye and the right eye selected by this image selection unit into a planar image, When displaying these two plane images, the parallax interval, which is the distance between the display centers, is set to be the same as the image separation for display in each plane image so that the parallax interval is equal to the distance between the photographing centers of the two plane images regardless of the line-of-sight direction. The image cut-out range determination unit that determines each output range and the image output unit that outputs the left-eye and right-eye images cut out by the image cut-out range determination unit to the stereo image display unit are configured. Characteristic stereo image display device. 7. An image cut-out range deciding unit, wherein a crossing angle .theta. Between a reference direction line orthogonal to a reference straight line connecting the photographing centers and a designated straight line passing through the midpoint of the reference straight line and including the line-of-sight direction.
7. The stereo image display device according to claim 6, wherein the image cut-out ranges cut out with a predetermined width from both plane images are respectively moved outward by a correction distance δ represented by the following equation based on. δ = d (1-cos θ) / 2 (where d is the distance between the imaging centers of both plane images) 8. When the designated straight line is shifted to one of the photographing center sides without passing through the midpoint of the reference straight line, the shift distance corresponding to the shift amount is added to the correction distance of the image cutout range. The stereo image display device according to claim 7, wherein the stereo image display device is added.