JPH1139514A - Three-dimensional display method, three-dimensional display device and computer readable recording medium recording three-dimensional display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To prepare three-dimensionally displayable image data by using multi- view-point image data by using a view point setting step for setting plural view points and the multi-view-point image data and preparing and outputting the plural image data viewing from the respective set plural view points. SOLUTION: Desired one of the multi-view-point image data stored in a memory is selected (S1). When one of buttons is pressed (YES in S2), whether or not to end a processing is judged (S3), and in the case of continuing the processing (NO in S3), left and right view points are set so as to perform three- dimensional display (S4). The image data viewing from the left view point are prepared and outputted through an input/output interface (S5). Also, the image data viewing from the right view point are prepared and outputted through the input/output interface (S6). A three-dimensional display which receives the left and right image data internally synthesizes the left and right image data and then, three-dimensionally displays them (S7).

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a three-dimensional display method, a three-dimensional display device, and a computer-readable recording medium on which a three-dimensional display program is recorded. The present invention relates to a stereoscopic display method, a stereoscopic display device, and a computer-readable recording medium that stores a stereoscopic display program.

[0002]

2. Description of the Related Art In recent years, with the spread of the Internet,
Opportunities to acquire image data through a network are increasing. This image data includes QuickTime VR (US
According to a format such as Apple Computer's trademark, there are real image data and CG (Computer Graphics) data (hereinafter, referred to as "multi-view image data") obtained by photographing an object, a landscape, and the like from multiple viewpoints. By using such multi-view image data, image data obtained by viewing an object or landscape from an arbitrary viewpoint can be displayed on an output device such as a display.

[0003]

However, the conventional display method using multi-viewpoint image data can only display image data viewed from a single viewpoint.

SUMMARY OF THE INVENTION The present invention has been made to solve these problems, and an object of the present invention is to create image data which can be stereoscopically displayed using multi-viewpoint image data. To provide a stereoscopic display method.

[0005] An object of the invention described in claim 2 is that of claim 1
Another object of the present invention is to provide a stereoscopic display method capable of creating image data capable of being stereoscopically viewed from an arbitrary viewpoint, in addition to the object of the invention described in (1).

According to the third and fourth aspects of the invention, in addition to the object of the first aspect, it is possible to create image data which can be stereoscopically displayed without a sense of discomfort when viewed by a human. And a stereoscopic display method.

An object of the invention described in claim 5 is that of claim 1
Another object of the present invention is to provide a stereoscopic display method capable of creating image data capable of binocular stereoscopic display, in addition to the objects of the inventions described in (1) to (4).

Another object of the present invention is to provide a three-dimensional display device capable of creating image data capable of three-dimensional display using multi-viewpoint image data.

An object of the invention described in claim 7 is that of claim 6
Another object of the present invention is to provide a stereoscopic display device capable of creating image data capable of being stereoscopically viewed from an arbitrary viewpoint, in addition to the object of the invention described in (1).

[0010] The object of the present invention described in claims 8 and 9 is that, in addition to the object of the invention described in claim 6, it is possible to create image data that can be stereoscopically displayed without a sense of strangeness when viewed by a human. To provide a three-dimensional display device.

An object of the invention described in claim 10 is to provide a stereoscopic display device capable of creating image data capable of performing binocular stereoscopic display, in addition to the objects of the inventions described in claims 6 to 9. It is to be.

An object of the invention described in claim 11 is to record a stereoscopic display program for causing a computer to execute a stereoscopic display method capable of creating image data capable of stereoscopic display using multi-viewpoint image data. A computer-readable recording medium is provided.

According to a twelfth aspect of the present invention, in addition to the object of the eleventh aspect, there is provided a three-dimensional display method capable of creating image data capable of being three-dimensionally viewed from an arbitrary viewpoint. An object of the present invention is to provide a computer-readable recording medium that stores a stereoscopic display program to be executed by a computer.

The object of the invention described in claims 13 and 14 is
In addition to the object of the invention described in claim 11, a stereoscopic display program for causing a computer to execute a stereoscopic display method capable of creating image data that can be stereoscopically displayed when viewed by a human being is recorded. And a computer-readable recording medium.

According to a fifteenth aspect of the present invention, in addition to the objects of the eleventh to fourteenth aspects, a three-dimensional display method capable of creating image data capable of binocular three-dimensional display is provided. And a computer-readable recording medium on which a stereoscopic display program to be executed by the computer is recorded.

[0016]

According to the first aspect of the present invention, there is provided a stereoscopic display method using multi-view image data composed of a plurality of image data, comprising: a viewpoint setting step of setting a plurality of viewpoints; Generating and outputting a plurality of image data viewed from each of the plurality of viewpoints set in the viewpoint setting step using the viewpoint image data.

According to the first aspect of the present invention, when a plurality of viewpoints are set, image data viewed from each of the viewpoints is created, so that stereoscopic display can be performed using multi-viewpoint image data.

According to a second aspect of the present invention, in the stereoscopic display method according to the first aspect of the present invention, the image data creating and outputting step includes the step of setting each of the plurality of viewpoints set in the viewpoint setting step. If the image data viewed from the viewpoint is present in the multi-view image data, the step of outputting the image data is performed.If the image data viewed from the viewpoint does not exist in the multi-view image data, Generating and outputting interpolated image data from image data in a plurality of pieces of multi-view image data viewed from a viewpoint near the viewpoint.

According to a second aspect of the present invention, in addition to the operation and effect of the first aspect, when image data viewed from a set viewpoint does not exist in the multi-viewpoint image data, surrounding image data Is used to perform interpolation processing to create image data. Thereby, it is possible to perform stereoscopic display as viewed from an arbitrary viewpoint.

According to a third aspect of the present invention, in the stereoscopic display method according to the first aspect of the present invention, in the image data creating and outputting step, the plurality of viewpoints set in the viewpoint setting step are mutually linked. If there is a predetermined relationship, a step of outputting image data viewed from the plurality of viewpoints, and if the plurality of viewpoints set in the viewpoint setting step are not in a predetermined relationship to each other, an image viewed from the plurality of viewpoints is displayed. Converting the image into an image viewed from the plurality of viewpoints having a predetermined relationship with each other and outputting the image.

According to a third aspect of the present invention, in addition to the functions and effects of the first aspect of the present invention, the image data is set to have a predetermined relationship so that a human does not feel uncomfortable when stereoscopically viewed. Convert and output.

In the stereoscopic display method according to a fourth aspect of the present invention, in addition to the configuration of the third aspect of the present invention, the predetermined relation may be such that each of the predetermined relations is determined from a plurality of viewpoints set in the viewpoint setting step. Is such that all the horizontal directions of the image data exist in the same plane.

According to a three-dimensional display method according to the fifth aspect of the present invention, in addition to the configuration of the first aspect, the number of the viewpoints is two.

According to the fifth aspect of the present invention, in addition to the functions and effects of the first to fourth aspects of the present invention, binocular stereoscopic display can be performed.

According to a sixth aspect of the present invention, there is provided a stereoscopic display apparatus using multi-view image data composed of a plurality of image data, a viewpoint setting means for setting a plurality of viewpoints, and a multi-view image data. And image data creation and output means for creating and outputting a plurality of image data viewed from each of the plurality of viewpoints set by the viewpoint setting means.

According to the sixth aspect of the present invention, when a plurality of viewpoints are set, image data viewed from each of the viewpoints is created, so that stereoscopic display can be performed using multi-viewpoint image data.

In the stereoscopic display apparatus according to a seventh aspect of the present invention, in addition to the configuration of the sixth aspect of the present invention, the image data creation and output means may include a plurality of viewpoints set by the viewpoint setting means. In the case where the image data viewed from the viewpoint is present in the multi-view image data, the means for outputting the image data and the image data viewed from the viewpoint are not present in the multi-view image data. Means for generating and outputting interpolated image data from image data in a plurality of pieces of multi-view image data viewed from a viewpoint near the viewpoint.

According to a seventh aspect of the present invention, in addition to the functions and effects of the sixth aspect, when image data viewed from a set viewpoint does not exist in multi-viewpoint image data, surrounding image data Is used to perform interpolation processing to create image data. As a result, it is possible to create image data that can be displayed three-dimensionally from any viewpoint.

[0029] In the stereoscopic display apparatus according to the invention described in claim 8, in addition to the configuration of the invention described in claim 6, the image data creation and output means may include a plurality of viewpoints set by the viewpoint setting means. If there is a predetermined relationship, the means for outputting image data viewed from the plurality of viewpoints and the plurality of viewpoints set by the viewpoint setting means are not viewed from the plurality of viewpoints unless the plurality of viewpoints are in the predetermined relationship. Means for converting the image into an image viewed from a plurality of viewpoints having a predetermined relationship with each other and outputting the image.

According to an eighth aspect of the present invention, in addition to the functions and effects of the sixth aspect of the present invention, the image data has a predetermined relationship so that a human does not feel uncomfortable when stereoscopically viewed. Convert and output.

According to a ninth aspect of the present invention, in addition to the configuration of the eighth aspect of the present invention, the predetermined relation is such that each of the predetermined relations is defined by a plurality of viewpoints set by viewpoint setting means. Is such that all the horizontal directions of the image data exist in the same plane.

A three-dimensional display device according to a tenth aspect of the present invention is the stereoscopic display device according to the sixth aspect, wherein the number of the viewpoints is two.

The invention according to claim 10 is the invention according to claims 6 to 9
In addition to the functions and effects of the invention described in any one of the above, image data capable of binocular stereoscopic display can be created.

A computer storing a stereoscopic display program for causing a computer to execute a stereoscopic display method for performing stereoscopic display using multi-viewpoint image data comprising a plurality of image data according to the present invention. The readable recording medium is, as the stereoscopic display method, a viewpoint setting step of setting a plurality of viewpoints, and a plurality of viewpoints viewed from each of the plurality of viewpoints set in the viewpoint setting step using multi-view image data. Image data generating and outputting step of generating and outputting image data.

According to the eleventh aspect, when a plurality of viewpoints are set, image data viewed from each of the viewpoints is created, so that stereoscopic display can be performed using multi-viewpoint image data.

A computer storing a stereoscopic display program for causing a computer to execute a stereoscopic display method for performing stereoscopic display using multi-viewpoint image data composed of a plurality of image data according to the twelfth aspect of the present invention. In addition to the configuration of the invention according to claim 11, the recording medium readable by the image data creating and outputting step includes, for each of the plurality of viewpoints set in the viewpoint setting step,
Outputting the image data if the image data viewed from the viewpoint is present in the multi-view image data;
If the image data viewed from the viewpoint does not exist in the multi-view image data, the interpolation image data is created and output from the image data in the plurality of multi-view image data viewed from the viewpoint near the viewpoint. Steps.

According to a twelfth aspect of the present invention, in addition to the functions and effects of the eleventh aspect, when image data viewed from a set viewpoint does not exist in multi-viewpoint image data, surrounding image data Is used to perform interpolation processing to create image data. Thereby, it is possible to perform stereoscopic display as viewed from an arbitrary viewpoint.

A computer storing a stereoscopic display program for causing a computer to execute a stereoscopic display method for performing stereoscopic display using multi-viewpoint image data composed of a plurality of image data according to the present invention. In addition to the configuration of the invention according to claim 11, the image data creating and outputting step includes the step of: if the plurality of viewpoints set in the viewpoint setting step have a predetermined relationship with each other, Outputting the image data viewed from the viewpoint, and if the plurality of viewpoints set in the viewpoint setting step do not have a predetermined relationship with each other, the plurality of images viewed from the plurality of viewpoints have a predetermined relationship with each other. Converting the image into an image viewed from the viewpoint and outputting the image.

According to a thirteenth aspect of the present invention, in addition to the functions and effects of the eleventh aspect of the present invention, the image data is set to have a predetermined relationship so that a human does not feel uncomfortable when stereoscopically viewed. Convert and output.

A computer storing a stereoscopic display program for causing a computer to execute a stereoscopic display method for performing stereoscopic display using multi-viewpoint image data comprising a plurality of image data according to the present invention. In the recording medium readable by the first and second aspects, the predetermined relationship may be such that the horizontal directions of the respective image data viewed from a plurality of viewpoints set in the viewpoint setting step are all the same. This is a relationship that exists in a plane.

A computer storing a stereoscopic display program for causing a computer to execute a stereoscopic display method for performing stereoscopic display using multi-viewpoint image data composed of a plurality of image data according to the present invention. The number of the viewpoints is two in addition to the configuration of the invention according to any one of claims 11 to 14.

The invention described in claim 15 is the invention according to claims 11 to
14. In addition to the effects and advantages of the invention described in any one of 14.
A stereoscopic display can be performed.

[0043]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Hereinafter, a stereoscopic image data display system 2 (FIG. 1) which is one of embodiments of the present invention will be described with reference to the drawings.

Referring to FIG. 1, stereoscopic image data display system 2 includes an input device 14 for setting left and right viewpoints.
And a computer 4 connected to the input device 14 for generating two image data viewed from the left and right viewpoints, and connected to the computer 4 for receiving the two image data and internally storing the two image data. And a stereoscopic display 16 for synthesizing with a circuit and performing stereoscopic display.

The computer 4 includes a memory 8 for storing multi-viewpoint image data in the QuickTime VR format or the like, a processing program, intermediate results of the processing, and the like.
According to the processing program stored in the memory 8, 2
CPU (Cent
ral Processing Unit) 6 and 3D display 1
Input / output interface 1 connected to input device 6 and input device 14 for controlling the transfer of input values and image data
2 and a bus 10 for mutually connecting the CPU 6, the memory 8, and the input / output interface 12.

Referring to FIG. 2, input device 14 includes a left button 64, a right button 68, an up button 60, and a down button 62 for moving the left and right viewpoints up and down and right and left, respectively. A widening button 72 and a narrowing button 70 for widening or narrowing the distance between each,
And an end button 71 for ending the processing. The input device 14 is not limited to this configuration, and may be capable of independently changing the left and right viewpoints. Further, an existing input device such as a mouse or a keyboard may be used.

The multi-view image data will be described with reference to FIGS. Consider an earth coordinate system as shown in FIG.
The latitude is represented by δ and the longitude is represented by α. An object 20 to be imaged is arranged at the center of the earth coordinate system. Further, the camera 22 is arranged at each grid point position on the earth surface so as to face the center of the earth coordinate system, and so that the vertical and horizontal directions of the captured image data correspond to longitude and latitude, respectively. In this example, the lattice points are δ (five patterns) and α shown below.
(12 patterns) (60 patterns = 5 patterns × 12 patterns).

Δ = (m × 30) ° (where m is an integer of −2 ≦ m ≦ 2) (1) α = (n × 30) ° (where n is an integer of −5 ≦ n ≦ 6) (2) FIG. 3 shows the arrangement of the camera 22 when (δ, α) = (60 °, −30 °) and (δ, α) = (60 °, 60 °).

Referring to FIG. 4, when the object 20 is photographed using the camera 22 arranged on the grid point, multi-view image data 30 photographed from 60 different viewpoints can be obtained. The multi-view image data 30 is existing image data that can be obtained through the Internet or the like. The multi-view image data 30 is stored in the memory 8. Note that FIG. 4 is an example in which multi-view image data is expanded, and it is not necessary to form an arrangement as shown in FIG. 4 by a technique such as image compression.

Referring to FIG. 5, the processing executed in the stereoscopic image data display system 2 will be described. Input device 1
4, a desired one of the multi-viewpoint image data 30 stored in the memory 8 is selected (S1). For example, the user looks at the multi-viewpoint image data 30 sequentially displayed on a flat display (not shown) and presses any button to make a selection.

Next, it is determined whether any of the buttons has been pressed (S2). If the button has not been pressed (NO in S2), wait until the button is pressed (S
2). If the button is pressed (YES in S2), it is determined whether or not to end the processing (S3). End button 71
Is pressed, the process is terminated (YE in S3).
S), otherwise, continue the process (N in S3)
O).

When the processing is to be continued (NO in S3),
Left and right viewpoints are set to perform stereoscopic display (S4).
The left and right viewpoints are indicated by latitude δ and longitude α in the earth coordinate system,
The left viewpoint is (δ, αL), and the right viewpoint is (δ, αR).
The viewpoint setting is performed using the input device 14. Next, the image data viewed from the left viewpoint is created, and the input / output interface 1
2 (S5). Further, image data viewed from the right viewpoint is created and output via the input / output interface 12 (S6). The three-dimensional display 16 that has received the left and right image data internally synthesizes the left and right image data, and then performs three-dimensional display (S7). Note that the stereoscopic display 16 is a well-known technology, and is described in “Ken Masutani et al .: 3D display without glasses with new image splitter system,
mage Conference '95 pp.90-95 "and the like.

Referring to FIG. 2, the processing in S4 will be described.
Left viewpoint (δ, αL) set in the previous processing of S4
And the coordinates of the right viewpoint (δ, αR) are updated according to the following six rules. When the process of S4 is the first time, the default value set in advance and stored in the memory 8 is used as the previous coordinate. Further, s1, s2, and s3 are positive values indicating updated values. min (A,
B) and max (A, B) are defined as functions having the minimum value and the maximum value of A and B as result values, respectively. αL and αR are values that circulate in the range of [−180 °, 180 °], and have longitude −180 ° and longitude 180.
° indicates the same longitude. For this reason, if αL or αR becomes smaller than −180 ° as a result of updating the coordinates by the following formula, 360 ° is added to the updated value to change αL or αR to [−180 °, 180 °. °]. Similarly, when αL or αR becomes larger than 180 °, by subtracting 360 ° from the updated value, αL or αR is changed to [−180 °, 180 °
°]. Similarly, for the latitude δ, processing is appropriately performed so that the value of δ falls within the range of [−90 °, 90 °]. (1) When the left button 64 is pressed αL: = αL-s1 (3) αR: = αR-s1 (4) (2) When the right button 68 is pressed αL: = αL + s1 (5) αR: = αR + s1 (6) (3) When the upper button 60 is pressed δ: = min (δ + s2, 90 °) (7) (4) When the lower button 62 is pressed δ: = max (δ -S2, -90 °) (8) (5) When the spread button 72 is pressed αL: = αL-s3 (9) αR: = αR + s3 (10) (6) The narrow button 70 is pressed Case αL: = αL + s3 (11) αR: = αR-s3 (12) By performing any of the processes (1) to (4),
You can move the viewpoint left, right, up and down. (5)-(6)
By performing any one of the processes described above, the distance between the left and right viewpoints can be adjusted, and stereoscopic viewing without discomfort can be achieved.

Referring to FIG. 6, the processing in S5 will be described in detail. It is determined whether or not image data viewed from the left viewpoint (δ, αL) exists in the multi-view image data 30 (S1).
0). That is, it is determined whether (δ, αL) is on the grid point of the earth coordinate system described with reference to FIG.

If image data exists (YES in S10), the image data is sent to the input / output interface 12
(S14).

If there is no image data (S10
NO), the interpolation process is performed using a predetermined number of pieces of image data (for example, the image data 36 and the image data 38) photographed from the viewpoint near the left viewpoint (δ, αL), thereby obtaining the left viewpoint ( Image data (for example, image data 48) viewed from (δ, αL) is created (S12). The image data is output via the input / output interface (S14). This interpolation processing is a known technique, such as “Nobuhiro Tsunashima et al .: Creation of Intermediate Image Data from Twin-Eye Stereo Image Data Considering Occlusion, 3D Image
ge Conference '95 pp.174-177 (1995) "and" Takeo Azuma et al .: Parallax Estimation Using Edge Information for Intermediate Image Generation, 3D Image Conference '95 pp.190-194 (1995) ", etc. It has been disclosed.

Referring to FIG. 7, the processing in S6 will be described in detail. It is determined whether or not image data viewed from the right viewpoint (δ, αR) exists in the multi-view image data 30 (S1).
6). That is, it is determined whether or not (δ, αR) is on the grid point in the earth coordinate system described with reference to FIG.

If image data exists (YES in S16), the processing of S20 and later described later is performed using the image data.

If no image data exists (S16)
NO), an interpolation process is performed using a predetermined number of pieces of image data taken from viewpoints near the right viewpoint (δ, αR) to create image data viewed from the right viewpoint (δ, αR). (S18). Using the image data, the processing of S20 and below, which will be described later, is performed. This interpolation processing is the same as the above-described interpolation processing.

Next, it is determined whether the right viewpoint (δ, αR) is on the equator, that is, whether δ = 0 ° (S2).
0).

If δ = 0 ° (YES in S20), the image data (eg, image data 50) is output via input / output interface 12 (S24).

Referring to FIG. 8, when δ ≠ 0 ° (S20)
NO) will be described. The arrangement of the camera at δ カ メ ラ 0 ° is such that the bottom surface of the camera is not on the same plane as point C and point D on the spherical surface S. Performing stereoscopic viewing using two pieces of image data captured in such a situation feels uncomfortable to humans. Therefore, one point D is moved to a position where the bottom surface of the camera is on the same plane as the bottom surface of the camera on the point C, and is set as a point E. By using two pieces of image data captured at points C and E, stereoscopic viewing can be achieved. Hereinafter, an example of a method for creating image data captured at the point E will be described.

(1) Let Kφ be a circle on the spherical surface S composed of points having the same latitude as the latitude of the point C.

(2) The spherical surface S passing through the point C and in contact with the circle Kφ
A circle Kc having the same diameter as the above equatorial circle Ko is obtained.

(3) On the circle Kc, a polar coordinate position of a point E having an angle θ with respect to a point C is obtained (an angle COE = θ with the center O of the earth coordinate system).

(4) Let Ke be a circle on the spherical surface S composed of points having the same latitude as the latitude of the point E.

(5) A circle K existing in a plane including the circle Kc
An angle す between the tangent at point E of c and the tangent at point E of the circle Ke existing in the plane including the circle Ke is determined.
A point F closest to the polar coordinates of the point E and at which the multi-view image data 30 holds the image data is obtained.

(6) The inclination of the image is rotated by an angle -ψ with respect to the image data at the point F, and the inclination is corrected.

By performing the above-described processes (1) to (6), the image data photographed at the point E is created. Thereafter, the image data captured at points C and E is output via the input / output interface 12 (S24).

In the above example, the data of the point C is determined as the left image, and the tilt correction is performed only on the corresponding right image. However, as shown in FIG. 9, the tilt of the left and right images is corrected. There is also a simple way to eliminate discomfort.

(1) Let Kφ be a circle on the spherical surface S composed of points having the same latitude as the latitudes of the points C and D.

(2) A circle K _CD passing through the points C and D and having the same diameter as the equator circle Ko on the spherical surface S is obtained.

(3) Tangent lines L _1C and L _1D at points C and D, respectively, of the circle Kφ existing in the plane containing the circle Kφ, and points of the circle K _CD existing in the plane containing the circle K _CD C
And tangents L _2C and L _{2D at} point D, respectively.

(4) The angle between the tangents L _1C and L _2C (the tangent L
Seeking _1D and angle between L _2D) ψ, the left image taken from the point C + [psi, rotate respective right images captured from the point D only -Pusai, the inclination correction.

By repeating the above-described processes from S2 to S7 sequentially as necessary, according to the user's settings,
It is possible to continuously display stereoscopic image data viewed from various viewpoints.

In the present embodiment, the description has been given with respect to the binocular stereoscopic vision, but it is also possible to adopt a configuration capable of multi-view stereoscopic vision of three or more eyes. In that case, the computer
Image data viewed from one or more viewpoints is created in the same manner as the left and right image data described above. Further, instead of the input device 14, an input device capable of setting a plurality of viewpoints is used,
A display capable of multi-view stereoscopic display is used instead of the binocular stereo display 16.

With the stereoscopic image data display system 2 as described above, stereoscopic display can be easily performed using existing multi-viewpoint image data.

[0078]

According to the present invention, it is possible to cause a computer to execute the three-dimensional display method according to the first to fifth aspects, the three-dimensional display device according to the sixth to tenth aspects, and the three-dimensional display method according to the eleventh to fifteenth aspects. By using a computer-readable recording medium that stores the stereoscopic display program, stereoscopic display can be performed using multi-viewpoint image data.

[Brief description of the drawings]

FIG. 1 is a block diagram showing a configuration of a stereoscopic image data display system 2.

FIG. 2 is an external view of the input device 14. FIG.

FIG. 3 is a diagram showing a method for creating multi-viewpoint image data.

FIG. 4 is a diagram illustrating multi-view image data and image data from left and right viewpoints created from the multi-view image data.

FIG. 5 is a flowchart showing a processing flow of the stereoscopic image data display system 2.

FIG. 6 is a flowchart illustrating a flow of a process of outputting left image data.

FIG. 7 is a flowchart illustrating a flow of a process of outputting right image data.

FIG. 8 is a diagram illustrating inclination correction of right image data.

FIG. 9 is a diagram illustrating inclination correction of left and right image data.

[Explanation of symbols]

2 stereoscopic image data display system 4 computer 6 CPU 8 memory 12 input / output interface 14 input device 16 stereoscopic display 20 object 22 camera 30 multi-viewpoint image data 32, 36, 38, 42, 44, 48, 50 image data

 ──────────────────────────────────────────────────続 き Continuing on the front page (72) Inventor Ryuhei Amano 2-5-5 Keihanhondori, Moriguchi-shi, Osaka Sanyo Electric Co., Ltd. (72) Noriaki Kihara 3rd-3, Senbahigashi, Minoh-shi, Osaka No. 11 Dynaware Co., Ltd.

Claims (15)

[Claims] 1. A stereoscopic display method using multi-viewpoint image data composed of a plurality of image data, the viewpoint setting step of setting a plurality of viewpoints, and the viewpoint setting using the multi-viewpoint image data. An image data creation output step of creating and outputting a plurality of image data viewed from each of the plurality of viewpoints set in the step. 2. The image data creation and output step, wherein, for each of the plurality of viewpoints set in the viewpoint setting step, when image data viewed from the viewpoint is present in the multi-view image data, Outputting the image data, and when the image data viewed from the viewpoint is not present in the multi-view image data, a plurality of pieces of image data in the multi-view image data viewed from a viewpoint near the viewpoint. And generating and outputting the interpolated image data. 3. The image data creating and outputting step includes, if the plurality of viewpoints set in the viewpoint setting step have a predetermined relationship with each other, outputting image data viewed from the plurality of viewpoints; If the plurality of viewpoints set in the viewpoint setting step are not in the predetermined relationship with each other, an image viewed from the plurality of viewpoints is converted into an image viewed from the plurality of viewpoints in the predetermined relationship with each other. Outputting the three-dimensional display method according to claim 1. 4. The relationship according to claim 3, wherein the predetermined relationship is a relationship in which the horizontal directions of the respective image data viewed from the plurality of viewpoints set in the viewpoint setting step are all in the same plane. 3D display method. 5. The method according to claim 1, wherein the number of viewpoints is two.
4. The stereoscopic display method according to any one of 4. 6. A stereoscopic display device for performing stereoscopic display using multi-view image data composed of a plurality of image data, a viewpoint setting means for setting a plurality of viewpoints, and the multi-view image data And an image data creation output unit for creating and outputting a plurality of image data viewed from each of the plurality of viewpoints set by the viewpoint setting unit. 7. The image data creation / output unit, for each of a plurality of viewpoints set by the viewpoint setting unit, when image data viewed from the viewpoint is present in the multi-view image data, Means for outputting data, and when the image data viewed from the viewpoint is not present in the multi-view image data, a plurality of image data in the multi-view image data viewed from a viewpoint near the viewpoint. Means for creating and outputting interpolated image data,
The three-dimensional display device according to claim 6. 8. The image data creating and outputting means, if the plurality of viewpoints set by the viewpoint setting means have a predetermined relationship with each other, means for outputting image data viewed from the plurality of viewpoints. If the plurality of viewpoints set by the viewpoint setting means are not in the predetermined relationship with each other, an image viewed from the plurality of viewpoints is converted into an image viewed from the plurality of viewpoints in the predetermined relationship with each other. 7. The three-dimensional display device according to claim 6, further comprising: means for outputting. 9. The predetermined relation is a relation in which the horizontal directions of the respective image data viewed from the plurality of viewpoints set by the viewpoint setting means are all present on the same plane.
The stereoscopic display device according to claim 8. 10. The number of viewpoints is two.
10. The stereoscopic display device according to any one of claims 9 to 9. 11. A computer-readable recording medium storing a stereoscopic display program for causing a computer to execute a stereoscopic display method for performing stereoscopic display using multi-viewpoint image data composed of a plurality of image data. Wherein the stereoscopic display method comprises: a viewpoint setting step of setting a plurality of viewpoints; and a plurality of image data viewed from each of the plurality of viewpoints set in the viewpoint setting step, using the multi-view image data. And a computer-readable recording medium having recorded thereon a stereoscopic display program. 12. The image data creation and output step,
For each of the plurality of viewpoints set in the viewpoint setting step, when image data viewed from the viewpoint is present in the multi-view image data, outputting the image data; and When the image data does not exist in the multi-view image data, creating and outputting interpolated image data from a plurality of pieces of image data in the multi-view image data viewed from a viewpoint near the viewpoint. A computer-readable recording medium that stores the stereoscopic display program according to claim 11. 13. The image data creation and output step,
If the plurality of viewpoints set in the viewpoint setting step are in a predetermined relationship with each other, outputting image data viewed from the plurality of viewpoints; and the plurality of viewpoints set in the viewpoint setting step are mutually different. The method according to claim 11, further comprising: converting the images viewed from the plurality of viewpoints to the images viewed from the plurality of viewpoints having the predetermined relationship with each other and outputting the images if the images are not in the predetermined relationship. A computer-readable recording medium that stores a stereoscopic display program. 14. The predetermined relationship according to claim 13, wherein the horizontal directions of the respective image data viewed from the plurality of viewpoints set in the viewpoint setting step are all in the same plane. And a computer-readable recording medium on which a stereoscopic display program is recorded. 15. The method according to claim 1, wherein the number of viewpoints is two.
A computer-readable recording medium recording the stereoscopic display program according to any one of 1 to 14.