JPH11331872A - Panoramic stereoscopic picture display system, panoramic stereoscopic picture display method and recording medium - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide the panoramic stereoscopic picture display system by which a panoramic stereoscopic picture having presence is displayed. SOLUTION: An image input section 1 inputs plural image data to be background pictures that are actually photographed. A processing control section 4 combines the plural inputted image data respectively and generates panoramic picture data for a left eye and panoramic picture data for a right eye according to predetermined parallax information and provides an output of the generated left eye panoramic picture data and right eye panoramic picture data to an image output section 7. The image output section 7 converts the acquired left eye panoramic image data and right eye panoramic image data into video signals respectively and gives the converted left eye and right eye video signals to a stereoscopic picture display section 8. The stereoscopic picture display section 8 displays a stereoscopic picture according to the acquired left eye and right eye video signals.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a panoramic stereoscopic image display system, a panoramic stereoscopic image display method, and a recording medium for displaying a virtual panoramic stereoscopic image with a sense of realism.

[0002]

2. Description of the Related Art In recent years, a landscape image or the like is displayed on a display device such as a personal computer, and the display image is changed according to a user's instruction to change the viewpoint position.
Three-dimensional panoramic image technology capable of displaying a panoramic image of 0 degrees is known. This three-dimensional panoramic image technology is slightly different from the conventional panoramic image technology. Whereas conventional panoramic image technology displays all panoramic images, 3D panoramic image technology displays a partial area of a panoramic image and smoothly moves the image according to a user's viewpoint change instruction. Thus, a 360-degree three-dimensional panoramic image is displayed.

Hereinafter, such a three-dimensional panoramic image technique will be described with reference to the drawings. As shown in FIG.
A description will be given of a case in which a plurality of images captured by changing the angle by an imaging device such as a camera with a center point defined are panoramic. FIG. 6 shows a plurality of images captured in this manner. According to the three-dimensional panoramic image technique, such a plurality of images are pasted inside an annular band in the virtual space shown in FIG. 7 and connected so that joints are not noticeable, thereby forming one three-dimensional panoramic image. Generate. The three-dimensional panoramic image technology displays a partial area in the three-dimensional panoramic image generated in this way, and smoothly moves the image according to a user's viewpoint change instruction to form a three-dimensional panoramic image of 360 degrees. To display. At present, there is a movement to use such a useful three-dimensional panoramic image in various fields.

[0004]

However, since a three-dimensional panoramic image is displayed on a display device such as a personal computer, the size of the image is limited, and the sense of realism may be lacking.

SUMMARY OF THE INVENTION The present invention has been made in view of the above circumstances, and has as its object to provide a panoramic stereoscopic image display system, a panoramic stereoscopic image display method, and a recording medium capable of displaying a realistic panoramic stereoscopic image. And

[0006]

In order to achieve the above object, a panoramic three-dimensional image display system according to a first aspect of the present invention comprises a background image input means for inputting a plurality of image data as a real imaged background image. And combining a plurality of image data input by the background image input means,
Panoramic image generating means for generating panoramic image data for the left eye and panoramic image data for the right eye in accordance with predetermined parallax information, and panoramic image data for the left eye and right panoramic image data generated by the panoramic image generating means Image data conversion means for converting the panoramic image data for the eye to a video signal, according to the video signal for the left eye and the video signal for the right eye converted by the image data conversion means,
Stereoscopic image display means for displaying a stereoscopic image.

According to the present invention, the panoramic image generating means combines the plurality of image data input by the background image input means, respectively, and according to predetermined parallax information.
Panoramic image data for the left eye and panoramic image data for the right eye are generated. The image data conversion unit converts the left-eye panorama image data and the right-eye panorama image data generated by the panorama image generation unit into video signals. The three-dimensional image display means displays a three-dimensional image according to the left-eye video signal and the right-eye video signal converted by the image data conversion means. As a result, it is possible to display a panoramic stereoscopic image with a sense of reality.

[0008] An operation panorama image display means for displaying an operation panorama image is further provided, wherein the image data conversion means synchronizes with the panorama image displayed on the operation panorama image display means. The left-eye panorama image data and the right-eye panorama image data generated by the generation means may be respectively converted into video signals. As a result, a realistic panoramic stereoscopic image can be displayed by a user's free operation.

The apparatus further includes a parallax information input unit for inputting parallax information, wherein the panorama image generating unit is configured to output panorama image data for the left eye and panorama image data for the right eye in accordance with the parallax information input by the parallax information input unit. Panoramic image data may be generated.

In order to achieve the above object, a second aspect of the present invention is provided.
The method of displaying a panoramic stereoscopic image according to the aspect of the present invention, a background image input step of inputting a plurality of image data serving as a background image actually captured, and a plurality of image data input in the background image input step are respectively combined, A panoramic image generating step of generating panoramic image data for the left eye and panoramic image data for the right eye according to predetermined disparity information; and a panoramic image data for the left eye and a right panoramic image generated by the panoramic image generating step. An image data converting step of converting the panoramic image data for the eye into a video signal, and a stereoscopic image displaying a stereoscopic image according to the video signal for the left eye and the video signal for the right eye converted in the image data converting step. And an image display step.

According to the present invention, the panoramic image generating step combines the plurality of image data input in the background image input step and generates the left-eye panoramic image data and the right-eye panoramic image data in accordance with predetermined parallax information. Generate panoramic image data for the eye. The image data conversion step converts the left-eye panorama image data and the right-eye panorama image data generated in the panorama image generation step into video signals. The three-dimensional image display step displays a three-dimensional image according to the left-eye video signal and the right-eye video signal converted in the image data conversion step. As a result, it is possible to display a panoramic stereoscopic image with a sense of reality.

In order to achieve the above object, a third aspect of the present invention is provided.
The recording medium according to the aspect of the present invention is a computer-readable recording medium that records a program that causes a computer to function as a panoramic stereoscopic image display system, and includes a background image inputting step of inputting a plurality of image data to be a captured real background image. And a plurality of image data input in the background image input step, and a panorama image generation for generating left-eye panorama image data and right-eye panorama image data according to predetermined parallax information. And an image data conversion step of converting the left-eye panorama image data and the right-eye panorama image data generated in the panorama image generation step into video signals, respectively, and the image data conversion step. According to the video signal for the left eye and the video signal for the right eye, a three-dimensional image Storing a program for realizing a stereoscopic image display step of displaying.

[0013]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A panoramic stereoscopic image display system according to an embodiment of the present invention will be described below with reference to the drawings. 1 includes an image input unit 1, an operation input unit 2, a parameter storage unit 3, a processing control unit 4, an image storage unit 5, an image display unit 6, and an image output unit. 7 and a stereoscopic image display unit 8.

The image input unit 1 inputs a plurality of image data and stores them in the image storage unit 5 via the processing control unit 4.

The operation input unit 2 is composed of an input device such as a keyboard and a mouse.

The parameter storage unit 3 stores various parameters used in the panorama image generation processing performed by the processing control unit 4 according to a predetermined parallax.

The processing control unit 4 performs a panoramic image generation process of the background image data input from the image input unit 1 and a stereoscopic image display process of the generated panorama image. That is,
The processing control unit 4 generates left-eye panorama image data and right-eye panorama image data from the acquired background image data, and outputs the panorama image data to the image display unit 6 and the image output unit 7.

The image storage unit 5 comprises a memory or the like, and stores background image data input from the image input unit 1. Further, the image storage unit 5 stores the left-eye panoramic image data and the right-eye panoramic image data generated by the processing control unit 4, respectively.

The image display unit 6 is a CRT (Cathode Ray Tu)
be) and the like, and displays the panoramic image data for the right eye for operation stored in the image storage unit 5.

The image output unit 7 converts the left-eye panorama image data and the right-eye panorama image data sent from the processing control unit 4 into video signals, respectively, and outputs them to the stereoscopic image display unit 8.

The three-dimensional image display section 8 includes a head mount
It comprises a display and the like, and displays a stereoscopic image in accordance with the left-eye video signal and the right-eye video signal sent from the image output unit 7.

Hereinafter, a stereoscopic image display process in the panoramic stereoscopic image display system according to the embodiment of the present invention will be described with reference to the drawings. FIG. 2 is a flowchart illustrating a panoramic stereoscopic image display process performed by the panoramic stereoscopic image display system. When the user inputs instruction data for instructing the start of the display processing from the operation input unit 2, the panoramic stereoscopic image display processing shown in FIG. 2 is started.

First, the image input unit 1 inputs a plurality of background image data from an external color scanner or the like (not shown) (step S1). That is, the image input unit 1 inputs a plurality of background image data as shown in FIG. The image input unit 1 supplies the input background image data to the processing control unit 4. The processing control unit 4 stores the acquired background image data in the image storage unit 5.

The processing control unit 4 combines the plurality of background image data stored in the image storage unit 5 to generate a left-eye panorama image and a right-eye panorama image (step S2). That is, the processing control unit 4 pastes a plurality of background image data as shown in FIG. 3 inside the annular band in the virtual space and combines them so that the joints are not conspicuous to form one panoramic image. Combine. At that time, the processing control unit 4 sets the coordinate conversion parameter based on the parallax stored in the parameter storage unit 3 in advance.
A panorama image for the left eye and a panorama image for the right eye are generated. As a result, a panoramic image having parallax as shown in FIG. 4 can be generated. The processing control unit 4 stores the generated panoramic image in the image storage unit 5.

The processing control section 4 displays a right-eye panoramic image for operation on the image display section 6 (step S).
3). That is, the processing control unit 4 displays a partial area in the generated right-eye panoramic image and smoothly moves the image in accordance with the user's viewpoint change instruction, thereby forming a 360-degree three-dimensional panoramic image. indicate.

Further, the processing control section 4 simultaneously outputs the same panoramic image data for the left eye and the right panoramic image data as the panoramic image displayed on the image display section 6.
The image is transmitted to the image output unit 7 (step S4). That is,
The processing control unit 4 outputs the left-eye panorama image data and the right-eye panorama image data, which are the same as some regions in the right-eye panorama image displayed on the image display unit 6, to the image output unit 7 Send to

The image output unit 7 converts the left-eye panorama image data and the right-eye panorama image data sent from the processing control unit 4 into video signals, respectively, and outputs them to the stereoscopic image display unit 8 (step). S5).

The three-dimensional image display unit 8 displays a three-dimensional image according to the left-eye video signal and the right-eye video signal sent from the image output unit 7 (step S6). As a result,
It is possible to display a panoramic stereoscopic image with a sense of reality.

In the above-described embodiment, a plurality of background image data input from the image input unit 1 are subjected to panoramic synthesis by the processing control unit 4, but panorama synthesis may be input from the beginning. By generating a left-eye panorama image and a right-eye panorama image from panorama synthesis generated by another image generation device, it is possible to omit a synthesis process for combining a plurality of images.

In the above-described embodiment, only one panoramic image for the right eye is displayed on the image display unit 6. However, two panoramic images for the left eye and the right eye are arranged side by side.
May be displayed. By displaying the two panoramic images for the left and right eyes side by side, the panoramic image can be stereoscopically viewed according to the convergence angle of both eyes.

In the above-described embodiment, the left-eye panorama image and the right-eye panorama image are generated in accordance with the predetermined parallax value. However, the input values from the user may be used. For example, a parallax value in millimeters is input from the operation input unit 2 to generate left and right panoramic images,
An appropriate panoramic stereoscopic image can be displayed to the user's eyes.

The panoramic stereoscopic image display system of the present invention can be realized by using a general computer system without using a dedicated system. For example, a medium (floppy disk, CD-ROM) storing a program for executing any of the above-described processes in a computer
By installing the program from
A panoramic stereoscopic image display system that executes the above-described processing can be configured.

The medium for supplying the program to the computer may be a communication medium (a medium that temporarily and fluidly stores the program, such as a communication line, a communication network, or a communication system). For example, the program may be posted on a bulletin board (BBS) of a communication network and distributed via the network. Then, by starting this program and executing it in the same manner as other application programs under the control of the OS, the above-described processing can be executed.

[0034]

As described above, according to the present invention,
It is possible to display a panoramic stereoscopic image with a sense of reality.

[Brief description of the drawings]

FIG. 1 is a schematic diagram showing a configuration of a panoramic stereoscopic image display system according to an embodiment of the present invention.

FIG. 2 is a flowchart illustrating a panoramic stereoscopic image display process according to the embodiment of the present invention.

FIG. 3 is a schematic diagram showing a plurality of background images.

FIG. 4 is a schematic diagram showing a panoramic image synthesized from a background image.

FIG. 5 is a schematic diagram showing a state in which shooting is performed while changing the angle.

FIG. 6 is a schematic diagram showing a plurality of captured images.

FIG. 7 is a schematic diagram showing an image of an image pasted inside a ring-shaped band in a virtual space.

[Explanation of symbols]

 Reference Signs List 1 image input unit 2 operation input unit 3 parameter storage unit 4 processing control unit 5 image storage unit 6 image display unit 7 image output unit 8 stereoscopic image display unit

Claims (5)

[Claims] 1. Background image input means for inputting a plurality of image data serving as a real image of a background image, and a plurality of image data input by the background image input means are respectively combined to obtain predetermined disparity information. According to
Panoramic image generating means for generating panoramic image data for the left eye and panoramic image data for the right eye, and displaying panoramic image data for the left eye and panoramic image data for the right eye generated by the panoramic image generating means Image data converting means for converting the image data into signals, and stereoscopic image display means for displaying a stereoscopic image according to the left-eye video signal and the right-eye video signal converted by the image data converting means. A featured panoramic stereoscopic image display system. 2. An operation panorama image display means for displaying an operation panorama image, wherein the image data conversion means synchronizes with the panorama image displayed on the operation panorama image display means, The panoramic stereoscopic image display system according to claim 1, wherein the panoramic image data for the left eye and the panoramic image data for the right eye generated by the panoramic image generating means are respectively converted into video signals. 3. The image processing apparatus according to claim 1, further comprising: disparity information input means for inputting disparity information, wherein the panoramic image generating means is configured to output left-eye panoramic image data and right-eye panoramic image data according to the disparity information input by the disparity information input means. The panoramic image display system according to claim 1 or 2, wherein the panoramic image data is generated. 4. A background image input step of inputting a plurality of image data serving as a real image of a background image, and a plurality of image data input in the background image input step are combined, and predetermined disparity information is obtained. A panoramic image generating step of generating panoramic image data for the left eye and panoramic image data for the right eye, and panoramic image data for the left eye and panoramic image data for the right eye generated by the panoramic image generating step To a video signal, and a stereoscopic image display step of displaying a stereoscopic image according to the left-eye video signal and the right-eye video signal converted in the image data conversion step. A panoramic three-dimensional image display method, characterized in that: 5. A computer-readable recording medium for recording a program for causing a computer to function as a panoramic three-dimensional image display system, comprising: a background image inputting step of inputting a plurality of image data serving as a real background image; A panoramic image generating step of combining a plurality of image data input in the background image input step and generating panoramic image data for the left eye and panoramic image data for the right eye according to predetermined parallax information, An image data conversion step of converting the left-eye panorama image data and the right-eye panorama image data generated in the panorama image generation step into a video signal, respectively, and a left-eye panorama image converted in the image data conversion step To display a stereoscopic image in accordance with the video signal of A recording medium storing a program for realizing a body image display step.