JPH0463092A - Three-dimensional scene display system - Google Patents

Abstract

PURPOSE:To easily cope with display systems different in display circumstances to relax restrictions on photographing and display by storing the video of a wide-range three-dimensional scene and obtaining two-dimensional videos to be displayed in accordance with display circumstances by a calculating means. CONSTITUTION:A video 3 of a wide-range three-dimensional scene including two-dimensional videos to be displayed on display screens 1a, 1b, and 1c of a display device 20 is inputted by a three-dimensional scene input device 12. The scene input device 12 photographs with a camera to which a lens capable of photographing a wide range is set. The video of the tree-dimensional scene from the scene input device 12 is stored in a storage device 16 through a processor 14. The processor 14 typically includes a microcomputer and the other data processors and converts the video 3 of the three-dimensional scene read out of the storage device 16 to two-dimensional videos to be displayed on display screens 1a, 1b, and 1c. Display circumstance information such as directions of sight and angles of visual fields for display screens 1a, 1b, and 1c from an observer is inputted from a display circumstance input device 18.

Description

[Detailed Description of the Invention] [Industrial Application Field] The present invention relates to a three-dimensional scene display system, and is particularly applicable to, for example, a multi-screen display system that simultaneously displays images from a plurality of different viewing directions on different display screens. , relates to a three-dimensional scene display system.

[Prior art]

One of the systems that provides realistic images at exhibitions, etc.
has a multi-screen display system. This system uses multiple cameras to capture images in different viewing directions from viewpoints, and displays these images simultaneously on multiple display screens placed in different viewing directions from the viewer's perspective, such as in a theater. It is something to do.

In a conventional general multi-screen display system, a plurality of different images are required to display different images on a plurality of display screens arranged in different viewing directions. For this purpose, it is necessary to determine the position and direction of the cameras to reproduce the relationship between the actual display screen and the viewer (line of sight direction) using a number of cameras corresponding to the number of images, and to take pictures. There were many restrictions on.

Furthermore, in a large display system having more than ten display screens, a correspondingly large number of cameras are required for photographing, resulting in large photographic equipment.

Furthermore, in order to display images shot at -degrees, a display system is required that has a display screen that reproduces the shooting conditions such as the position and direction of the camera when the images were shot. There was a problem that theaters were limited. For example, in a multi-screen display system having three display screens 1a, lb, and 1c as shown in FIG. 7, images viewed from different viewing directions from the observer 2 are displayed. The images displayed on these three display screens 1a to IC were taken with three cameras assuming the arrangement of the display screens. For example, two images arranged vertically as shown in FIG. This cannot be displayed in a multi-screen display system with different layouts, such as two display screens 1d and 1e.

Therefore, the main object of the present invention is to provide a three-dimensional scene display system that can alleviate restrictions during photographing and display.

[Means for Solving the Problems] Simply put, the present invention comprises a scene input means for inputting an image of a three-dimensional scene, a storage means for storing the input image of the three-dimensional scene, a display screen and an observer. a display environment input means for inputting information regarding the display environment representing the relationship between the display environment input means;
A three-dimensional device comprising: calculation means for calculating a two-dimensional image to be displayed from an image of a three-dimensional scene stored in the storage means; and display means for displaying the two-dimensional image obtained by the calculation means. It is a scene display system.

[Effect]

The three-dimensional scene input means takes an image of a wide range of three-dimensional scenes including a plurality of two-dimensional images to be displayed in advance with a camera equipped with, for example, a wide-angle lens or a fisheye lens, and inputs the images of the three-dimensional scene. The image of this three-dimensional scene is stored in the storage means, and when displayed, information such as the direction from the observer to the display screen of the display means (line of sight direction) and the viewing angle of the display screen from the observer is input from the display environment input means. Depending on the input display environment, the calculation means converts the image of the three-dimensional scene into a two-dimensional image, for example, by projection transformation, and the two-dimensional image is displayed by the display means.

〔Effect of the invention〕

According to the present invention, for example, when photographing images for a multi-screen display system, conventionally it was necessary to use a number of cameras corresponding to the number of display screens, but according to the present invention, For example, images of a wide range of 3D scenes are stored and converted into the necessary 2D images using calculation means, so the number of cameras can be reduced or
It can be made into a stand. Furthermore, since the two-dimensional image to be displayed is determined by the calculation means according to the display environment, it is possible to easily handle display systems with different display environments.

The above objects, other objects, features and advantages of the present invention will become more apparent from the following detailed description of embodiments with reference to the drawings.

〔Example〕

Referring to FIG. 2, a three-dimensional scene display system 10 of this embodiment includes a three-dimensional scene input device 12, and a three-dimensional scene image from this scene input device 12 is stored via a processing device '14. stored in the device 16. Then, the display environment input from the display environment input device 18 is transmitted to the processing device 14.
A predetermined calculation is performed on the image of the three-dimensional scene read out from the storage device 16 to obtain necessary two-dimensional image data and provided to the display device 20.

To explain in more detail, the three-dimensional scene input device 12 is
As shown in FIG. 1, the display screens 1a, l of the display device 20
b and 1. An image 3 of a wide range of three-dimensional scenes including two-dimensional images to be displayed is input to c. For this purpose, the scene input device 12 uses a camera equipped with a lens capable of photographing a wide range, such as a wide-angle lens or a fisheye lens.

The processing device 14 typically includes a microcomputer or other data processing device, and displays the image 3 of the three-dimensional scene shown in FIG. 1 read out from the storage device 16 on each display screen 1a.
, lb and 1c. For this purpose, the display environment input device 18 inputs display environment information such as the line of sight direction and viewing angle of each display screen 1a, lb and IC from the observer. Then, as shown in FIG. 4, the processing device 14 projects and transforms the three-dimensional scene 3 photographed with a wide-angle lens onto the display screen la, performs image processing such as interpolation as necessary, and performs image processing on the display screen. A two-dimensional image for 1a is obtained.

For example, as shown in Figure 4, the observer's viewpoint is set to O(0
,0,0), and the point P (x
, y, z) on the display screen 1a by projective transformation.
X", y", Z'), if the equation of the plane of the display screen 1a is Ax+By+Cz+D=O, then the point P
° is given by the following formula.

The image of the display screen 1a can be obtained by calculating all points (pixels) on the display screen 1a by the projection transformation given by the old method. Similarly, two-dimensional images for other display screens 1b and ICs can also be calculated.

Therefore, in the embodiment of FIG. 2, each time the scene changes, step S
In step S2.1, a three-dimensional scene image is called from the storage device 16, and in step S2. Step S3.34 is repeated as many times as there are display devices, that is, display screens, and a two-dimensional image is obtained as described above.

Furthermore, if similar projection transformation processing is applied to a multi-screen display system in which a plurality of display screens 1d and 1e are arranged vertically as shown in FIG. A two-dimensional image can be obtained.

In this way, the direction of the display screen as seen from the viewer of the display system (
If the viewing direction) and the size of the display screen (viewing angle) are known, the two-dimensional image to be displayed on the display screen can be calculated.

Note that, as shown in FIG. 5, if a plurality of cameras 22a, 22b, and 22c equipped with wide-angle lenses are used, images of an even wider range of three-dimensional scenes can be input.
It is possible to support multi-screen display systems with even more diverse display screen arrangements.

Furthermore, as shown in FIG. 6, it is also possible to photograph a three-dimensional scene corresponding to approximately half a celestial sphere using a camera 24 equipped with a fisheye lens. The images obtained in this way are orthographically projected onto a display screen in any viewing direction or viewing angle,
If image processing such as interpolation is performed as necessary, the video captured by one camera 24 can be used in almost all types of multi-screen display systems.

Furthermore, the present invention is not limited to the above-mentioned multi-screen display system, but is also applicable to a multi-screen display system that, although not shown, changes the display on a display screen built into goggles (helmet) as the observer changes direction. For example, it can be applied to space simulation devices such as fighter jet cockbits.

[Brief explanation of the drawing]

FIG. 1 is an illustrative diagram showing the principle of the invention. FIG. 2 is a block diagram showing an embodiment of the present invention. FIG. 3 is a flow diagram showing operations for obtaining a two-dimensional image to be displayed on the display screen shown in FIG. 1 according to the embodiment of FIG. FIG. 4 is an illustrative diagram showing the creation of the two-dimensional image in FIG. 3. Figure 5 shows three cameras equipped with wide-angle lenses.
FIG. 3 is an illustrative diagram showing a case where a dimensional scene is photographed. FIG. 6 is an illustrative diagram showing a case where a three-dimensional scene is photographed by a camera equipped with a fisheye lens. FIGS. 7 and 8 are illustrative views showing different examples of multi-screen display systems. In the figure, 10 represents 3D scene display system 12.
a dimensional scene input device; 14 is a processing device; 16 is a storage device;
18 is a display environment input device, 20 is a display device, 22a-2
2c and 24 are cameras, 1a to 1e are display screens, and 3 is an image of a three-dimensional scene. Patent Applicant Sanyo Electric Co., Ltd. Agent Patent Attorney Yama

Claims (1)

[Scope of Claims] Scene input means for inputting an image of a three-dimensional scene; storage means for storing the input image of the three-dimensional scene; and a display for inputting information regarding the display environment representing the relationship between the display screen and the observer. an environment input means, a calculation means for calculating a two-dimensional image to be displayed from the image of the three-dimensional scene stored in the storage means according to the display environment input by the display environment input means; A three-dimensional scene display system comprising display means for displaying the two-dimensional image obtained by the calculation means.