JP3047820B2 - Video display system - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a video display system that displays a video on a video display device in a projection room so that a viewer can enjoy an experience as if he were actually in a certain space.

[0002]

2. Description of the Related Art Conventionally, there has been a method in which various kinds of video software take a video using a live-action camera and project the video on a flat screen installed in front of a viewer. However, naturally, in this method, the projected image is planar, and a sense of reality that exists in a certain space cannot be obtained. Therefore, recently, in order to give a stereoscopic effect to a two-dimensional image projected on a flat screen, a stereoscopic image using the effect of binocular parallax of a human being is taken using two cameras at the same time. It has become. In addition, a projection screen having a curved surface has been used in order to give a more realistic feeling to the projection screen.

[0003]

These video reproduction systems, for example, when a stereoscopic video utilizing the effect of human binocular parallax is projected, the user can enjoy the sense that the video is approaching the eyes, In the case of using a projection screen having a curved surface, it is possible to reproduce an image in a certain range viewed from a viewer. However, in each of these video reproduction systems, since the viewer sits in front of the screen, the video only shows the video with a limited field of view, and the more the viewer is placed in the actual space, the more the video is displayed. I couldn't taste the realism. Further, when a screen having a curved surface such as an all-sky screen is used, a projection dome specially designed for installing the screen is required, which is very costly. Therefore, an object of the present invention is to provide a video display system that allows a viewer to enjoy a sense of realism as if he or she were actually in a certain space without using a special photographing device or a projection dome.

[0004]

According to the present invention, there is provided a projection room for accommodating a viewer of a video, and 4 rooms constituting the projection room.
A video display device provided on at least three sides of the peripheral side, the ceiling side, and the floor side that are the front side and the left and right side faces of the viewer;
And a video display control device for controlling the video display device, which can be obtained in different directions by the video display control device.
While synchronizing the images so that there is no time lag,
The image display device corresponding to images obtained in different directions
In the video system to display in , comprising a movement information input means for inputting movement information including viewpoint information of the video viewer,
An image display system characterized in that the input movement information is input to the image display device and an image generated based on the movement information is displayed.

[0005] Further, the moving information includes viewpoint information and gazing point information.

Further, the image is a three-dimensional stereoscopic image.

The video is a three-dimensional stereoscopic video in three directions viewed from a certain viewpoint.

[0008] Further, the image is an image generated by a computer graphics technique.

[0009]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of the video display system according to the present invention will be described in detail with reference to the drawings. FIG. 1 is an explanatory perspective view showing the whole of a video display system according to an embodiment of the present invention. In this system, all aspects surrounding the projection room to create a virtual space,
That is, rear projection type projection screens 11 to 11 as image display devices are provided on the front, rear, left and right four circumferential side surfaces (wall surfaces), ceiling surface and floor surface with respect to the viewer a.
16 is arranged. Although not shown, the projection screens 11 to 16 are arranged in a normal room.

A total of six projectors 21 to 26, one for each of the six projection screens, are arranged outside the projection screens 11 to 16. The projectors 21 to 26 are controlled by a controller 41 (not shown) as a video display control device, and temporally display images in different directions sent from an image signal reproducing device (not shown) on each screen. It is designed to project in synchronization with.

At the time of photographing an image, the image is photographed by a camera which is oriented in each of the front, rear, left and right and up and down directions. For example, an image of a train approaching from the left is captured by a camera on the left side of the photographer, and when the train passes in front of the photographer's eyes, the image is captured by a camera in front of the photographer. When the train runs away to the right, the camera shoots video with the camera on the right. When the image thus captured is displayed by the present system, the viewer a first looks at the projection screen 13 on the left side, shifts the viewpoint to the projection screen 11 on the front side, and finally shifts the viewpoint to the projection screen 14 on the right side. If you move it, it will be appreciated
The video image changes with the passage of time, and the user can enjoy the same sense of reality as if he were actually at the shooting site.

Further, the six projection screens 11 to 1 are provided.
A three-dimensional stereoscopic video may be used for the video developed in (6). Thereby, the viewer a feels, for example, that the train is coming up from the front projection screen 11 and approaching himself, and after looking close to him, looks back immediately,
By looking into the rear screen 12, the train can now feel as if it is far away. like this
At the same time, the viewed image changes over time,
You can experience the same sense of realism as if you were at the shooting site
it can. At this time, the seams of the projection screens 11 to 16 are spatially continuous despite the existence of the seam, because the seams are remembered behind the image floating from the projection screen and the viewer is not focused. It is possible to watch the video. When such a stereoscopic image is combined with all six projection screens, the sense of presence becomes unimaginable.

As can be seen from the above example, the projection screen does not necessarily require six surfaces. In other words, if the train passes in front of the viewer, it is desirable to place it on the front and left and right sides of the viewer, and if the train approaches and leaves, it is placed on the front, back, left and right opposite two faces of the viewer. It is possible to express the sense of presence. Therefore, it is sufficient to arrange them on at least the three surfaces of the front and left and right sides of the viewer.

Next, another embodiment in the case where computer graphics are used as images will be described. FIG. 2 is a block diagram showing the configuration of the video display system according to this embodiment. In this embodiment, a video simulation system is used.
The images projected on each of the projection screens 11 to 16 are generated by image generation devices 31 to 36 dedicated to the four peripheral surfaces, the ceiling surface, and the floor surface. Image generating devices 31 to 36
Basic shape data necessary for generating a simulation image, that is, shape, color, reflectivity, etc., are input in advance, and a computer graphics method is used to enter a viewpoint into the projection room from these data. When placed, images in six directions are generated. All six images thus generated are synchronized by the controller 41 so as not to cause a time lag, and the projectors 21 to 21 are synchronized.
26, the image is projected on the projection screens 11 to 16. That is, the image generated by the right-side simulation generation device 34 provided to simulate the landscape to be developed on the right side of the viewer a is projected on the projection screen 14 on the right side of the viewer.

The viewer is located at the center of the projection room, and can enjoy a virtual experience of the virtual space by looking at the projection screen in an appropriate direction according to the contents of the image. For example, in a scene where an airplane is approaching from the left, passing in front of the viewer, and flying away in the right direction, first look at the screen 13 on the left, and gradually see the screen 11 on the front. After the airplane has passed in front of the vehicle, the viewing direction may be gradually changed to the screen 14 on the right side in accordance with the movement of the airplane.

The six projection screens 11 to 1 are also provided.
A three-dimensional three-dimensional image may be used for the simulation image developed in Step 6. By doing so, the viewer feels, for example, that the airplane is approaching from the front projection screen 11 due to the effect of the stereoscopic image, and after approaching,
If you look back and look into the rear projection screen 12, you can feel the feeling of moving away. If three-dimensional images are combined and projected on all six surfaces, the sense of presence becomes unimaginable.

As described above, the projection screen does not necessarily require six surfaces.

Next, a case will be described in which an image is generated in real time when the viewer's viewpoint moves using computer graphics. In each of the simulation image generation devices 31 to 36, basic shape data necessary for generating an operation simulation image in advance, that is, a shape,
The color, the reflectance, etc. are input. Viewer 61 controls
When the user sits in front of, scenes of the departure point are generated by the simulation image generation devices 21 to 26, and are projected on the projection screens 11 to 16 by the corresponding projection projectors 21 to 26, respectively.

When the viewer operates a steering wheel, an accelerator, a brake and the like provided on the control device 61, control information is sent to the control information analyzer 51. Maneuver information analyzer 51
Then, based on the received maneuvering information, the motion data (movement, viewpoint and gazing point, perspective angle, etc.) are developed and calculated in six directions of front, rear, left, right, up and down, and the corresponding simulation image generating devices 31 to 32 are respectively provided. Hand over to The simulation image generation devices 31 to 36 generate the image generation calculation units 311 to 36 using the respective motion data as parameter information.
In step 1, a simulation image in each viewpoint direction is generated. The controller 41 includes six independent image generation calculation units 31
The reproduction of the images generated in steps 1 to 361 is synchronized. When completing the generation of the image, each of the image generation calculation units 311 to 361 sends a completion signal to the controller 41. Controller 41
Issues a command to the six simulation image generation devices 31 to 36 to start writing image data to the frame memories 312 to 362 for displaying images. Each of the frame memories 312 to 362 includes a D / A converter 313.
To 363 are connected, and the output analog video signal is input to each of the projectors 21 to 26 and projected on the projection screens 11 to 16. The control device 61
The control signal sent from the controller is sent, for example, in units of 1/30 seconds, and the simulation image generation devices 31 to 36
Since it is generated in real time, a continuous and smooth moving image can be displayed.

[0020] By providing an interactive simulation mechanism described above, an image prior viewer is unilaterally deployed from things like a constant <br/>-viewing, freely expanded contents of the video by the operation of the viewer Because it can be changed, it is possible to enjoy the feeling that the viewer is just experiencing, and there is an advantage that the content is not tired of at once.

The embodiment of the display system according to the present invention has been described above. However, the present invention is not limited to the above-described embodiment, and various changes can be made without departing from the spirit of the present invention. It is. For example, in the present embodiment, the image display device is a rear projection type projection screen, but a thin flat plasma display or the like may be used to save space or reduce installation costs. In this case, since the plasma display can be directly installed on a wall surface, a ceiling surface, or a floor surface, the installation work becomes very easy.

In this embodiment, an image generation operation unit is provided independently for each projection screen for the purpose of explanation. However, one image generation operation unit generates images corresponding to six surfaces. Image data may be sent to each projector.

Further, in the present embodiment, the projection screens are arranged on all surfaces surrounding the projection room arranged in the room, but the invention is not limited to this. The viewer simply sits in front of the screen as in the past, and is arranged so that the viewer can enjoy the sense of being realistic in a real space without having a limited field of view. I just need. That is, as described above, of the six surfaces surrounding the projection room, at least the front of the viewer,
What is necessary is just to arrange | position on three surfaces of a right and left side surface.

As described above, according to the video display system of the present embodiment, the viewer can view the video from all directions surrounded by the viewer, so that the viewer can feel as if he or she is actually in a certain space. You can taste. In addition, it is not necessary to use a special photographing device or a projection dome, and it is only necessary to install a projection screen in a normal room. Therefore, it is possible to simulate a space full of realism at low cost.

Also, by generating a simulation image by computer graphics, even if it is difficult to actually shoot a scene or a landscape that does not exist, the viewer can experience the experience as if he were actually in that space. It becomes possible to do.

Further, if a moving information input means for a viewpoint serving as a base point of the image generation is provided and the image is generated based on the moving information from the moving information input means, the contents of the development of the video can be controlled by the viewer. it is possible to the freely changed, can be changed interactively video, it can be simulated as moving a space where viewer is actually.

[0027]

According to the present invention, it is possible to provide a video display system which can provide a sense of realism as if it were actually in a certain space without using a special photographing device or a projection dome. Since the video generated based on the movement information including the video viewer's viewpoint information is projected, the development content of the video can be freely changed or interactively changed. You can enjoy a realistic virtual experience as if you were.

Also, since the movement information includes viewpoint information and gazing point information, the image changes in accordance with the movement of the position of the viewer's eye and the position of interest in the projection room, and furthermore, the reality is increased. A close space can be reproduced.

Further, since the image is a three-dimensional stereoscopic image, the image is raised and observed. Therefore, it is possible to view a spatially continuous image without observing the joint of the image display device on each surface. it can.

Further, since the image is a three-dimensional image in three directions viewed from a certain viewpoint, a joint of the image display device on each surface is not observed, and only a spatially continuous image can be reproduced. Instead, the viewer can enjoy the sense of presence as if he were in a real space.

Further, the image is provided by a computer
Because it is a video generated by the graphics method,
Actually, even if it is difficult to shoot or a scene that does not exist, it can be reproduced or created as a space.

[Brief description of the drawings]

FIG. 1 is an explanatory perspective view showing an entire video display system according to an embodiment of the present invention.

FIG. 2 is a block diagram illustrating a configuration of a video display system according to another embodiment. a viewer 11 front projection screen 12 rear projection screen 13 left projection screen 14 right projection screen 15 top projection screen 16 bottom projection screen 21 front projection projector 22 rear projection projector 23 left projection projector 24 right projection projector 25 top projection Projector 26 Lower surface projector 31 Front simulation image generator 32 Back simulation image generator 33 Left simulation image generator 34 Right simulation image generator 35 Upper simulation image generator 36 Lower simulation image generator 31 Front simulation image generator 41 Controller 51 Operating information analyzer 61 Operating device

Continuation of the front page (58) Fields investigated (Int. Cl. ⁷ , DB name) G03B 21/00 G03B 35/00-35/26 G03B 37/00 H04N 5/74 H04N 13/04

Claims (5)

(57) [Claims] 1. A projection room for accommodating an image viewer, and images provided on at least three of the four peripheral side surfaces, the ceiling surface, and the floor surface constituting the projection room, namely, the front surface and the left and right side surfaces of the viewer. A display device, and a video display control device for controlling the video display device.
There is no time lag between images obtained in different directions.
Video in different directions while synchronizing
A corresponding video system for displaying on the video display device, comprising: mobile information input means for inputting mobile information including viewpoint information of a video viewer, inputting the input mobile information to the video display device, and A video display system, which displays a video generated based on a video. 2. The video display system according to claim 1, wherein said movement information includes viewpoint information and gazing point information. 3. The video display system according to claim 1, wherein said video is a three-dimensional stereoscopic video. 4. The video display system according to claim 1, wherein said video is a three-dimensional stereoscopic video in three directions viewed from a certain viewpoint. 5. The video display system according to claim 1, wherein said video is a video generated by a computer graphics technique.