JP3159370B2 - Dome type environment simulation method and apparatus - Google Patents

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a method and an apparatus for simulating a dome-type environment, and more particularly to a method for projecting an image taken by a wide-angle lens camera onto a dome-shaped screen covering the entire field of view of a user with a low distortion, thereby realizing a highly realistic simulation. The present invention relates to a dome type environment simulation method and apparatus for reproducing an environment space.

[0002]

2. Description of the Related Art Various methods for simulating a visual environment have been proposed. For example, a space simulation device (CA) that captures environmental images on four flat screens surrounding the user
VE or Omnimax), a method of giving virtual reality (virtual reality) by means of a display (Head Mounted Display, HMD) or BOOM on the head of the user, a method of looking directly into the model, and a snorkel camera inside the model A method of confirming an image has been already used according to the purpose and effect.

[0003]

However, the image projected by the conventional method does not always occupy the entire field of view of the user, and in the case of an image having a relatively wide field of view, the brightness and resolution are insufficient or insufficient. The uniformity tends to occur, the image shape is distorted, and the simulated simulated environment lacks a sense of reality.

Accordingly, it is an object of the present invention to provide a stereoscopic wide view.
It is an object of the present invention to provide a dome-type environment simulation method and apparatus for presenting an environment simulation space having a high sense of reality by projecting a wild image.

[0005]

An image of an environment with a wide field of view can be taken by a camera having a wide-angle lens such as a fish-eye lens. The inventor of the present invention believes that the image produced by the wide-angle lens causes distortion at the peripheral portion. It has been noticed that the edge of the image is farther away from the single projector than its center, so that the image edge distortion due to the wide-angle lens is at least partially canceled out. The present invention has been completed based on the knowledge on the cancellation of the distortion.

Referring to the embodiment of FIG. 1, in the dome-shaped environment simulation method of the present invention, an environment image 3 is created by an image pickup device 2 with a wide-angle or fish-eye lens 1 and a spherical or non-spherical curved surface having a concave surface. Of the dome-shaped screen 8 of the dome-shaped screen 8
Closed space on the back side where the negative pressure can be adjusted by the exhaust pump 14
It is formed and the environmental image 3 projected onto the rear side of the screen 8 by the rear projector 7 spaced projecting side from the projecting end of the dome-type screen 8, the dome-type screen 8
The resolution of the image above is adjusted according to the negative pressure adjustment of the enclosed space.
The screen is controlled by adjusting the curvature of the screen 8 .

In this case, since the peripheral portion of the projected image is farther from the rear projector 7 than the central portion, distortion of the image peripheral portion due to the wide-angle lens 1 is at least partially canceled.

[0008]

DESCRIPTION OF THE PREFERRED EMBODIMENTS Referring to FIGS. 1 and 4D, according to the present invention, an environmental image 3 is created by an image pickup device 2 such as a camera with a standard lens. In this case, the front side of the curved dome-shaped screen 8 having the concave side is opposed to the simulated environment experience 9 and the environmental image 3 is placed on the back side of the dome-shaped screen 8.
Is projected by the rear projector 7. The “rear projector” is a projector that projects the image 3 from behind the screen 8 so that the image of the image 3 in the correct orientation can be seen on the front side of the screen 8. When the experienced person 9 looks at the viewpoint on the front side of the screen 8, the image of the environmental image 3 has a three-dimensional effect according to the curved surface of the screen 8. For example, when the central part of the environment in the visual field of the imaging device 2 is farther from the imaging device 2 than the other parts of the visual field, when the environment image 3 of the environment is projected on the screen 8 in FIG. Since the central portion of the screen 8 is recessed from the peripheral portion, the central portion is separated from the peripheral portion from the viewpoint of the observer 9, so that a perspective image is viewed on the screen 8. Since the viewpoint of the user 9 is surrounded by the image on the screen 8, the user has a high sense of presence in the environment.

Referring to FIG . 4A, a wide-angle or fish-eye lens
Cityscape with a wide field of view by the imaging device 2 with
An image of an environment such as a landscape (hereinafter, a wide-field image) 3a
The wide field-of-view image 3a is taken and the concave surface is
Rear project placed behind the screen 8
Projector 7 projects. Center axis of screen 8 and rear
It is desirable to align with the optical axis of the projector 7
New In the wide-field image 3a taken through the wide-angle lens 1,
No distortion at the center and it is continuous as it spreads in the radial direction
The distortion tends to shrink. On the other hand, rear projector
7 to the projection surface of the dome screen 8
The projection surface of the screen 8 extends from the center of the screen 8 to the periphery
Therefore, they increase sequentially and continuously. Therefore, the wide-angle lens 1
Wide-field image 3a taken through the dome-shaped screen 8
The rear projector 7 arranged on the back side as described above
When projected, the distortion of the periphery of the wide-field image 3a is reduced.
A Projection surface of dome screen 8 from projector 7
Is corrected by said sequential increase in the distance to
For this reason, the distortion of the image periphery due to the wide-angle lens 1 is corrected.
Image of the wide-field image 3a projected on the dome-shaped screen 8.
Can be projected.

Thus, the wide-field image 3a is projected.
When the user 9 faces the front side of the dome-shaped screen 8,
Experiencer 9 is surrounded by the concave side of the dome screen 8
You will see an environmental image that covers your entire field of view. Only
In this environmental image, the peripheral distortion in the wide-field image 3a is small.
High immersion as modified by clean curvature
You can experience the simulation environment with a feeling.

[0011] Thus, the object of the present invention is to provide a three-dimensional effect.
Environment simulation space with a high sense of reality by projecting wide-field images
Of dome-shaped environment simulation method and device to be presented "
can do.

In the example shown in FIG. 1, the dome-shaped screen 8 is so large that the body of the user 9 can enter the front concave surface, but the present invention is not limited to this size. For example, a dome-type environment simulation device of the present invention can be used as long as it can give a sufficient realism to the user even if only the head of the user 9 can enter.

[0013]

FIG. 4 (B) shows a projection of an environmental image 3 by the wide-angle lens 1 in FIGS. 1 and 4 (A), by attaching an appropriate correction lens 7a such as a fish-eye lens to the rear projector 7. 4 shows an embodiment in which distortion at the peripheral edge of the environmental image 3 caused by the wide-angle lens 1 is removed even better than in the case of FIG.

FIG. 4 (C) shows a rear projector 7 with a correction lens 7a in which an environmental image 3 taken by an image pickup device 2 with a standard lens is placed on a spherical or non-spherical curved screen 8 having a convex surface. An example is shown in which the stereoscopic effect of the image on the screen 8 is enhanced by projection.

When a part of an image on the screen 8 is to be viewed while being enlarged, reduced or emphasized, as shown in the example of FIG. Auxiliary optical means 16 suitable for the above may be provided.

It is also possible to arrange the dome-shaped screen 8 in front of and behind the experience person 9 so as to form a simulation device in which the experience person 9 is completely surrounded by a simulation environment. In the example of FIG. 1, the dome screen 8 is in front of the face of the user 9, but the screen 8 may be above the head of the user 9. Further, the dome-shaped screen 8 may be attached to the ceiling face upward or downward to be used for displaying various images.

The imaging device 2 of FIG. 1 used in the present invention includes, for example, an optical or electronic still camera 2a,
Video camera 2b, CCD (Charge Coupled Device) camera 2
c, an imaging tube camera or the like. A preferred example of the wide-angle lens 1 is a fish-eye lens whose viewing angle is as close as possible to 180 °. In selecting the imaging device 2 and the optical specifications (the type and number of cameras and lenses, elevation angle, depth of field, etc.) at the time of shooting, the shape of the dome-shaped screen 8 and the optical characteristics of the rear projector 7 are taken into consideration. Then, the image distortion due to the wide-angle lens 1 at the time of shooting can be sufficiently corrected at the time of projection.

When the image pickup device 2 is a still camera 2a, video camera 2b, CCD camera 2c, or the like that generates an electric image signal, an image on which the image signal is subjected to color tone correction and other various image processing. The processing device 4 is provided, and the wide-field image 3a after the image processing can be projected by the rear projector 7. When the optical characteristics of the wide-angle lens 1 and the image pickup device 2 are known, it is expected that the image processing device 4 corrects the peripheral distortion of the wide-field image 3a.

In the embodiment shown in FIG. 1, for example, CG (Computer
Graphics) An editor 5 for editing another image or moving image from the image creator 6 in combination with the environment image 3 is provided, and the edited image 3 having a large amount of information is projected on the dome-shaped screen 8. According to the editor 5, not only image synthesis but also creation of a walk-through image and other various image processing, recording of an edited image, and the like are possible. In order to enhance the sense of realism of the environmental image 3 of the present invention by comparing it with other methods, a screen presented by another space simulation device such as a five-sided liquid crystal monitor is taken by a CCD camera 2c with a fisheye lens, and this is dome-shaped. It is also possible to project on the screen 8 for comparison, and to supplement the information based on the result.

For projecting the environmental image 3 by the rear projector 7, a plurality of cameras and projectors may be used. In the present invention, the projection by one image pickup device 2 and one rear projector 7 is performed. Is the basis. This is because the time required to create the environmental image 3 is reduced, the variation in brightness of the projected image is prevented, a realistic image space is created, and complicated synchronous editing and control are not required.

The distortion and resolution of the image on the dome screen 8 can be controlled by adjusting the curvature of the dome shape. In the variable dome type screen device 10 used in the embodiment of FIG. 1, one end opening of a cylindrical peripheral wall 11 having both ends opened is hermetically closed by an elasto-plastic screen film serving as a dome type screen 8, and the other end opening is made of a transparent end plate 12 Closed more airtight,
It has a structure in which an exhaust port 13 is provided in the peripheral wall 11. If the exhaust pump 14 is connected to the exhaust port 13 by the exhaust hose 15 and the exhaust pump 14 is driven to adjust the pressure in the peripheral wall 11, the image distortion due to the type of lens and other various conditions at the time of shooting and projection of the environment can be achieved. Can be dealt with flexibly. Cylindrical wall
A pressure regulating valve (not shown) may be provided at a position inside the exhaust port 13 of the cylindrical peripheral wall 11 in order to keep the air pressure in the space inside 11 constant. The elasto-plastic screen film for the screen 8 has a cylindrical peripheral wall 11
In order to prevent rupture due to an excessive increase or decrease in the internal pressure of the screen, a sensor (not shown) using a laser beam for detecting the degree of deformation of the screen film is provided. The supply / exhaust from 13 may be controlled. Further, in order to prevent the rupture of the screen film, a pressure releasing portion (not shown) which loses hermeticity at a constant pressure equal to or lower than the pressure resistance of the screen film may be provided in a part of the screen film. The transparent end plate 12 of the cylindrical peripheral wall 11 can be made of a transparent rigid material, for example, a glass plate.

FIG. 2 shows a screen device in which the peripheral wall 11 is made into a truncated cone to facilitate transportation, an elasto-plastic screen film having a diameter D of about human height is used as the dome-shaped screen 8, and a plate glass is used as the transparent end plate 12. Show. The distance L between the openings at both ends of the peripheral wall 11 is determined by the optical characteristics of the wide-angle lens 1 used in the image pickup device 2, and this distance L can be reduced by using a fisheye lens for the rear projector 7. The elasto-plastic screen film is to be connected to an image according to the projection from the rear projector 7, to have the front side transparency so that the user 9 on the front side of the dome-shaped screen 8 can observe the image, It is required to have the strength and flexibility to follow the repetition of the pressure adjustment. Examples of such a screen film material include silicone rubber, Teflon (trade name of DuPont) or vinyl resin.

FIG. 3 shows a turntable 20 for allowing the user 9 to view an image on the dome-shaped screen 8 from a fixed direction regardless of the direction of his / her head. It is assumed that the user 9 is located at the center of the turntable 20 and is expected to keep his head in the direction of the central axis of the dome-shaped screen 8, in this case, the direction C toward the center of the dome-shaped screen 8. A sensor 21 for detecting a deviation of the head direction D with respect to the direction C is provided, and its output is applied as an input to an angular position control means 22 of the turntable. The angular position control means 22 has a function of rotating the turntable 20 in the direction opposite to the input by the magnitude of the input. sensor
If the angle position control means 22 detects that the head direction D is shifted by the angle θ with respect to the direction C toward the center as shown in FIG. In this way, the turntable 20 is rotated by the angle θ in the direction opposite to the displacement in response to the output of the sensor 21 at that time. Therefore, Experiencer 9
Regardless of which direction the head is turned, its line of sight is always kept in the direction C toward the center of the dome-shaped screen 8. Note that FIG.
R in (B) indicates the reference radial direction on the turntable 20.

[0024]

As described above, the method and apparatus for simulating a dome-shaped environment according to the present invention provide a wide-field image of an environment taken by a wide-angle lens, for example, onto a dome-shaped screen having a concave surface on the front side by a rear projector from behind. By projecting, the image distortion due to the wide-angle lens is canceled by the shape of the screen, so that the following remarkable effects are obtained.

(A) An environment simulation space with a high sense of reality is presented by an image covering the entire visual field of the user. (B) The distortion caused by the wide-angle lens is
High sense of reality with environmental image canceled by curvature
You can experience a simulated environment. (C) Wide-field images incorporating other CG images or moving images can be easily edited and projected. (D) Evacuation simulations for disasters and other crises can be performed with a high sense of realism. (E) Simulate the design content of special spaces such as the central control room, windowless space, underground space, and ultra-high-rise living space of a nuclear power plant with a high sense of reality, and reserve the effects on human psychology, physiology, and mental activities. Experiment and research (F) It simulates the contents of development plans such as urban development and regional development with a high sense of reality, and is an effective means of supporting those plans.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing a configuration of one embodiment of the present invention.

FIG. 2 is an explanatory view of an example of the structure of a variable dome type screen device.

FIG. 3 is a principle explanatory diagram of angle control of a turntable on which a rider rides;

FIG. 4 is a schematic illustration of another embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 ... Wide-angle lens 2 ... Image pick-up device 3 ... Image 4 ... Image processing apparatus 5 ... Editor 6 ... CG image creator 7 ... Rear projector 8 ... Domed screen 9 ... Experienced person 10 ... Variable dome type screen device 11 ... Perimeter wall 12 ... Transparent end plate 13 ... Exhaust port 14 ... Exhaust pump 15 ... Exhaust hose 16 ... Auxiliary optical means 20 ... Turntable 21 ... Sensor 22 ... Control device.

Continued on the front page (72) Inventor Shigeaki Fujita 2-9-1-1, Tobita-Ki, Chofu-shi, Tokyo Kashima Construction Co., Ltd. (72) Inventor Tadashi Ito 2-9-1-1, Tobita-Kiita, Chofu-shi, Tokyo Kashima (56) References JP-A-8-334845 (JP, A) (58) Fields investigated (Int. Cl. ⁷ , DB name) G03B 21/00 G03B 21/56 G03B 37/00 G09B 9/00

Claims (20)

(57) [Claims] 1. A creates an environment image in the wide-angle or fisheye lens with an imaging machine, the surface is opposed spherical curved or surface of the dome-type screen nonspherical curved surface which is concave in the simulated environment viewer's perspective, the dome type screen By the exhaust pump behind
Forming a closed space capable of adjusting the negative pressure, projecting the environmental image to the back side of the dome-shaped screen by a rear projector separated from the tip of the dome-shaped screen to the protruding side, and Resolution is closed
The curvature of the dome screen in response to the negative pressure adjustment of the chain space
A dome-shaped environment simulation method controlled by adjusting the rate . 2. The method of claim 1, wherein the image is a film slide image and the rear projector is a rear slide projector. 3. The environment simulation method according to claim 1, wherein the image is a video image, and the rear projector is a rear image.
A dome-type environment simulation method used as a video projector. 4. A method for simulating a dome environment according to claim 1 , wherein said rear projector is provided with a correction lens comprising a fisheye lens. 5. The environment simulation method according to claim 1 , wherein the image processing is performed on the image, and the image after the processing is processed.
Is projected by the rear projector . 6. An environment simulating method according to claim 1 , wherein an auxiliary optical means for clarifying a projected image on the screen is provided between a viewpoint of the simulated environment experience person and a front side of the dome type screen. Dome type environment simulation method provided. 7. A dome-shaped screen having a concave spherical surface or a non-spherical curved surface on the front side, an environment provided at a position away from the protruding end of the screen to the projecting side, and photographed with a wide-angle or fish-eye lens-equipped camera toward the rear side of the screen. Rear to project images
A projector, and a shape behind the dome screen
Closed space with exhaust pump that can adjust internal negative pressure
And the resolution of the image on the dome-shaped screen is increased.
A dome-type environment simulation device that projects an environmental image with a three-dimensional effect by controlling the negative pressure in the enclosed space . 8. An environment simulating apparatus according to claim 7 , further comprising an image processing apparatus for performing a distortion correction process on said image, wherein said processed image is projected by said rear projector. 9. The environment simulation device according to claim 7 , wherein
An editing device for processing the image and / or synthesizing the image with another image or a moving image;
A dome-type environment simulation device projected by a projector. 10. An environment simulating apparatus according to claim 7 , wherein said image is an environment image taken by a still image camera, an optical movie camera, a video camera, or a CCD camera. 11. A dome type environment simulating apparatus according to claim 7 , wherein said screen is an elasto-plastic film capable of isotropically deforming. 12. The simulated environment simulating apparatus according to claim 11 , wherein said screen is a silicon rubber film, a Teflon film or a vinyl resin film. 13. A dome-type environment simulating apparatus according to claim 7 , wherein a correction lens for correcting image distortion caused by said wide-angle or fish-eye lens is provided in said rear projector. 14. The environment simulation apparatus according to claim 7, wherein the dome-shaped screen is provided at a position facing the front of the screen, and a user seat on a turntable provided at a position facing the front of the screen. A deviation sensor for detecting a horizontal angle deviation of a head or an eyeball of the experienced person on the experienced person's seat with respect to the direction of the central axis, and the deviation of the turntable becomes zero according to an output of the deviation sensor. Dome-shaped environment simulation device provided with angular position control means that rotates as described above. 15. A pressure-resistant cylindrical peripheral wall having openings at both ends, an elastic-plastic screen film stretched airtightly at one end opening of the peripheral wall, a transparent end plate airtightly fixed at the other end opening of the peripheral wall, and a perforation formed on the peripheral wall. An exhaust port, and an exhaust pump connected to the exhaust port,
Suction in the direction of the transparent end plate by exhaust from the exhaust port
The curvature of the screen film to be measured
Variable curvature dome screen device for an environment simulation device controlled according to the resolution of the dome. 16. The screen device according to claim 15 ,
A variable curvature dome type screen device for an environment simulation device, comprising a pressure regulating valve provided on the inner side of the exhaust port of the cylindrical peripheral wall. 17. The screen device according to claim 15 , wherein
A displacement sensor that detects a maximum allowable displacement of the screen film corresponding to a maximum deformation allowed for the screen film of the cylindrical peripheral wall, and stops exhausting or supplying air from the exhaust port according to an output of the displacement sensor. Variable curvature dome type screen device for an environment simulation device provided with a means for performing the above. 18. The screen device according to claim 15 , wherein
A variable curvature dome-type screen device for an environment simulation device, comprising a pressure release portion that loses airtightness at a constant pressure equal to or lower than the pressure resistance of the screen film in a part of the screen film. 19. The screen device according to claim 15 ,
A variable curvature dome screen device for an environment simulation device, wherein the transparent end plate is made of a transparent rigid material. 20. The screen device according to claim 19 ,
A variable curvature dome screen device for an environment simulation device, wherein the transparent end plate is a glass plate made of a transparent rigid material.