JPH0916070A - View display system - Google Patents

Abstract

PURPOSE: To obtain a virtual space similar to the view from an unconstructed building by moving a camera to a view observation position, photographing the view, recording the videos thereof and reproducing and displaying the videos. CONSTITUTION: This view display system has a camera unit 1 as a view photographing means. This camera unit 1 is mounted at a stand 2 and this stand 2 is hung via a rope 4 by a crane car 3, by which the camera is moved to the observation position of the view. A VTR 5R for the right eye, a VTR 5L for the left eye and a controller 6 are connected by a cable or radio to the camera unit 1. Further, respective VTRs 5R, 5L, a head mounted display device 7 and an operation device 8 are connected by a cable or radio to a controller 6. The view display system has the projecting parts and video recording parts for both right and left eyes and the display device is formed as the head mounted type. The visual observation of the stereoscopic views is possible by having the reproduced videos for the right eye recognized by the right eye of an observer 20 and having the reproduced videos for the left eye recognized by the left eye of the observer 20.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a landscape display system capable of providing a landscape from the upper floors of a high-rise house, a landscape of a remote place, a landscape under the sea, etc. without actually standing at an observation site of the landscape, for example, , It can be used to give a view from the building, which is required as a presentation and setting material for the sale and construction of high-rise houses and new buildings.

[0002]

2. Description of the Related Art For example, when a high-rise house before construction or a villa in a remote place is sold, the landscape when standing there affects the value of the building and is therefore used as a sales material. There is. In addition, in public buildings and the like, before construction, the landscape seen from the building is used as planning explanation material and design material.

Conventionally, such landscapes are computer graphics (CG) based on aerial photographs, imaginary maps and topographic maps.
It was provided by images etc.

[0004]

[Problems to be Solved by the Invention] The landscape provided by the aerial photograph or the imaginary map is merely an image for the observer to see the picture, and does not have a sense of reality. Therefore, it has been attempted to reproduce the image of the actual landscape by allowing an observer to visually recognize the landscape created by the CG image using a head-mounted display device (HMD). In that case, a sufficient texture cannot be obtained, and on the contrary, only an unrealistic landscape can be expressed.

It is an object of the present invention to provide a landscape display system which can solve the above problems.

[0006]

A landscape display system according to the present invention includes a landscape photographing means, a means for positioning the photographing means at a view position of the landscape, and a means for recording an image photographed by the photographing means. And a display device that reproduces the recorded image and allows an observer to visually recognize it.

[0007]

With the system of the present invention, when displaying a landscape from a building to be constructed, for example, a photographing means such as a camera is moved to a landscape view position by a construction machine or the like and positioned for photographing. Then, the captured image is recorded on a VTR or the like, and the recorded image is reproduced by a display device so that an observer can visually recognize it.

According to the present invention, the image of the landscape photographed from the actual viewing position is made visible to the observer by the display device, so that the building which has not been actually constructed yet is located far from the viewing position. It is possible to provide the observer with a virtual space that is similar to the landscape from the etc. This allows the observer to experience the view from an unconstructed building in a realistic manner, and also to see how the landscape actually changes depending on the time. It is also a useful reference material.

[0009]

Embodiments of the present invention will be described below with reference to the drawings.

The landscape display system shown in FIG. 1 is used to display a landscape from the upper floors of a building to be constructed, and has a camera unit 1 as a means for photographing the landscape. The camera unit 1 is attached to the mount 2,
The gantry 2 is suspended by the crane vehicle 3 via the rope 4, so that the gantry 2 can be moved to the view position of the landscape.
The camera unit 1 includes a VTR5R for the right eye and a VTR for the left eye.
The TR 5L and the control device 6 are connected by cable or wireless, and the VTRs 5R, 5L, the head-mounted display device 7, and the operating device 8 are connected to the control device 6 by cable or wireless.

As shown in FIG. 2, the camera unit 1
Are two cameras 10a, 1 that can extract video signals.
0b, and a gimbal mechanism that changes the shooting direction of both cameras 10a and 10b into a three-dimensional direction. The gimbal mechanism includes a holder 11 that holds the cameras 10a and 10b so that the front and rear directions thereof are parallel to each other, and the holder 11 can be swiveled around a pitch axis 12 that is perpendicular to the front and rear directions of the cameras 10a and 10b. A pair of support plates 13 for supporting, a first servo motor 14 for rotating and driving the holder 11 thereof, a holder 11 for holding both cameras 10a, 10b, a rotary plate 15 for supporting the support plate 13 and the first servo motor 14. And a second servomotor 17 for rotating the rotary table 15 around a yaw axis 16 orthogonal to the pitch axis 12.

As shown in FIG. 3, the head-mounted display device 7 includes a pair of left and right display portions 21a and 21b and both display portions 2.
It has the holding part 22 holding 1a, 21b.

The holding portion 22 can be attached to the head of the observer 20 by forming, for example, a helmet or a band shape, and both display portions 21a and 21b are fixed to the observer's 20 visual field by the attachment. Is positioned at the position. The head of the observer 20 is not limited to the crown, but refers to a portion above the neck including the face.

Each of the display units 21a and 21b has a CR
Display elements 26a and 26b such as a T and a liquid crystal display panel, and display control devices 27a and 27b for the respective display elements 26a and 26b.
And an optical system. Each display control device 27a, 27b
Sends an image signal of a video image captured by the camera unit 1 to each of the display elements 26a and 26b.
An image corresponding to the image signal is displayed on a and 26b. Each optical system includes a lens system 29a, 29b, a mirror 30a,
30b, 1st combiners 31a and 31b, and 2nd combiners 32a and 32b. Each display element 26a,
The display light of the image displayed by 26b is the lens system 29.
The light is reflected by the mirrors 30a and 30b and the first combiners 31a and 31b via a and 29b, is reflected and focused by the second combiners 32a and 32b, is transmitted through the first combiners 31a and 31b, and is visible to the eyes of the observer 20. Be led to. In addition, in front of the second combiners 32a and 32b, the visor 35 is attached to the holding portion 22 so as to be vertically movable as indicated by an arrow in FIG. By displacing the visor 35 upward, the observer 20 can move not only the captured image but also the combiners 31a, 31b, 32a, 3
The actual object in the front field of view can be visually recognized through 2b, and only the captured image can be visually recognized by displacing the visor 35 downward.

A head motion sensor 30 for detecting the movement of the head of the observer 20 is provided. The head motion sensor 30 has a known one, for example, a coil attached to the holding portion 22 and a means for generating a magnetic field around the coil, and detects a change in current due to the movement of the coil in the magnetic field. Using the one that outputs the corresponding signal or the ultrasonic transmitter and receiver, attach the transmitter to the fixed side, attach the receiver to the holding part 22, and receive from the ultrasonic transmitter by the movement of the receiver. It is possible to use a device that outputs a signal according to a change in the arrival time to the machine.

As shown in FIG. 4, the control device 6 has an image generation unit 41 having a computer, a motor control unit 42 having a computer, and a VTR controller 43. The VTR controller 43 functions as an interface between the image generator 41 and the VTRs 5R and 5L. The image generation unit 41 determines that each V
TR5R, 5L and each camera 10 of the camera unit 1
a and 10b. The motor controller 42 is connected to a motor controller 44, and the motor controller 44 functions as an interface between the motor controller 42 and the first and second servomotors 14 and 17 of the camera unit 1. The operating device 8
Has a gimbal mechanism operating section 45 having a joystick for operating the gimbal mechanism of the camera unit 1 and a video processing operating section 46 having a video signal processing selection switch. The gimbal mechanism operation unit 45 and the head motion sensor 30 are connected to the motor control unit 42. The video processing operation unit 46 and the display control devices 27a and 27b of the head-mounted display device 7 are connected to the image generation unit 41.

The computer of the image generation unit 41 and the computer of the motor control unit 42 are synchronized with each other by a signal from the operating device 8 operated by the observer 20 and a signal from the head motion sensor 30 according to a stored program. While controlling the system.

That is, when the camera unit 1 is positioned at the view position set at an arbitrary height by the crane vehicle 3 and the joystick of the gimbal mechanism operation section 45 is operated, the motor control section 42 causes the motor control section 42 to change its direction of view. An instruction signal is output, and each servo motor 14, 17 is driven by this signal. As a result, each of the cameras 10a and 10b of the camera unit 1 turns around the pitch axis 12 and the yaw axis 16, and as shown in FIG. 5, photographs the landscape A in the visual field in an arbitrary direction. At the same time as this shooting, by turning on the recording instruction switch of the video processing operation unit 46, the image generation unit 41 causes each of the VTRs 5R and 5L to have each camera 1 connected.
Recording of the image signal of the video imaged by 0a and 10b is instructed. As a result, the captured video will be
Recorded on 5R and 5L. At the time of this recording, each VTR5
The image signal of the recorded video from R, 5L is input to the image generation unit 41 as a monitor signal, and the image generation unit 41 outputs the monitor signal to each of the display control devices 27a and 27b of the head-mounted display device 7. Here, one camera 10a
The monitor signal of the video image captured by the camera is output to one display control device 27a, is visually recognized by one of the left and right eyes of the observer 20, and the monitor signal of the video image captured by the other camera 10b is displayed on the other display control device 27b. And is visually recognized by the left and right eyes of the observer 20, and the landscape is perceived as a stereoscopic image.

Next, when the reproduction instruction switch of the video processing operation unit 46 is turned on, the image generation unit 41 causes each VTR 5 to operate.
It is instructed to output the image signal of the video recorded in R and 5L.
As a result, the image signal of the recorded video is input from each of the VTRs 5R and 5L to the image generation unit 41, and the image generation unit 41 causes each of the display control devices 27a and 27b of the head-mounted display device 7,
The image signal of the recorded video is output. Here, the image signal of the image captured by one of the cameras 10a is output to one display control device 27a, is visually recognized by one of the left and right eyes of the observer 20, and the image signal of the image captured by the other camera 10b. Is output to the other display control device 27b and is visually recognized by the other left and right eyes of the observer 20, and the landscape is perceived as a stereoscopic image B as shown in FIG.

When the changeover switch of the image processing operation section 46 is turned on and the display instruction signal is turned on, the image generation section 41 takes in the image signal of the image taken by each of the cameras 10a and 10b in real time and outputs the image signal. Is output to the head-mounted display device 7 to allow the observer 20 to visually recognize the captured image in real time. At this time, when the changeover switch of the gimbal mechanism operation unit 45 is turned on, the motor control unit 42 does not use the joystick but the visual field direction instruction signal corresponding to the movement of the head of the observer 2 detected by the head motion sensor 30. And output
The servomotors 14 and 17 are driven.

According to the above-described embodiment, the image of the landscape photographed from the actual viewing position is made visible to the observer 20 by the head-mounted display device 7, so that it is actually located at a place away from the viewing position. It is possible to provide the observer 20 with a virtual space similar to a landscape from a building that has not been constructed yet. As a result, the observer 20 can experience the view from the unconstructed building as if it were a reality, and can also see how the landscape actually changes depending on the time, and the obtained landscape is very useful in the design of the building. It is also a useful reference material. Further, in the above-described embodiment, the observer 20 can visually recognize a three-dimensional landscape, and can enjoy a more realistic landscape. Further, the observer 20 can visually recognize the captured image in real time according to the movement of the head, and thus can visually recognize the landscape at the time of actual observation in a more realistic state.

The present invention is not limited to the above embodiment. For example, a video image captured by the camera unit 1 is acquired in a wide angle and recorded in the VTRs 5R and 5L, and the image generation unit 41 causes the head-mounted display device 7 to display a part of the video acquired in the wide angle. The display image may be changed according to the movement of the head motion sensor 30. For example, the image generation unit 41 has an area for capturing and storing all the images acquired in a wide angle, and the image in the storage area designated by the signal corresponding to the movement of the head motion sensor 30 is mounted on the head-mounted display device. Output to 7.

Further, when the camera unit 1 is hung by a rope as in the above embodiment, each of the cameras 10a, 1a
The gyro compass is incorporated to detect the visual field direction of 0b, and the motor control unit 42 corrects the visual field instruction signal designated by the operation of the gimbal mechanism operating unit 45 according to the visual field detection signal by the gyro compass. However, the landscape in the designated direction may be accurately captured. Further, a vibration isolation structure may be interposed between the camera unit 1 and the gantry. Further, the positioning of the camera unit 1 in the view position is not limited to the crane vehicle 3, and may be installed on a temporary scaffold for construction, for example. In addition, in the scenery obtained by the camera unit 1, C
For example, an image of a part of a building (such as a window frame) created by G may be displayed in an overlapping manner. Further, the landscape is not limited to the one from the higher floors of the building, and may be a landscape from a low-rise building in a remote place or a landscape from an undersea building. Also,
When only a distant view is reproduced as a landscape, stereoscopic vision is not necessary, and thus the camera unit 1 may be configured by a single camera.

[0024]

BEST MODE FOR CARRYING OUT THE INVENTION In the landscape display system according to the present invention, the photographing means has a photographing section for the right-eye image and a photographing section for the left-eye image, and the recording means is for the right-eye image. The display device has a recording unit and a recording unit for the left-eye image, and the display device is head-mounted, and the reproduced right-eye image is visually recognized by the observer's right eye to reproduce the reproduced left-eye image. It is preferable that the image is visually recognized by the observer's left eye. This allows
By observing the three-dimensional landscape, the observer can fully enjoy the landscape.

It is preferable to provide means for changing the landscape photographing direction by the photographing means into a three-dimensional direction. Thereby, the landscape over a wide field of view can be displayed.

It is preferable that an image photographed by the photographing means can be viewed by an observer in real time by the head-mounted display device. This makes it possible to obtain a landscape at the time of actual observation.

Further, it is preferable to have a means for detecting the movement of the observer's head and a means for changing the image displayed by the head-mounted display device by a signal according to the movement. Thereby, the observer can visually recognize the landscape according to the change of the head, and can visually recognize the landscape in a more realistic state. In this case, the photographing means of the landscape display system photographs the landscape in a wide angle, the head-mounted display device displays a part of the recorded landscape, and the displayed image changes according to the movement of the observer's head. Preferably.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram of a configuration of a landscape display system according to an embodiment of the present invention.

FIG. 2 is a perspective view of a camera unit according to an embodiment of the present invention.

FIG. 3 is a structural explanatory view of a head-mounted display device according to an embodiment of the present invention.

FIG. 4 is a block diagram of a landscape display system according to an embodiment of the present invention.

FIG. 5 is a diagram showing a recording state of the landscape display system according to the embodiment of the present invention.

FIG. 6 is a diagram showing a display state of the landscape display system according to the embodiment of the present invention.

[Explanation of symbols]

 1 camera unit 5R, 5L VTR 7 head-mounted display device 20 observer

Claims (1)

[Claims] 1. A landscape photographing means, a means for positioning the photographing means at an observing position of the landscape, a means for recording an image photographed by the photographing means, and a reproduction of the recorded image for observation. A landscape display system that includes a display device that can be visually recognized by a person.