JPH10117309A - Video display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a display device which is rich in presence by providing a reproducing device for a removable storage device, in which stereoscopic video information is recorded, and displaying stereoscopic images from the reproducing device onto a head mount type display. SOLUTION: The images, simultaneously photographed by two cameras placed in parallel for photographing the stereoscopic images, are made into a digital signal and recorded in a removable storage device 10 such as a digital video disk, while being separated to two left and right channels. This recorded image is reproduced so as to display the image for left eye on left liquid crystal and to display the image for right eye on right liquid crystal. The images displayed on the liquid crystal screens are made incident through lenses to the eyes, while changing their directions through mirrors so that the stereoscopic image can be watched. With such a system a user puts on a head mount type display 1 and a headphone 5, while sitting on a chair 19 provided on a motion system 18 as a device for generating movement and/or vibrations.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an improvement in a video display device.

[0002]

2. Description of the Related Art Conventionally, head-mounted displays merely display images on a liquid crystal screen.

[0003]

However, the conventional head-mounted display has a problem that it lacks a sense of reality.

[0004] The present invention is to provide a video display device which solves the above-mentioned conventional problems.

[0005]

SUMMARY OF THE INVENTION In order to achieve the above object, the present invention provides a reproducing apparatus for a removable storage device in which stereoscopic video information is recorded, and displays a stereoscopic video from the reproducing apparatus on a head-mounted display. It was made.

[0006] It is preferable to provide an image display device using a head-mounted display provided with a device that causes movement and / or shaking.

It is preferable to provide a device for blowing air from the surroundings.

It is preferable to provide a device for changing the temperature of the wind.

It is preferable to mount the above-described device in a vehicle-mounted container.

10. The image display device according to claim 1, wherein a head-mounted display is used to display a stereoscopic image by displaying a right-eye image and a left-eye image, respectively. It may be.

A head-mounted display having a liquid crystal screen and displaying a three-dimensional image by displaying a right-eye image and a left-eye image on the liquid crystal screen, respectively. The image display device described in 4, 5, or 6 may be used.

A video display apparatus according to claim 1, 2, 3, 4, 5, 6, or 7, wherein a head-mounted display having headphones for reproducing stereophonic sound by the right ear sound and the left ear sound is used. You may. In this specification, the term “three-dimensional sound” means not only normal stereo including the claims but also three-dimensional sound, and reproduces sound from a sound source at an arbitrary position in front, back, left, right, up, and down. We use thing including thing.

[0013]

The video display device according to the present invention is provided with a headphone for reproducing stereophonic sound on a head-mounted display, a reproducing device for a removable storage device for recording video information, a device for causing movement and shaking, and a device for blowing wind. The video signal for the right eye and the video signal for the left eye are input to display the video for the right eye and the video for the left eye so that the user can experience a video full of a sense of reality.

[0014]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a perspective view showing an appearance of an image display device according to one embodiment of the present invention, FIG. 2 is a side view showing an optical system portion thereof, and FIG. 3 shows a system configuration of another embodiment of the present invention. FIG.

Conventional devices for displaying a stereoscopic image include a device using a red-blue filter and a polarizing filter. In the embodiment of the present invention, a right-eye image and a left-eye image are used.
A method is used in which these are displayed on the respective liquid crystals and viewed with the right and left eyes.

The head-mounted display 1 is provided with an optical system including a liquid crystal screen 2, a lens 3, and a mirror 4 for the left eye and the right eye, respectively. A portion between the right eye and the left eye is appropriately provided with a threshold portion 7. As a liquid crystal used for the liquid crystal screen, a liquid crystal generally used for display of a video camera or the like can be used.

The image displayed by the stereoscopic image apparatus of the present invention is
It may be produced by computer graphics or a live-action video. For shooting stereoscopic images,
Simultaneous images taken by two cameras placed in parallel (it is known that the distance between the optical axes of the two cameras is preferably 65 mm, which is the average distance between the pupils of a human) are digitally captured. The signal is divided into two channels, left and right, and recorded in a removable storage device such as a digital video disc (or its specification extended to record a stereoscopic video) or the like. In addition, instead of digital video disk, laser disk, CD-ROM, magneto-optical disk,
An appropriate storage medium such as a removable hard disk can be used. Here, as a camera used for recording a video, an appropriate camera such as a film camera, a video camera, a digital video camera, and the like can be used, including a high-vision camera. As a recording method for digital video discs, etc.,
The simplest is to record left-eye video information on one disk and right-eye video information on another disk,
These may be reproduced simultaneously. In addition, it is also possible to record the right-eye image information in a certain section of the disc, record the left-eye image information in another section separated from the right-eye section, and read the information with two heads. Also, for example, the left eye image information of a certain frame is recorded on a certain track,
The right-eye image information of the same frame is recorded at the next position of the track, followed by the left-eye image information of the next frame, and then the right-eye image information of the frame is recorded. For example, an appropriate method such as the above method can be used. In addition to this, use an appropriate method such as dividing the stereophonic sound information for the left ear and right ear and recording it on the track adjacent to the video information, or recording it alternately with the video information on the same track. Can be. In the above description, the case where stereoscopic video and stereophonic sound information are recorded has been described. However, it is needless to say that a system or the like that displays a simpler two-dimensional video by recording only one of the left and right can be used. is there. The recorded video is reproduced so that the left-eye video is displayed on the left liquid crystal and the right-eye video is displayed on the right liquid crystal. The playback method is to play back the video and audio information recorded according to the above-mentioned recording method as it is by a playback device in order, or to read the left and right ones temporarily into a buffer on a main memory or the like, and then read the left and right video information. The audio information may be sent from the buffer to the head-mounted display for playback.

The image displayed on the liquid crystal screen 2 is a lens 3
, Is turned by the mirror 4 and enters the eye, whereby a stereoscopic image can be viewed.

The head-mounted display is not limited to the one shown in the figure, but may be a helmet-type display.

Next, an example of an entertainment system using the above head-mounted display will be described with reference to FIG.

In this system, a chair 19 is mounted on a motion system 18 which is a device for generating movement and / or shaking.
The user sits on the chair 19 and wears the head-mounted display 1 and the headphones 5.

As the motion system, there is, for example, a micro motion system manufactured by Hydrodyne. In this system, a hydraulic actuator is connected to a platform on which a chair and a base frame fixed to the floor by a universal joint are connected, and a universal joint is used for the connection. The hydraulic actuator is operated by a hydraulic source 15. The hydraulic power source 15 is controlled by the controller 12 to move the platform to a specified position based on the specified position, speed and acceleration or position and sway information, and to specify a specified roll, pitch, The movement is performed so as to cause the platform (and thus the user) to yaw. Here, when the x-axis is taken in the front direction of the chair, the y-axis is taken in the direction perpendicular to the x-axis on the platform, and the z-axis is taken in the direction perpendicular to both the xy axes, the rotation around each of the xyz-axes is taken. These are called shaking, pitching and yawing. Next, the operation principle of an example of the motion system will be described in detail with reference to FIG. In this example, the motion system includes AD, AE, BD, BF, CE, and CF in which six hydraulic actuators connect the base frame 20 and the platform 21.
Are provided along each line. At each point of ABCDEF, the hydraulic actuator is connected by a universal joint. When the length of each actuator is determined, D
Since the plane passing through the EF is uniquely determined, the position and inclination of the platform 21 are determined by defining the length of each hydraulic actuator. Now, a point O is provided on the base frame, and a point on the platform that is directly above O when the platform is horizontal and free of displacement is _defined as Op.
Axis, the y-axis in a direction orthogonal to this on the platform,
The z-axis is taken in a direction orthogonal to the xy-axis. In general, when a new coordinate system is rotated by θx around the x-axis, the relationship between the old and new coordinates is expressed by a coordinate transformation formula.

(Equation 1) become that way. This transformation matrix is defined as Ux. Similarly, when rotated by θy around the y-axis, and when rotated by θz around the z-axis, the conversion matrices Uy and Uz of the coordinate conversion are expressed by the following equations.

(Equation 2) Therefore, the conversion matrix representing the relationship between the new and old coordinates as a result of sequentially performing these is as follows.

(Equation 3) Thus, a vector from O _P towards D is expressed as follows.

(Equation 4) Here, d1, d2, and d3 are the coordinates of D in the xyz coordinate system, which is the coordinate system that moves with the platform, and are constants. Therefore, the length of AD is calculated by the following equation.

(Equation 5) Here, the vector has the origin at O, takes the xy axes in two orthogonal directions on the base frame, and moves z vertically upward from O.
The representation is in a coordinate system with axes. Where XYZ
The amount of movement from the basic position of the platform (i.e., the amount of O _p displaced from the position immediately above the O _p or O),
H is the distance between O and _{O p} in the basic position, A1, A2,
A3 is the coordinates of point A in the coordinate system. The relationship between the lengths of other actuators and XYZ and θxθyθz is calculated in the same manner. As described above, when XYZ and θxθyθz are designated, the length of the actuator is calculated from this, and if each actuator is controlled to that length, the position and inclination of the desired platform are realized, and these are continuously operated. Then, the desired platform position and swing can be realized. In order to set the length of the actuator to a specified value, in this example, a means for measuring the length of the actuator is provided, and the hydraulic source is controlled by a servo mechanism or the like based on the length signal from the measuring means. ing. For example, in the case of an actuator composed of an outer cylinder that does not move and an inner rod that slides in and out of the inner surface of the outer cylinder, teeth are provided along the inner rod, and a gear that meshes with the inner rod in a portion that comes out of the outer cylinder. So that the movement of the center rod is transmitted as the rotation of the gear, the rotation state of this gear is measured, and the oil pressure is increased until it reaches a value corresponding to the length of the specified actuator, If it exceeds this, the oil pressure may be reduced. The controller 12 has XYZ, θxθyθ from the computer 11
A program for calculating the length of the actuator from the value of z is built in, and a D / A converter is also built in. Calculation of actuator length is performed by computer 1
1 may be performed.

The number of chairs 19 is not limited to a plurality as shown in the figure, and a chair for one person may be provided on a simpler platform. Conversely, a platform on which a chair is placed and a plurality of base frames connected to the platform by an actuator are provided, and these are collectively controlled so as to perform the same operation or different operations. You may make it.

In the present system, the blower 16 is controlled by the controller 13 so as to blow a wind having a designated wind direction and wind speed. As a mechanism for realizing this, for example, the blower may be installed on a disk that is rotated by a servomotor, and the rotation of the servomotor may be controlled by the controller 13. Note that the controller 13 has a D for converting a signal from the computer 11.
/ A converter is built-in. Further, the controller 14 controls the heating / cooling device 17 to blow a designated cold wind or hot wind. The controller 14 also has a built-in D / A converter for converting signals from the computer 11. The number of blowers and the like need not be one as shown in the figure, and a plurality of blowers may be arranged around the air blower to send wind from any or all blowers according to the scene. In addition to the above, if odors, water droplets, tree branches, and the like are appropriately emitted from the surroundings, the sense of presence is further increased, which is effective.

In the present system, data of video, sound, position, speed, acceleration, wind direction / wind speed, and wind temperature are recorded in a storage device 10 such as a magnetic disk. In addition, information indicating the correspondence between the two images, sound, position, speed, acceleration, wind direction / wind speed, and wind temperature at each time (hereinafter, referred to as timing information) is also recorded. This includes, for example, numbering each frame that makes up the video, the number of a frame and the sound, position, speed,
It records the beginning and end of the recording location of acceleration, wind direction / wind speed, and wind temperature data.

The video, sound,
The position, speed, acceleration, wind direction / wind speed, and wind temperature data are controlled by a control program running on a computer 11, and the position, speed, and acceleration data are stored in the controller 12, the wind direction / wind speed data is stored in the controller 13, and the wind temperature is calculated. The data is sent to the controller 14, the video data is sent to the head-mounted display 1, and the sound data is sent to the headphones 5. An example of the procedure of the processing of the control program is as shown in FIG. The data used in this control program is recorded on the magnetic disk as follows, and is read out to the main memory and processed. Video information is recorded as a series of data corresponding to left and right image frames according to a specified order corresponding to a video story to be shown to a customer. In addition, the audio data is recorded continuously in time series in correspondence with the video. Next, position data to be sent to the motion system is (X (i), Y (i), Z (i)), swing data is (θx (i), θy (i), θz (i)), and wind direction data is (Θ (i), Φ (i)) (where Θ, Φ are angles indicating the direction of the position vector of the wind direction), the wind speed data is V (i), and the temperature data is T (i). In this example, these data are stored in an array, and i corresponds to the number of the corresponding frame. Usually, the timing of these data changes is longer (ie, changes slowly) than the display interval of frames (30 frames per second in full motion, ie, 33 milliseconds per frame), so that the data amount is reduced. For this purpose, the number (or time) of the frame whose data needs to be changed and the data after the change are recorded in pairs, the frame number or time is checked in the processing program, and the recorded frame is recorded. If there is a match with the number or the time, the corresponding data may be sent to the controller. At the time of data creation, a time lag from the transmission of the data to the controller until an actual change is made is taken into consideration (especially, for data having a large time lag such as wind temperature data), synchronization with the video can be properly obtained. You need to do that. Next, the flow of processing of the control program will be described. After the processing of the control program starts,
In steps 102 and 103, the values of the frame number i and the time t are initialized. In step 104, the left and right acoustic data are sent to the headphones 5 and reproduced. In this example, since the audio data is recorded in correspondence with the video, the reproduction of the audio data may be simply and continuously processed by a task different from the following processing. In step 105,
Both image data (left and right) of the i-th frame are sent to the head mounted display 1 and displayed. Step 106
, The position data (X (i), Y (i), Z
(I)), swing data (θx (i), θy (i), θz)
(I)) is sent to the controller 12 of the motion system. In step 107, the wind direction data (Θ
(I), Φ (i)) and wind speed data V (i) are sent to the controller 13, and temperature data T (i) is sent to the controller 14. In step 108, a wait is made with reference to the system timer of the computer until the processing start time of the next frame. Update the value of the frame number and the time in step 109, it is determined whether the time in step 110 becomes the end time t _f, YES
If the answer is NO, the end processing 111 is executed.
The processing of 5 or less is performed on the data corresponding to the next frame. In the above apparatus, video data, audio data, and the like including a plurality of stories may be recorded, and the operator or the user (customer) may select one of the stories with a button or the like.

Further, the device according to the present embodiment may be appropriately provided with a handle, a fluke, and an accelerator. The signal from the handle or the like is converted into a digital signal by an AD converter, further converted into position information in the virtual reality space, and further, the corresponding data storage position on the storage device 10 is determined using the data storage position information. Is calculated. Thereby, video information or the like corresponding to the movement specified by the signal input by the control program is read,
The display based on this is performed. In addition, in order to perform full-scale movement in the virtual reality world by using a steering wheel or the like, computer graphics technology is used, and video information corresponding to 3
It is necessary to record as numerical information of modeling for expressing a dimensional object, and to calculate and display a video from a corresponding viewpoint based on a signal from a handle or the like based on the numerical information. As a result, the user can operate them to move freely in the virtual reality world.

By using the present system, for example, it is possible to experience a haunted house, an airplane or a spacecraft flying in the sky or space, etc., together with images and sounds with a sense of reality.

As an application of the three-dimensional image display device of the present invention,
By linking with the gyro balance system,
You can see the direction you want to see even from a distance. The camera is mounted on an omnidirectionally rotatable platform with built-in gyro balance, and the gyro balance is mounted on the head-mounted display to synchronize the two. As a result, the camera moves in the direction in which the face of the operator wearing the head-mounted display faces.

In order to move the position of the camera, the platform may be mounted on a motor vehicle and operated by an operator equipped with a head-mounted display. If you attach a manipulator to this system,
The operator can perform various operations in one place without moving. This makes it possible to construct a new remote operation system in which operations such as radioactive substances that have been handled by a conventional manipulator and the like can be performed at an arbitrary remote place.

The embodiments of the present invention are not limited to those described above. Appropriate additions and substitutions can be made within the spirit of the invention.

[0032]

Since the present invention is configured as described above, an excellent effect that an image full of a sense of reality can be experienced in an image display device using a head-mounted display. Play.

[Brief description of the drawings]

FIG. 1 is a perspective view illustrating an appearance of a video display device according to an embodiment of the present invention.

FIG. 2 is a side view showing the optical system portion.

FIG. 3 is a diagram showing a system configuration of another embodiment of the present invention.

FIG. 4 is a schematic diagram showing a structure of the motion system.

FIG. 5 is a flowchart showing an example of processing of the control program.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Head mounted display 2 Liquid crystal screen 3 Lens 4 Mirror 5 Headphone 7 Threshold 10 Storage device 11 Computer 12 Controller 13 Controller 14 Controller 15 Hydraulic power source 16 Blower 17 Heating / cooling device 18 Motion system 19 Chair 20 Base frame 21 Platform

Claims (8)

[Claims] 1. A video display device provided with a playback device of a removable storage device storing stereoscopic video information, and displaying a stereoscopic video from the playback device on a head-mounted display. 2. An image display device using a head-mounted display provided with a device that causes movement and / or shaking. 3. An image display device using a head-mounted display provided with a device for blowing air from the surroundings. 4. The image display device according to claim 3, further comprising a device for changing a temperature of the wind. 5. An image display device, wherein the image display device according to claim 1, 2, 3, or 4 is mounted on a container mounted on a vehicle. 6. The image display according to claim 1, wherein a head-mounted display is used to display a stereoscopic image by displaying a right-eye image and a left-eye image, respectively. apparatus. 7. A head-mounted display having a liquid crystal screen and displaying a three-dimensional image by displaying a right-eye image and a left-eye image on both surfaces of the liquid crystal, respectively. 7. The video display device according to 3, 4, 5, or 6. 8. The video display according to claim 1, 2, 3, 4, 5, 6, or 7, wherein a head-mounted display provided with headphones for reproducing stereophonic sound by the right ear sound and the left ear sound is used. apparatus.