JPH11237867A - Virtual space display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To enable each observer to simultaneously share a virtual space to be displayed for respective plural observers, and a real space where the respective viewers actually exist. SOLUTION: The positions/directions of the heads of observers 91 and 92 are detected by head motion sensors 21 and 22 and sent to mutually linked computers 31 and 32 and concerning one observation object 93, these computers 31 and 32 respectively prepare 3D image data viewed from the positions/ directions of these heads and send these data to see-through type HMD 11 and 12 mounted on the respective observers 91 and 92.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

[0001] 1. Field of the Invention [0002] The present invention relates to an apparatus for displaying a target object in a virtual three-dimensional space using an HMD (Head Mount Display).

[0002]

2. Description of the Related Art According to an MR imaging apparatus (nuclear magnetic resonance imaging apparatus) and a PET apparatus (positron emission computer tomography apparatus), three-dimensional image information inside a human body can be obtained. By performing a 3D modeling process or the like, a three-dimensional display is possible. In this way, while displaying the target object in the virtual three-dimensional space and performing operations such as changing the viewing direction, the medical condition of the affected part is examined by two or more doctors. Also, a building designed by 3D CAD (Computer Aided Design) is 3D modeled on a computer, it is displayed in 3D in a virtual space, and two or more people use an input device such as a joystick to view the interior. There are also studies on design while walking around.

[0003]

However, in the related art, the target object is simply displayed three-dimensionally in the virtual space. When the object is observed by two or more persons, the target object has a complicated structure that is difficult to understand. There was a problem that it was necessary to use words to support the point that I wanted to point out, it was difficult to communicate, and there was often a case where discussions were carried out while misunderstanding each other.

In addition, when walking around in a virtual space, the body is not actually moved because a joystick or the like is conventionally used. There is also a problem that may cause discomfort.

[0005] In view of the above, the present invention provides a virtual space displayed for each person when a plurality of observers wear an HMD and observe a target object in a three-dimensional virtual space. It is an object of the present invention to provide a virtual space display device that enables a person to simultaneously share a real space that actually exists and prevents a misunderstanding of a point of interest from being misunderstood.

[0006]

In order to achieve the above object, a virtual space display device according to the present invention comprises a plurality of see-through HMDs, a motion sensor for detecting the direction and position of the HMD, Image generating means for generating each 3D image data in which the viewing direction and the display position are determined in accordance with the direction and position of each HMD and sending it to each HMD.

Since the HMD is a see-through type,
The scenery of the outside world can be observed together with the display image, and the display image can be seen overlapping the scenery of the outside world. Then, each direction and position of the HMD is detected, and each position and
3D image data from each direction is generated and sent to each HMD. Therefore, in each HMD, a 3D image is displayed as if viewed from the position where the HMD is located in the real space in the direction in which the HMD is facing. Therefore, a plurality of observers observing through each of these HMDs appear as objects in one virtual space in the real space, and see the objects in the virtual space as if viewed from each direction. Can be recognized. By moving a finger or the like in the real space, it can be observed, so that an object in the virtual space can be indicated with a finger or the like in the real space, and it is possible to prevent a misunderstanding of the pointed-out point from occurring. .

[0008]

Next, embodiments of the present invention will be described in detail with reference to the drawings. The example shown in FIG. 1 shows a case where two observers (doctors) 91 and 92 face one observation object 93 while facing each other. Observers 91 and 92 are see-through HMs, respectively.
D11 and D12, and these HMD11, 1
2, image signals are sent from computers 31 and 32, respectively. Head motion sensors 21 and 22 are attached to the HMDs 11 and 12, and respond to a reference coordinate signal in the real space generated from the transmitter 41, so that the three-dimensional positions of the HMDs 11 and 12 can be determined.
The direction is detected. Thus, the three-dimensional positions and directions of the heads of the observers 91 and 92 are detected.
This detection signal is sent to computers 31 and 32, respectively.

The computers 31 and 32 are connected to each other, share original image data to be displayed, and exchange three-dimensional position detection data from the head motion sensors 21 and 22 with each other. I have. By linking the computers 31 and 32 in this manner, the two computers 31 and 32 can display the respective observers 91 and 92 on the coordinate axes of the real space unified, and the two observers 91 and 92 can perform display. , 92
Can be displayed so that the object 93 can be recognized on the same coordinate axis in the real space. That is,
One observation target (here, a 3D image of the skull) 93 appears exactly in the middle between the observers 91 and 92, and a 3D image is displayed as viewed from the direction of the observers 91 and 92. Since this object 93 appears between the observers 91 and 92 facing each other, the observer 91 becomes a 3D image from the right side of the skull as shown in FIG. 2B is a 3D image from the left side of the skull as shown in FIG.

In this case, since the HMDs 11 and 12 are of the see-through type, the observers 91 and 92 can see the real space together with these 3D images. And, as described above, the coordinate axes of the real space are two computers 31,
32, the virtual object 93 appears at the same position in the real space when viewed from the two observers 91 and 92, and floats in the real space between two opposing persons. It can be observed as if it were rising.
Since it is a see-through type, the real space can also be seen.
Is pointed out with a finger, the other observer 92 can see this finger, and the observer 92 is looking at the same virtual object 93. Of the virtual object 93 can be easily understood.

More specifically, the HMDs 11, 1
3 has an image interface 13, a CRT (cathode ray tube) 14, and an optical system 15 as shown in FIG.
Respectively. Also, the computers 31 and 32
Each has an arithmetic control unit 33 and an image output unit 34. The head motion sensors 21 and 22 are connected to the arithmetic and control units 33 of the computers 31 and 32, respectively.

The transmitter 41 is a computer 31,
32 are connected to any one of the operation control units 33, but since these operation control units 33 are connected to each other,
The three-dimensional position data from the head motion sensors 21 and 22 obtained by each of the head motion sensors 21 and 22 responding to the reference coordinate signal on the three-dimensional real space emitted from the transmitter 41 is transmitted to two computers. 31 and 32 are unified and deal with one and the same real space. These three-dimensional position data are calculated and controlled by the calculation control units 33 of the two computers 31 and 32, respectively, and change the positions of the heads of the two observers 91 and 92 and the distance between the two. , The viewing direction and the display position of the 3D image of the object 93 can be changed.

In this way, 3D image data of the object 93 reflecting the three-dimensional movement of the head is obtained, and sent to the image interfaces 13 of the HMDs 11 and 12 via the image output unit 34. This image data is converted into an appropriate display signal by the image interface 13 and the CR
The program is sent to T14 to display a 3D image. This image passes through the optical system 15 to create an external world (real space).
To the eyes of the observers 91 and 92 in superimposition with the light from the scenery.

FIG. 4 shows another embodiment. In this figure, the HMDs 11 and 12 use LCD instead of CRT.
(Liquid crystal display device) 16 is used to output an image. Further, here, the three-dimensional glove 51 and the three-dimensional mouse 61 are attached to the arithmetic control unit 33 of the computer 31 on the observer 91 side so that the object 93 in the virtual space can be moved and operated. The three-dimensional globe 52 in the arithmetic control unit 33 of the computer 32
And a three-dimensional mouse 62 are respectively connected.

The three-dimensional globes 51 and 52 and the three-dimensional mice 61 and 62 respond to the reference coordinate signal of the real space emitted from the transmitter 41, and the three-dimensional position data from them is calculated by the calculation control unit 33. Control is performed, and when an operation such as moving, rotating, or shaving the object 93 three-dimensionally is performed, processing of the 3D image corresponding thereto is performed. For example, observer 91
When the user operates the virtual object 93 being observed, 3D image data in which the contents are reflected is obtained. The 3D image data is displayed on the HMD 11 via the image output unit 34 of the user, and an image in which the operation result is reflected is obtained. Can be seen. In addition, the data input from the three-dimensional glove 51 and the three-dimensional mouse 61 regarding the operation by the observer 91 are as follows:
The 3D image data reflecting the operation result is also sent to the HMD 12 via the image output unit 34 and sent to the operation control unit 33 of the other computer 32 to be operated and controlled. The operation result will appear. Therefore, for example, the object 93 is placed on one observer 9
When rotated by 1, the object 93 being observed by the other observer 92 is also rotated.

Further, force sense controllers 71 and 72 can be used. If the force sense controllers 71 and 72 are used, both the observers 91 and 92 can read the object 9 in the virtual space.
The touch of the surface of No. 3 can be felt.

FIG. 5 shows still another embodiment. Here, position sensors 81 and 82 attached to appropriate places on the bodies of the observers 91 and 92 are used. The position sensors 81 and 82 are also
And outputs data representing a three-dimensional position in response to a reference coordinate signal in the real space issued from the device. Position sensors 81, 8
Since 2 is attached to the bodies of the observers 91 and 92, the observers 91 and 92 actually walk around in the real space,
When the user moves to an arbitrary place, the position is taken into the respective computers 31, 32.

The data from the position sensors 81 and 82 are calculated and controlled by the calculation control unit 33, so that the observer 91,
It is possible to generate 3D image data corresponding to the position change in the 92 real space. Therefore, observers 91 and 9
When each of the two walks around and changes position in real space,
Each of the observers 91 and 92 can recognize the object 93 in the virtual space that reflects those in the same real space. In this way, the movement of the real space when actually walking around is reflected in the virtual space. It is possible to accept the coexistence of the real space and the virtual space with a natural feeling.

The above description relates to one embodiment of the present invention, and it goes without saying that the present invention is not limited to the above description. The number of observers was two, but may be three or more, and each person wears an HMD. One computer is used for each person. However, it is also possible to use one computer to generate image data to be presented to each person and distribute each image data to each HMD. In addition, the specific configuration and the like can be variously changed.

[0020]

As described above, according to the virtual space display device of the present invention, the virtual space displayed for each of a plurality of observers and the real space where each person actually exists are displayed. Can be shared at the same time, an object in the virtual space can be displayed through the HMD worn by each observer, and misunderstanding such as the position of the object can be prevented. Since the movement in the real space of the observer's head or body movement is reflected in the virtual space,
There is no shift between the virtual space recognized through the sight and the real space recognized through another sense such as a sense of balance, and the coexistence of the real space and the virtual space can be accepted with a natural sense.

[Brief description of the drawings]

FIG. 1 is a schematic perspective view schematically showing an embodiment of the present invention.

FIG. 2 is a diagram showing an example of a 3D image observed by each observer.

FIG. 3 is an exemplary block diagram showing a signal processing system according to the embodiment;

FIG. 4 is a block diagram showing a signal processing system according to another embodiment.

FIG. 5 is a block diagram showing a signal processing system according to still another embodiment.

[Explanation of symbols]

11, 12 HMD (head mounted display) 13 image interface 14 CRT 15 optical system 16 LCD 21, 22 head motion sensor 31, 32 computer 33 arithmetic control unit 34 image output unit 41 transmitter 51, 52 three-dimensional globe 61, 62 three-dimensional Mouse 71, 72 Haptic controller 81, 82 Position sensor 91, 92 Observer 93 Object to be observed in virtual space

──────────────────────────────────────────────────の Continued on the front page (51) Int.Cl. ⁶ Identification code FI G09G 5/36 510 G06F 15/62 360

Claims (1)

[Claims] 1. A plurality of see-through HMDs and the HM
A motion sensor for detecting the direction and position of D, and image generating means for generating each 3D image data in which the viewing direction and the display position are determined according to the detected direction and position for each HMD and sending the data to each HMD A virtual space display device comprising: