JP2000029589A - Information display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an information display device capable of performing a modeling work with feelings equal to hands. SOLUTION: This device is provided with an input device 4 for transmitting an output signal corresponding to the motion of the hand 8 of an observer 6, arithmetic unit 3 for preparing new image information by changing given image information based on the output signal from the input device 4, display 1 for displaying an image based on the new image information prepared by using the arithmetic unit 3, a half mirror 5 for reflecting the image on the display 1 and presenting it to the observer 6, and a light source 7 arranged on the opposite side of the observer 6 interposing the half mirror 5 between them for illuminating an observation object existent on the opposite side of the observer 6 with the half mirror 5 inbetween. The image on the display 1 projected on the half mirror 5 and the observation object recognized through the half mirror 5 are observed while being overlapped.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an information display device for modeling and reviewing a design shape while superimposing a virtual object created by a computer or the like and an object in the real world (real object).

[0002]

2. Description of the Related Art Hitherto, efforts have been made in various fields to support processes from upstream of design to manufacturing by using a computer to improve the efficiency of product development. In the design stage, a computer-aided design (CAD) system that can handle a three-dimensional world is used.

Under the present circumstances, in order to create a design shape with the above-described system, it is necessary to input a dimension value of the shape using a complicated command. There is a method that partially defines a curve or a curved surface using a two-dimensional pointing device such as a mouse. However, even if such a function is used, a shape can be freely defined three-dimensionally. It is not possible.

[0004] Therefore, particularly in the initial stage of design design in which the dimensions of a shape are not determined in detail, it is necessary to provide a mechanism that can directly utilize the sensibility of a designer in shape generation. For example, a system that can perform the same work as the modeling work using clay or paper in a computer is ideal.

[0005]

Heretofore, there has been proposed a system for generating a more intuitive modeling sensation by using a three-dimensional pointing device instead of a mouse or by feeding back a tactile or force sensation applied to a hand. It has been.

However, in these systems, since the shape can be freely deformed, there is a problem that it is rather difficult to form a desired shape.
In other words, in order to perform modeling work with the same feeling as a hand,
However, it is not a system that freely deforms three-dimensionally, but it is necessary to create the same feeling as working by hand.

Here, since the position of the hand in the space is intuitively and accurately grasped, if the state of the molding by the actual movement of the hand can be seen at the same position as the hand, a modeling sensation close to the actual one can be obtained. Can be produced.

In other words, in order to construct a CAD system capable of intuitively and directly creating a shape, an information display device for superimposing and viewing a worker's hand and a three-dimensional workspace created by a computer is required. is necessary.

Accordingly, an object of the present invention is to provide an information display device capable of performing a modeling operation with the same feeling as performing while touching a real object.

[0010]

According to the present invention, there is provided an information display apparatus, comprising: input means for transmitting an output signal in accordance with the movement of an observer; and changing given image information based on the output signal from the input means. Calculating means for creating new image information, a half mirror for presenting an image to an observer based on the new image information created using the arithmetic means, and an opposite side of the half mirror with respect to the observer. A light source capable of adjusting the amount of light to the observation target existing in the image processing apparatus, and it is possible to visually recognize a state in which the image information reflected on the half mirror and the image of the observation target obtained through the half mirror are superimposed. It is characterized by having.

The input means may have a function of detecting the spatial position of the observer's hand or a function of detecting a change in its position, posture, and shape in a three-dimensional space.

Further, the apparatus may further comprise means for adjusting the luminance of the surface of the real object present on the opposite side of the half mirror from the observer.

[0013] The image processing apparatus may further include a luminance detecting means for detecting luminance of the image information, and a light source adjusting means for changing the brightness of the light source based on an output signal of the luminance detecting means.

The apparatus may further comprise means for changing the partial transmittance of the half mirror according to the position of the virtual object included in the image information and the position of the observation object to be superimposed on the virtual object. .

[0015]

DESCRIPTION OF THE PREFERRED EMBODIMENTS An information display device according to one embodiment of the present invention will be described below with reference to FIGS.

FIG. 1 is a schematic configuration diagram showing the entire configuration of the information display device according to the present embodiment. In FIG. 1, reference numeral 1 denotes a display for displaying an image, and the display 1 is, for example, a CRT or a liquid crystal monitor. In addition, the display 1 can perform stereoscopic display by displaying images from a plurality of viewpoints in a three-dimensional space to be displayed separately from the eyes of the observer 6.

An image to be displayed on the display 1 is based on information stored in a storage device 2a or a recording medium such as a hard disk, a DVD, or a memory, or information transmitted from an imaging device 2b such as a CCD camera. , An image created by the arithmetic unit (arithmetic means) 3.

An input device (input means) 4 for transmitting an output signal in accordance with the movement of the hand 8 of the observer 6 is connected to the arithmetic unit 3. The input device 4 includes, for example, a state detection device 41 that detects its own position and orientation in a three-dimensional space, such as a FASTRAK (trade name) sensor of Pohimas,
And a pressure detecting device 42 for detecting a change in pressure, such as ISCAN (trade name) of Nitta Corporation.

Then, the arithmetic unit 3 converts the information stored in the storage device 2a or the information transmitted from the imaging device 2b into
It has a function of creating new image information by changing it based on the output signal of the input device 4.

For example, the pressure detecting device 42 can detect a force applied from an arbitrary direction in a three-dimensional space,
Based on the output signal of the pressure detector 42, the arithmetic unit 3
Can change the image projected on the display 1. Therefore, the observer 6 can obtain a feeling that the shape is directly deformed by the hand 8.

The image on the display 1 is reflected to the observer 6.
Are arranged so as to have a predetermined positional relationship with the display 1. further,
A light source 7 capable of adjusting the amount of light emitted to the observation object located on the opposite side of the observer 6 with the half mirror 5 interposed therebetween is arranged here on the opposite side of the half mirror 5 with respect to the observer 6. .

As the light source 7, for example, a spotlight light source or the like can be used, and a plurality of light sources 7 can be provided.

Here, the "observation target" is an object in the real world (real object) to be recognized by the observer 6 through the half mirror 5, and specifically, for example, the observer 6
Of the hand 8 and the real object 9a to be observed in the same space as the virtual object in the image.

In the information display apparatus of the present embodiment having the above-described configuration, the observer 6 illuminates the image reflected on the display 1 with the image information obtained by inverting the image from left and right by the half mirror 5 and the light source 7 and transmits the image through the half mirror 5. The hand 8 of the observer 6 or the real object 9a obtained in this manner can be viewed in the same space by overlapping. The observation target in this case is the real object 9a and the hand 8 of the observer 6.

As shown in FIG. 2, for the input device 4 viewed from the observer 6 and the real object 9b such as a background object that the observer 6 does not want to be visually recognized, the luminance thereof is set to be sufficiently dark. In addition, a bright image is presented from the display 1 with respect to the input device 4 and the image of the real object 9b not to be visually recognized and the image located at the same place on the half mirror 5.

Then, as shown in FIG. 3, a bright image is more strongly recognized by the observer 6, and the input device 4 and the real object 9b, which are not the observation target, are less visible.

Conversely, if the real object 9a to be observed in the same space as the hand 8 or the virtual object of the observer 6 is sufficiently bright and the image from the display 1 is darker, as shown in FIG. , The hand 8 and the real object 9a, which are the observation objects, are strongly recognized, and the image from the display 1 is hard to be visually recognized, so that the virtual object is covered.

That is, the virtual object in the image displayed on the display 1 and the input device 4, the real object 9a in the work space,
The observer 6 visually recognizes a desired real object and a virtual object in the real world in the same space due to the luminance difference between 9b and the hand 8 of the observer 6.

Therefore, with respect to the real object 9a to be observed in the same space as the virtual object, the surface of the real object 9a is, for example, a bright color (particularly a white system color) so that it can be seen with the same or higher brightness as the virtual object. ), And on the contrary, if the surface of the real object 9b that the user does not want to be visually recognized by the observer 6 is colored with a dark color (especially a black-based color), the observer 6 can obtain the desired real object 9a and the image. Can be superimposed and observed in a more stable form.

If the space on the opposite side of the half mirror 5 from the observer 6 is covered with, for example, a wall coated with a black matting material, the background is hardly noticeable.

The same effect as described above is obtained by using an ultraviolet lamp as the light source 7 and observing the real object 9a or the observer 6
It can also be obtained by applying a fluorescent paint to the surface of the hand 8.

On the other hand, the input device 4 includes an observer 6 instead of the state detection device 41 for detecting the position and orientation in the three-dimensional space and the pressure detection device 42 for detecting a pressure change.
A device for detecting the spatial position of the hand 8 can be used,
For example, Cyber Globe (trade name) of Virtual Technology can be used. In this case, hand 8
Since the input device 4 for detecting the spatial position of the object is an observation target, the luminance of the input device 4 is set to be equal to or higher than that of the image so that the input device 4 and the virtual object can be seen in the same space good.

Further, in the information display device described above, a virtual object corresponding to the input device 4 in the image,
From the positional relationship between the hand 8 of the observer 6 and the virtual object and the real object 9 a to be observed in the same space, the brightness of the light source 7, the transmittance of the half mirror 5, the brightness of the image, and the like are partially and dynamically changed. The virtual object and the hand 8 of the observer 6 and the real object 9a can be more effectively adjusted by automatically adjusting the brightness difference between the hand 8 of the observer 6, the real object 9a, and the virtual object. Can be superimposed.

FIG. 5 shows an information display device to which a function for achieving such an effect is added. In FIG. 5, reference numeral 31 denotes a luminance detecting device for detecting the brightness of an image corresponding to the virtual object. For example, a luminance meter can be used as the luminance detecting device 31.

In FIG. 5, reference numeral 32 denotes a brightness adjusting device 32 for changing the partial transmittance of the half mirror 5 and the partial brightness of the image. , And transmissive liquid crystal panels 32a respectively disposed on the back side of the display 1 and the front side of the display 1.
32b.

The brightness adjusting device 32 is controlled by a computing device 33. Here, the arithmetic unit 33 may be configured by adding a brightness adjustment function to the arithmetic unit 3 shown in FIG.

In the information display device shown in FIG. 5, first, the brightness of the image is detected by the luminance detecting device 31, and then the real object 9a and the hand 8 of the observer 6 and the virtual object are detected by the arithmetic device 33. From the positional relationship, how they overlap each other is calculated by calculation, and based on the result, the liquid crystal panel 32 is determined.
The partial transmittance of the half mirror 5 or the partial luminance of the image is changed by a and 32b.

That is, for the real object 9a to be positioned behind the virtual object in the image and the hand 8 of the observer 6, the partial transmittance of the half mirror 5 at the corresponding position is lowered,
The real object 9a and the hand 8 of the observer 6 appear to be behind the virtual object. Conversely, the real object 9a and the hand 8 of the observer 6
The brightness of the portion of the image that should be obscured by the object is reduced, so that the image is hidden by the real object 9a and the hand 8 of the observer 6.

Although the brightness adjusting device 32 has been described here as having two liquid crystal panels 32a and 32b, the same function can be realized by using only one of the liquid crystal panels.

Further, a light source adjusting device (not shown) for automatically changing the brightness of the light source 7 based on the output signal from the luminance detecting device 31 can be provided. In this case, the arithmetic unit 33 calculates the adjustment amount of the brightness of the light source 7,
The light source adjusting device is controlled based on the calculation result, and the light source 7 is controlled.
Adjust brightness.

The position of the image corresponding to the virtual object is originally changed depending on the viewpoint of the observer 6. Therefore, by using a device that detects the viewpoint position of the observer 6, it is possible to change the position of the display image in accordance with the viewpoint of the observer 6, thereby stably superimposing the input device 4 and the image. .

Attempts have been made to superimpose image information and a real object using a half mirror. However, according to the information display device of the present embodiment, the brightness of the light source 7 (or the screen or object By changing the (brightness), it is possible to effect more effectively than the conventional device.

As described above, according to the information display device of the present embodiment, the function of detecting the spatial position of the hand 8 of the observer 6 or the function of detecting the position, posture, and shape change in the three-dimensional space are provided. Provided with an input device 4 provided with information stored in a storage device 2a or a recording medium or an imaging device 2b.
Can be changed by the arithmetic unit 3 based on the output signal of the input device 4 to generate new image information. Therefore, the hand of the observer 6 stably superimposed and displayed in the same space can be created. While looking at the virtual object 8 and the virtual object, the modeling work can be performed with the same feeling as a hand.

By increasing the brightness of the hand 8 of the observer 6 and the real object to be superimposed on the image by the light source 7, it is possible to superimpose the natural, easy-to-view hand, real object and virtual object. The hand 8 of FIG. 6 and the virtual object created by the calculation means 3 can be stably superimposed and presented in the same space.

A member reflecting visible light is provided on the surface of the real object 9a to be superimposed on the hand 8 of the observer 6 or the image, and the real object 9a is not superimposed on the input device 4 or the image. If a member that absorbs visible light is applied to the surface of the body to provide a difference in luminance between the two, only the hand 8 or the desired real object 9a, which is the object to be observed, can be stably converted into a virtual object. It becomes possible to overlap.

Further, using the liquid crystal panels 32a and 32b, the partial transmittance of the half mirror 5 according to the position of the virtual object in the image and the position of the real object to be superimposed on the image or the position of the hand 8 of the observer 6 By changing the partial brightness of the image and giving a brightness difference to the real objects 9a and 9b and the hand 8 of the observer 6, it is possible to express a state in which they are complicatedly overlapped.

Although the information display device as a CAD system has been described in the above embodiment, the applicable range of the information display device according to the present invention is not limited to the CAD system, but may be applied to, for example, a surgical simulator or the field of entertainment. can do.

[0048]

As described above, according to the information display device of the present invention, a modeling operation can be performed with the same feeling as performing while touching a real object.

[Brief description of the drawings]

FIG. 1 is a schematic configuration diagram showing an overall configuration of an information display device according to an embodiment of the present invention.

FIG. 2 is an explanatory diagram for explaining an operation of the information display device shown in FIG. 1;

FIG. 3 is a diagram showing an example of superposition of a real object and a virtual object in the information display device shown in FIG.

FIG. 4 is a diagram showing another example of the superposition of the real object and the virtual object in the information display device shown in FIG.

FIG. 5 is a schematic configuration diagram showing a configuration in which a function of partially changing the transmittance of a half mirror and the brightness of an image is added to the information display device shown in FIG. 1;

[Explanation of symbols]

 Reference Signs List 1 display 2a storage device 2b imaging device 3, 33 arithmetic unit 4 input device 5 half mirror 6 observer 7 light source 8 observer's hand 9a, 9b real object 31 brightness detection device (brightness meter) 32 brightness adjustment device 32a, 32b liquid crystal Panel 41 State detector 42 Pressure detector

Claims (5)

[Claims] An input unit for transmitting an output signal in accordance with a movement of an observer; an arithmetic unit for changing given image information based on an output signal from the input unit to create new image information; A half mirror for presenting an image to an observer based on new image information created using the arithmetic means, and an amount of light to an observation object present on the opposite side of the observer with the half mirror interposed therebetween can be adjusted An information display device, comprising: a light source; and a state in which image information reflected on the half mirror and an image of an observation target obtained through the half mirror are superimposed. 2. The apparatus according to claim 1, wherein said input means has a function of detecting a spatial position of an observer's hand or a function of detecting a change in its own position, posture, and shape in a three-dimensional space. The information display device according to claim 1. 3. The information according to claim 1, further comprising means for adjusting the luminance of the surface of a real object existing on the side opposite to the observer with the half mirror interposed therebetween. Display device. 4. The image processing apparatus according to claim 1, further comprising: a luminance detecting means for detecting luminance of the image information; and a light source adjusting means for changing a brightness of the light source based on an output signal of the luminance detecting means. The information display device according to claim 1. 5. According to the position of a virtual object included in image information and the position of an observation target to be superimposed on the virtual object,
The information display device according to claim 1, further comprising a unit configured to change a partial transmittance of the half mirror.