JP3859361B2 - Information display device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an information display device that performs modeling and review of a design shape while superimposing a virtual object created by a computer or the like and an object in the real world (real object).
[0002]
[Prior art]
Conventionally, efforts have been made in various fields to support the processes from the upstream of the design to the manufacturing using a computer and to improve the efficiency of product development. Among these, a computer-aided design (CAD) system capable of handling a three-dimensional world is used at the design stage.
[0003]
By the way, in the present situation, in order to create a design shape by the above-described system, the dimension value of the shape must be input using a complicated command. Some methods support partially defining a curve or curved surface using a two-dimensional pointing device such as a mouse. Even if such a function is used, the shape can be freely defined in three dimensions. It is not possible.
[0004]
Therefore, particularly in the initial stage of design design in which the dimensions of the shape are not determined in detail, a mechanism that can directly use the designer's sensitivity for shape generation is required. For example, a system that can perform the same work as modeling work using clay or paper in a computer is ideal.
[0005]
[Problems to be solved by the invention]
Until now, a system that generates a more intuitive modeling sensation by using a three-dimensional pointing device instead of a mouse or feeding back a tactile or force sense applied to a hand has been proposed.
[0006]
However, since these systems can be deformed too freely, there is a problem that it is difficult to make a desired shape. In other words, in order to perform a modeling work with a sense equivalent to that of a hand, it is necessary to create the same sensation as when working with a hand, not a system that freely deforms in three dimensions.
[0007]
Here, the position of the hand in the space is sensed fairly accurately, so if you can see the modeling of the actual movement of the hand at the same position as the hand, you can create a modeling feeling that is close to reality. it can.
[0008]
That is, in order to construct a CAD system capable of intuitively and directly creating a shape, an information display device that superimposes an operator's hand and a three-dimensional work space created by a computer is necessary. .
[0009]
Accordingly, an object of the present invention is to provide an information display device that can perform a modeling operation with a sense equivalent to that performed while touching a real object.
[0010]
[Means for Solving the Problems]
An information display device according to the present invention generates new image information by changing input image information based on an output signal from an input means for transmitting an output signal in accordance with an observer's movement and the output signal from the input means. A calculation means, a half mirror that presents an image to an observer based on new image information created using the calculation means, and a light quantity to an observation object that is on the opposite side of the observer across the half mirror A light source capable of adjusting the brightness, a brightness detecting means for detecting the brightness of an image presented by the half mirror, image information reflected on the half mirror, and an image of an observation object obtained through the half mirror and visible superimposed state, that comprises a luminance adjusting means for changing the partial brightness of the partial transmission or the image of the half mirror on the basis of an output signal of said luminance detecting means And it features.
[0011]
The input means may have a function of detecting the spatial position of the observer's hand or a function of detecting a change in position, posture, and shape of the observer in the three-dimensional space.
[0013]
Further, the apparatus may further include light source adjusting means for changing the brightness of the light source based on an output signal of the luminance detecting means .
[0014]
Further, the image processing apparatus may further include means for changing the partial transmittance of the half mirror according to the position of the virtual object included in the image information and the position of the observation object to be superimposed on the virtual object.
[0015]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, an information display device according to an embodiment of the present invention will be described with reference to FIGS.
[0016]
FIG. 1 is a schematic configuration diagram showing the overall configuration of the information display apparatus according to the present embodiment. In FIG. 1, reference numeral 1 denotes a display for displaying an image. The display 1 is, for example, a CRT or a liquid crystal monitor. The display 1 can also perform stereoscopic display by separately displaying images from a plurality of viewpoints in the three-dimensional space to be displayed in the eyes of the observer 6.
[0017]
An image to be displayed on the display 1 is based on, for example, information stored in a storage device 2a or a recording medium such as a hard disk, a DVD, or a memory, or information transmitted from an imaging device 2b such as a CCD camera. (Calculating means) 3 is an image created by 3.
[0018]
An input device (input means) 4 that transmits an output signal according to the movement of the hand 8 of the observer 6 is connected to the arithmetic device 3. This input device 4 includes a state detection device 41 that detects its own position and orientation in a three-dimensional space, such as a Pohistus FASTRAK (trade name) sensor, and an ISCAN (trade name) of NITTA Corporation, for example. A pressure detection device 42 for detecting such a pressure change is provided.
[0019]
The arithmetic device 3 has a function of changing the information stored in the storage device 2a or the information transmitted from the imaging device 2b based on the output signal of the input device 4 to create new image information. .
[0020]
For example, the pressure detection device 42 can detect a force applied from an arbitrary direction in a three-dimensional space, and changes an image projected on the display 1 by the arithmetic device 3 based on an output signal of the pressure detection device 42. Can be made. Therefore, the observer 6 can obtain a sense of shape deformation directly with the hand 8.
[0021]
A half mirror 5 that reflects the image of the display 1 and presents it to the observer 6 is arranged so as to have a predetermined positional relationship with the display 1. Further, a light source 7 capable of adjusting the amount of light irradiated to the observation object existing on the opposite side of the observer 6 with the half mirror 5 interposed therebetween is disposed on the opposite side of the observer 6 with the half mirror 5 interposed therebetween. ing.
[0022]
As the light source 7, for example, a spotlight light source or the like can be used, and a plurality of light sources 7 can be installed.
[0023]
Here, the “observation object” is a real-world object (real object) to be recognized by the observer 6 through the half mirror 5, and specifically, for example, the hand 8 of the observer 6, This is a real object 9a to be observed in the same space as the virtual object in the image.
[0024]
In the information display device of the present embodiment having the above-described configuration, the observer 6 is obtained by illuminating the image reflected on the display 1 with the light source 7 and the image information obtained by horizontally inverting the image reflected on the display 1 and passing through the half mirror 5. The hand 8 of the observer 6 or the real object 9a can be overlapped and viewed in the same space. In this case, the observation object is the real object 9a and the hand 8 of the observer 6.
[0025]
As shown in FIG. 2, the input device 4 viewed from the observer 6 and the real object 9b such as a background object that the observer 6 does not want to visually recognize are set so that the luminance thereof is sufficiently dark. In addition, a bright image is presented from the display 1 for the input device 4 and the real object 9b that is not desired to be visually recognized and the image located at the same place on the half mirror 5.
[0026]
Then, as shown in FIG. 3, the bright image is more visually recognized by the observer 6, and the input device 4 and the real object 9 b that are not the observation target are less visible.
[0027]
On the contrary, if the real object 9a to be observed in the same space as the hand 8 of the observer 6 or the virtual object is sufficiently bright and the image from the display 1 is darker, the observer 6 observes as shown in FIG. The hand 8 and the real object 9a which are the objects are strongly visually recognized, and the image from the display 1 is hardly visually recognized, so that the virtual object is obscured.
[0028]
That is, the virtual object in the image displayed on the display 1 and the input device 4, the luminance difference between the real objects 9 a and 9 b in the work space and the hand 8 of the observer 6, the observer 6 becomes a desired real object in the real world. The virtual object is visually recognized in the same space.
[0029]
Therefore, for the real object 9a to be observed in the same space as the virtual object, for example, the surface is colored with a bright color (especially a white color) so that the real object 9a can be seen with the same or higher brightness as the virtual object. On the other hand, regarding the real object 9b that the observer 6 does not want to be visually recognized, if the surface is colored with a dark color (especially a black color), the observer 6 can stabilize the desired real object 9a and the image more stably. It is possible to observe in a superimposed manner.
[0030]
Further, if the space opposite to the viewer 6 with the half mirror 5 is covered with a wall coated with, for example, a black matting material, the background is hardly noticed.
[0031]
The same effect as described above can also be obtained by using a UV lamp as the light source 7 and applying a fluorescent paint to the surface of the real object 9a that is the object to be observed or the surface of the hand 8 of the observer 6.
[0032]
On the other hand, the input device 4 detects the spatial position of the hand 8 of the observer 6 instead of the state detection device 41 that detects the position and orientation in the three-dimensional space and the pressure detection device 42 that detects a pressure change. For example, a cyber glove (trade name) of Virtual Technology Co., Ltd. can be used. In this case, since the input device 4 that detects the spatial position of the hand 8 is an observation object, the input device 4 and the virtual object are the same by setting the luminance of the input device 4 to be equal to or higher than that of the image. Make it visible in space.
[0033]
Further, in the information display device described above, the light source 7 is further derived from the positional relationship between the virtual object corresponding to the input device 4 in the image, the hand 8 of the observer 6 and the real object 9a to be observed in the same space as the virtual object. The brightness of the viewer 6, the transmittance of the half mirror 5, and the brightness of the image are partially and dynamically changed to automatically adjust the brightness difference between the hand 8 of the observer 6, the real object 9 a, and the virtual object. By doing so, it is possible to more effectively superimpose the virtual object, the hand 8 of the observer 6, and the real object 9a.
[0034]
FIG. 5 shows an information display device to which a function for achieving such an effect is added. In FIG. 5, reference numeral 31 denotes a luminance detection device that detects the brightness of an image corresponding to a virtual object. For example, a luminance meter can be used as the luminance detection device 31.
[0035]
In FIG. 5, reference numeral 32 indicates a luminance adjusting device 32 for changing the partial transmittance of the half mirror 5 and the partial luminance of the image. Transmission type liquid crystal panels 32 a and 32 b are provided respectively on the front side of the display 1.
[0036]
The brightness adjusting device 32 is controlled by the arithmetic device 33. Here, the arithmetic device 33 may be configured by adding a brightness adjustment function to the arithmetic device 3 shown in FIG.
[0037]
In the information display device shown in FIG. 5, first, the brightness of the image is detected by the luminance detection device 31, and then the arithmetic device 33 determines the physical object 9a and the positional relationship between the hand 8 of the observer 6 and the virtual object. Then, how they overlap each other is obtained by calculation, and the partial transmittance of the half mirror 5 or the partial luminance of the image is changed by the liquid crystal panels 32a and 32b based on the result.
[0038]
That is, with respect to the real object 9a to be located behind the virtual object in the image and the hand 8 of the observer 6, the partial transmittance of the half mirror 5 at the corresponding position is lowered, and the real object 9a and the observation are observed. The person's 6 hand 8 is shown behind the virtual object. On the other hand, regarding the image portion to be covered by the real object 9a and the hand 8 of the observer 6, the luminance of the portion is reduced and the real object 9a and the hand 8 of the observer 6 appear to be hidden.
[0039]
Here, the brightness adjusting device 32 has been described as being composed of two liquid crystal panels 32a and 32b, but the same function can be realized with only one of the liquid crystal panels.
[0040]
In addition, a light source adjusting device (not shown) that automatically changes the brightness of the light source 7 based on an output signal from the luminance detection device 31 can be provided. In this case, the amount of adjustment of the brightness of the light source 7 is calculated by the calculation device 33, and the brightness of the light source 7 is adjusted by controlling the light source adjustment device based on the calculation result.
[0041]
In addition, the position of the image corresponding to the virtual object originally changes depending on the viewpoint of the observer 6. Therefore, by using a device that detects the viewpoint position of the observer 6, it is possible to change the position of the display image in accordance with the viewpoint of the observer 6 and thereby to achieve stable input device 4 and image superposition. .
[0042]
Attempts to superimpose image information and a real object using a half mirror have been made conventionally, but according to the information display device according to the present embodiment, the brightness of the light source 7 (or the brightness of the screen or object) is adjusted. By changing, it is possible to produce more effective than the conventional device.
[0043]
As described above, according to the information display apparatus according to the present embodiment, the input having the function of detecting the spatial position of the hand 8 of the observer 6 or the function of detecting the position, posture, and shape change in the three-dimensional space. The apparatus 4 is provided, and the information stored in the storage device 2a or the recording medium or the information transmitted from the imaging device 2b is changed by the arithmetic device 3 based on the output signal of the input device 4 to obtain new image information. Since it can be created, the modeling work can be performed with the same feeling as a hand while observing the hand 8 of the observer 6 and the virtual object stably superimposed and displayed in the same space.
[0044]
Further, by increasing the brightness of the real object to be superimposed on the hand 8 of the observer 6 and the image by the light source 7, it is possible to superimpose natural, easier-to-see hands, real objects, and virtual objects. 8 and the virtual object created by the calculation means 3 can be stably superimposed and presented in the same space.
[0045]
Further, a member that reflects visible light is provided on the surface of the observer's hand 8 and the real object 9a to be superimposed on the image, and other input devices 4 and other real objects that are not superimposed on the image are provided on the surface. If a member that absorbs visible light is provided on the surface and a luminance difference is provided between the two, only the hand 8 or the desired real object 9a that is the observation target is stably superimposed on the virtual object. Is possible.
[0046]
Further, using the liquid crystal panels 32a and 32b, the partial transmittance of the half mirror 5 and the image of the image according to the position of the virtual object in the image and the position of the real object to be superimposed on the image or the hand 8 of the observer 6 are used. By changing the partial luminance and giving a difference in luminance to the real objects 9a and 9b and the hand 8 of the observer 6, it is possible to express a state in which they overlap in a complex manner.
[0047]
In the above embodiment, the information display device as a CAD system has been described. However, the application range of the information display device according to the present invention is not limited to the CAD system, and may be applied to, for example, a surgical simulator and the entertainment field. it can.
[0048]
【The invention's effect】
As described above, according to the information display device of the present invention, it is possible to perform a modeling work with a sense equivalent to that performed while touching a real object.
[Brief description of the drawings]
FIG. 1 is a schematic configuration diagram showing an overall configuration of an information display device according to an embodiment of the present invention.
FIG. 2 is an explanatory diagram for explaining the operation of the information display device shown in FIG. 1;
3 is a diagram showing an example of superposition of a real object and a virtual object in the information display apparatus shown in FIG.
4 is a diagram showing another example of superposition of a real object and a virtual object in the information display apparatus shown in FIG.
5 is a schematic configuration diagram showing a configuration in which a function of partially changing the transmittance of a half mirror and the brightness of an image is added to the information display device shown in FIG.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 1 Display 2a Memory | storage device 2b Imaging device 3, 33 Arithmetic device 4 Input device 5 Half mirror 6 Observer 7 Light source 8 Observer hand 9a, 9b Real object 31 Luminance detection apparatus (luminance meter)
32 brightness adjusting devices 32a and 32b liquid crystal panel 41 state detecting device 42 pressure detecting device

Claims (4)

Input means for transmitting an output signal according to the movement of the observer;
Arithmetic means for changing given image information based on an output signal from the input means and creating new image information;
A half mirror that presents an image to an observer based on new image information created using the computing means;
A light source capable of adjusting the amount of light to the observation object existing on the opposite side of the observer across the half mirror;
Luminance detecting means for detecting the luminance of the image presented by the half mirror;
The state in which the image information reflected on the half mirror and the image of the observation object obtained through the half mirror are superimposed can be visually recognized, and the half mirror is partially transmitted based on the output signal of the luminance detecting means. An information display device comprising: a luminance adjusting means for changing a rate or a partial luminance of the image .   The said input means is equipped with the function to detect the space position of an observer's hand, or the function to detect the own position, attitude | position, and shape change in three-dimensional space, The feature of Claim 1 characterized by the above-mentioned. Information display device. The information display device according to claim 1, further comprising a light source adjusting unit that changes a brightness of the light source based on an output signal of the luminance detecting unit .   2. The apparatus according to claim 1, further comprising means for changing a partial transmittance of the half mirror in accordance with the position of the virtual object included in the image information and the position of the observation object to be superimposed on the virtual object. Item 4. The information display device according to any one of Items 3 to 3.

Images