JPH05191726A - Presence display device - Google Patents

Abstract

PURPOSE:To provide the presence display device in which a real image is displayed with full of presence superimposed on a background. CONSTITUTION:A picture desired to be displayed is extracted by a picture extraction device 107 and a projection device 105 projects the picture onto a transmission rate control screen 102. On the other hand, contour information of the picture is extracted by a contour picture forming device 108 and only a region receiving a projection light from the projection device 105 on the transmission rate control screen 102 is made opaque based on the contour information and a picture displayed by the projection device 105 and extracted by the picture extraction device 107 is made observed as a real image without any limit of a display color. On the other hand, the part at the outside of the contour of the transmission rate control screen 102 is made transparent to make the picture to be observed through without strong lighting of a background. Thus, an optional real image superimposed on the background is displayed.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a display device which enables highly realistic communication in an image communication system such as a TV telephone or a TV conference room, and a display device for enhancing the presence in games and advertisements. The present invention relates to a realistic display device.

[0002]

2. Description of the Related Art If a person who is distant from a distance or a virtual object can be displayed as if he / she were actually present in front of his / her eyes, the sense of presence is remarkably improved and not only telecommunications but also ours. It is expected that the social structure will be renewed. In other words, not only will satellite offices that allow you to work while you are at home become a matter of course, but the era when you can travel virtually while you are at home will no longer be a dream.

FIG. 6 shows how two real people have a conversation in a real room. It is a scene in which a man and a woman sit on a chair with the desk 106 in between and have a conversation. A plant tree, which is an ornamental tree 104, is placed on the background of the woman, and a mural 103 is hung on it. Dentsu Prox has developed a magic vision (trade name) that displays a two-dimensional image in an existing background using a half mirror. With this magic vision, you can enjoy the mysterious sensation that the displayed human figure melts into the real background. Furthermore, although the displayed person image is a two-dimensional image, it can be observed three-dimensionally.

FIG. 7 shows the structure of Magic Vision. Magic Vision, half mirror 701, projector 10
5, screen 703, and background, for example ornamental tree 10
It is composed of 4. These components are contained in one box 70.
It is contained in 6. The image from the projector 105 is projected on the screen 703, and the image is projected onto the half mirror 7.
It is reflected at 01 and can be observed as a virtual image 705 in the background. Due to the transparency of the half mirror 701, the background can be observed at the same time. With the above operation, the observer 101
Can see the image projected on the screen 703 fused with the background, and can feel the state as shown in FIG.

[0005]

The prior art described above is a method of observing an image formed on a screen as a virtual image, and therefore, there are various restrictions for observing without feeling unnatural. For example, in order to fuse the virtual image with the background, the condition that the region other than the target human image is displayed completely black on the screen 703 is essential. If it is not completely black display, for example, grayish black display,
The color of a person's image becomes a frame, which hinders fusion with the background. At the same time, this condition also imposes restrictions on the color of the portrait. That is, the completely black color could not be used for the portrait. If black is used in a person's image, that part will be transparent. Furthermore, in order to observe the background through a semitransparent medium such as the half mirror 701, the background needs strong illumination. In addition, bright projection is also necessary in order to recognize the virtual image 705 having an optically transparent property as an image. As described above, the conventional technique has many problems to be solved.

The present invention has been made to solve the above problems, and an object of the present invention is to provide a presence display device capable of displaying a real image with a sense of presence fused in the background.

[0007]

In order to achieve the above object, in the immersive display device of the present invention, a transmittance control screen capable of partially switching between a transparent state and an opaque state, and a predetermined image of a captured image are provided. An image extracting device for extracting an image in a region, a projector for projecting the extracted image on the transmittance control screen, and an interior surrounded by the outline for extracting an outline of an image output from the image extracting device. And a contour image forming apparatus that makes one region an image, the transmittance control screen is switched so that only the inner area of the contour becomes opaque based on information from the contour image forming apparatus, and the projector is Only the extracted image is projected on the opaque region of the transmittance control screen based on the information from the image extracting device.

[0008]

In the realistic display device of the present invention, the image to be displayed is extracted by the image extracting device and projected from the projector onto the transmittance control screen. On the other hand, the contour information of the image is extracted by the contour image forming device, and only the area irradiated with the projection light from the projector on the transmittance control screen is made opaque based on the contour information, and the image extracting device The image that is extracted and displayed by the projector is made to appear as a real image with unlimited display colors. on the other hand,
A portion outside the contour of the transmittance control screen is set in a transparent state so that the background can be seen through without being strongly illuminated, and an arbitrary real image fused into a certain background is displayed.

[0009]

Embodiments of the present invention will now be described in detail with reference to the drawings.

FIG. 1 shows a block diagram of an embodiment of the present invention.
In the figure, 101 is an observer, 102 is a transmittance control screen (hereinafter abbreviated as screen in some cases), 1
03 is a mural, 104 is an ornamental tree, 105 is a projector, 106
Is a desk, 107 is an image extracting device, and 108 is an image contour forming device.

The observer 101 sitting in the chair is at the desk 106.
It faces the transmittance control screen 102 with the film sandwiched therebetween.
The ornamental tree 104 is in the background of the transmittance control screen 102.
There is a mural 103. The projector 105 is attached to, for example, the ceiling. The image extracting device 107 extracts a target image in a predetermined area from the captured image. Projector 1
05 projects the extracted target image on the screen 102. The contour image forming device 108 extracts the contour of the image output from the image extracting device 107, and sets the internal region surrounded by the contour as one image. The transmittance control screen 102 has a polymer-scattering liquid crystal as a main constituent element, and has electrodes formed on two substrates sandwiching the polymer-scattering liquid crystal,
It operates by supplying an electric signal based on the image information of the image extracting device 107. Such a transmittance control screen 102 is used in the contour image forming apparatus 10
The video signal from No. 8 is displayed, and only the inner region of the contour becomes opaque. The projector 105 projects only the extracted image on the opaque region based on the information from the image extracting device 107, and projects the projected image only when the transmittance control screen 102 is in the opaque state. To work.

FIG. 2 shows how the observer 101 observes, and 201 is a real image. Since the screen 102 is opaque except for the area where the real image 201 is projected, the ornamental tree 104 and the wall painting 103 in the background can be recognized there. Therefore, a projected image (real image 20
1) is displayed as if it were in front.

FIG. 3 is a state diagram of the transmittance control screen 102 when it looks like FIG. Only the person image and a part of the chair become the opaque area 301, which functions as a screen. On the other hand, the others are transparent regions 302. The transmittance control screen 102 can be realized by using polymer scattering type liquid crystal as described above. The driving method of the screen 102 is usually performed by a liquid crystal panel,
For example, either a matrix driving method or an active matrix driving method is possible.

FIG. 4 shows a projected image when it looks like FIG. In the projection light from the projector, the real image 201 of only a person and a part of the chair is the opaque area 3 of the screen 102.
01 is projected on.

FIG. 5 is an explanatory diagram of the signal processing algorithm in this embodiment. First, after capturing an image of a subject, the image extraction device 107 extracts a target object (target image). The method can be realized, for example, by setting the background of the object to be blue and cutting out only the object by the chroma key effect. It is expected that in the future, due to the progress of image processing technology, a method for cutting out an arbitrary area will be found regardless of the background, but those methods may be used. The extracted target object is directly projected from the projector 105 onto the screen. At this time, no area other than the target area is projected. On the other hand, in the contour image forming apparatus 108,
The contour area of the target object is formed based on the video signal of the target object. This contour area is formed on the transmittance control screen 102, only that portion is switched to opaque, and the target object is displayed as a real image. Since the display image of this target object is a real image, the display color is not limited. Further, since the area of the screen 102 other than the real image is transparent, the background can be viewed without being strongly illuminated like a half mirror.

The present invention can be applied to both moving images and still images. As described above, the present invention can be applied in various ways in accordance with the gist thereof and can take various embodiments.

[0017]

As is apparent from the above description, according to the immersive display device of the present invention, the projected image formed on the screen and the background behind the transparent area of the screen are blended together without any unnatural feeling. Therefore, it is possible to realize a display technology in which an object actually exists in the order of the background and the projected image. Furthermore, since the projected image is not a virtual image but a real image, no limitation is imposed on the display color of the projected image.

[Brief description of drawings]

FIG. 1 is a configuration diagram showing an embodiment of the present invention.

FIG. 2 is a diagram showing an observation situation of an observer in the above embodiment.

FIG. 3 is a state diagram of a transmittance control screen of the above embodiment.

FIG. 4 is a diagram showing a projected image in the above embodiment.

FIG. 5 is an explanatory diagram of an algorithm of signal processing of the above embodiment.

FIG. 6 is an explanatory diagram of a conventional technique.

FIG. 7 is a diagram showing a configuration example of a conventional technique.

[Explanation of symbols]

101 ... Observer, 102 ... Transmittance control screen, 10
3 ... Mural, 104 ... Ornamental tree, 105 ... Projector, 106 ...
Desk, 107 ... Image extracting device, 108 ... Image contour forming device, 201 ... Real image, 301 ... Opaque area, 302 ... Transparent area.

Front page continuation (51) Int.Cl. ⁵ Identification code Office reference number FI technical display location H04N 5/74 D 9068-5C 7/14 8943-5C // G09F 13/00 A 7319-5G

Claims (2)

[Claims] 1. A transmittance control screen capable of partially switching between a transparent state and an opaque state, an image extracting device for extracting an image in a predetermined region of a captured image, and the extracted image on the transmittance control screen. The projector includes a projector for projecting, and a contour image forming device that extracts a contour of an image output from the image extracting device and defines an internal region surrounded by the contour as one image. Based on the information from the contour image forming device, switching is performed so that only the inner region of the contour is in the opaque state, and the projector only extracts the extracted image based on the information from the image extracting device in the opaque state of the transmittance control screen. Reality display device, which is characterized in that it is projected on the area. 2. The transmittance control screen has a polymer-scattering liquid crystal as a main constituent element, and operates by supplying an electric signal to electrodes formed on two substrates sandwiching the polymer-scattering liquid crystal. The realistic display device according to claim 1.