KR20020040773A - Communications system - Google Patents

Abstract

An arrangement for displaying a life-size live image of a person from a remote location in a three dimensional setting in a home location while providing the person in the remote location with a corresponding telepresence of the home location. One embodiment comprises: a video presentation system for displaying a person on a black or chromakey background 102; a two way mirror 2 or viewing both a setting 7 and the superimposed video image of the person 4; a video camera or pair of camers 5 positioned in line with the eyes of the superimposed image of the person 4; and a network connection between the home location and the remote location. Stereoscopic views may be used with the two way minor and a retroreflective surface to display life-size autostereoscopic live images of a person from a remote location in a 3D setting. A further embodiment includes a device (36, Figure 7) that allows for tracting of the eyes of the user.

Description

Communication system {COMMUNICATIONS SYSTEM}

Various forms of communication have been developed for transmitting video and video between communication parties. Systems, commonly known as video conferencing, use network connections such as ISDSNs to transfer video between two locations. Most systems use video monitors to display people in remote locations, and have a camera on the monitor for capturing and transmitting images of users in the home.

It is a common form of video conferencing that users communicate with people who are visualized on a monitor. This type of communication is unnatural in that users cannot look straight at each other while communicating. This is because the camera is positioned higher than the monitor rather than the position of the human eye displayed on the monitor. When a user at home looks at a person on a monitor, the user looks away from the camera. Eventually, the image displayed on the monitor at the remote location would represent the person who turned away from the camera. For this reason, you cannot communicate naturally while looking at the other's eyes.

Some patents address the principle of using a two way mirror to match the line of sight of a person displayed on a monitor or screen to the reflected line of view of the camera. These inventions achieve eye contact between the user and the transmission image of the person at the remote location. However, because the transmitted person is shown on a flat screen, it cannot give a sense of presence in a space.

The present invention relates to a communication system that is particularly suitable for, but not limited to, video conferencing, which transmits a full-size image of a person superimposed in a three-dimensional setup to achieve eye contact.

1 shows an image of a remote user superimposed in a scene and the camera reflects the image of the remote user so that the camera captures the user's image through a two-way mirror and includes a chair to provide a setting to the setting through the two-way mirror. Fig. 1 shows a system according to the invention with a two-way mirror and with a user sitting at a table.

2 is a configuration of a remote system having a mirror image of exactly the same features as the home position.

3 illustrates a system for a short person in a home position.

4 is a system configuration of a remote location with a camera facing the user at a lower position to meet the eye level of the user at the home position.

5 is a system diagram with an image display under a two-way mirror and an overlay image of a remote person located in a chair.

FIG. 6 illustrates a system in which a remote person displays an image superimposed in front of a curtain background on a lecture desk.

7 illustrates an embodiment of a system used for autostereoscopic viewing of a remote person with a pair of projectors projecting an image on a reflective surface and a pair of cameras capturing a user's reflected image.

8 illustrates an autostereoscopic configuration of a remote system.

9 shows a system in which a home position user is in a proximity viewing position by adjusting the position of the projector to match the relative distance from the retroreflective screen.

FIG. 10 illustrates a remote system with a camera facing the user moving in close proximity to match the relative distance of the user at the home location to a commercial user at the remote location.

FIG. 11 illustrates an embodiment of a system displayed on a screen located over a binocular mirror of a home position person so that it is overlaid on the stage and visible to the audience.

12 is another system configuration diagram in a theater setting in which a bidirectional mirror is inclined to reflect down a screen having a full body image.

FIG. 13 is a schematic diagram of a system in which the appearance of a user's full body height is captured by a camera in a home position and the user can see the appearance of a remote audience displayed on a large screen.

14 is a system diagram of an exhibition pulpit in which a group of people standing can see a superimposed image of a home location user.

15 is a system configuration top view of an exhibition pulpit in which a camera angle captures an image of a group of people.

FIG. 16 is a plan view of a system in which a user at a home location can view an image of a remote camera angle positioned at a viewing angle toward a group of people looking at an exhibition pulpit. FIG.

FIG. 17 is a system configuration top view of an exhibition pulpit with two cameras covering a wider area showing a group of people. FIG.

18 is a plan view of the system configuration in a home position with two screens to align the camera angles towards the remote group.

Fig. 19 is a plan view of a triangular table showing a layout for a three-way teleconference.

20 is a plan view of a system configuration in a home position for a three-way teleconference conference.

21 is a plan view of the system configuration at a first remote location for three-way teleconference conference.

Fig. 22 is a plan view of a system configuration at a second remote location for three-way teleconference conference.

FIG. 23 is a block diagram of a rear projection screen for displaying an image of a remote person and a control object located on a plane of a reflected image;

24 is a block diagram of a rear projection screen displaying stereoscopic images using a plurality of control objects located at different depths.

According to the present invention, a user at home sees the remote place displayed on the screen directly in front of him. The present invention provides telepresence by representing the scene of a distant location as if it were actually there. People in remote locations see users at home as life-size images superimposed behind a lecture desk or sitting at a table. These overlapping life-size images are arranged to match the camera to the field of view for the remote realism of the user at home. This technique is called "teleportation" because people in remote locations see life-size images of people who have remote reality for natural human communication.

Eye to eye contact creates a presence that fosters more natural communication. This form of communication allows people to better express and use gestures or facial expressions to convey emotions and feelings. The present invention is a new form of name called "teleportation conference" instead of having a video conference. To create a communication.

The present invention provides a system that enables eye to eye communication by aligning the camera with the relative position of the eye of the image of people displayed on the screen.

Embodiments of the present invention include, but are not limited to, a communication system for linking two separate locations of participants.

Each comprising at least one real time image capture device, at least one image projection device, a viewing area occupied by the participant, and a bidirectional mirror in which the images are viewed;

(a) arranged to view a participant occupying a home position viewing area either directly or indirectly along the line of sight passing through the two-way mirror,

(b) first and second positions linked to the counterpart image projection device such that the captured image is transmitted from the home position to a remote position and projected at the remote position to be viewed through a corresponding bidirectional mirror;

The remotely captured image of the remote participant is superimposed within the three-dimensional set-up provided by the visual depth cue means, including the visual depth cue means for viewing through the bi-directional mirror from the observation zone. And at least one location configured to link the participants of the two separate locations.

The visual depth cueing means may consist of one or more objects suitably positioned so that an observer at that location can be prominently visible or an additional image display (e.g., an image or images projected onto a screen or backdrop). have.

The term "three-dimensional set" is to be understood as an arrangement that allows the viewer to impress the remotely captured image as being located in three-dimensional space beyond the bidirectional mirror. As such, according to the present invention, the three-dimensional set up image is remotely captured in a plane spaced along the line of sight of the viewer from one or more additional planes on which a plane or stereoscopic additional image or images (eg, background) are displayed. It is also possible to implement by positioning (planar or solid).

Other features and aspects of the invention are set forth in the following description and the appended claims.

The present invention may include an image capture device in the form of a video camera, a bidirectional mirror, and a home location connected via a network to one or more remote locations having an image display configuration. The video camera may be any device as long as the device can capture video of a user. The camera may output video in a standard video format or a format adapted for a network, such as an Internet protocol for transmission over the Internet. The bidirectional mirror may be, for example, a translucent element made of glass, plastic or film material having a partial mirror structure or other form of beam splitting arrangement. The bidirectional mirror may be laminated with one or more glass or plastic sheets to maintain a flat surface. The image display may be a rear projection screen, a front projection screen, a retroreflective surface, or a large display screen such as a plasma screen, LCD screen or monitor.

In one embodiment of the present invention, a user seated at a table at a starting point of a teleconference would like to see a life-size image of a person at another location referred to as a remote location. The bidirectional mirror located at the front of the user is angled to reflect the image of the person being displayed above the image display. In order for the image viewed by the viewer in one position not to be a mirror image of a participant in the remote position, it may be necessary to mount a small mirror in front of the camera lens or flip the image laterally by video processing.

The arrangements can arrange the bidirectional mirror inclined downward to reflect the image display located below it or inclined upward to reflect the image display located thereon. The image display and the mirror are configured to allow the reflected image of the image display to appear to be on the other side of the table or lecture table. In a configuration with a table, the remotely moved person appears to be seated in a chair, and the camera may be placed on a high back with the camera facing towards the user to capture an image of the user in the home position. In a configuration with a lecture table, the camera may be positioned on a hanging backdrop behind the lecture table. In either case, the location of the remotely moved person's eye is displayed at a location that may coincide with the line of sight captured by the camera.

The visual person-to-person link between locations may be supplemented by a computer link between the locations. Accordingly, the user (s) may have a computer monitor located in front of them to control computer programs containing content to share with the person (s) in the remote location. The computer at the home location may be connected to the compatible computer at the remote location via the Internet, a telephony connection, or a private network. Images displayed on the screen of the home location can be controlled via specific software and network connections so that they can be displayed on a monitor located in front of the person in the remote location and / or on a screen visible to an audience at the remote location. .

In one embodiment of the present invention, it may be possible for users at each location to use the stylus to make a display on the screen to be visualized on the computer screen of both home and remote locations. One application of the present invention is a teleportation meeting between a bank employee of a main bank and a customer of a branch bank, where the bank employee will select appropriate graphics and forms within the customer computer program. Bankers and customers will be able to discuss the displayed graphics and financial data through the teleportation visual display of face-to-face communication. Information of interest to the customer can be printed on a small printer next to the customer for later review and consideration. A bank clerk can maintain eye-to-eye communication to help the customer type and fill out the information on the form or use the stylus to check the appropriate boxes and provide warranty and evaluation answers. The completed form can be printed by the bank branch and signed by the customer for delivery to the bank branch.

In another embodiment of the present invention, a person in a home location may be displayed in a lecture table in a remote location. The visual content displayed on the home screen's computer screen may be networked to a remote location for display on a large screen in the audience's field of view. In one application, the present invention may be used for teaching, training, or integrated presentations when interested in both presenting and viewing the content of a presentation. Depending on the use of the stylus, the presenter will be able to make a presentation that highlights the content of the presentation. The screen in the presence of the audience may be an "interactive board," which may have the feature of registering all indications formed on the board as computer input. The display on the screen will be networked to the presenter's computer to allow the presenter to view the display of all input by the audience at the remote location.

In the large scale configuration of the present invention, the whole body from the head to the toe is generally displayed in full size. This telegraph can be displayed in a theater, in which case the teleported person appears to be on stage. It is possible to see a large screen display of the audience so that the remote person can communicate with the audience through natural conversation. In this way, dignitaries, performers, musicians, sports stars and nouns can make face-to-face contact with a worldwide audience.

For movie production it is possible to have a second projection means for projecting a backdrop behind superimposed images of teleported people. In this way, it is possible to have a live capability to make it appear that there is a remotely moved person in the presence of the projected backdrop, which may be transmitted from remote locations or may be a virtual environment generated in real time by a computer.

In the configuration of the present invention for teleconference meetings, the user in the home position will see an image of the remote user overlaid to the position behind the table in the plane in front of the chair and the three-dimensional setting of the conference room, for example, via a two-way mirror. will be. The chair and table act to provide a visual depth cue so that the remote user's image can be viewed in a three-dimensional setup. The user's camera at each location performs viewing through the bidirectional mirror to capture the user's image. The video or computer image has a background that turns black so that the image displayed on the screen can be the user's image. This black background can be photographed against a black background, by using chroma key technology to replace a color such as blue with a black background, or by using retroreflective material with key light located close to the camera lens. Can be achieved.

The present invention can be configured to have three or more locations participating in a teleconferencing conference, where each location has separate image displays for each person sent from the remote locations. In this configuration, a separate camera is used for each view of the user.

In another embodiment of the present invention, two cameras are provided with an offset of about 65 mm to capture stereoscopic images transmitted to or from remote locations. These two cameras are placed on top of the bidirectional mirror so that their viewing angle can cover the user's reflection in the bidirectional mirror. The exact location of the two cameras is determined by the location of the user's eye at the remote location. The exact location of the user's eyes at the remote location is determined by the head tracking system, and the coordinates are transmitted to the home location. In the home position, the cameras are moved to a selected position on the mirror to match the relative position of the remote user behind the two-way mirror.

In this configuration, the screen is made of retroreflective material, and images are projected entirely. Both projectors use single lenses and are positioned to match the focus of the reflected images with the positions of the user's eyes, respectively. The coordinates generated by the head tracking device are used to position the projectors in the remote location. The projectors are held at a conversion stage that moves to a position to be located at the focal point reflected from the retroreflective plane. In this way, the user will see an automatic stereoscopic image.

At the home location, the user will see an automatic stereoscopic image of the user at the remote location. In this configuration there is no problem because the projectors seen through the two-way mirror will be included in the field of view of the cameras. In order to minimize the brightness of such projectors, it is possible to install a polarizing filter on the projector and to install a second set of polarizing filters on the camera at 90 degrees.

Another way to solve this problem is to provide shutters for both cameras and projectors that are synchronized with each other to alternate between projection of the remote location image and capture of the home location image.

Another way to obtain stereoscopic images is to use two independent, remotely offset positions that are laterally offset to provide stereoscopic pairs using polarizing filters installed at 90 degrees to each other on the rear projection screen, which maintains polarity after light passes. Projecting two images obtained using cameras. Although normal rear projection screen materials diffuse polarization, the polarity of the light can be retained using transparent screen materials with Fresnel lenses located on one side and lens arrays located on the other side. The stereoscopic image pair projected on the high gain rear projection screen is reflected by the bidirectional mirror, and the resulting stereoscopic image may be viewed through the three-dimensional polarized glass.

The same stereoscopic visual effect can be obtained using glasses or goggles using LCD shutters to alternate between left and right views of the participant from the pair of cameras in the other position. Using such a system, the screen may be constructed in a form that can diffuse polarization. Shutter glasses can be used with CRT monitors, LCD monitors, plasma screens or other forms of electronic image display systems that can alternate the display of left and right images, in which the displayed image is a three-dimensional image placed beyond the bidirectional mirror. The configuration is such that it is reflected by the bidirectional mirror so that it appears to be in the setting section.

One way to achieve stereoscopic effects without the use of polarized glass or LCD goggles is to use a lenticular screen on a monitor that displays a set of offset views for reflection by a bidirectional mirror so that it appears to be in a three-dimensional setup. It can be mentioned. This method is ideal for simultaneous stereoscopic viewing from multiple locations. When using this technique, the size of the display is determined by the size of the high resolution monitors available.

According to this stereoscopic display, a person may be projected onto a screen with a black background. This stereoscopic image will be reflected to be visible in the three-dimensional space in front of the viewer. In this way, the person and all objects captured by the cameras will appear to go the real depth as seen in three-dimensional space. Unlike a single image that would appear to be in a single plane of the reflected image, a person in a stereoscopic image may appear to move close or apart in three-dimensional space behind the two-way mirror, and even appear to reach the front of the two-way mirror. .

A particularly advantageous feature of the present invention is that it is possible to make a life-size image of a person at a distant location appear as a three-dimensional setup that can include objects in the image area. Thus, it is possible to assign a function to be performed when an image of a person at a remote location intersects with the physical location of one of the objects. That is, the action on the user portion of the remote location may be correlated with the objects of the three-dimensional set up of the home location to provide an impression of the interaction between the remotely captured image and the object at the home location. In one example, a person at a remote location can trigger a function by reaching the location of a button in the image area. Since the person at the remote location is virtually nonexistent, this function can be triggered by a software application that detects the movement of the hand when it enters the area assigned to the intended function. In this way, the person at the remote location can perform the function in the same way as the actual location at the actual remote location.

Another way to register a function is for a person in the home position to make physical contact with an object at the home position. Physical contact will be registered with a series of measurable pressures and / or physical movements. These registered physical pressures and / or movements will be activated at a remote location for a similar object to mimic the action taken at the home location. This will display the coordinates of the image of the person in the remote location that activates the actual physical movement or physical change into an object in three-dimensional space. This effect can be very useful for training or demonstration.

The interaction between a two-dimensional full-scale image of a person and objects in three-dimensional space can work effectively if the objects are in the plane of the planar image. However, such interactions in three-dimensional space can be made more effective by using life-size stereoscopic images of people from remote locations.

Although the present invention has been described with reference to personal-to-person visual communication at two locations, the present invention, within its scope, provides that a person at each location is at least visual with one or more, preferably at each other location person. It also includes a system configured to have another location arranged to be able to communicate with one another.

Hereinafter, the present invention will be described with reference to the accompanying drawings.

Referring to FIG. 1, the user 1 is at a home location for a teleportation conference. The user 1 looks forward to see the image on the screen 3 reflected by the beam splitter in the form of a two-way mirror 2. The bidirectional mirror 2 and the screen 3 are such that the reflected image is in front of the chair 7 and the background wall 101 with the reflected image superimposed in a three-dimensional set up behind the table 8 at position 4. It is arranged in a line to show. The chair and the table are used as a viewer's visible depth cue. The rear projection screen 3 has an image projected by the projector 10, reflected from the mirror 9. The camera 5 captures an image of the user 1 through the bidirectional mirror 2. In this and other embodiments (but not all embodiments), the camera looks directly at the participant along the field of view through the bidirectional mirror and the image 4. The user 1 is observed against a background wall 102 made of black or retroreflective material, which is a chroma key color. The user 1 can enter computer commands via the keyboard of the console 6 which also includes a standard monitor or touchscreen monitor.

In FIG. 2, the remote location user 21 is shown in a screen 23, which appears to be located in a three-dimensional setting which exists behind the table 28 and in front of the chair 27 and the background wall 104 at position 24. See through a two-way mirror 22 to see the reflected image. The image at position 24 is what the user 1 of FIG. 1 is seen by the camera 5. The user 21 can enter information and control computer functions at the console 26, which is linked by a network to the console 6 in the home position shown in FIG. 1. The camera 25 may capture an image through the bidirectional mirror 22 of the user 21 and transmit it to a home position to display the captured image on the screen 3 of FIG. 1. The table and chair are likewise used for visibility depth skew.

3 shows another user 12 in a home position that is shorter than the first user of FIG. 1.

FIG. 4 shows the same remote user as the user 21 shown in FIG. The position of the camera 25 is lower than the position of FIG. 2 to match the height of the camera 25 to the eye position of the short user 12 of FIG. 3. The output of the camera 25 is transmitted to the home position via the network so that the user 2 can see the reflected image at the position 4 at a viewing angle that matches his angle of view, so that the screen 3 of FIG. ) Is displayed.

FIG. 5 shows a user 11 sitting on a chair 20 capable of adjusting the height 120 so that the user's eye position exactly matches the position of the camera 17. In order to accurately match the eye level of the person, the output of the camera 17 is displayed on the monitor 15 to be shown as an image superimposed on the position 16. An alignment reference is displayed on the monitor 15 so that the user can easily set the correct height. The camera looks at the user 11, the chair 20, and the background 106. Since the chair 20 and the background 106 are black, which is a chromakey material or a retroreflective material, the final image may be transmitted as an image of only the user 11 facing the black background. The camera 17 also sees the reflected ceiling 107 but is not recorded as an image to the camera 17 because the ceiling is black. The user 11 looks forward to see the chair 19 and the background wall 105 with the superimposed image 16 of the remote person reflected by the two-way mirror 14 and displayed on the video display 15. A user can share information with a remote person via a computer 18 connected to the network.

FIG. 6 shows a user 13 positioned in front of a lecture desk with a video display 15 reflected on a two-way mirror 14 for representing a superimposed image 16 of a three-dimensional set using a lecture desk as a means of visibility depth skew. ). The camera 17 is hidden in a draped background 68.

7 illustrates a user of a home location system having a configuration for an autostereoscope teleconference conference. The user 31 looks straight through the bidirectional mirror 32 to see the retroreflective screen 34. The user 31 also sees the ceiling 39 reflected from the two-way mirror 32. However, the ceiling 39 is black so no superimposed image is added over the image displayed on the retroreflective material 34. Projection equipment 35 holds a pair of projectors with a projection path with a convergence that is offset by about 65 mm horizontal to approximate a user's typical interocular offset. Projection equipment 35 having two projectors is positioned to reflect off of the bidirectional mirror 32 and project onto the retroreflective screen. The light reflected from the retroreflective screen passes through the bidirectional mirror to focus on the right and left eyes of the user 31, respectively. Camera equipment 33 holds these two cameras so that their cameras offset approximately 65 mm to capture stereoscopic pairs of images. The cameras face the bidirectional mirror at an angle to capture the stereoscopic image of the user 31.

The user 31 wears the head tracking device 36 which is used to provide the coordinates of his eye position. The position of the projection equipment 35 is maintained by a translation stage 37 that moves the projection equipment 35 to a position that matches the relative position of the user 31's eyes. Instead of tracking a user's eye position, a stationary camera is used to view the human operating area and analyze the image using a computer to determine the exact position of the eye relative to the position of the pair of projectors at both positions. Method can be used.

8 illustrates a remote user for an autostereoscopic teleconference conference. The user 41 looks through the two-way mirror to see the retroreflective screen 44. Projection equipment 45 is provided with two projectors for projecting the image captured by the camera equipment 33 of FIG. The camera equipment 43 is arranged to capture an image of the user 41 whose field of view is reflected by the bidirectional mirror 42. The image captured by the two cameras in the camera equipment 43 is transferred to the home position shown in FIG. 7 and provided in the camera equipment 35 so that the user 31 can see the stereoscopic image on the retroreflective screen 34. Projected by a pair of projectors. Here, it should be noted that in the embodiments of FIGS. 7 and 8, the camera 33, 43 sees the participant along the line of sight indirectly passing through the two-way mirror so that the participant's eyes can be effectively seen through the image 34. do.

FIG. 9 shows the user 31 in a home position who bends to see a shorter near field when an image transmitted from a remote location is displayed on the retroreflective screen 34. The head tracking device 36 determines the eye position coordinates of the user 31. Accordingly, the conversion stage 37 moves the projection equipment 35 closer to match the relative distance and the viewing angle of the user 31.

10 is a remote location where the conversion stage 48 moves the camera equipment 43 to a closer position to match the relative eye position of the home position user 31 detected by the head tracking device in the home position shown in FIG. Shows.

Fig. 11 shows a configuration of a system for conducting a teleconference meeting with an audience at a theater-type remote site. The audience 69 looks at the bidirectional mirror 65 to see the stage 64 and the backdrop 68 through the viewing area in front of the stage 64. Projector 66 projects an image onto mirror 67 upon reflection so that it is displayed on screen 63. The audience sees a reflection image of the screen 63 that appears superimposed on the stage setting body at position 62 in the three-dimensional stage setting body. The camera 61 captures an image of the audience through the bidirectional mirror 65. Stage floor 64 is disposed rearward such that reflections from mirror 65 do not overlap any light over the image captured by camera 61. The second projector 130 projects onto the backdrop 68, providing an backdrop setting for superposition of the image of the person 62, as well as displaying an image that provides visible depth skew.

12 shows another configuration of a system in which the bidirectional mirror 65 is arranged at an angle so that the image on the screen 63 is reflected so that it appears superimposed onto the set on the stage 64 and at the front of the backdrop 68 at the position 62. To show. In this configuration, the second projector 131 is disposed higher than the mirror 65 to project the background image on the backdrop 68.

FIG. 13 shows the home position for a teleconference meeting with a user 51 standing on stage 55. The camera 53 is visible through a small hole in the screen 54 and has a line of sight that captures an image of the user's full body height. The user looks at the front with the same viewing angle as the camera 61 of FIG. 11 so that the user sees the audience displayed on the screen 54 in the same direction as the sight of the audience at a remote location.

14 shows an exhibition pulpit with a group of people 69 looking at the pulpit to see a user transmitted from a home position, superimposed with pulpits at position 62 behind lecture desk 64 and in front of backdrop 68. As a system. The camera 61 captures the scene of the group of people 69 seen through the bidirectional mirror 65.

FIG. 15 shows a plan view of an exhibition pulpit with a group of people in the field of view 70 seen by the camera 61.

FIG. 16 shows a top view of a home position with a user 51 looking at a monitor or screen 54 showing a field of view 71 at the same viewing angle 70 as the camera 61 of FIG. 15 at a remote location.

FIG. 17 shows a plan view of a remote location with an exhibition pulpit and a camera 61 which captures an image of a series of Sarahs 69 in the coverage of the set viewing angle 70. The second camera 71 covers a viewing angle 72 that captures images of more people 79.

FIG. 18 shows the user 51 in home position with the field of view 71 being displayed on the monitor or screen 54, coinciding with the field of view 70 of the remote camera 61 of FIG. 17. A second field of view 73 coinciding with the field of view 72 of the remote camera 71 of FIG. 17 is displayed on the monitor or screen 75.

FIG. 19 shows a plan view of a three-way teleconference meeting configuration where the user 1 can see an image of a user 81 at a remote location and an image of another remote user 82. In this configuration, users 81 and 82 may also look and communicate with each other.

20 shows a camera 83 for capturing an image of the user 1 at the correct angle for viewing of the user 81 and a camera 84 capturing the image with the user 1 at the correct viewing angle for the user 82. It shows a user 1 of a home position having a. The bidirectional mirror 91 is used to superimpose images of users 81 and 82 at locations 94 and 95, respectively.

FIG. 21 shows a camera 85 capturing an image of the user 81 at an exact angle for viewing of a remote user 82 and a camera capturing an image of the user 81 with the exact viewing angle of the user 1 in a home position. 86 and user 81 are shown. The bidirectional mirror 92 is used to superimpose images of users 1, 82 at locations 96, 97, respectively.

22 shows a camera 87 capturing an image of the user 82 with an accurate viewing angle for the user 81 and a camera 88 capturing an image of the user 82 with the correct angle for the user 1 in the home position. And user 82 are shown. The bidirectional mirror 93 is used to superimpose images of users 1, 81 at locations 98, 99, respectively.

FIG. 23 shows a view of the reflected screen 204 on the bidirectional mirror 203 to indicate that the remote user's image is presented on a plane labeled 209, i.e., in a three-dimensional setup behind the mirror 203. FIG. Show the user. Camera 206 views user 201 through image 209. The projector 205 projects an image of a remote user, that is, an image reflected on the mirror 211, to be displayed on the rear projection screen 204. The object 212 is on the plane of the parent image 209. Physical components, such as table tops, are arranged to provide a visual barrier that matches the bottom of the superimposed image.

FIG. 24 shows a user 301 wearing a pair of polarzing glasses or LCD shutter glasses 302. A pair of projectors 305 project the reflected images onto the mirror 311 to be displayed on the rear projection screen 304. The pair of images projected onto the screen 304 can be projected rapidly and successively in a plane that is polarized or alternating 90 degrees with respect to each other. The bidirectional mirror 303 reflects on the screen 304 so that the images appear in the plane 309. Images are superimposed on the plane 309 so that images appear three-dimensional due to a persistence of vision phenomenon. Since the observer is wearing polarized glass or LCD shutter glass as described above, the user will see a stereoscopic image that will appear to be in the plane of the reflected image 309 or in the front or back of the plane 309.

As described above, numerous features will be apparent, including the following.

The present invention utilizes a video presentation system that displays live images of some or all of a person's full-scale live image to provide a remote reality of a home location to a person at a remote location, while at the home location. It can be embodied in a batch that actually displays a live image of a person's full-scale transmitted from a remote location.

Two-way mirrors allow the user to view three-dimensional setups and superimposed video images of people.

The camera is placed in the line of sight of the person's superimposed image to ensure eye to eye contact.

There is a network connection between the home location and the remote location to transfer video images in both directions between the home location and the remote location.

In addition, audio equipment, lighting, background, and equipment, which are components for achieving eye-to-eye contact between people existing at two different locations, are related thereto.

The background of the remote person's video image is black, and the three-dimensional set-up visible through the bidirectional mirror is a superimposed image of the person in the three-dimensional set-up without any visible indications around the video display screen or monitor. Can shine brightly to appear as a live persion.

The height of the camera or the height of the person viewed by the camera may be adjusted to match the eye height of the person to the camera height of that height in order to achieve precise telereality for the remote.

Images of one or more people are displayed as live images of heads and shoulders in full size, or images superimposed behind the console and in front of the chair, such that the person is actually sitting on the chair, behind the lecture table and in front of the backdrop, It provides an impression of being present behind a workbench or counter and in front of the background wall.

In some cases, the complete whole body of one or more people is displayed as a full-size live image superimposed on the stage and in front of the backdrop.

If necessary, shutters or polarizing filters can be used on cameras and projectors to avoid or minimize the light projected by the camera by alternating the shutter.

The network connection may use a standard video conferencing protocol or Internet protocol for ISDN access, and may be accessed using the Internet.

As described above, numerous features will be apparent, including the following.

The present invention utilizes a video presentation system that displays live images of some or all of a person's full-scale live image to provide a remote reality of a home location to a person at a remote location, while at the home location. It can be embodied in a batch that actually displays a live image of a person's full-scale transmitted from a remote location.

Two-way mirrors allow the user to view three-dimensional setups and superimposed video images of people.

The camera is placed in the line of sight of the person's superimposed image to ensure eye to eye contact.

There is a network connection between the home location and the remote location to transfer video images in both directions between the home location and the remote location.

In addition, audio equipment, lighting, background, and equipment, which are components for achieving eye-to-eye contact between people existing at two different locations, are related thereto.

The background of the remote person's video image is black, and the three-dimensional set-up visible through the bidirectional mirror is a superimposed image of the person in the three-dimensional set-up without any visible indications around the video display screen or monitor. Can shine brightly to appear as a live persion.

The height of the camera or the height of the person viewed by the camera may be adjusted to match the eye height of the person to the camera height of that height in order to achieve precise telereality for the remote.

Images of one or more people are displayed as live images of heads and shoulders in full size or as images superimposed behind the console and in front of the chair, such that a person is actually sitting on a chair, behind a lecture table and in front of a backdrop, a table, It provides an impression of being present behind a workbench or counter and in front of the background wall.

In some cases, the complete whole body of one or more people is displayed as a full-size live image superimposed on the stage and in front of the backdrop.

If necessary, shutters or polarizing filters can be used on cameras and projectors to avoid or minimize the light projected by the camera by alternating the shutter.

Network connection may use a standard video conference protocol (Internet protocol) or Internet protocol (Internet protocol) for ISDN access, it can be connected using the Internet.

Claims (37)

A communication system for linking participants in two separate locations, Each comprising at least one real time image capture device, at least one image projection device, a viewing area occupied by the participant, and a bidirectional mirror in which the images are viewed; (a) arranged to view a participant occupying a home position viewing area either directly or indirectly along the line of sight passing through the two-way mirror, (b) first and second positions linked to the counterpart image projection device such that the captured image is transmitted from the home position to a remote position and projected at the remote position to be viewed through a corresponding bidirectional mirror; The remotely captured image of the remote participant is superimposed within the three-dimensional set-up provided by the visual depth cue means, including the visual depth cue means for viewing through the bi-directional mirror from the observation zone. And at least one location configured to link the participants of the two separate locations. The method of claim 1, And said set up body comprises one or more objects located on opposite sides of said bidirectional mirror with respect to said viewing zone. The method of claim 2, And said object is located in front and / or back of the position of said remotely captured image. The method of claim 2, Said setting body comprising a chair whose rear side is located behind a position of said remotely captured image. The method of claim 2, And said setting body comprises a desk, a table, a counter, a console, etc., located in front of the location of said remotely captured image. The method of claim 2, And said set up body comprises a lecture table positioned in front of the location of said remotely captured image. The method of claim 2, And said set up body comprises a stage. The method of claim 7, wherein And a participant in two separate locations, wherein an image of a substantially full height of the remote participant is projected to be viewed relative to the stage. The method of claim 8, Said image being located at an intermediate position between the front and rear ends of said stage. The method according to claim 7 or 8, And said stage includes a background located behind a location of said remotely captured image. The method according to any one of claims 1 to 10, The setting body includes a background located behind a location of the remotely captured image and means for generating an image on the background for viewing through the bidirectional mirror. Linked communication system. The method according to any one of claims 1 to 11, The remotely captured image is projected from the viewing zone to project the remote participant as an image of substantially full size, optionally substantially full height, from the viewing zone. Communication system to link them. The method according to any one of claims 1 to 12, And means for inspecting one or more objects constituting said depth cue means. The method according to any one of claims 1 to 13, And wherein the remotely captured image of the participant comprises a substantially invisible background when the participant views in a home position through the two-way mirror. The method according to any one of claims 1 to 14, And said two-way mirror links participants in two separate locations, wherein the mirror is inclined with respect to the gaze of the participant located in said viewing zone. The method of claim 15, And the two-way mirror links participants in two separate locations, wherein the mirror is inclined about a horizontal axis. The method of claim 16, And wherein said remotely captured image is incident on said two-way mirror from said two-way mirror bottom position. The method of claim 16, And wherein said remotely captured image is incident on said two-way mirror from said two-way mirror upper position. The method according to any one of claims 1 to 18, And a means for adjusting the participant and the means for adjusting the participant such that the eye level of the participant is substantially aligned with the line of sight of the image capturing device viewing the participant. The method according to any one of claims 1 to 19, And wherein the remotely captured image is configured to be displayed to produce a stereoscopic visual effect when viewed from a home position viewing zone. The method of claim 20, The remotely captured image allows viewing of a stereo participant of a remote participant when viewing from the home position using polarized glass, so that the image viewed from the home position using a viewer such as a shutter glass is synchronized with the alternate image display. Wherein the communication system links the participants of two distinct locations, characterized in that they are processed using polarizers to form image pairs having different polarization angles. The method of claim 20, Wherein the stereoscopic visual effect is generated alternately between remote participant images captured from different viewpoints. The method according to any one of claims 1 to 19, At least one of the locations comprises at least two image capture devices for viewing a participant at the location from different angles and at least two image projection devices linked to the remote image capture device. A communication system that links participants in separate locations. The method of claim 23, wherein And wherein the remotely captured image is configured to be displayed to produce stereoscopic effects when viewed from a home viewing zone. The method of claim 23 or 24, The remotely captured image is projected onto a retroreflective screen located opposite the two-way mirror to the viewing zone and is retroreflected in the viewing zone to view the participants in two separate locations. . The method according to any one of claims 1 to 25, Means for tracking the participant's eye position in the viewing zone and means for adjusting the image projector according to the tracked eye position. The method of claim 26, And said tracking means comprises headwear to be worn by the participant during use of the system. The method of claim 26, And said tracking means comprises camera means for observing the participant and means for analyzing the captured image to determine eye position. The method according to any one of claims 1 to 28, wherein Means for correlating participant behavior at a remote location with one or more objects in the home position three-dimensional setting to produce an impression of the interaction of the object with the image observed at the home position. A communication system that links participants in a location. A communication system for linking participants in two separate locations, A first location comprising at least one real time image capture device, and an area occupied by one or more participants, the image location being arranged to view the area; At least one image projection device linked to the image capture device at the first position, a viewing zone occupied by the corresponding one or more participants, a three-dimensional set up with visual depth cue means viewable from the viewing zone, And a second position including a bidirectional mirror means interposed between the viewing zone and the three-dimensional setting body, wherein the captured image is transmitted from the first position to the second position, and through the bidirectional mirror means. A communication system for linking the participants of two separate locations, wherein the two locations are configured to be projected at the second location so that the remote participants are viewed in superimposition with a three-dimensional configuration. The method of claim 30, And a participant in two distinct locations projected such that an image of a substantially full height of the remote participant is projected to be viewed in the three-dimensional set. The method of claim 31, wherein Said setting body comprising a stage and means for displaying additional images constituting a visual depth cue means. 33. The method according to any one of claims 30 to 32, 30. A communication system for linking participants in two separate locations, comprising the feature of any one of claims 2 to 29. The method according to any one of claims 1 to 33, A visual system-to-location link between locations comprises a computer link between locations, wherein the participants link two separate locations. The method according to any one of claims 1 to 34, wherein In addition to said first and second locations, at least one additional location arranged to enable an individual at each location to communicate at least visually with at least one location, preferably an individual at the other party's location. A communication system that links participants in two separate locations. A viewing device for a communication system according to any one of claims 1 to 33, At least one image projection device linkable to an image capture device at a remote location, a viewing zone occupied by one or more participants, a three-dimensional set up with visual depth skew means viewable from the viewing zone, and the viewing zone and And a two-way mirror means interposed between the three-dimensional setting bodies, wherein the captured image transmitted from the remote position to the image projection apparatus is superimposed with the three-dimensional setting bodies through the two-way mirror means for viewing by the remote participants. Viewing device, characterized in that configured to be projected as possible. Novel features or combinations of features according to claims 1 to 36.