JP2010504709A - Three-dimensional display and telepresentation system and method - Google Patents

Three-dimensional display and telepresentation system and method Download PDF

Info

Publication number
JP2010504709A
JP2010504709A JP2009529416A JP2009529416A JP2010504709A JP 2010504709 A JP2010504709 A JP 2010504709A JP 2009529416 A JP2009529416 A JP 2009529416A JP 2009529416 A JP2009529416 A JP 2009529416A JP 2010504709 A JP2010504709 A JP 2010504709A
Authority
JP
Japan
Prior art keywords
camera
image
display device
telepresence
way mirror
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
JP2009529416A
Other languages
Japanese (ja)
Inventor
ピーター マクダフィー ホワイト
Original Assignee
ピーター マクダフィー ホワイト
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US84641506P priority Critical
Priority to US85506506P priority
Priority to US96844707P priority
Application filed by ピーター マクダフィー ホワイト filed Critical ピーター マクダフィー ホワイト
Priority to PCT/US2007/079207 priority patent/WO2008036931A2/en
Publication of JP2010504709A publication Critical patent/JP2010504709A/en
Application status is Pending legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/14Systems for two-way working
    • H04N7/141Systems for two-way working between two video terminals, e.g. videophone
    • H04N7/142Constructional details of the terminal equipment, e.g. arrangements of the camera and the display
    • H04N7/144Constructional details of the terminal equipment, e.g. arrangements of the camera and the display camera and display on the same optical axis, e.g. optically multiplexing the camera and display for eye to eye contact

Abstract

  A telepresence system improves recognition of the presence of a person at a remote location involved in a video conference. The system preferably has a two-way mirror (2), which is located between the observer (3) and the display device (17) at an angle reflecting the background surface (8). The background surface (8) is farther away from the two-way mirror (2) than the screen of the image display device (17), and appears to be superimposed on a position behind the person image from a remote place. The system desirably images via an optical path for a viewing direction (160, 161, 162) that is substantially longer than the physical distance (159) between the user (3) and the camera (1). Minimize distortion. The system can be asymmetric, where one camera is on-axis with the user's viewing direction (182), while the other camera is on-axis with the user's viewing direction (182).

Description

  This application includes US patent application Ser. No. 60 / 846,415 filed Sep. 22, 2006, US Provisional Patent Application No. 60 / 855,065 filed Oct. 27, 2006, and 2007. Claiming priority of US Provisional Patent Application No. 60 / 968,447, filed Aug. 28, 1998, and by reference, these applications are incorporated herein.

  The present invention relates to video conferencing equipment, and more particularly to a system and method for improving or achieving “telepresence” for recognizing the presence of a person from a remote location.

The above features of the present invention may be more clearly understood by considering the following description in conjunction with the accompanying drawings.
FIG. 1 illustrates a prior art device for an eye contact device having a display device behind a two-way mirror and a camera in front of the two-way mirror. FIG. 2 illustrates a conventional configuration of an eye contact device having a display device reflected on the two-way mirror 2 and a camera behind the two-way mirror. FIG. 3 illustrates the configuration of a person raising his hand to the camera field of view in an eye contact configuration having a display device behind the two-way mirror and a camera in front of the two-way mirror installed on the desktop. FIG. 4 illustrates the configuration of a person raising his hand to the camera view in an eye contact device having a display device reflected to the two-way mirror and a camera behind the two-way mirror placed on the desktop. FIG. 5 illustrates a user of the eye contact device of FIG. 3 or 4 with distortion resulting from a near wide field of view camera view. FIG. 6 illustrates a user of an eye contact device viewed from a camera at a desired distance. FIG. 7 illustrates a user positioned at a desired distance from the eye contact device. FIG. 8 illustrates a user in an embodiment of the present invention with a camera at the desired distance achieved through two reflective arrangements. FIG. 9 illustrates the course of the camera field of view for the configuration described in FIG. FIG. 10 illustrates the camera angle of view by the camera field of view for capturing the user and the installation of a computer keyboard and monitor on the desktop. FIG. 11 illustrates the black panel at the top of the two-way mirror and the position of the black background behind the user. FIG. 12 illustrates lighting installed so that the user can be desirably illuminated. FIG. 13 illustrates a plan view of a preferred embodiment of the present invention. FIG. 14 illustrates a plan view of a preferred embodiment of the present invention with a support structure. FIG. 15 illustrates a plan view of a preferred embodiment of the present invention illustrating the location of illumination. FIG. 16 illustrates an arrangement of workstations with desk devices arranged horizontally. FIG. 17 illustrates one arrangement of workstations having a background panel and the rear of alternating workstations arranged horizontally. FIG. 18 illustrates an arrangement of trapezoidal workstations aligned in a circle. FIG. 19 illustrates an arrangement of trapezoidal workstations arranged to draw a curve. FIG. 20 illustrates a telepresence workstation connected to a telepresence conferencing system via a telecommunication network. FIG. 21 illustrates a telepresence workstation with a codec and a computer connected by a computer and a codec via the Internet leading to a telepresence system. FIG. 22 illustrates a telepresence center with multiple telepresence workstations connected to multiple locations by a telepresence communications system. FIG. 23 is an illustration of an embodiment of the present invention with an asymmetric telepresence communication arrangement, an on-axis communication system, an on-axis camera for eye contact to capture images, and off-axis There are eye contact alignments and network connections for open communication systems, and cameras that are not obscured by two-way mirrors to capture off-axis user images for two-way communication. FIG. 24 illustrates an embodiment of the present invention in which there is a recipient who recognizes and sees the eye contact, the camera being non-axial to the eye contact and installed in front of the two-way mirror and image display device. Yes. FIG. 25 illustrates an embodiment of the present invention in which there is a recipient who recognizes and sees the eye contact, the camera being off-axis with respect to the eye contact and the gap between the two-way mirror and the image display device. See through. FIG. 26 illustrates an embodiment of the present invention with a recipient who recognizes and sees eye contact, with the image display device behind the two-way mirror, the camera at the top of the two-way mirror, and the background as the image display. Reflect to appear behind the image on the device. FIG. 27 illustrates an embodiment of the present invention with a recipient who recognizes and sees eye contact, with the image display device behind the two-way mirror, the camera under the two-way mirror, and the background as the image display. Reflected to appear behind the image on the device. FIG. 28 illustrates an embodiment of the present invention configured as a podium with a camera in front of a two-way mirror and an image display device. FIG. 29 illustrates an embodiment of the present invention configured as a podium with a camera installed in front of a two-way mirror and installed on the side of the monitor. FIG. 30 illustrates an embodiment of the present invention configured as a podium installed on a platform with a camera located inside such as a podium reflected in a two-way mirror. FIG. 31 is an illustration of an embodiment of the present invention configured such that the appearance of a person image from head to toe appears in a three-dimensional setting by a camera installed between a large two-way mirror and an overhead rear projection screen. It is. FIG. 32 is an illustration of an embodiment of the present invention configured to present a person's head-to-toe image with a camera placed on top of a two-way mirror and an underlying front projection screen. FIG. 33 illustrates an embodiment of the present invention configured as a service counter with a camera installed between a two-way mirror and an overhead display device. FIG. 34 illustrates the embodiment of the present invention in FIG. 33 with a two-way mirror rotated upwards so that a person can work at the service counter. FIG. 35 illustrates an embodiment of the present invention configured as a service counter with a camera between a two-way mirror and an image display device installed below. FIG. 36 shows the implementation of the present invention configured as a service counter with an image display device and keyboard, data monitor installed at the bottom, and a camera installed at the top of the two-way mirror for user interaction. An example is illustrated. FIG. 37 illustrates an embodiment of the present invention installed on top of a retail shelf with cameras installed between a two-way mirror and an overhead image display device. FIG. 38 illustrates an embodiment of the present invention installed on top of an intercom computer based on a kiosk with a camera installed between a two-way mirror and an overhead display device. FIG. 39 illustrates an embodiment of the present invention configured as a desk with a camera installed between a two-way mirror and an overhead image display device. FIG. 40 illustrates an embodiment of the present invention configured as a desk with a camera and a lower image display device installed around a two-way mirror. FIG. 41 is an illustration of an embodiment of the invention comprising a desk with a camera installed on top of a two-way mirror and an image display device with a background reflected at a position behind the image display device. FIG. 42 illustrates an implementation of the invention configured as a desk with a small camera on top of a two-way mirror, a reflected background to appear behind the image display device, and a small image display device behind the two-way mirror. An example is illustrated. FIG. 43 shows an embodiment of the present invention configured as a conference table system with an image display device placed behind, a reflected background to appear behind the image display device, and a camera located above the two-way mirror. Examples are illustrated. FIG. 44 illustrates an embodiment of the present invention including a retail shelf with an image display device in the back, a reflected background to appear behind the image display device, and a camera installed on top of the two-way mirror. Illustrate. FIG. 45 shows an embodiment of a computer-based kiosk of the present invention with a rear image display device, a reflected background to appear behind the image display device, and a camera installed on top of a two-way mirror. Illustrate. FIG. 46 illustrates an embodiment of the present invention incorporating ATM with a rear image display device, a reflected background to appear behind the image display device, and a camera on top of the two-way mirror. FIG. 47 shows an ATM having a rear image display device, a background curved to match the two-way mirror to an angle at which the reflection of the background behind the image display device appears, and a camera above the two-way mirror. Examples of incorporated embodiments of the invention are illustrated. FIG. 48 illustrates a large embodiment of the present invention with an image of a front projection screen, a reflected background as it appears behind the screen, and a camera placed on top of a two-way mirror. FIG. 49 illustrates a large embodiment of the present invention with a rear rear projection screen, a reflected background to appear behind the screen, and a camera located on top of the two-way mirror. FIG. 50 illustrates a large embodiment of the present invention with a rear front projection screen, a reflected background as it appears behind the screen, and a camera located on top of the two-way mirror. FIG. 51 illustrates a large embodiment of the present invention with a rear projection screen, a reflected background as it appears behind the screen, and a camera located on top of the two-way mirror. FIG. 52 illustrates an embodiment of the present invention as a kiosk or customer service counter with a surface at the height of the ceiling that reflects to the back wall surface. FIG. 53 illustrates a front view of the embodiment in FIG. FIG. 54 is an illustration of an embodiment of the present invention in a room with a background at the level of the floor so that it appears reflected off the surface of the rear wall. FIG. 55 illustrates the embodiment of FIG. 54 viewed from above.

Detailed Description of Exemplary Embodiments

  The conventional configuration realized eye contact. The prior art of FIG. 1 illustrates a two-way mirror 2 positioned between a user 3 and an image display device 17. The two-way mirror is angled to reflect the image of the user 3 toward the camera 1. The camera 1 images the user 3 with a wide field of view 45. A bi-directional mirror is generally a partially silvered transparent substrate, which can be glass, plastic, mylar or other transparent material. A bi-directional mirror can be a laminated glass panel where one surface is semi-reflective and the other surface is not reflective. Bidirectional mirrors can also be referred to as unidirectional mirrors or beam splitters. The line of sight of the camera 1 is positioned to coincide with the visual field direction between the user 3 and the eye height of the human image displayed on the image display device 17 and is simulated between the two parties. Generated eye contact.

  The prior art of FIG. 2 shows an example in which the two-way mirror 2 is angled so as to reflect the image display device 17 like a monitor or a screen. The reflected image 5 appears behind the two-way mirror. The camera 1 images the user 3 with a wide field of view 45.

  FIG. 3 shows an eye contact configuration in which user 3 is sitting in close proximity to the configuration. The camera 1 images the user 3 with a wide field of view 45. User 3 raises hand 156, which is in the field of view of camera 1. Since the mirror 42 is positioned between the two-way mirror 2 and the camera 1, the image is not inverted and the camera is in the horizontal direction. The camera 1 is lifted on the support structure 155 and the eye contact configuration is placed on the table 33.

  FIG. 4 shows an eye contact configuration in which the monitor 17 is positioned below the two-way mirror 2. The two-way mirror 2 reflects the image of what is displayed on the monitor 17 and appears to the user 3 as being on the back surface 5 of the two-way mirror 2. The eye contact terminal is lifted to approximately the eye level by the support structure 155 installed on the desktop 33. The camera 1 images the user 3 while the hand 156 is lifted into the wide field of view 45.

  FIG. 5 shows a user 3 having a hand 156 within a wide field of view produced by the camera of either the eye contact device of FIG. 3 or the eye contact terminal of FIG. Since the hand is closer to the camera than the user's body, the hand is distorted to be larger than the user's head. This distortion of the user display can confuse viewers who receive telepresence communications. In addition, portrait photography or video generation is well known to place a person at a reasonable distance from the camera. A wide-angle field of view distorts the person, for example, exaggerating the size of the person's nose.

  FIG. 6 shows an image of the user 3 projected by the camera at a desired distance from the camera. This image shows that the extended hand 156 is not too large compared to the rest of the body. Furthermore, facial features are not distorted by the preferred field of view distance. In this field of view, the camera was approximately 8 feet from the person.

  FIG. 7 shows the eye contact terminal of FIG. 4 with the camera 1 placed at a desired distance 157 from the user 3. This figure is drawn at a distance 157 of 8 feet. This distance can be somewhat larger or smaller with different results. The resulting field of view 45 does not distort the image of user 3 as shown in FIG. This configuration shows a long table 33 that spans the distance between the camera 1 and the user 3 in the eye contact terminal. The total distance 158 between the user 3 and the back of the eye contact terminal structure 155 is very long. This configuration is too long and therefore not practical for most applications. Furthermore, since the user 3 is away from the eye contact terminal, the image 5 will be too small to be seen clearly. As a result, the configuration of the eye contact terminal is insufficient.

  FIG. 8 shows an embodiment of the present invention in which the user 3 looks at the image display device 17 at eye level. The camera 1 captures an image of the user 3 by reflection of the remote mirror 42 and the two-way mirror 2. Without two reflections, the position of the camera would be required to be at position 200. The distance between the clear position of the camera 200 and the user 3 is indicated by the distance 157, which in this example is 8 feet. The actual distance can vary, but this distance of 8 feet achieves the desired viewing angle 45. In this example, the distance between the user 3 and the back of the image display device 17 is a distance 159 of 4 feet, which is half of the distance 157 of the camera field of view, which is not sufficient as illustrated in FIG. Less than half the depth of the eye contact configuration.

  FIG. 9 shows the viewing direction at the eye level between the user 3 and the camera 1. In this configuration, segment 160 is approximately 30 "(inch). Segment 161 is approximately 48" (inch) and segment 162 is approximately 18 "(inch). The total distance of all three segments is Approximately 96 "(inch) or 8 feet. The physical horizontal distance 159 between the user 3 and the back of the image display device 17 is about 4 feet. It is also the same as the physical horizontal distance 159 between the user 3 and the back of the camera 1. However, by using two reflections, ie two reflections of the two-way mirror 2 and the small mirror 42, the optical distance of twice the length (or more) or the distance in the viewing direction is the same. It can be realized within the physical distance 159. Although it is known to use two reflections in the direction of the camera's field of view, an understanding of mirror position and angle is not known to compensate for distortion. The inventor is the first person to understand a unique and desirable configuration in which the undesired distortion is reduced or eliminated by creating an asymmetric configuration, which is the optical configuration between the user 3 and the display 17. The target distance is clearly different from the optical distance between the user 3 and the camera 1, even if the physical distance is the same or similar.

  The angle of the two-way mirror 2 can be in the range of 45 degrees to 50 degrees, but is not limited to this range of angles. The angle of the illustrated two-way mirror 2 is 48 degrees. By setting the two-way mirror 2 to an angle of 48 degrees, the image path 161 is angled in a direction away from the position of the camera 1, and becomes a longer image path 162. The back of the camera 1 is vertically aligned with the back of the image display device 17 to achieve the longest camera field of view while maintaining the most compact profile of the telepresence workstation. In order to achieve a horizontal line between the small mirror 42 and the camera 1, the small mirror 42 should be parallel to the angle of the two-way mirror 2. In this example, the small mirror 42 is 48 degrees from the horizontal. However, those skilled in the art will recognize that either or both of the mirrors can be tilted to other angles and the position of the camera 1 can be adjusted accordingly.

  FIG. 10 illustrates an optimal viewing angle 45 for capturing a user image on a 16 × 9 aspect ratio 50 ″ (inch) screen, such as a 50 ″ (inch) plasma display. The camera image is transmitted to another telepresence system at the receiving location. What is desired at the receiving location is that the person image is displayed on the telepresence system with a life size. Therefore, the camera 1 must capture the image of the user 3 with an accurate size. In this example, line 201 provides a reference for the height of the image at the position of user 3. For purposes of this example, the reference line 201 is 20.5 "(inch) high 163, which is a 50" (inch) plasma monitor typically used in a telepresentation system at the receiving location. Average height.

  FIG. 10 also shows the position of the data sharing display monitor 69 to be viewed by the user 3. This monitor 69 is positioned below the camera field 45 reflected by the two-way mirror and in front of the camera field reflected by the small mirror 42. A keyboard 94 is placed on the telepresence workstation desktop 164. Panel 165 is placed on the back of desktop 164. The panel 165 protects the mirror 42 and prevents unnecessary light from entering the field of view of the camera 1.

  FIG. 11 shows the panel 16 on the two-way mirror 2. The bottom of this panel 16 absorbs light like a matt black surface. An extended camera field 168 extending to the bottom of the panel 16 passes through the two-way mirror 2. Since the surface 16 of this panel does not reflect or emit light, only the light seen by the camera is reflected by the two-way mirror 2. It is important to note that the image display device 17 is not on the line of the stretched camera field of view 168 and therefore needs to be positioned at a distance behind the two-way mirror 2.

  FIG. 11 also shows the light absorbing panel 127 behind the user 3. The panel 127 covers the entire height of the viewing angle 45 of the camera 1. This black panel 127 is a particularly useful component because the telepresence workstation can display the depth relationship between the telepresence person's image and the physical background at the receiving location. When it is used for communication with. Since the received image has a black background, there will be no light displayed outside the telepresence person image. As a result, a person is viewed in a three-dimensional relationship in front of the reflected background, as shown in US Pat. No. 7,057,637 by White. The above US patents are hereby incorporated by reference.

  FIG. 12 shows a cross-sectional view of a illuminated telepresence workstation. The overhead light 129 illuminates the head and shoulders of the user 3. The illumination range angle 130 must be limited to cover only the area of the user 3. In particular, the overhead light 129 should not illuminate the black background surface 127. Also, the light should not shine on the monitor 69 or should shine in the area of the camera 1. The front light 131 is positioned so as to illuminate the front surface of the user 3. This light 131 is particularly effective for brightening the camera field of view and illuminating the user 3. The front light can also be positioned on the side to minimize direct light shining on the user 3 eyes.

  FIG. 13 is a plan view of an embodiment of the present invention. The horizontal angle of view 67 is the basis of the telepresence workstation form and structure. The viewing angle 67 begins at point 200, which is determined by the desired optical distance to the camera in the path of the device with the two mirrors, as illustrated in FIG. The angle 67 is determined according to the width of the image plane 166 in the middle of the position of the user 3. The width of the image plane 166 is based on the width of the 16 × 9 aspect ratio of the 50 ″ (inch) plasma monitor in this example. In order to capture a life-size image of the user 3, the camera field of view is received. The other configuration is determined according to the other size and configuration of the monitor through iterative implementation.

  Also, in FIG. 13, the image display device 17 is embodied in a width that approximately fits within the angle 67. In this example, a width of a 23 ″ (inch) LCD monitor with a 16 × 9 aspect ratio is utilized for the size of the image display device 17. The two-way mirror 2 has a trapezoidal shape with sides that fit within a vertical plane at an angle 67. The two-way mirror 2 is preferably wider than the range of the angle 67, giving some margin to the camera range.

  Telepresence workstation desktop 164 is preferably trapezoidal with sides that fit within a vertical plane at angle 67. The side of the desktop extends beyond angle 67 to give some margin to the camera range. The black background panel 127 is set slightly larger than the width of the angle 67 so that the angle 67 reaches the background surface 127. Although trapezoidal shapes are very effective for compactness, all kinds of shapes and configurations are within the intended scope of the present invention, including square, rectangular and curved shapes.

  FIG. 14 shows support structure panels 169 on both sides of the telepresence workstation. These side panels provide side enclosures to prevent unwanted light from reaching the camera in the workstation. The side panel supports the two-way mirror 2. Telepresence workstation desktop 164 is attached to side panel 169. The keyboard 94 can be placed on the desktop 164. The back panel 170 is positioned behind the image display device 17. The back panel 170 is removable so that the image display device 17 can be accessed for service. Also, the lower portion of the back panel 170 is removable to allow access to the camera, codec, computer and other devices. The black background surface 127 is attached to the support structure 173. The support structure 173 can be suspended from the ceiling or supported from the floor. In some configurations, the support structure 173 can be in the form of a sliding door or a hinged panel.

  FIG. 15 shows a plan view of the illumination of the telepresence workstation. One, two, or more lights 129 can be positioned over the user 3 head. This overhead light can be an elongated illumination such as a fluorescent lamp. The light 129 can be attached to the support structure 173. These overhead lights 129 should cover the entire width of the image area 166 to ensure that the user 3 is illuminated from above. Overhead lighting is particularly important when the user 3 is black hair. Highlights can help make black hair stand out from the black background captured by the camera. The overhead light 129 is also important to give a bright border to the user's shoulder, especially when the user is wearing a black coat or shirt. Side sidelights 171 may be installed to illuminate across the width of the workstation to illuminate the inside of the side panel 169. The sidelight 171 is controlled to an angle 172 that does not directly irradiate the eyes of the user 3. Furthermore, the sidelight 171 needs to be controlled so that the light is not directly applied to the two-way mirror 2 or the camera, because unnecessary light can be guided into the camera field of view. Alternatively, the light 171 can be integrated in the depth direction of the side panel 169 having a diffusion surface that produces a large illumination surface, in order to illuminate the user 3 with soft light.

  FIG. 16 shows the arrangement of the entire workstation 174 when the workstations are installed in a line. In this arrangement, the back 170 of one workstation is aligned with the front of the desktop 164 of the other workstation. Adjacent workstations 174 are turned over in a vertical orientation and the trapezoidal diagonal sides are aligned to create a linear row. The background structure 173 forms rows having small gaps between them. If this gap is not wide enough for the user to pass through, it must be made to slide sideways or rotate outward to allow access.

  FIG. 17 shows another arrangement of the entire workstation 174. In this arrangement, the back panel 170 is aligned with the background structure 173. This creates a workspace that is surrounded. Access to the workspace is achieved by rotating the background panel 173 outward or sliding it to the side.

  FIG. 18 is an array of trapezoidal workstations 174 with sides that fit adjacent workstations. The result is an arrangement that can form a complete circle.

  FIG. 19 is an arrangement of trapezoidal workstations 174 with sides adapted to form a curved (curved) array.

  FIG. 20 illustrates the configuration of a telepresence network solution that includes a telepresence workstation 174 connected to a network 144 by a cable 136 in an embodiment of the present invention. Telepresence system 133 is at the receiving location, which is connected to network 144 by cable 137. It should be noted that telepresence is not practical in a stand-alone system. Telepresence is practical when two or more systems are connected through a network that meets certain requirements. Therefore, it is advantageous for the present invention to include the specific techniques necessary to complete telepresence communication. For purposes of discussion, an embodiment of the present invention is referred to as a “telepresence technology configuration”.

  Network 144 may be an IP network for transferring data with Internet protocols, such as the Internet, Internet 2, LAN, WAN, MAN, VPN, ATM or other networks. When transferred over an IP network, the codecs 40 and 152 are H.264. The transfer of music or video is encoded or decoded using the H.323 protocol or other IP protocols.

  Computer 154 at telepresence workstation 174 can be connected to display monitor 153. The cable 139 is connected between the codec 152 and the display monitor 153. The codec 152 can receive signals sent to the display monitor through an internal hardware solution or an external data solution box. The codec 152 processes the signal to the display monitor and transfers the signal as part of the output through the network connection 136.

  The codec 40 for the receiving communication system 133 receives a signal transmitted by the network connection 137. The signal is decoded by the codec 40 and sent to the display monitor via the cable 135. In this way, the output of the computer 154 in the transmitting communication system 174 appears on both the display monitor 153 and the display monitor 69 of the receiving communication system. Viewers 3 and 70 at the receiving location see the output of the computer 154 displayed on their previous image display device 69 as the visible content is controlled by the presenter 128 at the transmitting location.

  The captured visual presentation is received through the network 144 and decoded by the codec 40, so there is no need for a computer at the receiving location. However, in this configuration, viewers 70 and 3 have no means to interact with the visual display content and do not have the ability to send the visual content back to presenter 128.

  FIG. 21 shows another telepresence technologies configuration having a workstation 174 connected to the receiving communication system 133 by an IP network 145. The IP network can be any network operating with an Internet protocol such as LAN, WAN, MAN, VPN, Internet 2, Internet or other IP networks. In this configuration, the codec 152 at the workstation 174 is connected to the input box 147 by a cable 148 such as a CAT5 cable. The input box 147 is connected to the IP network 145 by a network connection 146, such as a T1 line, DSL, ADSL, VDSL, SDSL and other network transmission services. The codec 40 at the location of the receiving communication system 133 is connected to the network 145 by a cable 141 and a network service 144 to the binding box 143. Codecs 40 and 152 can establish two-way communication over network 145.

  The computer 154 in the transmission communication system 174 can have a network connection 149 that leads to the binding box 147 for accessing the network 145 through the network service 146. The computer 120 in the receiving communication system 133 can have a network 142 connected to a network 145, a network service 144, and a binding box 143. The two computers 120 and 154 can establish a connection on the network 145 and can share data via a software application such as Microsoft NetMeeting or other data sharing software. The advantage of this configuration is that both the sending location and the receiving location can interact with visual display material for efficient cooperation. An advantage of this configuration is also that the codecs 40 and 152 do not need to process visual display material, and therefore their power and bandwidth can be dedicated to the quality of audio and video transmission.

  FIG. 22 illustrates a telepresence technologies architecture that embodies a custom network architecture and innovative device functionality. This telepresence technologies architecture has two locations 133 and 174 connected to a telepresence operations center 150, which is specific to the requirement to realize telepresence through an embodiment of the present invention. is there. Instead of a direct connection between the two locations 133 and 174, each location may establish a connection to the telepresence operation center. A telepresence operation center is unique in receiving and transmitting life-size human images with alignment for eye contact. Unlike typical network architectures that use voice or data hubs, Telepresence Technologies architectures can standardize or standardize a format that creates 3D quality enabled through life-size communications with a reflected background. I will. In addition, the telepresence technologies architecture will be designed to synchronize supporting visuals with telepresence communications that digitize people life-size.

  Through the telepresence technologies architecture, each telepresence location will have a permanent IP connection to connect to the telepresence operations center. This IP connection can automatically return to low bandwidth when the telepresence system is not utilized for communication. Because no directory or dialing functionality is required, the codec at each location is much cheaper and simpler than the standard video conferencing codec. When the power to the codec is turned on, the codec can be wired to automatically connect to the telepresence operation center. Telepresence Technologies architecture allows users to access a directory in the Telepresence Operations Center, which lists telepresence locations and new telepresence communications in use Or provide up-to-date status such as whether it was available or not. Through the telepresence technologies architecture, all connections between telepresence users are connected and operated via a telepresence operation system.

  FIG. 23 shows an asymmetric arrangement, which has a viewing direction 204 away from the axis for camera 1 at customer location 205, while a camera at presenter location 174 has a viewing direction 182 on the axis. Have. Although customer location 202 has a field of view 203 away from the axis, customer 3 sees the image of the presenter appearing to have the correct alignment for eye contact. The customer's eyes are aligned to the height of the viewing direction 182 to achieve eye contact recognition, and the customer 3 input image is displayed on the image display device 174 at the presenter 174 location. Recognition is realized. Even if the camera at customer location 202 is not on-axis, the camera's field of view 203 captures an image of customer 3 with the eye at the same height on the image.

  As an example, the eyes of the presenter 176 can be at two-thirds the height of the presenter's image. Similarly, even if the camera 1 is non-axis imaged from a position somewhat higher than the standard line in the viewing direction 182, the eye of the customer 3 is 2/3 of the height of the customer image. Can be in position.

  With this asymmetric communication solution, customers gain the added value of eye contact. Customers can feel a personal relationship with the presenter through eye contact, thereby gaining a great sense of trust and close presence. Even if the presenter does not have the same direct viewing direction for eye contact, the presenter still has the front view of the customer to read the response to marketing communications. Presenters can sell products and services with the primary goal of achieving business goals, which do not require the same eye contact to achieve those goals.

  In order to obtain proper results, the eye contact configuration at presenter 174 must meet certain requirements. These requirements are illustrated in White, “Telepresence Workstation and Telepresence Center” in US patent application Ser. No. 60 / 846,415. One requirement is that the camera 1 does not get too close to the presenter 176. It is not desirable to bring the camera too close to the presenter, which causes wide-angle distortion. This problem is solved by placing the camera 1 close to the floor and imaging the front direction 177 in front of the mirror 42. The mirror 42 reflects the upward viewing direction 45 toward the two-way mirror 2, which is reflected forward along the viewing direction 182. The viewing direction 182 is aligned with the eye contact between the presenter 176 and the customer 3 image displayed on the image display device 17. The black panel 16 is positioned on the two-way mirror 2 so as to block the camera field of view through the two-way mirror 2. In this arrangement, the image display device 17 is relatively close to the presenter 176, but does not require a very large area for the workstation, so that the image coming from the customer location 202 is a clear image. .

  FIG. 24 shows an embodiment of the invention having both the image display device 17 and the camera 1 in front of the two-way mirror 2. In this configuration, the camera 1 has an unobstructed viewing angle 45 of the user 3. User 3 has a viewing direction 182 that realizes an eye contact recognized as a telepresence person appearing in reflected image 5. This eye contact is aligned with the viewing direction 185 reflected by the image display device 17. Camera 1 is seen as a reflection at position 179 in front of the reflected image 5.

  FIG. 25 shows an embodiment of the present invention having a camera 1 installed between the image display device 17 and the two-way mirror 2. The camera is positioned rearward with a sufficient distance so that it does not block the reflected field of view 5 of the image display device 17. Furthermore, the camera 1 is installed so as to have a viewing angle 45 that does not interfere with the user 3. The user has an eye contact recognized as a telepresence person displayed on the image display device by having a viewing direction 182, the viewing direction 182 of the two-way mirror 2 along the reflected viewing direction 185. This corresponds to the eye level of the telepresence person seen as reflection 5 away from.

  FIG. 26 shows an embodiment of the invention having a camera 1 placed between a two-way mirror 2 having an unobstructed viewing angle 45 of the user 3 and the background 8. User 3 has a recognized eye contact with the telepresenting person projected on the image display device according to the viewing direction 182, and the viewing direction 182 is aligned with the telepresence person's view projected on the image display device 17. Is done. The telepresence person can appear in front of the reflection 9 of the background 8, which can give a sense of depth between the telepresence person's image and the reflected background. The principle of reflected background is described in “Reflected Background for Communications Systems” in US Pat. No. 7,057,637 by White.

  FIG. 27 shows an embodiment of the present invention having the same configuration as that of FIG. 26 except that the camera is positioned under the two-way mirror 2 and the image display device 17 and inverted in the vertical direction.

  FIG. 28 shows the present invention configured as a podium having both the camera 1 and the image display device 17 installed in front of the two-way mirror 2. The camera 1 has an unobstructed field of view 45 of the customer 3. Customer 3 has perceived eye contact along the viewing direction 182 to image 5, which is the image on the image display device 17 reflected by the two-way mirror 2. The bi-directional mirror 2 is angled approximately 45 degrees forward, and the image display device can be approximately horizontal to produce a reflection that is vertical. However, the image display device 17 can be angled to lift the front edge, minimizing the direct viewing of the image area by the customer 3. If the image display is tilted at a certain angle, the two-way mirror needs to be tilted at half of the certain angle because the reflected image 5 is in a vertical position. As an example, the configuration of FIG. 28 shows the image display device 17 tilted at 10 degrees and the two-way mirror 2 tilted at an additional 5 degrees from 45 degrees, resulting in a tilt of 50 degrees.

  The camera 1 is in front of the two-way mirror 2 and can therefore be viewed as a reflector of the two-way mirror. In FIG. 28, the camera 1 is housed inside an enclosure or seal 180, which is in the field of view of the customer 3 as a reflection 181. The enclosure 180 can be designed to be an integral part of the podium 184 and can include a banner with a company logo and the name of the speaker. The enclosure 180 can have a small hole for the camera to have a field of view field 45. The reflected enclosure 181 appears to be an integral part of the top of the podium 184, which looks like a stand that holds the speaker's notes.

  The reflected image 5 can display the presenter so that it appears at the rear end of the podium 184. The incoming image of the presenter is captured against a black background, so the displayed image is only brightened by the presenter image. In this way, the image area surrounding the presenter cannot be seen because the image area is black and therefore the presenter will not appear to be contained within the frame of the image area. When there is a faintly illuminated background 191, the person will physically appear in front of the background 191. The background is ideally well illuminated so that it is clearly visible to the audience (audience), but not bright enough to burn through the superimposed images of the presenter 5. In fact, it was effective when there was an amber curtain, which was illuminated from the side and dark to see the depth between the image location of the presenter 5 and the background 181. Provides contrast between the shaded area and the illuminated blue crease of the curtain.

  The reflected image plane 5 is only an image produced by the reflection of the image display device 17 reflected by the two-way mirror 2 as seen by the user 3. The space behind the podium 184 is not narrowed by the display device, and the person 187 can stand freely in this space. When there is no image on the image display device 17, there is no reflected image 5 to be viewed by the customer 3 or audience. Therefore, the person 187 can stand behind the podium in the audience's field of view. In the meeting application, the person 187 can introduce a guest speaker, and the guest speaker can appear on the reflecting surface 5 of the podium after the introduction.

  FIG. 29 illustrates the present invention configured as a podium 184 with a camera 1 positioned in front of the two-way mirror 2 and in front of the image display device 17. The camera 1 has an unobstructed field of view 45 of the customer 3, and in the application, the field of view 45 can include a large number of viewers. The podium 184 can be placed on the platform 183 so that the viewer can clearly see the presenter of the podium. Customer 3 has a direct viewing direction 182 for eye contact. It is important to note that the viewing direction 182 need not be horizontal to recognize eye contact. The presenter will be looking forward with the incoming image of the presenter 5 captured on the workstation by the camera in the viewing direction for eye contact. Even if the viewing direction 182 is slightly off axis, the customer 3 will see a reflected image of the presenter 5 that appears as a flat image that faces directly forward. Since the displayed image is flat, a field far from the slight axis will not see a different field of view of the presenter, while a field far from the actual presenter's axis is a real 3D person. You will see different perspectives.

  FIG. 30 illustrates the present invention configured as a podium 207 placed on a platform 183 having a camera 1 located inside a like 206 podium reflected by a two-way mirror 2. . The platform includes a rear projection configuration having a projector 189 that projects onto a mirror 190, which reflects the projected image to a rear projection screen 188. Screen 188 can be horizontal or angled so that it is not visible to customer 3. In FIG. 30, the screen is tilted at 10 degrees and the two-way mirror is tilted at 50 degrees.

  The camera 1 is installed between the two-way mirror 2 and the rear projection screen 188, where the camera 1 has an unobstructed field of view 45 of the customer 3. Since the camera 1 is located within the field of view of the reflected image 5, it can be placed inside the enclosure 206. The enclosure 206 can be represented as an intended part of the stage, such as a structure that holds a logo or meeting banner. The enclosure 206 can have a small hole for the camera to see the field of view 45. The enclosure 206 can be installed to match the position of the physical podium 207. The reflected image of the enclosure 206 is seen superimposed on the same physical position as the podium 207. In order to avoid a gap between the two superimposed images, either the podium 207 or the enclosure 206 can be black, allowing other objects to appear without the superimposed image. In order to provide a more visually appealing three-dimensional display, the enclosure 206 and the podium 207 can be open inside or are made of a transparent material so that the image of the presenter 5 is It can appear behind the physical object.

  In FIG. 30, the rear projection screen 188 can be from the person's head to toe, or life-size and large enough to display the entire person's body. The reflected image 5 appears in free space behind the podium 207. It is also possible for the actual person 187 to stand in the reflection image plane of the presenter 5. The reflected image 5 can be so large that a person 187 can stand directly next to a life-size telepresence person for interactive conversation.

  FIG. 31 is an illustration of the present invention configured such that an image from the head of the person 5 to the toe appears as shown in a three-dimensional set having a background 191. The camera 1 is installed between a large two-way mirror 2 and an overhead rear projection screen 188. The camera 1 has a clear field of view 45 that is not disturbed by the user 3. The projector 189 projects onto the mirror 190, and the mirror 190 reflects the image projected onto the rear projection screen 188. The customer 3 can look forward along the viewing direction 182 to recognize eye contact with a life-size person reflected on the surface 5. The actual person can walk to the position of the surface 5 and has a contact with the customer 3 that matches the eyes.

  FIG. 32 illustrates the present invention configured for the appearance of a full body image of a person 5 having a two-way mirror 2 and a camera 1 placed on top of an underlying front projection screen 104. The camera 1 has a clear field of view 45 that is not disturbed by the customer 3. The customer has a viewing direction 182 toward the presenter image appearing in the reflected image plane 5. The projector 189 projects the image projected under the two-way mirror 2 onto the front projection screen 104 at an angle that positions the image. Projector 189 may need to use lens shift and / or digital keystone correction to produce an undistorted image.

  FIG. 33 is an illustration of the present invention configured as a service counter with the camera 1 positioned between the two-way mirror 2 and the overhead image display device 17. The camera 1 has a clear field of view 45 that is not disturbed by the customer 3. The customer 3 has a viewing direction 182 for recognizing an eye contact with a presenter appearing on the reflection image plane 5. The image display device 17 is sealed in the support structure 193. The image display device can be horizontal or can be placed at an angle so that it is not visible to the customer 3. In FIG. 33, the image display device 17 is tilted at 10 degrees, and the two-way mirror is tilted at 50 degrees. The enclosure 193 can have graphics 194 on the outside.

  There may be a service counter 195 under the eye contact display device. The service counter can include a computer 154 and a printer 178 and can be remotely controlled by a presenter appearing on face 5. In business applications, the printer 178 can print out boarding passes, tags, receipts, product information, maps, reservations, and other printed material that would be valuable to the customer 3.

  FIG. 34 is an illustration of the present invention of FIG. 33 with the two-way mirror 2 rotated upward so that a person 187 can work at the service counter 195. The rotated two-way mirror 2 can be the bottom of the overhead enclosure 193. When the two-way mirror 2 is rotated upward, the counter 195 can be used in the normal manner due to the presence of the actual person 187. Computer 154 and printer 178 may be used with keyboard 94 by person 187.

  FIG. 35 illustrates the present invention configured as a service counter 195 having a camera 1 installed between the two-way mirror 2 and the image display device 17 positioned below. The camera has a clear field of view 45 unobstructed by the customer 3. Customer 3 has a viewing direction 182 for making eye contact with the presenter appearing as reflected image 5. The service counter can have a printer 178 and a computer 154 that can be controlled by a presenter appearing on the reflective image plane 5. The configuration of FIG. 35 is superior to the configuration of FIG. 33 in that there is no device overhead. However, the configuration of FIG. 35 may not be well suited for use by an actual person as illustrated in FIG.

  FIG. 36 shows a service counter having an image display device 17 installed at the bottom, a keyboard 94 for interaction with the customer 3, a data monitor 69, and a camera 1 installed at the top of the two-way mirror 2. The present invention which comprises is illustrated. The camera 1 has a field of view 45 that does not interfere with the customer 3. Customer 3 has eye contact recognition with the image of the presenter on reflective image plane 5 along field of view direction 182. Computer 154 and printer 178 can be remotely operated by a presenter. Customers can enter information such as their name and password to communicate with the presenter.

  FIG. 37 illustrates the present invention located on a retail shelf 91 having a camera 1 placed between the two-way mirror 2 and the overhead image display device 17. The camera 1 has an unobstructed field of view 45 of the customer 3. Customer 3 has eye contact recognition with the image of the presenter on reflective image plane 5 along field of view direction 182. A retail shelf 91 below the eye contact communication device may display retail products. A promotional sale banner 194 can be placed outside the enclosure 193.

  FIG. 38 illustrates the present invention installed on an interactive computer based on a kiosk 192 having a camera 1 installed between the two-way mirror 2 and the overhead image display device 17. The camera 1 has a field of view 45 that does not interfere with the customer 3. Customer 3 has eye contact recognition with the presenter image on reflective image plane 5 along field of view direction 182. A logo or sign 194 can be placed outside the enclosure 193. Customer 3 can enter data into computer 154 with keyboard 94 and view computer screen 69. The computer 154 can be connected to a computer database by a network to access a vast amount of information. In addition, the computer 154 can be connected to a network by a computer operated by a presenter appearing on the reflection image plane 5. With this configuration, the presenter can engage in eye contact communication with the customer 3, while sharing visual information and data with the customer. Since both parties can exchange (interact) data, the communication can be interactive. The resulting information can be printed for customer 3 at printer 178.

  FIG. 39 illustrates the present invention configured as a desk 164 having a camera 1 placed between the two-way mirror 2 and the overhead image display device 17. The camera 1 has an unobstructed field of view 45 of the customer 3. The customer 3 has eye contact recognition with the presenter image on the reflection image plane 5 along the visual field direction 182. The customer can interact with the presenter at computer 154 using keyboard 94 and monitor 69.

  FIG. 40 illustrates the present invention configured as a desk 164 having a camera 1 installed on top of a two-way mirror 2. The camera 1 has a clear field 45 that is unobstructed by the customer 3. Customer 3 has eye contact recognition with the image of the presenter on the reflective image plane 5 along the viewing direction 182. Customer 3 can interact with the presenter at computer 154 using keyboard 94 and monitor 69.

  FIG. 41 shows the present invention configured as a desk 164 having an image display device 17 and a camera positioned on the two-way mirror 2 and having a background 8 reflected on the image plane 9 behind the image display device 17. Illustrate. The camera 1 has an unobstructed field of view 45 of the customer 3. Customer 3 has eye contact recognition with the image of the presenter on image display device 17 along viewing direction 182. Customer 3 can interact with the presenter via computer 154 using keyboard 94 and monitor 69. The configuration can be placed adjacent to the wall 196 to save space, but the reflected background 9 provides a great depth sensation beyond the wall 196.

  FIG. 42 has a small image display device 17 behind the two-way mirror 2, has a small camera 1 on the two-way mirror 2, and is reflected to appear on the rear surface 9 of the image display device 17. 6 illustrates the present invention configured as a desk 164 with a backdrop 8. The camera 1 has an unobstructed field of view 45 of the customer 3. Customer 3 has eye contact recognition with the image of the presenter on image display device 17 along viewing direction 182. Customer 3 can interact with the presenter using computer 154 using keyboard 94 and monitor 69. While this configuration can be placed close to the wall 196 to save space, the reflected background 9 provides a greater sense of depth beyond the wall 196.

  FIG. 43 shows a conference table system having an image display device 17 installed at the rear, a background 8 reflected to appear on the rear surface 9 of the image display device 17, and a camera 1 installed on the two-way mirror 2. The present invention configured as 197 is illustrated. The camera 1 has an unobstructed field of view 45 of the customer 3. Customer 3 has eye contact recognition with the image of the presenter on image display device 17 along viewing direction 182. Customer 3 can interact with the presenter via computer 154 using keyboard 94 and monitor 69.

  44 shows the rear image display device 17 and the background shelf 8 reflected to appear on the rear surface 9 of the image display device 17 and the retail shelf 91 of the present invention having the camera 1 installed on top of the two-way mirror 2. Is illustrated. The camera 1 has an unobstructed field of view 45 of the customer 3. Customer 3 has eye contact recognition with the image of the presenter on image display device 17 along viewing direction 182. The presenter can promote the product on the display on the retail shelf to select what the customer purchases.

FIG. 45 shows the rear image display device 17 and the background 8 reflected to appear on the rear surface 9 of the image display device 17 and the kiosk 192 of the present invention having the camera 1 installed on top of the two-way mirror 2. An example of a computer based on. The camera 1 has an unobstructed field of view 45 of the customer 3.
Customer 3 has eye contact recognition with the image of the presenter on image display device 17 along viewing direction 182. Customer 3 can interact (interact) with the presenter via computer 154 using keyboard 94 and monitor 69.

  FIG. 46 incorporates the present invention with the rear image display device 17 and the background 8 reflected to appear on the rear surface 9 of the image display device 17 and the camera 1 placed on top of the two-way mirror 2. The automatic teller machine (ATM) 198 is illustrated. The camera 1 has an unobstructed field of view 45 of the customer 3. Customer 3 has eye contact recognition with the image of the bank salesman on the image display device 17 along the viewing direction 182. Customer 3 can interact with a bank clerk using touch screen 209 to operate computer 154. A cash dispenser 97 is incorporated into the ATM 198.

  FIG. 47 illustrates the customer representative kiosk illustrated by FIG. 46 with background 8, which is curved to fit the two-way mirror 2 so that the reflected background 9 appears to be a continuation of background 8.

FIG. 48 shows an embodiment of the large scale of the present invention with the image of the front projection screen 104 and the background 8 reflected to appear on the rear face 9 of the screen 104 and the camera 1 placed on top of the two-way mirror 2. Is illustrated.
The surface of the reflected background 9 coincides with the wall 196 and gives a background sensation in which part of the back wall of the room is expanded. The camera 1 has an unobstructed field of view 45 of the customer 3. Customer 3 has eye contact recognition with the presenter image on the front projection screen 104 along the viewing direction 182.

  FIG. 49 shows a large-scale implementation of the present invention having a rear rear projection screen 188 and a background 8 reflected to appear on the rear face 9 of the screen 188 and a camera 1 placed on top of the two-way mirror 2. An example is illustrated. The camera 1 has a clear field 45 that is unobstructed by the customer 3. Customer 3 has eye contact recognition with the presenter image on rear projection screen 188 along viewing direction 182. The rear projection uses a mirror 190 to reflect the projection image to the second mirror 199, and the second mirror 199 reflects the projection image to the rear projection screen 188.

  FIG. 50 shows a large scale of the present invention having a rear front projection screen 104 and a background 8 reflected to appear on the rear surface 9 of the front projection screen 104 and a camera 1 installed on top of the two-way mirror 2. Examples are illustrated.

  FIG. 51 is a schematic diagram of the invention with a camera 1 installed on top of a two-way mirror 2 having a rear rear projection screen 188 and a background 8 reflected to appear on the rear face 9 of the rear projection screen 188. A scale example is illustrated. The camera 1 has a clear field 45 that is unobstructed by the user 3. Customer 3 has eye contact recognition with the presenter image on rear projection screen 188 along viewing direction 182. The rear projection can use the mirror 190 to reflect the projection image to the second mirror 199, and the second mirror 199 further reflects the projection image to the rear projection screen 188.

  FIG. 52 illustrates a kiosk embodiment similar to FIG. In this embodiment, kiosk 192 is a free standing structure that is separated from wall 196 and ceiling 210. The part of the surface of the ceiling 210 immediately above the kiosk is a surface 8 that serves as a background to be reflected at the vertical position 9, which coincides with the surface of the wall 196. Customer 3 sees the wall 196 surrounding the area of the two-way mirror 2 and sees the reflection of the background 8 reflected on the vertical plane 9 coinciding with the surface of the wall 196. The combination of walls 196 seen on the same surface as the reflected background 9 can give the impression of a seamless surface. However, the image displayed on the monitor 17 appears before the combination of the wall 196 and the reflected background 9.

  The embodiment of FIG. 52 can be used for a service desk or reception, where it has the advantage of hiding the imaging device and creating the sensation of a customer service clerk who appears to serve the customer. The kiosk 192 accessories can be designed to be compatible with office, hotel, and shop decorations. In particular, the counter 211 can be viewed through the two-way mirror 2, so that the customer service representative displayed on the monitor 17 can appear directly behind the counter. Since the camera 1 has a field of view through the two-way mirror 2, the camera is not seen by the customer 3. The black panel 212 is installed directly below the camera in order to avoid overlapping images as a reflector of the two-way mirror 2. The data monitor 69 can be installed in front of the two-way mirror 2. This data monitor does not obstruct most of the customer's field of view because the data monitor 69 is not as wide as the monitor 17.

  In FIG. 52, the lights 213 can be installed at an equal distance from the wall 196 and the ceiling 210. In this way, the lights directed at the wall and ceiling come from the same angle. This makes the light on the surface of the background 8 and the light on the wall 196 equivalent. In this manner, the reflected background surface 9 and the wall 196 can have wave quenching from the same angle to support a seamless wall surface sensation.

  FIG. 53 is a front view of the configuration illustrated in FIG. The camera 1 is installed on the upper part of the image display device 17. Alternatively, the camera 1 can be installed behind a two-way mirror. The two-way mirror 2 is angled to reflect the background 8 located on the ceiling 210. The light 213 is installed under the ceiling, where the light can illuminate the area for the user 3. The kiosk 192 has a support structure below the counter 211. The data monitor 69 can be installed in front of the two-way mirror 2. Alternatively, the data monitor 69 can be placed behind a two-way mirror to protect against damage.

  FIG. 54 illustrates an embodiment of the present invention with a background 8 placed in or on the floor. The background 8 appears as the background 9 reflected on the vertical plane at the position of the wall 196. The image on the image display device 17 appears on the front of the wall 196. The panel 214 is installed on top of the two-way mirror 2, so that the field of view of the camera 1 through the two-way mirror sees a black surface. Alternatively, the surface 16 can be a black surface. The camera has a field of view that is placed on or close to the floor and heads to the mirror 42, which reflects the upward field of view to the two-way mirror 2, and the field of view then heads to the user 3. . The camera 1 can be included in an enclosure 215, which is dark or black so that it does not overlay the image seen by the user 3.

  FIG. 55 is an illustration of a plan view of the configuration of FIG. The background 8 above the floor appears as a reflection on the vertical surface of the wall 196. A person 217 sitting on the side will have a viewing direction 216 that is obstructed by the image display device 17. Background 8 is wide enough to provide a reflected image to cover the width of wall 196 to the extent of viewing direction 216. The person 218 sitting on the other side has a viewing direction 219 that is not just blocked by the image display device 17 and will therefore see much of the wall 196. The width of the background 8 is sufficient for the viewing direction 216 and there will be some overlap between the reflected background 8 and the wall 196. In order to avoid unwanted overlap of the reflected background surface 8 and the wall 196, the respective patterns are generated to overlap in an acceptable manner. This is accomplished by using an interlaced pattern or design, which includes a dark background with a random or planned pattern of illuminated image areas or feathered edges.

  Many creative applications and methods are also contemplated within the broad scope of the present invention. A non-limiting example application is described below.

  The telepresence technologies architecture described above can be adapted to allow telepresence users to enter, for a fee, a virtual ballroom managed by a telepresence operations center. At the social venue, users interact with each other through eye contact and natural human communication through facial expressions and body language for the purpose of getting to know people through intellectual dialogue, dating, and telepsence for intimate experiences. In order to meet people in face-to-face chat rooms or pre-arranged meetings. In other embodiments, users can participate in games, competitions, and entertainment for a fee. They include eye contact with the other party through live computer graphics shared display on a second image display device for the participation of telepresence users connected to the telepresence center from anywhere in the world. It is a waste.

  The telepresence technologies architecture described above can be configured to meet the global standards of telepresence and to have additional functionality for certain applications in the financial services sector. In financial services, in order to convey confidential financial information from the head office of a bank to a branch, a transmission is encrypted on a dedicated and secure network of the financial system by a strictly managed telepresence operation center. sell. In this embodiment, financial information is shared on the second image display device in addition to peripherals for printing, digitally scanning, and communicating signed contracts, thereby providing financial information. Bank managers and financial specialists at the center can provide personal services face-to-face with important customers in remote locations. The system preferably includes equipment and systems for money handling, checks and other financial documents, through the telepresence operations center of the financial organization.

  Other Telepresence Technologies architectures provide telepresence communication systems used to connect health professionals, doctors and practitioners anywhere in the world to a telepresence global network that leads to a telepresence operations center. provide. At the Telepresation Operations Center, they can provide services to potential patients coming to pharmacies and medical facilities. Thus, patients can make tests, medical tests, or re-issue prescriptions by appointment with a licensed physician through telepresence for face-to-face treatment. Doctors can remotely control blood pressure, cholesterol levels, body temperature, blood sugar levels, and other unique devices for basic testing, so doctors can create new prescriptions or re-prescribe In addition, after payment by a credit card reader is completed, a medicine can be automatically administered to a patient from a neighboring pharmacy.

  In another embodiment, the telepresence technologies architecture described above allows their presentation via a telepresence network connection to a telepresence operations center by a lecturer, university professor, trainer, or speaker. Can be used to communicate. (Connected to the Telepresence Operations Center) Digitally record the presentation as a life-size appearance with synchronized visual support for playback to groups, audiences, and classes who will be viewing the telepresence presentation for a fee, It is for accumulating. Presenters can schedule their appearance through the Telepresence Operations Center to appear live in the final question-and-answer session, so that presenters can make good use of time and earn revenue from pre-recorded presentations. Can do.

  Further, an example intended for a telepresence technologies architecture is a telepresence communications system manufactured for a global telepresence standard. It can be installed in major business districts around the world, so it has a telepresence communications system where people who are looking for or are looking to change jobs are connected via a telepresence network connection that leads to the telepresence operations center. You can pay for using the room. Appointments can be scheduled for interviews of applicants in one location and employers in other locations by a job placement agency or on a job placement website. Appointments may be submitted to the second image display device by the network service for immediate results, and the applicant may take the test communicated through the Telepresence Operations Center, There is a possibility of being transferred to a room for face-to-face interviews with employers.

  Yet another contemplated embodiment is the telepresence technologies architecture described above, where a telepresence communications system that meets the global telepresence standard can be installed at: That is where the security company wants to place a security guard, but recognizes that unless the security sensor is activated, the security guard will not play an actual role in safety. The system is able to display a security guard's digital recording at that location most of the time, and when the security sensor is activated, it immediately switches to the guard's live telepresence, so that the telepresence guard Can see and judge the situation, can interact with the person who is there, remotely activates alarms and lights, locks or unlocks the door.

  It should be understood that the figures and detailed description herein are illustrative rather than limiting and are not intended to limit the invention to the particular forms or examples disclosed. On the contrary, it will be apparent to those of ordinary skill in the art that the present invention may be further modified, changed, readjusted, represented, and made apparent in the following claims without departing from the spirit and scope of the present invention. Includes substitutions, design choices, and examples. Accordingly, it is intended that the following claims be construed to include all such modifications, alterations, readjustments, substitutions, substitutions, design choices, and examples. For example, the embodiments described above may include a microphone that is improved to receive sound from the viewing location and a speaker that is improved to output sound to the viewing location. Also intended is a communication device that receives a video image by a camera and compresses the video image for transmission to be transmitted over a network connected to a second communication system at a remote location, And it is a communication system which receives the transmission received and transmitted via the network from the said 2nd communication system in the above-mentioned remote place.

  Other variations include a communication system characterized in that, when not in use, a background bi-directional mirror and the light-absorbing panel described above are included in the support structure; or A communication system characterized in that the light-absorbing panel can be folded to form a working desk with a direct field of view of the aforementioned image display device. Communication may include a keyboard, mouse, or other interactive device so that the communication system can be operated and / or the interactive visual and audio devices can be accessed.

  The communication system is suitable for business transactions and further comprises a kiosk comprised of the aforementioned image display device, the aforementioned two-way mirror, and the aforementioned camera, which further comprises a credit card reader or a product dispensing device. May consist of storage space for product promotion and distribution. Still other variations and modifications will become apparent to those skilled in the art through routine experimentation, and are considered and are within the scope of the following claims.

Claims (15)

  1. A telepresence workstation,
    A two-way mirror,
    A display device positioned so as to be visible from the observation area and in a predetermined spatial relationship with the two-way mirror;
    A camera positioned at a physical distance from the observation area and having a viewing direction between the camera and the observation area, wherein the viewing direction is within a physical distance substantially longer than the physical distance. Defining an optical distance, the optical distance being predetermined to minimize distortion of an image captured by the camera in the observation region;
    Telepresence workstation with.
  2. The predetermined spatial relationship is such that the display device is positioned behind the two-way mirror with respect to the viewing region and the display device is positioned with respect to the viewing region so as to be reflected from the two-way mirror. The telepresence workstation of claim 1, wherein the telepresence workstation is selected.
  3. The telepresence workstation of claim 1, further comprising a viewer of the observation area.
  4. The viewing direction is such that the two-way mirror is optically between the observation region and the second mirror, and the second mirror is optically between the two-way mirror and the camera. The telepresence workstation of claim 1.
  5. The telepresence workstation of claim 1, wherein the optical distance is at least about twice the physical distance.
  6. A telepresence communication system,
    The first telepresence station is
    An observation area;
    A camera having a first viewing direction that collides with the viewing area, wherein the camera has a viewing direction on the axis of the user's second viewing direction when the user is using the viewing area Positioned with the camera, and
    An image display device that is within the viewing direction of the user when the user is using the viewing area;
    The second telepresence station is
    A second observation region;
    A second camera having a third viewing direction that collides with the second observation area, wherein the second camera is a second camera when the second user is using the second observation area; The second camera of the previous period, positioned such that the third viewing direction of the second camera is away from the axis of the second viewing direction of the second user;
    A second image display device in a second viewing direction of the second user when the second user is using the second viewing area;
    A telepresence communication system.
  7. Telepresence communication system
    A two-way mirror in the user's second viewing direction;
    The background is positioned such that a reflection of a background is reflected by the two-way mirror and superimposed on an image displayed on the image display device;
    The telepresence communication system according to claim 6.
  8. The telepresence communication system of claim 7, wherein the background reflection provides depth to a user using the viewing area.
  9. The camera is positioned at a physical distance from the observation area, the viewing direction of the camera follows an optical path that defines an optical distance from the observation area, and the optical distance is greater than the physical distance. The telepresence communication system according to claim 6, wherein the telepresence communication system is sufficient to reduce distortion of an image of a user who uses an observation area imaged by the camera.
  10. Display method,
    An image is displayed on the image display device, the image display device can be observed from the observation region, and the image display device can be observed with respect to the observation region via a two-way mirror, and the image is displayed in the observation region Appearing substantially in a first plane when viewed from, further reflecting a background with the two-way mirror to form a reflected background, the reflected background being viewed from the viewing region Superimposed on the image of the display and appears substantially in a second plane when viewed from the viewing region, the second plane being substantially parallel to the first plane and the first plane. A display method that appears farther from the observation area than the surface of 1.
  11. The display method according to claim 10, wherein the background is formed integrally with a part of a ceiling on the two-way mirror, or formed integrally with a part of a floor below the two-way mirror.
  12. The display method of claim 10, further comprising positioning an observer in the observation region to view a reflected background superimposed with an image of the image display device.
  13. The display method according to claim 11, wherein the background has a surface substantially coinciding with a wall surface positioned behind the image display device.
  14. The display method according to claim 11, wherein the wall is at least partially visible through the two-way mirror.
  15. The display method according to claim 10, wherein the reflected background covers at least a part of the image display device that can be observed from the observation region by another method.
JP2009529416A 2006-09-22 2007-09-21 Three-dimensional display and telepresentation system and method Pending JP2010504709A (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
US84641506P true 2006-09-22 2006-09-22
US85506506P true 2006-10-27 2006-10-27
US96844707P true 2007-08-28 2007-08-28
PCT/US2007/079207 WO2008036931A2 (en) 2006-09-22 2007-09-21 3-d displays and telepresence systems and methods therefore

Publications (1)

Publication Number Publication Date
JP2010504709A true JP2010504709A (en) 2010-02-12

Family

ID=39201333

Family Applications (1)

Application Number Title Priority Date Filing Date
JP2009529416A Pending JP2010504709A (en) 2006-09-22 2007-09-21 Three-dimensional display and telepresentation system and method

Country Status (4)

Country Link
EP (1) EP2064866A4 (en)
JP (1) JP2010504709A (en)
KR (1) KR20090074210A (en)
WO (1) WO2008036931A2 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017163895A1 (en) * 2016-03-25 2017-09-28 パナソニックIpマネジメント株式会社 Information displaying system and information providing terminal

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
SE535205C2 (en) * 2010-06-03 2012-05-22 Erik Eskilsson Studio and conference videoconferencing system
SE535881C2 (en) * 2011-06-15 2013-01-29 Mebe Viewcom Ab Video conferencing system that uses a camera with inverted telescope
US9759420B1 (en) 2013-01-25 2017-09-12 Steelcase Inc. Curved display and curved display support
US9261262B1 (en) 2013-01-25 2016-02-16 Steelcase Inc. Emissive shapes and control systems
US10264213B1 (en) 2016-12-15 2019-04-16 Steelcase Inc. Content amplification system and method

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0865647A (en) * 1994-08-22 1996-03-08 Toshiba Corp Portable television telephone device

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB9918704D0 (en) * 1999-08-10 1999-10-13 White Peter M Device and method for eye to eye communication overa network
AU6171200A (en) * 1999-08-10 2001-03-05 Peter Mcduffie White Communications system
US7057637B2 (en) * 2004-04-21 2006-06-06 White Peter Mcduffie Reflected backdrop for communications systems

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0865647A (en) * 1994-08-22 1996-03-08 Toshiba Corp Portable television telephone device

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2017163895A1 (en) * 2016-03-25 2017-09-28 パナソニックIpマネジメント株式会社 Information displaying system and information providing terminal

Also Published As

Publication number Publication date
WO2008036931A2 (en) 2008-03-27
EP2064866A4 (en) 2011-01-12
WO2008036931A3 (en) 2008-07-17
EP2064866A2 (en) 2009-06-03
KR20090074210A (en) 2009-07-06

Similar Documents

Publication Publication Date Title
Nguyen et al. MultiView: spatially faithful group video conferencing
CN104469256B (en) Immersion and interactive video conference room environment
CN104871084B (en) Self adaptation projector
US6930669B2 (en) Portable personal computing device with fully integrated projection display system
US6844893B1 (en) Restaurant video conferencing system and method
US7710391B2 (en) Processing an image utilizing a spatially varying pattern
EP2183655B1 (en) Dual screen presentation notebook computer
US20080043100A1 (en) Projection screen and camera array
US20030169334A1 (en) Iris capture device having expanded capture volume
US8159519B2 (en) Personal controls for personal video communications
US6808268B2 (en) Projection system for aerial display of three-dimensional video images
US7059733B2 (en) Display apparatus
US5600114A (en) Remote unmanned banking center
US20120002008A1 (en) Apparatus for secure recording and transformation of images to light for identification, and audio visual projection to spatial point targeted area
US5639151A (en) Pass-through reflective projection display
US20030078840A1 (en) System and method for interactive advertising
US20080150913A1 (en) Computer vision based touch screen
US20050122308A1 (en) Self-contained interactive video display system
US20080136973A1 (en) Portable projector system
US7092002B2 (en) Systems and method for enhancing teleconferencing collaboration
KR100851612B1 (en) Interactive teleconferencing display system
US20040117067A1 (en) Mutually-immersive mobile telepresence with gaze and eye contact preservation
US7134756B2 (en) Selectable projector and imaging modes of display table
US20020080094A1 (en) Teleportal face-to-face system
DE69634041T2 (en) Device for supporting transactions

Legal Events

Date Code Title Description
A621 Written request for application examination

Free format text: JAPANESE INTERMEDIATE CODE: A621

Effective date: 20100818

A131 Notification of reasons for refusal

Free format text: JAPANESE INTERMEDIATE CODE: A131

Effective date: 20120828

A977 Report on retrieval

Effective date: 20120829

Free format text: JAPANESE INTERMEDIATE CODE: A971007

A02 Decision of refusal

Free format text: JAPANESE INTERMEDIATE CODE: A02

Effective date: 20130319