WO2006028150A1

WO2006028150A1 - Remote control communication method using 3d display device having imaging function and 3d display device having imaging function used for the method

Info

Publication number: WO2006028150A1
Application number: PCT/JP2005/016446
Authority: WO
Inventors: Susumu Tachi; Tomohiro Endo; Naoki Kawakami
Original assignee: Japan Science And Technology Agency
Priority date: 2004-09-07
Filing date: 2005-09-07
Publication date: 2006-03-16
Also published as: JP2006078597A; JP3946213B2

Abstract

There is provided a remote communication method capable of performing a remote communication by using a 3D display device having imaging function when a plurality of persons are present together. At a first point, there is arranged a 3D display device (1) including a first imaging function having a 3D video presentation function for presenting a 3D video (2) which can be viewed with naked eyes and an imaging function for imaging the person (3) present at the first point. At a second point apart from the first point, there is arranged a 3D display device (4) including a second imaging function having a 3D video presentation function for presenting a 3D video (5) which can be viewed with naked eyes and an imaging function for imaging persons (6 to 8) present at the second point.

Description

Specification

Remote communication method using three-dimensional display device with photographing function and three-dimensional display device with photographing function used in the method

Technical field

The present invention relates to a remote communication method using a three-dimensional display device with a photographing function that provides a stereoscopic image that can be viewed with the naked eye, and a three-dimensional display device with a photographing function used in the method.

Background art

[0002] Realization of line-of-sight matching is an important issue in video presentation systems used for remote communication. In this system, it is necessary to present a 3D image to the user and capture the user's appearance without obstructing it. Some of the inventors of the present application implement the autostereoscopic display “TWISTER” as a 3D display device with a shooting function that rotates the camera and display unit around the user and allows them to coexist in a time-sharing manner. Proposed [Non-Patent Document 1]. This device provides a 360-degree field of view to the user by rotating a one-dimensional LED array with light-emitting diodes (LEDs) arranged vertically, and is equipped with a video camera. The user's appearance is photographed. As a result, it is possible to take a picture of the user looking at the positional force on the screen and realize line-of-sight matching during face-to-face communication. In addition, right-eye and left-eye LEDs are prepared as LED arrays, and a light-shielding plate called a parallax barrier is installed in front of the LED array and rotated together to achieve autostereoscopic vision.

[0003] Figure 7 shows the Internet website “www.jst.go.jp/kisoken/seik a / zensen” that publicly announces the research results of the “Strategic Creation Promotion Project” conducted by the Japan Science and Technology Agency. / 01tachi / j [Non-Patent Document 2] is a conceptual diagram of the mutual communication system.

[0004] In addition, as a multiplex hologram, one of the three-dimensional display devices in which a large number of people can observe 360-degree full-circle power simultaneously with the naked eye is a one-dimensional display in which light-emitting elements such as LEDs are arranged in a vertical row. Cylindrical paralatusno << structure of rotating inside the rear Some inventors of the present application propose a three-dimensional display device [Non-Patent Documents 3, 4 and 5].

[0005] Further, Japanese Patent Application Laid-Open No. 2003-195214 [Patent Document 1] proposes a stereoscopic display device using a light-emitting array that is circularly scanned and Noralux Noria.

Non-Patent Document 1: Kenji Tanaka, Shinya Hayashi, Ichiro Kawasaki, Masahiko Inami, Susumu Tsuji “Nude Eyes Full-Stereo Stereo Video Display TWISTER III” Journal of the Institute of Image Information and Television Engineers, Vol. 58, No. 6, pp. 819- 26, 2004.

Patent Document 2: www.jst.go.jp/kisoken/seika/zensen/01tachi/ lZ3 page

Non-Patent Document 3: Tomohiro Kusumi and Makoto Sato “All-round real-time three-dimensional display by rotating a one-dimensional light source array”, Imaging Journal, Vol. 53, no. 3, pp. 399-404, March 1999 Non-Patent Document 4: Tomohiro Kusudo, Yoshihiro Kusunoki, Ikuo Honda, Makoto Sato “All-round 3D video display” 3D image conference, 99 papers, no. 4-4, pp. 99-104 , June 1

999

Non-Patent Document 5: “All-round 3D Display” written by Tomohiro Todo, Yoshihiro Kusunoki, Ikuo Honda and Makoto Sato, IEICE Transactions D— II Vol. J84-D-II No. 6 ppl003— 1011 June 2001

Patent Document 1: Japanese Patent Application Laid-Open No. 2003-195214 (Applicant: Seiko Epson Corporation) Disclosure of Invention

Problems to be solved by the invention

[0006] As shown in the conceptual diagram of Fig. 7, in a mutual tele-existence environment that consists of multiple 3D display devices with multiple imaging functions that have been proposed in the past, in a state where multiple people are gathered together, Communication was only possible in a virtual environment where each participant entered a 3D display device with a shooting function.

[0007] An object of the present invention is to provide a remote communication method capable of performing remote communication using a three-dimensional display device with a photographing function in a state where a plurality of people meet together, and a three-dimensional device with a photographing function used in the method. It is to provide a display device.

[0008] Another object of the present invention is to provide a 3D display with a shooting function that can easily mount a shooting device including a plurality of cameras on a 3D display device in which a plurality of people can view a stereoscopic image with the naked eye. It is to provide a play device.

Means for solving the problem

[0009] In the remote communication method using the three-dimensional display device with a photographing function of the present invention, a stereoscopic image presenting function that presents a stereoscopic image that is arranged at the first point and can be viewed with the naked eye, and a person at the first point 3D display device with a first shooting function with a shooting function for shooting images, and a 3D image presentation function for displaying a 3D image that can be viewed with the naked eye, placed at a second point away from the first point And a second 3D display device with a photographing function, which has a photographing function for photographing a person at the second point. Then, the video of the person at the first point imaged by the 3D display device with the first photographing function is presented to the person at the second point as a stereoscopic image by the 3D display device with the second photographing function. Then, the image of the person at the second point captured by the 3D display device with the second imaging function is presented to the person at the first point as a stereoscopic image with the 3D display device with the first imaging function. . This enables communication between people in remote locations.

[0010] In the communication method of the present invention, as the first three-dimensional display device with a photographing function, one having a structure including a first composite rotating structure that rotates around a person at a first point is used. The first composite rotating structure has a structure including a first light emitting element array structure, a first light shielding unit structure, and a first imaging device. In the first light-emitting element array structure, a pair of light-emitting elements composed of a left-eye light-emitting element array and a right-eye light-emitting element array arranged at predetermined intervals in the circumferential direction has a predetermined circumferential direction. Has a structure with multiple intervals

. The first light-shielding part structure is disposed inside the light-emitting element array structure corresponding to the plurality of light-emitting element arrays, and is provided to the person at the first point due to the binocular parallax of the person at the first point. It has a structure in which a plurality of light shielding portions are arranged at predetermined intervals in the circumferential direction so as to present a stereoscopic image. The first photographing device is arranged to photograph a person at the first point. The first imaging device can be configured with multiple camera forces. The plurality of cameras may be disposed at a position where photographing is performed through a slit formed between two adjacent light shielding portions of the plurality of light shielding portions, or may be disposed on the light shielding plate. Multiple cameras may be arranged so that a hole is made in the light shielding plate so that the back side force of the light shielding plate can also be photographed through the hole. As long as the light emitted from the light emitting element array force does not block the light, multiple cameras can be placed at any position. It is. The plurality of cameras are preferably arranged at equal intervals in the circumferential direction. The number of cameras is arbitrary, and is not necessarily equal to the number of pairs of light emitting element rows.

[0011] In addition, the second 3D display device with a photographing function used in the present invention includes a second composite rotating structure disposed at the center of a plurality of persons at the second point. The second composite rotating structure also has a structure including a second light emitting element array structure, a second light shielding unit structure, and a second imaging device. The second light emitting element array structure has a structure in which a plurality of one-dimensional light emitting element arrays arranged at predetermined intervals in the circumferential direction are arranged at predetermined intervals in the circumferential direction. In addition, the second light shielding unit structure is disposed outside the second light emitting element array structure, and is provided to each of the plurality of persons at the second point due to the binocular parallax of the plurality of persons at the second point. It has a structure in which a plurality of light shielding parts are arranged at predetermined intervals in the circumferential direction so as to present a stereoscopic image. The second photographing device is arranged so as to photograph a plurality of people at a second point located outside the second composite rotating structure. Similarly to the second imaging device, the second imaging device can be composed of a plurality of cameras, and the arrangement of the second imaging device is arbitrary.

[0012] According to the method of the present invention, the person at the first point enters the first three-dimensional display with the photographing function, and the stereoscopic video of the plurality of persons at the second point While looking around, you can talk with other people at the second point while keeping an eye on them. In addition, multiple people at the second location can see the 3D image of the person at the first location provided by the second 3D display device with a shooting function in the center, and You can have a conversation with your eyes. Therefore, according to the present invention, it is possible to perform remote communication in a state where a plurality of persons gathered together, which has been impossible in the past. Of course, there may be only one person at the second point depending on the method of use.

[0013] Note that in the second 3D display device with a photographing function, the second light-emitting element array structure and the second light-shielding portion structure have a second rotational speed of the second light-emitting element array structure. It is preferable that the light-shielding part structure is configured to rotate in the opposite direction under the condition that it is slower than the rotational speed of the light-shielding part structure. Also, in this case, the second light-emitting element array structure is rotated so that the second imaging device rotates together with the second light-emitting element array structure to photograph a plurality of people at the second point. Wearing It is preferable to do this. The photographing apparatus is configured to include at least an image sensor, and is actually composed of a plurality of cameras. When the camera is mounted on the second light-shielding part structure that rotates at high speed, a commercially available camera has a problem that the electronic circuit of the camera cannot withstand centrifugal force, resulting in poor connection. In addition, power can be supplied to multiple cameras and images can be taken out using slip rings, but slip rings for high-speed rotation are very expensive and there is a problem that the price of the entire apparatus becomes high. Furthermore, moving the camera at high speed has the problem of blurring the image. Therefore, if the photographing device is mounted on the second light emitting element array structure that rotates at a low speed, the photographing device that does not cause the above problem can be mounted on the three-dimensional display device. Therefore, in this way, an inexpensive second imaging device configured using a commercially available power camera can be mounted on the 3D display device with the second imaging device.

When a plurality of cameras constituting the second imaging device are mounted on the second light emitting element row structure, for example, adjacent to the plurality of one-dimensional light emitting element rows constituting the second light emitting element row structure. Multiple cameras can be arranged between two matching one-dimensional light-emitting element arrays. In such a case, since a plurality of people outside are photographed through the plurality of slits formed in the second light shielding unit structure, the light amount depends on the number of slits and the width dimension. Is lacking. Therefore, the first polarizing plate is arranged outside each of the plurality of one-dimensional light emitting element arrays constituting the second light emitting element array structure. The plurality of light shielding portions of the second light shielding portion structure are each configured by a second deflection plate that blocks the passage of light that has passed through the first deflection plate. As these deflecting plates, linear polarizing plates, circular deflecting plates, elliptical deflecting plates and the like can be used. In this way, the light from the outside of the second light shielding part structure reaches the plurality of cameras through the light shielding part and the slits between the light shielding parts, so that there is no shortage of light quantity. A first polarizing plate is disposed outside the plurality of one-dimensional light emitting element arrays. Therefore, when the first polarizing plate and the second deflecting plate constituting the light-shielding portion overlap on the optical path of the light from the one-dimensional light emitting element array, the light of the one-dimensional light emitting element array force is second. Passage is blocked by the light shielding part, which is the deflection plate force. In addition, when the first polarizing plate and the light shielding portion serving as the second deflecting plate force do not overlap, the one-dimensional light emitting element array passes through the first polarizing plate and the slit formed in the second light shielding portion structure. Light is emitted to the outside. As a result, the function of the shading part The necessary amount of light can be introduced into the camera without losing the image.

[0015] In addition, the second imaging device can also be configured with a plurality of camera forces that are located outside the second light-shielding portion structure and arranged at predetermined intervals in the circumferential direction. In this case, the plurality of cameras is an attachment structure configured to attach the plurality of cameras to the second light emitting element array structure without hindering the rotation of the second light shielding unit structure. It may be supported by. In this way, since there are no obstacles in front of the camera, the necessary and sufficient amount of light can be secured easily.

[0016] It is to be noted that the 3D display device with a photographing function used in the remote communication method of the present invention, the three-dimensional display device with a photographing function arranged at the center of a plurality of people viewing stereoscopic images, includes a composite rotating structure. It is preferable to have the following configuration. That is, the compound rotating structure includes a light emitting element array structure in which a plurality of one-dimensional light emitting element arrays arranged at predetermined intervals in the circumferential direction are arranged at predetermined intervals in the circumferential direction; A plurality of light shielding portions are arranged at predetermined intervals in the circumferential direction so as to be arranged on the outside of the light emitting element array structure and present a plurality of people with a stereoscopic image by parallax between the eyes of the plurality of people. It has a structure including a light-shielding part structure that is arranged and a photographing device that photographs a plurality of persons located outside the composite rotating structure. Then, the light emitting element array structure and the light shielding part structure are configured to rotate in opposite directions under the condition that the rotation speed of the light emitting element array structure is slower than the rotation speed of the light shielding element structure. . Further, the photographing device is attached to the light emitting element array structure so as to rotate the light emitting element array structure together with the light emitting element array structure to photograph a plurality of people. In addition, the photographing apparatus includes a plurality of cameras respectively disposed between two adjacent one-dimensional light emitting element rows of the plurality of one-dimensional light emitting element rows constituting the light emitting element row structure. Then, a first polarizing plate is disposed outside each of the plurality of one-dimensional light emitting element arrays constituting the light emitting element array structure. In addition, the plurality of light shielding portions of the light shielding portion structure are each configured by a second deflecting plate that blocks passage of light that has passed through the first polarizing plate.

[0017] It is to be noted that the imaging device is composed of a plurality of cameras that are located outside the light shielding portion structure and are arranged at predetermined intervals in the circumferential direction, and the plurality of cameras inhibit rotation of the light shielding portion structure. A plurality of cameras may be supported by a mounting structure configured to be mounted on the light emitting element array structure without doing so. [0018] Even in the case of a deviation, it is preferable that the rotational speed of the light emitting element array structure is equal to or less than lZio of the rotational speed of the light shielding part structure. With such a speed, the weight of the photographing apparatus does not become an obstacle particularly when the light emitting element array structure is rotated.

Brief Description of Drawings

FIG. 1 is a diagram used for explaining a concept when a method of the present invention is carried out.

[FIG. 2] (A) and (B) are diagrams used to explain the structure and concept of the first proposed 3D display device with a photographing function.

FIG. 3 is a diagram showing a basic structure excluding an imaging device in a second 3D display device with an imaging function used in the embodiment of the present invention.

FIG. 4 is an arrangement diagram for explaining an internal configuration of a second 3D display device with a photographing function.

FIG. 5 is a diagram used for explaining experimental results.

FIG. 6 is a schematic perspective view showing the structure of another example of the second 3D display device with a photographing function that can be used in the method of the present invention.

FIG. 7 is a diagram showing a concept of a conventional method.

BEST MODE FOR CARRYING OUT THE INVENTION

Hereinafter, embodiments of a remote communication method of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing the concept when the method of the present invention is carried out. In FIG. 1, reference numeral 1 is provided at a first point and has a three-dimensional video presentation function that presents a stereoscopic video 2 that can be viewed with the naked eye and a photographing function that photographs a person 3 at the first point. The first 3D display device with an imaging function (inward-facing 3D display device) is shown. Reference numeral 4 is a stereoscopic video presentation function that presents a stereoscopic video 5 that is placed at a second point away from the first point and can be viewed with the naked eye, and a shot that captures people 6 to 8 at the second point. This is a second 3D display device with shooting functions (outward-facing 3D display device).

In the remote communication method according to the embodiment of the present invention, the video of the person 3 at the first point captured by the first three-dimensional display device 1 with a photographing function 1 is captured with the second three-dimensional display with the second photographing function. It is presented to the person at the second point as a stereoscopic image ^ on the play device 4. Then, the images of people 6 to 8 at the second point taken by the 3D display device 4 with the second shooting function 4 3D display device 1 with shooting function 1 is presented as a 3D image ^ ~ ^ to the person at the first point. In order to realize this, both the first and second 3D display devices 1 and 4 with photographing functions need to have a function of performing both imaging and presentation of stereoscopic images.

[0022] Regarding the presentation of stereoscopic video, since there is only one person inside the first three-dimensional display device 1 with a photographing function 1 (inward system), it may be a binocular stereoscopic video that performs viewpoint tracking. On the other hand, in the second 3D display device 4 with an imaging function (outward-facing system), it is necessary to cope with this because a plurality of people observe at the same time. In addition, it is imaging, but it is only necessary to acquire information according to the request of the corresponding presentation side. Therefore, the 2D 3D display device with shooting function 4 (outward facing system) only needs 2 eyes. . The field of view must be 360 degrees around the perimeter, but the user 3 of the first 3D display device 1 with an imaging function 1 (inward-facing system) does not see 360 degrees all around at the same time. In such a case, it is sufficient if the image is sufficiently wide and the angle of view can be taken. The first 3D display device 1 with an imaging function (inward-facing system) needs to support multiple viewpoints.

[0023] The presentation of a stereoscopic image in the first three-dimensional display device 1 with a photographing function 1 (inward-facing system) has already been realized by the aforementioned TWISTER. In addition, with regard to the imaging of the first three-dimensional display device 1 with an imaging function (inward-facing system), a method using shuffler timing control of a rotating camera (Takuya Hayashi, Kenji Tanaka, Tomohiro Kusumi, Susumu Tsuji) The construction of a stereo imaging system using shutter timing control, Proceedings of the 8th Annual Conference of the VR Society of Japan, pp. 269-70, 2003.)) has already been proposed.

FIGS. 2 (A) and 2 (B) are diagrams for explaining the structure and concept of the first three-dimensional display device 1 with a photographing function that has already been proposed! The first three-dimensional display device 1 with a photographing function includes a complex rotating structure 10 that rotates around a person 3 at a first point. The composite rotating structure 10 includes a light emitting element array structure 11, a light shielding part structure 12, and an imaging device 13. The light-emitting element array structure 12 includes a light-emitting element array pair 16 including a left-eye light-emitting element array 14 and a right-eye light-emitting element array 15 that are arranged at predetermined intervals in the circumferential direction. A plurality of structures are arranged with a predetermined interval. The light-emitting element array 14 for the left eye and the light-emitting element array 15 for the right eye have three color light emitters in one package. Has a structure in which a plurality of light emitting elements containing are vertically arranged. In practice, a plurality of light emitting element array pairs 16 are supported by a cylindrical frame (not shown). The light-shielding part structure 12 is arranged inside the light-emitting element array structure 11 corresponding to the plurality of light-emitting element arrays 16, and is arranged on the person 3 by parallax between the eyes of the person 3 inside (first point). A plurality of light-shielding portions 17 have a structure arranged at predetermined intervals in the circumferential direction so as to present a stereoscopic image ˜8 mm. Each light shielding portion 17 has a plate shape and is supported by a mounting plate of the corresponding light emitting element array 16 via a support member 18. In this example, the photographing device 13 is arranged so as to photograph the person 3 at the center (first point) inside through a slit S formed between two adjacent light shielding portions 17 and 17. Specifically, it is mounted on a cylindrical frame (not shown) so that the camera 19 is positioned between two adjacent light emitting element rows 16 and 16. Here, the camera 19 is a video camera used for so-called continuous shooting. Driving power to the plurality of light emitting element arrays 16 and the plurality of cameras 19 is supplied via a power source electric brush provided in a support device (not shown) that rotatably supports the composite rotating structure 10. Although the composite rotating structure 10 is heavy, a battery may be mounted on the composite rotating structure 10 and used as a power source. The video signal from the camera 19 is transmitted to a transmission device provided in a support device (not shown) that rotatably supports the composite rotary structure 10 using a slip ring and an optical rotary joint. Of course, the video signal may be transmitted using a wireless communication means using radio waves or light. In addition, the video signal received from the second 3D display device 4 with a photographing function is wirelessly transmitted to a light emitting element row driving circuit (not shown) mounted on the composite rotating structure 10, and the light emitting element row driving circuit is not shown. Blinks the light emitting diodes of a plurality of light emitting element rows based on the received video signal. Note that illustration and description of the rotation drive mechanism for rotating the composite rotating structure 10 are omitted.

FIG. 3 shows the basic structure of the second 3D display device 4 with a photographing function used in the embodiment of the present invention, excluding the photographing device 23. FIG. 4 is a layout diagram for explaining the internal configuration of the second 3D display device 4 with a photographing function. This outward-facing 3D display device 4 with a photographing function includes a composite rotating structure 20 disposed in the center of a plurality of persons 6 to 8 (FIG. 1) at a second point. This composite rotating structure 2 0 has a structure including a light emitting element array structure 21, a light shielding part structure 22, and a photographing device 23. The light emitting element array structure 21 has a structure in which a plurality of one-dimensional light emitting element arrays 24 arranged at predetermined intervals in the circumferential direction are arranged at predetermined intervals in the circumferential direction. The one-dimensional light-emitting element array 24 has a structure in which a plurality of light-emitting diodes are attached to a supporting member so as to form a line vertically (vertically). The plurality of one-dimensional light-emitting element arrays 24 constituting the light-emitting element array structure 21 each have a structure in which single-color light emitting diodes are arranged in the vertical direction, and three types of one-dimensional light emission of red, green, and blue are performed. The light-emitting element array structure 21 is configured by repeatedly arranging the element arrays in the circumferential direction. Similar to the light-emitting element array used in the first three-dimensional display device with a photographing function 1, a structure in which a plurality of light-emitting elements containing three-color light emitters are arranged vertically in one package. You can also do it. The plurality of one-dimensional light emitting element arrays 24 are connected by ring-shaped thin and connecting frames (not shown) disposed at the upper and lower positions of each one-dimensional light emitting element array 24. Therefore, from the outside, the inner space of the plurality of one-dimensional light emitting element rows 24 can be seen through the slit 25 formed between two adjacent one-dimensional light emitting element rows 24.

As shown in FIG. 4, in the second three-dimensional display device 4 with a photographing function used in the present embodiment, a plurality of cameras 26 constituting the photographing device 23 are arranged in two adjacent one-dimensional light emitting element arrays 24. Are arranged in the slits 25 formed between the two. The plurality of force lenses 26 are fixed with respect to the main body of the one-dimensional light emitting element array 24. In addition, driving power to the plurality of one-dimensional light emitting element arrays 24 and the plurality of cameras 26 is supplied via a power source electric brush provided in a support device (not shown) that supports the composite rotating structure 20 on its own rotation. . Although the light emitting element array structure 21 is heavy, a battery may be mounted on the light emitting element array structure 21 and this battery may be used as a power source. The video signal from the camera 26 is transmitted to a transmission device provided in a support device (not shown) that rotatably supports the light emitting element array structure 21 using radio. Also, the video signal received from the first three-dimensional display device 1 with a photographing function 1 is wirelessly transmitted to a light emitting element row driving circuit (not shown) mounted on the light emitting element row structure 21, and a light emitting element row driving circuit (not shown) is transmitted. The path blinks the light emitting diodes LED of the plurality of primary light emitting element arrays 24 based on the received video signal. In the present embodiment, as shown in FIG. A linearly polarizing plate is disposed as the first deflector 27 on the outside of the plurality of one-dimensional light emitting element arrays 24 constituting each. These first deflection plates 27 are attached to the main body on which the light-emitting diodes LED constituting the one-dimensional light-emitting element array 24 are mounted through appropriate attachment means.

[0027] The light shielding unit structure 22 called a parallax barrier is arranged outside the light emitting element array structure 21, and parallax between the eyes of a plurality of persons 6 to 8 outside the three-dimensional display device 4 with photographing function 4 Thus, a plurality of light-shielding portions 28 are arranged at predetermined intervals in the circumferential direction so as to present a stereoscopic image to each person. The light emitting element array structure 21 and the light shielding part structure 22 rotate in opposite directions under the condition that the rotation speed of the light emitting element array structure 21 is slower than the rotation speed of the light shielding element structure 22. The description of the drive structure for rotating the light emitting element array structure 21 and the light shielding portion structure 22 in the reverse direction is omitted. In this example, the plurality of light-shielding portions 28 of the light-shielding portion structure 22 are linearly polarizing plates and deflection axes used as the first deflecting plate 27 arranged outside the one-dimensional light emitting element array 24, respectively. Are each constituted by a deflection plate (second deflection plate) perpendicular to each other. If the light shielding part structure 22 is provided with a plurality of individual light shielding parts 28 as in the structure shown in FIG. 3, the plurality of light shielding parts 28 are all composed of deflection plates. do it. Also, as shown in FIG. 4, a plurality of light blocking portions 28 and light passing portions that allow light to pass through may be alternately arranged to form a continuous structure. In the case of FIG. 4, the light passing portion located between the two adjacent light shielding portions 28 can be formed of a transparent sheet. In this example, a linear polarizing plate is used as the first deflecting plate 27, but it is needless to say that a circular deflecting plate, an elliptically deflecting plate or the like can be used.

[0028] When the light shielding portions 28 are individually provided as in the principle structure of FIG. 3, the width dimension of the slit 29 between two adjacent light shielding portions 28 becomes very narrow, and the camera 26 also requires external force. There is not enough light. Therefore, if the light shielding unit 28 is configured by a second deflecting plate that blocks the passage of light that has passed through the first polarizing plate 27, the camera 26 can receive a sufficient amount of light with an external force. That is, when viewed from the light emitting diode LED, even if the light passes through the first polarizing plate 27, the light that hits the light shielding portion 28 is not radiated to the outside. On the other hand, when the external force is also seen, the light that has passed through the light-shielding portion 28 and entered the inside reaches the camera 26 only by being blocked by the first polarizing plate 27. Therefore, if such a configuration is adopted, it is necessary for the camera 26. It becomes possible to enter a sufficient amount of light.

[0029] Regarding the basic principle of the three-dimensional display device 4 used in the present embodiment, a part of the inventors has already announced that it is a "cylindrical solid display by a method of rotating a one-dimensional light source array and a paralatras noria". (Tomohiro Todo, Yoshihiro Kashiwagi, Ikuo Honda, Makoto Sato: 3D display all around, IEICE Transactions, Vol. J84-D-II, No. 6. pp. 1 003 -011, 2001 .). The announced prototype can present different images in a narrow space such as once. The principle of operation is as follows. As shown in FIG. 3, both the light shielding part structure 22 (parallax barrier) and the light emitting element array structure 21 inside thereof rotate. The direction of rotation is opposite. By rotating a plurality of one-dimensional light emitting elements 24 provided in the light emitting element array structure 21, a cylindrical surface image can be displayed. The relative position changes at a high speed due to the rotation of both the light emitting element array structure 21 and the light shielding part structure 22 (parallax barrier). As a result, the direction of the thin light beam exiting through the slit of the light shielding unit structure 22 is scanned, and the luminance of the light emitting diode elements constituting the one-dimensional light emitting element array is changed in synchronization with the direction of the light beam. Reproduce. As a result, it is possible to show different images (stereoscopic images) depending on the viewing direction.

[0030] In this three-dimensional display device 4, a plurality of cameras 26 are attached to the light emitting element array structure in the same manner as the three-dimensional display device 1 (TWISTER) with the first photographing device in order to match the line of sight. . Specifically, for the light shielding part structure (parallax barrier) 22, for example, the prototype rotates at a high speed of 1800 rpm. It is not realistic to attach a camera to this and rotate it, such as the problem of centrifugal force. On the other hand, the light-emitting element array structure 21 rotates at a speed of about lOOrpm in the prototype. Since lOOrpm is relatively slow, it is possible to mount the camera 26 between two adjacent one-dimensional light emitting element arrays 24.

[0031] In the mutual teleexistence system proposed in the present embodiment, the information flows from the 3D display device 1 with the first imaging function 1 (inward imaging system) to the 3D display device with the second imaging function. 4 Flow of image information transmitted to (outward presentation system: multiple observers) and reverse 3D display device with second imaging function 4 (outward imaging system) to first imaging function 3 Sent to 3D display device 1 (inward presentation system: 1 observer) There are two types of flow of image information. Of these, the flow toward the inward imaging system and the outward presentation system requires that the parallax images (light ray information) be acquired sufficiently densely and displayed in order to be fully compatible with many people. When this is performed, the amount of information becomes enormous. However, when considering actual communication, it is considered that there is sufficient practicality if it corresponds to several people. Therefore, the amount of information can be reduced by simplifying the number of viewpoints. One method is to measure the viewpoint position of each observer, acquire images for the number of observers corresponding to each position in the inward imaging system, and then use the outward display system to correspond each image to the observer. It is to display in the direction of. For the observer's viewpoint position measurement using a non-contact / non-wearing method, a simple image measurement method and a method using retroreflection of the human fundus are at the practical level and follow the viewpoint. Also used for presenting images! In many cases, viewpoint tracking is performed for one person, but viewpoint position measurement itself can be easily handled for multiple persons. In addition, imaging from any direction has already been proposed and studied in the imaging system of the first 3D display device 1 (TWI STER) with imaging function!

Next, in order to confirm the feasibility of the second 3D display device 4 with a photographing function, an image display experiment was performed using an actual cylindrical display. The device used here was developed by some of the inventors (Tomohiro Kusudo, Ikuo Honda: All-round 3D video display, 1 color moving image display system, 3D image conference 2002, pp 8 9-2 and 2002.) based on real-time image display. The specifications are shown in Table 1.

[Table 1] Pixel pitch 1 [mm]

Number of pixels 1254 (H) 256 (V)

Viewing angle 360 ° (60 ° per pixel)

Ray angle interval 1 ⁰

3D image size 0200 256 [mm]

Number of colors 4096 (12b i t)

Frame memory capacity 6.9 G B

Equipment size 800W 800D 1 100H [mm] [0033] In principle, the device cannot be wired directly from the outside because the light source part is rotating! Therefore, image information is transmitted to the inside using a device called a slip ring. In the experiment, real-time image transmission for several viewpoints of parallax images is achieved by changing the transmission part as fast as possible while maintaining the hardware configuration of the previously developed device and rewriting the entire internal logic. I was able to cope with. The transmission speed of image information is about 10MBZ sec, which corresponds to the transmission speed of images for about 4 viewpoints at 30fps.

[0034] An ideal figure when presenting an image outward is to present a sufficiently high density parallax image. This is because it is possible to handle multi-person observation without performing viewpoint tracking. Although real-time transmission is not possible, the device can present parallax images at 1-degree intervals. Therefore, first, a multi-parallax image was displayed as a still image. A digital video camera 19 was installed in the 3D display device 1 (TWISTER III) with the first shooting function, and the entire circumference was acquired by rotating around the person at low speed and displayed on this experimental device. As shown in Fig. 5, an appropriate image was observed depending on the viewing direction, and natural stereoscopic vision was possible. In particular, when moving around the display, I felt a very high sense of realism due to the effect of motion parallax, and it seemed as if my face was floating in a cylinder.

[0035] The display device used in the experiment can display a three-dimensional image in a cylindrical space having a diameter of about 200 mm. For telecommunications applications, at least a diameter of about 300-400mm may be required. However, this size can be achieved by simply increasing the size with the same configuration as the current device. With the current equipment, the transmission speed is about 30 fps, which is equivalent to 4 viewpoints. However, if the circuit configuration is to be strong, it is possible to easily increase the speed several times while using an inexpensive slip ring, and it is possible to realize input / output of stereo images from several viewpoints. In addition, if optical communication using an optical rotary joint is used to connect to a rotating body, the bandwidth can be greatly improved. It is also possible to transmit moving images for 360 viewpoints once in real time. Is possible.

[0036] By installing high-speed cameras as the cameras 19 and 26 to be used, it is possible to obtain and display high-density light information in real time. I expect it.

FIG. 6 is a diagram schematically showing a configuration of another 3D display device 4 ′ with a second imaging function that can be used when carrying out the method of the present invention. In FIG. 6, the same reference numerals as those shown in FIGS. 3 and 4 are added to the same reference numerals as those in the configuration of the second 3D display device 4 with a photographing function 4 shown in FIGS. The description is omitted. In the second three-dimensional display device 4 with a photographing function 4, the photographing device 123 is composed of a plurality of cameras 126 that are located outside the light shielding portion structure 122 and arranged at predetermined intervals in the circumferential direction. To do. The plurality of cameras 126 are supported by an attachment structure 130 configured to attach the plurality of cameras 126 to the light emitting element array structure 121 without hindering the rotation of the light shielding portion structure 122. When the light shielding unit structure 122 rotates at a speed of about lOO rpm, the presence of the plurality of cameras 126 is not particularly disturbing. As the position of the force lens, U is a position where the light of the one-dimensional light emitting element array force is not blocked as much as possible. Specifically, the position in the circumferential direction is an intermediate position between two adjacent one-dimensional light-emitting element arrays, and the position in the radial direction is as close to the one-dimensional light-emitting element array as possible at a position that does not hit the light shielding structure 12. Preferred, is the position.

Industrial applicability

[0038] In a mutual tele-existence environment composed of 3D display devices with the first shooting function (the aforementioned TWISTE R) that have been proposed in the past, participants can see the situation in which multiple people gathered together. Can only be realized in a virtual environment in the form of a 3D display device (TWISTER) with a shooting function. However, according to the present invention, by using the 3D display device with the second shooting function, the human inside the 3D display device with the first shooting function is added to the 3D display device with the second shooting function. As 3D images can exist in real space, it is possible to create a state in which multiple people who are actually present are mixed with humans who are terrestrial. Of course, if a plurality of 3D display devices with a second photographing function are present at the second point, the number of people who are tele-distance can be further increased. In that case, it is only necessary to selectively connect the 3D display device with the first shooting function and the plurality of 3D display devices with the second shooting function.

Claims

The scope of the claims

A 3D display device with a first shooting function, which is arranged at a first point and has a three-dimensional video presentation function that presents a stereoscopic video that can be viewed with the naked eye and a shooting function that takes a picture of a person at the first point; ,

The second shooting function, which is located at a second point away from the first point and has a three-dimensional image presentation function that presents a stereoscopic image that can be viewed with the naked eye and a shooting function that captures a person at the second point. With a 3D display device with

Presenting the video of the person at the first point captured by the first 3D display device with the first photographing function to the person at the second point as a stereoscopic image by the 3D display device with the second photographing function And

Presenting the image of the person at the second point captured by the 3D display device with the second shooting function to the person at the first point as a stereoscopic image with the 3D display device with the first shooting function This is a remote communication method using a 3D display device with a shooting function that enables communication between people in remote locations.

The first three-dimensional display device with a photographing function includes a first composite rotating structure that rotates around a person at the first point,

The first composite rotating structure has a predetermined light emitting element array pair formed of a left eye light emitting element array and a right eye light emitting element array arranged at predetermined intervals in the circumferential direction. A plurality of first light-emitting element array structures configured with a space therebetween, and the first light-emitting element array structures disposed inside the light-emitting element array structures corresponding to the plurality of light-emitting element arrays, A first light shielding part structure in which a plurality of light shielding parts are arranged at predetermined intervals in the circumferential direction so as to present a stereoscopic image to the person at the first point by the parallax of both eyes of the person located in And a structure having a first photographing device for photographing a person at the first point,

The second imaging function-equipped 3D display device includes a second composite rotating structure disposed in the center of a plurality of persons at the second point;

Second light emission comprising a plurality of one-dimensional light emitting element arrays in which the second composite rotating structure is arranged at a predetermined interval in the circumferential direction and a plurality of one-dimensional light emitting element arrays arranged at a predetermined interval in the circumferential direction. Elementary The child row structure and the second light emitting element row structure are arranged outside the second light emitting element row structure, and stand on a plurality of people at the second point by parallax of both eyes of the plurality of people at the second point, respectively. A second light-shielding portion structure in which a plurality of light-shielding portions are arranged at predetermined intervals in the circumferential direction so as to present a body image; and the second light-shielding portion structure positioned outside the second composite rotating structure A remote communication method using a three-dimensional display device with a photographing function, characterized in that a device having a structure including a second photographing device for photographing a plurality of persons at two points is used.

[2] In the second three-dimensional display device with a photographing function, the second light emitting element array structure and the second light shielding section structure have a rotational speed of the second light emitting element array structure. It is configured to rotate in opposite directions under conditions that are slower than the rotation speed of the second light shielding part structure,

The second imaging device is attached to the second light emitting element array structure so as to rotate together with the second light emitting element array structure and image a plurality of people at the second point. A remote communication method using the three-dimensional display device with a photographing function according to claim 1.

[3] The second imaging device includes a plurality of two-dimensional light-emitting element arrays that are arranged between two adjacent one-dimensional light-emitting element arrays that constitute the second light-emitting element array structure. The camera power is composed and

A first polarizing plate is disposed outside each of the plurality of one-dimensional light-emitting element arrays constituting the second light-emitting element array structure;

3. The plurality of light shielding portions of the second light shielding portion structure are each configured by a second deflecting plate that blocks passage of light that has passed through the first polarizing plate. A remote communication method using the described 3D display device with a photographing function.

[4] The second imaging device includes a plurality of camera forces that are located outside the second light-shielding part structure and arranged at predetermined intervals in the circumferential direction.

The plurality of cameras are supported by an attachment structure configured to attach the plurality of cameras to the second light emitting element array structure without hindering rotation of the second light shielding portion structure. A remote communication method using the 3D display device with a photographing function according to claim 2.

[5] Shooting function with a complex rotating structure placed in the center of multiple people viewing stereoscopic images 3D display device with

The composite rotating structure is

A light-emitting element array structure configured such that a plurality of the one-dimensional light-emitting element arrays arranged at predetermined intervals in the circumferential direction are arranged at predetermined intervals in the circumferential direction;

A plurality of light-shielding portions are arranged at predetermined intervals in the circumferential direction so as to present stereoscopic images to the plurality of people by parallax of the binocular eyes of the plurality of people, disposed outside the light emitting element array structure. A light-shielding part structure,

A structure including a photographing device for photographing the plurality of persons located outside the composite rotating structure;

The light emitting element array structure and the light shielding part structure rotate in opposite directions under the condition that the rotational speed of the light emitting element array structure is slower than the rotational speed of the light shielding part structure. Is composed of

The imaging device is mounted on the light emitting element array structure so as to rotate together with the light emitting element array structure and image the plurality of persons.

The imaging device is composed of a plurality of cameras respectively disposed between two adjacent one-dimensional light emitting element rows of the plurality of one-dimensional light emitting element rows constituting the light emitting element row structure.

A first polarizing plate is disposed outside each of the plurality of one-dimensional light emitting element arrays constituting the light emitting element array structure;

The three-dimensional display with a photographing function, wherein the plurality of light-shielding portions of the light-shielding portion structure are each configured by a second deflecting plate that blocks light passing through the first polarizing plate. apparatus.

6. The three-dimensional display device with a photographing function according to claim 5, wherein a rotation speed of the light emitting element array structure is 1Z10 or less of a rotation speed of the light shielding portion structure.

[7] A three-dimensional display device with a photographing function having a composite rotating structure arranged in the center of a plurality of people viewing stereoscopic images,

The composite rotating structure is

One-dimensional light emitting element arrays arranged at predetermined intervals in the circumferential direction are A plurality of light emitting element array structures that are arranged at intervals, and

The photographing apparatus includes a plurality of camera forces that are located outside the light shielding portion structure and arranged at predetermined intervals in the circumferential direction.

The plurality of cameras are supported by an attachment structure configured to attach the plurality of cameras to the light emitting element array structure without obstructing rotation of the light shielding portion structure. A 3D display device with a shooting function.

8. The three-dimensional display device with a photographing function according to claim 7, wherein a rotation speed of the light emitting element array structure is 1Z10 or less of a rotation speed of the light shielding portion structure.