JP2006078597A - Remote communication method in which 3-dimensional display device with shooting function is used and three-dimensional display with camera which is used in the same method - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a remote communication method capable of performing remote communication by using three-dimensional display devices with shooting functions in the state that a plurality of persons gathers in a room. <P>SOLUTION: In this remote communication method, a 1st three-dimensional display device with a shooting function 1 which is equipped with a three-dimensional video images presenting function which presents three-dimensional video images 2 which can be visually recognized with naked eyes, and which can photograph a person 3 existing at a first place is arranged at the first place and a 2nd three-dimensional display device with a shooting function 4 which is equipped with a three-dimensional video images presenting function which presents three-dimensional video images 5 which can be visually recognized with naked eyes, and which can photograph persons 6 to 8 existing at a second place is arranged at the second place. <P>COPYRIGHT: (C)2006,JPO&NCIPI

Description

  The present invention relates to a remote communication method using a three-dimensional display device with a photographing function that provides a stereoscopic image that can be viewed with the naked eye, and a three-dimensional display device with a camera used in the method.

  Realization of line-of-sight matching is an important issue in video presentation systems used for remote communication, and it is necessary to shoot a user's figure without obstructing it while presenting a stereoscopic video to the user. A part of the inventors of the present application has proposed the autostereoscopic display “TWISTER” as a three-dimensional display device with a photographing function in which a camera and a display unit are rotated around a user and both are coexisted in a time-sharing manner as a method for realizing the above. [Non-Patent Document 1]. This device realizes a 360-degree field of view for the user by rotating a one-dimensional LED array in which light-emitting diodes (LEDs) are arranged in a vertical direction around the user, and is equipped with a video camera. Take a picture of the user. As a result, it is possible to take a picture of the user as seen from the position on the screen and realize line-of-sight matching during face-to-face communication. In addition, right-eye and left-eye LED arrays are prepared, and a light-shielding plate called a parallax barrier is installed in front of the LED array and rotated together to realize autostereoscopic viewing.

  Figure 7 shows the Internet homepage “www.jst.go.jp/kisoken/seika/zensen/01tachi/” [Non-Patent Document 2] that publicly announces the research results of the “strategic imagination promotion project” conducted by the applicant. It is a conceptual diagram of the mutual communication system published in.

  In addition, as a multiplex hologram, a one-dimensional light source array in which light-emitting elements such as LEDs are arranged in a line in the vertical direction is used as one of the three-dimensional display devices that can be observed from the entire 360-degree circumference with the naked eye. Some inventors of this application have proposed the three-dimensional display apparatus of the structure rotated inside the shape parallax barrier [a nonpatent literature 3, 4, and 5].

Further, Japanese Patent Laid-Open No. 2003-195214 [Patent Document 1] proposes a stereoscopic display device using a light-emitting array and a parallax barrier that are circularly scanned.
Kenji Tanaka, Shinya Hayashi, Ichiro Kawasaki, Masahiko Inami, ▲ 舘 ▼ ▲ Susumu ▼ "Two-stereo video display TWISTER III", Journal of the Institute of Image Information and Television Engineers, Vol. 58, no. 6, pp. 819, 26, 2004. 1/3 page of www.jst.go.jp/kisoken/seika/zensen/01tachi/ Tomohiro Kusudo and Makoto Sato, “Real-time 3D display around the circumference by rotating 1D light source array”, Imaging Journal, Vol. no. 3, pp. 399-404, March 1999 Tomohiro Shindo, Yoshihiro Kashiwagi, Ikuo Honda, Makoto Sato, “All-round 3D Video Display” 3D Image Conference '99 Proceedings, no. 4-4, pp. 99-104, June 1999 “Two-Dimensional 3D Display” written by Tomohiro Shindo, Yoshihiro Kashiki, Ikuo Honda and Makoto Sato, Electronic Information Communication Instruments Journal D-II Vol. J84-D-II No. 6 pp1003-1011 June 2001 JP 2003-195214 A (Applicant: Seiko Epson Corporation)

  As can be seen from the conceptual diagram of FIG. 7, in the mutual tele-existence environment configured by a plurality of three-dimensional display devices with a photographing function that has been proposed in the past, in the state where a plurality of people gathered together, each participant photographed one by one. Communication could only be realized in a virtual environment in a 3D display device with functions.

  An object of the present invention is to provide a remote communication method capable of performing remote communication using a three-dimensional display device with a photographing function in a state where a plurality of people meet together, and a three-dimensional display device with a photographing function used in the method. There is to do.

  Another object of the present invention is to provide a three-dimensional display device with a photographing function capable of easily mounting a photographing device comprising a plurality of cameras on a three-dimensional display device in which a plurality of persons can visually recognize a stereoscopic image with the naked eye.

  In the remote communication method using the three-dimensional display device with a photographing function of the present invention, a stereoscopic image presenting function that presents a stereoscopic image that is arranged at the first point and can be visually recognized with the naked eye, and a person at the first point is photographed. A three-dimensional display device with a first photographing function having a photographing function, a three-dimensional image presenting function for presenting a three-dimensional image that is disposed at a second point distant from the first point and is visible with the naked eye, and a second A second three-dimensional display device with a photographing function provided with a photographing function for photographing a person at a point is used. Then, the video of the person at the first point imaged by the three-dimensional display device with the first photographing function is presented to the person at the second point as a three-dimensional image with the second three-dimensional display device with the photographing function. Then, the video of the person at the second point imaged by the 3D display device with the second shooting function is presented to the person at the first point as a stereoscopic image by the 3D display device with the first shooting function. This enables communication between people in remote locations.

  In the communication method according to the present invention, the first three-dimensional display device with a photographing function having a structure including a first composite rotating structure that rotates around a person at a first point is used. The first composite rotating structure has a structure including a first light emitting element array structure, a first light shielding unit structure, and a first imaging device. In the first light emitting element array structure, a pair of light emitting element arrays composed of a light emitting element array for the left eye and a light emitting element array for the right eye arranged at predetermined intervals in the circumferential direction has a predetermined number in the circumferential direction. It has a structure in which a plurality are arranged at intervals. The first light-shielding part structure is disposed inside the light-emitting element array structure corresponding to the plurality of light-emitting element arrays, and is provided to the person at the first point due to the binocular parallax of the person at the first point. It has a structure in which a plurality of light shielding portions are arranged at predetermined intervals in the circumferential direction so as to present a stereoscopic image. The first photographing device is arranged to photograph a person at the first point. The first imaging device can be composed of a plurality of cameras. The plurality of cameras may be arranged at a position where photographing is performed through a slit formed between two adjacent light shielding parts of the plurality of light shielding parts, may be arranged on the light shielding plate, or may be arranged on the light shielding plate. You may arrange | position so that imaging | photography can be taken through the hole from the back side of a light-shielding plate, and those arrangement | positioning positions are arbitrary if it is a position which does not block the light emitted from a light emitting element row | line | column. The plurality of cameras are preferably arranged at equal intervals in the circumferential direction. The number of cameras is arbitrary, and is not necessarily equal to the number of light emitting element array pairs.

  In addition, the second 3D display device with a photographing function used in the present invention includes a second composite rotating structure disposed at the center of a plurality of persons at the second point. The second composite rotating structure also has a structure including a second light emitting element array structure, a second light shielding unit structure, and a second imaging device. The second light emitting element array structure has a structure in which a plurality of one-dimensional light emitting element arrays arranged at predetermined intervals in the circumferential direction are arranged at predetermined intervals in the circumferential direction. In addition, the second light shielding unit structure is disposed outside the second light emitting element array structure, and is provided to each of the plurality of persons at the second point due to the binocular parallax of the plurality of persons at the second point. It has a structure in which a plurality of light shielding portions are arranged at predetermined intervals in the circumferential direction so as to present a stereoscopic image. And the 2nd imaging device is arranged so that a plurality of people who are in the 2nd point located outside the 2nd compound rotating structure can be photoed. Similarly to the second imaging device, the second imaging device can be composed of a plurality of cameras, and the arrangement of the second imaging device is arbitrary.

  According to the method of the present invention, a person at the first point enters the inside of the first three-dimensional display with a photographing function, while watching a plurality of persons at the second point sufficiently around. Moreover, it is possible to have a conversation while keeping an eye on a plurality of people at the second point. A plurality of people at the second point can watch the stereoscopic video of the person at the first point provided by the second 3D display device with a photographing function in the center, and each person can You can talk while keeping an eye on the person at the point. Therefore, according to the present invention, it is possible to perform remote communication in a state in which a plurality of persons who have been impossible in the past meet together. Of course, depending on the method of use, there may be only one person at the second point.

  Note that in the second three-dimensional display device with a photographing function, the second light emitting element array structure and the second light shielding element structure have a second light shielding element structure in which the rotation speed of the second light emitting element array structure is the second light shielding element structure. It is preferable to be configured to rotate in opposite directions under conditions that are slower than the rotational speed of the body. In this case, the second imaging device is mounted on the second light emitting element array structure so as to photograph a plurality of persons at the second point by rotating the second imaging device together with the second light emitting element array structure. It is preferable to do this. The imaging device is configured to include at least a camera including an image sensor, and is actually configured by a plurality of cameras. When the photographing apparatus is mounted on the second light shielding unit structure that rotates at a high speed, a commercially available camera has a problem in that the electronic circuit of the camera cannot withstand centrifugal force and connection failure occurs. In addition, power can be supplied to a plurality of cameras and images can be taken out using a slip ring or the like. However, a slip ring for high-speed rotation is very expensive and there is a problem that the price of the entire apparatus increases. Furthermore, there is a problem that the image is blurred when the camera is moved at high speed. Therefore, if the photographing device is mounted on the second light emitting element array structure that rotates at a low speed, the photographing device can be mounted on the three-dimensional display device without causing the above-described problem. Therefore, if it does in this way, the cheap 2nd imaging device comprised using the commercially available camera can be mounted | worn with a 3D display apparatus with a 2nd imaging device.

  When a plurality of cameras constituting the second imaging device are mounted on the second light emitting element row structure, for example, adjacent to the plurality of one-dimensional light emitting element rows constituting the second light emitting element row structure. A plurality of cameras can be arranged between two matching one-dimensional light emitting element arrays. In this case, since a plurality of people outside are photographed through the plurality of slits formed in the second light shielding portion structure, the amount of light is insufficient depending on the number of slits and the width dimension. To do. Therefore, the first polarizing plate is disposed outside each of the plurality of one-dimensional light emitting element rows constituting the second light emitting element row structure. The plurality of light shielding portions of the second light shielding portion structure are each constituted by a second deflection plate that blocks passage of light that has passed through the first deflection plate. As these deflecting plates, linear polarizing plates, circular deflecting plates, elliptical deflecting plates, etc. can be used. In this way, light from the outside of the second light shielding part structure reaches the plurality of cameras through the light shielding part and the slits between the light shielding parts, so that there is no shortage of light quantity. In addition, since the first polarizing plate is arranged outside the plurality of one-dimensional light emitting element arrays, the second polarizing plate and the second light blocking part are configured on the optical path of light from the one-dimensional light emitting element array. The light from the one-dimensional light-emitting element array is blocked from passing by the light-shielding portion comprising the second deflection plate, and the light-shielding portion comprising the first polarizing plate and the second deflection plate. When the two do not overlap, the light from the one-dimensional light emitting element array is radiated to the outside through the first polarizing plate and the slit formed in the second light shielding portion structure. As a result, a necessary amount of light can be introduced into the camera without losing the function of the light shielding unit.

  The second imaging device can also be configured by a plurality of cameras that are located outside the second light shielding portion structure and are arranged at predetermined intervals in the circumferential direction. In this case, the plurality of cameras are provided by an attachment structure configured to attach the plurality of cameras to the second light emitting element array structure without hindering the rotation of the second light shielding portion structure. It only has to be supported. In this way, since there is no obstacle in front of the camera, a necessary and sufficient amount of light can be easily ensured.

  Note that the 3D display device with a photographing function used in the remote communication method of the present invention, the three-dimensional display device with a photographing function arranged at the center of a plurality of people viewing stereoscopic images, includes a composite rotating structure and is described below. What has the structure of this is preferable. That is, the composite rotating structure includes a light emitting element array structure in which a plurality of one-dimensional light emitting element arrays arranged at predetermined intervals in the circumferential direction are arranged at predetermined intervals in the circumferential direction, and light emission A light-shielding element that is arranged outside the element array structure, and in which a plurality of light-shielding portions are arranged at predetermined intervals in the circumferential direction so as to present stereoscopic images to a plurality of persons by parallax between the eyes of the plurality of persons, respectively. It has a structure including a partial structure and a photographing device that photographs a plurality of persons located outside the composite rotating structure. Then, the light emitting element array structure and the light shielding part structure are configured to rotate in opposite directions under the condition that the rotation speed of the light emitting element array structure is slower than the rotation speed of the light shielding element structure. In addition, the photographing apparatus is attached to the light emitting element array structure so as to rotate together with the light emitting element array structure and photograph a plurality of people. In addition, the photographing apparatus is constituted by a plurality of cameras respectively disposed between two adjacent one-dimensional light emitting element rows of the plurality of one-dimensional light emitting element rows constituting the light emitting element row structure. Then, a first polarizing plate is disposed outside each of the plurality of one-dimensional light emitting element arrays constituting the light emitting element array structure. Further, the plurality of light shielding portions of the light shielding portion structure are each configured by a second deflecting plate that blocks passage of light that has passed through the first polarizing plate.

  The photographing apparatus is configured by a plurality of cameras that are located outside the light shielding portion structure and arranged at predetermined intervals in the circumferential direction, and the plurality of cameras can be arranged without obstructing the rotation of the light shielding portion structure. The camera may be supported by an attachment structure configured to attach to the light emitting element array structure.

  In any case, the rotational speed of the light-emitting element array structure is preferably 1/10 or less of the rotational speed of the light shielding portion structure. With such a speed, the weight of the photographing apparatus does not become an obstacle particularly when the light emitting element array structure is rotated.

  In a mutual tele-existence environment composed of three-dimensional display devices with the first imaging function (TWISTER described above) that have been proposed in the past, a group of people gathered together, and each participant has a shooting function. This could only be realized in a virtual environment in the form of a 3D display device (TWISTER). However, according to the present invention, by using the 3D display device with the second shooting function, the human body inside the 3D display device with the first shooting function is added to the 3D display device with the second shooting function. Since 3D images can exist in real space, it is possible to create a state in which a person who is tele-existing is mixed among a plurality of persons who are actually present. Of course, when a plurality of 3D display devices with a second photographing function are present at the second point, it is possible to further increase the number of people who are tele-distance. In this case, the first three-dimensional display device with the photographing function and a plurality of second three-dimensional display devices with the photographing function may be selectively connected.

  Hereinafter, embodiments of a remote communication method of the present invention will be described in detail with reference to the drawings. FIG. 1 is a diagram showing a concept when the method of the present invention is carried out. In FIG. 1, reference numeral 1 is a first image that is arranged at a first point and has a three-dimensional image presentation function for presenting a three-dimensional image 2 that can be viewed with the naked eye, and a photographing function for photographing a person 3 at the first point. 1 shows a three-dimensional display device with an imaging function (inward-facing three-dimensional display device). Reference numeral 4 denotes a stereoscopic video presenting function that presents a stereoscopic video 5 that is arranged at a second point away from the first point and can be viewed with the naked eye, and a photographing function that photographs the people 6 to 8 at the second point. A second three-dimensional display device with photographing function (outward-facing three-dimensional display device) is provided.

  In the remote communication method according to the embodiment of the present invention, an image of the person 3 at the first point captured by the first three-dimensional display device 1 with a photographing function is stereoscopically displayed on the three-dimensional display device 4 with the second photographing function. The video 3 ′ is presented to the person at the second point. Then, the images of the persons 6 to 8 at the second point imaged by the 3D display device 4 with the second imaging function are first converted into stereoscopic images 6 ′ to 8 ′ by the 3D display device 1 with the first imaging function. Present to the person at the point.

In order to realize this, both the first and second 3D display devices 1 and 4 with a photographing function need to have a function of performing both imaging and presentation of a stereoscopic video.

  Regarding the presentation of the stereoscopic video, since there is only one person inside the first three-dimensional display device 1 with an imaging function (inward-facing system), it may be a binocular stereoscopic video that performs viewpoint tracking. On the other hand, in the 3D display device 4 with the second photographing function (outward system), since a plurality of people observe at the same time, it is necessary to cope with it. Moreover, although it is imaging, since it is only necessary to acquire information according to the request on the corresponding presentation side, the second three-dimensional display device 4 with an imaging function (outward system) may be for two eyes. The field of view needs to be 360 degrees around the circumference, but the user 3 of the first 3D display device 1 with an imaging function (inward system) does not see 360 degrees around the circumference at the same time. It is only necessary to be able to shoot with a sufficiently wide angle of view. The first three-dimensional display device 1 with photographing function (inward system) needs to support a plurality of viewpoints.

  The presentation of a stereoscopic image in the first three-dimensional display device 1 with an imaging function (inward-facing system) has already been realized by the aforementioned TWISTER. In addition, regarding the imaging of the first three-dimensional display device 1 with an imaging function (inward system), a method using a shutter timing control of a rotating camera (Takuya Hayashi, Kenji Tanaka, Tomohiro Kusudo, ▲ 舘 ▼ ▲ Provide: The construction of a stereo imaging system based on camera shutter timing control, Proceedings of the 8th Annual Meeting of the VR Society of Japan, pp.269 / 70, 2003.) has already been proposed.

  2A and 2B are diagrams for explaining the structure and concept of the first proposed three-dimensional display device 1 with a photographing function. The first three-dimensional display device 1 with a photographing function includes a complex rotating structure 10 that rotates around a person 3 at a first point. The composite rotating structure 10 includes a light emitting element array structure 11, a light shielding unit structure 12, and an imaging device 13. The light-emitting element array structure 12 includes a light-emitting element array pair 16 composed of a left-eye light-emitting element array 14 and a right-eye light-emitting element array 15 arranged at predetermined intervals in the circumferential direction. A plurality of structures are arranged with an interval of. The left-eye light-emitting element array 14 and the right-eye light-emitting element array 15 have a structure in which a plurality of light-emitting elements containing three-color light emitters are arranged in one package. In practice, a plurality of light emitting element array pairs 16 are supported by a cylindrical frame (not shown). The light shielding unit structure 12 is arranged inside the light emitting element array structure 11 so as to correspond to the plurality of light emitting element arrays 16, and the person 3 is parallaxed by the binocular parallax of the person 3 located inside (first point). A plurality of light-shielding portions 17 have a structure arranged at predetermined intervals in the circumferential direction so as to present stereoscopic images (6 ′ to 8 ′). Each light shielding portion 17 has a plate shape and is supported by a mounting plate of a corresponding light emitting element array 16 via a support member 18. In this example, the photographing device 13 is arranged so as to photograph the person 3 at the center (first point) inside through a slit S formed between two adjacent light shielding portions 17, 17. Specifically, it is mounted on a cylindrical frame (not shown) so that the camera 19 is positioned between two adjacent light emitting element rows 16 and 16. Here, the camera 19 is a video camera used for so-called continuous shooting. Driving power to the plurality of light emitting element arrays 16 and the plurality of cameras 19 is supplied via an electric brush from a power source provided in a support device (not shown) that rotatably supports the composite rotating structure 10. Although the composite rotating structure 10 is heavy, a battery may be mounted on the composite rotating structure 10 and used as a power source. The video signal from the camera 19 is transmitted to a transmission device provided in a support device (not shown) that rotatably supports the composite rotary structure 10 using a slip ring and an optical rotary joint. Needless to say, the video signal may be transmitted using wireless communication means using radio waves or light. The video signal received from the 3D display device 4 with the second photographing function is wirelessly transmitted to a light emitting element row driving circuit (not shown) mounted on the composite rotating structure 10, and the light emitting element row driving circuit (not shown) receives the video signal. The light emitting diodes of the plurality of light emitting element rows are caused to blink based on the video signal. Note that illustration and description of the rotation drive mechanism for rotating the composite rotary structure 10 are omitted.

  FIG. 3 shows the basic structure of the second three-dimensional display device 4 with a photographing function used in the embodiment of the present invention, excluding the photographing device 23. FIG. 4 is a layout diagram for explaining the internal configuration of the second three-dimensional display device 4 with a photographing function. This outward-facing three-dimensional display device 4 with a photographing function includes a composite rotating structure 20 disposed at the center of a plurality of persons 6 to 8 (FIG. 1) located at a second point. The composite rotating structure 20 has a structure including a light emitting element array structure 21, a light shielding portion structure 22, and an imaging device 23. The light emitting element array structure 21 has a structure in which a plurality of one-dimensional light emitting element arrays 24 arranged at predetermined intervals in the circumferential direction are arranged at predetermined intervals in the circumferential direction. The one-dimensional light emitting element row 24 has a structure in which a plurality of light emitting diodes are attached to a support member so as to form a row in the vertical direction (vertical direction). The plurality of one-dimensional light-emitting element arrays 24 constituting the light-emitting element array structure 21 have a structure in which monochromatic light-emitting diodes are arranged in the vertical direction, and three types of one-dimensional light-emitting elements of red, green, and blue The light emitting element array structure 21 is configured by repeatedly arranging the arrays in the circumferential direction. As with the light-emitting element array used in the first three-dimensional display device 1 with a photographing function, a structure in which a plurality of light-emitting elements containing three color light emitters are vertically arranged in one package is used. You can also. The plurality of one-dimensional light emitting element arrays 24 are connected by a ring-shaped thin connection frame (not shown) arranged at the upper and lower positions of each one-dimensional light emitting element array 24. Therefore, from the outside, the inner space of the plurality of one-dimensional light emitting element rows 24 can be seen through the slit 25 formed between two adjacent one-dimensional light emitting element rows 24.

  As shown in FIG. 4, in the second three-dimensional display device 4 with a photographing function used in the present embodiment, a plurality of cameras 26 constituting the photographing device 23 includes two adjacent one-dimensional light emitting element arrays 24. They are arranged in the slits 25 formed therebetween. The plurality of cameras 26 are fixed to the main body of the one-dimensional light emitting element array 24. Driving power to the plurality of one-dimensional light emitting element arrays 24 and the plurality of cameras 26 is supplied via an electric brush from a power source provided in a support device (not shown) that rotatably supports the composite rotating structure 20. Although the light emitting element array structure 21 is heavy, a battery may be mounted on the light emitting element array structure 21 and used as a power source. The video signal from the camera 26 is transmitted to a transmission device provided in a support device (not shown) that rotatably supports the light emitting element array structure 21 using radio. The video signal received from the first three-dimensional display device 1 with a photographing function 1 is wirelessly transmitted to a light emitting element row driving circuit (not shown) mounted on the light emitting element row structure 21, and the light emitting element row driving circuit (not shown) Based on the received video signal, the light emitting diodes LED of the plurality of primary light emitting element rows 24 are blinked. In the present embodiment, as shown in FIG. 4, linear polarizing plates are arranged as first deflecting plates 27 on the outer sides of the plurality of one-dimensional light emitting element rows 24 constituting the light emitting element row structure 21. . These first deflection plates 27 are attached to the main body on which the light-emitting diodes LED constituting the one-dimensional light-emitting element array 24 are mounted through appropriate attachment means.

  The light shielding part structure 22 called a parallax barrier is arranged outside the light emitting element array structure 21 and is given to each person by parallax of the binocular eyes of a plurality of people 6 to 8 outside the 3D display device 4 with a photographing function. Each has a structure in which a plurality of light-shielding portions 28 are arranged at predetermined intervals in the circumferential direction so as to present stereoscopic images. The light emitting element array structure 21 and the light shielding part structure 22 rotate in opposite directions under the condition that the rotation speed of the light emitting element array structure 21 is slower than the rotation speed of the light shielding element structure 22. A description of the drive structure for rotating the light emitting element array structure 21 and the light shielding portion structure 22 in the opposite directions is omitted. In this example, the plurality of light shielding portions 28 of the light shielding portion structure 22 are orthogonal to the linear polarizing plate used as the first deflection plate 27 disposed outside the one-dimensional light emitting element array 24. Each is constituted by a deflection plate (second deflection plate). In the case where the light shielding part structure 22 has a structure including a plurality of individual light shielding parts 28 as in the structure shown in FIG. 3, all of the plurality of light shielding parts 28 may be configured by deflection plates. Moreover, as shown in FIG. 4, it is good also as a continuous structure by arranging the several light-shielding part 28 and the light passage part which permeate | transmits light alternately. In the case of FIG. 4, the light passage part located between two adjacent light shielding parts 28 can be formed of a transparent sheet. In this example, a linear polarizing plate is used as the first deflecting plate 27, but it is needless to say that a circular deflecting plate, an elliptically deflecting plate, or the like can be used.

  If the light shielding portions 28 are individually provided as in the principle structure of FIG. 3, the width dimension of the slit 29 between the two adjacent light shielding portions 28 becomes very narrow, and the camera 26 has a necessary and sufficient amount of light from the outside. Will not enter. Therefore, if the light shielding portion 28 is configured by the second deflecting plate that blocks the passage of the light that has passed through the first polarizing plate 27, a necessary and sufficient amount of light enters the camera 26 from the outside. That is, when viewed from the light emitting diode LED, even the light that has passed through the first polarizing plate 27 does not radiate to the outside as it hits the light shielding portion 28. On the other hand, when viewed from the outside, the light that has passed through the light-shielding portion 28 and entered the interior reaches the camera 26 only by being blocked by the first polarizing plate 27. Accordingly, when such a configuration is adopted, it is possible to put a necessary and sufficient amount of light into the camera 26.

  Regarding the basic principle of the three-dimensional display device 4 used in the present embodiment, a part of the inventor has already announced as "a cylindrical three-dimensional display by a method of rotating a one-dimensional light source array and a parallax barrier" (圓Michi Tomohiro, Yasuhiro Kashiki, Ikuo Honda, Makoto Sato: All-round 3D display, IEICE Transactions, Vol. J84-D-II, No. 6. pp. 1003, 011, 2001.). The announced prototype can present different images in a narrow space such as once. The principle of operation is as follows. As shown in FIG. 3, both the light shielding part structure 22 (parallax barrier) and the light emitting element array structure 21 inside thereof rotate. The direction of rotation is opposite. By rotating a plurality of one-dimensional light emitting elements 24 provided in the light emitting element array structure 21, a cylindrical surface image can be displayed. The relative position changes at a high speed by the rotation of both the light emitting element array structure 21 and the light shielding portion structure 22 (parallax barrier). As a result, the direction of the thin light beam exiting through the slit of the light shielding unit structure 22 is scanned, and the light beam is reproduced in a time-sharing manner by changing the luminance of the light-emitting diode elements constituting the one-dimensional light-emitting element array in synchronization therewith. . As a result, it is possible to show different images (stereoscopic images) depending on the viewing direction.

  In the three-dimensional display device 4, a plurality of cameras 26 are attached to the light emitting element array structure in the same manner as the first three-dimensional display device with a photographing device 1 (TWISTER) in order to match the line of sight. The specific light shielding part structure (parallax barrier) 22 rotates at a high speed of 1800 rpm in a prototype, for example. It is not practical to attach a camera to this and rotate it due to centrifugal problems. On the other hand, the light-emitting element array structure 21 rotates at a speed of about 100 rpm by the prototype. Since 100 rpm is a relatively low speed, it is sufficiently possible to mount the camera 26 between two adjacent one-dimensional light emitting element arrays 24.

  In the mutual teleexistence system proposed in the present embodiment, the information flows from the first 3D display device 1 with an imaging function (inward imaging system) to the second 3D display device 4 with an imaging function (outside). Flow of image information transmitted to direction presentation system (multiple observers) and 3D display device 1 with first imaging function from 3D display device 4 with second imaging function (outward imaging system) in reverse direction It is divided into two flows of image information transmitted to (inward presentation system: one observer). Among these, in the flow from the inward imaging system to the outward presentation system, it is necessary to obtain and display parallax images (light ray information) sufficiently densely in order to be completely compatible with a large number of people. This is an enormous amount of information. However, when considering actual communication, it is thought that there is enough practicality to handle several people, so the amount of information can be reduced by simplifying the number of viewpoints. . One method is to measure the viewpoint position of each observer, acquire images for the number of observers corresponding to each position with an inward-facing imaging system, and observe each image with an outward-facing display system. It is to display in the direction of. For measuring the observer's viewpoint position using a non-contact / non-wearing method, there are practical methods such as a method using simple image measurement and a method that uses retroreflection of the human fundus for presentation of images following the viewpoint. Is also used. In many examples, the viewpoint tracking is performed for one person, but it is considered that the viewpoint position measurement itself can easily cope with a plurality of persons. Further, imaging from an arbitrary direction has already been proposed and studied in the imaging system of the first three-dimensional display device 1 with a photographing function (TWISTER).

Next, in order to confirm the feasibility of the second three-dimensional display device 4 with a photographing function, an image display experiment was performed using an actual cylindrical display. The apparatus used here was developed by a part of the inventors (Tomohiro Kusudo, Ikuo Honda: All-round 3D moving image display-color moving image display system-, 3D Image Conference 2002 Proceedings, pp. 89.2, 2002.), and corresponding to real-time real image display. The specifications are shown in Table 1.

In principle, this apparatus cannot be directly wired from the outside because the light source part is rotating. Therefore, image information is transmitted to the inside using a device called a slip ring. In the experiment, it is possible to support real-time image transmission for parallax images for several viewpoints by speeding up the transmission part as much as possible with the hardware configuration of the previously developed device and rewriting the entire internal logic. I did it. The transmission speed of image information is about 10 MB / sec, which corresponds to the speed at which images for approximately four viewpoints are transmitted at 30 fps.

  The ideal appearance when presenting an image outward is to present a sufficiently high density parallax image. This is because it is possible to handle multi-person observation without performing viewpoint tracking. Although real-time transmission is not possible, the apparatus can present parallax images at intervals of one degree. Therefore, first, a multi-parallax image was displayed as a still image. The digital video camera 19 is mounted on the first three-dimensional display device 1 with a photographing function (TWISTERIII), and the entire circumference image is acquired by rotating around the person at a low speed, and the image is displayed on the experimental apparatus. As shown in FIG. 5, an appropriate image was observed according to the viewing direction as shown in FIG. 5, and natural stereoscopic vision was possible. In particular, when moving around the display, I felt a very high sense of realism due to the effect of motion parallax, as if my face was floating in a cylinder.

  The display device used in the experiment can display a stereoscopic image in a cylindrical space having a diameter of about 200 mm. It seems that at least a diameter of about 300 to 400 mm is necessary for the application of remote communication. However, this size can be realized by simply increasing the size with the same configuration as the current apparatus. In the current apparatus, the transmission speed is about 30 fps, which corresponds to four viewpoints. However, with an appropriate circuit configuration, it is possible to easily increase the speed several times even when using an inexpensive slip ring, and input / output of stereo images from several viewpoints can be realized. In addition, if optical communication using an optical rotary joint is used for connection with a rotating body, the bandwidth can be greatly improved, and moving images for 360 viewpoints can be transmitted in real time once. is there.

  As the cameras 19 and 26 to be used, by installing a high-speed camera, it is possible to acquire and display high-density light information in real time, and applications other than remote communication can be expected.

  FIG. 6 is a diagram schematically showing the configuration of another second 3D display device 4 ′ with a photographing function that can be used when carrying out the method of the present invention. In FIG. 6, the same reference numerals as those in FIG. 3 and FIG. 4 are added to the reference numerals in FIG. 3 and FIG. 4 in the same parts as the configuration of the second 3D display device 4 with the photographing function shown in FIG. The description is omitted. In the second three-dimensional display device 4 ′ with a photographing function, the photographing device 123 is composed of a plurality of cameras 126 that are located outside the light-shielding portion structure 122 and arranged at predetermined intervals in the circumferential direction. The plurality of cameras 126 are supported by an attachment structure 130 configured to attach the plurality of cameras 126 to the light emitting element array structure 121 without hindering the rotation of the light shielding portion structure 122. When the light shielding unit structure 122 rotates at a speed of about 100 rpm, the presence of the plurality of cameras 126 is not particularly obtrusive. A preferable position of the camera is a position where light from the one-dimensional light emitting element array is not blocked as much as possible. Specifically, the position in the circumferential direction is an intermediate position between two adjacent one-dimensional light emitting element arrays, and the position in the radial direction is a position as close to the one-dimensional light emitting element array as possible at a position that does not hit the light shielding unit structure 12. It is preferable.

It is a figure used in order to demonstrate the concept in the case of implementing the method of this invention. (A) And (B) is a figure used in order to demonstrate the structure and concept of the 3D display apparatus with a 1st imaging | photography function already proposed. It is a figure which shows the basic structure except the imaging device in the 3D display apparatus with a 2nd imaging function used by embodiment of this invention. FIG. 6 is a layout diagram for explaining an internal configuration of a second three-dimensional display device with a photographing function. It is a figure used in order to explain an experimental result. It is a schematic perspective view which shows the structure of the other example of the 3D display apparatus with a 2nd imaging | photography function which can be used with the method of this invention. It is a figure which shows the concept of the conventional method.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 3D display apparatus with 1st imaging | photography function 4 3D display apparatus with 2nd imaging | photography function 10 Composite rotation structure 11 Light emitting element row | line | column structure 12 Light-shielding part structure 13 Imaging device 14, 15 Light emitting element row | line | column 16 Light emitting element Row pair 17 Shielding portion 19 Camera 20 Composite rotating structure 21 Light emitting element row structure 22 Shielding portion structure 23 Imaging device 26 Camera 27 Linear polarizing plate 28 Shielding portion 29 Slit

Claims (7)

A three-dimensional display device with a first photographing function, which is arranged at a first point and has a three-dimensional image presentation function for presenting a stereoscopic image that can be viewed with the naked eye and a photographing function for photographing a person at the first point;
A second shooting function provided with a three-dimensional video presentation function that presents a three-dimensional video that can be viewed with the naked eye, and a shooting function that shoots a person at the second point, which is arranged at a second point away from the first point With a three-dimensional display device with
Presenting the image of the person at the first point imaged by the three-dimensional display device with the first photographing function to the person at the second point as a stereoscopic image by the three-dimensional display device with the second photographing function. And
Presenting the image of the person at the second point imaged by the 3D display device with the second photographing function to the person at the first point as a stereoscopic image with the three-dimensional display device with the first photographing function. A remote communication method using a 3D display device with a photographing function that realizes communication between people in remote locations by
As the three-dimensional display device with the first photographing function, comprising a first composite rotating structure that rotates around a person at the first point,
The first composite rotating structure has a light emitting element array pair composed of a left eye light emitting element array and a right eye light emitting element array arranged at predetermined intervals in the circumferential direction. A plurality of first light emitting element array structures that are arranged at intervals, and are disposed inside the light emitting element array structure corresponding to the plurality of light emitting element arrays, and are at the first point. A first light shielding part structure in which a plurality of light shielding parts are arranged at predetermined intervals in the circumferential direction so as to present a stereoscopic image to a person at the first point by parallax of human eyes; Using a structure having a first photographing device for photographing a person at the first point,
As the second three-dimensional display device with a photographing function, comprising a second composite rotating structure disposed in the center of a plurality of people at the second point,
A second light emitting element in which a plurality of one-dimensional light emitting element arrays in which the second composite rotating structure is arranged at a predetermined interval in the circumferential direction are arranged at a predetermined interval in the circumferential direction. A stereoscopic image is arranged on the outer side of the row structure and the second light emitting element row structure, and each of the plurality of people at the second point by the parallax of both eyes of the plurality of people at the second point. A second light-shielding part structure in which a plurality of light-shielding parts are arranged at predetermined intervals in the circumferential direction, and the second point located outside the second composite rotating structure A remote communication method using a three-dimensional display device with a photographing function, characterized in that a device having a structure including a second photographing device for photographing a plurality of people in the area is used. In the second three-dimensional display device with a photographing function, the second light emitting element array structure and the second light shielding part structure have a second rotational speed of the second light emitting element array structure. It is configured to rotate in opposite directions under conditions that are slower than the rotational speed of the light shielding part structure.
The second imaging device is attached to the second light emitting element array structure so as to rotate together with the second light emitting element array structure and image a plurality of people at the second point. A remote communication method using the three-dimensional display device with a photographing function according to claim 1. The second imaging device includes a plurality of cameras disposed between two adjacent one-dimensional light emitting element rows of the plurality of one-dimensional light emitting element rows constituting the second light emitting element row structure. Configured,
A first polarizing plate is disposed outside each of the plurality of one-dimensional light emitting element arrays constituting the second light emitting element array structure;
3. The plurality of light shielding portions of the second light shielding portion structure are each configured by a second deflecting plate that blocks passage of light that has passed through the first polarizing plate. A remote communication method using the described three-dimensional display device with a photographing function. The second imaging device is composed of a plurality of cameras that are located outside the second light-shielding part structure and are arranged at predetermined intervals in the circumferential direction.
The plurality of cameras are supported by an attachment structure configured to attach the plurality of cameras to the second light emitting element array structure without obstructing the rotation of the second light shielding portion structure. A remote communication method using the three-dimensional display device with a photographing function according to claim 2. A three-dimensional display device with a photographing function used in a remote communication method using the three-dimensional display device with a photographing function according to any one of claims 1 to 4,
A composite rotating structure arranged in the center of a plurality of people viewing a stereoscopic image,
The composite rotating structure is
A light-emitting element array structure configured by arranging a plurality of one-dimensional light-emitting element arrays arranged at predetermined intervals in the circumferential direction;
A plurality of light-shielding portions are arranged at predetermined intervals in the circumferential direction so as to present stereoscopic images to the plurality of people by parallax of both eyes of the plurality of people, disposed outside the light emitting element array structure. A light-shielding part structure,
A structure including a photographing device that photographs the plurality of persons located outside the composite rotating structure;
The light emitting element array structure and the light shielding part structure rotate in opposite directions under the condition that the rotational speed of the light emitting element array structure is slower than the rotational speed of the light shielding part structure. Configured,
The imaging device is mounted on the light emitting element array structure so as to rotate together with the light emitting element array structure and image the plurality of persons.
The imaging device is composed of a plurality of cameras respectively disposed between two adjacent one-dimensional light emitting element arrays of the plurality of one-dimensional light emitting element arrays constituting the light emitting element array structure.
A first polarizing plate is disposed outside each of the plurality of one-dimensional light-emitting element arrays constituting the light-emitting element array structure,
The three-dimensional display device with photographing function, wherein the plurality of light-shielding portions of the light-shielding portion structure are each constituted by a second deflection plate that blocks passage of light that has passed through the first polarizing plate. . A three-dimensional display device with a photographing function used in a remote communication method using the three-dimensional display device with a photographing function according to any one of claims 1 to 4,
A composite rotating structure arranged in the center of a plurality of people viewing a stereoscopic image,
The composite rotating structure is
A light-emitting element array structure configured by arranging a plurality of one-dimensional light-emitting element arrays arranged at predetermined intervals in the circumferential direction;
A plurality of light-shielding portions are arranged at predetermined intervals in the circumferential direction so as to present stereoscopic images to the plurality of people by parallax of both eyes of the plurality of people, disposed outside the light emitting element array structure. A light-shielding part structure,
A structure including a photographing device that photographs the plurality of persons located outside the composite rotating structure;
The light emitting element array structure and the light shielding part structure rotate in opposite directions under the condition that the rotational speed of the light emitting element array structure is slower than the rotational speed of the light shielding part structure. Configured,
The imaging device is mounted on the light emitting element array structure so as to rotate together with the light emitting element array structure and image the plurality of persons.
The imaging device is composed of a plurality of cameras located outside the light-shielding part structure and arranged at predetermined intervals in the circumferential direction,
The plurality of cameras are supported by an attachment structure configured to attach the plurality of cameras to the light emitting element array structure without obstructing rotation of the light shielding portion structure. A three-dimensional display device with a photographing function.   The three-dimensional display device with a photographing function according to claim 5 or 6, wherein a rotation speed of the light emitting element array structure is 1/10 or less of a rotation speed of the light shielding portion structure.

Images