JP4135040B2 - Imaging device, display device, imaging / display device, and three-dimensional image display system using them - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an imaging device, a display device, an imaging / display device, and a three-dimensional image display system using them. Specifically, by configuring the light input to the imaging surface of the imaging device to be output as it is from the display surface of the display device, a 3D image display system or the like for obtaining a highly realistic 3D image is provided. It is related.
[0002]
[Prior art]
The purpose of television is to make something that exists in one place appear as if it is in front of a remote viewer. However, the presentation of an image in a conventional television system has a basic mechanism of projecting an image in the direction in which the camera is facing onto one plane and reproducing it in a remote place.
[0003]
[Problems to be solved by the invention]
As a result, the conventional television system has the following problems.
[0004]
(A) The information presented is the color (including brightness) of each point on the display plane, and this means that the actual imaging object is viewed as a shape only when viewed at a certain distance from the front of the display. If you change the angle or distance from the display of the viewpoint, you will see an image that does not actually exist.
[0005]
Specifically, with regard to the angle, for example, the sphere should look like a circle when viewed from anywhere, but the image of the sphere is displayed on the display, and when viewed from a direction that is not front, it is no longer a circle. In terms of distance, it is a problem of perspective.In many cases, if you approach an object while looking at an object, the appearance of the object is not a similar shape, but it deforms, even if you are approaching the display The object displayed above only changes in size and does not deform.
[0006]
(B) When a person sees a real thing, he can see various things in focus by adjusting the focus of his eyes according to what he wants to see. The target to be seen in a focused state is determined only by which object is in focus when an image is captured.
[0007]
(C) When viewing an actual object, the focus is on the position where the object exists, but in order to view an image displayed on the display without blur, the focus of the eyes is always on the display screen. It is necessary to adjust it to the top, and the sense of depth and three-dimensionality are lost.
[0008]
(D) When looking at the display, the image on the plane with the information that enters the left eye and the right eye is viewed from a different direction, so that the depth of the object being viewed is all the position of the display There is no sense of depth or three-dimensionality.
[0009]
Note that a three-dimensional display that presents separate planar images for the left and right eyes to express a three-dimensional effect has been proposed in the past, but this solves only the problem (d). There was no one that could solve all the above problems.
[0010]
Therefore, an object of the present invention is to provide a three-dimensional image display system that obtains a three-dimensional image with high presence.
[0011]
[Means for Solving the Problems]
  In the imaging apparatus according to the present invention, a plurality of imaging pixel units are arranged in a surface shape, and each imaging pixel unit includes a plurality of light receiving units that detect spectrum information of light input from a plurality of directions.The plurality of light receiving means includes a plurality of light guide tubes that guide light input from the plurality of directions, and a plurality of light receiving elements that detect spectral information of the light guided by the plurality of light guide tubes. The light guide tube has a light-absorbing substance on a side surface thereof.Is.
[0012]
  In the display device according to the present invention, a plurality of display pixel units are arranged in a surface shape, and each of the display pixel units outputs a plurality of lights having predetermined spectral information related to the pixels in a plurality of directions. MeansThe plurality of light emitting means includes a plurality of light emitting elements that emit light having predetermined spectral information, and a plurality of light guide tubes that output light emitted from the plurality of light emitting elements in the plurality of directions. And the light guide tube has a light-absorbing substance on a side surface thereof.Is.
[0013]
  Further, the three-dimensional image display system according to the present invention includes a plurality of light receiving means in which a plurality of imaging pixel units are arranged in a surface shape, and each imaging pixel unit detects spectral information of light input from a plurality of directions. HaveThe plurality of light receiving means includes a plurality of light guide tubes that guide light input from the plurality of directions, and a plurality of light receiving elements that detect spectral information of the light guided by the plurality of light guide tubes.And a plurality of display pixel portions arranged in a surface shape corresponding to the plurality of imaging pixel portions of the imaging device, and the display pixel portions are input to the imaging pixel portions from a plurality of directions, respectively. A plurality of light emitting means for outputting light corresponding to the light in the same direction as the input direction is provided.The plurality of light emitting means includes a plurality of light emitting elements that emit light having predetermined spectral information and a plurality of light guide tubes that output light emitted from the plurality of light emitting elements in the plurality of directions. YesDisplay deviceIn addition, at least one of the light guide tube included in the imaging device and the light guide tube included in the display device has a light-absorbing substance on a side surface thereof.It is characterized by this.
[0014]
  In the present invention, a plurality of image pickup pixel portions are arranged in a surface shape on the image pickup surface of the image pickup apparatus. Each imaging pixel unit has a plurality of light receiving means for detecting spectrum information of light input from a plurality of directions. For example, the plurality of light receiving means includes a plurality of light guide tubes that guide light input from a plurality of directions, and a plurality of light receiving elements that detect spectral information of the light guided by the plurality of light guide tubes. .These light guide tubes have light-absorbing substances on their side surfaces.
[0015]
  A plurality of display pixel portions are arranged in a surface shape on the screen of the display device. Each display pixel unit transmits light having predetermined spectral information related to the pixel to a plurality of pixels.
It has a plurality of light emitting means for outputting in the direction. For example, the plurality of light emitting means includes a plurality of light emitting elements that emit light having predetermined spectral information and a plurality of light guide tubes that output light emitted from the plurality of light emitting elements in a plurality of directions. Yes.These light guide tubes have light-absorbing substances on their side surfaces.
[0016]
Light corresponding to light input from a plurality of directions to a plurality of light receiving units of each imaging pixel unit of the imaging device is output in the same direction as the input direction from a plurality of light emitting units of each display pixel unit of the display device. By doing so, the light input to the imaging surface of the imaging device appears to be output as it is from the display surface of the display device. This makes it possible to see a three-dimensional image with a high sense of realism as if there is an actual imaging target beyond the display surface of the display device even if it is stopped from any position by any number of people or moving. Can be obtained.
[0017]
  In the imaging / display apparatus according to the present invention, a plurality of pixel units are arranged in a surface shape, and each pixel unit includes a plurality of light receiving units that detect spectrum information of light input from a plurality of directions. Each has a plurality of light emitting means for outputting light having predetermined spectral information related to each pixel in a plurality of directions.AboveThe light receiving meansMultiple directions aboveGuides more input lightpluralLight guide tube and abovepluralLed by light guide tubeRuDetect spectral information of lightpluralAnd a light receiving element. the abovepluralThe light emitting means emits light having predetermined spectral informationpluralA light emitting element and the abovepluralThe light emitted from the light emitting elementMultiple directions aboveOutput topluralAnd a light guide tube. At least one of the light receiving unit and the light guide tube of the light emitting unit has a light-absorbing substance on a side surface of the light guide tube.
[0018]
In addition, the three-dimensional image display system according to the present invention includes first and second imaging / display devices, and each of the first and second imaging / display devices has a plurality of pixel portions in a surface shape. Each pixel unit has a plurality of light receiving means for detecting spectral information of light input from a plurality of directions and outputs light having predetermined spectral information related to the pixels in a plurality of directions. The plurality of light emitting means of each pixel portion of the second imaging / display device emit light corresponding to light input from a plurality of directions to each pixel portion of the first imaging / display device. Light that is output in the same direction as the input direction, and the plurality of light emitting means of each pixel unit of the first imaging / display device correspond to light that is input to each pixel unit of the second imaging / display device from a plurality of directions. Output in the same direction as the input direction. It is intended.
[0019]
In the present invention, the imaging / display apparatus has a plurality of pixel portions arranged in a surface shape. Each pixel unit has a plurality of light receiving means for detecting spectrum information of light input from a plurality of directions, and a plurality of lights having predetermined spectrum information related to the pixels in a plurality of directions. It has light emitting means.
[0020]
Light corresponding to light input from a plurality of directions to a plurality of light receiving means of each pixel unit of the first imaging / display device from a plurality of light emitting units of each pixel unit of the second imaging / display device A state in which light input to the imaging surface of the first imaging / display device appears to be output as it is from the display surface of the second imaging / display device by being output in the same direction as the input direction It becomes. On the other hand, light corresponding to light input from a plurality of directions to a plurality of light receiving units of each pixel unit of the second imaging / display device is emitted from a plurality of light emitting units of each pixel unit of the first imaging / display device. By outputting in the same direction as the input direction, the light input to the imaging surface of the second imaging / display device is output as it is from the display surface of the first imaging / display device. It becomes visible.
[0021]
Thus, on either side of the first and second imaging / display devices, it appears as if there is an actual imaging target beyond the display surface, and the other party's three-dimensionality is highly realistic. An image can be obtained.
[0022]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described with reference to the drawings. FIG. 1 shows a circuit configuration of a three-dimensional image display system 10 as the first embodiment. The image display system 10 includes a camera 11 as an imaging device, an encoder 12 that performs compression encoding on image data Sa output from the camera 11, and digital modulation on output data of the encoder 12. And a modulator 13 that obtains transmission data Sb to be processed and sent to the network 14.
[0023]
In addition, a demodulator 15 that performs digital demodulation processing on transmission data Sb sent over the network 14, and a decoder 16 that performs compression decoding processing on the output data of the demodulator 15 to obtain image data Sa. And a display 17 as a display device for displaying a three-dimensional image based on the image data Sa.
[0024]
2A to 2D and FIG. 3A illustrate the configuration of the imaging surface 11F of the camera 11. 2A is a front view of the imaging surface 11F viewed from the imaging target side, FIG. 2B is a schematic side view of the imaging surface 11F, FIGS. 2C and 3A are enlarged sectional views of the imaging surface 11F, and FIG. It is the front enlarged view shown expanded. As shown in FIG. 2A, the imaging surface 11F includes a plurality of imaging pixel units P (1,1) to P (i, j) arranged in a matrix. This arrangement is an example, and a plurality of imaging pixel units may be arranged in a plane.
[0025]
In addition, each imaging pixel unit P (1,1) to P (i, j) includes a plurality of light receiving units that detect spectrum information of light input from a plurality of directions (25 directions in the illustrated example). It is said. As shown in FIGS. 2C, D, and 3A, each light receiving unit includes a plurality of light guide tubes 11a that guide light input from a plurality of directions, and spectral information of the light guided by the plurality of light guide tubes 11a. It comprises a plurality of light receiving elements 11b to be detected.
[0026]
In this case, the direction of each light guide tube 11a is made different so as to correspond to a plurality of directions. 2C and FIG. 3A show the case where the direction of the light guide tube 11a changes only in the vertical direction, but the direction of the light guide tube 11a also changes in the horizontal direction. Therefore, when each imaging pixel unit is enlarged and viewed, the opening of the light guide tube 11a looks as shown in FIG. 2D.
[0027]
In order to guide only light input from a certain direction corresponding to the direction of the light guide tube in each light guide tube 11a to the light receiving element 11b, the side surface side of each light guide tube 11a is covered with a light-absorbing substance 11c such as carbon. Yes. Thus, by covering the side surface side of each light guide tube 11a with the light absorbing material 11c, the light input to each light guide tube 11a has a large deviation from the direction in which the light guide tube faces. It is absorbed by 11c.
[0028]
As each light receiving element 11b, one that reacts to light of a specific wavelength or a plurality of photoelectric conversion elements corresponding to, for example, R (red), G (green), and B (blue) is used. .
[0029]
Since the imaging surface 11F of the camera 11 has the above-described structure, input is performed from a plurality of directions at a plurality of points on the plane, that is, at the imaging pixel units P (1,1) to P (i, j). The spectrum of light can be detected.
[0030]
2E to 2H and FIG. 3B show the configuration of the display surface 17F of the display 17. 2E is a front view of the display surface 17F viewed from the light output side, FIG. 2F is a schematic side view of the display surface 17F, FIGS. 2G and 3B are enlarged sectional views of the display surface 17F, and FIG. It is the front enlarged view which expanded and showed. Note that the front view and the enlarged front view shown in FIGS. 2E and 2H are diagrams in which left and right are reversed so that the relationship with the imaging surface 11F of the camera 11 can be easily described.
[0031]
The display surface 17F is formed to be approximately equal in size and shape to the imaging surface 11F. As shown in FIG. 2E, the display surface 17F has a plurality of display pixels corresponding to the plurality of image pickup pixel portions P (1,1) to P (i, j) of the image pickup surface 11F in one-to-one correspondence. The parts Q (1,1) to Q (i, j) are arranged in a matrix. Note that this arrangement is an example, and it is only necessary that a plurality of display pixel portions are arranged corresponding to the plurality of imaging pixel portions of the imaging surface 11F described above. In this case, a plurality of imaging pixel portions P (1,1) to P (i, j) on the imaging surface 11F and a plurality of display pixel portions Q (1,1) to Q (i, j) on the display surface 17F As shown by the broken line, the pixel portion at the same position corresponds to the front view of the imaging surface 11F (FIG. 2A) and the front view of the display surface 17F reversed right and left (FIG. 2E).
[0032]
In addition, each display pixel portion Q (1,1) to Q (i, j) is a plurality of light receiving means of each imaging pixel portion P (1,1) to P (i, j) of the imaging surface 11F described above. A plurality of light emitting means corresponding to one-to-one. The plurality of light emitting means of the display pixel portions Q (1,1) to Q (i, j) have a plurality of directions on the imaging pixel portions P (1,1) to P (i, j) of the imaging surface 11F. For outputting light corresponding to more input light in the same direction as the input direction.
[0033]
Here, the plurality of light receiving means of each imaging pixel portion P (1,1) to P (i, j) and the plurality of light emitting means of each display pixel portion Q (1,1) to Q (i, j) As shown by the broken line, a front enlarged view (FIG. 2D) of the imaging surface 11F and a front enlarged view (FIG. 2H) in which the left and right sides of the display surface 17F are reversed correspond to those in a point-symmetrical position.
[0034]
As shown in FIGS. 2G and 2H, the plurality of light emitting means of the display pixel portions Q (1,1) to Q (i, j) j) a plurality of light emitting elements 17b for emitting light having spectral information that looks like light from a plurality of directions inputted to the light receiving elements 11b constituting the plurality of light receiving means, and the plurality of light emitting elements 17b. And a plurality of light guide tubes 17a that output light emitted in the same direction as the input direction.
[0035]
In this case, the directions of the plurality of light guide tubes 17a constituting the plurality of light emitting means of the display pixel portions Q (1,1) to Q (i, j) are set to the corresponding imaging pixel portions P (1,1). The directions of the plurality of light guide tubes 11a constituting the plurality of light receiving means of P (i, j) are symmetrical with respect to the left and right sides. 2G shows a case in which the direction of the light guide tube 17a changes only in the vertical direction, but the direction of the light guide tube 17a also changes in the horizontal direction. Therefore, the opening of the light guide tube 17a that can be seen when each imaging pixel unit is enlarged is as shown in FIG. 2H.
[0036]
In order to output light emitted from each light emitting element 17b in a certain direction corresponding to the direction of the light guide tube from the light guide tube 17a, the side surface side of each light guide tube 17a is covered with a light-absorbing substance 17c such as carbon. Yes. Thus, by covering the side surface side of each light guide tube 17a with the light absorbing material 17c, the light input to each light guide tube 17a has a large deviation from the direction of the light guide tube. It is absorbed by 17c. In addition, as each light emitting element 17b, one which emits light of a specific wavelength, or a plurality of LEDs (light emitting diodes) corresponding to, for example, R, G and B are used.
[0037]
Returning to FIG. 1, the circuit configuration of the camera 11 and the display 17 will be described. First, the camera 11 will be described. The camera 11 includes a plurality of amplifiers 11e that respectively amplify the detection outputs of the plurality of light receiving elements 11b constituting the plurality of light receiving units of the imaging pixel portions P (1,1) to P (i, j) of the imaging surface 11F. The A / D converter 11f for converting the output signals of the plurality of amplifiers 11e from analog signals to digital signals, and a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 11b output from the A / D converter 11f. A multiplexer 11g for multiplexing and a parallel / serial converter 11h for converting the output data of the multiplexer 11g from parallel data to serial data to obtain image data Sa are configured.
[0038]
The display 17 corresponds to the serial / parallel converter 17e for converting the image data Sa from serial data to parallel data, and the detection output of the plurality of light receiving elements 11b in the camera 11 from the output data of the converter 17e. A demultiplexer 17f for separating a plurality of data, a D / A converter 17g for converting a plurality of data output from the demultiplexer 17f from a digital signal to an analog signal, and a camera 11 output from the D / A converter 17g Based on signals corresponding to the detection outputs of the plurality of light receiving elements 11b, a plurality of display pixel portions Q (1,1) to Q (i, j) of the display surface 17F corresponding to the plurality of light receiving elements 11b. And a driver 17h for driving a plurality of light emitting elements 17b constituting the light emitting means.
[0039]
Next, the operation of the three-dimensional image display system 10 shown in FIG. 1 will be described. Light relating to an imaging target is supplied to each imaging pixel unit P (1,1) to P (i, j) on the imaging surface 11F of the camera 11 from a plurality of directions. Then, in each of the imaging pixel portions P (1,1) to P (i, j), spectral information of light input from a plurality of directions is detected by a plurality of light receiving elements 11b constituting a plurality of light receiving means. .
[0040]
In the camera 11, the detection outputs of the plurality of light receiving elements 11b constituting the plurality of light receiving means of the image pickup pixel portions P (1,1) to P (i, j) of the image pickup surface 11F are amplified by the amplifier 11e. The analog signal is converted to a digital signal by the A / D converter 11f, then multiplexed by the multiplexer 11g, and further converted from parallel data to serial data by the parallel / serial converter 11h to obtain the image data Sa.
[0041]
Image data Sa output from the camera 11 is compression-encoded by the encoder 12 and further digitally modulated by the modulator 13. The transmission data Sb output from the modulator 13 is sent to the network 14. Transmission data Sb obtained from the network 14 is digitally demodulated by the demodulator 15 and further compressed and decoded by the decoder 16. The image data Sa output from the decoder 16 is supplied to the display 17.
[0042]
In the display 17, the image data Sa is converted from serial data to parallel data by the serial / parallel converter 17e, and the demultiplexer 17f converts the data into a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 11b in the camera 11. To be separated. The plurality of data is converted into an analog signal by the D / A converter 17g, and the plurality of light receptions are performed based on signals corresponding to the detection outputs of the plurality of light receiving elements 11b in the camera 11 output from the D / A converter 17g. A plurality of light emitting elements 17b constituting a plurality of light emitting means of the display pixel portions Q (1,1) to Q (i, j) of the display surface 17F corresponding to the element 11b are driven by a driver 17h.
[0043]
Thereby, each imaging pixel part P (1,1) -P of the camera 11 is received from a plurality of light emitting means of each display pixel part Q (1,1) -Q (i, j) of the display surface 17F of the display 17. Light corresponding to light input from a plurality of directions at (i, j) is output in the same direction as the input direction. Therefore, even if it stops at any position from what position or moves, it looks as if there is an actual imaging target beyond the display surface 17F of the display 17.
[0044]
As described above, the three-dimensional image display system 10 shown in FIG. 1 is configured such that light input to the imaging surface 11F of the camera 11 is output as it is from the display surface 17F of the display 17, and the display 17 side This makes it possible to obtain a highly realistic 3D image.
[0045]
The three-dimensional image display system 10 supplies the image data Sa output from the camera 11 to the display 17 side via the network 14 after being compression-encoded and digitally modulated. For example, FIG. A configuration as shown in FIG. 4 to 6, portions corresponding to those in FIG. 1 are denoted by the same reference numerals.
[0046]
A three-dimensional image display system 10 </ b> A shown in FIG. 4 is configured to supply the image data Sa output from the camera 11 directly to the display 17. The three-dimensional image display system 10B shown in FIG. 5 transmits the transmission data Sb output from the modulator 13 through the transmission antenna 21, and supplies the transmission data Sb received by the reception antenna 22 to the demodulator 15. Is. Further, the three-dimensional image display system 10C shown in FIG. 6 supplies the image data Sa output from the camera 11 to the recording device 23 and records it on a tape-shaped or disk-shaped recording medium, a semiconductor memory or the like, and the reproducing device 24. Thus, the image data Sa is reproduced from a tape-shaped or disk-shaped recording medium, a semiconductor memory, or the like, and the image data Sa is supplied to the display 17.
[0047]
By the way, the three-dimensional image display system 10 shown in FIG. 1 displays an image captured by the camera 11 on the display 17, and only one-way image communication in which the image at the first point is sent to the second point. Cannot be realized. However, it is convenient if bidirectional image communication is possible in which the image at the first point is sent to the second point and at the same time the image at the second point is sent to the first point.
[0048]
FIG. 7 shows the configuration of a three-dimensional image display system 20 as a second embodiment of the present invention. The three-dimensional image display system 20 includes an imaging / display system 21 on the first point side and an imaging / display system 22 on the second point side. These imaging / display systems 21 and 22 are connected to a network. 23.
[0049]
The imaging / display system 21 includes a display camera 24 as an imaging / display device, an encoder 25 that performs compression encoding processing on image data Sa1 output from the display camera 24, and output data of the encoder 25. A modulator 26 that performs digital modulation processing to obtain transmission data Sb1, and transmits the transmission data Sb1 to the imaging / display system 22 via the network 23, and transmissions transmitted from the imaging / display system 22 The transmission / reception unit 27 for receiving the data Sb2, the demodulator 28 that performs digital demodulation processing on the transmission data Sb2, and the compression decoding processing on the output data of the demodulator 28 to the display camera 24 And a decoder 29 for obtaining supplied image data Sa2.
[0050]
The imaging / display system 22 includes a display camera 31 as an imaging / display device, an encoder 32 that performs compression encoding processing on image data Sa2 output from the display camera 31, and output data of the encoder 32. A modulator 33 that performs digital modulation processing to obtain transmission data Sb2, and transmits the transmission data Sb2 to the image pickup / display system 21 via the network 23, and also transmits from the image pickup / display system 21. The transmission / reception unit 34 for receiving the data Sb1, the demodulator 35 that performs digital demodulation processing on the transmission data Sb1, and the display camera 31 that performs compression decoding processing on the output data of the demodulator 35 And a decoder 36 for obtaining image data Sa1 to be supplied.
[0051]
8A to 8D and 9A show the configuration of the imaging / display surface 24F of the display camera 24. FIG. 8A is a front view of the imaging / display surface 24F viewed from the imaging target side or the image observer side, FIG. 8B is a schematic side view of the imaging / display surface 24F, and FIGS. 8C and 9A are enlarged cross-sectional views of the imaging / display surface 24F. FIG. 8D is an enlarged front view showing an enlarged pixel portion described later. As shown in FIG. 8A, the imaging / display surface 24F includes a plurality of pixel portions R (1,1) to R (i, j) arranged in a matrix. This arrangement is an example, and a plurality of pixel portions may be arranged in a plane.
[0052]
Each pixel portion R (1,1) to R (i, j) has a plurality of light receiving means for detecting spectrum information of light input from a plurality of directions (25 directions in the illustrated example), and A plurality of light emitting means for outputting light corresponding to light input from a plurality of directions to each pixel unit S (1,1) to S (i, j) of the display camera 31 to be described later in the same direction as the input direction. have.
[0053]
As shown in FIGS. 8C, 8D, and 9A, the plurality of light receiving units include a plurality of light guide tubes 24a that guide light input from a plurality of directions, and spectral information of light guided by the plurality of light guide tubes 24a. And a plurality of light receiving elements 24b for detecting. As shown in FIGS. 8C, D, and 9A, the plurality of light emitting means are arranged on the light receiving element 31b that constitutes the plurality of light receiving means of the pixel portions S (1,1) to S (i, j) of the display camera 31. A plurality of light emitting elements 24c for emitting light having spectral information that looks similar to light from a plurality of input directions, and light emitted by the plurality of light emitting elements 24c in the same direction as the input direction. It comprises a plurality of light guide tubes 24d that output.
[0054]
In this case, the directions of the light guide tubes 24a and 24d are made different so as to correspond to a plurality of directions. 8C and 9A show the case where the directions of the light guide tubes 24a and 24d change only in the vertical direction, but the directions of the light guide tubes 24a and 24d also change in the horizontal direction. ing. Therefore, when each pixel portion is enlarged, the openings of the light guide tubes 24a and 24d appear as shown in FIG. 8D.
[0055]
In order to guide only light input from a certain direction corresponding to the direction of the light guide tube in each light guide tube 24a to the light receiving element 24b, the light emitted from each light emitting element 24c is guided from the light guide tube 24d to the light guide tube. The side surfaces of the light guide tubes 24a and 24d are covered with a light absorbing material 24e such as carbon. Thus, by covering the side surfaces of the light guide tubes 24a and 24d with the light-absorbing material 24e, the light input to the light guide tubes 24a and 24d has a large deviation from the direction in which the light guide tubes are directed. Things are absorbed by the light-absorbing material 24e.
[0056]
As each light receiving element 24b, one that reacts to light of a specific wavelength or a plurality of photoelectric conversion elements corresponding to, for example, R (red), G (green), and B (blue) is used. . Similarly, as each light emitting element 24c, one that emits light of a specific wavelength, or a plurality of LEDs (light emitting diodes) corresponding to, for example, R, G, and B is used.
[0057]
8E to H and FIG. 9B show the configuration of the imaging / display surface 31F of the display camera 31. FIG. 8E is a front view of the imaging / display surface 31F viewed from the imaging target side or the image observer side, FIG. 8F is a schematic side view of the imaging / display surface 31F, and FIGS. 8G and 9B are enlarged cross-sectional views of the imaging / display surface 31F. FIG. 8H is an enlarged front view showing an enlarged pixel portion to be described later. Note that the front view and the front enlarged view shown in FIGS. 8E and 8H are reversed from left to right to facilitate the explanation of the relationship with the imaging / display surface 24F of the display camera 24 described above.
[0058]
The imaging / display surface 31F is formed to be approximately equal in size and shape to the imaging / display surface 24F. As shown in FIG. 8E, the imaging / display surface 31F has a plurality of pixel portions R (1,1) to R (i, j) on the imaging / display surface 24F in a one-to-one correspondence. The pixel portions S (1,1) to S (i, j) are arranged in a matrix. Note that this arrangement is an example, and it is only necessary that the plurality of pixel portions are arranged in a one-to-one correspondence with the plurality of pixel portions of the imaging / display surface 24F described above. In this case, a plurality of pixel portions R (1,1) to R (i, j) on the imaging / display surface 24F and a plurality of pixel portions S (1,1) to S (i, j) on the imaging / display surface 31F. ) Corresponds to the pixel portion at the same position in the front view (FIG. 8A) of the imaging / display surface 24F and the front view (FIG. 8E) obtained by inverting the left and right of the imaging / display surface 31F, as shown by the broken line.
[0059]
Each pixel unit S (1,1) to S (i, j) includes a plurality of light receiving means of each pixel unit R (1,1) to R (i, j) of the imaging / display surface 24F described above. A plurality of light emitting means corresponding to one-to-one. A plurality of light emitting means of these pixel portions S (1,1) to S (i, j) are provided in a plurality of directions on each pixel portion R (1,1) to R (i, j) of the imaging / display surface 24F. For outputting light corresponding to more input light in the same direction as the input direction. Similarly, each pixel unit S (1,1) to S (i, j) emits a plurality of light emission of each pixel unit R (1,1) to R (i, j) of the imaging / display surface 24F described above. The means has a plurality of light receiving means corresponding one-to-one.
[0060]
Here, a plurality of light receiving means and light emitting means of each pixel portion R (1,1) to P (i, j) of the imaging / display surface 24F, and each pixel portion S (1,1) of the imaging / display surface 31F. The plurality of light emitting means and light receiving means of S (i, j) are, as shown by broken lines, an enlarged front view of the imaging / display surface 24F (FIG. 8D) and an enlarged front view in which the left and right of the imaging / display surface 31F are reversed. In the figure (FIG. 8H), the one in a point-symmetrical position corresponds.
[0061]
As shown in FIGS. 8G, H, and 9B, the plurality of light receiving units include a plurality of light guide tubes 31a that guide light input from a plurality of directions, and spectral information of light guided by the plurality of light guide tubes 31a. And a plurality of light receiving elements 31b for detecting. As shown in FIGS. 8G, H, and 9B, the plurality of light emitting means are provided on the light receiving element 24b that constitutes the plurality of light receiving means of the pixel portions R (1,1) to R (i, j) of the display camera 24. A plurality of light emitting elements 31c for emitting light having spectral information that looks similar to light from a plurality of input directions, and light emitted from the plurality of light emitting elements 31c in the same direction as the input direction. It is comprised from the some light guide tube 31d to output.
[0062]
In this case, the directions of the plurality of light guide tubes 31a constituting the plurality of light receiving means of the respective pixel portions S (1,1) to S (i, j) are in correspondence with the corresponding pixel portions R (1,1) to R. The directions of the plurality of light guide tubes 24d constituting the plurality of light emitting means (i, j) are symmetrical with respect to the left, right, and top. Similarly, the directions of the plurality of light guide tubes 31d constituting the plurality of light emitting means of the respective pixel portions S (1,1) to S (i, j) are in correspondence with the corresponding pixel portions R (1,1) to R. The directions of the plurality of light guide tubes 124a constituting the plurality of light receiving means (i, j) are symmetrical with respect to the left and right sides. 8G and 9B show a case where the directions of the light guide tubes 31a and 34d change only in the vertical direction, but the directions of the light guide tubes 31a and 34d also change in the horizontal direction. ing. Therefore, when each pixel portion is enlarged, the openings of the light guide tubes 31a and 31d appear as shown in FIG. 8H.
[0063]
In order to guide only light input from a certain direction corresponding to the direction of the light guide tube in each light guide tube 31a to the light receiving element 31b, the light emitted from each light emitting element 31c is further guided from the light guide tube 31d to the light guide tube. In order to output in a certain direction corresponding to this direction, the side surfaces of the light guide tubes 31a and 31d are covered with a light absorbing material 31e such as carbon. Thus, by covering the side surfaces of the light guide tubes 31a and 31d with the light-absorbing material 31e, the light input to the light guide tubes 31a and 31d has a large deviation from the direction in which the light guide tubes are directed. Things are absorbed by the light-absorbing material 31e.
[0064]
As each light receiving element 31b, one that reacts to light of a specific wavelength or a plurality of photoelectric conversion elements corresponding to, for example, R (red), G (green), and B (blue) is used. . Similarly, as each light emitting element 31c, one that emits light of a specific wavelength, or a plurality of LEDs corresponding to, for example, R, G, and B is used.
[0065]
Returning to FIG. 7, the circuit configuration of the display cameras 24 and 31 will be described. First, the display camera 24 will be described. The display camera 24 includes a plurality of amplifiers for amplifying the detection outputs of the plurality of light receiving elements 24b constituting the plurality of light receiving means of the pixel portions R (1,1) to R (i, j) of the imaging / display surface 24F. 24f, an A / D converter 24g for converting the output signals of the plurality of amplifiers 24f from analog signals to digital signals, and a plurality of detection outputs of the plurality of light receiving elements 24b output from the A / D converter 24g. A multiplexer 24h that multiplexes data and a parallel / serial converter 24i that converts the output data of the multiplexer 24h from parallel data to serial data to obtain image data Sa1 are provided.
[0066]
The display camera 24 corresponds to the serial / parallel converter 24j that converts the image data Sa2 from serial data to parallel data, and the detection output of the plurality of light receiving elements 31b in the display camera 31 from the output data of the converter 24j. A demultiplexer 24k for separating a plurality of data, a D / A converter 24m for converting a plurality of data output from the demultiplexer 24k from a digital signal to an analog signal, and a display camera output from the D / A converter 24m Based on the signals corresponding to the detection outputs of the plurality of light receiving elements 31b at 31, the pixel portions R (1,1) to R (i, j) of the imaging / display surface 24F corresponding to the plurality of light receiving elements 31b. Driver 24n for driving a plurality of light emitting elements 24c constituting a plurality of light emitting means The has.
[0067]
Next, the display camera 31 will be described. The display camera 31 includes a plurality of amplifiers that respectively amplify detection outputs of the plurality of light receiving elements 31b constituting the plurality of light receiving units of the pixel units S (1,1) to S (i, j) of the imaging / display surface 31F. 31f, an A / D converter 31g for converting the output signals of the plurality of amplifiers 31f from analog signals to digital signals, and a plurality of detection outputs of the plurality of light receiving elements 31b output from the A / D converter 31g. A multiplexer 31h for multiplexing data and a parallel / serial converter 31i for converting the output data of the multiplexer 31h from parallel data to serial data to obtain image data Sa2 are provided.
[0068]
The display camera 31 corresponds to the serial / parallel converter 31j for converting the image data Sa1 from serial data to parallel data, and the detection output of the plurality of light receiving elements 24b in the display camera 24 from the output data of the converter 31j. A demultiplexer 31k for separating a plurality of data, a D / A converter 31m for converting a plurality of data output from the demultiplexer 31k from a digital signal to an analog signal, and a display camera output from the D / A converter 31m 24, each pixel portion S (1,1) to S (i, j) of the imaging / display surface 31F corresponding to the plurality of light receiving elements 24b based on signals corresponding to the detection outputs of the plurality of light receiving elements 24b. Driver 31n for driving a plurality of light emitting elements 31c constituting a plurality of light emitting means The has.
[0069]
Next, the operation of the three-dimensional image display system 20 shown in FIG. 7 will be described. Light relating to an imaging target is supplied to each pixel portion R (1,1) to R (i, j) of the imaging / display surface 24F of the display camera 24 from a plurality of directions. In each of the pixel portions R (1, 1) to R (i, j), spectral information of light input from a plurality of directions is detected by a plurality of light receiving elements 24b constituting a plurality of light receiving means.
[0070]
In the display camera 24, the detection outputs of the plurality of light receiving elements 24b constituting the plurality of light receiving means of the respective pixel portions R (1, 1) to R (i, j) of the imaging / display surface 24F are amplified by the amplifier 24f. Then, the analog signal is converted into a digital signal by the A / D converter 24g, then multiplexed by the multiplexer 24h, and further converted from the parallel data to the serial data by the parallel / serial converter 24i to obtain the image data Sa1. .
[0071]
Image data Sa1 output from the display camera 24 is compression-encoded by the encoder 25 and further digitally modulated by the modulator 26. The transmission data Sb1 output from the modulator 26 is sent to the network 23 from the transmission / reception unit 27. Further, transmission data Sb1 acquired from the network 23 by the transmitting / receiving unit 34 is digitally demodulated by the demodulator 35 and further compressed and decoded by the decoder 36. The image data Sa1 output from the decoder 36 is supplied to the display camera 31.
[0072]
In the display camera 31, the image data Sa1 is converted from serial data to parallel data by the serial / parallel converter 31j, and the demultiplexer 31k corresponds to the detection outputs of the plurality of light receiving elements 24b in the display camera 24 described above. Separated into data. The plurality of data is converted from a digital signal to an analog signal by the D / A converter 31m, and based on signals corresponding to the detection outputs of the plurality of light receiving elements 24b in the display camera 24 output from the D / A converter 31m, A plurality of light emitting elements 31c constituting a plurality of light emitting means of the pixel portions S (1,1) to S (i, j) of the imaging / display surface 31F corresponding to the plurality of light receiving elements 24b are driven by a driver 31n. The
[0073]
Thereby, each pixel part R (1,1) of the display camera 24 is emitted from the plurality of light emitting means of each pixel part S (1,1) to S (i, j) of the imaging / display surface 31F of the display camera 31. Light corresponding to light input from a plurality of directions to ~ R (i, j) is output in the same direction as the input direction. Accordingly, even if it is stopped from any position and by how many people, it can be seen as if there is an actual imaging target beyond the imaging / display surface 31F of the display camera 31.
[0074]
In addition, light relating to an imaging target is supplied to each pixel unit S (1, 1) to S (i, j) of the imaging / display surface 31F of the display camera 31 from a plurality of directions. In each pixel unit S (1,1) to S (i, j), spectral information of light input from a plurality of directions is detected by a plurality of light receiving elements 31b constituting a plurality of light receiving units.
[0075]
In the display camera 31, the detection outputs of the plurality of light receiving elements 31b constituting the plurality of light receiving units of the pixel portions S (1,1) to S (i, j) of the imaging / display surface 31F are amplified by the amplifier 31f. Then, the analog signal is converted into a digital signal by the A / D converter 31g, then multiplexed by the multiplexer 31h, and further converted from parallel data to serial data by the parallel / serial converter 31i to form the image data Sa2. .
[0076]
The image data Sa2 output from the display camera 31 is compression-encoded by the encoder 32 and further digitally modulated by the modulator 33. The transmission data Sb2 output from the modulator 33 is sent from the transmission / reception unit 34 to the network 23. The transmission data Sb2 acquired from the network 23 by the transmission / reception unit 27 is digitally demodulated by the demodulator 28 and further compressed and decoded by the decoder 29. The image data Sa2 output from the decoder 29 is supplied to the display camera 24.
[0077]
In the display camera 24, the image data Sa2 is converted from serial data to parallel data by the serial / parallel converter 24j, and the demultiplexer 24k outputs a plurality of signals corresponding to the detection outputs of the plurality of light receiving elements 31b in the display camera 31 described above. Separated into data. The plurality of data is converted from a digital signal to an analog signal by the D / A converter 24m, and based on signals corresponding to the detection outputs of the plurality of light receiving elements 31b in the display camera 31 output from the D / A converter 24m, A plurality of light emitting elements 24c constituting a plurality of light emitting means of the pixel portions R (1,1) to R (i, j) of the imaging / display surface 24F corresponding to the plurality of light receiving elements 31b are driven by a driver 24n. The
[0078]
Thereby, each pixel part S (1,1) of the display camera 31 is emitted from a plurality of light emitting means of each pixel part R (1,1) to R (i, j) of the imaging / display surface 24F of the display camera 24. Light corresponding to light input from a plurality of directions to S (i, j) is output in the same direction as the input direction. Accordingly, even if it is stopped from any position and by how many people, it can be seen as if there is an actual imaging target beyond the imaging / display surface 24F of the display camera 24.
[0079]
As described above, in the three-dimensional image display system 20 illustrated in FIG. 7, the light input to the imaging surfaces 24F and 31F of the display cameras 24 and 31 is output as they are from the display surfaces 31F and 24F of the display cameras 31 and 24, respectively. The display cameras 24 and 31 can obtain a highly realistic 3D image of the other party. As a result, on the display cameras 24 and 31 side, it is possible to view and communicate with the other party's image as if the imaging / display surfaces 24F and 31F are windows.
[0080]
In the three-dimensional image display system 20, the display cameras 24 and 31 are connected via the network 23, but they are directly connected (see FIG. 4) or connected via a wireless communication path (see FIG. 4). 5), and connecting via a transmission line such as a recording device or a reproducing device (see FIG. 6).
[0081]
In the above-described embodiment, the imaging surface 11F of the camera 11, the display surface 17F of the display 17, and the imaging / display surfaces 24F and 31F of the display cameras 24 and 31 are shown to be planar. However, it is not necessarily planar, and any surface shape such as a hemispherical surface can be used.
[0082]
【The invention's effect】
  According to the present invention, the light input to the imaging surface of the imaging device can be configured to be output as it is from the display surface of the display device.Of the light input to the light guide tube, a large deviation from the direction in which the light guide tube is directed is absorbed by the light absorbing material.Therefore, even when viewed from any position by any number of people or moving, it looks as if there is an actual imaging object beyond the display surface of the display device, and a highly realistic 3D image is obtained. be able to. In addition, by using an image pickup / display device having both an image pickup function and a display function, bidirectional image communication using a three-dimensional image with a high sense of presence between two points distant from each other is possible.
[Brief description of the drawings]
FIG. 1 is a block diagram showing a circuit configuration of a three-dimensional image display system as a first embodiment.
FIG. 2 is a diagram illustrating a configuration of an imaging surface of a camera and a display surface of a display.
FIG. 3 is an enlarged cross-sectional view of an imaging surface and a display surface.
FIG. 4 is a block diagram showing a circuit configuration of a modified example of the three-dimensional image display system.
FIG. 5 is a block diagram showing a circuit configuration of a modified example of the three-dimensional image display system.
FIG. 6 is a block diagram showing a circuit configuration of a modified example of the three-dimensional image display system.
FIG. 7 is a block diagram showing a circuit configuration of a three-dimensional image display system as a second embodiment.
FIG. 8 is a diagram illustrating a configuration of an imaging / display surface of a display camera.
FIG. 9 is an enlarged cross-sectional view of an imaging / display surface.
[Explanation of symbols]
DESCRIPTION OF SYMBOLS 10,10A-10C ... Three-dimensional image display system, 11 ... Camera, 11F ... Imaging surface, 11a ... Light guide tube, 11b ... Light receiving element, 11c ... Absorbing substance, 12 ... Encoder, 13 ... Modulator, 14 ... Network, 15 ... Demodulator, 16 ... Decoder, 17 ... Display, 17F ... Display surface, 17a ... Light guide tube, 17b... Light emitting element, 17c... Absorbing substance, 20... 3D image display system, 21, 22. Display camera, 24F, 31F ... Imaging / display surface, 24a, 24d, 31a, 31d ... Light guide tube, 24b, 31b ... Light receiving element, 24c, 31c ... Light emitting element, 24e, 31e ... Light absorbing material

Claims (5)

A plurality of imaging pixel portions are arranged in a surface shape,
Each imaging pixel unit includes a plurality of light receiving means for detecting spectrum information of light input from a plurality of directions,
The plurality of light receiving means are:
A plurality of light guide tubes for guiding light input from the plurality of directions;
A plurality of light receiving elements for detecting spectral information of light guided by the plurality of light guide tubes,
The light guide tube has a light-absorbing substance on a side surface thereof. A plurality of display pixel portions are arranged in a surface shape,
Each display pixel unit includes a plurality of light emitting means for outputting light having predetermined spectral information related to each pixel in a plurality of directions,
The plurality of light emitting means includes
A plurality of light emitting elements that emit light having predetermined spectral information;
A plurality of light guide tubes that output light emitted from the plurality of light emitting elements in the plurality of directions,
The light guide tube has a light-absorbing substance on a side surface thereof. A plurality of imaging pixel portions are arranged in a surface shape, and each of the imaging pixel portions has a plurality of light receiving means for detecting spectral information of light input from a plurality of directions, and the plurality of light receiving means are the plurality of light receiving means. An imaging device having a plurality of light guide tubes that guide light input from the direction of the light source, and a plurality of light receiving elements that detect spectral information of the light guided by the plurality of light guide tubes,
A plurality of display pixel units are arranged in a surface shape corresponding to a plurality of imaging pixel units of the imaging device, and each display pixel unit corresponds to light input to each imaging pixel unit from a plurality of directions. A plurality of light emitting means for outputting light in the same direction as the input direction, and the plurality of light emitting means emit light from a plurality of light emitting elements that emit light having predetermined spectral information. A display device having a plurality of light guide tubes that output light in the plurality of directions,
At least one of the light guide tube included in the imaging device and the light guide tube included in the display device has a light-absorbing substance on a side surface thereof. A plurality of pixel portions are arranged in a surface shape,
Each pixel part is
A plurality of light receiving means for detecting spectral information of light respectively input from a plurality of directions;
A plurality of light emitting means for outputting light having predetermined spectral information related to each pixel in the plurality of directions,
The plurality of light receiving means are:
A plurality of light guide tube for guiding the light input from the plurality of directions,
And a plurality of light receiving elements for detecting the spectrum information of the plurality of light is Ru guided by the light guide tube,
The plurality of light emitting means includes
A plurality of light emitting elements that emit light having predetermined spectral information;
The light emitted by the plurality of light emitting elements and a plurality of light pipes to be output to the plurality of directions,
At least one light guide tube of the light receiving unit and the light guide unit of the light emitting unit has a light-absorbing substance on a side surface of the light guide tube. Comprising first and second imaging / display devices;
The first and second imaging / display devices are
A plurality of pixel portions are arranged in a surface shape, and each pixel portion has a plurality of light receiving means for detecting spectrum information of light input from a plurality of directions and has predetermined spectrum information related to each pixel. Having a plurality of light emitting means for outputting light in a plurality of directions;
The plurality of light emitting means of each pixel portion of the second imaging / display device are:
Outputting light corresponding to light input from a plurality of directions to each pixel portion of the first imaging / display device in the same direction as the input direction;
The plurality of light emitting means of each pixel portion of the first imaging / display device are:
A three-dimensional image display system that outputs light corresponding to light input from a plurality of directions to each pixel portion of the second imaging / display device in the same direction as the input direction.

Images