JPH11234702A - Image pickup device, display device, image pickup/display device and three-dimensional image display system using them - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain a three-dimensional image with high presence. SOLUTION: Each of photographing pixel sections P(1, 1)-P(i, j) of an image pickup face 11F of a camera are provided with plural light receiving means that detect optical spectral information received from plural directions respectively. Each of display pixel sections Q(1, 1)-Q(i, j) of a display screen 17F of a display device is provided with plural light emitting means corresponding one to one to plural light receiving means of each of to photographing pixel sections P(1, 1)-P(i, j) of the image pickup face 11F. Plural light emitting means of each of the display pixel sections Q(1, 1)-Q(i, j) act like outputting lights corresponding to the lights received in plural directions to each of the photographing pixel sections P(1, 1)-P(i, j) of the image pickup face 11F in the same direction as the input direction. Since the light given to the photographing face 11F of the camera is outputted as it is from the display screen 17F of the display device, the object is seen as if an actual photographing object were existing on the other side of the display screen 17F of the display device even when the object is observed from any position by many people standing or moving.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

The present invention relates to an imaging device, a display device, an imaging / display device, and a three-dimensional image display system using the same. More specifically, a three-dimensional image display system or the like that attempts to obtain a highly realistic three-dimensional image by configuring the light input to the imaging surface of the imaging device to be directly output from the display surface of the display device. It is related.

[0002]

2. Description of the Related Art The purpose of television is to make something appearing in a certain place as if it were in front of a viewer in a remote place. However, the basic mechanism of presenting an image in a conventional television system is to project an image in a direction facing the camera on one plane and reproduce the image in a remote place.

[0003]

Therefore, the conventional television system has the following problems as a result.

(A) The information to be presented is the color (including brightness) of each point on the display plane, which is a shape only when viewed at a certain distance from the front of the display, so that the actual object to be imaged can be viewed. If you change the angle or distance of the viewpoint from the display, you will see an image that does not actually exist.

More specifically, in terms of angle, for example, a sphere should have a cross section that looks like a circle from any point of view, but an image of the sphere is displayed on a display, and when viewed from a direction other than the front, the sphere is no longer a circle. Speaking of distance, it is a matter of perspective.In many cases, if you approach an object while looking at an object, the appearance of the object is not a similar shape but deforms even if you approach the display The object displayed above does not deform but only changes in size.

(B) When a person looks at a real thing, various things can be viewed in focus by adjusting the focus of the eyes according to the desired one. In some cases, an object to be viewed in a focused state is determined only by which object is focused at the time of capturing the displayed image.

(C) When viewing a real thing, the focus is on the position where the object itself exists. However, in order to view the image displayed on the display without blur, the focus of the eye is always set. It needs to fit on the screen of the display, eliminating the sense of depth and three-dimensional effect.

(D) When looking at the display, a picture on a plane having information to enter the left eye and the right eye is viewed from a different direction. There is no feeling of depth or three-dimensional feeling.

A three-dimensional display that presents separate plane images to the left and right eyes for expressing a three-dimensional effect has been proposed, but this solves only the above problem (d). However, there is no one that can solve all of the above problems.

Accordingly, an object of the present invention is to provide a three-dimensional image display system for obtaining a three-dimensional image having a high sense of reality.

[0011]

According to an image pickup apparatus of the present invention, a plurality of image pickup pixel units are arranged in a plane, and each image pickup pixel unit detects spectral information of light input from a plurality of directions. Of light receiving means.

Further, in the display device according to the present invention, a plurality of display pixel units are arranged in a plane shape, and each display pixel unit outputs light having predetermined spectral information related to a pixel in a plurality of directions. The light emitting means is provided.

Further, in the three-dimensional image display system according to the present invention, a plurality of imaging pixel units are arranged in a plane, and each imaging pixel unit detects spectral information of light input from a plurality of directions. An imaging device having light receiving means, and a plurality of display pixel portions arranged in a plane corresponding to the plurality of imaging pixel portions, each of which corresponds to light input to the imaging pixel portion from a plurality of directions. And a display device having a plurality of light emitting means for outputting the generated light in the same direction as the input direction.

In the present invention, a plurality of image pickup pixel units are arranged in a plane on the image pickup surface of the image pickup apparatus. And
Each imaging pixel unit has a plurality of light receiving means for detecting spectral information of light input from a plurality of directions. For example, the plurality of light receiving units include a plurality of light guide tubes for guiding light input from a plurality of directions, and a plurality of light receiving elements for detecting spectral information of light guided by the plurality of light guide tubes. .

Further, a plurality of display pixel portions are arranged in a plane on the screen of the display device. Each of the display pixel units has a plurality of light emitting units that output light having predetermined spectral information related to the pixels in a plurality of directions. For example,
The plurality of light emitting units include a plurality of light emitting elements that emit light having predetermined spectral information, and a plurality of light guide tubes that output light emitted by the plurality of light emitting elements in a plurality of directions.

Light corresponding to light input from a plurality of directions to a plurality of light receiving means of each imaging pixel unit of the image pickup device from a plurality of light emitting units of each display pixel unit of the display device in the same direction as the input direction. By outputting the light, the light input to the imaging surface of the imaging device appears to be output as it is from the display surface of the display device. This makes it possible to see a real three-dimensional image as if there is an actual imaging target on the other side of the display surface of the display device, regardless of the position and the number of people stopping or moving. It is possible to obtain.

Further, an image pickup / display device according to the present invention comprises:
A plurality of pixel units are arranged in a plane shape, and each pixel unit has a plurality of light receiving units for detecting spectral information of light input from a plurality of directions, respectively, and has predetermined spectral information related to each pixel. It has a plurality of light emitting means for outputting light in a plurality of directions.

The three-dimensional image display system according to the present invention includes first and second image pickup / display devices. Each of the first and second image pickup / display devices has a plurality of pixel units. Arranged in a plane shape, each pixel unit has a plurality of light receiving means for detecting spectral information of light input from a plurality of directions, respectively, and transmits light having predetermined spectral information related to the pixel in a plurality of directions. It has a plurality of light emitting means for outputting, and the plurality of light emitting means of each pixel unit of the second imaging / display device correspond to light input from each direction to each pixel unit of the first imaging / display device. Light is output in the same direction as the input direction, and a plurality of light emitting means of each pixel unit of the first image pickup / display device are adapted to output light to each pixel unit of the second image pickup / display device from a plurality of directions. The corresponding light is the same as its input direction And outputs it to the counter.

In the present invention, a plurality of pixel portions are arranged in a plane in the imaging / display device. Each pixel unit has a plurality of light receiving means for detecting spectral information of light input from a plurality of directions, and a plurality of light sources for outputting light having predetermined spectral information related to pixels in a plurality of directions. It has light emitting means.

Light corresponding to light input from a plurality of directions to a plurality of light receiving means of each pixel unit of the first imaging / display device from a plurality of light emitting units of each pixel unit of the second imaging / display device. Is output in the same direction as the input direction, so that light input to the imaging surface of the first imaging / display device is directly output from the display surface of the second imaging / display device. Will be visible. On the other hand, light corresponding to light input from a plurality of directions to a plurality of light receiving units of each pixel unit of the second imaging / display device from a plurality of light emitting units of each pixel unit of the first imaging / display device. By outputting the light in the same direction as the input direction, the light input to the imaging surface of the second imaging / display device is output as it is from the display surface of the first imaging / display device. It becomes visible.

With this arrangement, it looks as if there is an actual object to be imaged on the other side of the display surface on either side of the first and second image pickup / display devices, and the other party has a high sense of presence. Can be obtained.

[0022]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 shows a circuit configuration of a three-dimensional image display system 10 according to the first embodiment. The image display system 10 includes a camera 11 as an imaging device, and an encoder 12 that performs compression encoding on image data Sa output from the camera 11.
And a modulator 13 for performing digital modulation processing on output data of the encoder 12 to obtain transmission data Sb to be transmitted to the network 14.

A demodulator 15 performs digital demodulation processing on the transmission data Sb transmitted through the network 14, and performs compression decoding processing on output data of the demodulator 15 to obtain image data Sa. It has a decoder 16 and a display 17 as a display device for displaying a three-dimensional image based on the image data Sa.

FIGS. 2A to 2D and 3A show the configuration of the image pickup surface 11F of the camera 11. FIG. 2A is a front view of the imaging surface 11F viewed from the imaging target side, FIG. 2B is a schematic side view of the imaging surface 11F, FIGS. 2C and 3A are cross-sectional enlarged views of the imaging surface 11F, and FIG. It is the front enlarged view which expanded and showed. As illustrated in FIG. 2A, the imaging surface 11F includes a plurality of imaging pixel units P (1,1) to P (i, j) arranged in a matrix. Note that this arrangement is an example, and a plurality of imaging pixel units may be arranged in a plane.

Each of the image pickup pixel units P (1,1) to P (i, j)
Is configured to have a plurality of light receiving means for detecting spectrum information of light input from a plurality of directions (in the illustrated example, 25 directions). Each light receiving means is shown in FIGS.
As shown in A, a plurality of light guide tubes 11a for guiding light input from a plurality of directions, and a plurality of light receiving elements 11b for detecting spectral information of light guided by the plurality of light guide tubes 11a.
It is composed of

In this case, the directions of the light guide tubes 11a are different from each other so as to correspond to a plurality of directions. The enlarged cross-sectional views of FIGS. 2C and 3A show the light guide tube 11a.
Is changed only in the vertical direction, but the direction of the light guide tube 11a is also changed in the horizontal direction.
Therefore, when each of the imaging pixel units is enlarged, the opening of the light guide tube 11a looks as shown in FIG. 2D.

In order to guide only the light input from each light guide tube 11a from a certain direction corresponding to the direction of the light guide tube to the light receiving element 11b, the side surface of each light guide tube 11a is made of a light absorbing material 11c such as carbon. Covered. Thus, each light guide tube 11
a of the light guide tube 1 by covering the side surface of
Of the light input to 1a, the light having a large deviation from the direction in which the light guide tube faces is absorbed by the light absorbing substance 11c.

As each light receiving element 11b, one that responds to light of a specific wavelength, or R (red), G
A plurality of photoelectric conversion elements corresponding to (green) and B (blue) are used.

By forming the imaging surface 11F of the camera 11 as described above, a plurality of points on the plane, that is, imaging pixels P (1,1) to P (i, j) are provided in a plurality of directions, respectively. Can detect the spectrum of the light input from.

FIGS. 2E to 2H and 3B show the display 17.
Of the display surface 17F is shown. 2E is a front view of the display surface 17F viewed from the light output side, and FIG.
2G and 3B are enlarged cross-sectional views of the display surface 17F, and FIG. 2H is an enlarged front view showing a display pixel portion described later. The front view and the enlarged front view shown in FIGS. 2E and 2H are the imaging surface 11F of the camera 11 described above.
In order to facilitate the explanation of the relationship, the left and right sides are inverted.

The display surface 17F is formed to have substantially the same size and shape as the imaging surface 11F. And this display surface 17F
2E, a plurality of display pixel units Q (1,1) correspond one-to-one to a plurality of imaging pixel units P (1,1) to P (i, j) on the imaging surface 11F, as shown in FIG. 2E. ) To Q (i, j) are arranged in a matrix. Note that this arrangement is an example, and it is sufficient that the plurality of display pixel units are arranged corresponding to the plurality of imaging pixel units on the imaging surface 11F described above. In this case, the plurality of imaging pixel units P (1,1) to P (i, j) of the imaging surface 11F and the plurality of display pixel units Q (1,1) to Q (i, j) of the display surface 17F Is a front view of the imaging surface 11F as shown by a broken line (FIG. 2).
A) and a front view in which the left and right sides of the display surface 17F are inverted (FIG. 2E).
And correspond to the pixel portion at the same position.

Each of the display pixel portions Q (1,1) to Q (i, j)
Are the respective imaging pixel portions P of the imaging surface 11F described above.
It has a plurality of light emitting means corresponding to the plurality of light receiving means (1,1) to P (i, j) on a one-to-one basis. Each of these display pixel portions Q
The plurality of light-emitting units (1,1) to Q (i, j) emit light input from a plurality of directions to each of the imaging pixel units P (1,1) to P (i, j) on the imaging surface 11F. This is for outputting the corresponding light in the same direction as the input direction.

Here, each of the imaging pixel units P (1,1) to P (i, j)
The plurality of light receiving means and the plurality of light emitting means of each of the display pixel portions Q (1,1) to Q (i, j) are connected to the imaging surface 11 as shown by a broken line.
In the enlarged front view of FIG. F (FIG. 2D) and the enlarged front view of the display surface 17F (FIG. 2H), the ones at point-symmetric positions correspond to each other.

As shown in FIGS. 2G and 2H, the plurality of light emitting means of each of the display pixel portions Q (1,1) to Q (i, j) correspond to each of the above-mentioned image pickup pixel portions P (1,1) to P (P). (i, j) a plurality of light emitting elements 17b for emitting light having spectral information that looks the same as light from a plurality of directions input to the light receiving elements 11b constituting the plurality of light receiving means; A plurality of light guide tubes 17a for outputting light emitted by the light emitting elements 17b in the same direction as the input direction.

In this case, each of the display pixel portions Q (1,1) to Q (i,
The directions of the plurality of light guide tubes 17a constituting the plurality of light emitting means of j) are the same as those of the plurality of light guides constituting the plurality of light receiving means of the corresponding imaging pixel portions P (1,1) to P (i, j). The left, right, up and down directions of the light tube 11a are symmetrical. The enlarged cross-sectional view of FIG. 2G shows a case where the direction of the light guide tube 17a changes only in the vertical direction, but the direction of the light guide tube 17a also changes in the horizontal direction. Therefore, the opening of the light guide tube 17a that is seen when each imaging pixel unit is enlarged is as shown in FIG. 2H.

In order to output the light emitted from each light emitting element 17b from the light guide tube 17a in a fixed direction corresponding to the direction of the light guide tube, the side surface of each light guide tube 17a is made of a light absorbing material 17c such as carbon. Covered. Thus, each light guide tube 17
a of the light guide tube 1 by covering the side surface of
Of the light input to 7a, those having a large deviation from the direction in which the light guide tube is directed are absorbed by the light absorbing substance 17c. In addition, as each light emitting element 17b, one that emits light of a specific wavelength, or a plurality of LEDs (light emitting diodes) corresponding to R, G, and B, for example, is used.

Returning to FIG. 1, the circuit configuration of the camera 11 and the display 17 will be described. First, the camera 11 will be described. The camera 11 includes a plurality of amplifiers 11e for amplifying detection outputs of a plurality of light receiving elements 11b constituting a plurality of light receiving units of each of the imaging pixel units P (1,1) to P (i, j) on the imaging surface 11F. An A / D converter 11f for converting the output signals of the plurality of amplifiers 11e from analog signals to digital signals, and a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 11b output from the A / D converter 11f. A multiplexer 11g for multiplexing and a parallel / serial converter 11h for converting the output data of the multiplexer 11g from parallel data to serial data to obtain image data Sa are configured.

The display 17 displays the image data S
a / serial converter 17e for converting a from serial data to parallel data, and a demultiplexer for separating a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 11b in the camera 11 from the output data of the converter 17e. 17f and the demultiplexer 17
f / g, a D / A converter 17g for converting a plurality of data output from the digital signal into an analog signal, and a signal corresponding to the detection output of the plurality of light receiving elements 11b in the camera 11 output from the D / A converter 17g. Driver that drives a plurality of light emitting elements 17b constituting a plurality of light emitting means of each of the display pixel portions Q (1,1) to Q (i, j) of the display surface 17F corresponding to the plurality of light receiving elements 11b. 17h.

Next, the operation of the three-dimensional image display system 10 shown in FIG. 1 will be described. Light related to an imaging target is supplied to each of the imaging pixel units P (1,1) to P (i, j) on the imaging surface 11F of the camera 11 from a plurality of directions. Then, in each of the imaging pixel units P (1,1) to P (i, j), the spectrum information of the light input from a plurality of directions is detected by the plurality of light receiving elements 11b constituting the plurality of light receiving means. .

Then, in the camera 11, the imaging surface 11
The detection output of the plurality of light receiving elements 11b constituting the plurality of light receiving means of each of the imaging pixel units P (1,1) to P (i, j) of the F
1e, the signal is converted from an analog signal to a digital signal by an A / D converter 11f, multiplexed by a multiplexer 11g, and further converted from parallel data to serial data by a parallel / serial converter 11h. It is said.

Image data Sa output from the camera 11
Are compression-encoded by an encoder 12 and digitally modulated by a modulator 13. Then, the transmission data Sb output from the modulator 13 is transmitted to the network 14. The transmission data S obtained from the network 14
b is digitally demodulated by the demodulator 15 and further decoded by the decoder 1
6 is compression-decoded. Then, the image data Sa output from the decoder 16 is supplied to the display 17.

Then, on the display 17, the image data Sa is converted from serial data to parallel data by a serial / parallel converter 17e, and a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 11b in the camera 11 are output by a demultiplexer 17f. Data. The plurality of data are converted into analog signals by a D / A converter 17g, and the plurality of data are converted into analog signals based on signals output from the D / A converter 17g and corresponding to detection outputs of a plurality of light receiving elements 11b in the camera 11. Each display pixel portion Q (1,1) on the display surface 17F corresponding to the element 11b.
A plurality of light emitting elements 17b constituting a plurality of light emitting means of 1) to Q (i, j) are driven by a driver 17h.

Thus, the display surface 1 of the display 17 is
From the plurality of light emitting units of each of the display pixel units Q (1,1) to Q (i, j) on the 7F, the imaging pixel units P (1,1) to P (i,
Light corresponding to light input from a plurality of directions in j) is output in the same direction as the input direction. Therefore, no matter how many people stop or move from any position, it looks as if there is an actual imaging target behind the display surface 17F of the display 17.

As described above, the three-dimensional image display system 10 shown in FIG. 1 is configured so that the light input to the imaging surface 11F of the camera 11 is output as it is from the display surface 17F of the display 17. A highly realistic three-dimensional image can be obtained on the display 17 side.

In the three-dimensional image display system 10, the image data Sa output from the camera 11 is supplied to the display 17 via the network 14 after being compression-coded and digitally modulated. The configuration shown in FIGS. 4 to 6 may be considered. 4 to 6, parts corresponding to those in FIG. 1 are denoted by the same reference numerals.

The three-dimensional image display system 10A shown in FIG.
Is such that the image data Sa output from the camera 11 is directly supplied to the display 17. FIG.
3B transmits the transmission data Sb output from the modulator 13 through the transmission antenna 21 and transmits the transmission data Sb received by the reception antenna 22.
b is supplied to the demodulator 15. Further, the three-dimensional image display system 10C shown in FIG. 6 supplies the image data Sa output from the camera 11 to the recording device 23 to record the image data Sa on a tape-shaped or disk-shaped recording medium, a semiconductor memory, or the like. The image data Sa is reproduced from a tape-shaped or disk-shaped recording medium, a semiconductor memory, or the like, and the image data Sa is supplied to the display 17.

The three-dimensional image display system 10 shown in FIG. 1 displays an image taken by the camera 11 on the display 17, and sends the image of the first point to the second point. Only image communication can be realized.
However, it is convenient if two-way image communication can be performed in which the image of the first point is sent to the second point while the image of the second point is sent to the second point.

FIG. 7 shows a configuration of a three-dimensional image display system 20 according to a second embodiment of the present invention.
The three-dimensional image display system 20 includes an imaging / display system 21 on a first point side and an imaging / display system 22 on a second point side, and these imaging / display systems 21 and 22 are connected to a network. 23.

The imaging / display system 21 includes a display camera 24 as an imaging / display device, an encoder 25 for performing compression encoding processing on image data Sa1 output from the display camera 24, and an encoder 25. Digitally modulating the output data of
A transmission / reception unit 27 for transmitting the transmission data Sb1 to the imaging / display system 22 via the network 23 and receiving the transmission data Sb2 transmitted from the imaging / display system 22; A demodulator 28 that performs digital demodulation processing on the transmission data Sb2, and a decoder 29 that performs compression decoding processing on output data of the demodulator 28 to obtain image data Sa2 to be supplied to the display camera 24. Have.

The imaging / display system 22 includes a display camera 31 as an imaging / display device, an encoder 32 for performing compression encoding on image data Sa2 output from the display camera 31, and an encoder 32 Digital data processing is performed on the output data of
A transmission / reception unit 34 for transmitting the transmission data Sb2 to the imaging / display system 21 via the network 23 and receiving the transmission data Sb1 transmitted from the imaging / display system 21; A demodulator 35 that performs digital demodulation processing on the transmission data Sb1 and a decoder 36 that performs compression decoding processing on output data of the demodulator 35 to obtain image data Sa1 to be supplied to the display camera 31 Have.

FIGS. 8A to 8D and 9A show the configuration of the image pickup / display surface 24F of the display camera 24. FIG. FIG.
A is a front view of the imaging / display surface 24F viewed from the imaging target side or the image observer side, FIG. 8B is a schematic side view of the imaging / display surface 24F, and FIGS. 8C and 9A are cross-sectional enlarged views of the imaging / display surface 24F. FIG. 8D is an enlarged front view showing a pixel portion described later in an enlarged manner. As shown in FIG. 8A, the imaging / display surface 24F includes a plurality of pixel units R (1,1) to R (i, j) arranged in a matrix. Note that this arrangement is an example, and a plurality of pixel units may be arranged in a plane.

Each of the pixel units R (1,1) to R (i, j) includes a plurality of light receiving means for detecting spectrum information of light input from a plurality of directions (in the illustrated example, 25 directions). And each pixel portion S (1,
1) to S (i, j) have a plurality of light emitting means for outputting light corresponding to light input from a plurality of directions in the same direction as the input direction.

The plurality of light receiving means are shown in FIGS.
As shown in A, a plurality of light guide tubes 24a for guiding light input from a plurality of directions, and a plurality of light receiving elements 24b for detecting spectral information of the light guided by the plurality of light guide tubes 24a.
It is composed of As shown in FIG. 8C, FIG. 8D and FIG. A plurality of light emitting elements 24c for emitting light having spectral information that looks similar to light from a plurality of input directions, and light emitted by the plurality of light emitting elements 24c is directed in the same direction as the input direction. And a plurality of light guide tubes 24d for outputting.

In this case, the directions of the light guide tubes 24a and 24d are different from each other so as to correspond to a plurality of directions. 8C and 9A show the case where the directions of the light guide tubes 24a and 24d change only in the vertical direction, but the directions of the light guide tubes 24a and 24d also change in the horizontal direction. ing. Therefore, when each pixel portion is enlarged and viewed, the openings of the light guide tubes 24a and 24d are shown in FIG.
It looks as shown in D.

In order to guide only light input from each light guide tube 24a from a fixed direction corresponding to the direction of the light guide tube to the light receiving element 24b, light emitted from each light emitting element 24c is further transmitted from the light guide tube 24d. To output the light in a fixed direction corresponding to the direction of the light guide tube, the side surfaces of the respective light guide tubes 24a and 24d are covered with a light absorbing substance 24e such as carbon. By covering the side surfaces of the light guide tubes 24a and 24d with the light absorbing substance 24e in this manner, of the light input to each of the light guide tubes 24a and 24d, the deviation from the direction in which the light guide tubes face is large. Thing is absorbed by the light absorbing substance 24e.

As each light receiving element 24b, one which responds to light of a specific wavelength, for example, R (red), G
A plurality of photoelectric conversion elements corresponding to (green) and B (blue) are used. Similarly, as each light emitting element 24c, one emitting light of a specific wavelength or, for example, R,
Multiple LEDs corresponding to G and B (light emitting
diode) is used.

FIGS. 8E to 8H and 9B show the structure of the image pickup / display surface 31F of the display camera 31. FIG. FIG.
E is a front view of the imaging / display surface 31F viewed from the imaging target side or the image observer side, FIG. 8F is a schematic side view of the imaging / display surface 31F, and FIGS. 8G and 9B are enlarged cross-sectional views of the imaging / display surface 31F. FIG. 8H is an enlarged front view showing a pixel portion described later in an enlarged manner. The front view and front enlarged view shown in FIGS.
The left and right sides are inverted to facilitate the description of the relationship with the display surface 24F.

The imaging / display surface 31F is connected to the imaging / display surface 24.
F and the size and shape are substantially equal. Then, as shown in FIG. 8E, the imaging / display surface 31F is in one-to-one correspondence with the plurality of pixel units R (1,1) to R (i, j) of the imaging / display surface 24F.
, A plurality of pixel units S (1,1) to S (i, j) are arranged in a matrix. Note that this arrangement is merely an example, and the plurality of pixel units are connected to the above-described imaging / display surface
It suffices if the pixels are arranged in a one-to-one correspondence with a plurality of pixel units on the 4F. In this case, the plurality of pixel units R (1,1) to R (i, j) on the imaging / display surface 24F and the plurality of pixel units S (1,1) to S (i, j) on the imaging / display surface 31F. ) Means a front view (FIG. 8A) of the imaging / display surface 24F and the imaging / display surface 3 as shown by the broken line.
The pixel portion at the same position corresponds to the front view (FIG. 8E) in which the left and right of 1F are inverted.

Each of the pixel units S (1,1) to S (i, j) corresponds to each of the pixel units R (1,1) of the imaging / display surface 24F.
ＲR (i, j) are provided with a plurality of light emitting means corresponding to one to one. These pixel units S (1,1) to S (i,
The plurality of light emitting means of j) emit light corresponding to light input from a plurality of directions to each of the pixel units R (1,1) to R (i, j) on the imaging / display surface 24F in the same direction as the input direction. Output in the direction of. Similarly, each pixel unit S (1,1) to S (i, j)
Are the respective pixel portions R of the imaging / display surface 24F described above.
It has a plurality of light receiving means corresponding to the plurality of light emitting means (1,1) to R (i, j) on a one-to-one basis.

Here, each pixel portion R on the imaging / display surface 24F
A plurality of light receiving means and light emitting means of (1,1) to P (i, j), and a plurality of light emitting means of each pixel portion S (1,1) to S (i, j) of the imaging / display surface 31F; The light receiving means is an image pickup /
Enlarged front view (FIG. 8D) of display surface 24F and imaging / display surface 3
In the enlarged front view (FIG. 8H) in which the left and right of 1F are inverted,
Those located at point-symmetric positions correspond to each other.

As shown in FIGS. 8G, H and 9B, the plurality of light receiving means are a plurality of light guide tubes 31a for guiding light input from a plurality of directions, and the light guided by the plurality of light guide tubes 31a. Light receiving elements 31b for detecting spectral information of
It is composed of As shown in FIGS. 8G, H and 9B, the plurality of light emitting units are connected to the light receiving elements 24b constituting the plurality of light receiving units of each of the pixel units R (1, 1) to R (i, j) of the display camera 24. A plurality of light emitting elements 31c for emitting light having spectral information that looks similar to light from a plurality of input directions, and light emitted by the plurality of light emitting elements 31c is directed in the same direction as the input direction. And a plurality of light guide tubes 31d for outputting.

In this case, the directions of the plurality of light guide tubes 31a constituting the plurality of light receiving means of each of the pixel units S (1,1) to S (i, j) correspond to the corresponding pixel unit R (1,1). ) To R (i, j), the directions of the plurality of light guide tubes 24d constituting the plurality of light emitting means are symmetrical in the left, right, up and down directions. Similarly, the pixel units S (1,1) to S (i,
The directions of the plurality of light guide tubes 31d constituting the plurality of light emitting units of j) are the same as the plurality of light guides constituting the plurality of light receiving units of the corresponding pixel units R (1,1) to R (i, j). The direction of the tube 124a is symmetric with respect to the left, right, up and down. 8G and 9B show the case where the directions of the light guide tubes 31a and 34d are changed only in the vertical direction, but the light guide tubes 31a and 34d are shown.
The direction of d also changes in the horizontal direction. Therefore, when each pixel portion is enlarged, the openings of the light guide tubes 31a and 31d look as shown in FIG. 8H.

In order to guide only light input from each light guide tube 31a from a fixed direction corresponding to the direction of the light guide tube to the light receiving element 31b, the light emitted from each light emitting element 31c is further transmitted from the light guide tube 31d. To output the light in a fixed direction corresponding to the direction of the light guide tube, the side surfaces of the respective light guide tubes 31a and 31d are covered with a light absorbing substance 31e such as carbon. By covering the side surfaces of the light guide tubes 31a and 31d with the light absorbing material 31e in this way, of the light input to each of the light guide tubes 31a and 31d, the deviation from the direction in which the light guide tubes face is large. Thing is absorbed by the light absorbing substance 31e.

As each light receiving element 31b, one that responds to light of a specific wavelength or, for example, R (red), G
A plurality of photoelectric conversion elements corresponding to (green) and B (blue) are used. Similarly, as each light emitting element 31c, one emitting light of a specific wavelength or, for example, R,
A plurality of LEDs corresponding to G and B are used.

Returning to FIG. 7, the display cameras 24,
31 will be described. First, the display camera 24 will be described. The display camera 24 includes a plurality of amplifiers for amplifying detection outputs of a plurality of light receiving elements 24b constituting a plurality of light receiving units of each of the pixel units R (1,1) to R (i, j) on the imaging / display surface 24F. 24f, an A / D converter 24g for converting output signals of the plurality of amplifiers 24f from analog signals to digital signals, and an A / D converter
Plurality of light receiving elements 24b output from converter 24g
And a parallel / serial converter 24i for converting the output data of the multiplexer 24h from parallel data to serial data to obtain image data Sa1. .

The display camera 24 includes a serial / parallel converter 24j for converting the image data Sa2 from serial data to parallel data, and a serial / parallel converter 24j.
a demultiplexer 24k for separating a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 31b in the display camera 31 from the output data of j, and converting a plurality of data output from the demultiplexer 24k from a digital signal to an analog signal D / A converter 24
m, and each pixel of the imaging / display surface 24F corresponding to the plurality of light receiving elements 31b, based on the signals corresponding to the detection outputs of the plurality of light receiving elements 31b in the display camera 31 output from the D / A converter 24m. Part R (1,
1) to a driver 24n for driving a plurality of light emitting elements 24c constituting a plurality of light emitting means of R (i, j).

Next, the display camera 31 will be described. The display camera 31 includes an imaging / display surface 31.
A plurality of amplifiers 31f for amplifying detection outputs of a plurality of light receiving elements 31b constituting a plurality of light receiving means of each of the pixel units S (1,1) to S (i, j) of F; An A / D converter 31g for converting an output signal from an analog signal to a digital signal;
g, a multiplexer 31h that multiplexes a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 31b output from g.
And a parallel / serial converter 31i for converting the output data of the multiplexer 31h from parallel data to serial data to obtain image data Sa2.

The display camera 31 includes a serial / parallel converter 31j for converting the image data Sa1 from serial data to parallel data, and a serial / parallel converter 31j.
a demultiplexer 31k for separating a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 24b in the display camera 24 from the output data of j, and converting a plurality of data output from the demultiplexer 31k from a digital signal to an analog signal D / A converter 31
m, and each pixel of the imaging / display surface 31F corresponding to the plurality of light receiving elements 24b, based on the signals corresponding to the detection outputs of the plurality of light receiving elements 24b in the display camera 24 output from the D / A converter 31m. Section S (1,
1) to a driver 31n for driving a plurality of light emitting elements 31c constituting a plurality of light emitting means of S (i, j).

Next, the operation of the three-dimensional image display system 20 shown in FIG. 7 will be described. Each of the pixel units R (1,1) to R (i, j) on the imaging / display surface 24F of the display camera 24 is supplied with light relating to an imaging target from a plurality of directions. Then, in each of the pixel units R (1,1) to R (i, j), the spectral information of the light input from a plurality of directions is detected by the plurality of light receiving elements 24b constituting the plurality of light receiving means.

Then, in the display camera 24, each of the pixel portions R (1,1) to R (i, j) on the imaging / display surface 24F.
The detection outputs of the plurality of light receiving elements 24b constituting the plurality of light receiving means are amplified by the amplifier 24f, and the A / D converter 2
The signal is converted from an analog signal to a digital signal by 4g, then multiplexed by a multiplexer 24h, and further converted from parallel data to serial data by a parallel / serial converter 24i to obtain an image data Sa1.

The image data Sa1 output from the display camera 24 is compression-coded by the encoder 25, and is further digitally modulated by the modulator 26. The transmission data Sb1 output from the modulator 26 is transmitted from the transmission / reception unit 27 to the network 23. The transmission data Sb1 obtained from the network 23 by the transmission / reception unit 34 is digitally demodulated by the demodulator 35, and is compression-decoded by the decoder 36. Then, the image data Sa1 output from the decoder 36 is supplied to the display camera 31.

Then, in the display camera 31, the image data Sa1 is converted to a serial / parallel converter 31j.
Is converted from serial data to parallel data by the demultiplexer 31k.
Are separated into a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 24b. The plurality of data is converted from a digital signal to an analog signal by the D / A converter 31m, and based on a signal corresponding to the detection output of the plurality of light receiving elements 24b in the display camera 24 output from the D / A converter 31m. Each pixel unit S on the imaging / display surface 31F corresponding to the plurality of light receiving elements 24b
A plurality of light emitting elements 31c constituting a plurality of light emitting means of (1,1) to S (i, j) are driven by a driver 31n.

As a result, the plurality of light emitting means of each of the pixel portions S (1,1) to S (i, j) on the imaging / display surface 31F of the display camera 31 emits each of the pixel portions R (1) of the display camera 24. , 1) to R (i, j) are output in the same direction as the input direction.
Therefore, from where and how many people stop,
Or, even when viewed while moving, it looks as if there is an actual imaging target on the other side of the imaging / display surface 31F of the display camera 31.

Further, light relating to the object to be imaged is supplied from a plurality of directions to each of the pixel portions S (1,1) to S (i, j) on the imaging / display surface 31F of the display camera 31. Then, in each of the pixel units S (1,1) to S (i, j), a plurality of light receiving elements 31b constituting a plurality of light receiving means detect spectral information of light input from a plurality of directions.

Then, in the display camera 31, each pixel section S (1,1) to S (i, j) on the imaging / display surface 31F.
The detection outputs of the plurality of light receiving elements 31b constituting the plurality of light receiving means are amplified by the amplifier 31f, and the A / D converter 3
The signal is converted from an analog signal to a digital signal by 1g, then multiplexed by a multiplexer 31h, and further converted from parallel data to serial data by a parallel / serial converter 31i to obtain an image data Sa2.

The image data Sa 2 output from the display camera 31 is compression-encoded by the encoder 32 and further digitally modulated by the modulator 33. The transmission data Sb2 output from the modulator 33 is transmitted from the transmission / reception unit 34 to the network 23. The transmission data Sb2 obtained from the network 23 by the transmission / reception unit 27 is digitally demodulated by the demodulator 28, and is further compression-decoded by the decoder 29. Then, the image data Sa2 output from the decoder 29 is supplied to the display camera 24.

Then, in the display camera 24, the image data Sa2 is converted to a serial / parallel converter 24j.
Is converted from serial data to parallel data by the demultiplexer 24k.
Are separated into a plurality of data corresponding to the detection outputs of the plurality of light receiving elements 31b. The plurality of data is converted from a digital signal to an analog signal by the D / A converter 24m, and based on a signal corresponding to the detection output of the plurality of light receiving elements 31b in the display camera 31 output from the D / A converter 24m. Each pixel portion R of the imaging / display surface 24F corresponding to the plurality of light receiving elements 31b
A plurality of light emitting elements 24c constituting a plurality of light emitting means of (1,1) to R (i, j) are driven by a driver 24n.

Thus, the plurality of light emitting means of each of the pixel units R (1,1) to R (i, j) on the image pickup / display surface 24F of the display camera 24 emits each of the pixel units S (1) of the display camera 31. , 1) to S (i, j) are output in the same direction as the input direction.
Therefore, from where and how many people stop,
Or, even if it is seen while moving, it looks as if there is an actual imaging target behind the imaging / display surface 24F of the display camera 24.

As described above, in the three-dimensional image display system 20 shown in FIG. 7, the light input to the imaging surfaces 24F and 31F of the display cameras 24 and 31 is transmitted from the display surfaces 31F and 24F of the display cameras 31 and 24, respectively. It is configured to be output as it is, and it is possible to obtain a three-dimensional image of the other party with a high sense of reality on each of the display cameras 24 and 31. Thereby, on the display cameras 24 and 31 side, the imaging / display surfaces 24F and 3F
It is possible to see an image of the other party as if the first floor is a window and communicate with the other party.

In the three-dimensional image display system 20, the display cameras 24 and 31 are connected via the network 23. If the display cameras 24 and 31 are connected directly (see FIG. 4), they are connected via a wireless communication path. (See FIG. 5)
Connection via a transmission line such as a recording device and a reproducing device (see FIG. 6) is also conceivable.

In the above embodiment, the imaging surface 11F of the camera 11 and the display surface 17 of the display 17 are used.
F, and the imaging / display surfaces 24F and 31F of the display cameras 24 and 31 are shown as being planar, but need not be planar, and may have any surface shape such as a hemisphere. Can be.

[0082]

According to the present invention, it is possible to configure so that light input to the imaging surface of the imaging device is directly output from the display surface of the display device. Therefore, even if the user stops at any position or moves while watching, it looks as if there is an actual imaging target on the other side of the display surface of the display device, and a highly realistic three-dimensional image is obtained. be able to.
In addition, by using an imaging / display device having both an imaging function and a display function, two-way image communication with a highly realistic three-dimensional image can be performed between two points separated from each other.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a circuit configuration of a three-dimensional image display system according to a first embodiment.

FIG. 2 is a diagram illustrating a configuration of an imaging surface of a camera and a display surface of a display.

FIG. 3 is an enlarged cross-sectional view of an imaging surface and a display surface.

FIG. 4 is a block diagram showing a circuit configuration of a modification of the three-dimensional image display system.

FIG. 5 is a block diagram showing a circuit configuration of a modification of the three-dimensional image display system.

FIG. 6 is a block diagram illustrating a circuit configuration of a modification of the three-dimensional image display system.

FIG. 7 is a block diagram illustrating a circuit configuration of a three-dimensional image display system according to a second embodiment.

FIG. 8 is a diagram showing a configuration of an imaging / display surface of a display camera.

FIG. 9 is an enlarged cross-sectional view of an imaging / display surface.

[Explanation of symbols]

10, 10A to 10C ... three-dimensional image display system,
11 ... camera, 11F ... imaging surface, 11a ...
Light guide tube, 11b ... light receiving element, 11c ... light absorbing substance, 12 ... encoder, 13 ... modulator, 14 ...
Network, 15 demodulator, 16 decoder
17 display, 17F display surface, 17a
... light guide tube, 17b ... light emitting element, 17c ... light absorbing substance, 20 ... three-dimensional image display system, 21 and 22
2 ... imaging / display system, 23 ... network, 2
4,31 ・ ・ ・ Display camera, 24F, 31F ・
..Imaging / display surface, 24a, 24d, 31a, 31d
..Light guide tubes, 24b, 31b ... light receiving elements, 24c,
31c: light emitting element, 24e, 31e: light absorbing substance

Claims (8)

[Claims] 1. An imaging apparatus comprising: a plurality of imaging pixel units arranged in a plane; and each of the imaging pixel units includes a plurality of light receiving units for detecting spectral information of light input from a plurality of directions. A plurality of light guides for guiding light input from the plurality of directions; and a plurality of light receiving elements for detecting spectral information of the light guided by the plurality of light guides. The imaging device according to claim 1, comprising: 3. A display device comprising: a plurality of display pixel portions arranged in a plane; each display pixel portion having a plurality of light emitting means for outputting light having predetermined spectral information related to each pixel in a plurality of directions; Display device. 4. A plurality of light emitting means for emitting light having predetermined spectral information, and a plurality of light guides for outputting light emitted by the plurality of light emitting elements in the plurality of directions. The display device according to claim 3, comprising a tube. 5. A plurality of imaging pixel units are arranged in a plane shape,
An image pickup device, wherein each of the image pickup pixel portions has a plurality of light receiving means for detecting spectral information of light input from a plurality of directions, and a plurality of display pixel portions corresponding to the plurality of image pickup pixel portions of the image pickup device. A display device having a plurality of light emitting units arranged in a plane shape, wherein each of the display pixel units outputs light corresponding to light input to each of the image pickup pixel units from a plurality of directions in the same direction as the input direction. And a three-dimensional image display system. 6. A plurality of pixel portions are arranged in a plane shape, and each of the pixel portions has a plurality of light receiving means for detecting spectral information of light input from a plurality of directions, respectively, and each of the plurality of pixel portions is associated with a pixel. An imaging / display device having a plurality of light emitting means for outputting light having predetermined spectral information in a plurality of directions. 7. The plurality of light receiving means includes: the plurality of light guide tubes; and a plurality of light receiving elements for detecting spectral information of light guided by the plurality of light guide tubes. An imaging device comprising: a plurality of light emitting elements that emit light having the predetermined spectrum information; and a plurality of light guide tubes that output light emitted by the plurality of light emitting elements in the plurality of directions. / Display device. 8. A first and second imaging / display device, wherein each of the first and second imaging / display devices has a plurality of pixel units arranged in a planar shape, and each of the pixel units is Having a plurality of light receiving means for detecting spectral information of light input from a plurality of directions, and a plurality of light emitting means for outputting light having predetermined spectral information related to the pixel in a plurality of directions, The plurality of light emitting units of each pixel unit of the second imaging / display device are configured to change light corresponding to light input to each pixel unit of the first imaging / display device from a plurality of directions in the same input direction. And the plurality of light emitting means of each pixel unit of the first imaging / display device emit light corresponding to light input from each direction to each pixel unit of the second imaging / display device. Output in the same direction as its input direction A three-dimensional image display system characterized by the following.