JP2000152205A - Image pickup and display device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image pickup and a display device that can pick up a natural image of an object person displayed on a display screen of the display device without being perceived by the object person. SOLUTION: The image pickup display device has at least one image pickup device that is placed between a display device consisting of a point light emitting element array and point light emitting elements 106 of the display device whose image pickup face is nearly the same as a display plane of the display device, and at least one image pickup device has an image transfer element and a photoelectric conversion element 101. Moreover, the image transfer element of at least one image pickup device consists of a straight line rod lens 102.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup / display apparatus, and more particularly, to an interactive communication service (for example, a video telephone system, a video conference system) which requires simultaneous display and image pickup on the same apparatus. To apply to effective technology.

[0002]

2. Description of the Related Art In an image pickup / display device for a videophone or a video conference, an image pickup device such as a television camera is installed near a display device such as a CRT. In such a configuration, for example, since the line of sight of the observer faces the display surface of the display device, the line of sight does not match the shooting direction of the camera, and the line of sight does not match with the communication partner. There was a problem that it could not be conveyed accurately. Furthermore, when the observer approaches the display device, there is a problem that the observer cannot be imaged. Therefore, as a method of solving the above-described problem, for example, a method of taking an image on a display surface using a half mirror shown in FIG. 5 has been proposed. Hereinafter, the imaging / display device shown in FIG. 5 will be described. In the imaging / display device shown in FIG.
The half mirror 1002 is set at an angle of 45 degrees with respect to
An imaging device 1001 is installed in a direction opposite to 004, and further, a display device 1003 is installed in a direction at an angle of 45 degrees with respect to the half mirror 1002 when viewed from an observer 1004. In this imaging / display device, since the imaging device 1001 is indirectly embedded in the display device 1003, an image can be taken from the display screen of the display device 1003. Thus, the observer can be imaged.

[0003]

However, in the image pickup / display device shown in FIG. 5, since the half mirror 1002 needs to be installed at an angle, a large volume is required on the front surface of the display screen of the display device 1003, and the image pickup / display device has a large capacity. -There is a disadvantage that the depth of the entire display device is increased. Furthermore, since the actual display surface exists deep in the imaging / display device, the angle at which the display image is viewed is limited, and the display image cannot be viewed close to the display surface, or the display surface may be pointed with a finger. There were problems such as inability to do so. Further, a method of imaging from a minute hole formed on the display screen has also been proposed, but of course there is a problem that the amount of photographing light is insufficient, and further, when a large hole is drilled, the image is perceived by an observer and displayed. There was a problem that quality was greatly impaired. As described above, in the conventional imaging / display apparatus, it is not possible to perform imaging from an area that is not perceived by an observer, and to satisfy the light amount necessary for imaging and the resolution of the captured image. Therefore, in the imaging / display device, the imaging device is directly embedded in the display screen of the display device.
In addition, there has been a demand for a configuration that makes the imaging device itself inconspicuous. The present invention has been made in order to solve the problems of the prior art, and an object of the present invention is to provide an imaging / display device that allows an observer to observe an image from a display screen of the display device without being perceived by an observer. It is an object of the present invention to provide a technology capable of capturing a natural image of a person. The above and other objects and novel features of the present invention will become apparent from the description of the present specification and the accompanying drawings.

[0004]

SUMMARY OF THE INVENTION Among the inventions disclosed in the present application, the outline of a representative one will be briefly described.
It is as follows. That is, the present invention is a display device including a point light emitting element array, and an imaging device arranged between the point light emitting devices of the display device, wherein an imaging surface is substantially the same as a display surface of the display device. An imaging / display device having at least one imaging device, wherein the at least one imaging device has an image transfer element and a photoelectric conversion element. Further, the present invention is characterized in that the point light emitting element array is constituted by an LED element or an FED element. Further, the present invention provides a display device in which panel-type displays are arranged in a matrix, and an imaging device arranged between the panel-type displays of the display device, wherein an imaging surface is substantially the same as a display surface of the display device. An imaging / display device having at least one imaging device serving as a surface, wherein the at least one imaging device has an image transfer element and a photoelectric conversion element. Further, the invention is characterized in that the panel type display is a CRT projector, a CRT display, or a plasma display. Further, the invention is characterized in that the image transfer element of the at least one image pickup device is a linear rod lens or a fiber array with a lens. Further, the present invention is characterized in that an optical system for enlarging the angle of view is arranged in front of the imaging surface of the linear rod lens. Further, the invention is characterized in that the photoelectric conversion element of the at least one imaging device is a CCD element. Further, the present invention is characterized in that an enlargement optical system for enlarging an image is arranged between the image transfer element and the CCD element.

[0005]

Embodiments of the present invention will be described below in detail with reference to the drawings. In all the drawings for describing the embodiments, components having the same functions are denoted by the same reference numerals, and repeated description thereof will be omitted.

[First Embodiment] FIG. 1 is a block diagram showing a schematic configuration of an image pickup / display apparatus according to a first embodiment of the present invention. In the figure, 101 is a CCD element, 102 is a rod-shaped distributed index lens, and 103 is an LED (Light Emi).
ssion diode) element (R: Red), 104 is an LED element (G: Green), 105 is an LED element (B: Bl)
ue), 106 is one pixel, 107 is an LED element substrate, 1
08 is an imaging / display device. In the imaging / display device 108 of the present embodiment, the display device is configured by arranging an LED element substrate 107 in which a plurality of pixels are arranged in a matrix in an array. Here, one pixel 106 is LE
D element 103 (R), LED element 104 (G), LED
It is composed of the element 105 (B). In addition, the imaging device
A CCD element 101 and a rod-shaped distributed index lens 102 constituting an image transmission element for transmitting an image to the CCD element 101
It consists of. Here, a rod-shaped distributed refractive index lens 102
Is a lens whose refractive index decreases parabolically from the central axis of the lens toward the outer peripheral surface, and has a diameter (φ) of 1 to 3 mm.
A lens having a characteristic of a resolution of about 400 lines / mm is actually commercially available.

In this embodiment, the LED elements (103 to 103)
A hole is made in an LED element substrate 107 for driving the element 105), a rod-shaped distributed index lens 102 is inserted into the hole, and an image is formed directly on the CCD element 101. Here, as shown in FIG.
The imaging surface of the (or imaging device) is substantially the same as the display surface of the display device. The rod-shaped distributed index lens 1
02 and the LED element substrate 107 on which the CCD elements 101 are arranged are arranged in an array. By using the rod-shaped distributed refractive index lens 102, an image to be photographed can be efficiently transmitted to the CCD element 101, so that the diameter of the hole into which the rod-shaped distributed refractive index lens 102 is inserted can be reduced, and The CCD element 101 and the peripheral circuits that require an area larger than the imaging area can be provided outside the LED element substrate 107. Thereby, the imaging region embedded on the display screen of the display device is
It is possible to reduce the size so as not to be perceived by the observer. Here, the diameter of the region where no pixel is perceived by the observer is generally defined as that the minimum distance that can be perceived in a spatially separated manner when a person with a visual acuity of 1.0 observes is 1 minute in solid angle. From, for example, assuming that the length of the display screen of the display device in the vertical direction is H, assuming observation from a distance of 3H in HDTV and 7H in NTSC, when the display screen is a 100-inch large screen display device, 1mm or less for HDTV,
In NTSC, the area is 3 mm or less.

In the present embodiment, a plurality of imaging devices each including the rod-shaped distributed refractive index lens 102 and the CCD element 101 are arranged. A single imaging device may be arranged, and an LED
It may be arranged between the element substrates 107. Also,
In the present embodiment, as shown in FIG. 2, an optical system (for example, a lens or the like) 110 for enlarging the angle of view is arranged on the front surface of the imaging surface of the rod-shaped distributed refractive index lens 102, so that the shooting area can be reduced. Can be expanded. Further, as shown in FIG. 3, an optical system (for example, a lens or the like) 111 for magnifying an image is disposed between the rod-shaped distributed refractive index lens 102 and the CDD element 101, thereby enlarging the area of the captured image. can do.

As described above, according to the present embodiment, LE
A point light emitting element array using D elements is used as a display device, at least a rod-shaped distributed refractive index lens (image transfer element) 102 and a photoelectric conversion element 101 are used as an imaging device, and a rod-shaped distributed refractive index is used. Since the lens 102 is embedded in a small area between the point light emitting elements so as not to be perceived by the observer, the observer is imaged through the rod-shaped distributed refractive index lens (image transmission element) 102.
A natural image of the observer can be taken from within the display screen without damaging the display screen. Thus, according to the present embodiment, a natural image of the observer can be captured from within the displayed display screen without being perceived by the observer. Imaging and display can be performed, and the sense of presence in bidirectional communication can be improved. Further, even when the observer approaches the display device, some of the plurality of arranged imaging devices can capture an image of the observer.
Furthermore, images are taken from a plurality of imaging devices arranged on the display screen of the display device, and a plurality of images are synthesized according to the purpose, and in a video conference or the like, an image capturing the gaze of the observer is transmitted to a communication partner. Then, by displaying, it is possible to match the eyes and create a sense of meeting. In this embodiment, an FED (Field Emission Display) element can be used as the point light emitting element instead of the LED element.

[Second Embodiment] FIG. 4 is a block diagram showing a schematic configuration of an image pickup / display device according to a second embodiment of the present invention. In the figure, 201 is a CRT projector unit, 202 is a CCD element, 203 is a fiber array,
204 is a screen, 205 is a lens, 206 is an image
A display device. Imaging / display device 206 of the present embodiment
, The display device is configured by a panel-type display including a projection-type CRT projector unit 201 and a screen 204. In addition, the imaging device is CC
It comprises a D element 202 and a fiber array 203 with a lens 205 that constitutes an image transmission element for transmitting an image to the CCD element 202. In the present embodiment, a hole is formed in the screen 204, a fiber array 203 with a lens 205 is inserted into the hole, and an image is formed directly on the CCD element 202. Here, as shown in FIG.
The imaging surface of the fiber array 203 (or imaging device) with 5 is substantially the same as the display surface of the display device. Also,
A plurality of the CCD elements 202 and a fiber array 203 having a lens 205 that constitutes an image transmission element that transmits an image to the CCD elements 202 are arranged between the projector units 201. Note that one imaging device including the fiber array 203 with the lens 205 and the CCD element 202 may be arranged between the projector units 201. By using the fiber array 203 with the lens 205, the captured image can be efficiently transmitted to the CCD element 202.
The diameter of the hole into which the fiber array 203 with the lens 205 is inserted can be reduced, and the CCD element 202 and peripheral circuits that require an area larger than the imaging area can be installed outside the projector unit 201.

As a result, also in the present embodiment, it is possible to make the imaging area embedded on the display screen of the display device small enough not to be perceived by an observer. Here, as described above, the diameter of the region in which the pixel is not perceived by the observer is based on the assumption that the length of the display screen of the display device in the vertical direction is H, and that the distance is 3H in HDTV and 7H in NTSC. In the case of a large-screen display device having a 100-inch display screen, 1 mm or less for HDTV and NTS
In C, the area is 3 mm or less. Also in the present embodiment, an optical system for image enlargement (for example, a lens or the like) is arranged between the fiber array 203 with the lens 205 and the CDD element 202 to enlarge the area of the captured image. be able to.

As described above, according to the present embodiment, the projection type CRT projector unit 201 and the screen 204 are used as the display device, and at least the fiber array 203 with the lens 205 and the CCD device 202 are used as the imaging device. Use and lens 205
Fiber array 203 with projector unit 2
01, the image is embedded in a small area of the screen 204 so as not to be perceived by the observer, and the observer is imaged through the fiber array 203 with the lens 205. An image of the observer's nature can be taken. Thus, also in the present embodiment, it is possible to obtain the same effect as in the first embodiment. In the present embodiment, the projection type CRT projector unit 201 and the screen 204 are used as the display device, but a panel type display such as a CRT display or a plasma display arranged in a matrix may be used. is there. As described above, the invention made by the present inventor is:
Although a specific description has been given based on the above-described embodiment, the present invention is not limited to the above-described embodiment, and it is needless to say that various modifications can be made without departing from the gist of the invention.

[0013]

The effects obtained by typical ones of the inventions disclosed in the present application will be briefly described as follows. (1) According to the present invention, a natural image of an observer can be captured from the display screen of the display device without being perceived by the observer. Display becomes possible, and it is possible to improve the sense of reality of two-way communication. (2) According to the present invention, even when the observer approaches the display device, some of the plurality of arranged imaging devices can image the observer. (3) According to the present invention, images are taken from a plurality of imaging devices arranged on a display screen, and a plurality of images are synthesized according to the application. By transmitting to the communication partner and displaying it, it is possible to match the eyes and create a sense of meeting.

[Brief description of the drawings]

FIG. 1 is a block diagram illustrating a schematic configuration of an imaging / display device according to a first embodiment of the present invention.

FIG. 2 is a diagram for explaining a modification of the imaging / display device according to the first embodiment of the present invention.

FIG. 3 is a diagram for explaining a modification of the imaging / display device according to the first embodiment of the present invention;

FIG. 4 is a block diagram illustrating a schematic configuration of an imaging / display device according to a second embodiment of the present invention.

FIG. 5 is a block diagram illustrating a schematic configuration of a conventional imaging / display device.

[Description of Signs] 101, 202: CCD element, 102: rod-shaped distributed index lens, 103: LED element (R), 104: LED
Element (G), 105: LED element (B), 106: LE
D1 pixel, 107 ... LED element base, 108, 206 ...
Imaging / display device, 110: optical system for expanding the angle of view, 111
... Optical system for image enlargement, 201 ... CRT projector unit, 203 ... Fiber array, 204 is a screen, 205 ... Lens, 1001 ... Imaging device, 1002 ...
Half mirror, 1003 ... Display device, 1004 ... Observer.

 ──────────────────────────────────────────────────の Continuing on the front page (72) Inventor Kenji Nakazawa 3-19-2 Nishi-Shinjuku, Shinjuku-ku, Tokyo Japan Telegraph and Telephone Co., Ltd. F-term (reference) 5C022 AA12 AC01 AC42 AC54 5C064 AA02 AB04 AC04 AC08 AC12 5C094 AA56 BA16 BA23 BA31 BA34 DA01 ED20 HA10 5G435 AA18 BB02 BB04 BB06 CC09 FF00 GG02 GG18 GG25 LL04

Claims (8)

[Claims] 1. A display device comprising a point light emitting element array, and an imaging device arranged between the point light emitting devices of the display device, wherein an imaging surface is substantially the same as a display surface of the display device. An imaging / display device having at least one device, wherein the at least one imaging device has an image transfer element and a photoelectric conversion element. 2. The point light emitting element array includes an LED element,
The imaging / display device according to claim 1, wherein the imaging / display device is configured by an FED element. 3. A display device in which panel displays are arranged in a matrix, and an imaging device arranged between the panel displays of the display device, wherein an imaging surface is substantially the same as a display surface of the display device. Imaging device having at least one imaging device
A display device, wherein the at least one imaging device has an image transfer element and a photoelectric conversion element. 4. The apparatus according to claim 3, wherein the panel type display is a CRT projector, a CRT display, or a plasma display. 5. The apparatus according to claim 1, wherein the image transfer element of the at least one image pickup device is a linear rod lens or a fiber array with a lens. The imaging and display device according to the above. 6. The image pickup / display apparatus according to claim 5, wherein an optical system for enlarging an angle of view is arranged in front of an image pickup surface of the linear rod lens. 7. The device according to claim 1, wherein the photoelectric conversion element of the at least one imaging device is a CCD element.
An imaging / display device according to claim 6. 8. A device according to claim 1, further comprising:
The imaging / display device according to any one of claims 1 to 7, wherein an enlargement optical system for enlarging an image is arranged.