JP2000333145A - Image input output device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To obtain an image input output device that can realize a display image with excellent visibility while realizing a thin profile and integration of an image pickup means and a display means. SOLUTION: The image input output device is provided with a display section 11 that bas light emitting elements arranged in a form of a matrix and displays an image by controlling light emission of the light emitting elements and with an image pickup section 12 that has light receiving elements arranged in a form of a matrix and extracts a light receiving signal outputted from the light receiving elements as image data signal. A light emitting direction of the light emitted by the light emitting elements of the display section 11 is selected nearly the same as an incident direction of the light received by the light receiving elements of the image pickup section 12.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image input / output device used in a television telephone system, a video conference system, and the like, and more particularly, to a display device for displaying an image and an imaging device for taking an image. The present invention relates to an image input / output device.

[0002]

2. Description of the Related Art In a telephone or conference system using a television system, a video of a speaker or a participant of a conference is displayed on a terminal of another party or another conference participant. An image pickup unit for acquiring an image and a display unit for displaying the image are provided. Generally, a camera provided with a lens is used as an imaging unit.

However, a camera as an imaging means has a limit in miniaturization and thinning due to the thickness of a lens portion. Therefore, when a camera is used as an imaging unit of a terminal device of a telephone or a conference system using a television system, the miniaturization of the camera is limited due to the limitation of miniaturization of the camera, and the miniaturization of the terminal device is also limited. The proportion of the terminal device occupying the desk becomes large, and the work space on the desk is reduced.

Further, in the case of realizing a portable information terminal device in a telephone using a television system, the limitation of miniaturization and thinning of a camera impedes the miniaturization and weight reduction of the portable information terminal device. I do.

[0005] In a telephone or conference system terminal device using this type of television system, the imaging means and the display means are separately provided. For example, a camera is used as the imaging means, and a liquid crystal display or other display device is used as the display means. In this case, since the camera as the imaging unit and the display device as the display unit are arranged at different positions, the line of sight of the user who looks at the display screen of the display device does not completely match the imaging direction of the camera. . Therefore, when the user of the terminal device speaks while looking at the image displayed on the display device, the interacting party talks while the user displayed on the display screen of his terminal device looks at another place. You will feel uncomfortable.

Conventionally, in order to eliminate the above-mentioned limitation caused by the thickness of the lens portion of the camera and to realize a thin imaging means, a lens array, a pinhole array, and a photodiode array are combined to form a layer structure. Panel-type image sensors have been proposed. As this kind of conventional technology, there is a technology disclosed in, for example, US Pat. No. 5,729,361. However, even in the prior art, the viewpoint of the user who looks at the display screen of the display device does not coincide with the imaging direction of the camera, which causes the discomfort.

As another conventional technique provided with a panel-type imaging means and a display means, there is a technique disclosed in Japanese Patent Application Laid-Open No. Hei 8-102924. However, in the technology disclosed in the publication, the imaging direction of the imaging unit and the display direction of the display unit are different, and a user is photographed from the side of the display screen as a subject facing the display screen. is not.

Therefore, an image input / output device has been proposed in which the imaging means and the display means are integrally formed so as not to cause such a feeling of strangeness. As an example of this type of conventional image input / output device, there is a technology disclosed in Japanese Patent Application Laid-Open No. 4-315390. This publication discloses a technique in which a translucent mirror is arranged on the entire surface of a display means to reflect an image of a subject (user), and an imaging means projects the light reflected by the translucent mirror, A method of arranging an optical shutter composed of a scattering type liquid crystal cell, further arranging an imaging means behind it, providing a fixed imaging time, and setting the scattering type liquid crystal cell to a transmission state during the imaging time during displaying an image. Is disclosed. According to these methods, the line of sight of the user who looks at the display screen can be made to coincide with the imaging direction of the imaging unit, so that the line of sight can be made natural.

However, since the translucent mirror is disposed on the front surface of the display means and the control circuit for the translucent mirror is further provided, the miniaturization and weight reduction of the apparatus are hindered. In addition, even when an optical shutter using a scattering type liquid crystal cell is provided, since light is temporarily transmitted to the imaging unit during the imaging time,
Display flickers.

[0010]

As described above, in the conventional image input / output device, when a camera is used as an image pickup means, there is a limit in miniaturization and thickness reduction due to the thickness of the lens portion. However, there is a disadvantage that the miniaturization of the terminal device itself is hindered.

Also, in the conventional image input / output device, since the imaging means and the display means are separately provided, the line of sight of the user who looks at the display screen does not match the imaging direction of the camera, and the conversation partner is uncomfortable. Had the disadvantage of having

Further, as in the prior art disclosed in Japanese Patent Application Laid-Open No. 4-315390, the imaging direction of the imaging device and the display direction of the display device are matched by using a semi-transparent mirror or an optical shutter of a scattering type liquid crystal cell. In this case, too, the device configuration becomes complicated, which hinders the miniaturization and weight reduction of the terminal device, and the display screen flickers.

An object of the present invention is to provide an image input / output device which solves the above-mentioned conventional drawbacks, realizes a reduction in thickness, integrates an image pickup means and a display means, and realizes a display image with good visibility. With the goal.

[0014]

The image input / output device of the present invention, which achieves the above object, comprises display means for arranging light emitting elements in a matrix and displaying an image by controlling light emission of the light emitting elements. Imaging means for arranging light receiving elements in a matrix, and taking out a light receiving signal output from the light receiving element as an image data signal; and an emission direction of light emitted by the light emitting element of the display means; And the incident direction of the light received by the light receiving element is substantially the same.

According to a second aspect of the present invention, the image input / output device is a plate-like member having a size to cover the entire light receiving side of the image pickup means, and is provided so as to be superimposed on a surface of the image pickup means in the light receiving direction. Using a member having good translucency, further provided with a light guiding means formed in a shape having a light guiding property to guide the light passing therethrough in parallel for each of the light receiving elements of the imaging means. I do.

According to a third aspect of the present invention, there is provided the image input / output device, wherein the plate-like member has a size to cover the entire display side of the display means and the entire light receiving side of the imaging means. Is provided, using a member having a good translucency and a refractive index different from that of the light guide means, to prevent reflection of light emitted from the light emitting element of the display means, and to input light from the light receiving side of the imaging means. A light incident angle control means for transmitting only light is provided.

According to another aspect of the present invention, there is provided an image input apparatus, wherein optical elements which can be used as a light emitting element and a light receiving element by electrical control are arranged in a matrix, and a part of the optical element is provided. An image display and image pickup means for displaying an image by controlling light emission using a light emitting element and extracting a light reception signal output using another part of the light element as a light receiving element as an image data signal, The light emitting direction when the optical element is used as a light emitting element is substantially the same as the light incident direction when the optical element is used as a light receiving element.

According to still another aspect of the present invention, there is provided an image input / output device for displaying an image using an LCD, and light receiving elements arranged in a matrix.
Imaging means for taking out a light receiving signal output from the light receiving element as an image data signal, wherein a direction of a display surface of the display means and an incident direction of light received by the light receiving element of the imaging means are substantially the same. It is characterized by a direction.

[0019]

Embodiments of the present invention will be described below with reference to the drawings. FIG. 1 is a schematic diagram illustrating a configuration of an image input / output device according to an embodiment of the present invention. Referring to FIG. 1, an image input / output device according to the present embodiment includes a display unit 11 for displaying an image, and an imaging unit 12 for capturing an image.
And a substrate 13 provided with a control circuit for controlling the imaging unit 12
And a light incident angle control unit 14 for restricting incident light. As shown in the drawing, light is incident on the surface of the image input / output device in a direction from the light incident angle control unit 14 to the imaging unit 12, and passes from the display unit 11 through each light incidence control unit 14. Light is emitted. In FIG. 1, only the characteristic configuration of the present embodiment is described, and the description of other general configurations is omitted.

In the above configuration, the display section 11 is formed by arranging a plurality of light-emitting elements that serve as pixels of a display screen in a matrix. Each light emitting element is connected to an electrode to which a potential for emitting light is applied.

The image pickup section 12 is formed by arranging a plurality of light receiving elements having a light detecting function in a matrix. The matrix in the imaging unit 12 can correspond to, for example, a matrix of light emitting elements in the display unit. In this case, each light receiving element of the imaging unit 12 and each light emitting element of the display unit 11 overlap at a corresponding position.

The substrate 13 is a light guiding unit that covers the entire light receiving side of the image pickup unit 12 and guides light to each light receiving element arranged in the image pickup unit 12. As a member of the substrate 13, a member having good translucency such as glass or plastic is used. In addition, the shape has a light guiding property such that light passing through the substrate 13 is guided in parallel to each light receiving element of the imaging unit 12. Accordingly, the incident direction of light to each light receiving element becomes constant, and for example, a direction perpendicular to the surface of the imaging unit 12 can be set as the imaging direction. An example of the configuration of the substrate 13 may be a lens-curacular configuration.

The light incident angle control unit 14 covers the entire surface of the display unit 11 on the display side and the imaging unit 12, and the light emitted from the light emitting element of the display unit 11 is reflected on the substrate 13 and Do not lead to the light receiving element. As a member of the light incident angle control unit 14, a member having good light transmission such as glass or plastic is used. In addition, the refractive index of the substrate 1
3 is adjusted to an appropriate value different from that of the display unit 1.
The light coming from the light emitting element 1 is not reflected.

By the combination of the substrate 13 and the light incident angle control unit 14, the imaging direction of the imaging unit 12 is controlled to be substantially the same as the display direction of the display unit 11 (the side on which the display is viewed). Thereby, the imaging unit 12 can take an image of the user who wants to view the image displayed on the display unit 11 from the direction of the user's line of sight as a subject.

In this embodiment, a pixel serving as a unit of display or imaging is constituted by individual light emitting elements included in the display unit 11 and individual light receiving elements included in the imaging unit 12. That is, the display unit 11 and the imaging unit 12
Include one set of a corresponding light-emitting element and light-receiving element in a state where they are superimposed. The substrate 13 also guides light for each pixel. FIG. 2 is a circuit diagram showing a configuration of one pixel. FIG.
FIG. 3 is a schematic diagram showing matrix wiring for controlling the display unit 11 and the imaging unit 12. Referring to FIG. 3, the matrix wiring includes a display scanning signal line 113 and an image scanning signal line 123 which are arranged in parallel and alternately with each other.
The display data signal lines 114 and the image data signal lines 124 which are arranged in parallel and alternately with each other are arranged orthogonal to each other.

Referring to FIG. 2, the pixel 100 includes one light emitting element 110 and one light receiving element 120. The light emitting element 110 includes a photodiode 111 and a transistor 11
2 and a display scanning signal line 1 for controlling display of an image among the matrix wirings shown in FIG.
13 and the display data signal line 114 are connected.
The light emitting element 110 is connected via a display scanning signal line 113 to
A scanning signal for controlling image display is received, and a data signal of an image to be displayed on the display unit 11 is received via the display data signal line 114. In addition, regarding the technology of displaying an image using the light emitting elements arranged in a matrix,
A known technique used conventionally can be used.

The light receiving element 120 is constituted by connecting a photodiode 121 and a transistor 122,
In the matrix wiring shown in FIG. 3, the light receiving element 120 is connected to an image scanning signal line 123 and an image data signal line 124 for converting light received by the light receiving element 120 into a captured image. The light receiving element 120 is connected to the image scanning signal line 12.
3, a scanning signal for generating an image is received, and a light receiving signal is transmitted via the image data signal line 124. In addition, as a technique for creating an image using the light receiving signal thus obtained as image data, a known technique that has been conventionally used can be used.

Therefore, the light emitting element 110 is provided at each intersection of the display scanning signal line 113 and the display data signal line 114 of the matrix wiring shown in FIG.
Reference numeral 20 is provided at each intersection of the image scanning signal line 123 and the image data signal line 124 of the matrix wiring shown in FIG. Thereby, the light emitting element 110 and the light receiving element 1
20 correspond one to one, and each set of the light emitting element 110 and the light receiving element 120 constitutes one pixel.

As described above, in the imaging section 12 superimposed on the display section 11, it is possible to perform imaging by receiving light by a plurality of light receiving elements arranged in a matrix. Thereby, the line of sight of the user who looks at the display screen and the imaging direction of the imaging unit can be matched, so that the line of sight can be made natural. Further, since the light emitting element and the light receiving element are provided side by side, the visibility of the displayed image is not deteriorated. Further, since the substrate 13 that guides light for each light receiving element of the imaging unit 12 is used as a light condensing unit for the imaging unit 12, the thickness of the entire image input / output device can be extremely reduced.

In the above embodiment, the light emitting elements in the display unit 11 and the light receiving elements in the imaging unit 12 are provided in one-to-one correspondence, but the light emitting elements and the light receiving elements are not necessarily one to one. There is no need to make it correspond. For example, if a reduction in resolution is allowed, several light emitting elements and one light receiving element may be provided in association with each other. Further, the light receiving elements may be arranged only at positions corresponding to a partial area of the display screen of the display unit 11.

FIG. 4 is a schematic diagram showing the configuration of an image input / output device according to another embodiment of the present invention. Referring to FIG. 4, the image input / output device according to the present embodiment includes an image display / imaging unit 21 for displaying and photographing an image, a substrate 13 including a control circuit for controlling the image display / imaging unit 21, It has a laminated structure in which the light incidence angle control unit 14 to be restricted is superimposed. As shown in the drawing, light is incident on the surface of the image input / output device in a direction from the light incident angle control unit 14 to the imaging unit 12, and passes from the display unit 11 through each light incidence control unit 14. Light is emitted. FIG. 4 shows only the characteristic configuration of the present embodiment, and the description of other general configurations is omitted.

In the present embodiment, as a whole, the display unit 11 and the imaging unit 12 are integrated with the image input / output device according to the first embodiment shown in FIG. Since the substrate 13 and the light incident angle control unit 14 are the same as the substrate 13 and the light incident angle control unit 14 in the first embodiment, the same reference numerals are given and the description is omitted.

The image display / imaging unit 21 is formed by arranging a plurality of optical elements which operate as light emitting elements and light receiving elements by electric switching control in a matrix. Each optical element has the same circuit configuration as the light emitting element 110 in FIG. 2 when functioning as a light emitting element, and has the same circuit configuration as the light receiving element 120 in FIG. 2 when functioning as a light receiving element.

As the optical element of this embodiment, for example, PN
An element having a light-emitting function having a junction can be used. In this case, when the optical element is used as a light emitting element,
Light is emitted by forcibly injecting electrons via a PN junction and performing recombination light emission as an excitation means using spontaneous emission. On the other hand, when an optical element is used as a light receiving element, the phenomenon opposite to recombination light emission is used, and by using a phenomenon corresponding to light absorption excitation, the flow of electrons is changed at the PN junction, Obtain the excitation current. As described above, by using an element using a PN junction as the optical element and inverting the voltage applied to the electrode of the element, the element can be used as a light emitting element and a light receiving element.

FIG. 5 shows an image display / imaging unit 21 according to this embodiment.
FIG. 3 is a schematic diagram showing a matrix wiring for controlling an optical element constituting the device. Referring to FIG. 5, the matrix wiring includes a parallel and parallel scanning signal line 131 shared for display and imaging, and a parallel and parallel data signal line 132 also shared for display and imaging. They are wired orthogonally to each other. The optical element is provided at each intersection of the matrix wiring shown in FIG. Then, the data signal line 132
By changing the voltage supplied to each optical element through the optical element, the optical element operates as a light emitting element or a light receiving element.

As shown in FIG. 5, each data signal line 132
The operation of transmitting a data signal for display to the optical element,
A changeover switch 140 for switching between an operation of extracting a light receiving signal output from the optical element as an image data signal is connected. When the data signal line 132 is connected to the data signal line 141 that supplies the data signal of the display image under the control of the changeover switch 140, the data signal of the display image is supplied to the optical element via the data signal line 132, The optical element operates as a light emitting element. On the other hand, a data signal line 132 for acquiring a data signal of an image image
Is connected to the optical element, the optical element operates as a light receiving element, and the light receiving signal output from the optical element is transmitted to the data signal line 13.
2 and processed as image data.

The image display and imaging unit 2 configured as described above
In 1, the optical elements arranged in a matrix are
By operating every other or every other light-receiving element and operating other optical elements as light-emitting elements, or as a light-receiving element, only light elements in a partial area of the display screen of the image display / photographing section 21 are used as light-receiving elements. By operating and operating another optical element as a light emitting element, the line of sight of the user who looks at the display screen and the imaging direction of the imaging unit can be matched, so that the line of sight can be made natural. Further, according to the present embodiment, since the optical element constituting the image display / imaging unit 21 can be used as both a light emitting element and a light receiving element by electrical control, it is easy to switch the optical element operated as the light receiving element. It can be carried out. Therefore, it is possible to dynamically adjust the resolution and set the position of the light receiving element so that the line of sight does not become unnatural.

FIG. 6 is a schematic diagram showing the configuration of an image input / output device according to still another embodiment of the present invention. Referring to FIG. 6, the image input / output device according to the present embodiment includes an LCD layer 31 for displaying an image, a pixel driving element plate 32, a switching element plate 33, and a backlight 34, and an imaging unit 12 for capturing an image. , A substrate 13 having a control circuit for controlling the imaging unit 12 and a light incident angle control unit 14 for restricting incident light are provided in a superposed manner. Also, as shown
Light is incident on the surface of the image input / output device in the direction from the light incident angle control unit 14 to the imaging unit 12, and the LCD layer 31
The light is emitted in a direction in which the light passes through each control unit 14. FIG. 6 shows only the characteristic configuration of the present embodiment, and the description of other general configurations is omitted.

This embodiment is different from the image input / output device according to the first embodiment shown in FIG. 1 in that, instead of the display section 11, the LCD layer 31, the pixel driving element plate 32, the switching element plate 3
3 and a backlight 34. The image pickup unit 12, the substrate 13, and the light incident angle control unit 14 are the same as the image pickup unit 12, the substrate 13, and the light incident angle control unit 14 in the first embodiment. Omitted.

In the present embodiment, a pixel drive element plate 32 on which a control circuit for controlling liquid crystal constituting each pixel in the LCD layer 31 is mounted, and a current supplied to a drive element for each pixel in the pixel drive element plate 32 is controlled. A desired image is displayed by controlling the operation of the LCD layer 31 by using the switching element plate 33 having a control circuit mounted thereon. LC
As for the image display technique by D, a known technique conventionally used can be used.

Although the present invention has been described with reference to the preferred embodiments, the present invention is not necessarily limited to the above embodiments.

[0042]

As described above, according to the image input / output device of the present invention, in the image pickup device superimposed on the display device, the image is picked up by the light reception by the plurality of light receiving elements arranged in a matrix. Can be. Thereby, since the line of sight of the user who looks at the display screen can be made to coincide with the imaging direction of the imaging unit, there is an effect that the line of sight can be made natural.

Further, since the light emitting element and the light receiving element are provided side by side, there is an effect that the visibility of the displayed image is not deteriorated.

Further, since a light guiding means for guiding light in units of light receiving elements of the imaging means is used as a condensing means for the imaging means, there is an effect that the thickness of the entire image input / output device can be extremely reduced. .

Further, the light emitting element and the light receiving element are used for
In addition, since switching can be performed by electrical control and the imaging unit and the display unit are integrally configured, it is possible to easily switch an element that operates as a light receiving element.
There is an effect that the adjustment of the resolution and the setting of the position of the light receiving element so that the line of sight does not become unnatural can be performed dynamically.

[Brief description of the drawings]

FIG. 1 is a schematic diagram showing a configuration of an image input / output device according to an embodiment of the present invention.

FIG. 2 is a circuit diagram showing a configuration of a light emitting element and a light receiving element constituting a pixel in the present embodiment.

FIG. 3 is a schematic diagram showing matrix wiring for controlling the light emitting element and the light receiving element of FIG. 2;

FIG. 4 is a schematic diagram illustrating a configuration of an image input / output device according to another embodiment of the present invention.

FIG. 5 is a diagram showing matrix wiring for controlling an optical element in the present embodiment.

FIG. 6 is a schematic diagram showing a configuration of an image input / output device according to still another embodiment of the present invention.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 11 Display part 12 Imaging part 13 Substrate 14 Light incident angle control part 21 Image display imaging part 31 LCD layer 32 Pixel drive element board 33 Switching element board 34 Backlight

Continued on the front page (51) Int.Cl. ⁷ Identification symbol FI Theme coat II (reference) H04N 5/225 H04N 5/225 F 5G435 7/15 630Z 7/15 630 H01L 31/02 DF term (reference) 5C022 AA06 AA12 AB13 AB37 AC41 AC55 AC70 5C051 AA01 BA03 DA06 DB01 DB04 DB06 DC02 DC04 DC05 DC07 FA00 5C064 AA01 AA02 AB01 AB02 AB04 AC04 AC12 AD06 BA07 BB10 BC20 BD01 BD07 5C080 AA10 BB05 DD21 EE32. KA10 5G435 AA00 AA01 AA18 BB01 BB12 BB15 CC09 DD09 DD10 EE25 EE33 FF01 GG25 HH02 LL07

Claims (9)

[Claims] 1. A light-emitting element is arranged in a matrix, a display means for displaying an image by controlling light emission of the light-emitting element, and a light-receiving signal output from the light-receiving element is arranged in a matrix. Imaging means for extracting the light as an image data signal, wherein the emission direction of light emitted by the light emitting element of the display means and the incident direction of light received by the light receiving element of the imaging means are substantially the same direction. An image input / output device characterized by the above-mentioned. 2. A plate-like member which is large enough to cover the entire light-receiving side of the imaging means and is provided so as to be superimposed on a surface in the light-receiving direction of the imaging means, and using a member having good translucency, 2. The image input / output apparatus according to claim 1, further comprising a light guiding unit formed in a shape having a light guiding property for guiding the light passing therethrough in parallel for each of the light receiving elements of the imaging unit. . 3. A plate-like member which is large enough to cover the entire surface on the display side of the display means and on the light receiving side of the image pickup means, and is provided so as to overlap with the light guide means, and has good light transmission properties. A light incident angle control unit that prevents reflection of light emitted from the light emitting element of the display unit using a member having a different refractive index from that of the light unit and transmits only light incident from the light receiving side of the imaging unit. The image input / output device according to claim 2, wherein the image input / output device is provided. 4. An image is displayed by arranging optical elements which can be used as a light emitting element and a light receiving element by electric control in a matrix, and controlling light emission by using a part of the optical elements as a light emitting element. And an image display / imaging means for extracting a light reception signal output by using another part of the optical element as a light receiving element as an image data signal, and an emission direction of light when the optical element is used as a light emitting element. An image input device wherein the light incident direction when the optical element is used as a light receiving element is substantially the same as the light incident direction. 5. A plate-shaped member which is large enough to cover the entire light receiving side of the image display / imaging means, and is provided so as to be superimposed on a surface of the image display / imaging means in a light receiving direction, and has a good translucency. 5. The method according to claim 4, further comprising: a light guiding unit formed in a shape having a light guiding property to guide light passing therethrough in parallel for each of the optical elements of the image display / imaging unit. The image input / output device according to the above. 6. A plate-like member which is large enough to cover the entire display side and the light receiving side of the image display / imaging means, and is provided so as to be superposed on the light guide means, and has a good light transmission property. Light incident angle control means for preventing reflection of light emitted from the optical element of the image display / imaging means and transmitting only light incident from the light receiving side of the image display / imaging means by using a member having a different refractive index from that of the image display / imaging means. 6. The method according to claim 5, further comprising:
An image input / output device according to claim 1. 7. An image display means for displaying an image using an LCD, and an image pickup means for arranging light receiving elements in a matrix and taking out a light receiving signal output from the light receiving element as an image data signal, An image input / output apparatus, wherein a direction of a display surface of the means and an incident direction of light received by the light receiving element of the imaging means are substantially the same. 8. A plate-like member which is large enough to cover the entire light-receiving side of the imaging means, is provided so as to be superimposed on a surface in the light-receiving direction of the imaging means, and uses a member having good translucency. 8. The image input / output device according to claim 7, further comprising a light guiding unit formed in a shape having a light guiding property for guiding the light passing therethrough in parallel for each of the light receiving elements of the imaging unit. . 9. A plate-like member which is large enough to cover the entire surface on the display side of the display means and on the light receiving side of the imaging means, and is provided so as to be superposed on the light guide means, and has good light transmission properties. Using a member having a refractive index different from that of the light means, preventing reflection of light emitted from the display means, and further providing a light incident angle control means for transmitting only light incident from the light receiving side of the imaging means. 9. The image input / output device according to claim 8, wherein: