KR20010046844A - A compound apparatus of camera and display - Google Patents

Abstract

PURPOSE: A device for complexing a camera and a display is provided to simplify a system constituting and photograph a user who is watching a screen being displayed at the front direction. CONSTITUTION: A complex panel(20) complexes a photographing element and a displaying element organically for paralleling a displaying direction and a photographing direction with respect to a front surface of one user. As the photographing element being called by an image sensor, one sensor out of image sensors including a CCD-image sensor and a CMOS image sensor is adapted. As the displaying element, one sensor out of display elements including a LCD element cell, a TFT-LCD element cell is adapted. A display driving unit(21) and a control unit(22) displays inputted image signal to a user using display elements of the complex panel(20) in accordance with a predetermined driving control method. A photographing signal detecting unit(23) and a signal processing unit(24) detect and process a signal respond to the photographed image of the user using photographing elements of the complex panel(20).

Description

A compound apparatus of camera and display

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a device in which a camera and a display are combined, and more particularly, to a panel in which an imaging device and a display device are combined, and more particularly, to an apparatus for more efficiently performing imaging and display using the same.

Conventionally, as shown in FIG. 1, the imaging means and the display means are configured independently of each other. Therefore, in a system such as a video conferencing system, a video phone, a video phone, a mobile phone for video communication, the camera constitutes a system that is separately mounted in a position not overlapping with the display screen, and the front image of the user staring at the screen is captured. For this purpose, the posture of the camera located outside the screen area must be adjusted or controlled separately.

However, in a video communication system in which image capturing means and display means are independently configured, a user who needs to stare at a screen for video communication with the other party must adjust a posture of a camera for capturing his / her own appearance, which is very inconvenient in use. .

In order to alleviate such inconvenience in use, a system for automatically adjusting the posture of a camera by tracking a user's movement has been proposed, but since the camera is mounted to protrude outside the body of the display means or inserted into the body, The problem remains that the configuration is complicated, the appearance is not beautiful, the user cannot be photographed from the front of the displayed screen, and the high cost is required for the adoption of the above-described camera posture control system.

SUMMARY OF THE INVENTION An object of the present invention for solving all the above-mentioned problems is an optimal combination of display means and image pickup means, which is convenient in use and simplifies the system configuration and can image a user staring at a displayed screen from the front. In providing a device.

1 is a configuration diagram showing an example of an existing system, wherein the camera and the display are configured independently of each other,

2 is a block diagram showing an apparatus in which an imaging unit and a display are combined according to an exemplary embodiment of the present invention;

FIG. 3 is a view illustrating a configuration where a composite panel of the apparatus of FIG. 2 is implemented as one panel layer; FIG.

4a to 4c are views showing the configuration when the composite panel of the device of Figure 2 is implemented with at least two panel layers,

<Description of the symbols for the main parts of the drawings>

20: composite panel 20a: image pickup device panel layer

20b: display element panel layer 20c: insulating layer

21: display driver 22: drive control unit

23: image pickup signal detector 24: signal processor

An apparatus for achieving the above object of the present invention is an apparatus for imaging and display, comprising: a panel in which an imaging device and a display device are combined; Signal processing means for an image pickup device composited on said panel; And driving means for a display element composite on the panel.

The panel in which the imaging device and the display device are combined (hereinafter, referred to as a "composite panel") is configured such that the display direction and the imaging direction are parallel to each other on the optical path, thereby finally fronting the front of the same user. Characterized by facing. Herein, in the above-described embodiments of the composite panel, a first case in which the image pickup device and the display device are combined without overlapping each other on one same panel, and the first panel layer on which the image pickup device is formed and the first panel on which the display device is formed The second case in which the two panel layers are combined so as to have the corresponding imaging direction and the display direction parallel to each other is preferable, but the present invention is not limited thereto.

Hereinafter, exemplary embodiments of the present invention will be described in detail with reference to the accompanying drawings.

2 shows an apparatus in which an image pickup means and a display means are combined according to a preferred embodiment of the present invention. The apparatus of FIG. 2 comprises a composite panel 20 which is a panel in which a display element and an image pickup element are organically compounded, means 21 and 22 for driving the display element of the composite panel 20 described above, and Means 23 and 24 for processing signals from the image pickup device of the composite panel 20 are provided.

In the above-described composite panel 20, the image pickup device and the display device are organically combined so that the display direction and the image pickup direction are parallel with respect to the front face of the same user on the optical path. For clarity, the display direction and the imaging direction are defined as the direction from the composite panel 20 toward the user, and the light receiving direction is the direction from the user who is the subject toward the composite panel 20. In addition, although the above-described optical path is preferably straight, the optical path may be changed by a predetermined non-illustrated optical path changing means (for example, a reflection mirror or a light refractive means). The image pickup device is generally called an image sensor in the art, and at least one of image sensors including a CCD image sensor and a CMOS image sensor is employed. Especially, the CMOS image sensor has a modulator attached to each pixel to convert the charge into an electrical signal according to the photoelectric conversion, and reads only the necessary data, and the read speed is fast and operates at the same low voltage as a general semiconductor. There is no need to control circuits of various levels of voltage, the battery life is long, and one-chip and miniaturization with surrounding signal processing circuits are easy. Therefore, when the apparatus according to the present invention is applied to a portable communication terminal, it is more preferable to employ a CMOS image sensor having advantages of low power consumption, miniaturization, and low cost, rather than a CCD image sensor, but the present invention is not limited thereto. Do not. And the display element is employed at least one of the LCD element cell known in the art, or display elements comprising a TFT-LCD element cell, the present invention is not limited to this.

The display driver 21 and the controller 22 display the input image signal to the user using the display elements of the composite panel 20 according to a predetermined driving control method. The image pickup signal detector 23 and the signal processor 24 detect and signal the signal corresponding to the image of the user captured by using the image pickup devices of the composite panel 20. In addition, since the general configuration and operation of these means will be well understood by those skilled in the art, a detailed description thereof will be omitted. However, according to the present invention, the display driver 21 and the image pickup signal detector 23 are organically coupled to the display devices and the image pickup devices on the composite panel according to the embodiment of the composite panel, which will be described later.

Next, a specific embodiment of the composite panel 20 shown in FIG. 2 will be described with reference to FIGS. 3 to 4C.

FIG. 3 conceptually illustrates a configuration in which the composite panel 20 of the apparatus of FIG. 2 is implemented with one panel layer. Referring to FIG. 3, a display device cell and an imaging device cell ( ) Are formed so as not to overlap each other in areas separated from the same panel layer so as not to cause signal interference with each other. This is based on the fact that the size of each cell (display device cell, imaging device cell) is extremely small, so that even if cells that are distinguished from each other are formed in a complex manner, they can be implemented without significantly affecting the quality of the display and the captured image. . Here, the display element cell and the imaging element cell ( The arrangement ratio and relative position of) may be configured as '1: 1' as shown in FIG. 3, but the present invention is not limited thereto. Therefore, when deformed, it is obvious that the arrangement ratio and the relative position of each cell can be variably adjusted by those skilled in the art according to product specifications related to the quality of the displayed image, the resolution of the captured image, and the application field. Do.

And a display element cell and an imaging element cell ( The display driver 21 and the image pickup signal detection unit 23 shown in Fig. 2 are organically coupled to each other to perform driving control of the image to be displayed and detection of the imaged signal. Here, the organic coupling relationship may be implemented in various ways depending on the type of display device cell and the image pickup device cell to be employed, and the respective drive control and signal detection methods corresponding thereto, based on the technical idea of the present invention. As will be apparent to those skilled in the art, detailed descriptions are omitted.

4A to 4C illustrate the composite panel 20 of the apparatus of FIG. 2 in the case where the first panel layer 20a in which the image pickup device is formed and the second panel layer 20b in which the display element is formed are organically composited. Show the composition conceptually. Here, the first panel layer 20a and the second panel layer 20b are combined such that the imaging direction and the display direction of the front face facing the user are parallel to each other on the optical path.

In the embodiment of FIG. 4A, since the first panel layer 20a on which the image pickup device is formed is compounded ahead of the user than the second panel layer 20b on which the display device is formed, the first panel layer 20a is formed to prevent distortion of the image signal displayed toward the user. It is preferable not to employ an optical lens in front of the one panel layer 20a. In this case, the optical signal corresponding to the image of the user, which is the subject, is immediately converted into an electrical signal in the first panel layer 20a where the image pickup device is located, and supplied to the image pickup signal detection unit 23 shown in FIG. The first panel layer 20a is at least optically transparent so that the image displayed on the second panel layer 20b can be seen as an image of sufficient quality to a user located in front of the first panel layer. The image pickup device is generally formed on a transparent substrate such as a glass plate, and will be obvious to those skilled in the art.

In the embodiment of FIG. 4B, since the second panel layer 20b on which the display element is formed is compounded in front of the user than the first panel layer 20a on which the image sensing element is formed, the second panel layer 20b and the first panel layer 20a. ), An optical lens may be used to form an image of a subject incident through the second panel layer 20b, and in this case, it is preferable that the optical lens adopt a thin refractive index lens. . In addition, the second panel layer 20b is formed to be optically transparent at least as much as the image sensor of the first panel layer can capture a subject positioned in front of the second panel layer as an image of sufficient quality. This is generally apparent to those skilled in the art, since the spacing between the corresponding element cells on the display panel is wide enough to transmit the optical signal of the subject located in front of the second panel layer. For example, in the first panel layer 20a located behind the second panel layer 20b, the imaging device cells are mainly formed at positions corresponding to the vertical intervals between the scanning lines of the second panel layer. Imaging element cells are formed at positions corresponding to the intervals between the display element cells in the horizontal position corresponding thereto. When the resolution of the captured image is low, the image pickup signal detector 23 or the signal processor 24 of FIG. 2 processes the captured image by interpolation or motion compensation based on the temporal and spatial correlation of the image. Images can be obtained with sufficient quality.

In the embodiment of FIG. 4C, a signal insulator between two panel layers 20a and 20b is formed by disposing a transparent insulator 20c (for example, a dielectric) between the first panel layer 20a and the second panel layer 20b. It can be blocked miraculously. Even in this case, the display driver 21, the controller 22, and the image pickup signal detector 23 and the signal processor 24 shown in FIG. 2 are organically applied to the respective panel layers or respective elements described above. It works in conjunction.

On the other hand, it will be apparent to those skilled in the art that a number of non-mentioned embodiments can be derived from the preferred embodiments based on the technical spirit of the present invention described above.

2 to 4c, the apparatus in which the image pickup means and the display means are organically combined, and the method for implementing the aforementioned composite panel and a control method thereof also belong to the technical scope based on the technical idea of the present invention. Will be apparent to those skilled in the art.

As described above, the present invention proposes a panel in which an imaging device and a display device are combined, and enables imaging and display in the same position and in the same direction on an optical path using the same. Therefore, when the present invention is applied to a video communication system, the system configuration is greatly simplified and the camera means are not exposed at all, thereby providing beauty of the appearance, and at the same time, the user using the same does not have to care about the camera separately while staring at the screen. This provides a significant improvement in use. In addition, when the device according to the present invention is mass-produced through a semiconductor manufacturing process, it will provide a significantly improved cost saving effect compared to the conventional. In particular, when the device according to the present invention is applied to a portable video communication terminal, the miniaturization and convenience of use of the system will be greatly improved, and thus, a great industrial success is obvious to those skilled in the art.

Claims (7)

In the device for imaging and display, A panel in which an image pickup device and a display device are combined; Signal processing means for an image pickup device integrated on the panel; And And drive means for a display element composite on said panel. 2. The apparatus of claim 1, wherein the panel is compounded such that the display direction and imaging direction are parallel to each other on its optical path. The display panel of claim 1, wherein the panel comprises a first panel layer in which an image pickup device is formed and a second panel layer in which a display element is formed, and the first panel layer and the second panel layer are formed in parallel with each other in an imaging direction and a display direction. Device. 4. The apparatus of claim 3, wherein, among the first panel layer and the second panel layer, the panel layer disposed ahead of the user facing the user is formed of an optically transparent panel layer. The apparatus of claim 1, wherein the composite panel is a composite of an image pickup device and a display device on the same panel layer. 2. The apparatus of claim 1, wherein the image pickup device is at least one of image pickup devices including a CMOS image sensor and a CCD image sensor. The apparatus of claim 1, wherein the display element is at least one of display elements including an LCD element and a TFT-LCD element.