JPH07143469A - Image pickup and display integrated device - Google Patents

Abstract

PURPOSE:To attain a compact configuration without arrangement of a half mirror or the like to a talker in front of a display section by picking up an object through a display section at an image pickup section when the transparency of the display section provided to a front side of the image pickup increased. CONSTITUTION:When an image pickup part picks up an image, a display part makes no display, a flat panel display device 1 of the display part and a reflecting member 5 whose transparency is controlled in an increasing way are controlled so as to increase the transparency of the both. Thus, an image of the light from the front side of the display device 1 is formed to a light receiving part of an image pickup element 4 through an image pickup lens 3 to pick up an image of an object in front of the display device 1. Furthermore, when the display makes the display, the image pickup does not pick up any image, a back light 2 is lighted and the illuminated light and the light reflected in reflecting plates 6, 5 (its transparency is not increased in the display state) pass through the display device 1. Thus, the transmitted video image is displayed with contrast or coloring based on a filter control state of the display device 1.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an image pickup / display integrated device in which an image pickup section and a display section are integrated.

[0002]

2. Description of the Related Art Conventionally, as an image pickup and display integrated device, in order to realize a videophone device or the like which allows a user to talk with each other as if he / she was staring at the other side of the display unit, as disclosed in JP-A-5-236470. There is a structure in which a half mirror or the like is diagonally arranged on the caller side. This is because the optical axis of the display light reaching the eyes of the caller from the display unit and the optical axis of the imaging light for imaging the caller are matched by a half mirror or the like. Since the display direction of the screen matches or approaches, the caller in front of both videophone devices connected via a network or the like can talk in line-of-sight conversation while watching the image of the other party on the screen. .

[0003]

DISCLOSURE OF THE INVENTION Problems to be Solved by the Invention
In order for both parties to talk with their eyes aligned, in order to match or approach the image pickup direction and the display direction that the display screen is facing, the size equal to or larger than the area of the display unit It is necessary to equip the front surface of the display unit with a half mirror, etc., and there is a drawback that the device cannot be made compact.

An object of the present invention is to eliminate these drawbacks and to make a compact structure without disposing a half mirror or the like on the front side of the display unit on the side of the caller.

Another object of the present invention is to realize an image pickup and display integrated device capable of picking up an image of a part on the display screen and a portion close to the display screen through the display screen.

[0006]

In order to achieve the above object, the present invention uses a flat panel display 1 as a display unit as shown in FIG. 1, and the flat panel display 1 uses a liquid crystal or the like. It is possible to control the flat panel display 1 by the image pickup element 4 and the lens 3 of the image pickup unit which are arranged behind the flat panel display 1 when the transparency is increased.
It is possible to image the front of the.

Also, the flat panel display 1
When a light source is required to emit light, the backlight 2 is arranged behind the flat panel display 1.
The backlight 2 emits light while displaying an image, and when the image capturing section captures an image, the backlight 2 is extinguished so as not to wrap around to the light receiving section of the image sensor 4 of the image capturing section.

Instead of turning off the backlight 2, the light reaching the light receiving portion of the image pickup device 4 may be blocked.

Also, the flat panel display 1
In order to make the luminous intensity distribution of the emitted light as constant as possible, the light from the backlight 2 has a substantially constant luminous intensity over the entire area of the flat panel display 1. It is also possible to provide 5 and 6) therein. In this case, a part of the light guide device (5 in FIG. 1)
Is installed between the flat panel display 1 and the image pickup device 4 and the lens 3 of the image pickup section by using liquid crystal or the like. When the panel display 1 is displayed, it is controlled so as to have a reflection function of reflecting the light from the backlight 2 to the flat panel display 1.

Further, a shutter blade or the like (not shown) having a reflecting function may be arranged on the front surface of the lens of the image pickup section to form a part of the light guide device.

In order to take an image through the display unit, the image pickup unit is not arranged behind the flat panel display, but the mirror 15 shown in FIG. It is also possible to image through.

It goes without saying that the flat panel display can be displayed in color. in this case,
The color filter used also has a shutter function from a state of increased transparency to a state of increased coloring and light shielding.

Since the display section repeats light emission and extinction, the length of the non-light-emission period is shortened as much as possible in order to make flicker less noticeable to an observer such as a human.

[0014]

As a result, the display section has a period in which it emits light to display an image and a period in which the transparency increases. Therefore, during the period in which the display section emits light, the image is displayed on the flat panel display of the display section. You can see the image directly. Further, during the period in which the transparency of the display unit is increased, the front of the flat panel display can be imaged by the imaging unit arranged behind the flat panel display.

[0015]

Embodiments of the present invention will be described below with reference to the drawings. 1 is a sectional view of an image pickup and display integrated device according to a first embodiment of the present invention, FIG. 2 is a block diagram of an image pickup and display integrated device according to the first embodiment of the present invention, and FIG. 9 is a display of the first embodiment. FIG. 3 is a diagram schematically showing the relationship between the operation time of the image pickup unit and the image pickup unit. In FIG. 1, 1 is a flat panel display (display unit), 2 is a backlight, 3 is an imaging lens, 4
Is an image sensor, 5 is a reflective member that can be arranged in front of the image pickup lens so as to increase transparency, and 6 is a reflector.
Is the housing of the device. A flat panel display 1 attached to the front surface of a housing 20, a reflection member 5 that can be controlled so as to increase transparency, an imaging lens 3, and an imaging element 4 are arranged in order.

When the image pickup section of the present apparatus takes an image, the display section does not display, and the flat panel display 1 of the display section is displayed.
Since both the reflection member 5 and the reflection member 5 which can be controlled so as to increase the transparency are controlled so as to increase the transparency, the light from the front of the flat panel display 1 is transmitted to the light receiving portion of the image sensor 4 by the imaging lens 3. Image and flat
A subject in front of the panel display 1 is imaged.

When the display unit of the apparatus displays, the image pickup unit does not pick up the image, and the backlight 2 emits light, and the emitted light and the reflection plate 6 and the reflection member 5 (however, the transparency is not increased at the time of display). The light reflected by the flat panel display 1 passes through the flat panel display 1 and is imaged with a gray scale or a color based on the filter control state of the flat panel display 1, for example, by another image pickup and display integrated device (not shown), Display the transmitted video.

The control described above with reference to FIG. 1 will be described below with reference to FIGS. 2 and 9 in accordance with the flow of signals. The control circuit 9 controls the flat panel display 1 and the reflective member 5 that can be controlled so as to increase the transparency in accordance with the time of image pickup of the present device (the period (c) shown in (4) of FIG. 9). A control signal for increasing the transparency is output. These control signals increase the transparency of the flat panel display 1 in the period (a) shown in (1) of FIG. 9 and increase the transparency in the period (d) shown in (3) of FIG. The transparency of the reflection member 5 which can be controlled so as to increase is increased.

Further, the control circuit 9 (2) in FIG. 9 according to the above-described image pickup (the period (c) shown in (4) in FIG. 9).
A control signal for causing the backlight 2 to be extinguished during the extinction period shown in (1) is output.

The light 21 that has passed through the reflecting member 5 that can be controlled so as to increase the transparency is condensed by the imaging lens 3 and forms an image on the light receiving portion of the imaging device 4, and the imaging device 4 photoelectrically converts the light. Then, charges are accumulated in the period (c) shown in (4) of FIG. The image pickup device 4 outputs an image pickup signal to the image pickup signal processing circuit 7 in the subsequent stage based on the drive control signal from the control circuit 9.

The signal processed by the image pickup signal processing circuit 7 is transmitted and output from the terminal 12 via the image pickup signal output circuit 11 in the subsequent stage. Further, the above signal can be input to the display signal processing circuit 8 through the signal switch 10.

Next, a description will be given of the display of this device. For example, an image is captured by another image display / integration device (not shown),
Receive and input the video signal transmitted and output from the terminal 14,
The video signal is input to the display signal processing circuit 8 via the video signal input circuit 13 and the signal switcher 10. On the basis of the signal from the signal switcher 10, the display signal processing circuit 8 is flat during display (period (b) shown in (1) of FIG. 9).
Generates a signal to drive and control the panel display 1,
In response to the signal, the flat panel display 1 displays an image which is picked up and transmitted by another image pickup / display integrated device (not shown) in the period (b) shown in FIG. 9A.

Further, the control circuit 9 controls the flat panel display 1 and the reflecting member which can be controlled so as to increase the transparency in accordance with the above display (the period (b) shown in (4) of FIG. 9). 5 outputs a control signal for increasing the reflection ability without increasing the transparency and a control signal for causing the backlight 2 to emit light.

Although not shown in FIG. 2, a control signal for controlling so as to increase the transparency of the flat panel display 1 at the time of image pickup is not provided from the control circuit 9 but from the display signal processing circuit 8 described above. The signal for driving and controlling the flat panel display 1 may also serve as the transparent control.

Further, as described above, when the signal switcher 10 is switched to the image pickup signal processing circuit side and the signal processed by the image pickup signal processing circuit 7 is input to the display signal processing circuit 8 through the signal switcher 10. Displays the image in front of the flat panel display 1 captured by the image capturing unit.

Although not shown in the figure, a signal synthesizing means is provided in place of the signal switch 10, and an image received and input from the terminal 14 and an image taken by the image pickup section of the device are combined at the same time. It can also be displayed.

The timing relating to each control of the control circuit 9 may be generated based on the timing information from the display signal processing circuit 8.

Next, the use condition of the video telephone apparatus realized by using the present invention will be described with reference to FIGS. Videophone device 30 which is an image pickup and display integrated device
Although not shown in FIG. 3 to FIG. 5, is connected to a line as a terminal, and a similar video telephone device is connected as a terminal to the other end of the line. In FIG. 3, a videophone call party 31 receives an input from another terminal and is looking at an image displayed on the display unit 1 of the videophone device 30.

In FIG. 4, from the other terminals displayed on the display unit 1 during a short period (period (a) shown in (1) of FIG. 9) that is difficult to recognize due to a visual afterimage phenomenon. The image is erased, and at the same time, the display unit 1 has increased transparency. At this time, as shown in FIG. 5, the image of the caller 31 is captured by the imaging lens 3 and the imaging element 4. The videophone device 30 transmits and outputs this image to a similar videophone device at the other end through the line.

By repeating the above-described operation bidirectionally, both parties can talk with each other while looking at the image of the videophone device while keeping their line of sight.

Next, another embodiment of the present invention will be described with reference to the drawings. FIG. 6 is a diagram schematically showing a use state of the image pickup and display integrated device of the second embodiment of the present invention, and FIG. 7 is a sectional view of the image pickup and display integrated device of the second embodiment of the present invention.

FIG. 6 shows a state in which the image pickup and display integrated device according to the present invention is fixed to the wrist of the operator with a band. The relative positional relationship between the operator's face and wrist,
Alternatively, in order to make it easier for the operator to orient the image pickup portion of the image pickup and display integrated device in the direction of the subject to be imaged, as shown in the sectional view of FIG.
The image pickup lens 3 and the image pickup element 4 are arranged obliquely with respect to the surface of the display 1.

Depending on the conditions of use, the image pickup lens 3 and the image pickup element 4 may be provided so that the image pickup direction is vertical to the surface of the flat panel display 1 instead of being oblique. Further, the image pickup section may be movable to change the image pickup direction, or a plurality of image pickup sections may be provided for one display section of the device of the present invention.

Further, another embodiment of the present invention will be described with reference to the drawings. FIG. 8 is a sectional view of the image pickup and display integrated device according to the third embodiment of the present invention. In the figure, 1, 3,
4 and 20 are the same as those in FIG. 1, and the description thereof is omitted. Reference numeral 15 is a mirror. The mirror 15 is located behind the flat panel display 1 and reflects the light, which is incident through the flat panel display 1 having increased transparency, toward the imaging lens 3 and the imaging element 4 when the image is taken by the present device. Play a role. The imaging lens 3 collects the reflected light, forms an image on the light receiving portion of the imaging element 4, and images a subject in front of the flat panel display 1.

Further, at the time of display of this apparatus, a backlight (not shown) emits light, and the emitted light and the light (not shown) reflected by a reflector or the like pass through the flat panel display 1. As a result, a video image which is picked up and transmitted by another image pickup / display integrated device (not shown) is displayed in a shade or a color based on the filter control state of the flat panel display 1.

Further, another embodiment of the present invention will be described. FIG. 10 is a diagram schematically showing a situation where an image is captured on the display screen and the vicinity of the display screen of the image pickup and display integrated device realized by using the present invention, and FIG. 11 is on the display screen of FIG. 10 and the vicinity of the display screen. It is a figure showing an example of the image which picturized.

In FIG. 10, the tip of the rod-shaped pointing device 40 held in the operator's hand is, for example, the area 41 among one or a plurality of areas displayed on the flat panel display 1 of the present apparatus. Represents the state of being close to or in contact with the position of for a predetermined period. here,
In order to display each area, for example, the apparatus may be newly provided with an image signal generator (not shown) to display a frame line which becomes an area figure by a signal output from the circuit. Further, for example, a similar signal may be superimposed on a video signal received and input from another image pickup and display integrated device. The pointing device 40 may be replaced by a fingertip of an operator (not shown) or may be a rod-shaped device (not shown) having a function of emitting light from the tip.

Although not shown in the figure, the image pickup and display integrated apparatus of the present embodiment is newly provided with an image processing section. The image processing unit processes an image captured by the image capturing unit of the present apparatus, extracts a feature point from the image, and obtains the position of the feature point on the screen. In particular, of the pointing device 40 that is close to or in contact with the display screen as in the above state,
The image processing is performed so as to obtain the position information of the tip portion, which is a portion that is close to or in contact with.

In this example, as shown in FIG. 11, an image including the image of the tip portion of the pointing device 40 is picked up by the image pickup section of this apparatus. The frame shown by the dotted line in FIG. 11 indicates the display position of the above-mentioned area displayed during the display operation. A frame 41 'shows the display position of the area 41 in FIG. 10, and an image 40' of the tip portion of the pointing device 40 is in the frame 41 '.

The position information of the tip portion of the pointing device 40 obtained by the image processing unit is combined with the area display position information held in this apparatus or another image display integrated apparatus, and the position information of the pointing device 40 is combined. Judging means (not shown) for specifying the area to be shown, and means (not shown) for communicating the position information of the tip portion of the pointing device 40 and the area display position information between the present device and another image pickup and display integrated device. No.) is provided in the present device or in another image pickup and display integrated device, etc., the device having the above-mentioned determination means can be operated by the operator by pointing the desired area with the pointing device 40. The selected area can be specified, and in this embodiment, it can be determined that the area 41 has been selected.

[0041]

As described above, according to the present invention,
Even if a half mirror or the like having an area equal to or larger than the area of the display unit is not provided on the front surface of the display unit of the image pickup and display integrated device, the timing for displaying on the display screen of the display unit and the display It is possible to operate in a time-sharing manner with the timing of imaging the subject in front of the screen. Therefore, a compact image pickup and display integrated device that can be fastened to the wrist with a band, or a compact image pickup and display integrated device that allows the interlocutor to have a line-of-sight match while demanding a videophone, etc. Can be provided.

Further, a subject on or near the surface of the display screen of the image pickup and display integrated device can be picked up.

[Brief description of drawings]

FIG. 1 is a sectional view of an image pickup / display integrated device according to a first embodiment of the present invention.

FIG. 2 is a block diagram of the image pickup and display integrated device according to the first embodiment of the present invention.

FIG. 3 is a diagram schematically showing a usage situation of a videophone device realized by using the present invention.

FIG. 4 is a diagram schematically showing a state where the display unit does not display an image and the degree of transparency is increased in the use state of the videophone device realized by using the present invention.

5 is a view showing the image pickup unit of the videophone device of FIG. 4 by a notch.

FIG. 6 is a diagram schematically showing a usage state of the image pickup and display integrated device according to the second embodiment of the present invention.

FIG. 7 is a sectional view of an image pickup / display integrated device according to a second embodiment of the present invention.

FIG. 8 is a sectional view of an image pickup and display integrated device according to a third embodiment of the present invention.

FIG. 9 is a diagram schematically showing a relationship between operation times of a display section and an image pickup section of the image pickup and display integrated device according to the first embodiment of the present invention.

FIG. 10 is a diagram schematically showing a situation where an image is captured on the display screen and in the vicinity of the display screen of the image pickup and display integrated device of the present invention.

11 is a diagram showing an example of an image obtained by imaging the display screen and the vicinity of the display screen of the image pickup and display integrated device of FIG.

[Explanation of symbols]

 DESCRIPTION OF SYMBOLS 1 Flat panel display 2, 16 Backlight 3 Imaging lens 4 Imaging element 5 Reflective member 6 that can be controlled so that transparency is increased 6 Reflector 7 Imaging signal processing circuit 8 Display signal processing circuit 9 Control circuit 10 Signal switcher 11 imaging signal output circuit 12, 14 terminal 13 video signal input circuit 15 mirror

Claims (5)

[Claims] 1. An image pickup and display integrated device in which an image pickup unit and a display unit are integrated, wherein a period in which the display unit is provided on the front surface of the image pickup unit and the transparency of the display unit is increased is provided, and An image pickup and display integrated device, wherein the image pickup unit picks up an image of a subject that has passed through the display unit. 2. The image pickup and display integrated device according to claim 1, wherein the display section has a flat panel shape, and is composed of a member such as a liquid crystal that can be controlled in a state of increasing transparency. 3. A light guide device is provided behind the display unit,
The light guide device provides a period in which the transparency increases in accordance with a period in which the transparency of the display unit increases, and the imaging unit captures an image of a subject that passes through the display unit and the light guide device during the period. The image pickup and display integrated device according to claim 1 or 2. 4. A shutter having a light reflecting function is provided on the front surface of the lens of the image pickup unit, and a period in which the shutter opens the lens of the image pickup unit is provided in accordance with a period in which the shutter increases the transparency of the display unit. The image pickup and display integrated device according to claim 1 or 2, wherein the image pickup unit picks up an image of a subject that has passed through the display unit during the period. 5. A mirror is provided behind the display unit, and the image pickup unit passes through the display unit during a period in which the transparency of the display unit is increased, and further, images are taken through reflection of the mirror. An image pickup / display integrated device according to 1, 2, or 3.