JP2004147307A - Display device, terminal equipment and bidirectional interactive system - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a display device or the like which has a structure integrated with an imaging part not to be limited by a use environment and is equipped with a structure for installing the imaging part at a position where a bidirectional interaction is made possible while maintaining the state of matching a visual line. <P>SOLUTION: A display device (21) is provided with a monitor screen (8) corresponding to a screen whereon video is displayed or projected, a casing (220) for holding the monitor screen (8), an imaging part (5) for imaging the front side of the monitor screen (8), and a support part (700) mounted on the casing (220) for holding the imaging part (5) at a predetermined position with respect to the monitor screen (8). In the casing (220), a housing area (230) for housing the imaging part (5) when in no use is provided on a surface in the same direction as the front face of the monitor screen (8), and the support part (700) has a structure for moving the imaging part (5) to the front of the monitor screen (8) so as to be overlapped with the monitor screen (8) when in use. <P>COPYRIGHT: (C)2004,JPO

Description

INDUSTRIAL APPLICABILITY The present invention is applicable to a two-way interactive system having a structure for indirectly realizing a line-of-sight matching state while viewing an image of a remote party's interlocutor between remote locations. TECHNICAL FIELD The present invention relates to a display device integrated with an imaging unit capable of switching the installation state of a camera, a terminal device including the same, and a two-way interactive system including the terminal device.

2. Description of the Related Art Hitherto, a two-way interactive system has been proposed that realizes intimate dialogue such as counseling while displaying images of the other party's interlocutors on a monitor in a state where they are in line of sight with each other. In particular, various techniques have been proposed for the eye-gaze matching technique. For example, Patent Literatures 1 and 2 disclose an imaging device such as a CCD camera at a predetermined position on the front surface of a monitor on which the image of the other party is displayed. Line-of-sight matching is realized by the arrangement. Further, Patent Literature 3 proposes a display device in which an imaging device is embedded at a head position of a displayed image of a conversational partner. As described above, by embedding the imaging device in the display device, the interlocutor located in front of the monitor can concentrate on the conversation without being aware of the existence of the imaging device, as compared with the configuration in which the imaging device is arranged in front of the monitor. It becomes possible to do.
Patent No. 3074677 JP 2000-152059 A Japanese Patent No. 3074678

(4) As a result of studying a conventional display device which aims at eye-gaze matching as described above, the inventors have found the following problems. In other words, the imaging device embedded type display device as disclosed in Patent Document 3 needs to have a hole for exposing a part of the imaging device on a monitor screen facing the interlocutor because of its structure. Such an imaging device cannot be applied to an existing display device such as a personal computer. In addition, in an imaging device that is installed on an existing display device and has a structure in which the imaging device is dropped in front of the display monitor, the imaging device does not exist in a usage state other than the usage state in which two-way conversation is performed. Causes display failure.

On the other hand, Patent Literature 1 and Patent Literature 2 disclose an imaging device that can be installed on a CRT display. As described above, in a stationary imaging device, if the imaging device is not configured to be detachable, It is unsuitable for application to case storage, movement, and transportation when the portable information processing device has been used.

The present invention has been made in order to solve the above-described problems, and is a display device integrated with an imaging unit which is not limited by a use environment, and is capable of maintaining a line-of-sight matching state. It is an object of the present invention to provide a display device having a structure for enabling an imaging unit to be installed at a position where interactive communication is possible, a terminal device including the same, and a two-way interactive system including the terminal device. .

The display device according to the present invention includes a screen on which an image is displayed or projected, and includes an imaging unit for capturing an image in front of the screen. The display device according to the present invention includes, in addition to a projection type video device using a projector, a thin display of a desktop PC, a CRT monitor, a TV monitor, a notebook PC, and a detachable notebook PC as display monitors. Display tablets, tablet PCs, and the like are included. Further, the thin display is not limited to the liquid crystal display, but may be a plasma display or the like. In this specification, the screen includes a display surface of the display monitor, and when the display device is a projection type video display device, the screen is made of a flexible material having a smooth surface. Is preferred.

In particular, a display device according to the present invention includes a housing that holds the screen, and a support unit that has one end attached to the housing while holding the imaging unit, and the housing houses the imaging unit. Storage area is provided. The support section has a structure for moving the imaging section housed in the housing area of the housing to the front of the screen so as to overlap the screen. The housing may include a cover to protect a lens portion of the imaging unit when the imaging unit is stored in the storage area. With this configuration, in the two-way dialogue, while the gaze matching state between the interlocutors can be easily realized, by moving the imaging unit to a position off the screen, it is also possible to apply to uses other than the two-way dialogue. When the display device is a projection type video display device, the display device can be easily transported by providing the housing with a structure for housing the screen inside.

In the display device according to the present invention, it is preferable that the movement of the imaging unit by the support unit slides the imaging unit substantially parallel to the screen. This is because the size of the imaging unit moving mechanism in the support unit can be reduced, and the imaging unit can be moved in a small space.

支持 The support section preferably has a structure for adjusting the distance between the imaging section and the outer periphery of the screen when the imaging section is installed in front of the screen so as to overlap the screen. With this configuration, in the two-way conversation, the fine adjustment of the indirect line-of-sight matching state with the other party's interlocutor image displayed or projected on the screen becomes easy. In addition, the support unit may be configured by a first member rotatably attached to the housing and a second member holding the imaging unit. In this case, the support section has a distance adjustment mechanism for defining the distance between the first and second members, so that the distance between the imaging section and the outer periphery of the screen as described above can be adjusted.

In addition, the display device according to the present invention preferably includes a power switch for driving the imaging unit. Thereby, while energy saving can be achieved, two-way conversation can be started more smoothly by setting ON / OFF of the power switch as a start condition of related software or the like. In addition, since at least a part of the imaging device including the imaging unit and the support unit is configured to be detachable, this attachment / detachment information (determined based on whether or not an imaging signal is received from the imaging unit) can be used by starting conditions of related software or the like. It may be. Further, the display device according to the present invention may further include a mechanism for adjusting an imaging angle of the imaging unit via the support unit. This is because finer adjustment of the gaze matching state between the interlocutors becomes possible.

Furthermore, the terminal device according to the present invention may include a personal computer that transmits and receives voices and images via transmission means such as an image transmission device and the Internet, and is configured integrally with the imaging device as described above. (A display device according to the present invention). When the display device includes a display monitor for directly displaying an image, the display device includes a display control unit for performing display control of the display monitor. On the other hand, when the display device is a projection-type image display device, the terminal device includes a projector for projecting an image on a screen, and a display control unit for controlling the projector.

In particular, the display control means determines whether or not the image pickup section is to be stored in or taken out of the storage area by ON / OFF of the switch, or an image pickup apparatus (including an image pickup section and a support section) integrally attached to a housing. It is preferable to detect at least a part of the attachment / detachment information of (1) and start related software necessary for realizing the two-way interaction.

Further, the two-way interactive system according to the present invention includes the terminal device having the above-described structure (the terminal device according to the present invention), and transmits the captured interlocutor image via a predetermined transmission unit to the other party's interactive system. By presenting them to each other, remote dialogue between the interlocutor and the opponent interlocutor is realized. Note that such a two-way interactive system includes one-to-one, one-to-many, many-to-one, or many-to-many through transmission and reception of voice data and image data between a plurality of terminal devices such as a videophone system and a video conference system. A communication system for realizing the two-way interaction of the above is included.

ADVANTAGE OF THE INVENTION According to this invention, while providing the storage space for accommodating an imaging part in the housing | casing holding the screen on which an image | video is displayed or projected, the imaging part can be installed in a different position at the time of use and non-use. A suitable support is attached to the housing. With this configuration, in the two-way dialogue, while the gaze matching state between the interlocutors can be easily realized, by moving the imaging unit to a position off the screen, it is also possible to apply to uses other than the two-way dialogue. Further, in a portable display device, case storage and transportation are facilitated.

Hereinafter, embodiments of a display device, a terminal device, and a two-way interactive system according to the present invention will be described in detail with reference to FIGS. In the description of the drawings, the same portions will be denoted by the same reference symbols, without redundant description.

The display device according to the present invention is applicable to a terminal device (terminal device according to the present invention) connected via a predetermined transmission unit, and realizes a remote place dialogue between such terminal devices, for example, The present invention is applicable to a two-way interactive system described in Patent Document 1.

First, here, a description will be given of the two-way interactive system to which the terminal device including the display device is applicable. Although this two-way interactive system is a system for realizing a remote dialogue in a state where the eyes are matched, the terminal device including the display device has a configuration in which the eyes cannot be matched between the interlocutors and is merely text data. It is also applicable to a two-way interactive system capable of transmitting and receiving image data.

FIG. 1 is a logical configuration diagram showing an entire interactive interactive system that enables eye-gaze matching between interlocutors at remote locations. A display device having a display monitor is applied to each terminal device. This system realizes a two-way dialogue between a talker 3A (first talker) at point A (first point) and a talker 3B (second talker) at point B (second point). System. In particular, this system is a counseling system that establishes a close relationship of trust and realizes in-depth communication between interlocutors in remote areas and a system oriented toward home learning. Assumes a counselor, such as a psychologist. Therefore, this system has various functions and configurations so that these counselors can provide information necessary for counseling and an ideal counseling environment.

Specifically, at the point A, (a) a chair 4A (having a height adjustment mechanism 40A) on which the interlocutor 3A (for example, a counselor) sits, (b) a table 2A to which the interlocutor 3A goes, and (c) A terminal device 20A provided with a mechanism for matching the line of sight between the interlocutors via the transmission means 27 is installed, and the interlocutor 3A is isolated by the partition 22A. On the other hand, at the point B, (a) a chair 4B (having a height adjusting mechanism 40B) on which the interlocutor 3B (for example, a client who receives counseling) sits, (b) a table 2B to which the interlocutor 3B goes, and (c) A terminal device 20B provided with a mechanism for matching the line of sight between the interlocutors via the transmission means 27 is installed, and the interlocutor 3B is isolated by the partition 22B. Here, the transmission unit 27 includes an optical fiber transmission line 31 (main transmission line) and a satellite to enable transmission and reception of image information and audio information between the terminal device 20A at the point A and the terminal device 20B at the point B. It includes a communication transmission line 32 (backup transmission line) and the like. The transmission means 27 may be wired or wireless. The transmission means includes a network such as a telephone line network that has already been laid, and also includes an electronic bulletin board system (BBS: Bulletin Board System) provided with various databases.

At point A, the chair 4A described above functions to define the position of the interlocutor 3A. The chair 4A is preferably fixed to keep a constant distance from the display unit (including a display monitor such as the monitor TV1A) 21A of the terminal device 20A. However, even when the chair 4A is not fixed, the distance between the chair 4A and the display unit 21A can be kept constant by installing the table 2A on the interlocutor 3A and the display unit 21A. (It has been confirmed that the presence of the table 2A serves as a criterion for the psychological distance of the interlocutor 3A). The same applies to the configuration of the terminal device 20B at the point B where the other party 3B (for example, a person receiving counseling) is located.

At the point A, the terminal device 20A is (1) arranged on the table 2A for displaying an image or the like of the interlocutor 3B based on the image information transmitted from the terminal device 20B at the point B via the transmission means 27. A display unit 21A provided with a monitor TV 1A, (2) an imaging device main body 6A for holding a CCD camera (imaging unit) 5A at a predetermined position, and (3) a transmission device 27 from a terminal device 20B at a point B. And a voice output unit 23A (speaker) for outputting the voice of the interlocutor 3B based on the voice information transmitted via the (3), and (4) collecting the voice of the interlocutor 3A as voice information, and An audio input unit 24A (microphone) for transmission to the terminal device 20B is provided. Furthermore, in order to realize more detailed communication as a counseling system, (5) the interlocutor 3A inputs characters and figures, displays the input characters and figures on the display unit 21A, and displays character / graphic information. Character / graphic input unit 25A (interface such as keyboard, pointing device, touch panel, etc.) for transmission to terminal device 20B at point B, and (6) provided between the above-mentioned components and transmission means 27. , A video processing device 26A (including display control means) for performing signal processing, transmission control, video data editing work, monitor display control, and the like. The terminal device 20B at the point B has the same configuration as the terminal device 20A at the point A described above. Specifically, the display unit 21B, the imaging device 600B including the CCD camera 5B and the main body 6B, and the audio output unit 23B, an audio input unit 24B, a character / graphic input unit 25B, and a video processing device 26B (including a display control unit).

The configuration of the imaging devices 600A and 600B in the terminal devices 20A and 20B at the point A and the point B will be described. For convenience of description, when referring to components common to the terminal devices 20A and 20B at point A and point B, characters A and B for distinguishing each point are omitted, for example, as in the imaging device 600. Will be explained. In addition, unless otherwise described, it is assumed that the terminal device 20A at the point A is described in principle, and a duplicate description of the terminal device 20B at the point B having a common configuration is omitted.

The imaging device 600 includes an ultra-small CCD camera 5 (5A) as an imaging unit, and an imaging device main body 6 for supporting the CCD camera 5 at a predetermined position while supporting the CCD camera 5. The monitor TV1 (1A) is placed on the table 2 (2A), and the interlocutor 3 (3A) controls the height adjustment mechanism 40 (40A) placed at a distance L (m) from the monitor TV1. Sitting on chair 4 (4A) equipped. This distance L (LA) is set to 0.5 m or more and 5 m or less. A cylindrical microminiature CCD camera 5 having an outer diameter of 20 mm or less and a length of about 100 mm is provided between the person 3 to be photographed and the monitor TV 1. The CCD camera 5 is installed so that its imaging direction is directed to the person 3 to be photographed. Then, the video of the interlocutor 3 captured by the CCD camera 5 is transmitted to the other interlocutor side as image information (transmitted to the terminal device 20B at the point B via the transmission means 27). Note that the interval between the display unit 21 and the interlocutor may be slightly shifted depending on the interlocutor. Therefore, in order to cope with such a situation, it is preferable to select a CCD camera 5 having a large depth of focus.

Next, a specific installation position of the micro CCD camera 5 will be described with reference to FIG.

{Circle around (1)} First, it is installed on the display unit 21 for displaying the transmitted image of the other interlocutor. The switch 210 includes a power switch for turning on / off the power of the display unit 21 and the like. The CCD camera 5 is arranged at a predetermined position in front of a monitor screen (hereinafter referred to as a monitor screen) 8 on which the transmitted image 9 of the other talker 3B is displayed. The monitor screen 8 can be used sufficiently if it is about 4 inches.

Specifically, the CCD camera 5 is located at a position w (cm) ahead of the monitor screen 8 and near the head 9a of the interlocutor image 9 displayed on the monitor screen 8. The central axis of the cylindrical CCD camera 5 is located at a position h (cm) above the eye position of the interlocutor image 9 indicated by a dotted line.

As described above, since the ultra-small CCD camera 5 is located near the head above the position of the eyes of the interlocutor image 9 displayed on the screen 8 of the large monitor TV 1, there is no particular obstacle to the two-way interaction. Does not occur. For example, the CCD camera 5 is provided at about h (about 10 cm) above the eye position (the position shown by the dotted line in the figure) of the interlocutor image 9 displayed on the monitor screen 8, and the distance between the monitor TV 1 and the interlocutor 3 is increased. In the case of the system configuration in which the distance L is set to about 2.5 (m), the parallax angle is 2.3 °, which is sufficiently smaller than the parallax angle 3 ° which is the detection limit (the monitor screen 8 and the CCD). Even when the interval w between the cameras 5 is about 10 (cm), there is no particular effect on the fluctuation of the parallax angle). In other words, if the other party's eyes (the eyes of the image of the other interlocutor 3B displayed on the monitor screen 8) are clearly visible at the time of gaze coincidence, even if the ultra-small camera 5 is provided around the head, the display is performed. It has been confirmed that if the monitor screen 8 of the display monitor included in the unit 21 is large, there is almost no obstacle to the two-way conversation. As a result of an experiment, it has been confirmed by experiments that the size of the monitor screen 8 is about 35 cm in width and 26 cm in height, so that good two-way conversation can be realized. In addition, if the mutual interlocutors are acquaintances, there is also obtained a result that the size of the screen is small but the psychological obstacle is also small, and the screen size may be properly used depending on the application.

Further, the parallax angle will be described with reference to FIG. In this specification, the parallax angle means, as shown in FIG. 3, the line of sight of the interlocutor 3 to be photographed, which is directed to the interlocutor image 9 displayed on the monitor screen 8, and to the CCD camera 5. The angle θ between the line of sight and the line of sight of the interlocutor 3. In other words, it means a shift angle of the installation position of the CCD camera 5 with respect to the line of sight of the interlocutor 3. The line of sight coincidence here means below the allowable limit of unnaturalness due to the installation position of the CCD camera 5, as reported at the 4th Conference of the Institute of Electrical Engineers of Japan (No. 1998). . Quantitatively, the parallax angle is 4.5 ° or less in the left-right direction (with respect to the center A of the eyes of the interlocutor image 9 and both temples of the image 9), and 12 ° directly above (with respect to the image center A). The line of sight coincides with the head 9b of the image 9) and the direction directly below 8 ° (the body side of the image 9 with respect to the image center A). Of course, the smaller the parallax angle, the better, and the detection limit is 3 ° or less in the left-right and up-down directions. Therefore, the area where the CCD camera 5 can be installed is the conical area shown in FIG. Note that this conical area is defined by the center 30 of the eyes 30 of the interlocutor 3 and the center of the interlocutor image 9 displayed on the monitor screen 8 (in this embodiment, the center of both eyes of the interlocutor image 9 is (Defined as the center point A), the line-of-sight matching area 9b on the monitor screen 8 at a predetermined distance L (m) away from the line of sight 31 of the interlocutor 3, and the eyes of the interlocutor 3. 30 positions.

When the size of the interlocutor image 9 displayed on the monitor screen 8 is small, the CCD camera 5 and the head of the interlocutor image 9 do not necessarily have to overlap. Rather, the head of the talker 9 is hidden by the CCD camera 5, making it difficult to see. As described above, the eye-gaze coincidence condition is that the CCD camera 5 and the eyes of the interlocutor image 9 exist within the area of the parallax angle of 3 °, and specifically, about 3 cm at a position 50 cm away from the screen (FIG. 2). H). Therefore, within this range, the line-of-sight matching state is maintained even if the head of the CCD camera 5 and the head of the interlocutor image 9 are shifted. To shift the interlocutor image 9 and the CCD camera 5, for example, the image display position on the monitor screen 8 is adjusted, or the position of the CCD camera 5 itself is changed by adjusting the support of the CCD camera 5. Is done.

Next, a description will be given of a first embodiment of the display device according to the present invention, which is applicable to the terminal device in the above-described two-way interactive system. FIG. 5 is an assembly process diagram showing a specific structure of the first embodiment of the display device according to the present invention. As shown in FIG. 5, in the display device, an imaging device including an imaging unit 5 corresponding to a CCD camera and a display unit 21 including a monitor screen (monitor screen) 8 are integrally configured. . Note that the display device according to the present invention includes a thin display of a desktop PC, a CRT monitor, a TV monitor, a notebook PC, a detachable display tablet of a notebook PC, a tablet PC, and the like. A projection-type image display device having a projector that projects an image (a fourth embodiment described below) may be used.

The display monitor in the display unit 21 includes a monitor screen 8 such as a liquid crystal display, a plasma display, and a CRT monitor, and a housing 220 that holds the monitor screen 8 with its front surface (display surface) exposed. The housing 220 is provided with a storage area 230 for storing the imaging device 600 on a surface (usually having a width of about 10 mm to 20 mm) facing in the same direction as the front surface of the monitor screen 8. The storage area 230 is further provided with a hollow screw member 235 for attaching the imaging device 600 itself to the housing 220 and a cover 236 for protecting the imaging unit 5, particularly, the lens portion in the stored imaging device. ing.

On the other hand, the imaging device 600 includes the imaging unit 5 and a support unit 700 (corresponding to the main unit 6) having one end attached to the hollow screw member 235 of the housing 220 while holding the imaging unit 5. The support unit 700 includes a first member 710 rotatably attached to the housing 220, a second member 720 holding the imaging unit 5, and a connecting member that defines a distance between the first and second members 710 and 720. 730 (functioning as a distance adjusting mechanism).

The first member 710 is provided with a through hole 715 in which a ring 815 is embedded, and the screw member 810 and the hollow screw member 235 are engaged via the ring 815, so that the entire support portion 700 is rotatable. It is attached to the housing 220. The second member 720 is a hollow member, and is embedded in the front surface with the lens portion of the imaging unit 5 being exposed. A projection 725 for pulling out the imaging device from the storage area 230 of the housing 220 is provided on the front surface of the second member 720. The data transfer and power supply cord 800 electrically connected to the imaging unit 5 sequentially passes through the inside of the second member 720, the connecting member 730, the inside of the first member 710, the through hole 715, and the hollow screw member 235. It is led outside the housing 220. The connecting member 730 is provided with a biasing means 735 having a positioning projection, and any one of a plurality of grooves provided on the inner wall of the second member 720 and the projection provided on the biasing means are engaged with each other. Thereby, the interval between the first and second members 710 and 720 is defined.

The display device according to the present invention can be variously modified. FIG. 6 is a view for explaining the structure of the display device according to the second and third embodiments of the present invention. As shown in FIG. 6A, the display device according to the second embodiment pulls out the support unit 700 from the storage area 230 so as to move the imaging unit 5 to the front of the monitor screen 8 and at the same time A power switch 238 may be provided to turn on the power supply of the power supply 5. As an application example in this case, for example, when the power supply of the imaging unit 5 is sensed, the dedicated software is started, or the keyboard input is used to adjust the display position of the display window or the display position of the human image in the display window. Linking with software, such as switching to key input for, improves convenience. The embodiment of FIG. 6A has a configuration in which the power switch 238 detects the storage and removal of the imaging unit 5 from the storage area 230. The imaging apparatus 600 including the imaging unit 5 and the support unit 700 is used. May be configured to be detachable, and dedicated software may be activated based on the detachment information of the part. The activation of the dedicated software is performed by the video processing unit 26 (26A, 26B) which is a display control unit.

In addition, as shown in FIG. 6B, in the display device according to the third embodiment, the housing 220 includes the member 237 that rotates in the direction indicated by the arrow S2 about the axis AX. The support part 700 can be rotated by the angle θ about the axis AX. Since the support part 700 is rotatably attached to the member 237 via the hollow screw member 235, the imaging angle of the imaging part 5 located at the other end of the support part 700 is determined by the support part 700. By changing the rotation about the axis AX, the change becomes possible.

In each of the above embodiments, only one imaging device 600 is integrally attached to the housing 220. However, a plurality of imaging devices may be provided at any position on the outer periphery of the monitor screen 8. In addition, the display device may be a TV monitor. In this case, it is easy to use the TV monitor if it is possible to operate the TV monitor by using a power switch, a remote controller, or the like. For example, when the TV monitor is switched to the use state of the remote conversation, the imaging unit housed in the housing area of the housing is pulled out so as to be located in front of the display monitor, and the imaging direction and the like can be adjusted by the remote control. It is also possible to configure. In this case, it is more preferable that the imaging unit has a zoom function that can be controlled by software or hardware.

(4) If the imaging device 600 is detachably attached to the housing 220, conversation with a plurality of persons, change of imaging quality (replacement with a new product), and the like become easy. In addition, by linking the handling operation of this imaging device 600 (attachment / removal and storage / removal to / from the storage area 230) and activation / termination of the software, the association between the new imaging device and the dedicated software can be established. It will be easier and provide more detailed services. As such an application example, for example, a storage unit (a memory chip or the like) in which dedicated software is stored in advance may be mounted on the imaging apparatus. In this case, the imaging device and the software are associated with each other.

Further, the display device can be applied to a terminal device capable of interactive communication via a predetermined network, and in this case, a configuration in which setting / resetting of an imaging unit can be remotely controlled from a partner terminal device. . With this function, for example, it is also possible to check the status of a house where a person is away and the status of a parent living alone, at the same time as his / her own convenience. Also, when the interlocutor located on the monitor screen visually recognizes the state in which the imaging unit has been dropped in front of the monitor screen, it is thought that the other party's interlocutor has confirmed and recognized himself. Such remote control of the imaging unit can be expected to have an effect that the care receiver can give a sense of security that a caregiver such as a helper or relatives has confirmed his / her state in care or the like.

Next, an operation of changing the installation position of the imaging unit in the display device according to the first embodiment will be described with reference to FIG.

First, when no interactive dialogue is performed or when a task other than the interactive dialogue (character input or the like) is performed, the imaging apparatus 600 causes a failure in monitor observation as shown in FIG. It is stored in a storage area 230 provided in the housing 220 so as not to be distorted. At this time, the lens portion of the imaging unit 5 is protected by being covered by the cover 236 provided in the storage area 230. On the other hand, when performing a two-way conversation, the imaging device 600 stored in the storage area 230 of the housing 220 is moved to the front of the monitor screen 8 so that the imaging unit 5 overlaps the monitor screen 8. That is, the support unit 700 of the imaging device 600 is rotated in the direction indicated by the arrow S3. (In the case of manual operation, a protrusion 725 provided on the second member 720 of the support portion 700 is used). By this rotating operation, the imaging unit 5 is installed in front of the display monitor 8 (FIG. 7B).

When the two-way dialogue is actually performed, it is necessary to indirectly match the eyes via the monitor screen 8, so that the relative image of the other party displayed on the monitor screen 8 and the image capturing unit 5 are displayed. Position matters. In this case, as shown in FIG. 7C, the distance between the first member 710 and the second member 720 is reduced by moving the second member 720 in the direction indicated by the arrow S4. Adjustment mechanism). Further, the imaging angle can be adjusted by the rotation mechanism shown in FIG. Further, it is also possible to increase the number of joints of the rotation mechanism or add a rotation mechanism that can be freely used with a spherical support or the like.

The display device according to the present invention may be a projection-type image display device that projects an image on a screen as shown in FIG. FIG. 8 is a diagram for explaining a schematic configuration of a fourth embodiment of the display device according to the present invention.

The display device (projection type video display device) according to the fourth embodiment includes, for example, a projector 900 that projects the other party's interlocutor image 9a and a display unit 21 in a two-way interactive system in which the eyes can be matched. The display unit 21 includes a screen 920 and a housing 910 that holds the screen 920. The screen 920 may be a white board installed on a wall or the like, or may be a flat member having a smooth surface made of a flexible material.

In the fourth embodiment, the screen 920 is a flat member made of a flexible material, and the housing 910 has a structure for housing the screen inside. When the screen 920 is housed in the housing, the display device can be easily transported. The housing 910 has a structure for supporting and storing the imaging device 600 on which the CCD camera 5 as the imaging unit is mounted, as in the above-described first to third embodiments. Also in the fourth embodiment, the imaging device 600 has the imaging unit 5 and one end rotatably attached to the housing 910 while holding the imaging unit 5, similarly to the structure illustrated in FIG. 5. The support unit 700 is provided.

On the other hand, the projector 900 transmits video information transmitted from the video processing device 26 (see FIG. 1) including the display control means (for example, an electric signal corresponding to the image of the other party's interlocutor transmitted via the transmission means 27). Is converted into a two-dimensional image (an image of the other party's interlocutor), and the two-dimensional image is projected into the display area 930 on the screen 920. At this time, the imaging unit 5 supported so as to overlap the other party's interlocutor image 9 a on the screen 920 images the interlocutor 3 sitting on the chair 4 so as to be located in front of the screen 920. By transmitting the video information of the interlocutor 3 captured by the imaging unit 5 to the partner terminal device via the transmission unit 27, a two-way dialogue in a state of line of sight is realized.

As described above, in the fourth embodiment in which an image is projected on the screen 920 using the projector 900, the imaging unit 5 is also stored in the housing 910 that stores the screen 920. If the imaging unit 5 is also pulled out according to the above, the eye-gaze matching can be performed via the large-screen screen 920. When the two-way conversation is performed in such a manner that the eyes are aligned, it is preferable that the operation of pulling out the screen 920 and the operation of pulling out the imaging unit 5 be performed in cooperation with each other, and further, the imaging angle of the imaging unit 5 can be freely set with a remote controller. You may make it adjustable. In addition to the manual adjustment, the adjustment of the imaging angle may be automatically adjusted by image recognition of a human image. If an image of the user is projected on the screen 920, it is possible to confirm the eye-gaze matching state before starting the two-way conversation.

FIG. 9 is a diagram for explaining different installation states of the imaging device in the display device according to the fourth embodiment shown in FIG. 8, and FIG. FIG. 9B shows the appearance of the display unit 21 during a two-way conversation.

As shown in FIG. 9A, the housing 910 has a structure in which the screen 920 and the imaging device 600 are respectively housed, and the display unit 21 in which the screen 920 and the imaging device 600 are simultaneously housed, respectively. Is reduced in size and has a shape excellent in portability.

On the other hand, when used for two-way conversation, as shown in FIG. 9B, first, the screen 920 is pulled out from the housing 910 in the direction indicated by the arrow S6 in the figure. Subsequently, the imaging unit 5 side of the imaging device 600 stored in the storage area 230 of the housing 910 is pulled out using the protrusion 725, and the position of the imaging unit 5 from the outer periphery of the screen 920 is adjusted. As shown in FIG. 5, the support unit 700 of the imaging device 600 includes a first member 710 rotatably attached to the housing 910, a second member 720 in which the imaging unit 5 is embedded, And a connecting member 730 that can be stored inside the second members 710 and 720. By displacing the second member 720 with respect to the first member 710 in the direction indicated by the arrow S5 in the drawing, the installation position of the imaging unit 5 is adjusted.

Note that the fourth embodiment may also have the same structure as the above-described second and third embodiments.

According to the present invention, in the two-way dialogue, while the gaze matching state between the interlocutors can be easily realized, by moving the imaging unit to a position outside the display monitor, the present invention can be applied to uses other than the two-way dialogue. Further, in a portable display device, case storage and transportation are facilitated.

FIG. 1 is a diagram illustrating a configuration of a two-way interactive system that achieves eye-gaze matching between remote locations via a transmission unit. FIG. 2 is a diagram illustrating the imaging device illustrated in FIG. 1 and is a diagram for describing a method of installing a CCD camera for line-of-sight matching. It is a figure for explaining a parallax angle. FIG. 3 is a diagram showing an area where a CCD camera is to be installed. FIG. 3 is an assembly process diagram showing a specific structure of the first embodiment of the display device according to the present invention. It is a figure for explaining the concrete structure of the 2nd and 3rd embodiments in a display concerning this invention. It is a figure for explaining change operation of the installation position of the display concerning this invention. It is a perspective view for explaining the schematic structure of a 4th embodiment in a display concerning this invention. FIG. 9 is a diagram for explaining different installation states of an imaging device in the display device according to the fourth embodiment shown in FIG. 8.

Explanation of reference numerals

8 Monitor screen (included in screen)
21 (21A, 21B): Display unit 3 (3A, 3B): Interactors A, B
5 (5A, 5B) ... imaging unit (CCD camera)
6 (6A, 6B) ... main body 220, 910 ... housing 230 ... storage area 236 ... cover 238 ... power switch 600 (600A, 600B) ... imaging device 26 (26A, 26B) ... video processing device 700 ... support portion 710 ... 1st member 720 ... 2nd member 730 ... Connecting part (distance adjustment mechanism)
735 urging means 900 projector 920 screen 930 image display area

Claims (17)

A display device that includes a screen on which an image is displayed or projected, and includes an imaging unit for imaging the front of the screen,
A case that holds the screen and has a storage area for storing the imaging unit,
A structure for moving the imaging unit housed in the housing area to the front of the screen so as to overlap the screen, the support unit having one end attached to the housing while holding the imaging unit. A display device comprising: The display device according to claim 1, wherein the screen includes a display surface of a display monitor. The display device according to claim 1, wherein the screen is made of a flexible material having a smooth surface. The display device according to claim 3, wherein the housing has a structure for accommodating the screen therein. 5. The display device according to claim 1, further comprising a projector for projecting an image in a predetermined area of the screen. 6. The display device according to claim 1, wherein the support unit has a structure that moves the imaging unit substantially in parallel with the screen. 7. The said support part has a structure for adjusting the distance of the said imaging part and the outer periphery of the screen, in the state where the said imaging part was installed in front of the said screen so that it might overlap with the said screen. The display device according to any one of claims 1 to 6. The display according to any one of claims 1 to 7, wherein the support unit includes a first member rotatably attached to the housing, and a second member holding the imaging unit. apparatus. The display device according to claim 8, wherein the support unit has a distance adjusting mechanism for defining a distance between the first and second members. The display device according to any one of claims 1 to 9, further comprising: a power switch for driving the imaging unit. The display device according to any one of claims 1 to 10, further comprising a mechanism for adjusting an imaging angle of the imaging unit via the support unit. The display device according to claim 1, wherein the housing includes a cover that covers a lens portion of the imaging unit when the imaging unit is stored in the storage area. . The imaging device integrally attached to the housing is configured by the imaging unit and the support unit, and at least a part of the imaging device is detachable. The display device according to the item. A terminal device connected to predetermined transmission means,
A display device according to any one of claims 1 to 13, wherein an imaging unit for imaging the front of the screen is attached,
A terminal device comprising: display control means for performing display control of the display device. 15. The terminal device according to claim 14, wherein the display control unit activates related software in response to storage and removal of the imaging unit in the storage area. An imaging device integrally attached to the housing is configured by the imaging unit and the support unit, and related software is started in response to attachment / detachment of at least a part of the imaging device. The terminal device according to claim 14. A two-way interactive system for realizing a remote dialogue between the interlocutor and the opponent interlocutor by presenting the captured interlocutor image to each other interlocutor via predetermined transmission means. A two-way interactive system comprising the terminal device according to any one of claims 14 to 16.

Images