JP2008228170A - Image display device and television telephone device - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide a technology for imaging a user observing a displayed image from the front on an image display device having a three-dimensional display. <P>SOLUTION: An image display device displaying a first image in a first view direction of an observer and displaying a second image in a second view direction, to produce three-dimensional view is equipped with: a display section including a display screen for displaying thereon the first image and the second image; an enclosure section which is disposed to surround the edge of the display screen, is expanded from the display screen to a side of the observer and includes an opening at the side of the observer; a half mirror section which is disposed within an enclosed space surrounded by the enclosure section while being inclined with respect to the display screen; and an imaging section which is disposed outside the enclosed space and picks up an image of the observer reflected on a half mirror from a plurality of directions. <P>COPYRIGHT: (C)2008,JPO&INPIT

Description

  The present invention relates to a technique for capturing an observer who observes a display image in an image display apparatus that enables stereoscopic viewing.

  With the recent development of networks, so-called video conferencing, in which audio and video are transmitted and received between remote locations using a video phone device, has been held. In the videophone device, an image (video) of the other user is displayed, and an image (video) of the user on the other side is captured by an imaging device such as a CCD (Charge Coupled Devices) camera and transmitted to the other side. (See Patent Documents 1 and 2 below).

JP 2000-209559 A JP 2006-39883 A

  In the videophone devices described in Patent Documents 1 and 2, since the imaging device is installed above the display, the user looks down from above to take an image. At this time, the user is looking at the image of the other party displayed on the display and is not looking at the imaging device. Therefore, there has been a problem that a human image not facing the front but facing downward is captured. Therefore, in a video conference, the image of the other party facing down is displayed on each display, and it was impossible to talk with each other with their eyes aligned. In particular, in a videophone device including a stereoscopic display that enables stereoscopic viewing, the other party appears as a stereoscopic image, and thus there is a risk that the line of sight is clearly recognized.

  As described above, the problem that the user who observes the image displayed on the stereoscopic display cannot be captured from the front can occur not only in the videophone device but also in other image display devices. For example, when a user's face is photographed and the face is displayed, it can also occur in an apparatus for confirming his / her face viewed from the front when using makeup or glasses. It may also occur in an apparatus (game machine) that images the face of a user playing a game and displays it on the game screen. That is, even in these image display devices, it is not possible to take an image of a user facing the front, and accordingly, the user's face not facing the front is displayed.

  An object of the present invention is to provide a technique capable of obtaining an image viewed from the front of a user observing a display image in an image display device including a stereoscopic display.

  SUMMARY An advantage of some aspects of the invention is to solve at least a part of the problems described above, and the invention can be implemented as the following forms or application examples.

  Application Example 1 An image display apparatus that displays a first image in a first viewing direction of an observer and a second image in a second viewing direction, the first image and A display unit having a display surface for displaying the second image; and a display unit disposed so as to surround a periphery of the display surface. The display unit projects from the display surface to the viewer side and has an opening on the viewer side. An enclosure having an enclosure, a half mirror arranged in an inclined state with respect to the display surface in an enclosure enclosed by the enclosure, and arranged outside the enclosure and reflected by the half mirror An image display device comprising: an imaging unit configured to capture an image of the observer from a plurality of directions.

  In the image display device according to the application example 1, it is possible to make a stereoscopic view using at least the first and second images. An image may be displayed in each of three or more viewing directions. When the observer views the first image and the second image displayed on the display surface, the image of the observer is reflected by the half mirror and captured by the imaging unit arranged outside the enclosed space. Thus, it is possible to obtain an image obtained by viewing the observer looking at the display surface from the front. Further, since the imaging unit is disposed outside the enclosure space, it does not hinder the observation of the first image and the second image by the observer. Also, since the enclosure projects to the viewer side, when the user wants to see something other than the first image and the second image, the focus position changes by looking at the enclosure. Can be suppressed and the feeling of fatigue can be relieved.

  Application Example 2 In the image display device according to Application Example 1, in the inner surface of the enclosure part facing the enclosure space, at least a region included in the field of view of the imaging unit is black.

  By adopting such a configuration, it is possible to suppress the first image and the second image reflected by the half mirror or the like from being reflected on the inner surface of the enclosure and reflected in the captured image. Can do.

  Application Example 3 The image display device according to Application Example 1 or Application Example 2, wherein the imaging unit is arranged so that the display surface is not included in the field of view of the imaging unit.

  By setting it as such a structure, it can suppress that the other party's image projected on the display surface is imaged.

  Application Example 4 The image display device according to any one of Application Examples 1 to 3, wherein the enclosure is detachably attached to the image display device.

  With such a configuration, when the image display device can switch between a three-dimensional display and a normal display (two-dimensional display), the enclosure is removed when functioning as a two-dimensional display. Thus, the display image can be viewed in a brighter environment.

  Application Example 5 In the image display device according to any one of Application Example 1 to Application Example 4, the enclosure portion has a depth direction as viewed from the observer side on any inner surface facing the enclosure space. An image display device having an index portion serving as an index of the position of the image.

  With such a configuration, when the user views the stereoscopic image including the first image and the second image, the index portion serves as an index of the position in the depth direction, so that the stereoscopic image is a stereoscopic image. It is possible to give a stronger feeling to the user.

  Note that the present invention can be realized in various forms, for example, in the form of a videophone device including the image display device described in any one of Application Examples 1 to 5. it can.

Hereinafter, the best mode for carrying out the present invention will be described in the following order based on examples.
A. First embodiment:
B. Second embodiment:
C. Third embodiment:
D. Variation:

A. First embodiment:
FIG. 1 is an explanatory view showing a videophone device to which an image display device as an embodiment of the present invention is applied. The videophone device 100 is connected to a network 10 and realizes a video conference via the network 10. This videophone device 100 can display the image of the other party in three dimensions. In addition, the videophone device 100 transmits images (videos) obtained by imaging the user from two different positions to the other side so that the image of the user on this side can be stereoscopically viewed on the other side.

FIG. 2 is a block diagram showing a detailed configuration of the videophone device 100 shown in FIG. The videophone device 100 includes a main body unit 200, a display unit 300, a hood unit 110, a half mirror 120, and an imaging unit 150. The hood part 110 is a hollow member that protrudes toward the user side, and is arranged so as to surround the periphery of the display part 300. The space surrounded by the hood part 110 is hereinafter referred to as an enclosure space AR. The half mirror 120 is installed inside the enclosure space AR. The half mirror 120 transmits a part of the incident light and reflects the remaining light. As such a half mirror 120, for example, a glass substrate having a dielectric thin film layer (TiO ₂ layer, SiO ₂ layer or the like) formed on the surface thereof can be used. The imaging unit 150 is installed on the upper outer surface of the hood unit 110 and includes two CCD cameras (a first camera 151 and a second camera 152). Although not shown, a hole for receiving light by the two cameras 151 and 152 is provided in the ceiling portion of the hood portion 110. These two cameras 151 and 152 are installed at a predetermined distance from each other, and can capture the same subject from different angles to obtain a stereoscopic image.

  The display unit 300 is a stereoscopic display that displays a stereoscopically visible image, and includes a liquid crystal panel 310, a backlight 320, and a liquid crystal panel drive unit 330. The liquid crystal panel 310 includes a lower polarizing plate 301, a lower glass substrate 302, a liquid crystal layer 303, a color filter layer 304, an upper glass substrate 305, a parallax barrier 306, and an upper polarizing plate 307. Each has a laminated structure.

  The liquid crystal panel driving unit 330 receives composite image data (R (red), G (green), B (blue)) FD of two images (first image and second image) for stereoscopic viewing. . The liquid crystal panel drive unit 330 drives the liquid crystal panel 310 by generating and outputting a drive signal SD based on the composite image data FD. In the liquid crystal panel 310, the lower glass substrate 302 includes pixel electrodes (not shown). The upper glass substrate 305 includes a common electrode (not shown). Then, in the liquid crystal layer 303 sandwiched between these two glass substrates 302 and 305, according to the change in the drive signal SD output from the liquid crystal panel drive unit 330 (change in voltage between the pixel electrode and the common electrode), The alignment of liquid crystal molecules changes. The color filter layer 304 includes three color filters of R, G, and B. As the parallax barrier, for example, a so-called stripe barrier in which light shielding portions and openings are arranged in a stripe shape can be used.

  Illumination light emitted from the backlight 320 passes through the lower polarizing plate 301 and the lower glass substrate 302, is modulated in the liquid crystal layer 303, and is converted into image light of a total of three colors of R, G, and B in the color filter layer 304. Is done. The liquid crystal panel driving unit 330 drives each pixel so that the first image and the second image are displayed in stripes. The three color image lights converted in the color filter layer 304 are emitted to the outside (enclosure space AR) of the liquid crystal panel 310 through the upper glass substrate 305 and the parallax barrier 306. At this time, among the image light representing the first image and the second image emitted from the upper glass substrate 305, the image light representing the first image passes through the stripe-shaped opening of the parallax barrier 306 and is first. Injected in the viewing direction α. Further, the image light representing the second image is emitted in the second viewing direction β through the striped opening of the parallax barrier 306. Therefore, when the user of the videophone device 100 observes the display unit 300, the user sees the image light of the first image emitted in the viewing direction α with the left eye and the second image emitted in the viewing direction β with the right eye. The other person's face can be stereoscopically viewed by viewing the image light.

  The main unit 200 includes a network interface unit 222, a signal multiplexing / demultiplexing unit 224, an audio encoding / decoding unit 226a, a video encoding / decoding unit 226b, a signal converting unit 228a, a signal converting unit 228b, and a microphone. 230, the speaker 240, and the control part 210 which controls each of these components. The network interface unit 222 is a communication protocol for video conferencing, which is an H.264 standard based on ITU-T (International Telecommunication Union, Telecommunication Standardization Department). H.323 recommended protocol is executed.

  The signal multiplexing / demultiplexing unit 224 separates the signal from the other party received via the network interface unit 222 into an audio signal and a video signal, and multiplexes the video signal and the audio signal transmitted from the videophone device 100. Or The voice encoding / decoding unit 226a decodes the other party's voice signal extracted by the signal multiplexing / demultiplexing unit 224 or encodes the voice signal input from the speaker 240. The signal conversion unit 228a performs D / A conversion on the audio signal decoded by the audio encoding / decoding unit 226a, outputs the audio signal to the speaker 240, and A / D converts the audio signal input from the microphone 230 to generate an audio code. Output to the encoding / decoding unit 226a. The video encoding / decoding unit 226b decodes the counterpart video signal extracted by the signal multiplexing / demultiplexing unit 224, or encodes the image (video) signals captured by the two cameras 151 and 152 described above. . The signal conversion unit 228 b performs D / A conversion on the video signal decoded by the video encoding / decoding unit 226 b and outputs it to the liquid crystal panel driving unit 330.

  3 is a cross-sectional view of the videophone device 100 shown in FIG. 1 on the YZ plane. The half mirror 120 is installed at a predetermined angle with respect to the display surface (upper polarizing plate 307) of the display unit 300 in the enclosed space AR. With this configuration, the appearance of the user who views the display unit 300 is transmitted through the half mirror 120 toward the display unit 300 and reflected upward at the half mirror 120. On the other hand, the stereoscopically visible image displayed on the display unit 300 is reflected downward by the half mirror 120 and passes through the half mirror 120 toward the user.

  The optical axes D1 of the two cameras 151 and 152 included in the imaging unit 150 are both perpendicular to the bottom surface S1 inside the hood unit 110. Then, these two cameras 151 and 152 capture the image of the user reflected by the half mirror 120 at two different positions. Note that the images of the lens portions of the two cameras 151 and 152 are reflected by the half mirror 120 to the user side. However, since the image of the lens portion is darker than the brightness of the image displayed on the display unit 300, there is no problem when the user views the image on the other side.

  In this way, the videophone device 100 captures the image of the user reflected by the half mirror 120, so that an image of the user looking at the display unit 300 viewed from the front can be obtained. Therefore, when using a video conference apparatus having the same configuration as that of the video phone apparatus 100 on the other side, it is possible to have a conversation with the same line of sight. Moreover, since the imaging unit 150 is installed on the outer surface of the hood unit 110, the user does not get in the way when viewing the image of the other party. The bottom surface S1 inside the hood part 110 is black. This is due to the following reason. As described above, the image (image light) displayed on the display unit 300 passes through the half mirror 120 and is reflected downward by the half mirror 120. Therefore, by making the bottom surface S1 black, the reflected image light from the half mirror 120 can be absorbed by the bottom surface S1, and the occurrence of reflection in the image captured by the imaging unit 150 can be suppressed. is there. Instead of the bottom surface S1 or together with the bottom surface S1, any surface (ceiling surface or side surface) inside the hood portion 110 may be black. Further, the bottom surface S1 is not limited to black, but may be an arbitrary relatively dark color such as dark gray.

  FIG. 4 is an explanatory view of the videophone device 100 during a video conference as viewed from the user side. For convenience of illustration, the half mirror 120 is indicated by a broken line. During the video conference, the user's face image (virtual image) F1 appears to appear in the enclosed space AR. In the user's field of view, in addition to the virtual image F1, the display surface of the display unit 300 (upper polarizing plate 307), the inner surface of the hood unit 110 (the bottom surface S1 and the side surface), and the frame 112 of the hood unit 110 are included. ing. Here, when the distance in the depth direction (Z-axis direction) to the virtual image F1 is compared between the display unit 300 and the frame 112, the distance from the frame 112 to the virtual image F1 is shorter. Therefore, when the user moves the viewpoint from the virtual image F1 to the frame 112 (viewpoint movement direction Q), the shift of the focus position of the eye is when the viewpoint is moved from the virtual image F1 to the display surface (viewpoint movement direction P). It becomes smaller than the deviation.

  Generally, when a user views a stereoscopic image on a stereoscopic display, the user may move the viewpoint from the stereoscopic image (virtual image) to see something other than the virtual image. In the videophone device 100, if the user views the display surface (upper polarizing plate 307) itself as something other than the virtual image F1, the focal position changes greatly due to the movement of the viewpoint from the virtual image F1 to the display surface. It can cause fatigue. However, in the videophone device 100, the frame 112 of the hood portion 110 enters the user's field of view as a visual recognition object whose focal position shift from the virtual image F1 is smaller than the display surface. Therefore, the user can view the frame 112 as something other than the virtual image F1 with almost no change in the focal position. Therefore, in the videophone device 100, it is possible to relieve the fatigue of the user who performs the video conference while viewing the virtual image F1.

B. Second embodiment:
FIG. 5 is a cross-sectional view on the YZ plane of the videophone apparatus according to the second embodiment. The video phone device 100a differs from the video phone device 100 of the first embodiment in that the half mirror 120 is installed in a posture closer to the Y-axis direction and the imaging unit 150 is installed in a position closer to the user side. And the optical axes of the first camera 151 and the second camera 152 are not perpendicular to the bottom surface S1, and the other configurations are the same as those of the videophone device 100.

  In the videophone device 100a, the half mirror 120 is configured such that the angle formed by the reflecting surface and the incident direction (Z-axis direction) of the light representing the user is larger than that of the videophone device 100 (FIG. 3). is set up. That is, the half mirror 120 in the second embodiment is installed in a posture closer to the Y-axis direction than the half mirror 120 in the first embodiment. Thereby, the reflection direction of the user's figure in the half mirror 120 changes from the first embodiment. Accordingly, the installation position of the imaging unit 150 is installed closer to the user side than the videophone device 100 (FIG. 3) in order to capture the user's appearance reflected by the half mirror 120. Further, the optical axes D2 of the two cameras 151 and 152 are not perpendicular to the bottom surface S1, but form a predetermined angle with respect to the bottom surface S1. Here, the two cameras 151 and 152 are arranged so that the display surface (upper polarizing plate 307) of the display unit 300 does not enter the field of view.

  With the configuration as described above, the half mirror 120 is arranged in a posture closer to the Y-axis direction as compared to the first embodiment, so that the length of the hood portion 110 itself in the Z-axis direction is set to the first length. This can be made shorter than in the first embodiment. Therefore, the entire videophone device 100a can be reduced in size. In addition, since the display surface of the display unit 300 does not fall within the imaging range of the two cameras 151 and 152, it is possible to avoid capturing the other party's image on the display unit 300.

C. Third embodiment:
FIG. 6 is an explanatory view of the videophone device during a videoconference in the third embodiment viewed from the user side. In addition, the half mirror 120 is shown with a broken line similarly to the 1st Example (FIG. 4). In this videophone device 100b, the half mirror 120 is installed so as to reflect the user's figure downward, the imaging unit 150 is installed inside the main body 200, and the hood unit 110a. Unlike the videophone device 100 (FIG. 4) in that the inner bottom surface S1 is not black, the other configurations are the same as those of the first embodiment.

  In the videophone device 100b, the imaging unit 150 is installed not inside the upper outer surface of the hood unit 110a but inside the main body unit 200 (just below the bottom surface S1 of the hood unit 110a). In the videophone device 100b, the half mirror 120 is installed so as to reflect the user's figure downward. Therefore, the two cameras 151 and 152 built in the main body 200 can capture the user's appearance reflected by the half mirror 120 below the hood 110a. The bottom surface S1 is provided with holes (not shown) for receiving light by the two cameras 151 and 152.

  Unlike the bottom surface S1 (FIG. 4) in the videophone device 100, the bottom surface S1 inside the hood portion 110a has a striped pattern in which black stripes extending in the X-axis direction are arranged at predetermined intervals in the Z-axis direction. . The bottom surface S1 inside the hood portion 110a has such a striped pattern for the following reason. That is, since the striped black streaks serve as an index of the position in the depth direction (Z-axis direction) when the user views the virtual image F1, the virtual image F1 is more strongly given to the user. Because it can. The striped pattern may be applied to the inner side surface of the hood portion 110a instead of the inner bottom surface S1 of the hood portion 110a or together with the bottom surface S1. Further, instead of the striped pattern, an arbitrary pattern serving as an index of the position in the depth direction may be applied. The ceiling surface S2 inside the hood part 110a is black. This is to suppress the occurrence of the reflection of the virtual image F1 or the like in the image picked up by the image pickup unit 150, similarly to the case where the bottom surface S1 is black in the videophone device 100 (FIG. 4). is there. In addition, the striped pattern mentioned above is corresponded to the parameter | index part in a claim.

With the configuration as described above, the videophone device 100b can obtain an image of the user looking at the display unit 300 as seen from the front. In addition, since the imaging unit 150 is disposed inside the main body unit 200, the entire videophone device 100b can be downsized. Further, since the hood part 110a is provided so as to surround the virtual image F1, an index of the position in the depth direction of the virtual image F1 can be provided by using the inner surface of the hood part 110a.
D. Variation:
In addition, elements other than the elements claimed in the independent claims among the constituent elements in each of the above embodiments are additional elements and can be omitted as appropriate. The present invention is not limited to the above-described examples and embodiments, and can be implemented in various modes without departing from the gist thereof. For example, the following modifications are possible.

D1. Modification 1:
In each of the embodiments described above, the display unit 300 (FIG. 2) uses the parallax barrier 306 to control the emission direction of the image light. However, instead of the parallax barrier 306, the emission direction of the image light is controlled. Any possible device may be used. As such an apparatus, for example, a lenticular lens in which cylindrical lenses are arranged in the horizontal direction (X-axis direction) may be used.

D2. Modification 2:
In each of the above-described embodiments, the image display device is applied to a videophone device. However, the present invention is not limited to a videophone device, and is applied to any device that captures a user who views an image while displaying the image. be able to. For example, a device that allows a user who tries makeup or glasses to check his / her face as viewed from the front, or a device that captures the face of a user playing a game and displays it on a game screen (game machine) It can also be applied.

D3. Modification 3:
In each of the embodiments described above, the hood portions 110 and 110a may be detachable. With such a configuration, when the display unit 300 functions as a two-dimensional display in a configuration in which a three-dimensional display and a normal display (two-dimensional display) can be switched, the hood units 110 and 110a are removed. Thus, the display image can be viewed in a brighter environment.

D4. Modification 4:
In each of the above-described embodiments, the installation angle of the half mirror 120 may be arbitrarily changed. Further, the imaging unit 150 and the two cameras 151 and 152 are movable, and the position of the imaging unit 150 and the optical axes of the two cameras 151 and 152 can be changed in accordance with the change in the installation angle of the half mirror 120. Also good. With such a configuration, even if the position (height) of the eyes changes due to the change of the user or the like, it is possible to take an image of the user as seen from the front.

D5. Modification 5:
In the first embodiment described above, the imaging unit 150 is disposed on the upper outer surface of the hood unit 110. In the third embodiment, the imaging unit 150 is installed inside the main body unit 200. The installation position of the imaging unit 150 is not limited to these locations, and can be any location that does not hinder the user from visually recognizing the virtual image F1. For example, the side surface of the enclosures 110 and 110a may be used.

D6. Modification 6:
In each of the embodiments described above, the videophone devices 100, 100a, and 100b are stationary phone devices, but may be portable phone devices. In such a configuration, the hood portions 110 and 110a may be detachable, and the hood portions 110 and 110a may be attached only when a video conference is performed.

It is explanatory drawing which shows the video telephone apparatus to which the image display apparatus as one Example of this invention is applied. It is a block diagram which shows the detailed structure of the video telephone apparatus 100 shown in FIG. It is sectional drawing in the YZ plane of the video telephone apparatus 100 shown in FIG. It is explanatory drawing which looked at the video telephone apparatus 100 in a video conference from the user side. It is sectional drawing in the YZ plane of the video telephone apparatus in a 2nd Example. It is explanatory drawing which looked at the video telephone apparatus in the video conference in a 3rd Example from the user side.

Explanation of symbols

DESCRIPTION OF SYMBOLS 10 ... Network 100, 100a, 100b ... Videophone apparatus 110, 110a ... Hood part 112 ... Frame 120 ... Half mirror 150 ... Imaging part 151 ... 1st camera 152 ... 2nd camera 200 ... Main-body part 210 ... Control part 222 ... Network Interface unit 228a, 228b ... Signal conversion unit 230 ... Microphone 240 ... Speaker 300 ... Display unit 301 ... Lower polarizing plate 302 ... Lower glass substrate 303 ... Liquid crystal layer 304 ... Color filter layer 305 ... Upper glass substrate 306 ... Parallax barrier 307 ... Upper part Polarizing plate 310 ... Liquid crystal panel 320 ... Back light 330 ... Liquid crystal panel drive unit 224 ... Signal multiplexing / separation unit 226a, 226b ... Audio encoding / decoding unit SD ... Drive signal FD ... Composite image data P, Q ... Viewpoint moving direction D1 , D2 ... Optical axis S1 ... Bottom 2 ... ceiling surface F1 ... virtual image AR ... enclosure space α ... the first viewing direction β ... the second viewing direction

Claims (6)

An image display device that displays a first image in a first viewing direction of an observer and displays a second image in a second viewing direction,
A display unit having a display surface for displaying the first image and the second image;
An enclosure that is disposed so as to surround the periphery of the display surface, and that projects from the display surface to the viewer side and has an opening on the viewer side;
A half mirror part arranged in an inclined state with respect to the display surface in an enclosure space surrounded by the enclosure part;
An imaging unit that is arranged outside the enclosure space and that captures the image of the observer reflected by the half mirror from a plurality of directions;
An image display device comprising: The image display device according to claim 1,
Of the inner surface of the enclosure facing the enclosure space, at least the region included in the field of view of the imaging unit is black,
Image display device. The image display device according to claim 1 or 2,
The imaging unit is arranged so that the display surface is not included in the field of view of the imaging unit.
Image display device. The image display device according to any one of claims 1 to 3,
The enclosure is detachably attached to the image display device.
Image display device. The image display device according to any one of claims 1 to 4,
The enclosure has an indicator portion that serves as an indicator of a position in the depth direction when viewed from the observer side on any inner surface facing the enclosure space.
Image display device.   A videophone device comprising the image display device according to any one of claims 1 to 5.

Images