JP2012048066A - Image display apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image display apparatus capable of displaying images that give the watcher an illusion of presence on the scene and make the discontinuity of picture quality difficult to perceive.SOLUTION: An image display apparatus has a main image display device that displays a main image on its display surface and a subordinate image display device that is arranged on one peripheral side of the display surface and projects a subordinate image in a projecting direction crossing the normal line of the display surface, wherein the subordinate image projected by the subordinate image display device does not overlap the display surface.

Description

  Embodiments described herein relate generally to a video display device.

  In recent years, display devices using so-called FPD (Flat Panel Display) such as LCD (Liquid Crystal Display) and PDP (Plasma Display Panel) have become mainstream when viewing video stored in TV broadcasting and storage devices. Yes.

  Generally, the display device is installed in a room of a living space. For example, an indoor space (peripheral environment) such as light from a wall, curtain, furniture, or window spreads around the display device. For this reason, the viewer views the video displayed on the display device and at the same time observes the indoor space that is not related to the video. By observing the surrounding environment, which is discontinuous with the image, the sense of immersion in the image being viewed is hindered. For this reason, for example, in a movie theater, the periphery is darkened so that only the image can be seen.

  In order to solve the discontinuity between the image and the surrounding environment, there is a technology that gives a change in color and brightness related to the image by illumination around the display device. In addition, a technique for reducing the discontinuity described above and enhancing the sense of reality by projecting video information related to the video has been studied.

  For example, a technique for projecting an image surrounding a main image on a wall behind a television receiver has been proposed. In addition, for example, a technique for displaying a surround video display with lower quality than a video display displayed in the main display area in an area around the main display area in a projection apparatus has been proposed.

  However, as a result of the examination, the discontinuity between the main video and the sub-video is perceived by the viewer in the layout disclosed in the above-described technique in which the plane for projecting the main video and the plane for projecting the sub-video are substantially parallel. It became clear that it was easy. For example, if the image quality (resolution, contrast, brightness) of the sub-image is lower than that of the main image, the discontinuity in image quality gives a strong sense of incongruity. In addition, in dolly images (images captured by camerawork approaching or moving away from the subject) and follow images (images captured by camerawork tracking the subject), it is clear that the improvement of the sense of reality is limited. Became.

JP 2007-272230 A JP 2007-295559 A

  The problem to be solved by the present invention is to provide a video display device capable of displaying a realistic video and in which discontinuity in image quality is difficult to perceive.

  In order to solve the above-described problem, in the video display device according to the embodiment, the main video display device that displays the main video on the display surface, and the display surface is arranged around one periphery of the display surface. A sub-picture display device that projects a sub-picture in a projection direction that intersects the normal line of the sub-picture, and the sub-picture projected by the sub-picture display apparatus does not overlap the display surface.

The block diagram which shows the video display apparatus of 1st Embodiment. The figure which looked at the video display device of a 1st embodiment from the front. The figure which looked at the video display device of a 1st embodiment from the upper part. The figure which shows the modification of the video display apparatus of 1st Embodiment. The figure which looked at the video display device of a 3rd embodiment from the front. The figure which looked at the video display device of a 4th embodiment from the front. The figure which looked at the video display device of a 4th embodiment from the upper part. The figure which looked at the video display device of the 5th form from the front. The figure which looked at the modification of the video display device of the 1st form from the front.

  An embodiment of the present invention will be described. In addition, the same code | symbol is attached | subjected to the structure and process which mutually perform the same operation, and the overlapping description is abbreviate | omitted.

(First embodiment)
FIG. 1 is a block diagram showing a video display apparatus according to the present embodiment. The video display device of FIG. 1 includes a main video display device 1 that displays an input video as a main video, a sub-video generation unit 20 that generates one or a plurality of sub-videos from the input video, and a sub-video generation unit 20. And a sub-picture display device 21 for displaying one or a plurality of sub-pictures generated.

  The input video may be a video input from any device or medium. For example, it may be a signal input from a recording medium such as an HDD, an external device (not shown) connected via a network, or a broadcast wave such as a TV.

  The main video apparatus 1 only needs to be able to display information such as video on its display surface. For example, a liquid crystal display panel, an organic EL panel, a plasma display panel, a CRT, or the like may be used. Alternatively, a projector and a screen may be used.

  The sub video generation unit 20 generates a sub video from the input video. The sub video may be generated by any method. For example, a sub video may be generated from an input video using an optical flow. Alternatively, a sub-video may be generated by simply expanding an image area corresponding to a side on which a sub-video is projected from the input video. The sub-picture is preferably corrected because the surface is inclined.

  The sub-video display device 21 projects one or a plurality of sub-videos generated by the sub-video generation unit 20 on the surface of the indoor space such as curtains and furniture around the main video device 1. The sub video display device 21 is arranged around the display surface of the main video display device 1, and projects the sub video in a direction facing the arranged position on the display surface of the main video display device 1. The sub-picture display device 21 includes sub-picture projectors 2 and 3. Details will be described later.

    FIG. 2 is a projection view showing an outline of the video display apparatus of the present embodiment. In the present video display device, for example, the main video device 1 is arranged at a desired position in an indoor space. FIG. 2 is a diagram viewed from the front side (position observed by the viewer) of the display surface of the main video apparatus 1. In order to project the sub-images 4 and 5 onto the surfaces 40 and 50 of the indoor space such as the walls, curtains, and furniture around the main image device 1, two sub-image projection devices 2 and 3 are provided here. The sub-picture projection devices 2 and 3 are included in the sub-picture display device 21.

  FIG. 3 is a view of the video display device of this embodiment as viewed from above. The sub video 4 projected on the left side surface 40 toward the main video display device 1 is projected from the video projection device 3 provided on the right side of the main video display device 1. Further, the sub video 5 projected on the right surface 7 toward the main video display device 1 is projected from the sub video projection device 2 on the left side of the main video display device 1. In addition, it is preferable to adjust the projection angle from the sub-picture projection devices 2 and 3 so that the sub-pictures 4 and 5 do not overlap the display surface of the main video projection apparatus 1.

  As a specific example, the main video display device 1 uses a 47-type Full-HD liquid crystal display. The sub-picture projectors 2 and 3 are implemented by two XGA-LCD projectors having a projection angle of view of ± 20 degrees, which are laid out in a portrait layout on both sides of the main video display apparatus 1. When the main video display device 1 is laid out at the corner of the room, the distance from the sub video projection devices 2 and 3 to the sub video images 4 and 5 projected onto the surfaces 40 and 7 is about 1.2 m, and the XGA video is about Projected onto a 1.0 m × 0.7 m area. In this way, the sub-picture is laid out so that the projection direction connecting the sub-picture projection devices 2 and 3 and the projected sub-pictures 4 and 5 intersects the normal of the main picture display device 1 with the target axis. It is possible to secure a projection distance from the projection devices 2 and 3 to the surfaces 40 and 7 on which the image is projected, and to suppress an increase in the cost of the optical system of the sub-image projection device. For example, it is also effective to provide a screen that is substantially parallel to the surfaces 40 and 7. This screen looks good when it is translucent. As a result, the layout of the present system does not need to be a corner of the room, and the placement location is not limited.

  In this embodiment, when viewing at a viewing distance such that the horizontal angle of view of the display surface is ± 15 °, the main image is viewed with an effective visual field and the sub-video is viewed with a stable focus field to a guided field of view. Therefore, not only the track video but also the dolly video and the follow video could provide a high sense of realism that would be included in the main video.

(Example of change)
FIG. 4 is a diagram illustrating a modification of the video display device according to the first embodiment. The video display apparatus according to this modification further includes a main video generation unit 10 in addition to the video display apparatus of FIG.

  The main video generation unit 10 can generate a main video in the same manner as a conventional screen in a game, for example.

  The sub-video generation unit 20 shares the viewpoint with the virtual camera for generating the main video in the CG space, and generates the sub-videos 4 and 5 corresponding to the planes 40 and 50 with the two virtual cameras for generation. Can do.

  As described above, according to the first embodiment, the main image is laid out at an angle with respect to the display surface of the main image by laying out the plane on which the sub-image is projected. It is possible to show the sub-picture with a stable focus field (outside the effective field of view) at 12 degrees. Therefore, even if the image quality of the sub-video is reduced with respect to the main video, the discontinuity is not lost, and the presence in the dolly video and follow video has been remarkably improved. As a result, a practical system with an appropriate investment effect (a good balance between the calculation cost and the realistic sensation obtained) can be realized.

  In addition, the projection device that projects the sub-video can ensure the projection distance while suppressing the region overlapping the main video by separating and projecting in the left and right directions of the observation direction from the display surface that displays the main video. I understood. And it was confirmed that sub-pictures can improve the sense of reality even with only the left and right screens. This also corresponds to the fact that the effective visual field of the left and right eyes is wide from side to side.

(Comparative example)
When a sub-picture was projected onto the surfaces 40 and 50 of the indoor space substantially parallel to the display surface, the image quality (resolution, brightness, and contrast) of the main picture was required, and the continuity was severely questioned. Nevertheless, the dolly video and follow video did not improve the realism at all.

  It was also found that even if the image quality was made uniform, the presence in the track image (the image captured by the camerawork moving to the left and right) was somewhat effective, but the presence was not improved at all. In other words, there is a problem that the presence of the sub-picture is not improved when the load of creating the sub-picture is high.

(Second Embodiment)
In the first embodiment, the case where both the main video and the sub video are 2D video has been described, but in the present embodiment, an example in which the main video display device 1 can display 3D video will be described. Note that the sub-video display device 21 displays a 2D video as in the first embodiment.

  3D video display methods include time-division multiplex display of two parallax images, a micro-pole method that changes the polarization direction for each pixel row of the FPD, and a naked eye that combines FPD and a lenticular sheet. Various methods such as a three-dimensional display method are known, but any method may be used.

  In the present embodiment, a micropole system will be exemplified. Observers are wearing glasses with polarization directions that are perpendicular to the left and right. At this time, the axis of polarization direction of the polarizing plate of the right eye is aligned with the axis of polarization direction of the sub-image projector 2, the axis of polarization direction of the polarizing plate of the left eye is aligned with the axis of polarization direction of the sub-image projector 3. In other words, it is possible to suppress a decrease in luminance due to viewing the sub-image 4 or 5 while wearing the polarized glasses necessary for viewing the main image. The luminance of the sub-picture is set so as to compensate for the luminance drop caused by the polarized glasses for viewing the 3D main video.

  In this embodiment, when viewing at a viewing distance such that the horizontal angle of view of the display surface is ± 15 °, the main video appears as a stereoscopic video, and the sub video is not only a track video but also a dolly video or a follow video. Also contributed to increase the stereoscopic effect of the main video. Also, the viewer did not recognize that it was a 2D image. This is because the viewer's right eye field of view extends in the right direction and the left eye field of view extends in the left direction, and the 3D main image is displayed in the region where the fields of both eyes overlap, and the 2D sub image is displayed in each independent field of view. This is because the layout of the embodiment is appropriate for human visual function.

  When the central video is 3D video, it has been found that even if 2D video is used for the top, bottom, left, and right sub-videos, it is possible to obtain sufficient presence (it is not known if it is 2D video). This is also a reasonable result considering that the region where the viewing angles of the left and right eyes overlap is limited to a substantially frontal area.

(Third embodiment)
FIG. 5 is a front view of the video display apparatus according to the third embodiment. In addition to the first embodiment of FIG. 2, sub-picture projectors 7 and 8 are further provided on the upper right and upper left of the main picture display device 1, respectively. The upper left sub video projection device 7 projects the upper right sub video image 10 of the main video display device 1, and the upper right sub video projection device 8 projects the upper left sub video image 9 of the main video display device 1. As a result, sub-pictures can be displayed not only on the left and right sides of the main picture but also on the top and bottom, and the immersive feeling can be further improved. Here, the projector for projecting the sub-picture projectors 7 and 8 preferably has a landscape arrangement. Although details are omitted, the sub-picture may be displayed below the main picture in the same way. The projection direction connecting the sub-image projection devices 2, 3, 7, 8 and the sub-images 4, 5, 9, 10 projected on the surfaces 40, 50 intersects the normal of the main image display device 1 with the target axis. By laying out, it is possible to secure a projection distance and suppress an increase in the cost of the optical system of the sub-picture projector. In addition, although the sub-images 4, 9, 5, and 10 are shown as areas that are projected in an overlapping manner, in such a case, each of the sub-pictures 4, 9, 5, and 10 is continuously displayed in a region where the total luminance is not superimposed. Adjust the brightness.

(Fourth embodiment)
The figure which looked at the video display device of a 4th embodiment from the front, and the figure seen from the upper part are shown in FIGS. In the present embodiment, the sub-picture projection devices 2 and 3 are arranged closer to the viewer than the display surface of the main video display device 1. In FIG. 5, the sub-picture projection device is incorporated in the housing 11. In this configuration, the sub-videos 4 and 5 are displayed between the housing 11 and the main video display device 1. Specifically, the main video display device 1 is a 47-inch Full-HD liquid crystal display, and the sub-video projection device is two XGA-LCD projectors laid out in a portrait layout on the housing 11 with a projection angle of view of ± 10 °. Consists of. When the main video display device 1 is laid out at the corner of the room and the sub video projection device is arranged 1 m away from the side of the main video display device, it is projected onto the planes 40 and 50 from the sub video projection devices 2 and 3. The distance to the sub-pictures 4 and 5 was approximately 2.4 m, and the XGA image was projected onto an area of approximately 0.7 × 1.0 m. When the housing 11 also serves as a housing of the audio equipment, for example, the viewer can obtain an acoustic effect not only from the front where the main video display device 1 is located but also from the left and right directions. Further, when the housing 11 is not used, the entire system can be made compact by moving to both sides of the main video display device 1. Although not shown, it is also possible to reduce visual noise in the indoor spaces 40 and 50 by providing a mechanism that stretches a screen between the housing 11 and the main video display device 1. With this configuration, it is not necessary to limit the installation environment of the display device to the corner of the room, and the angle formed by the surfaces 40 and 50 can be freely set in the vicinity of 90 °. Further, the housing 11 may be provided with sub-video display devices 7 and 8 for projecting sub-videos 9 and 10 to be displayed above the main video display device. At this time, the projector has a good landscape arrangement.

  In the configuration of the present embodiment, when viewing at a viewing distance such that the horizontal angle of view of the display surface is ± 15 °, the main image looks as a stereoscopic image and the sound is also three-dimensionalized. Furthermore, the sub-video contributed not only to the track video, but also to the three-dimensional effect of the main video in the dolly video and follow video.

(Fifth embodiment)
FIG. 8 is a front view of the video display apparatus according to the fifth embodiment. Sub-pictures are less likely to be perceived as compared to main pictures even if the resolution and contrast are reduced. On the other hand, a decrease in luminance or a reduction in the projection size of an image reduces the feeling of immersion. This can be explained by human visual characteristics that peripheral vision is more sensitive to brightness than central vision, but less sensitive to resolution and contrast. Therefore, it is also possible for each of the sub-picture projection apparatuses 2 and 3 to project the sub-pictures 4 and 5 displayed so as to surround the main picture display device. At this time, the sub-video generation unit 20 generates a video in which the corresponding area is clipped so as not to cover the display surface of the main video display device 1. The sub-image projection devices 2 and 3 project the clipped image without impairing the image quality of the main image.

  Finally, the main video and sub-video can be generated frankly as content to be displayed on this system. However, if there is only main video such as general broadcasting, the area outside the main video, for example, about 20% It is possible to enlarge and expand to make a sub-video, or to extract extrapolated video by extracting information related to motion such as optical flow from the main video. Although details will not be described here, for example, a virtual surface 13 parallel to the display surface as shown by a broken line in FIG. It becomes possible to handle it as a video. The area corresponding to 1, 4, and 5 is extracted from one image generated in the 13 areas, and by performing keystone correction that reflects the inclination of the surface for 4 and 5, the images of 1, 4, and 5 are obtained. Can be converted. Since 4 and 5 are lower in resolution than 1 displayed in full-HD resolution, it is more efficient to generate them individually. However, by holding the video in the form of a virtual plane 13, the plane 40, It is possible to adapt flexibly to changes in the angle of 50 and changes in the number and area of sub-pictures as described in the embodiment.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the scope of the invention (and equivalents) described in the claims.

DESCRIPTION OF SYMBOLS 1 ... Main image display apparatus 2, 3, 7, 8 ... Image projection apparatus 4, 5, 9, 10, 12 ... Image projection area | region, 40, 50 ... Plane, 11, ...・ Case, 13 ... Virtual plane

DESCRIPTION OF SYMBOLS 10 ... Main video production | generation part, 20 ... Sub video production | generation part, 21 ... Sub video display apparatus,

Claims (9)

A main video display device for displaying the main video on the display surface;
A sub-picture display device that projects the sub-picture in a projection direction that is arranged around one display surface and intersects the normal of the display surface from one periphery of the display face;
And a sub-picture projected by the sub-picture display device does not overlap the display surface.
The sub-picture display device
A plurality of projection devices are provided in a group around one of the display surfaces of at least one of the left, right, and top and bottom in front of the display surface,
The video display device according to claim 1, wherein the projection device projects the sub-video in the direction of the other projection device in the set.
The video display device according to claim 2, wherein the plurality of projection devices are arranged so that the sub-images projected by the plurality of projection devices intersect at least at one point.
The video display device according to claim 2, wherein the main video display device is capable of displaying a stereoscopic video as the main video.
The video display device according to claim 2, further comprising a generation unit that generates a sub-video from the input video.
The video display device according to claim 5, wherein the generation unit generates a sub-video having the same luminance as the input image and lower in resolution and / or contrast than the input image.
The video display device according to claim 1, further comprising a screen for displaying the sub-video.
The image display apparatus according to claim 7, wherein the screen is translucent.
  The video display device according to claim 6, wherein the generation unit adjusts luminance in a display region where sub-pictures projected by the plurality of projection devices overlap.

Images