JP2013105000A - Video display device and video display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a video display device allowing a user to view a video that is larger than the dimension of a display (video display part).SOLUTION: The video display device includes: input means that inputs a first video and a second video; a display unit that displays the first video such that a viewer in a first location can directly view it, displays the second video such that the viewer in the first location cannot directly view it, and displays the video such that the viewer in the first location can view the second video that is reflected by a mirror surface present in a second location at a predetermined angle.

Description

  Embodiments described herein relate generally to a video display device and a video display method.

  In recent years, many portable communication devices, information processing devices, and the like have been provided. In these apparatuses, further miniaturization is promoted in order to improve portability. In addition, in order to differentiate from other devices along with miniaturization and respond to user needs, the functions possessed by the devices tend to increase. For this reason, the amount of information displayed is also increasing. Therefore, there is a need for a technique for displaying more information on a miniaturized display.

JP 9-37193 A

  By the way, in recent years, 3D video display devices capable of displaying moving images without using dedicated glasses or the like, so-called autostereoscopic displays, are also used in the above-described portable communication devices, information processing devices, and the like. .

  In general, the larger the image, the larger the amount of information is preferable for the video viewed by the user. However, since the size of the display provided to the user is fixed, the user views the video larger than the size of the display. It is difficult.

  The present invention has been made in view of the above, and an object of the present invention is to provide a video display device and a video display method that allow a user to view a video larger than the size of a display (video display unit).

  According to an embodiment of the present invention for solving the above-described problem, the input means for inputting the first video and the second video, and the first video is directly viewed by the viewer at the first position. The display unit displays the second video so that the second image cannot be directly viewed by the viewer at the first position, and is reflected by a mirror surface existing at a predetermined angle at the second position. It is possible to obtain a video display device including a display unit that displays the video so that the second video can be viewed by the viewer at the first position.

The figure for demonstrating the fundamental view of the video display apparatus of this Embodiment. The conceptual diagram for demonstrating the display principle of II system. The figure which illustrates the some stereoscopic viewing possible range of an autostereoscopic display. FIG. 3 illustrates a principle of a video display device according to an embodiment of the present invention. The figure for demonstrating the response | compatibility of the quality fall by the cause on manufacture of the video display apparatus of this Embodiment. The figure which shows the signal processing block of the video display apparatus of this Embodiment. The figure explaining the response | compatibility of the quality fall by the change of the observer's observation position of the video display apparatus of this Embodiment. The flowchart which shows the process sequence which correct | amends the image distortion of the video display apparatus of this Embodiment. The figure for demonstrating the fundamental view of the video display apparatus of other embodiment. The figure for demonstrating the basic view of the video display apparatus of another embodiment.

  FIG. 1 is a diagram for explaining the basic concept of the video display apparatus according to the present embodiment.

  Mirrors 11a and 11b facing each other are provided on the left and right sides of the display panel 10 for displaying an image. The display panel 10 is a liquid crystal display panel, for example, and displays one image for every three horizontal (or vertical) scanning lines. In other words, a smiley image is displayed on the 3n horizontal (or vertical) scan line, a star-shaped image is displayed on the (3n + 1) horizontal (or vertical) scan line, and the (3n + 2) horizontal line is displayed. A sun image is displayed on the (or vertical) scan line.

  Then, these three images are projected in different directions by the action of a light beam control element (not shown) that distributes light from a backlight (not shown) of the display panel 10 in three directions. That is, the smiley image of the 3n horizontal (or vertical) scan line is projected to the front, the star image of the (3n + 1) th horizontal (or vertical) scan line is projected to the left, and (3n + 2) The sun image of the first horizontal (or vertical) scan line is projected to the right.

  Assuming that the observer is observing the display image from a predetermined position in front of the display panel 10, the image of the smiley mark is observed on the front display panel 10. The star-shaped image projected in the left direction is reflected by the mirror 11a and observed. Therefore, the observer observes the star-shaped image on the display panel 10a of the mirror image reflected on the mirror 11a. The sun image projected in the right direction is reflected by the mirror 11b and observed. Accordingly, the observer observes the sun image on the mirror-image display panel 10b reflected on the mirror 11b.

  As a result, the observer is observing the display panels 10, 10a, and 10b, and as a result, the visual field width is expanded.

Next, the autostereoscopic display will be described.
There are various types of 3D image display devices capable of displaying moving images, so-called autostereoscopic displays. In recent years, there is a growing need for a flat panel type method that does not require special glasses. As one type of autostereoscopic display that does not require special glasses, a light control element is installed in front of the display panel, and the light from the display panel is controlled and directed to the viewer. Yes. As the display panel (display device), a direct-view or projection-type liquid crystal display device, a plasma display device, or the like is used, and the pixel position is fixed.

  The light beam control element has a function of making different images visible depending on the angle at which the same position on the light beam control element is observed. When only the left and right parallax (horizontal parallax) is given, a slit (parallax barrier) or a lenticular sheet (cylindrical lens array) is used as the light beam control element. In the case of providing not only left-right parallax but also vertical parallax (vertical parallax), a pinhole array or a lens array is used as a light beam control element.

  Methods using light control elements are classified into two-lens, multi-lens, super-multi-lens (a multi-lens condition that satisfies the super-multi-lens condition), and integral imaging (hereinafter also referred to as II). The The binocular system is a stereoscopic view based on binocular parallax. An image based on a multi-view type or later method is accompanied by motion parallax to some extent, and is therefore referred to as a “three-dimensional image” so as to be distinguished from a binocular type stereoscopic image. The basic principle for displaying a three-dimensional image is substantially the same as the principle of integral photography (IP), which was invented about 100 years ago and applied to three-dimensional photography.

  FIG. 2 is a conceptual diagram for explaining the display principle of the II system.

  Depending on the position of the viewer or the viewing angle of the viewer, γ, which is a one-parallax image, β, which is a two-parallax image, and α, which is a three-parallax image, are viewed. Here, if the images α, β, and γ are images having different parallaxes for the same object, the observer can perceive a solid by the parallax that enters the right eye and the left eye. Note that when a lenticular lens is used as the light beam control element, the luminance can be increased because of high light utilization efficiency. The gap between the lens array and the pixel should be approximately the same as the focal length of the lens, so that one pixel can be emitted in one direction and different parallax images can be seen depending on the viewing angle. Therefore, when the viewing angle is changed, a stereoscopic image (motion parallax image) having a different depth of the observation target can be observed.

  In the II system, light rays emitted from one lens correspond to the number of element pixel groups. The number of element pixel groups is called the number of parallaxes. That is, the number of images switched and displayed according to the line-of-sight direction is called the number of parallaxes, and the number of parallaxes is nothing but the number of pixels included in one lens pitch.

  By the way, in the stereoscopic video system including the II system, there is an area called a main lobe in which the screen can be viewed stereoscopically (stereoscopic viewable area). Therefore, for example, the light beam control element can be configured so that the autostereoscopic display has a plurality of stereoscopic viewing possible ranges.

FIG. 3 is a diagram illustrating a plurality of stereoscopic viewing possible areas of the autostereoscopic display.
This autostereoscopic display has a three-dimensional viewing area in three directions (front and diagonally left and right). In each stereoscopic viewing possible area, a plurality of parallax images that enable the above-described motion parallax are displayed. And the parallax image displayed in each stereoscopic viewing possible area is the same. As a result, the stereoscopic viewing range is widened, and the autostereoscopic display is easier to view.

  FIG. 4 is a diagram for explaining the principle of the video display apparatus according to the present embodiment.

  In FIG. 4, a plurality of parallax images emitted in the right stereoscopic viewing area are referred to as a first parallax group, and a plurality of parallax images emitted in the front stereoscopic viewing area are referred to as a second parallax group. A plurality of parallax images emitted to the area are referred to as a third parallax group.

  A stereoscopic image displayed on the display panel 10a of the mirror image reflected on the mirror 11a is set in the first parallax group, a stereoscopic image displayed on the display panel 10 is set in the second parallax group, and the mirror 11b is set in the third parallax group. The stereoscopic image displayed on the display panel 10b of the mirror image shown in the above is set.

  As a result, the observer is observing the stereoscopic images displayed on the display panels 10, 10a, and 10b, and as a result, the visual field width is pseudo-expanded three times.

  By the way, unlike a planar image, a high-quality three-dimensional image is obtained when an observer observes a parallax image at an appropriate position. Therefore, the video display device of the present application is provided with a mechanism corresponding to the cause of the following deterioration in quality in order to provide a high-quality stereoscopic image to the observer.

(1) Response to degradation of quality due to manufacturing causes of video display devices
The stereoscopic viewable area is formed by, for example, creating and arranging a light control element in an appropriate shape so that an appropriate stereoscopic image can be obtained at a predetermined position specified by the observer. For this reason, the angle at which the first and third parallax groups are emitted may not be able to realize the designed angle. In addition, an error may occur in the angle of injection.

(2) Response to deterioration of quality due to changes in the observation position of the observer
When an observer's observation position deviates from a predetermined position, for example, when a stereoscopic image is provided to an unspecified number of observers, the observation position may be different for each observer. Moreover, even if it is the same observer, the observation position may be changed by changing the observation posture during observation.

  FIG. 5 is a diagram for explaining the response to the deterioration in quality due to the manufacturing cause of the video display device according to the present embodiment.

  When the angle at which the first parallax group is emitted is different from the predetermined angle, the panel 10 and the mirror 11a are configured so that the first parallax group reflected by the mirror 11a is incident on the observer at a desired angle. Change the angle. Specifically, the angle formed by the light beam direction corresponding to the center line of the first parallax group to be incident on the observer and the light beam direction corresponding to the center line of the first parallax group emitted from the panel 10 is equally divided. The mirror 11a is arranged so as to be perpendicular to the line segment. The inclination of the mirror 11b corresponding to the third parallax group can be similarly determined.

  However, the adjustment of the inclination of the mirrors 11a and 11b should be performed in the manufacturing stage of the video display device, and the inclination of the mirrors 11a and 11b cannot be adjusted after the adjustment.

  As shown in FIG. 5, when the mirror 11a is tilted, the mirror image display panel 10a when viewed from the observer is tilted (with an angle) instead of being horizontal, unlike the original mirror image display panel 10a. Is done. Accordingly, since the image is distorted by this angle (such as an image depth shift), the pixel data set in the panel 10 needs to be pixel data in which the image distortion is corrected.

  FIG. 6 is a diagram illustrating a signal processing block of the video display apparatus 100 according to the present embodiment. The video display device 100 includes a tuner unit 102, a video composition unit 103, a GUI display generation unit 104, a video display unit 105, and a constant table 106.

  The overall control unit 101 is connected to each unit by a signal line. The overall control unit 101 operates the video display apparatus 100 by controlling each unit by a control register of each unit mapped to a part of the memory space, a dedicated control command, or the like.

  The overall control unit 101 can receive an operation signal transmitted from a remote controller (not shown). At the time of user operation input, the GUI display generation unit 104 generates an operation interface screen and performs user support. When the operation signal is input, the overall control unit 101 decodes the operation signal and reflects the content operated by the user in the operation of the video display device 100.

  When displaying a program sent by broadcast waves, the broadcast waves are input to the tuner unit 102. The tuner unit 102 selects a channel and a program according to the operation signal. The demodulated signal of the selected channel and program is sent to the video composition unit 103. Also, from the video data input, video input from an HDMI / video input terminal or the like is sent to the video composition unit 103.

  The video composition unit 103 captures video data from the tuner unit 102 or video input according to the setting, and generates an image for displaying a stereoscopic image. For example, an image having a necessary number of parallaxes is generated by converting a 2D screen into a 3D image. Alternatively, an image having the required number of parallaxes is generated from the left and right eye video signals. Further, instead of generating an image having the required number of parallaxes in the video composition unit 103, all parallax images may be input from the outside.

  The video composition unit 103 also performs image distortion correction. As described above, the mirrors 11 a and 11 b are not limited to be provided perpendicular to the panel 10, and may be provided tilted. Therefore, the constant table 106 records the tilt angles of the mirrors 11a and 11b. The video composition unit 103 corrects the image distortion for the above-described parallax image data using the inclination angles of the mirrors 11a and 11b.

  FIG. 7 is a diagram for explaining a response to a decrease in quality due to a change in the observation position of the observer in the video display apparatus according to the present embodiment.

  The panel 10 is provided with a camera 110 that captures the face of the observer. The camera 110 is connected to the overall control unit 101, and a person image (face image) photographed by the camera 110 is captured. The overall control unit 101 determines the observation position from the person image, and determines how much the observer is shifted left and right (up and down) from the reference position. The amount of deviation from the reference position may be acquired, for example, by referring to the dictionary data stored in the constant table 106, or the eye position is specified by applying a face image recognition technique and the deviation from the reference position is determined. You may ask for the quantity.

  The obtained deviation amount is recorded in the constant table 106. The video composition unit 103 corrects the image distortion for the parallax image data according to the shift amount in the constant table 106.

  In addition, the video display device is configured to have a function to cope with the deterioration of quality of either one of the response to the deterioration of quality due to the manufacturing cause of the video display device and the response to deterioration of quality due to the change of the observation position of the observer. Alternatively, the video display device may be configured to have a function to cope with both degradations.

  FIG. 8 is a flowchart showing a processing procedure for correcting image distortion of the video display apparatus according to the present embodiment.

  The observer determines the observation position and observes the panel 10. If the observer observes the panel 10 from the reference position, a high-quality stereoscopic image should be observable. Therefore, there is no problem if the observer continues observation at a reference position where a high-quality stereoscopic image can be observed. However, if the observer does not want to change the current position that is not the reference position, it is necessary to provide a high-quality stereoscopic image at the observation position.

  The observer can input an instruction to the user to continue observation at the current observation position (“observation position change instruction”) to the video display device. When the observer instructs an observation position change, the overall control unit 101 receives an observation position change operation signal transmitted from a remote controller (not shown). In step S01, the camera 110 is operated to photograph the face of the observer. In step S02, the overall control unit 101 obtains the current observation position of the observer from the photographed face image. In step S03, the overall control unit 101 obtains a deviation amount between the current observation position and the reference observation position. In step S04, the video composition unit 103 corrects image distortion of the image data based on the inclination angles θ1 and θ2 of the mirrors 11a and 11b and the obtained shift amount.

  According to the video display device of the present embodiment described above, the central parallax group, the left parallax group, and the right parallax can be obtained by installing mirrors facing the left and right of the panel using the three parallax groups that can be stereoscopically viewed. By connecting the groups in the left-right direction, we were able to widen the screen width that allows stereoscopic viewing.

[Other embodiments]
The video display apparatus described in the above embodiment can be further implemented in the following forms.

  FIG. 9 is a diagram for explaining a basic concept of a video display device according to another embodiment. In the form shown in FIG. 9, (2n + 1) parallax groups are used. The light beams of the parallax group are guided to the observer using mirrors 11a and 11b provided facing the left and right ends of the panel 10. As a result, a screen width of (2n + 1) times can be realized. Note that n = 1 corresponds to a case where the display image is enlarged three times as described in the above embodiment.

  At this time, correction for interpolating the reflection characteristics may be performed. The correction method may be correction that uniformly increases the representative value (average value, maximum value, etc.) of the image. For example, when the reflectance of the mirror is 90%, correction such as increasing the luminance by 10% may be used. Further, for each pixel, correction may be performed in consideration of the difference in reflectance caused by the difference in reflection angle depending on the position. Further, the reflectance of each color generated by the wavelength characteristic of the reflectance may be individually corrected. If the configuration is 2n + 1 parallax groups, correction is made for multiple reflections.

  FIG. 10 is a diagram for explaining a basic concept of a video display apparatus according to another embodiment. In the form shown in FIG. 10, the light beams of the parallax group are guided to the observer using four mirrors provided facing the upper, lower, left and right ends of the panel 10. With this configuration, the visual field width can be expanded not only in the width direction but also in the height direction.

  In the above-described embodiment, the mirrors 11a and 11b facing each other are provided on both the left and right sides of the display panel 10. However, in order to be able to view a video larger than the size of the display panel 10, at least one It is sufficient that a mirror is provided.

  Note that the techniques described in the above embodiments can be applied to displays such as television devices, portable devices, smartphones, and notebook PCs.

[Appendix]
The video display device described in each of the above embodiments can be expressed as follows.

  (1) An autostereoscopic display having a plurality of stereoscopic viewing ranges, and first and second mirrors arranged opposite to the vicinity of both ends of the autostereoscopic display, and capable of stereoscopic viewing The area is provided in the front direction of the autostereoscopic display and in both oblique directions sandwiching the front direction, and the first and second mirrors are used to display a group of parallax images from the stereoscopic viewable area in the oblique direction. An image display device, wherein the image display device is provided so as to be reflected at a predetermined reference observation position, and at least the first or second mirror is inclined with respect to the autostereoscopic display.

  (2) The image processing apparatus further includes a video composition unit that generates a parallax image corresponding to the parallax image group in the plurality of stereoscopic viewable areas and corrects the distortion of the parallax image at the reference observation position due to the tilt of the mirror. The video display device according to (1), which is characterized.

  (3) The video display device includes a face image acquisition unit that acquires face image information of a user observing the autostereoscopic display, a user observation position obtained from the face image information, and the reference observation position. A displacement amount calculating means for obtaining a displacement amount, wherein the video composition unit corrects the distortion of the parallax image at the observation position of the user based on the tilt angle of the mirror and the displacement amount. The video display device according to (2).

  (4) The video display device according to (3), wherein the first and second mirrors are provided in the vicinity of left and right ends of the autostereoscopic display, respectively.

  (5) The video display device according to (3), wherein the first and second mirrors are provided in the vicinity of upper and lower ends of the autostereoscopic display, respectively.

  (6) The video display device includes third and fourth mirrors arranged to face each other in the vicinity of both ends in a direction orthogonal to the both ends provided with the first and second mirrors. The image display device according to (3), wherein the stereoscopic viewing possible area is provided in a front direction of the autostereoscopic display and in an oblique direction of up, down, left, and right across the front direction.

  (7) The video display device according to (2), wherein a plurality of stereoscopic viewing areas are provided in the oblique direction.

  Note that the functions described in the above-described embodiments are not limited to being configured using hardware, and can be realized by causing a computer to read a program describing each function using software. Each function may be configured by appropriately selecting either software or hardware.

Note that the present invention is not limited to the above-described embodiment as it is, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage.
Various inventions can be formed by appropriately combining a plurality of constituent elements disclosed in the embodiment. For example, some components may be deleted from all the components shown in the embodiment. Furthermore, you may combine suitably the component covering different embodiment.

  DESCRIPTION OF SYMBOLS 10 ... Display panel, 10a ... Display panel, 10b ... Display panel, 11a ... Mirror, 11b ... Mirror, 100 ... Video display apparatus, 101 ... Overall control part, 102 ... Tuner part, 103 ... Video composition part, 104 ... GUI display Generating unit, 105 ... video display unit, 106 ... constant table, 110 ... camera.

Claims (7)

Input means for inputting the first video and the second video;
A display unit for displaying the first video so that the first video can be directly viewed by a viewer at the first position so that the second video cannot be directly watched by the viewer at the first position; A display unit for displaying the video so that the second video reflected by the mirror surface existing at a predetermined angle at the second position can be viewed by the viewer at the first position;
A video display device comprising:   The video display device according to claim 1, further comprising a video synthesis unit that corrects distortion at the first position of the second video reflected by the mirror surface. The video display device
Face image acquisition means for acquiring face image information of the viewer;
A deviation amount calculating means for obtaining a deviation amount between the viewer's observation position obtained from the face image information and a predetermined reference observation position;
The video composition unit
The video display device according to claim 2, further comprising correcting distortion at the first position of the second video due to the shift amount. An autostereoscopic display having a plurality of stereoscopic viewing areas;
A mirror disposed near one end of the autostereoscopic display,
The stereoscopic viewing area is provided in a front direction and an oblique direction of the autostereoscopic display, and the mirror reflects a parallax image group from the oblique stereoscopic viewing area to a predetermined reference observation position. And the mirror is tilted with respect to the autostereoscopic display.   The image processing apparatus further includes a video synthesis unit that generates a parallax image corresponding to the parallax image group in the plurality of stereoscopic viewable areas and corrects the distortion of the parallax image at the reference observation position due to the tilt of the mirror. The video display device according to claim 4. The video display device
Facial image acquisition means for acquiring facial image information of a user observing the autostereoscopic display;
A deviation amount calculating means for obtaining a deviation amount between the observation position of the user obtained from the face image information and the reference observation position;
The video composition unit
The video display device according to claim 5, wherein the distortion of the parallax image at the observation position of the user is corrected based on the tilt angle of the mirror and the positional deviation amount. Input the first video and the second video,
The second video is displayed so as not to be directly viewable to the viewer at the first position so that the first video can be directly watched by the viewer at the first position, and the second video is displayed. A video display method comprising: displaying a video so that a second video reflected by a mirror surface existing at a predetermined angle at the position can be viewed by a viewer at the first position.

Images