JP2015039075A - Stereoscopic image display device, and stereoscopic image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a stereoscopic image display device and a stereoscopic image display method capable of emphasizing three-dimensional display according to the selection of a user.SOLUTION: A stereoscopic image display device of an embodiment includes display means and selection means. The display means displays stereoscopic images in a plurality of display areas in a display screen. The selection means selects at least one display area of the plurality of display areas as a selection display area. The display means displays the stereoscopic images with different stereoscopic degrees in the selection display area selected by the selection means and in a non-selection display area other than the selection display area.

Description

  Embodiments described herein relate generally to a stereoscopic image display device and a stereoscopic image display method.

  2. Description of the Related Art Conventionally, a technique related to a video display device that can display two-dimensional display and three-dimensional display together on a display is disclosed. In such a video display device, a technique is known in which an item selected by a user is changed to a three-dimensional display by a remote controller, a mouse, or the like.

JP 2011-35827 A Japanese Patent No. 3944188

  However, in the conventional technique, when a three-dimensional display is performed in each of a plurality of windows, when a specific window is selected by the user, the selected window cannot be highlighted and displayed. There was room for improvement in terms of convenience.

  The problem to be solved by the present invention is to provide a stereoscopic image display device and a stereoscopic image display method capable of enhancing a three-dimensional display according to a user's selection.

  The stereoscopic image display apparatus according to the embodiment includes display means and selection means. The display means displays a stereoscopic image in a plurality of display areas in the display screen. The selection means selects at least one display area from among the plurality of display areas as a selection display area. The display means displays the stereoscopic image with different degrees of stereogenicity between the selected display area selected by the selecting means and a non-selected display area other than the selected display area.

FIG. 1 is an external perspective view of a digital television that is a stereoscopic image display device according to an embodiment. FIG. 2 is a block diagram showing a signal processing system of a digital television. FIG. 3A is a front view schematically showing the display screen of the display unit. FIG. 3B is a schematic diagram illustrating an example of a display form of the selection window and the non-selection window. FIG. 3C is a schematic diagram illustrating another display form example of the selection window and the non-selection window. FIG. 4 is a perspective view schematically showing an example of the structure of the display unit. FIG. 5 is a flowchart showing a procedure of display processing performed by the digital television. FIG. 6 is a schematic diagram illustrating a case where three or more windows are displayed on the display unit. FIG. 7 is a schematic diagram showing a case where priority of pop-out amounts is provided for a plurality of windows.

  FIG. 1 is an external perspective view of a digital television 1 that is a stereoscopic image display device according to an embodiment. As shown in FIG. 1, the digital television 1 has a rectangular appearance when viewed from the front (when viewed from the front). The digital television 1 includes a housing 2 and a display unit 3. The display unit 3 is a display device that receives a video signal from a video processing unit 30 (see FIG. 2), which will be described later, and displays a video such as a still image or a moving image. The housing 2 is supported by the support portion 4.

  FIG. 2 is a block diagram showing a signal processing system of the digital television 1. As shown in FIG. 2, the digital television 1 supplies a digital television broadcast signal received by an antenna 12 to a tuner unit 14 as a receiving means via an input terminal 13, thereby transmitting a broadcast signal of a desired channel. It is possible to tune in. The digital television 1 supplies the broadcast signal selected by the tuner unit 14 to the demodulation / decoding unit 15 and restores it to a digital video signal, audio signal, etc., and then outputs it to the input signal processing unit 16. The digital television 1 of the present embodiment has three tuners as receiving means for receiving digital television broadcast signals, two of which are tuners A141 and B142 for receiving terrestrial digital broadcasts. The other one is a tuner C143 for receiving BS / CS digital broadcasts.

  The digital television 1 is provided with an input terminal 19. Digital video signals and audio signals input from the outside via the input terminal 19 are input to the input signal processing unit 16 via the recording / playback processing unit 29 under the control of the control unit 20.

  The input signal processing unit 16 performs predetermined digital signal processing on the digital video signal and audio signal supplied from the demodulation / decoding unit 15 and outputs the result to the output signal processing unit 17. As shown in FIG. 2, the output signal processing unit 17 includes an audio processing unit 18 and a video processing unit 30. The input signal processing unit 16 outputs a digital video signal to the video processing unit 30 and outputs a digital audio signal to the audio processing unit 18.

  The audio processing unit 18 converts the input digital audio signal into an analog audio signal in a format that can be reproduced by the speaker 22 at the subsequent stage, and inputs the analog audio signal to the speaker 22. The speaker 22 reproduces sound based on the analog sound signal output from the sound processing unit 18.

  The video processing unit 30 converts the digital video signal input from the input signal processing unit 16 into an analog video signal in a format that can be displayed on the display unit 3 and inputs the analog video signal to the display unit 3. In addition, when the video signal is a 3D video signal including depth information of a stereoscopic image and parallax information such as binocular parallax, the video processing unit 30 applies a 3D to the display unit 3 based on the 3D video signal. Display video.

  The display unit 3 is a three-dimensional display that can partially switch between two-dimensional display and three-dimensional display in the display screen. FIG. 3A is a front view schematically showing a display screen of the display unit 3. As illustrated in FIG. 3A, the display unit 3 can display the stereoscopic images 51 and 52 in each of the plurality of windows 41 and 42 in the display screen. The configuration of the display unit 3 will be described later.

  In FIG. 2, the digital television 1 includes a control unit 20 that controls the overall operation of the apparatus itself. The control unit 20 includes a CPU (Central Processing Unit) and a ROM (a ROM that stores a control program executed by the CPU). Read Only Memory), RAM (Random Access Memory) for providing a work area to the CPU, various setting information, control information, and operation unit 24 and remote controller 25 (hereinafter referred to as remote controller 25). A non-volatile memory in which operation information and the like are stored. The CPU realizes a function as the selection unit 21 as shown in FIG. 2 by expanding and executing a program stored in the ROM on the RAM.

  The control unit 20 receives an operation from the operation unit 24 provided in the main body of the digital television 1 or an operation transmitted from the remote controller 25 and received by the reception unit 26 so that the operation content is reflected. Each part is controlled individually.

  The selection unit 21 can select at least one of the plurality of windows displayed on the display unit 3. The selection result of the selection unit 21 is input to the audio processing unit 18 and the video processing unit 30 via the input signal processing unit 16.

  For example, as shown in FIG. 3A, when the window 41 is selected from the windows 41 and 42 displayed on the display unit 3, the audio processing unit 18 sends an analog audio signal related to the video of the window 41 to the speaker 22. Output. Further, the video processing unit 30 makes the three-dimensionality of the three-dimensional image 51 of the selected window 41 different from the three-dimensional image 52 of the unselected window 42, and three-dimensionally displays the windows 41 and 42 on the display unit 3. Display. Hereinafter, the selected window is referred to as “selected window”, and the unselected window is referred to as “non-selected window”. Note that the video processing unit 30 may display the selected window in a size larger than the non-selected window (see FIG. 6).

  FIG. 3B is a schematic diagram illustrating an example of a display form of the selection window 41 and the non-selection window 42. As illustrated in FIG. 3B, the video processing unit 30 displays the pop-up amount of the stereoscopic image 51 displayed in the selection window 41 larger than the pop-out amount of the stereoscopic image 52 displayed in the non-selection window 42. Part 3 is displayed. As an example, the video processing unit 30 displays the position to be stereoscopically displayed on the front side in the depth direction in the stereoscopic image 51 on the front side of the position to be stereoscopically displayed on the near side in the stereoscopic image 52 in the non-selection window 42. Let

  FIG. 3C is a schematic diagram illustrating another display form example of the selection window 41 and the non-selection window 42. As shown in FIG. 3C, the video processing unit 30 further displays the amount of popping out of the background screen 61 of the selected window 41 on the display unit 3 by making it larger than the amount of popping out of the background screen 62 of the non-selected window 42. It may be allowed. Here, the background image is an image that is displayed with the same pop-out amount as the window frame or the window frame, and is an image that is the background of the stereoscopic image. The video processing unit 30 makes the pop-out amount of the stereoscopic image 51 from the surface of the display unit 3 larger than the pop-out amount of the stereoscopic image 52 by making the pop-out amount of the background image 61 larger than the pop-out amount of the background image 62. it can.

  In addition, when performing three-dimensional display or two-dimensional display for each window and the selected window is a two-dimensional display, the video processing unit 30 displays a planar display for the selected window as a two-dimensional display of a non-selected window. Alternatively, the image may be displayed by jumping out from the three-dimensional display.

  Next, functions of the video processing unit 30 will be described in more detail. As shown in FIG. 2, the video processing unit 30 includes a parallax amount determination unit 31 and a display image generation unit 32.

  Here, a naked-eye type three-dimensional display method will be described. Further, as an example of the naked eye method, a stereoscopic image display device that displays a three-dimensional image by an integral imaging method (II method) using an array of lenticular lenses (lenticular sheet) extending in the vertical direction will be described as an example. To do. However, the present embodiment is not limited to the II system, and can be applied to a 3D image display apparatus using an active shutter system using glasses in addition to another 3D image display apparatus using the naked eye system.

  The parallax amount determination unit 31 determines the parallax amount of the 3D video signal (multi-viewpoint image) for each window input from the input signal processing unit 16. In addition, the parallax amount determination unit 31 determines the parallax amount of the 3D video signal (multi-viewpoint image) for each window so that the stereoscopic window has different stereoscopic degrees between the selected window and the non-selected window.

  In general, the larger the parallax amount (viewpoint interval) of a multi-viewpoint image, the larger the pop-out amount (or depth amount) of the stereoscopic image. Therefore, the parallax amount determination unit 31 determines the parallax amount of each multi-viewpoint image so that the parallax amount of the multi-viewpoint image with respect to the selected window is larger than the parallax amount of the multi-viewpoint image with respect to the non-selected window.

  As an example, the parallax amount determination unit 31 enlarges the parallax information (parallax amount) included in the 3D video signal displayed in the selected window by a predetermined factor and is included in the 3D video signal displayed in the non-selected window. The disparity information (disparity amount) is enlarged by a multiple smaller than a multiple of the selected window. Thereby, the parallax amount determination unit 31 corrects each parallax information so that the parallax amount of the multi-viewpoint image with respect to the selected window is larger than the parallax amount of the multi-viewpoint image with respect to the non-selected window. By doing in this way, as shown to FIG. 3-2, the display part 3 makes the pop-out amount of the stereo image 51 displayed on the selection window 41 larger than the pop-out amount of the stereo image 52 displayed on the non-selection window 42. It can be enlarged and displayed.

  Alternatively, the parallax amount determination unit 31 sets the maximum parallax amount that is the maximum value of the parallax amount in the 3D video signal of the selected window to be greater than the maximum parallax amount that is the maximum value of the parallax amount in the 3D video signal of the non-selected window. The parallax information may be corrected by increasing it. As a result, the display unit 3, as shown in FIG. 3B, displays the position to be displayed in the foreground in the stereoscopic image 51 to be displayed in the selection window 41 in the foreground in the stereoscopic image 52 to be displayed in the non-selection window 42. It can be displayed on the near side of the position for stereoscopic display.

  Furthermore, the parallax amount determination unit 31 sets the parallax amount with respect to the background screen 61 of the selection window 41 to be larger than the parallax amount with respect to the background screen 62 of the non-selection window 42 as illustrated in FIG. The correction may be performed. Thereby, the display unit 3 can display the pop-up amount of the background screen 61 of the selection window 41 larger than the pop-up amount of the background screen 62 of the non-selection window 42.

  The display image generation unit 32 generates an element image array (multi-viewpoint image) including element images based on the parallax amount determined by the parallax amount determination unit 31, and displays the generated element image array on the display unit 3. . Here, the element image refers to a set of parallax images displayed in units of sub-pixels corresponding to an exit pupil (opening 116) described later, and the element image array represents an element image group displayed on the display unit 3. Say. Note that a known technique is used as a method for generating an element image.

  Next, a more detailed configuration of the display unit 3 will be described. The display unit 3 is a device that displays the multi-viewpoint image generated by the display image generation unit 32. FIG. 4 is a perspective view schematically showing an example of the structure of the display unit 3. In FIG. 4, description will be made assuming that the number of viewpoints n = 18. As illustrated in FIG. 4, the display unit 3 is arranged on the front surface of the display element array 114 configured by an FPD (Flat Panel Display) such as an LCD (Liquid Crystal Display), for example. And an opening control unit 115.

  The aperture control unit 115 is a light beam control element that restricts light beams that pass through and emits light beams in a predetermined direction. As the opening control unit 115 of the present embodiment, a lenticular sheet is used as shown in FIG. The lenticular sheet is an array plate of lens segments that controls incident and exiting light beams to direct the light beams in a predetermined direction. As the aperture control unit 115, an array plate such as a slit provided with a light transmission region as appropriate can be used. These light transmission regions and lens segments have a function of selectively emitting only light rays that are directed in a specific direction among light rays emitted from the display element array 114 toward the front thereof. Hereinafter, the lens segment and the light transmission region are collectively referred to as the opening 116.

  Each opening 116 of the lens segment is arranged corresponding to a pixel. The aperture control unit 115 is not limited to the above-described array plate in which the lenticular segments and the light transmission regions are integrated, and an LCD can also be used as an optical shutter that can change the position and shape of the light transmission region with time.

  Here, in a general FPD, one pixel is composed of RGB sub-pixels. One display element corresponds to one subpixel. In the example of FIG. 4, display elements (sub-pixels 140, 140,...) Having an aspect ratio of 3: 1 are arranged in a matrix in the display element array 114 so that the pixels are square. Each sub-pixel bears one of R (red), G (green), and B (blue). For the row direction, an element displayed is an image displayed in a pixel group in which each sub-pixel is arranged in the row direction by the number of parallaxes, that is, a set of parallax images displayed in units of sub-pixels corresponding to the exit pupil (opening 116). This is called an image 117 (shown with a frame in FIG. 4). Note that the sub-pixels are not limited to R, G, and B.

  Regarding the column direction, in the example of FIG. 4, the element image 117 is configured by a set of six sub-pixels arranged in the column direction. That is, one element image 117 is displayed with 18 pixels in the row direction and 6 pixels in the column direction. In FIG. 4, stereoscopic display that gives 18 parallaxes in the horizontal direction is possible, and further by setting the column direction to 6 pixels, the element image, that is, the stereoscopic display pixel, becomes a square. Note that the position of the pixel in the horizontal direction in the element image 117 corresponds to the aperture control unit 115 and has a correlation with the angle of the emitted light beam.

  The opening 116 is provided corresponding to the position of the element image 117. In the example of FIG. 4, the width (lens pitch) Ps of the opening 116 matches the width of the one-element image.

  In the configuration as described above, for example, a plurality of images respectively acquired with a plurality of different parallaxes from the same subject are supplied from the input terminal 19 to the input signal processing unit 16 as a three-dimensional video signal. The plurality of images are interleaved for each pixel corresponding to the position and supplied as one image data. The present invention is not limited to this, and a plurality of image data can be supplied.

  For example, the display image generation unit 32 distributes, for a plurality of supplied images, pixels corresponding to positions and having different amounts of parallax in order according to the amount of parallax. The display image generation unit 32 configures the element image 117 by distribution and supplies it to the display element array 114 of the display unit 3.

  Here, the opening 116 of the opening control unit 115 is an exit pupil provided so as to correspond to the element image 117. For this reason, the light beam from the pixel of the parallax amount according to the direction from the observer's viewpoint in the element image 117 selectively reaches the observer's viewpoint. When the light rays from pixels having different parallax amounts reach the eyes of the observer, the observer can observe a stereoscopic image (for example, the stereoscopic images 51 and 52). In this case, the larger the amount of parallax, the larger the amount of image pop-out or depth, so if the amount of parallax in the selection window 41 is set larger than the amount of parallax in the non-selected window 42 as described above, FIG. 2, the pop-out amount of the stereoscopic image 51 displayed in the window 41 is larger than the pop-out amount of the stereoscopic image 52 displayed in the window 42.

  The display element array 114 arranged on the back side of the lenticular sheet as viewed from the observer has a parallax that looks slightly different depending on the angle due to the above-described opening 116 and the element image in which a plurality of pixels are arranged. An image group, that is, a multi-viewpoint image is displayed. The light beam from the multi-viewpoint image has its exit direction determined through one of the openings 116 of the opening control unit 115, and a stereoscopic image is reproduced.

  Next, a display processing procedure performed by the digital television will be described. FIG. 5 is a flowchart showing the procedure of display processing performed by the digital television 1.

  First, the selection unit 21 determines whether or not a selection operation by the operation unit 24 or the remote controller 25 has been received for at least one of the plurality of windows displayed on the display unit 3 (step S1). When the selection operation is not accepted (step S1: No), the process returns to step S1 and waits for the operation. On the other hand, when the selection unit 21 receives a selection operation (step S1: Yes), the process proceeds to step S2. The parallax amount determination unit 31 determines the parallax amount for each 3D video signal so that the parallax amount of the 3D video signal with respect to the selected window is larger than the parallax amount of the 3D video signal with respect to the non-selected window (step S2). ).

  The display image generation unit 32 arranges the parallax images in the parallax image arrangement table based on the parallax amount with respect to the 3D video signal of each window determined in step S <b> 2, and multi-viewpoint images (element image array) of each window. Is generated (step S3), and the generated multi-viewpoint image is displayed in the display area of each window of the display unit 3 (step S4). The parallax image arrangement table is a multi-viewpoint image displayed on the display surface of the display unit 3, that is, an arrangement table showing how each parallax image is arranged in each element image of the element image array. Details thereof are described in Patent Document 2.

  In addition, although the case where the two windows 41 and 42 are displayed on the display unit 3 has been described above, three or more windows may be displayed on the display unit 3. FIG. 6 is a schematic diagram showing a case where eight windows 41 and 42 a to 42 g are displayed on the display unit 3. FIG. 6 illustrates an example in which windows 41, 42a, 42e, and 42f that perform three-dimensional display and windows 42b, 42c, 42d, and 42g that perform two-dimensional display are displayed on the display unit 3. As shown in FIG. 6, even when three or more windows 41, 42a, 42e, and 42f are displayed three-dimensionally, a non-selection window that performs three-dimensional display of the pop-up amount of the stereoscopic image displayed on the selection window 41 is displayed. It is good also as a form made larger than the pop-out amount of the stereo image displayed on 42a, 42e, 42f.

  Further, when three or more windows are displayed on the display unit 3, display priority may be given to the selection window, and the pop-out amount in each selection window may be determined based on the priority. . For example, the priority order may be determined in descending order of the number of selections and the number of reproductions based on a selection history such as the number of selections and the number of reproductions.

  FIG. 7 is a schematic diagram showing a case where priority of pop-out amounts is provided for a plurality of windows. FIG. 7 shows a case where the priority is higher in the order of the window 41, the window 42, and the window 43. As illustrated in FIG. 7, the video processing unit 30 causes the display unit 3 to display the three-dimensional display pop-up amounts in the windows 41, 42, and 43 in the descending order of priority. In addition to this, in addition to this, the background screens of the windows 41, 42, and 43 are stereoscopically displayed on the front side in the descending order of priority. As shown in FIG. 7, in a window with a low priority (for example, window 43), the display may be switched from the three-dimensional display to the two-dimensional display.

  As described above, according to the present embodiment, since the stereoscopic image is displayed with the selected display area and the non-selected display area having different stereoscopic degrees, the three-dimensional display can be emphasized according to the user's selection. . This also makes it easier to see the image that the user is interested in.

  Although several embodiments of the present invention have been described, these embodiments are presented by way of example and are not intended to limit the scope of the invention. These novel embodiments can be implemented in various other forms, and various omissions, replacements, and changes can be made without departing from the scope of the invention. These embodiments and modifications thereof are included in the scope and gist of the invention, and are included in the invention described in the claims and the equivalents thereof.

DESCRIPTION OF SYMBOLS 1 ... Digital television, 2 ... Housing | casing, 3 ... Display part, 4 ... Support part, 14 ... Tuner part, 15 ... Demodulation decoding part, 16 ... Input signal processing part, 17 ... Output signal processing part, 18 ... Audio | voice processing , 20 ... control unit, 21 ... selection unit, 30 ... video processing unit, 31 ... parallax amount determination unit, 32 ... display image generation unit, 41, 42 (42a, 42b, 42c, 42d, 42e, 42f, 42g) , 43 ... Window, 51, 52 ... Stereoscopic image, 61, 62 ... Background screen, 114 ... Display element array, 115 ... Opening control part, 116 ... Opening part, 117 ... Element image, 140 ... Subpixel.

Claims (9)

Display means for displaying a stereoscopic image in a plurality of display areas in the display screen;
Selection means for selecting at least one display area as a selection display area among the plurality of display areas;
With
The display means is a stereoscopic image display device that displays the stereoscopic image with different stereoscopic degrees in the selected display area selected by the selection means and a non-selected display area other than the selected display area.   The stereoscopic image display apparatus according to claim 1, wherein the display unit displays the pop-up amount of the stereoscopic image displayed in the selected display area larger than the pop-out amount of the stereoscopic image displayed in the non-selected display area. .   The display means sets a position closest to the depth direction of the stereoscopic image displayed in the selection display area to a position closest to the depth direction of the stereoscopic image displayed in the non-selection display area. The stereoscopic image display device according to claim 2, wherein the stereoscopic image display device displays on the front side.   3. The stereoscopic image display device according to claim 1, wherein the display means displays the background screen pop-up amount in the selected display area larger than the pop-out amount of the background screen in the non-selected display region.   The display means displays a three-dimensional image pop-up amount displayed in the selected display area larger than a pop-up amount of a three-dimensional image displayed in the non-selected display area based on the parallax amount of the three-dimensional video. The three-dimensional image display device according to any one of claims 2 to 4.   The display means enlarges the parallax amount of the stereoscopic image displayed in the selected display area by a predetermined factor, and enlarges the parallax amount of the stereoscopic image displayed in the non-selected display region by a multiple smaller than the predetermined factor. Item 6. The stereoscopic image display device according to Item 5. The display means, when a plurality of the selection display areas are selected by the selection means,
The stereoscopic image display device according to any one of claims 2 to 6, wherein a pop-out amount in each of the selection display areas is determined based on display priority of the selection display areas.   The stereoscopic image display apparatus according to claim 7, wherein the display unit determines the priority order based on a selection history for the plurality of selection display areas. In a stereoscopic image display device,
A display step of displaying a stereoscopic image in a plurality of display areas in the display screen;
A selection step of selecting at least one display area of the plurality of display areas as a selection display area;
A step of displaying the stereoscopic image with different stereoscopic degrees in the selected display area selected in the selection step and a non-selected display area other than the selected display area;
3D image display method.

Images