JP2016192712A - Multi-viewpoint image display system and multi-viewpoint image display program - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a multi-viewpoint image display system and a multi-viewpoint image display program capable of reducing the image resolution observable from each viewpoint, regardless of the multi-viewpoint image display method, and without applying any special processing to the display device itself.SOLUTION: A multi-viewpoint image display system for displaying an image dependent on the viewpoint position of an observer includes a display device having a display section for displaying an image, and an optical control section for passing the light irradiated from the display section only in a specific direction, an image processing section displaying images for more than one viewpoints alternately for each pixel of the display section, shutter glasses attached to the observer and performing visibility control of the observer by open/close control, a position detector for detecting the viewpoint position of the observer, and an open/close control section of the shutter glasses in response to the viewpoint position.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a multi-view image display system and a multi-view image display program capable of presenting different images for each viewpoint position.

  A multi-viewpoint image display device that performs optical control by adding a lens array or a parallax barrier to a display unit and presents a different image for each viewpoint position is known. By using such a multi-viewpoint image display device, for example, a completely different image is presented depending on the observation position of the observer, or images with different observation angles of the same object are displayed in accordance with the observation position of the observer. It is possible to present a stereoscopic image in a pseudo manner without wearing special glasses such as 3D glasses.

  In recent years, the number of viewpoints to be generated is increased and the viewpoint can be moved not only in the horizontal direction but also in the vertical direction with respect to the display surface. It has become possible to present.

  However, in a multi-viewpoint image display device that does not use special glasses or the like, when the number of viewpoints to be generated is increased, the image resolution that can be observed from each viewpoint is lowered.

  FIG. 5 shows an example of a multi-viewpoint image display apparatus that can observe different images from two viewpoints. In this multi-viewpoint image display device, the image for the viewpoint A is distributed and displayed on the pixels A1 to A7 and the image for the viewpoint B is divided into the pixels B1 to B7, so that it can actually be observed from each viewpoint. The image resolution is halved.

  When the number of viewpoints is increased by this method, it is necessary to distribute the pixels of the display device by the number of viewpoints, and the image resolution decreases accordingly. For example, if the number of viewpoints is n, the image resolution that can be observed from each viewpoint is 1 / n.

  With respect to the above problem, Patent Document 1 attempts to solve the problem that the resolution is lowered by controlling the transmission position of the barrier portion in the parallax barrier method with time. However, this method is applicable only to the parallax barrier method, and has the disadvantage of the same method that an observed image becomes dark. Moreover, in order to apply this method, the subject that a special process is required for the display device itself also occurs.

JP 2011-158722 A

  It is an object of the present invention to increase the number of viewpoints regardless of the multi-viewpoint image display method and without reducing the image resolution that can be observed from each viewpoint without performing special processing on the display device itself. A viewpoint image display system and a multi-viewpoint image display program are provided.

  The multi-viewpoint image display system according to the present invention displays different images depending on the viewpoint position of an observer, and transmits a display unit that displays an image and light emitted from the display unit only in a specific direction. A display device having an optical control unit, an image processing unit that alternately displays two or more viewpoint images for each pixel of the display unit, and attached to the observer to perform visual control of the observer by opening / closing control The shutter glasses, a position detection unit that detects the viewpoint position of the observer, and an opening / closing control unit that opens and closes the shutter glasses according to the viewpoint position.

  A multi-viewpoint image display program according to the present invention is mounted on a viewer, a display device having a display unit that displays an image, an optical control unit that transmits light emitted from the display unit only in a specific direction, and an observer And displaying a multi-viewpoint image on a multi-viewpoint image display system including shutter glasses that perform visual control of an observer by opening / closing control and an imaging unit that captures the shutter glasses. The image processing means for alternately displaying two or more viewpoint images, the viewpoint position detecting means for detecting the viewpoint position of the observer based on the image photographed by the photographing means, and the shutter glasses according to the viewpoint position. It functions as an opening / closing control means for opening and closing.

  According to the present invention, it is possible to increase the number of viewpoints without reducing the resolution of images that can be observed from each viewpoint, regardless of the multi-viewpoint image display method and without performing special processing on the display device itself. A multi-viewpoint image display system and a multi-viewpoint image display program can be realized.

1 is a diagram illustrating a configuration of a multi-viewpoint image display system according to an embodiment. It is a figure which shows the structure of the multiview image display system after 1 frame of FIG. It is a figure which shows the image observed by each of 4 viewpoints for every time in the multi-viewpoint image display system which concerns on embodiment. It is a figure which shows the image observed by each of eight viewpoints for every time in the multi-viewpoint image display system which concerns on embodiment. It is a figure which shows an example of the conventional multiview image display system.

  Hereinafter, the present invention will be described through embodiments of the invention, but the following embodiments do not limit the invention according to the claims. In addition, not all the combinations of features described in the embodiments are essential for the solving means of the invention.

  1 and 2 are diagrams showing a configuration of a multi-viewpoint image display system 100 according to the present embodiment. FIG. 2 shows a state after one frame in FIG. 1, and when the update frequency of the display unit 10 is 60 Hz, the time is 1/60 seconds later. The multi-viewpoint image display system 100 continuously repeats the states of FIGS. 1 and 2.

  In the configuration of FIGS. 1 and 2, after the observer's observation viewpoint is detected in advance, optical control is performed so that only specific pixels are observed from each viewpoint, and shutter glasses 30 worn by the observer. In combination with the open / close control of the image, images for four viewpoints are displayed while the number of pixels distributed in the display device 12 is two. Details of the image display method will be described later.

  The display device 12 includes a display unit 10 that displays an image, and an optical control unit 11 that controls the direction of light emitted from the display unit 10. The display unit 10 may be a general display device such as a liquid crystal panel, and the optical control unit 11 may be a lenticular lens. The optical control unit 11 realizes multi-viewpoint image display by limiting the pixels that can be observed depending on the position of the viewpoint.

  The shutter glasses 30 are provided with light shielding means capable of opening and closing such as a liquid crystal shutter, and are mounted so as to cover the eyes of the observer. The shutter glasses 30 open and close the shutter in synchronization with switching of the display image on the display device 12 according to control by the opening / closing control unit 22 described later.

  The control device 40 includes an image processing unit 20, a position detection unit 21, and an opening / closing control unit 22. The control device 40 is configured by, for example, a computer including a CPU and a storage medium, and the CPU reads and executes a program stored in the storage medium, whereby the computer is processed by the image processing unit 20 and the position detection unit 21. And function as the open / close control unit 22.

  The image processing unit 20 holds four types of images to be presented to the viewpoints A to D. The viewpoint A image and the viewpoint D image are displayed in the state shown in FIG. 1, and the viewpoint B image is displayed in the state shown in FIG. And the image for the viewpoint C are alternately arranged for each display pixel and displayed on the display unit 10. The viewpoint A image and the viewpoint B image are preferably displayed on the same display pixel, and the viewpoint D image and the viewpoint C image are preferably displayed on the same display pixel. The arrangement of the display pixels may be changed according to the position.

  When the same display pixel is used for the viewpoint A image and the viewpoint B image, and for the viewpoint D image and the viewpoint C image, as shown in FIGS. The irradiated light passes through the optical control unit 11 so that the former is limited to the range where the viewpoints A and B are located, and the latter is limited to the range where the viewpoints C and D are located.

  The position detection unit 21 estimates the position of the observer's viewpoint based on the positional relationship between the display device 12 and the shutter glasses 30.

  As a method for estimating the position, for example, a gyro sensor or an acceleration sensor is mounted on the shutter glasses 30 and the positional relationship between the display device 12 and the shutter glasses 30 is set in advance, and the movement amount acquired by the sensor is used. There are a method of estimating the position, a method of estimating the position by performing wireless communication, and the like. However, it is possible to estimate the position by attaching light emitting means to the shutter glasses 30 and photographing with a photographing means such as a camera. preferable. In this case, the position detection unit 21 performs position estimation based on the position of the light emitting unit included in the image captured by the imaging unit 13.

  Examples of the light emitting means include general light emitting devices such as visible light and infrared light. As a photographing means, a general photographing device such as a multi-lens camera or an infrared camera can be applied. The installation position of the photographing means is preferably mounted on the display device 12, but can be installed separately from the display device 12. In that case, positional relationship information between the display device 12 and the photographing unit is stored in advance in the position detecting unit 21, and the position detecting unit 21 emits light included in the positional relationship information and the image photographed by the photographing unit 13. The position is estimated based on the position.

  The opening / closing control unit 22 performs opening / closing control of the shutter glasses 30 according to the viewpoint position of the observer detected by the position detection unit 21. The opening / closing control of the shutter glasses 30 is synchronized with the switching of the display image on the display unit 10. The opening / closing control unit 22 changes the opening / closing timing of the shutter glasses 30 according to the position detected by the position detection unit 21 and is detected. Light is transmitted only when the viewpoint image corresponding to the selected position is displayed.

  For example, in the state of FIG. 1, as described above, the viewpoint A image can be viewed from the range in which the viewpoint A and the viewpoint B are located, but the shutter glasses 30 for the viewpoint B are displayed at the timing when the viewpoint A image is displayed. Is closed, the viewpoint A image is actually visible only from the viewpoint A. Similarly, for the viewpoint C and the viewpoint D, the viewpoint D image can be visually recognized from the viewpoint C, but since the shutter glasses 30 of the viewpoint C are closed, only the viewpoint D can actually be viewed. It becomes.

  Next, the case where the state of FIG. 1 is switched to the state of FIG. 2 will be described.

  In the state of FIG. 2, the viewpoint B image is displayed from the display pixel displaying the viewpoint A image, and the viewpoint C image is displayed from the display pixel displaying the viewpoint D image. become. At the same timing as the display image switching, the shutter glasses for the viewpoints A and D are closed, and the shutter glasses for the viewpoints B and C are opened. As a result, the viewpoint B image can be viewed only from the viewpoint B, and the viewpoint C image can be viewed only from the viewpoint C.

  In addition, in order to reduce the problem that the pixels different from the original are observed due to the viewpoint position detection error, the pixels observed by the optical control unit 11 are separated, for example, the viewpoint B and the viewpoint C in FIGS. It is desirable to match the open / closed state at the selected viewpoint position.

  The image processing unit 20, the position detection unit 21, and the opening / closing control unit 22 may be provided in the same computer or may be provided in different computers. The image processing unit 20, the position detection unit 21, and the opening / closing control unit 22 may be provided in the display device 12, and the position detection unit 21 and / or the opening / closing control unit 22 are provided in the shutter glasses 30. May be. The display device 12, the shutter glasses 30, and the control device 40 are connected so as to be able to communicate with each other wirelessly or by wire.

  FIG. 3 shows images observed at each viewpoint for each time in the configuration of FIGS. 1 and 2. From each viewpoint, only the viewpoint images are observed, and it can be seen that an image having the same resolution as the image observed from the two viewpoints can be observed from the four viewpoints in FIG. dt is an image update interval of the display unit 10 and is 1/60 second when it is 60 Hz.

  FIG. 4 shows images observed at each viewpoint every time when the observable viewpoints are increased. By increasing the display cycle of the same viewpoint image displayed on the display unit 10 and the opening / closing cycle of the shutter glasses 30, it is possible to observe an image having the same resolution as that observed from two viewpoints in FIG. 5 from eight viewpoints. It turns out that it is. Thus, the number of viewpoints that can be observed is the product of the viewpoint number and the time division number by the optical control unit 11.

  According to the multi-viewpoint image display apparatus system 100 according to the present embodiment, an image processing unit that alternately displays two or more viewpoint images for each pixel of the display unit, and an observer that is mounted and observed by opening / closing control Multi-viewpoint image display with the naked eye by providing shutter glasses that perform visual control of the viewer, a position detection unit that detects the viewpoint position of the observer, and an open / close control unit that opens and closes the shutter glasses according to the viewpoint position It is possible to increase the number of viewpoints without reducing the resolution of an image that can be observed from each viewpoint, regardless of the method and without performing special processing on the display device itself.

  The multi-viewpoint image display system and the multi-viewpoint image display program according to the present invention are not limited to the multi-viewpoint image display method with the naked eye, and the image that can be observed from each viewpoint is not subjected to special processing. The present invention can be used in a multi-viewpoint image display system that can increase the number of viewpoints without reducing the resolution.

DESCRIPTION OF SYMBOLS 10 ... Display part 11 ... Optical control part 12 ... Display apparatus 20 ... Image processing part 21 ... Position detection part 22 ... Opening / closing control part 30 ... · Shutter glasses 40 · · · Control device 100 · · · Multi-viewpoint image display system

Claims (6)

A multi-viewpoint image display system that displays different images depending on the viewpoint position of an observer,
A display device having a display unit that displays an image, and an optical control unit that transmits light emitted from the display unit only in a specific direction;
An image processing unit that alternately displays two or more viewpoint images for each pixel of the display unit;
Shutter glasses that are attached to the observer and perform visual control of the observer by opening and closing control,
A position detection unit for detecting the observer's viewpoint position;
An opening / closing control unit for opening / closing the shutter glasses according to the viewpoint position;
A multi-viewpoint image display system comprising:   The multi-viewpoint according to claim 1, wherein the opening / closing control unit opens and closes the shutter glasses in synchronization with a timing of switching display of the two or more viewpoint images on the display unit. Image display system. Photographing means;
A light emitting means provided in the shutter glasses,
The said viewpoint position detection means detects the viewpoint position of the said observer based on the position of the said light emission means contained in the image image | photographed by the said imaging | photography means, The said observer position is characterized by the above-mentioned. Multi-viewpoint image display system.   The multi-viewpoint image display system according to claim 3, wherein the photographing unit is provided in the display device.   5. The optical control unit according to claim 1, wherein the optical control unit is a lens array or a parallax barrier, and can generate a plurality of viewpoints in the horizontal direction, the vertical direction, or both with respect to the display unit. The multi-viewpoint image display system described. A display device that has a display unit that displays an image and an optical control unit that transmits light emitted from the display unit only in a specific direction, and is attached to the observer, and performs visual control of the observer by opening and closing control. A multi-viewpoint image display program for displaying a multi-viewpoint image on a multi-viewpoint image display system including shutter glasses and photographing means for photographing the shutter glasses,
The multi-viewpoint image display program causes the computer to alternately display two or more viewpoint images for each pixel of the display unit;
Viewpoint position detection means for detecting the viewpoint position of the observer based on the image captured by the imaging means;
A multi-viewpoint image display program that functions as an opening / closing control unit that opens and closes the shutter glasses according to the viewpoint position.

Images