WO2021181935A1

WO2021181935A1 - Information processing device, control method, and information processing program

Info

Publication number: WO2021181935A1
Application number: PCT/JP2021/003200
Authority: WO
Inventors: 優斗小林; 紀晃高橋; 孝明鈴木
Original assignee: ソニーグループ株式会社
Priority date: 2020-03-10
Filing date: 2021-01-29
Publication date: 2021-09-16

Abstract

This information processing device (100) comprises: a barrier unit in which light shielding areas and slits are alternately arrayed; and a width control unit (153) which controls the widths of the light shielding areas. The width control unit (153) controls, on the basis of each of viewpoint positions of two or more observers of a display device 120 for displaying a stereoscopic image, the widths of the light shielding areas which shield light propagating from the display device 120 to each of the viewpoint positions of the two or more observers.

Description

Information processing device, control method and information processing program

The present invention relates to an information processing device, a control method, and an information processing program.

Conventionally, various technologies for displaying a stereoscopic image on a display have been proposed. For example, a parallax barrier method and a lenticular lens method are known as a method for displaying a stereoscopic image by the naked eye without using a tool such as eyeglasses. In a stereoscopic image display device that employs these methods, a device for displaying a stereoscopic image such as a parallax barrier or a lenticular lens is superimposed on an image display panel that displays a parallax image for stereoscopic vision, and the binocular parallax is used. Make the observer see the stereoscopic image.

Japanese Unexamined Patent Publication No. 2016-161912

By the way, in recent years, when one display is observed by a plurality of observers, it is expected that each observer can see the display stereoscopically.

Therefore, the present disclosure proposes an information processing device, a control method, and an information processing program capable of displaying a stereoscopic image to a plurality of observers.

In order to solve the above problems, the information processing device of one form according to the present disclosure includes a barrier unit in which light-shielding regions and slits are alternately arranged, and a width control unit for controlling the width of the light-shielding region. The width control unit blocks the light propagating from the display device to the viewpoint positions of the two or more observers based on the viewpoint positions of the two or more observers of the display device displaying the stereoscopic image. Control the width of the area.

It is explanatory drawing for demonstrating binocular parallax and motor parallax. It is explanatory drawing for demonstrating the method of reproducing the motion parallax which concerns on the prior art. It is explanatory drawing for demonstrating the method of reproducing the motion parallax which concerns on the prior art. It is explanatory drawing for demonstrating the outline of information processing which concerns on embodiment of this disclosure. It is a block diagram which shows the function of the information processing apparatus which concerns on embodiment. It is a block diagram which shows the structure of the information processing apparatus which concerns on embodiment. It is a graph which shows the relationship between the distance between observers which concerns on embodiment, and the observation competition rate for each pitch of a slit. It is a graph which shows the relationship between the distance between observers which concerns on embodiment, and the minimum value of the observation competition rate for each slit pitch. It is a flowchart which shows the information processing procedure which concerns on embodiment. It is explanatory drawing for demonstrating the modification which concerns on embodiment. It is a hardware block diagram which shows an example of the computer which reproduces the function of an information processing apparatus.

Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings. In each of the following embodiments, the same parts are designated by the same reference numerals, so that duplicate description will be omitted.

The present disclosure will be described according to the order of the items shown below.
1. 1. Introduction 1-1. Binocular parallax and motor parallax 1-2. Method for reproducing motion parallax according to the prior art 1-2-1. Range of view A method of displaying different parallax images at all viewpoints at the same time 1-2-2. How to switch the parallax image according to the viewpoint position of the observer 2. Embodiment 2-1. Outline of information processing 2-2. Information processing device functions 2-3. Configuration of information processing device 2-4. Relationship between distance between observers and observation competition rate 2-5. Information processing procedure 2-6. Modification example 3. Effect of this disclosure 4. Hardware configuration

[1. Introduction]
[1-1. Binocular parallax and motor parallax]
First, binocular parallax and motor parallax will be described with reference to FIG. FIG. 1 is an explanatory diagram for explaining binocular parallax and motor parallax. In the example shown in FIG. 1, an observer observes a lighting fixture O2 which is a three-dimensional object and a sofa O1 which is a three-dimensional object located behind the lighting fixture O2.

First, the binocular parallax will be explained. Since the human eye is attached to the left and right, when a certain object is viewed with both eyes, an image of the object slightly displaced in the horizontal direction is projected on the retinas of the left and right eyes. This deviation is called binocular parallax. Humans perceive an object as a deep three-dimensional object by processing binocular parallax in the brain. In this way, binocular parallax causes stereoscopic perception due to the difference in the appearance of the left and right eyes.

In the example shown in the center of FIG. 1, when the observer observes the luminaire O2 and the sofa O1 located behind the luminaire O2 from the front direction, the retina of the observer's right eye is in front of the sofa O1. The image G14 in which the lighting fixture O2 is located is projected on the left end. Further, an image G13 in which the position of the lighting fixture O2 is located to the right of the sofa O1 is projected on the retina of the observer's left eye as compared with the image G14. Then, the observer perceives the luminaire O2 and the sofa O1 located behind the luminaire O2 as a three-dimensional object with depth by processing the image G13 of the left eye and the image G14 of the right eye in the brain. ..

Next, the motion parallax will be explained. When a moving observer is gazing at an object, an object farther than the gaze object appears to be moving in the same direction as the observer, and an object closer than the gaze object is. , Seems to be moving in the opposite direction to the observer. This is called motor parallax. Humans perceive an object as a deep three-dimensional object by processing motion parallax in the brain. In this way, motion parallax causes stereoscopic perception by moving the positions of the left and right eyes (viewpoint positions).

Further, in the example shown on the left side of FIG. 1, when an observer at a position displaced from the front of the display device to the left by a predetermined distance is gazing at the sofa O1, it is closer than the sofa O1 to be gazed at ( The luminaire O2 in the foreground) appears to be moving to the right opposite to the observer's moving direction. For example, an image G12 in which the position of the luminaire O2 is located to the right of the sofa O1 is projected on the retina of the observer's right eye as compared with the image G14 of the right eye observed from the front direction. Further, on the retina of the left eye of the observer, an image G11 in which the position of the luminaire O2 is located to the right of the sofa O1 is projected as compared with the image G13 of the left eye observed from the front direction.

Further, in the example shown on the right side of FIG. 1, when an observer at a position displaced from the front of the display device to the right by a predetermined distance is gazing at the sofa O1, it is closer than the sofa O1 to be gazed at ( The luminaire O2 in the foreground) appears to be moving to the left, which is opposite to the observer's moving direction. For example, an image G16 in which the position of the luminaire O2 is located to the left of the sofa O1 is projected on the retina of the observer's right eye as compared with the image G14 of the right eye observed from the front direction. Further, on the retina of the left eye of the observer, an image G15 in which the position of the luminaire O2 is located to the left with respect to the sofa O1 is projected as compared with the image G13 of the left eye observed from the front direction.

As described above, humans perceive a solid not only by binocular parallax but also by motion parallax caused by the movement of the viewpoint position. Therefore, if the stereoscopic image display method can reproduce not only the stereoscopic perception by binocular parallax but also the stereoscopic perception by motion parallax, the observer can feel the stereoscopic perception closer to reality. Therefore, conventionally, in a stereoscopic image display method, a method of reproducing motion parallax in addition to binocular parallax has been known. Hereinafter, a method for reproducing motion parallax according to the prior art will be described.

[1-2. Reproduction method of motion parallax according to the prior art]
[1-2-1. How to display different parallax images at the same time for all viewpoints in the range of the field of view]
Next, a method of reproducing motion parallax according to the prior art will be described with reference to FIG. FIG. 2 is an explanatory diagram for explaining a method of reproducing motion parallax according to the prior art. FIG. 2 describes a method in which a display device (hereinafter, also referred to as a display device) that displays a stereoscopic image by a parallax barrier method reproduces motion parallax.

FIG. 2 is a top view of a display device using the parallax barrier method. As shown in FIG. 2, a display device using the parallax barrier method is composed of a display panel (hereinafter, also referred to as an image panel) for displaying an image for stereoscopic viewing and a parallax barrier.

The parallax barrier has a function of blocking the light propagating from the display panel displaying the stereoscopic image to the viewpoint position of the observer. Specifically, the parallax barrier is a striped pattern in which slits and light-shielding regions (barriers) are alternately arranged. More specifically, the parallax barrier may be realized by a light-shielding plate in which slits and light-shielding areas are alternately provided. Moreover, the parallax barrier may be realized by an image. For example, the parallax barrier may be realized by a black striped image corresponding to the shading area.

Further, the image display panel has a plurality of vertically long parallax images (for example, a parallax image corresponding to the viewpoint position of the left eye and a parallax image corresponding to the viewpoint position of the right eye) for each of two or more viewpoint positions. It is divided into sliced images, and the sliced images for each divided viewpoint position are displayed alternately side by side. The parallax barrier is placed in front of the image display panel. The observer of the display device observes the display panel through the slit row of the parallax barrier. Then, since the line-of-sight angle of the observer passing through the slit is different between both eyes, the observer's left eye observes only the parallax image for the left eye, and the observer's right eye observes only the parallax image for the right eye. do. In this way, the display device using the parallax barrier method creates binocular parallax by utilizing the fact that the line-of-sight angle of the observer passing through the slit of the parallax barrier is different between the two eyes, and the viewer can see the parallax. Produces stereoscopic perception.

Return to the explanation in Fig. 2. In FIG. 2, the display device displays a parallax image corresponding to all viewpoint positions so that different stereoscopic images can be visually recognized at the same time from all viewpoint positions included in a visible range (hereinafter, also referred to as a viewing area). Display on the display panel all at once. In the example shown in FIG. 2, the viewing range of the display device includes the viewpoint positions for eight viewpoints.

Further, the display device displays the parallax images for the eight viewpoints generated by photographing the lighting fixture O2 shown in FIG. 1 and the sofa O1 located at the back of the lighting fixture O2 from different eight viewpoints on the display panel. Specifically, the display device divides each parallax image for each viewpoint position into a plurality of vertically long slice images, and displays the divided slice images for each viewpoint position alternately on the display panel. For example, as shown in the central portion of the display panel of FIG. 2, the display device displays slice images a to h of the parallax images for eight viewpoints from the left a, b, c, d, e, f, g, h. Display them in order on the display panel.

In the example shown in the center of FIG. 2, the display device displays a parallax image G24 (the same image as the image G14 shown in FIG. 1) corresponding to the viewpoint position of the right eye of the observer who observes the display device from the front direction on the display panel. indicate. More specifically, the display device divides the parallax image G24 into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every eight slice images. For example, the display device displays the slice image d of the parallax image G24 on the display panel. At this time, the right eye of the observer who observes the display device from the front side observes the slice image of the parallax image G24 including the slice image d through the slit. The observer's right eye visually recognizes the parallax image G24 by processing the sliced image of the observed parallax image G24 in the brain.

Further, the display device displays a parallax image G23 (the same image as the image G13 shown in FIG. 1) corresponding to the viewpoint position of the left eye of the observer who observes the display device from the front direction on the display panel. More specifically, the display device divides the parallax image G23 into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every eight slice images. For example, the display device displays the slice image e of the parallax image G23 on the display panel. At this time, the left eye of the observer who observes the display device from the front direction observes the slice image of the parallax image G23 including the slice image e through the slit. The left eye of the observer visually recognizes the parallax image G23 by processing the sliced image of the observed parallax image G23 in the brain.

In this way, the display device reproduces the stereoscopic perception by binocular parallax by having the observer simultaneously observe the parallax image G24 of the right eye and the parallax image G23 of the left eye.

Further, in the example shown on the left side of FIG. 2, the display device is a differential image G22 corresponding to the viewpoint position of the right eye of the observer who observes the display device from a position displaced from the front of the display device to the left by a predetermined distance. (The same image as the image G12 shown in FIG. 1) is displayed on the display panel. More specifically, the display device divides the parallax image G22 into a plurality of vertically long slice images, and displays the divided slice images in an arrangement every eight slice images on the display panel. For example, the display device displays the slice image g of the parallax image G22 on the display panel. At this time, the right eye of the observer observing the display device from a position displaced from the front of the display device to the left by a predetermined distance observes the slice image of the parallax image G22 including the slice image g through the slit. The observer's right eye visually recognizes the parallax image G22 by processing the sliced image of the observed parallax image G22 in the brain.

Further, the display device is a parallax image G21 (same as the image G11 shown in FIG. 1) corresponding to the viewpoint position of the left eye of the observer who observes the display device from a position displaced from the front of the display device to the left by a predetermined distance. Image) is displayed on the display panel. More specifically, the display device divides the parallax image G21 into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every eight slice images. For example, the display device displays the slice image h of the parallax image G21 on the display panel. At this time, the left eye of the observer observing the display device from a position displaced from the front of the display device to the left by a predetermined distance observes the slice image of the parallax image G21 including the slice image h through the slit. The left eye of the observer visually recognizes the parallax image G21 by processing the sliced image of the observed parallax image G21 in the brain.

In this way, the display device corresponds to the movement of the viewpoint from the front of the display device to the left with respect to the observer observing the display device from a position displaced by a predetermined distance from the front of the display device to the left. By simultaneously observing the parallax image G22 of the eye and the parallax image G21 of the left eye, stereoscopic perception due to motion parallax is reproduced.

Further, in the example shown on the right side of FIG. 2, the display device is a parallax image G26 corresponding to the viewpoint position of the right eye of the observer who observes the display device from a position displaced by a predetermined distance from the front of the display device to the right. (The same image as the image G16 shown in FIG. 1) is displayed on the display panel. More specifically, the display device divides the parallax image G26 into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every eight slice images. For example, the display device displays the slice image a of the parallax image G26 on the display panel. At this time, the right eye of the observer observing the display device from a position displaced from the front of the display device to the right by a predetermined distance observes the slice image of the parallax image G26 including the slice image a through the slit. The observer's right eye visually recognizes the parallax image G26 by processing the sliced image of the observed parallax image G26 in the brain.

Further, the display device is a parallax image G25 (same as the image G15 shown in FIG. 1) corresponding to the viewpoint position of the left eye of the observer who observes the display device from a position displaced from the front of the display device to the right by a predetermined distance. Image) is displayed on the display panel. More specifically, the display device divides the parallax image G25 into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every eight slice images. For example, the display device displays the slice image b of the parallax image G25 on the display panel. At this time, the left eye of the observer observing the display device from a position displaced from the front of the display device to the right by a predetermined distance observes the slice image of the parallax image G25 including the slice image b through the slit. The left eye of the observer visually recognizes the parallax image G25 by processing the sliced image of the observed parallax image G25 in the brain.

In this way, the display device corresponds to the movement of the viewpoint from the front of the display device to the right with respect to the observer observing the display device from a position displaced by a predetermined distance from the front of the display device to the right. By simultaneously observing the parallax image G26 of the eye and the parallax image G25 of the left eye, stereoscopic perception by motion parallax is reproduced.

Of the parallax images for the eight viewpoints in FIG. 2, the illustration and description of the parallax images for the remaining two viewpoints will be omitted.

The display device shown in FIG. 2 has a drawback that the number of pixels allocated to one viewpoint is small because the amount of image information displayed at the same time is large. That is, the display device shown in FIG. 2 has a drawback that the resolution per viewpoint visually recognized by the observer is low. In other words, the display device shown in FIG. 2 requires an ultra-high resolution display panel in order to cover the drawback that the resolution per viewpoint viewed by the observer is low.

[1-2-2. How to switch the parallax image according to the viewpoint position of the observer]
Next, a method of reproducing motion parallax according to the prior art will be described with reference to FIG. FIG. 3 is an explanatory diagram for explaining a method of reproducing motion parallax according to the prior art. FIG. 3 describes another method in which the display device reproduces motion parallax by the parallax barrier method. The display device shown in FIG. 3 is a display device shown in FIG. 2 in that the parallax image is displayed according to the viewpoint position of the observer instead of simultaneously displaying the parallax image corresponding to all the viewpoint positions included in the visual range. Different from.

FIG. 3 is a top view of the display device. The point that the display device is composed of the display panel and the parallax barrier and the point that the parallax barrier is arranged in front of the display panel are the same as those in FIG. The display device shown in FIG. 3 differs from the display device of FIG. 2 in that it includes a tracker for detecting the viewpoint position of the observer.

Further, the display device displays the parallax images for the two viewpoints generated by photographing the lighting fixture O2 shown in FIG. 1 and the sofa O1 located behind the lighting fixture O2 from different viewpoints on the display panel. The display device displays on the display panel parallax images for two viewpoints according to the viewpoint position of the observer detected by the tracker. For example, the display device divides the generated parallax image into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every two slice images.

For example, as shown on the left side of FIG. 3, the display device is a parallax image G33 (image G13 shown in FIG. 1) corresponding to the viewpoint position of the observer's left eye when the observer is located in front of the display device. (Same image as) is displayed on the display panel. More specifically, the display device divides the parallax image G33 into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every two slice images. For example, the display device displays the slice image e of the parallax image G33 on the display panel. At this time, the left eye of the observer who observes the display device from the front of the display device observes the slice image of the parallax image G33 including the slice image e through the slit. The left eye of the observer visually recognizes the parallax image G33 by processing the sliced image of the observed parallax image G33 in the brain.

Further, when the observer is located in front of the display device, the display device is a parallax image G34 (same as the image G14 shown in FIG. 1) corresponding to the viewpoint position of the right eye of the observer located in front of the display device. Image) is displayed on the display panel. More specifically, the display device divides the parallax image G34 into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every two slice images. For example, the display device displays the slice image d of the parallax image G34 on the display panel. At this time, the right eye of the observer who observes the display device from the front of the display device observes the slice image of the parallax image G34 including the slice image d through the slit. The observer's right eye visually recognizes the parallax image G34 by processing the sliced image of the observed parallax image G34 in the brain.

As described above, when the observer is located in front of the display device, the display device simultaneously displays the parallax image G34 of the right eye and the parallax image G33 of the left eye with respect to the observer located in front of the display device. By observing, stereoscopic perception by binocular parallax is reproduced.

On the other hand, as shown on the right side of FIG. 3, when the observer is located at a position displaced by a predetermined distance from the front of the display device to the right, the display device is predetermined from the front of the display device to the right. A parallax image G35 (the same image as the image G15 shown in FIG. 1) corresponding to the viewpoint position of the left eye of the observer located at a position displaced by a distance is displayed on the display panel. More specifically, the display device divides the parallax image G35 into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every two slice images. For example, the display device displays the slice image b of the parallax image G35 on the display panel. At this time, the left eye of the observer observing the display device from a position displaced from the front of the display device to the right by a predetermined distance observes the slice image of the parallax image G35 including the slice image b through the slit. The left eye of the observer visually recognizes the parallax image G35 by processing the sliced image of the observed parallax image G35 in the brain.

Further, when the observer is located at a position displaced by a predetermined distance from the front of the display device to the right, the display device is located at a location displaced by a predetermined distance from the front of the display device to the right. A displacement image G36 (the same image as the image G16 shown in FIG. 1) corresponding to the viewpoint position of the right eye of the person is displayed on the display panel. More specifically, the display device divides the parallax image G36 into a plurality of vertically long slice images, and displays the divided slice images on the display panel by arranging them every two slice images. For example, the display device displays the slice image a of the parallax image G36 on the display panel. At this time, the right eye of the observer observing the display device from a position displaced from the front of the display device to the right by a predetermined distance observes the slice image of the parallax image G36 including the slice image a through the slit. The observer's right eye visually recognizes the parallax image G36 by processing the sliced image of the observed parallax image G36 in the brain.

In this way, the display device corresponds to the movement of the viewpoint from the front of the display device to the right with respect to the observer observing the display device from a position displaced by a predetermined distance from the front of the display device to the right. By simultaneously observing the parallax image G36 of the eye and the parallax image G35 of the left eye, stereoscopic perception by motion parallax is reproduced.

Unlike the display device shown in FIG. 2, the display device shown in FIG. 3 does not require an ultra-high resolution display panel because it only needs to display parallax images for two viewpoints corresponding to the viewpoint positions detected by the tracker. Is. However, the display device shown in FIG. 3 has a drawback that it can reproduce stereoscopic perception by binocular parallax and motion parallax only for one observer. In other words, the display device shown in FIG. 3 has a drawback that it cannot simultaneously reproduce stereoscopic perception due to binocular parallax and motion parallax for a plurality of observers.

[2. Embodiment]
[2-1. Information processing overview]
Next, the outline of the information processing according to the embodiment of the present disclosure will be described with reference to FIG. FIG. 4 is an explanatory diagram for explaining an outline of information processing according to the embodiment of the present disclosure. In the example shown in FIG. 4, the information processing device 100 shown in FIG. 5 described later controls the width of the parallax barrier based on the viewpoint positions of the two observers (U1 and U2) of the display device.

The display device shown in FIG. 4 displays a stereoscopic image by a parallax barrier method. The display device shown in FIG. 4 has a configuration in which two layers of liquid crystal panels are laminated. Of the two-layer liquid crystal panel, one liquid crystal panel (hereinafter, also referred to as an image panel) corresponds to an image for stereoscopic viewing, and the other liquid crystal panel (hereinafter, also referred to as a barrier panel) corresponds to a parallax barrier. Used to display an image.

In the example shown on the left side of FIG. 4, the information processing apparatus 100 displays a barrier for four viewpoints on the barrier panel. Further, the information processing apparatus 100 displays the parallax images for the four viewpoints generated by photographing from the four different viewpoints on the display panel. Specifically, the information processing apparatus 100 calculates the width of the slice image when dividing each parallax image for each viewpoint position into a plurality of vertically long slice images based on the barrier width of the barrier for four viewpoints. do. Subsequently, the information processing device 100 divides the parallax image for each viewpoint position into slice images having a calculated width. Subsequently, the information processing apparatus 100 alternately arranges sliced images for each divided viewpoint position and displays them on the display panel. Here, it is assumed that the image panel has a resolution for four viewpoints, which is sufficient for displaying a slice image divided into long strips for four viewpoints.

Specifically, the information processing device 100 displays the parallax image A corresponding to the viewpoint position of the left eye of the observer U1 located in front of the display device on the display panel. More specifically, the information processing apparatus 100 divides the parallax image A into slice images having a width for a plurality of four viewpoints long in the vertical direction, and displays the divided slice images in the display panel by arranging them every four slice images. do. For example, the information processing apparatus 100 _{arranges the slice images A 1} , A ₂ , A ₃ , A ₄ , ... Of the parallax image A every four slice images and displays them on the image panel.

Further, the information processing device 100 displays the parallax image B corresponding to the viewpoint position of the right eye of the observer U1 located in front of the display device on the display panel. More specifically, the information processing apparatus 100 divides the parallax image B into slice images having a width for a plurality of four viewpoints that are long in the vertical direction, and displays the divided slice images in the display panel by arranging them every four slice images. do. For example, the information processing apparatus 100 has sliced images B ₁ , B ₂ , B ₃ , B ₄ , ... Of the parallax image B, and slice images A ₁ , A ₂ , A ₃ , A ₄ , ... of the parallax image A, respectively. Display them on the image panel side by side on the right.

Further, the information processing device 100 displays a parallax image C corresponding to the viewpoint position of the left eye of the observer U2 who observes the display device from a position displaced from the front of the display device to the right by a predetermined distance on the display panel. .. More specifically, the information processing apparatus 100 divides the parallax image C into slice images having a width for a plurality of four viewpoints that are long in the vertical direction, and displays the divided slice images in the display panel by arranging them every four slice images. do. For example, the information processing apparatus 100 places the slice images C ₁ , C ₂ , C ₃ , ... Of the parallax image C on the right side of each of _{the slice images B 1} , B ₂ , B ₃ , B _{4, ... of the parallax image B.} Display them side by side on the image panel.

Further, the information processing device 100 displays a parallax image D corresponding to the viewpoint position of the right eye of the observer U2 who observes the display device from a position displaced to the right by a predetermined distance from the front of the display device on the display panel. .. More specifically, the information processing apparatus 100 divides the parallax image D into slice images having a width for a plurality of four viewpoints long in the vertical direction, and displays the divided slice images in the display panel by arranging them every four slice images. do. For example, the information processing apparatus 100 _{arranges the slice images D 1} , D ₂ , D ₃ , ... Of the parallax image _{D to the right of the slice images C 1} , C ₂ , C ₃ , ... of the parallax image C for the image. Display on the panel.

By the way, as shown on the left side of FIG. 4, when a plurality of observers observe the display device at the same time, when the viewpoint position of the first observer U1 is determined, the second observer U2 becomes the observer U1. The viewpoint position where different stereoscopic images can be visually recognized is limited.

For example, the left eye of the viewer U1 observing the display panel through the barrier for four viewpoints from the front of the display device, the slice image A ₁ of the parallax image A including a slice image A _{_2,} A 2, _A _3, A ₄ Observe ,. Further, the observer U1 visually recognizes the parallax image A by processing _{the slice images A 1} , A ₂ , A ₃ , A ₄ , ... Of the observed parallax image A in the brain.

The right eye of the viewer U1 observing the display panel through the barrier for four viewpoints from the front of the display device, the slice image B ₁ of the parallax image B including a slice image B _{_2,} B 2, _B _3, B ₄ Observe ,. Further, the observer U1 visually recognizes the parallax image B by processing _{the slice images B 1} , B ₂ , B ₃ , B ₄ , ... Of the observed parallax image B in the brain.

At this time, the viewpoint positions at which the second observer U2 can observe an image different from that of the observer U1 are the slice images C ₁ , C ₂ , C ₃ , ... Of the parallax image _{C and the slice image D 1 of} the parallax image D. It is limited to the viewpoint position where _{D 2} , D _{3, ... Can be observed.} Therefore, the viewpoint position of the second observer U2 can observe the slice images C ₁ , C ₂ , C ₃ , ... Of the parallax image _{C and the slice images D 1} , D ₂ , D ₃ , ... Of the parallax image D. When it deviates from the viewpoint position, it becomes difficult for the information processing apparatus 100 to visually recognize different stereoscopic images for two observers. Therefore, when the information processing apparatus 100 cannot make two observers visually recognize different stereoscopic images with the barrier for four viewpoints and the parallax image for four viewpoints, the barrier and the display image are used for the five viewpoints. Switch.

In the example shown on the right side of FIG. 4, the information processing apparatus 100 displays a barrier for five viewpoints on the barrier panel. Further, the information processing apparatus 100 displays the parallax images for the five viewpoints generated by photographing from the five different viewpoints on the display panel. Specifically, the information processing apparatus 100 calculates the width of the slice image when dividing each parallax image for each viewpoint position into a plurality of vertically long slice images based on the barrier width of the barrier for five viewpoints. do. Subsequently, the information processing device 100 divides the parallax image for each viewpoint position into slice images having a calculated width. Subsequently, the information processing apparatus 100 alternately arranges sliced images for each divided viewpoint position and displays them on the display panel. Here, it is assumed that the image panel has a resolution for five viewpoints, which is sufficient for displaying a sliced image divided into long strips for five viewpoints.

Specifically, the information processing device 100 divides the parallax image E corresponding to the viewpoint position of the left eye of the observer U1 located in front of the display device into slice images having a width for a plurality of five viewpoints long in the vertical direction. Then, the divided slice images are arranged every 5 slice images and displayed on the display panel. For example, the information processing apparatus 100 _{arranges the slice images E 1} , E ₂ , E ₃ , ... Of the parallax image E every 5 slice images and displays them on the image panel.

Further, the information processing device 100 divides the parallax image F corresponding to the viewpoint position of the right eye of the observer U1 located in front of the display device into a plurality of slice images having a width for five viewpoints long in the vertical direction and divides the image F. The sliced images are arranged every 5 sliced images and displayed on the display panel. For example, the information processing apparatus 100 _{arranges the slice images F 1} , F ₂ , F ₃ , ... Of the parallax image F on the right side of each of _{the slice images E 1} , E ₂ , E _{3, ... of the parallax image E for the image.} Display on the panel.

Further, the information processing device 100 has a plurality of vertically long parallax images G corresponding to the first viewpoint position of the observer who observes the display device from a position displaced from the front of the display device to the right by a predetermined distance. It is divided into slice images with a width of 5 viewpoints, and the divided slice images are arranged every 5 slice images and displayed on the display panel. For example, the information processing apparatus 100 _{arranges the slice images G 1} , G ₂ , G ₃ , ... Of the parallax image _{G on the right side of the slice images F 1} , F ₂ , F ₃ , ... of the parallax image F for the image. Display on the panel.

Further, the information processing device 100 has a plurality of vertically long parallax images H corresponding to the second viewpoint position of the observer who observes the display device from a position displaced from the front of the display device to the right by a predetermined distance. It is divided into slice images with a width of 5 viewpoints, and the divided slice images are arranged every 5 slice images and displayed on the display panel. For example, the information processing apparatus 100 _{arranges the slice images H 1} , H ₂ , H ₃ , ... Of the parallax image H to the right of each of _{the slice images G 1} , G ₂ , G _{3, ...} Display on the panel.

Further, the information processing device 100 has a plurality of vertically long parallax images I corresponding to the third viewpoint position of the observer who observes the display device from a position displaced from the front of the display device to the right by a predetermined distance. It is divided into slice images with a width of 5 viewpoints, and the divided slice images are arranged every 5 slice images and displayed on the display panel. For example, the information processing apparatus 100 _{arranges the slice images I 1} , I ₂ , I ₃ , ... Of the parallax image I on the right side of each of _{the slice images H 1} , H ₂ , H _{3, ... of the parallax image H for the image.} Display on the panel.

Here, the left eye of the viewer U1 observing the display panel through the barrier for five viewpoints from the front of the display device, a slice image of the parallax image E containing slice image E ₂ E _1, E 2, _E _3, E _{Observe 4} , ... Further, the observer U1 visually recognizes the parallax image E by processing _{the slice images E 1} , E ₂ , E ₃ , E ₄ , ... Of the observed parallax image E in the brain.

The right eye of the viewer U1 observing the display panel through the barrier for five viewpoints from the front of the display device, slice images F parallax image F comprising slice images F ₂ _1, F 2, _F _3, F ₄ Observe ,. Further, the observer U1 visually recognizes the parallax image F by processing _{the slice images F 1} , F ₂ , F ₃ , F ₄ , ... Of the observed parallax image F in the brain.

At this time, the viewpoint positions where the second observer U2 can observe an image different from that of the first observer U1 are the slice images C ₁ , C ₂ , C ₃ , of the parallax image C when the parallax image C is for four viewpoints. ... and the slice images D ₁ , D ₂ , D ₃ , ... And the parallax image D from the viewpoint position where (1) the slice images G ₁ , G ₂ , G ₃ , ... And the parallax image H can be observed. Images H ₁ , H ₂ , H ₃ , ..., Or (2) Slice images of parallax image H H ₁ , H ₂ , H ₃ , ... And slice images of parallax image I I ₁ , I ₂ , I ₃ , ... It changes to the viewpoint position where you can observe. That is, as the information processing apparatus 100 switches the barrier and the display image from the four viewpoints to the five viewpoints, the viewpoint positions where the second observer U2 can observe an image different from that of the first observer U1 have increased. You can see that.

In this way, the information processing device 100 controls the barrier width and the displayed image based on the viewpoint positions of the plurality of observers. As a result, the information processing apparatus 100 can make a plurality of observers observe different stereoscopic images at the same time. Further, since the information processing device 100 can make a plurality of observers observe different stereoscopic images at the same time, for example, it is possible to simultaneously reproduce the motion parallax according to each position for a plurality of observers. can. Therefore, the information processing device 100 can display a stereoscopic image to a plurality of observers.

Further, the information processing device 100 can display a stereoscopic image to a plurality of observers with the minimum necessary resolution (the number of pixels corresponding to the number of viewpoints corresponding to the number of observers). For example, when there are two observers, the information processing apparatus 100 can reproduce binocular parallax and motion parallax for two people at the same time by using a display panel having a resolution of 4 to 6 viewpoints. Therefore, the information processing apparatus 100 is more efficient for a plurality of observers than the conventional method using a fixed width barrier by controlling the variable width barrier according to the viewpoint positions of the plurality of observers. A stereoscopic image can be displayed.

[2-2. Information processing device functions]
Next, the function of the information processing apparatus according to the embodiment will be described with reference to FIG. FIG. 5 is a block diagram showing the functions of the information processing apparatus according to the embodiment.

The observer position sensing unit shown in FIG. 5 detects the positions (viewpoint positions) of the left and right eyes of each of two or more observers (hereinafter, also referred to as a plurality of observers) of the display device that displays a stereoscopic image. For example, the observer position sensing unit detects the viewpoint position of each of the plurality of observers using a tracker. Subsequently, the observer position sensing unit identifies the left and right eye positions (viewpoint positions) of each of the plurality of observers based on the detection results of detecting the eye positions of the plurality of observers. For example, the observer position sensing unit specifies information such as the eye position of a plurality of observers and the distance from the display device based on the detection result, and the viewpoint position of each of the plurality of observers based on the specified information. To identify. Subsequently, when the observer position sensing unit specifies the viewpoint position of each of the plurality of observers, the observer position sensing unit acquires the position information (viewpoint position information) of the viewpoint position of each of the specified plurality of observers.

The slice image drawing unit acquires the viewpoint position information of each of the plurality of observers from the observer position sensing unit. Subsequently, the slice image drawing unit generates a parallax image corresponding to each of the viewpoint positions of the plurality of observers based on the viewpoint position information of each of the plurality of observers. For example, the slice image drawing unit generates a parallax image for the left eye corresponding to the viewpoint position of the left eye of each of the plurality of observers. Further, the slice image drawing unit generates a parallax image for the right eye corresponding to the viewpoint position of the right eye of each of the plurality of observers.

The image panel / barrier panel display image calculation unit (hereinafter, also referred to as the calculation unit) acquires the viewpoint position information of each of the plurality of observers from the observer position sensing unit. Subsequently, the calculation unit calculates the information of the barrier image displayed by the barrier panel based on the acquired viewpoint position information of each of the plurality of observers. Specifically, the calculation unit controls the width of the barrier displayed by the barrier panel based on the viewpoint position information of each of the plurality of observers. For example, the calculation unit calculates the distance between the two observers based on the viewpoint position information of each of the two observers among the plurality of observers. Subsequently, the calculation unit is based on the minimum value of the observation competition rate for each pitch of the slit regarding the distance between the two observers and whether or not the two observers can visually recognize different stereoscopic images at the same time. , Determine the width of the barrier displayed by the barrier panel. Subsequently, the calculation unit generates a barrier image (hereinafter, also referred to as barrier panel data) corresponding to the barrier having the determined width.

In addition, the calculation unit acquires parallax images corresponding to the viewpoint positions of each of the plurality of observers from the slice image drawing unit. Subsequently, the calculation unit calculates the width of the slice image obtained by vertically cutting the parallax image acquired from the slice image drawing unit based on the viewpoint position information of each of the plurality of observers and the determined width of the barrier. .. Further, for example, the calculation unit calculates a display position for displaying the slice image on the image panel based on the viewpoint position information of each of the plurality of observers and the determined width of the barrier. When the calculation unit calculates the width and display position of the slice image, the image for displaying the parallax image acquired from the slice image drawing unit on the image panel with the calculated width and display position of the slice image (hereinafter, the image panel). (Also called data) is generated.

The slice image drawing unit and the image panel / barrier panel display image calculation unit correspond to the generation unit 152 of the information processing device 100, which will be described later.

The barrier panel control unit acquires the barrier panel data from the calculation unit. Subsequently, the barrier panel control unit controls to display the barrier panel data on the barrier panel by transmitting the control signal for the barrier panel to the barrier panel when the barrier panel data is acquired.

The image panel control unit acquires image panel data from the calculation unit. Subsequently, the image panel control unit controls to display the image panel data on the image panel by transmitting the control signal for the image panel to the image panel when the image panel data is acquired. The image panel control unit displays the sliced images obtained by cutting the parallax image obtained from the sliced image drawing unit in the vertical direction on the display panel side by side.

The barrier panel unit displays the barrier panel data under the control of the barrier panel control unit. Further, the image panel unit displays the image panel data under the control of the image panel control unit. The display device 120 displays the barrier panel data on the barrier panel unit and at the same time displays the image panel data on the image panel unit, so that different images (stereoscopic images) can be displayed for a plurality of observers at the same time. Is displayed.

The barrier panel unit corresponds to the first display unit 121 of the display device 120, which will be described later. Further, the image panel unit corresponds to the second display unit 122 of the display device 120, which will be described later.

[2-3. Information processing device configuration]
Next, the configuration of the information processing apparatus according to the embodiment will be described with reference to FIG. FIG. 6 is a block diagram showing a configuration of an information processing device according to an embodiment. As shown in FIG. 6, the information processing device 100 includes a detection unit 110, a display device 120, a storage unit 130, a communication unit 140, and a control unit 150. The information processing device 100 may have an input unit (for example, a keyboard, a mouse, etc.) that receives various operations from the administrator of the information processing device 100.

(Detection unit 110)
The detection unit 110 detects the positions (viewpoint positions) of the left and right eyes of each of two or more observers (hereinafter, also referred to as a plurality of observers) of the display device that displays a stereoscopic image. For example, the detection unit 110 includes a tracker (eye tracker). For example, the detection unit 110 is provided on the upper part of the display device 120 so that the positions of the eyes of each of the plurality of observers can be detected. The detection unit 110 detects the positions of the eyes of each of the plurality of observers by, for example, an RGB camera, an IR camera, a depth camera, an ultrasonic sensor, or the like. The detection unit 110 may detect constantly or periodically.

The detection unit 110 acquires, for example, information that can identify the positions, distances, etc. of the heads, left and right eyes, etc. of each of the plurality of observers in a space where the display device can be visually recognized. For example, the detection unit 110 acquires an image of a face including the left and right eyes of each of the plurality of observers. Alternatively, the detection unit 110 may detect the positions of the eyes of each of the plurality of observers by detecting the positions of the markers attached to the heads of the plurality of observers, the left and right eyes, and the like in advance.

(Display device 120)
The display device 120 is a stereoscopic image display device that employs a parallax barrier system. The display device 120 is configured by laminating two layers of liquid crystal panels. The display device 120 is configured by laminating a liquid crystal panel that displays a barrier image corresponding to a light-shielding region and a liquid crystal panel that displays an image for stereoscopic viewing.

As shown in FIG. 6, the display device 120 includes a first display unit 121 and a second display unit 122.

(1st display unit 121)
The first display unit 121 is a liquid crystal panel that displays an image for stereoscopic viewing. The first display unit 121 displays images corresponding to two viewpoints, multiple viewpoints, and the like. The first display unit 121 displays the image panel data generated by the generation unit 152 under the control of the display control unit 154.

(Second display unit 122)
The second display unit 122 is a liquid crystal panel that displays a barrier image in which light-shielding regions and slits are alternately arranged. The barrier displayed by the second display unit 122 corresponds to a barrier unit in which light-shielding regions and slits are alternately arranged. Specifically, the second display unit 122 displays the barrier panel data generated by the width control unit 153 under the control of the display control unit 154. The second display unit 122 displays a barrier image corresponding to the parallax barrier. For example, the second display unit 122 displays a black striped image corresponding to the light-shielding region.

The second display unit 122 is arranged behind the first display unit 121. The second display unit 122 projects the parallax barrier into the space between the first display unit 121 and the observer by the backlight. For example, the second display unit 122 projects a black striped image corresponding to the light-shielding region into the space between the first display unit 121 and the observer by the backlight.

The second display unit 122 may be arranged in front of the first display unit 121. When the second display unit 122 is arranged in front of the first display unit 121, the second display unit 122 may be a transparent liquid crystal panel. For example, the second display unit 122 displays a barrier image corresponding to the parallax barrier on a transparent liquid crystal panel. For example, the second display unit 122 displays a black striped image corresponding to the light-shielding region on a transparent liquid crystal panel.

(Storage unit 130)
The storage unit 130 is reproduced by, for example, a semiconductor memory element such as a RAM (Random Access Memory) or a flash memory (Flash Memory), or a storage device such as a hard disk or an optical disk.

(Communication unit 140)
The communication unit 140 is reproduced by, for example, a NIC (Network Interface Card) or the like. Then, the communication unit 140 may be connected to the network by wire or wirelessly, and may transmit / receive information to / from an external information processing device such as a tracking device.

(Control unit 150)
The control unit 150 is a controller, and for example, various programs (information processing programs) stored in a storage device inside the information processing device 100 by a CPU (Central Processing Unit), an MPU (Micro Processing Unit), or the like. (Corresponding to one example) is reproduced by executing the RAM as a work area. Further, the control unit 150 is a controller, and is reproduced by, for example, an integrated circuit such as an ASIC (Application Specific Integrated Circuit) or an FPGA (Field Programmable Gate Array).

As shown in FIG. 6, the control unit 150 includes an acquisition unit 151, a generation unit 152, a width control unit 153, and a display control unit 154, and reproduces or executes the information processing operation described below. .. The internal configuration of the control unit 150 is not limited to the configuration shown in FIG. 6, and may be another configuration as long as it is a configuration for performing information processing described later.

(Acquisition unit 151)
The acquisition unit 151 acquires the viewpoint position information of each of the two or more observers of the display device that displays the stereoscopic image. Specifically, the acquisition unit 151 acquires the detection result of detecting the position of each eye of the plurality of observers from the detection unit 110. For example, the acquisition unit 151 acquires an image of a face including the left and right eyes of each of the plurality of observers from the detection unit 110.

Subsequently, the acquisition unit 151 identifies the positions of the left and right eyes (viewpoint positions) of each of the plurality of observers based on the detection results of detecting the positions of the eyes of each of the plurality of observers. For example, the acquisition unit 151 identifies and specifies information such as the positions of the left and right eyes of each of the plurality of observers and the distance from the display device based on the images of the faces including the left and right eyes of each of the plurality of observers. The positions of the left and right eyes (viewpoint positions) of each of the plurality of observers are specified based on the obtained information. Subsequently, when the acquisition unit 151 specifies the viewpoint position of each of the plurality of observers, the acquisition unit 151 acquires the position information (viewpoint position information) of the viewpoint position of each of the specified plurality of observers.

Further, the acquisition unit 151 determines the direction in which the line of sight of the right eye is directed based on, for example, the image of the eyeball of the observer's right eye captured by the detection unit 110 and the positional relationship between the right eye and the right eye. It may be specified. Similarly, the acquisition unit 151 identifies the direction in which the line of sight of the left eye is directed based on the image of the eyeball of the observer's left eye captured by the detection unit 110 and the positional relationship between the left eye and the left eye. You may. Further, the acquisition unit 151 may specify which position of the display device each of the plurality of observers is visually recognizing based on the position of the eyes of each of the plurality of observers.

(Generator 152)
The generation unit 152 acquires the viewpoint position information of each of the two or more observers of the display device 120 that displays the stereoscopic image from the acquisition unit 151. When the generation unit 152 acquires the viewpoint position information of each of the plurality of observers, the generation unit 152 draws a parallax image corresponding to each of the viewpoint positions of the plurality of observers based on the acquired viewpoint position information. Specifically, the generation unit 152 generates parallax images for the left eye corresponding to the viewpoint positions of the left eyes of each of the plurality of observers based on the viewpoint positions of the left eyes of each of the plurality of observers. Further, for example, the generation unit 152 generates parallax images for the right eye corresponding to the viewpoint positions of the right eyes of each of the plurality of observers based on the viewpoint positions of the right eyes of each of the plurality of observers.

(Width control unit 153)
The width control unit 153 controls the width of the light-shielding region in the barrier unit in which the light-shielding region and the slits are alternately arranged. The width control unit 153 controls the width of the light-shielding region in the barrier unit which is a parallax barrier. The width control unit 153 is a light-shielding region that blocks light propagating from the display device 120 to each of the two or more observer's viewpoint positions based on the viewpoint positions of each of the two or more observers of the display device 120 that displays a stereoscopic image. Control the width.

Specifically, the width control unit 153 relates to the relationship between the distance between two or more observers and the index value for each slit pitch regarding whether or not two or more observers can simultaneously view different stereoscopic images. The width of the shading area is controlled based on. For example, the width control unit 153 acquires the viewpoint position information of each of the two or more observers of the display device that displays the stereoscopic image from the acquisition unit 151. Subsequently, when the width control unit 153 acquires the viewpoint position information of each of the plurality of observers, the width control unit 153 calculates the distance between the plurality of observers based on the acquired viewpoint position information. For example, the width control unit 153 calculates the distance between the two observers based on the viewpoint positions of the two observers among the plurality of observers.

Subsequently, when the width control unit 153 calculates the distance between the two observers, it relates to the distance between the two observers and whether or not the two observers can simultaneously view different stereoscopic images. The width of the light-shielding area is controlled based on the relationship with the index value for each slit pitch. For example, the width control unit 153 controls the width of the light-shielding region based on the relationship between the distance between observers shown in FIG. 8 described later and the minimum value of the observation competition rate for each slit pitch. For example, the width control unit 153 determines the width of the light-shielding region based on the relationship between the distance between observers shown in FIG. 8 described later and the minimum value of the observation competition rate for each slit pitch. Subsequently, the width control unit 153 generates a barrier image (barrier panel data) corresponding to the light-shielding region having the determined width.

(Display control unit 154)
The display control unit 154 displays a parallax image corresponding to the viewpoint position of each of the two or more observers on the display device based on the viewpoint position of each of the two or more observers and the width of the light-shielding area. Specifically, the display control unit 154 acquires a parallax image corresponding to the viewpoint position of each of the two or more observers from the generation unit 152. Subsequently, the display control unit 154 transmits the parallax image acquired from the generation unit 152 to the first display unit 121 based on the viewpoint position information of each of the plurality of observers and the width of the light-shielding region determined by the width control unit 153. indicate.

Further, the display control unit 154 divides each parallax image for each viewpoint position into a plurality of vertically long slice images, and divides the slice image for each divided viewpoint position into the viewpoint position and width of each of the two or more observers. The display is displayed on the display device based on the width of the light-shielding area determined by the control unit 153.

Specifically, the display control unit 154 controls the width of the slice image based on the viewpoint position of each of the two or more observers and the width of the light-shielding region determined by the width control unit 153. For example, the display control unit 154 calculates the width of the slice image based on the viewpoint position of each of the two or more observers and the width of the light-shielding region determined by the width control unit 153.

Further, the display control unit 154 controls the display position for displaying the slice image on the display device. Specifically, the display control unit 154 calculates the display position of the slice image based on the viewpoint position information of each of the plurality of observers and the width of the light-shielding region determined by the width control unit 153.

Subsequently, when the display control unit 154 calculates the width and display position of the slice image, the image for displaying the parallax image acquired from the generation unit 152 on the first display unit 121 with the calculated width and display position of the slice image. (Hereinafter, also referred to as image panel data) is generated. Subsequently, the display control unit 154 displays the generated image panel data on the first display unit 121.

Further, the display control unit 154 displays the barrier image generated based on the viewpoint positions of each of the two or more observers on the second display unit 122. Specifically, the display control unit 154 acquires the barrier panel data generated by the width control unit 153. Subsequently, the display control unit 154 displays the acquired barrier panel data on the second display unit 122.

[2-4. Relationship between distance between observers and observation competition rate]
Next, with reference to FIG. 7, the relationship between the distance between observers and the observation competition rate for each slit pitch according to the embodiment will be described. FIG. 7 is a graph showing the relationship between the distance between observers and the observation competition rate for each slit pitch according to the embodiment. FIG. 7 is a plot of the relationship between the distance between two observers and the observation competition while changing the barrier width. FIG. 7 shows the results of eight types of experiments in which the barrier width was increased by 1 pixel from 9 pixels to 16 pixels while keeping the slit width at 3 pixels. By changing the barrier width while keeping the slit width constant, the slit pitch changes. The horizontal axis X of the graph shown in FIG. 7 indicates the distance between the two observers. Further, the vertical axis Y of the graph indicates the observation competition rate (hereinafter, also referred to as the competition rate). At the viewpoint position where the competition rate is high, the two observers cannot see the separate slice images. The line type of the plot represents the width of the barrier, and the width of the barrier changes the distance at which observation conflict does not occur.

Next, with reference to FIG. 8, the relationship between the distance between observers and the minimum value of the observation competition rate for each slit pitch according to the embodiment will be described. FIG. 8 is a graph showing the relationship between the distance between observers according to the embodiment and the minimum value of the observation competition rate for each slit pitch. The graph shown in FIG. 8 illustrates the minimum value in the graph shown in FIG. 7. From the graph shown in FIG. 8, by controlling the width of the barrier between 13 and 19 subpixels, two people at a viewpoint position in a practical range (for example, the distance between observers is 1000 pixels to 9000 pixels). It can be seen that a stereoscopic image corresponding to each viewpoint position of the observer can be presented. The information processing device 100 stores the relationship shown in FIG. 8 as a look-up table in the storage unit 130. Alternatively, the information processing apparatus 100 stores in the storage unit 130 a function that models the relationship shown in FIG. The width control unit 153 uses a look-up table showing the relationship shown in FIG. 8 or a function modeling the relationship shown in FIG. 8 to obtain an optimum barrier according to the viewpoint position of each of the two observers acquired by the tracker. Derivation of width. Further, the display control unit 154 controls the display of the image according to the viewpoint position and the optimum barrier width of each of the two observers.

[2-5. Information processing procedure]
Next, the information processing procedure according to the embodiment will be described with reference to FIG. FIG. 9 is a flowchart showing an information processing procedure according to the embodiment.

In the example shown in FIG. 9, the detection unit 110 acquires the viewpoint position information of a plurality of observers using a tracker (step S101). The generation unit 152 calculates the barrier width and the display image according to the viewpoint position information of a plurality of observers by using a table (graph shown in FIG. 8) or a function prepared in advance (step S102). The width control unit 153 displays the barrier image generated by the generation unit 152 on the first display unit 121. Further, the display control unit 154 displays the slice image generated by the generation unit 152 on the second display unit 122 (step S103).

[2-6. Modification example]
In the above-described embodiment, an example in which the display device 120 is configured by laminating two layers of liquid crystal panels has been described, but the present invention is not limited to this. Specifically, among the two-layer display panels, the display panel used for image display is not limited to the liquid crystal panel, and may be an OLED (Organic Light Emitting Diode) or the like. Further, instead of using the display panel, the image may be displayed by projection.

Further, the device used as the parallax barrier among the two-layer display panels may be any device as long as it has a light-shielding ability and can control the width of the light-shielding area (barrier). For example, as the parallax barrier, a light-shielding plate having a fixed width of the light-shielding region (barrier) may be rotationally moved or translated. Further, as the parallax barrier, a light-shielding plate using a stretchable material (for example, an elastic body such as rubber) may be used in the light-shielding region (barrier).

Next, a modified example according to the embodiment will be described with reference to FIG. FIG. 10 is an explanatory diagram for explaining a modified example according to the embodiment. In FIG. 10, two types of barriers having different barrier widths are prepared in advance, and the information processing device 100 selects which type of display is displayed according to the viewpoint positions of the two observers U1 and U2. , Show only that. Further, the information processing apparatus 100 synthesizes an optical path with a half mirror M1.

In FIG. 10, a barrier for 4 viewpoints and a barrier for 5 viewpoints are prepared in advance. Although not shown, the information processing device 100A according to the modified example includes a display device 120A. The display device 120A includes a first display unit 121A that displays a slice image for four viewpoints, a first display unit 121B that displays a slice image for five viewpoints, and a second display unit 122A that displays a barrier image for four viewpoints. A second display unit 122B for displaying a barrier image for five viewpoints is provided.

The acquisition unit 151 acquires the viewpoint position information of each of the two observers U1 and U2. The width control unit 153 calculates the distance L between the two observers U1 and U2 based on the viewpoint positions of the two observers U1 and U2 acquired by the acquisition unit 151. Subsequently, when the width control unit 153 calculates the distance L between the two observers U1 and U2, the relationship between the distance between the observers shown in FIG. 8 and the minimum value of the observation competition rate for each slit pitch is established. Based on this, the width of the shading area is controlled. For example, the width control unit 153 is selected from the barriers for 4 viewpoints and the barriers for 5 viewpoints based on the relationship between the distance between observers and the minimum value of the observation competition rate for each slit pitch shown in FIG. , The width of the light-shielding area is determined to be the width corresponding to the barrier for four viewpoints. Subsequently, the width control unit 153 selects and displays a barrier corresponding to the width of the determined light-shielding region. For example, the width control unit 153 displays a barrier for four viewpoints on the second display unit 122A. Further, the width control unit 153 turns off the screen of the second display unit 122B.

Further, the display control unit 154 acquires a parallax image corresponding to the viewpoint position of each of the two observers U1 and U2 from the generation unit 152. Subsequently, the display control unit 154 first obtains a parallax image acquired from the generation unit 152 based on the viewpoint position information of each of the two observers U1 and U2 and the width of the light-shielding region determined by the width control unit 153. It is displayed on the display unit 121A. For example, the display control unit 154 calculates the width of a slice image obtained by cutting the parallax image acquired from the generation unit 152 in the vertical direction for four viewpoints. In addition, the display control unit 154 calculates the display position of the slice image. Subsequently, the display control unit 154 calculates the width and display position of the sliced image to generate image panel data. Subsequently, the display control unit 154 displays the generated image panel data on the first display unit 121A.

[3. Effect of this disclosure]
As described above, the information processing apparatus 100 according to the embodiment of the present disclosure or a modification thereof has a barrier unit in which light-shielding regions and slits are alternately arranged, and a width control unit 153 that controls the width of the light-shielding region. Be prepared. The width control unit 153 determines the width of the light-shielding region that blocks the light propagating from the display device to the viewpoint positions of the two or more observers based on the viewpoint positions of the two or more observers of the display device that displays the stereoscopic image. Control.

As a result, the information processing device 100 allows a plurality of observers to observe different stereoscopic images at the same time. Further, since the information processing device 100 can make a plurality of observers observe different stereoscopic images at the same time, for example, it is possible to simultaneously reproduce the motion parallax according to each position for a plurality of observers. can. Therefore, the information processing device 100 can display a stereoscopic image to a plurality of observers.

Further, the width control unit 153 is based on the relationship between the distance between two or more observers and the index value for each slit pitch regarding whether or not two or more observers can simultaneously view different stereoscopic images. The width of the light-shielding area is controlled. Further, the width control unit 153 controls the width of the light-shielding region based on the relationship between the distance between two or more observers and the minimum value of the index value.

As a result, the information processing apparatus 100 presents a stereoscopic image corresponding to each of a plurality of observer's viewpoint positions in a practical range (for example, a distance between observers is 1000 pixels to 9000 pixels). Can be done.

Also, the barrier part is a parallax barrier.

As a result, the information processing device 100 can display a stereoscopic image to a plurality of observers by the parallax barrier method.

Further, the information processing device 100 further includes a display control unit 154. The display control unit 154 displays a parallax image corresponding to the viewpoint position of each of the two or more observers on the display device based on the viewpoint position of each of the two or more observers and the width of the light-shielding area. Further, the display control unit 154 divides each parallax image for each viewpoint position into a plurality of vertically long slice images, and the divided slice image for each viewpoint position is shielded from the viewpoint position of each of the two or more observers. Display on the display device based on the width of the area. Further, the display control unit 154 controls the width of the slice image based on the viewpoint position of each of the two or more observers and the width of the light-shielding region. In addition, the display control unit 154 controls the display position for displaying the slice image on the display device.

As a result, the information processing device 100 can display an appropriate parallax image according to the viewpoint position of each of the plurality of observers. That is, the information processing device 100 can simultaneously display different stereoscopic images according to the viewpoint positions of each of the plurality of observers. Therefore, the information processing device 100 can display a stereoscopic image to a plurality of observers.

Further, the display device includes a first display unit that displays a parallax image and a second display unit that displays a barrier image corresponding to the barrier unit. The display control unit 154 displays a parallax image on the first display unit based on the viewpoint position of each of the two or more observers and the width of the light-shielding area, and the barrier is based on the viewpoint position of each of the two or more observers. The image is displayed on the second display unit.

This makes it easier for the information processing apparatus 100 to control the variable width barrier according to the viewpoint positions of a plurality of observers. Further, the information processing apparatus 100 can easily display a slice image corresponding to the variable width barrier.

[4. Hardware configuration]
Information devices such as the information processing device 100 according to the above-described embodiments and modifications are reproduced by, for example, a computer 1000 having a configuration as shown in FIG. FIG. 11 is a hardware configuration diagram showing an example of a computer 1000 that reproduces the functions of an information processing device such as the information processing device 100. Hereinafter, the information processing apparatus 100 according to the embodiment will be described as an example. The computer 1000 includes a CPU 1100, a RAM 1200, a ROM (Read Only Memory) 1300, an HDD (Hard Disk Drive) 1400, a communication interface 1500, and an input / output interface 1600. Each part of the computer 1000 is connected by a bus 1050.

The CPU 1100 operates based on the program stored in the ROM 1300 or the HDD 1400, and controls each part. For example, the CPU 1100 expands the program stored in the ROM 1300 or the HDD 1400 into the RAM 1200 and executes processing corresponding to various programs.

The ROM 1300 stores a boot program such as a BIOS (Basic Input Output System) executed by the CPU 1100 when the computer 1000 is started, a program that depends on the hardware of the computer 1000, and the like.

The HDD 1400 is a computer-readable recording medium that non-temporarily records a program executed by the CPU 1100 and data used by the program. Specifically, the HDD 1400 is a recording medium for recording an information processing program according to the present disclosure, which is an example of program data 1450.

The communication interface 1500 is an interface for the computer 1000 to connect to an external network 1550 (for example, the Internet). For example, the CPU 1100 receives data from another device or transmits data generated by the CPU 1100 to another device via the communication interface 1500.

The input / output interface 1600 is an interface for connecting the input / output device 1650 and the computer 1000. For example, the CPU 1100 receives data from an input device such as a keyboard or mouse via the input / output interface 1600. Further, the CPU 1100 transmits data to an output device such as a display, a speaker, or a printer via the input / output interface 1600. Further, the input / output interface 1600 may function as a media interface for reading a program or the like recorded on a predetermined recording medium (media). The media is, for example, an optical recording medium such as a DVD (Digital Versatile Disc) or PD (Phase change rewritable Disk), a magneto-optical recording medium such as an MO (Magneto-Optical disk), a tape medium, a magnetic recording medium, or a semiconductor memory. Is.

For example, when the computer 1000 functions as the information processing device 100 according to the embodiment, the CPU 1100 of the computer 1000 reproduces the functions of the control unit 150 and the like by executing the information processing program loaded on the RAM 1200. Further, the information processing program according to the present disclosure and the data in the storage unit 130 are stored in the HDD 1400. The CPU 1100 reads the program data 1450 from the HDD 1400 and executes the program, but as another example, these programs may be acquired from another device via the external network 1550.

The present technology can also have the following configurations.
(1)
A barrier section where light-shielding areas and slits are arranged alternately,
A width control unit that controls the width of the light-shielding region,
With
The width control unit blocks the light propagating from the display device to the viewpoint positions of the two or more observers based on the viewpoint positions of the two or more observers of the display device displaying the stereoscopic image. Control the width of
Information processing device.
(2)
The width control unit
The shading region is based on the relationship between the distance between the two or more observers and the index value for each pitch of the slit regarding whether or not the two or more observers can simultaneously view different stereoscopic images. Control the width of
The information processing device according to (1) above.
(3)
The width control unit
The width of the shading region is controlled based on the relationship between the distance between the two or more observers and the minimum value of the index value.
The information processing device according to (2) above.
(4)
The barrier part is
A parallax barrier,
The information processing device according to any one of (1) to (3) above.
(5)
A display control unit for displaying a parallax image corresponding to the viewpoint position of each of the two or more observers on the display device based on the viewpoint position of each of the two or more observers and the width of the light-shielding region is further provided.
The information processing device according to any one of (1) to (4) above.
(6)
The display control unit
Each of the parallax images for each viewpoint position is divided into a plurality of vertically long slice images, and the sliced image for each of the divided viewpoint positions is divided into the viewpoint position and the light-shielding region of each of the two or more observers. Displayed on the display device based on the width of
The information processing device according to (5) above.
(7)
The display control unit controls the width of the slice image based on the viewpoint position and the width of the light-shielding region of each of the two or more observers.
The information processing device according to (6) above.
(8)
The display control unit
Control the display position of displaying the slice image on the display device.
The information processing device according to (7) above.
(9)
The display device includes a first display unit that displays the parallax image and a second display unit that displays a barrier image corresponding to the barrier unit.
The display control unit
The parallax image is displayed on the first display unit based on the viewpoint position of each of the two or more observers and the width of the light-shielding region.
The barrier image is displayed on the second display unit based on the viewpoint position of each of the two or more observers.
The information processing device according to (5) above.
(10)
It is a control method for controlling a barrier portion in which light-shielding areas and slits are alternately arranged.
Based on the viewpoint position of each of the two or more observers of the display device for displaying the stereoscopic image, the width of the light-shielding region that blocks the light propagating from the display device to the viewpoint position of each of the two or more observers is controlled.
Control methods including that.
(11)
A program for operating a computer of an information processing device having a barrier portion in which light-shielding areas and slits are alternately arranged.
A width that controls the width of the light-shielding region that blocks light propagating from the display device to the viewpoint positions of the two or more observers based on the viewpoint positions of each of the two or more observers of the display device that displays a stereoscopic image. Control processing,
A program for causing the computer to execute.

100 Information processing device 110 Detection unit 120 Display device 121 First display unit 122 Second display unit 130 Storage unit 140 Communication unit 150 Control unit 151 Acquisition unit 152 Generation unit 153 Width control unit 154 Display control unit

Claims

A barrier section where light-shielding areas and slits are arranged alternately,
A width control unit that controls the width of the light-shielding region,
With
The width control unit blocks the light propagating from the display device to the viewpoint positions of the two or more observers based on the viewpoint positions of the two or more observers of the display device displaying the stereoscopic image. Control the width of
Information processing device.
The width control unit
The shading region is based on the relationship between the distance between the two or more observers and the index value for each pitch of the slit regarding whether or not the two or more observers can simultaneously view different stereoscopic images. Control the width of
The information processing device according to claim 1.
The width control unit
The width of the shading region is controlled based on the relationship between the distance between the two or more observers and the minimum value of the index value.
The information processing device according to claim 2.
The barrier part is
A parallax barrier,
The information processing device according to claim 1.
A display control unit for displaying a parallax image corresponding to the viewpoint position of each of the two or more observers on the display device based on the viewpoint position of each of the two or more observers and the width of the light-shielding region is further provided.
The information processing device according to claim 1.
The display control unit
Each of the parallax images for each viewpoint position is divided into a plurality of vertically long slice images, and the sliced image for each of the divided viewpoint positions is divided into the viewpoint position and the light-shielding region of each of the two or more observers. Displayed on the display device based on the width of
The information processing device according to claim 5.
The display control unit controls the width of the slice image based on the viewpoint position and the width of the light-shielding region of each of the two or more observers.
The information processing device according to claim 6.
The display control unit
Control the display position of displaying the slice image on the display device.
The information processing device according to claim 7.
The display device includes a first display unit that displays the parallax image and a second display unit that displays a barrier image corresponding to the barrier unit.
The display control unit
The parallax image is displayed on the first display unit based on the viewpoint position of each of the two or more observers and the width of the light-shielding region.
The barrier image is displayed on the second display unit based on the viewpoint position of each of the two or more observers.
The information processing device according to claim 5.
It is a control method for controlling a barrier portion in which light-shielding areas and slits are alternately arranged.
Based on the viewpoint position of each of the two or more observers of the display device for displaying the stereoscopic image, the width of the light-shielding region that blocks the light propagating from the display device to the viewpoint position of each of the two or more observers is controlled.
Control methods including that.
A program for operating a computer of an information processing device having a barrier portion in which light-shielding areas and slits are alternately arranged.
A width that controls the width of the light-shielding region that blocks light propagating from the display device to the viewpoint positions of the two or more observers based on the viewpoint positions of each of the two or more observers of the display device that displays a stereoscopic image. Control processing,
An information processing program for causing the computer to execute.