JP3966753B2 - Stereoscopic image playback device - Google Patents

Description

[0001]
BACKGROUND OF THE INVENTION
The present invention relates to an image display apparatus, and more particularly to a stereoscopic image reproduction apparatus capable of displaying a stereoscopic image over a wide range of viewing angles while using an integral photography (IP) method or a light beam reproduction method.
[0002]
[Prior art]
As one of the stereoscopic image display methods that enable stereoscopic display used in amusement, internet shopping, mobile terminals, medical care, virtual reality, advertising billboards, right-eye and left-eye planar images are displayed on the display and deflected. There is a “stereoscope method” that uses light or the like so that the right eye planar image can be seen by the right eye and the left eye planar image can be seen by the left eye.
[0003]
This stereoscope method needs to be observed through optical means such as deflecting glasses. Also, although it looks three-dimensional at first glance, it does not reproduce the three-dimensional image, so the image does not change even if the viewing angle is changed, and it does not appear to the back of the three-dimensional image even if the viewing position is changed. So there is a problem of putting it on reality.
[0004]
In addition, since the focal position is on the display surface, and there is a spatial “deviation” between this focal position and the convergence position where the object is being watched, there is a mismatch between the so-called focus adjustment and the convergence distance, which is reproduced for the observer. There is also a problem in that the space is uncomfortable and it tends to cause fatigue to the observer.
[0005]
As a stereoscopic display method for solving these problems, there is a method called an “integral photography (IP) method” or a “ray reproduction method” using a very large number of parallax images. In this method, a parallax image of a stereoscopic image to be displayed is recorded by some method and is reproduced. Examples of documents disclosing this method include Japanese Patent Application Laid-Open No. 10-239785 and Japanese Patent Application Laid-Open No. 2001-56450.
[0006]
Here, the integral photography method and the light beam reproduction method are considered to be based on almost the same principle although the meaning of the term is not accurately established as a stereoscopic display method. In the following description, the “integral photography method” is referred to as a concept including the light beam reproduction method, and this integral photography method will be described.
[0007]
FIG. 16 is a conceptual diagram illustrating the configuration of a stereoscopic image display apparatus using the integral photography method.
[0008]
As shown in the figure, a natural three-dimensional image can be obtained by using a simple optical system including an image display device 501 such as a liquid crystal display and an array plate 502 of two-dimensionally arranged pinholes or microlenses. Can be played.
[0009]
On the display device 501, a large number of patterns corresponding to a group of parallax images that are slightly different depending on the viewing angle are displayed corresponding to each pinhole or microlens. When a corresponding pattern is observed from the viewer 505 through these pinholes or microlenses, a three-dimensional virtual image 503 (an image that does not exist when viewed from the back) can be observed on the back of the display device 501.
[0010]
In addition, light emitted from a large number of patterns corresponding to a group of parallax images is emitted to the front of the display device through corresponding pinholes or microlenses, and these lights are focused, thereby pinholes or A three-dimensional real image 504 is formed on the front surface of the microlens array plate 502.
[0011]
That is, the three-dimensional virtual image 503 can be observed from the observer 505 via the pinhole or microlens array plate 502 toward the pattern on the display device 501, and the pinhole or microscopic image can be observed from the pattern on the display device 501. A three-dimensional real image 504 is formed by focusing a group of parallax image rays directed toward the observer 505 through the lens array plate 502.
[0012]
In addition to such a method, there are several methods for enabling a viewer to observe a three-dimensional virtual image or a three-dimensional real image. However, the integral photography method is excellent in that a natural stereoscopic image can be formed with such a simple configuration. In addition, since the integral photography method actually reproduces a stereoscopic image, it does not require optical means such as deflection glasses, and the angle at which the stereoscopic image can be seen changes depending on the viewing angle of the observer, making it more realistic. It can be said that this method is excellent in that a three-dimensional image can be reproduced.
[0013]
[Problems to be solved by the invention]
However, as a result of the inventor's original study, it has been found that the integral photography method has a problem that the peripheral portion thereof cannot be normally viewed as the screen size increases.
[0014]
FIG. 17 is a conceptual diagram for explaining the relationship between the viewing zone angle and the observation distance in the integral photography method.
[0015]
In the integral photography method, a plurality of parallax image light ray groups are emitted from an image display device 401 such as a liquid crystal display or a plasma display, and these are observed by an observer through each pinhole of the pinhole plate 402. A stereoscopic image is observed.
[0016]
Therefore, in order to obtain a realistic stereoscopic image, it is desirable that all of these parallax images reach the observer. However, as can be seen from FIG. 17, some of the parallax images emitted from each pinhole may not reach depending on the position of the observer. For example, in the case of the simplified specific example shown in FIG. 17, the position where the observer can observe all of the light emitted from each of the three pinholes 402 </ b> A to 402 </ b> C is a hatched portion indicated by reference numeral B in FIG. 17. Only.
[0017]
Therefore, there is a shortest value for the observation distance for the normal appearance of the entire screen, and when the image is closer to the screen than this shortest value, a part of the parallax image cannot be observed. This shortest distance L can be expressed by the following equation, where W is the horizontal size of the screen.
L = W / (2 tan θ)
For example, if the horizontal size of the screen is 42 cm and the viewing zone angle 2θ is 30 degrees, it can be seen that the observation distance must be at least 78 cm.
[0018]
In many applications, the proper viewing distance is usually about the same as the horizontal size of the screen. Therefore, if the horizontal size of the screen is 42 cm, an appropriate observation distance is about 42 cm. However, as can be seen from FIG. 17, a normal stereoscopic image is observed only near the center of the screen as it approaches 42 cm. If the viewing zone angle 2θ can be set to 54 ° or more, the observation distance is equivalent to the horizontal size of the screen, but it is difficult to actually set the viewing zone angle 2θ to 54 ° or more.
[0019]
As described above, the integral photography method has a problem that when the screen size is increased, a stereoscopic image is not normally recognized in the peripheral portion, and the observation distance must be increased.
[0020]
The present invention has been made based on recognition of such a problem, and an object thereof is to provide a stereoscopic image reproducing apparatus capable of observing a wide screen from an appropriate observation distance.
[0021]
[Means for Solving the Problems]
According to one aspect of the invention,
A display device;
An array plate provided on the front surface of the display device and formed with a plurality of pinholes or lenses;
With
The display device displays a plurality of pattern images corresponding to each of the plurality of pinholes or lenses, and a group of light rays emitted from the display device through each of the plurality of pinholes or lenses. A stereoscopic image reproducing apparatus based on an integral photography method or a light ray reproducing method for displaying a stereoscopic image,
The stereoscopic image reproducing device is divided into at least a first region, a second region, and a third region provided between them,
Each of the first to third regions has a plurality of the pinholes or lenses,
Within each of the first to third regions, the direction of the central axis of each of the light ray groups emitted through the plurality of pinholes or lenses is substantially the same,
Both the direction of the central axis of the light beam group emitted in the first region and the direction of the central axis of the light beam group emitted in the second region are relative to the display surface of the stereoscopic image. Tilted from the vertical direction toward the center of the display surface,
A stereoscopic image reproducing apparatus is provided in which the direction of the central axis of the light beam emitted in the third region is substantially perpendicular to the display surface.
[0024]
Further, the positional relationship between the pixel group of the display device in the first region and the pinhole or lens corresponding thereto is the pixel group of the display device in the second region and the pinhole or lens corresponding thereto. And the positional relationship can be different.
[0025]
Further, the display device has a blank area between the first area and the second area,
The positional relationship between the pixel group of the display device in the first region and the pinhole or lens corresponding thereto is the relationship between the pixel group of the display device in the second region and the pinhole or lens corresponding thereto. The positional relationship can be different.
[0026]
Or the said array board shall have a part from which the arrangement pitch of the said pinhole or a lens differs between the surroundings between the said 1st area | region and a 2nd area | region.
[0027]
Further, if the viewing zone angle of the light beam group is 27 degrees or more, it is possible to observe a realistic stereoscopic image at an appropriate observation distance.
[0028]
DETAILED DESCRIPTION OF THE INVENTION
Hereinafter, embodiments of the present invention will be described in detail with reference to the drawings.
[0029]
FIG. 1 is a conceptual diagram illustrating the configuration of a stereoscopic image reproducing apparatus according to the first embodiment of the present invention.
[0030]
As shown in the figure, this stereoscopic image reproducing apparatus includes a display device 101 such as a liquid crystal display, and a pinhole or microlens array plate 102 arranged on the front surface and arranged two-dimensionally. A natural three-dimensional image is reproduced by the optical system.
[0031]
On the display device 101, a large number of patterns corresponding to parallax image groups that are slightly different depending on the viewing angle are displayed corresponding to each pinhole or microlens provided in the array plate 102. Is done. For example, if the displayed image is a cube, the parallax image group includes a plurality of cube patterns corresponding to the viewing angle. When a corresponding pattern (a pattern that varies depending on the viewing angle) is observed from the observer side through a pinhole or a microlens, a three-dimensional virtual image (an image that does not exist when viewed from the back side) can be observed on the back surface of the display device 101. it can.
[0032]
In addition, light emitted from a large number of patterns corresponding to the parallax image group is emitted through corresponding pinholes or microlenses, and this light is focused, so that the light is focused on the front surface of the array plate 102 of the pinholes or microlenses. A dimensional real image is formed.
[0033]
That is, a three-dimensional virtual image can be observed by a group of parallax image light beams directed to a pattern on the display device 101 from a viewer through a pinhole or microlens array plate 102, and a pinhole or microlens can be observed from the pattern on the display device 101. A three-dimensional real image is formed by focusing a group of parallax image light rays directed toward an observer through the array plate 102.
[0034]
Here, in the present invention, the stereoscopic image reproducing device is divided into a plurality of regions, and the emission angle of the light beam emitted from each pinhole or lens of the array plate 102 is changed for each of these regions. For example, in the case of the configuration illustrated in FIG. 1, the playback device is divided into three regions DP1 to DP3. Then, the light rays from the central divided region DP2 of the display device 101 are emitted so that the central axis thereof is substantially perpendicular to the screen, and the light rays emitted from the outer divided regions DP1 and DP3 are Release toward the center of the screen. In other words, the central axis C of the light beam from the outer peripheral portion of the display device is inclined so as to be inside (close to the center) with respect to the normal N of the display device.
[0035]
Here, in each of the divided regions DP1 to DP3, the direction of the central axis C of the light beam group is constant. This is because, within a region where the central axis C is constant, a pattern to be displayed on the display device 101 can be obtained by high-speed arithmetic processing from polygon data of an image to be displayed.
[0036]
In this way, it is possible to shorten the observation distance for making the entire screen look normal. That is, when the inclination angle of the central axis C of the light ray group from the outer peripheral portion of the screen is δ, the shortest observation distance L that can receive all the light ray groups on the central axis N of the screen is If the horizontal size is W, it can be expressed by the following equation.
L = W / {2 tan (θ + δ)}
For example, when the inclination angle δ is half the viewing zone angle 2θ of the light beam, that is, θ, the shortest observation distance L can be expressed by the following equation.
L = W / (2 tan 2θ)
For example, when the horizontal size of the screen is 42 cm and the viewing zone angle 2θ is 30 degrees, the observation distance L is 36 cm. This value is less than half of the conventional example described above with reference to FIG. 17, and is smaller than the horizontal size (42 cm) of the screen, which is an appropriate observation distance.
[0037]
When the image is on the center vertical axis N of the screen, a normal stereoscopic image is observed over the entire screen in a range away from the observation distance L.
[0038]
If the viewing zone angle 2θ is 27 degrees or more, the shortest distance L can be made smaller than the appropriate observation distance that is the same as the horizontal size of the screen (L <42 cm in the case of the above specific example) and approaches the screen. Even in the state, a normal stereoscopic image can be observed over the entire screen.
[0039]
In the present invention, as a means for inclining the light ray group from the portion near the outside of the display device 101 toward the center of the screen as described above, the relative relationship between the multi-viewpoint image on the display screen and the pinhole or the micro lens is used. A method of changing the positional relationship can be used. This specific example will be described below.
[0040]
FIG. 2 is a schematic diagram showing a part of the display screen 201 and the array plate 202.
[0041]
In this specific example, in the array plate 202, a plurality of pinholes or lenses P1 to P5 are arranged at a constant pitch PP, that is, at an equal interval. And corresponding to each of these pinholes or lenses P1 to P5, the pixels PX of the display device 201 are allocated, and divided regions PG1 to PG5 are formed.
[0042]
Then, by inserting a blank area BP between the divided areas PG3 and PG4, the relative positional relationship between the pinholes P4 and P5 is shifted with respect to the divided areas PG4 and PG5. As a result, the central axis C of the light beam emitted from these divided regions PG4 and PG5 is inclined toward the center with respect to the normal of the screen. That is, the light beams from the divided regions PG4 and PG5 near the outside of the screen can be emitted while being inclined toward the center of the screen.
[0043]
For example, a plurality of pinholes P1 to P5 are arranged on the array plate 202 in a square lattice with a uniform interval, the pinhole interval PP is 2.0 mm pitch, and the diameter of the pinhole (light transmission part) is 100 μm. it can. On the other hand, on the display device 201 such as a liquid crystal display, in order to display a parallax image pattern, divided regions PG1 to PG5 having the same width as the pinhole pitch PP are allocated.
[0044]
Then, by providing the blank area BP in the peripheral area of the liquid crystal display 201, the positional relationship between the divided areas PG4 (PG5) and the pinholes P4 (P5) of the pixels constituting the image is changed, and the central axis C Can be inclined toward the center of the display device.
[0045]
That is, by providing a “joint portion” between the divided areas PG3 and PG4, the positional relationship between the divided areas and the pinholes is shifted on the outer periphery of the screen. Such a blank region BP can be provided at an appropriate position between the pinholes so as not to be seen by an observer in normal observation.
[0046]
By doing so, a normal stereoscopic image was observed over the entire screen even at an appropriate observation distance (that is, when the distance from the screen is approximately the same as the horizontal size of the screen). Further, since the number of light rays that can be received by the observer is effectively increased, the stereoscopic effect is further increased.
[0047]
Here, for example, as conceptually illustrated in FIG. 3, one blank area BP in the present invention can be provided on each of the left and right sides of the screen. In this case, in the left and right regions divided by the blank region BP, the light beam group is emitted in the same direction.
[0048]
On the other hand, in the case of a large screen size or a horizontally long screen, as illustrated in FIG. 4, two or more blank areas BP are provided on both the left and right sides of the screen, and the beam axes from the left and right ends of the screen are provided. Can be greatly tilted toward the center of the screen.
[0049]
On the other hand, in the present invention, as illustrated in FIG. 5, blank regions BP may be provided not only on the left and right sides of the screen but also on appropriate locations above and below. In particular, when the vertical size of the screen is large, it is possible to incline the light rays from the upper and lower parts of the screen toward the observer near the center of the screen.
[0050]
Further, as illustrated in FIG. 6, two or more blank areas BP may be provided in the upper and lower parts of the screen. In particular, when the screen size is large or the screen is long in the vertical direction, as shown in FIG. 6, by providing a plurality of blank areas BP on both the upper and lower sides of the screen, the beam axes from the upper and lower portions of the screen are displayed. It can also be greatly inclined toward the center of the.
[0051]
Furthermore, as illustrated in FIG. 7, there are cases where blank regions BP are provided only on the left and right and top of the screen. This is particularly advantageous when the observer observes from below the center of the screen. For example, it may be a movie screen.
[0052]
Further, as illustrated in FIG. 8, when the screen is vertically long and large, an observer observes from the lower side of the screen, so it is preferable to provide a blank area BP only above the screen.
[0053]
Next, another method for tilting the light beam group in the present invention will be described.
[0054]
FIG. 9 is a schematic diagram showing a part of the display screen 301 and the array plate 302.
[0055]
In this specific example, the pixels PX of the display device 301 are allocated to the pinholes at an equal pitch, and divided regions PG1 to PG5 are formed. On the other hand, in the array plate 302, pinholes or lenses P1 to P3 and P4 to P5 are arranged at a constant pitch PP1, that is, at an equal interval, but between P3 and P4, It has a small pitch PP2.
[0056]
As described above, the relative positional relationship between the divided regions PG4 and PG5 and the pinholes P4 and P5 can be shifted also by locally changing the pinhole pitch. As a result, the central axis C of the light beam emitted from these divided regions PG4 and PG5 is inclined toward the center with respect to the normal of the screen. That is, in this example, the light beams from the divided areas PG4 and PG5 near the outside of the screen are directed toward the center of the screen, the pitch of the multi-viewpoint image is kept constant, and the pitch of the pinholes 302 is changed for each divided area. Even with this method, a normal stereoscopic image was observed over the entire screen at an appropriate observation distance.
[0057]
As a result, a normal stereoscopic image is observed over the entire screen at an appropriate observation distance.
[0058]
Also in this specific example, the positions where the different pitches PP2 are provided in this way can be, for example, one on each of the left and right sides of the array plate 302 as conceptually illustrated in FIG. Further, as illustrated in FIG. 11 in the case of a large screen size or a horizontally long screen, the left and right edges of the screen can be obtained by setting the pitch between two or more pinholes on the left and right sides of the screen as the pitch PP2. The beam axis from the screen can be greatly tilted toward the center of the screen.
[0059]
On the other hand, in the present invention, as illustrated in FIG. 12, not only the right and left sides of the screen but also the upper and lower portions of the screen may have pinhole intervals of the pitch PP2. In particular, when the vertical size of the screen is large, it is possible to incline the light rays from the upper and lower parts of the screen toward the observer near the center of the screen.
[0060]
Further, as illustrated in FIG. 13, the pitch of the pinholes may be set to the pitch PP2 at two or more portions in the upper and lower portions of the screen. In particular, when the screen size is large or the screen is long in the vertical direction, as shown in FIG. 13, by providing the portions with the pitch PP2 in the plurality of portions on the upper and lower sides of the screen, the light rays from the upper and lower portions of the screen The axis can be greatly tilted toward the center of the screen.
[0061]
14 and 15 are also advantageous when the observer observes from below the screen, as described above with reference to FIGS.
[0062]
The embodiments of the present invention have been described above by exemplifying specific examples. However, the present invention is not limited to the specific examples described above.
[0063]
For example, the number of pixels and the pitch of the display device, the pinholes of the array plate, the arrangement pattern and pitch of the lenses, and the like can be appropriately selected according to the specifications.
[0064]
Further, those skilled in the art also appropriately selected the size and arrangement position of the blank area BP provided in the display device or the pitch amount, arrangement relation, number, etc. of the area where the pitch is changed, such as the pitch PP2 provided on the array plate. Are included within the scope of the present invention.
[0065]
Further, display devices using various display devices such as CRT, plasma display and EL display instead of the liquid crystal display are also included in the scope of the present invention.
[0066]
In addition, the present invention can be implemented with various modifications without departing from the spirit thereof, and these examples are also included in the scope of the present invention.
[0067]
【The invention's effect】
As described above, according to the present invention, it becomes possible to observe a wide screen from an appropriate observation distance in a stereoscopic image display method for forming a three-dimensional image in a space by a group of light beams having parallax image information, A stereoscopic image reproducing apparatus capable of natural stereoscopic viewing can be provided.
[0068]
As a result, a device capable of natural stereoscopic viewing can be realized at low cost, and the industrial merit is great.
[Brief description of the drawings]
FIG. 1 is a conceptual diagram illustrating a configuration of a stereoscopic image reproduction device according to a first embodiment of the present invention.
FIG. 2 is a schematic diagram showing a part of a display screen 201 and an array plate 202. FIG.
FIG. 3 is a schematic diagram showing a specific example in which one blank area is provided on each of the left and right sides of the screen.
FIG. 4 is a schematic diagram showing a specific example in which two or more blank regions BP are provided on both the left and right sides of the screen.
FIG. 5 is a schematic diagram showing a specific example in which blank areas BP are provided not only on the left and right sides of the screen but also at appropriate locations above and below.
FIG. 6 is a schematic diagram showing a specific example in which two or more blank regions BP are provided in the upper and lower portions of the screen, respectively.
FIG. 7 is a schematic diagram showing a specific example in which blank regions BP are provided only on the left and right and top of the screen.
FIG. 8 is a schematic diagram showing a specific example in which a blank area BP is provided only above the screen.
9 is a schematic diagram showing a part of the display screen 301 and the array plate 302. FIG.
FIG. 10 is a schematic diagram showing a specific example in which portions with a pitch PP2 are provided on each of the left and right sides of the array plate 302. FIG.
FIG. 11 is a schematic diagram showing a specific example in which a pitch PP2 is used as an interval between two or more pinholes on both the left and right sides of the screen.
FIG. 12 is a schematic diagram showing a specific example in which the pinhole interval is set to the pitch PP2 not only on the left and right sides of the screen but also at appropriate upper and lower portions.
FIG. 13 is a schematic diagram showing a specific example in which the pinhole interval is set to pitch PP2 at two or more portions in the upper and lower portions of the screen.
FIG. 14 is a schematic diagram showing a specific example in which variable pitch PP2 is provided only on the left and right and top of the screen.
FIG. 15 is a schematic diagram showing a specific example in which a variable pitch PP2 is provided only above the screen.
FIG. 16 is a conceptual diagram illustrating the configuration of a stereoscopic image display device using an integral photography method.
FIG. 17 is a conceptual diagram for explaining a relationship between a viewing zone angle and an observation distance in the integral photography method.
[Explanation of symbols]
δ Inclination angle 101, 201, 301, 401, 501 Display device 102, 202, 302, 402, 502 Array plate 402A to 402C Pinhole 503 Three-dimensional virtual image 504 Three-dimensional real image 505 Observer BP Blank region C Center axis N Perpendicular PP1 , PP2 Pitch P1-P5 Pinhole PG1-PG5 Divided area (pixel group)
PX pixel

Claims (5)

A display device;
An array plate provided on the front surface of the display device and formed with a plurality of pinholes or lenses;
With
The display device displays a plurality of pattern images corresponding to each of the plurality of pinholes or lenses, and a group of light rays emitted from the display device through each of the plurality of pinholes or lenses. A stereoscopic image reproducing apparatus based on an integral photography method or a light ray reproducing method for displaying a stereoscopic image,
The stereoscopic image reproducing device is divided into at least a first region, a second region, and a third region provided between them,
Each of the first to third regions has a plurality of the pinholes or lenses,
Within each of the first to third regions, the direction of the central axis of each of the light ray groups emitted through the plurality of pinholes or lenses is substantially the same,
Both the direction of the central axis of the light beam group emitted in the first region and the direction of the central axis of the light beam group emitted in the second region are relative to the display surface of the stereoscopic image. Tilted from the vertical direction toward the center of the display surface,
The stereoscopic image reproducing apparatus according to claim 1, wherein a direction of a central axis of the light group emitted in the third region is substantially perpendicular to the display surface.   The positional relationship between the pixel group of the display device in the first region and the pinhole or lens corresponding thereto is the relationship between the pixel group of the display device in the third region and the pinhole or lens corresponding thereto. The stereoscopic image reproducing apparatus according to claim 1, wherein the stereoscopic image reproducing apparatus is different from the positional relationship. The display device has a blank area between the first area and the third area,
The positional relationship between the pixel group of the display device in the first region and the pinhole or lens corresponding thereto is the relationship between the pixel group of the display device in the third region and the pinhole or lens corresponding thereto. The stereoscopic image reproducing apparatus according to claim 1, wherein the stereoscopic image reproducing apparatus is different from the positional relationship.   3. The stereoscopic image according to claim 1, wherein the array plate has a portion where the arrangement pitch of the pinholes or lenses is different from the surroundings between the first region and the third region. Playback device.   The stereoscopic image reproducing device according to any one of claims 1 to 4, wherein a viewing zone angle of the light beam group is 27 degrees or more.

Images