JP2018129826A - Stereoscopic image display device and stereoscopic image display method - Google Patents

Abstract

PROBLEM TO BE SOLVED: To display a significant stereoscopic image not giving an observer any discomfort, by reducing the impact of double image, reverse view, and 3D Moire due to 3D crosstalk effectively by an inexpensive configuration.SOLUTION: In addition to mobile object state detection means 110 and stereoscopic display panel means 120, a stereoscopic image display device 12 has an arithmetic processing section 132 performing various arithmetic processing, and imaging means 280 for imaging an observer and recording the image data thereof. The arithmetic processing section 132 has image data preservation means 150 and device characteristic data holding means 160, and also has observation position calculation means 290 for calculating the observation position Pindicating the relative position of the observation position of the observer for the center position of the display surface of the stereoscopic display panel means 120, and display setting adjustment means 270 for adjusting display setting of the stereoscopic image based on the observation position calculated by the observation position calculation means 290 and the device characteristic data preserved in the device characteristic data holding means 160.SELECTED DRAWING: Figure 38

Description

  The present invention relates to a stereoscopic image display technique, and in particular, a stereoscopic display that displays a stereoscopic image that does not give the viewer a sense of incongruity even when the relative distance between the stereoscopic image display device installed on the back of the seat and the observer changes. The present invention relates to an image display device, a stereoscopic image display method, and a stereoscopic image display program.

  In recent years, in passenger seats such as airplanes and long-distance trains, small and medium displays are installed on the back of each passenger, each passenger uses the display provided on the back of each front seat, You can watch your favorite program content.

  Since there are many contents for displaying stereoscopic images in the program contents for viewing passengers represented by movies and the like, it is desired to display a stereoscopic image on a display installed on the back of the seat.

  Here, a stereoscopic image display device provided with a display for displaying a stereoscopic image includes a glasses-type device and a naked-eye type device.

  In the glasses-type stereoscopic image display device, when an observer wears glasses for displaying a stereoscopic image, images with different parallax are projected on the left and right eyes to display a stereoscopic image to the observer. However, many observers are uncomfortable with wearing glasses for stereoscopic image display, and a naked-eye type stereoscopic image display device that does not require glasses is desired.

  In an autostereoscopic image display device, a spatial region in which a stereoscopic image is projected is divided, and an image with different parallax is projected for each divided spatial region, thereby projecting an image with different parallax to the left and right eyes of the observer. The method is common.

  In such a method, the stereoscopic display panel of the stereoscopic image display device is provided with a lenticular lens, a parallax barrier, or the like, which is an optical beam separation unit, so that an image to be projected is separated for each spatial region, and a plurality of spatial regions are separated. The method of projecting images with different parallax is used.

  A stereoscopic image display device provided with such optical beam separation means such as a lenticular lens and a parallax barrier is superior in that it does not require wearing glasses for stereoscopic image display and is not bothered.

  However, the space area where the observer can visually recognize the stereoscopic image (normal stereoscopic view possible area) is located within the spatial area where the left eye position of the observer is projected, and the right eye of the observer Is located within the space area where the right-eye image is projected.

  If the left and right eye positions of the observer deviate from the normal stereoscopic viewable region, the left eye image and the right eye image appear to overlap (so-called 3D crosstalk double image), and the sense of depth is reversed. There is a problem that a stereoscopic image can be seen (so-called reverse viewing).

  In addition, in an autostereoscopic image display device, if the observer's observation position deviates from the normal stereoscopic view possible region, luminance unevenness (brightness fluctuation) occurs on the surface of the stereoscopic display panel, and the periphery in the stereoscopic image There is a problem that an image area that is displayed darker than the image area appears.

  This phenomenon is called 3D moire, and the non-display area between pixels for each viewpoint (light-shielding part generally called a black matrix in a liquid crystal panel) is used for optical beam separation such as lenticular lenses and parallax barriers. This is caused by interference with the means. In other words, 3D moire is periodic luminance unevenness (sometimes referred to as color unevenness) caused by projecting different images in different angular directions.

  3D moiré is a variation in luminance angular direction (Luminance Angular Fluctuation), which may not be a problem depending on the observation position, but if the luminance variation in the angular direction is large, the display quality of the stereoscopic image is reduced, There is a problem that the viewer feels uncomfortable.

  Problems caused by double images by 3D crosstalk, reverse viewing, and 3D moire (hereinafter referred to as “problems in 3D display”), which are peculiar to these autostereoscopic image display apparatuses, are a stereoscopic image display apparatus and an observer. Depends on the relative distance.

  Also, in passenger aircraft, passenger cars, etc., the backrest on the back part of the front seat may fall due to the convenience of the passenger in the front seat, and the stereoscopic image display device installed on the back part also moves accordingly It becomes.

  Therefore, when the stereoscopic image display device is installed on the seat back portion, even if the observer does not move, the relative distance (observation distance) between the stereoscopic image display device and the observer due to the convenience of the passenger in the front seat Changes abruptly, which causes various problems in 3D display, resulting in a significant reduction in the display quality of stereoscopic images. Since this deterioration in display quality makes the viewer feel uncomfortable, there is a strong demand for a stereoscopic image display device that does not cause problems in 3D display even when the observation distance changes.

  As a technique for reducing the influence of each problem in such 3D display, an observer's position is measured, an observation distance indicating a relative distance between the stereoscopic image display apparatus and the observer, and an observer's position with respect to the stereoscopic image display apparatus. A configuration in which an observation position representing a relative position is calculated and the display setting of the stereoscopic image is adjusted in accordance with the calculated observation distance or information related to the observation position is conceivable. Alternatively, since observation position information is required, an apparatus for measuring the position of the observer is required.

  In particular, in order to more effectively reduce the effects of double images, reverse viewing, and 3D moire due to 3D crosstalk, it is necessary to measure the observation distance representing the distance in the depth direction between the observer and the stereoscopic image display device. Thus, as a device for measuring the observation distance, a measurement device (three-dimensional position measurement device) capable of measuring a distance in the depth direction and measuring a position in a three-dimensional space is known.

  In recent years, the price of such a three-dimensional position measurement device has decreased, but even so, a USB camera (a small camera module of a mobile device) that can take an observer's position as captured image data on a two-dimensional plane, or a fall of the seat Compared with an inclination sensor or the like that measures the condition, the measuring device is still expensive.

  That is, installing such an expensive measuring device on a stereoscopic image display device leads to an increase in the overall device cost, which has hindered the widespread use of the stereoscopic image display device installed on the back of the seat. .

  For example, the following contents are known as techniques related to the solution of such problems (Patent Documents 1 to 9, etc.).

  Patent Document 1 discloses an observation position including an observation distance from an observer's seat state and an image taken by an in-vehicle camera attached to a rearview mirror in order to correct distortion caused by image tilt caused by observing the display surface from an oblique direction. A technique for calculating the value is disclosed.

  In Patent Document 2, in a calibration system that adjusts the position and orientation of the display in accordance with the position of the observer, the infrared light emitted from the display is measured by an infrared camera installed at the position of the observer, thereby A technique of calculating a relative position with respect to a display is disclosed.

  Patent Document 3 discloses an image processing technique for measuring the position of an observer from captured image data captured by a camera in order to display a stereoscopic image that does not feel strange even when the observer moves. In addition to the image processing method for measuring the position of the observer from captured image data on a two-dimensional plane, the processing method in the art adjusts the focal length of the camera to capture a face image in an arbitrary image range. How to do is described.

  Patent Document 4 discloses a technique for notifying an observer to move into a space area where a stereoscopic image can be visually recognized when the position of the observer deviates from a space area where the stereoscopic image can be normally visually recognized. .

  In the stereoscopic image display device in Patent Document 5, an inclination sensor typified by an acceleration sensor or the like is installed in the stereoscopic image display device in order to provide a stereoscopic image that does not feel strange even when the observer moves. That is, the technical content of detecting the tilt of the stereoscopic image display device by this tilt sensor and measuring the observation position is disclosed.

  In Patent Document 6, even if the display direction of the display surface installed on the back part of the front seat changes due to the reclining state of the passenger in the front seat, the display direction of the display surface and the viewing direction of the observer In order to make them coincide, a technique is disclosed in which the installation angle of the display surface is adjusted in consideration of the inclination angle between the observer's seat and the front seat.

  In the stereoscopic image display devices in Patent Documents 7 to 9, even if the position of the observer moves, the image conversion processing is performed on the right-eye image and the left-eye image according to the position, thereby performing 3D crosstalk. The technology of reducing the influence of double images, reverse viewing, and 3D moire and displaying a stereoscopic image without a sense of incongruity is adopted.

  Further, in Non-Patent Document 1, in order to measure the observation position only with an inexpensive measuring device, the actual interpupillary distance of the observer is registered in advance, and a two-dimensional plane captured image captured by a USB camera or the like. By comparing the distance between the pupils of the observer reflected in the data and the distance between the pupils of the observer registered in advance, the observation distance representing the distance in the depth direction between the stereoscopic image display device and the observer is calculated. Technology is disclosed.

JP 2009-75842 A WO2012-023509 JP 2000-152285 A JP 2012-170502 A JP 2008-15188 A JP 2008-279155 A JP 2014-45474 A JP 2014-45473 A JP 2014-44396 A

S-H. Ju, et al, “Viewer's Eye Position Estimation Using Camera” 2013 International Symposium Digest of Technical Papers, 48.3, pp 671-674

  However, since the calculation method of the observation position in Patent Document 1 is a technique based on the premise that the installation position of the in-vehicle camera and the display is fixed, the installation position of the display moves according to the convenience of the passenger in the front seat. In such a case (for example, in the case of using a display installed on the back of the seat), there is a problem that it cannot be applied.

  In addition, the technique disclosed in Patent Document 2 has a disadvantage that it is difficult to install a measuring apparatus and the apparatus cost is high because an infrared camera needs to be installed at the position of the observer.

  By the way, in order to more effectively reduce the influence of double images, reverse viewing, and 3D moire due to 3D crosstalk, it is possible to measure an observation distance that represents the distance in the depth direction between the stereoscopic image display device and the observer. Although necessary, Patent Document 3 does not disclose any method for measuring the distance in the depth direction between the stereoscopic image display device and the observer from the captured face image. Therefore, even if the technique disclosed in Patent Document 3 is adopted, there is a problem that it is not possible to display a good stereoscopic image without a sense of incongruity.

  In the technique in Patent Document 4, since a distance measuring sensor is used for measuring the observation distance, there is a problem that the cost of the measuring device increases.

  In addition, Patent Document 5 describes a method for detecting the tilt angle of the stereoscopic image display device using a tilt sensor, but the observation distance is measured using the tilt angle of the observer's seat and the seat in front of it. There is no disclosure of how to do this. Therefore, even if the technique in Patent Document 5 is used, there is an inconvenience that the relative distance between the stereoscopic image display device installed on the back of the seat and the observer cannot be measured only with an inexpensive measuring device.

Although the technique in Patent Document 6 employs a method of calculating a relative angle between the display direction of the display surface and the viewing direction of the observer from the inclination angle between the observer's seat and the front seat, the display surface and the observer The content of calculating the distance in the depth direction is not disclosed at all.
Here, unlike a normal image display device (a display that displays a two-dimensional image), the autostereoscopic image display device does not only have a 3D cross not only when the relative angle changes but also when the observation distance changes. The display quality of the stereoscopic image is remarkably deteriorated due to the influence of the double image, reverse viewing, and 3D moire due to the talk. For this reason, even if the method according to Patent Document 6 is used, there is a problem that it is not possible to reduce the influence of double images, reverse viewing, 3D moire, and the like due to 3D crosstalk, which are peculiar to autostereoscopic image display devices. is there.

  The techniques in Patent Documents 7 to 9 do not employ a configuration in which the inclination angle between the observer's seat and the front seat is used when measuring the observation position representing the relative distance between the stereoscopic image display device and the observer. For this reason, even when such a technique is applied in a situation where the stereoscopic image display device is installed on the back of the seat, there is an inconvenience that the observation distance cannot be measured only with an inexpensive measurement device.

  Further, according to the technique described in Non-Patent Document 1, it is possible to measure the observation distance using only an inexpensive measuring device, but prior to the measurement, the distance between the pupils of the observer is registered in the stereoscopic image display device in advance. It is necessary to keep it. Therefore, when the technology is applied to a highly public stereoscopic image display device used by a large number of observers, it is necessary to register the interpupillary distance every time the observer changes, and the processing becomes complicated. There is an inconvenience. That is, there is a problem that even if the technique that is not disclosed at all about a method for easily registering the interpupillary distances of many observers is applied to a highly public stereoscopic image display device or the like, the advantage cannot be utilized. There is.

(Object of invention)
Therefore, the present invention solves the above-described problems, and in particular, a significant three-dimensional image that effectively reduces the effects of double images, reverse viewing, and 3D moire due to 3D crosstalk with an inexpensive configuration and does not give the viewer a sense of incongruity. An object of the present invention is to provide a stereoscopic image display device for displaying the image, its display method, and its display program.

  In order to achieve the above object, a stereoscopic image display device according to the present invention is a stereoscopic image display device that is installed on a moving object and displays a stereoscopic image, and projects images having different parallax for each adjacent spatial region. Stereoscopic display panel means, imaging means for photographing an observer in front of the display surface of the stereoscopic display panel, and recording it as captured image data, and relative position of the observer with respect to the stereoscopic display panel means using the captured image data Relative position calculation means for calculating the device, device characteristic data storage means for storing device characteristic data relating to the stereoscopic display panel means, and adjustment of display settings of the stereoscopic image with reference to the relative position and the device characteristic data And a display setting adjusting means.

  In addition, the stereoscopic image display method according to the present invention includes a stereoscopic display panel unit that projects an image having different parallax for each adjacent space region, and is a stereoscopic image display apparatus that displays a stereoscopic image installed on a moving object. An image display method, in which an observer in front of the display surface of the stereoscopic display panel is imaged and recorded as captured image data, and the observer's relative to the stereoscopic display panel means using the captured image data A relative position calculating step for calculating a position; a device characteristic data receiving step for receiving device characteristic data for the stereoscopic display panel; and a display setting for the stereoscopic image with reference to the relative position and the device characteristic data. Based on the display setting adjustment process to be adjusted and the display setting after the adjustment, the parallax is different for each of the spatial regions. And having a three-dimensional image display step of displaying the stereoscopic image by projecting the image.

  Furthermore, the stereoscopic image display program according to the present invention has a stereoscopic display panel means for projecting images with different parallax for each adjacent spatial region, and is applied to a stereoscopic image display device that is installed on a moving object and displays a stereoscopic image. A stereoscopic image display program for capturing an image of the front of the display surface of the stereoscopic display panel together with an observer and recording the captured image data as captured image data; A relative position calculating function for calculating a relative position, a device characteristic data receiving function for receiving device characteristic data relating to the stereoscopic display panel means, and adjusting the display setting of the stereoscopic image with reference to the relative position and the device characteristic data The display setting adjustment function to be performed, and the display setting after this adjustment Characterized in that to realize the stereoscopic image displaying function of displaying the stereoscopic image by projecting images having different parallaxes to previously provided a computer on the stereoscopic image display apparatus.

  In the present invention, as described above, the distance in the depth direction (observation distance) between the stereoscopic image display device installed on the back of the seat and the observer is calculated using only an inexpensive measurement device, and is adjusted to the observation distance. 3D image display settings are adjusted to reduce the effects of double images, reverse vision, and 3D moire caused by 3D crosstalk with an inexpensive configuration, and it does not give the viewer a sense of incongruity. It is possible to provide a stereoscopic image display device that displays a stereoscopic image, a display method thereof, and a display program thereof.

It is a block diagram of the three-dimensional image display apparatus in 1st Embodiment of this invention. FIG. 2 is an external view of the stereoscopic image display device disclosed in FIG. 1. It is an enlarged view of the three-dimensional display panel means disclosed in FIG. FIG. 2 is a schematic view illustrating an optical model formed by the stereoscopic display panel means in a configuration in which a lenticular lens is applied to the stereoscopic display panel means of FIG. 1 and the like. FIG. 2 is a schematic view illustrating an optical model formed by the stereoscopic display panel means in a configuration in which a parallax barrier is applied to the stereoscopic display panel means of FIG. 1 and the like. It is the schematic explaining reverse view among the figures which show the optical model formed by the same three-dimensional display panel means as FIG. It is the schematic explaining 3D crosstalk among the figures which show the optical model formed by the same three-dimensional display panel means as FIG. It is an external view which shows the state by which the stereo image display apparatus disclosed by FIG. 1 etc. was installed in the seat back part. It is an external view which shows the state which provided the outer frame in the stereoscopic image display apparatus disclosed in FIG. 1 etc., and installed in the seat back part. It is a schematic diagram which shows the positional relationship of the stereoscopic image display apparatus in FIG. 1 etc. and the observer which were installed in the seat back part. FIG. 11 is a schematic diagram illustrating a positional relationship between the stereoscopic image display device and the observer when the seat in front of the observer is tilted from the situation illustrated in FIG. 10. Among the schematic diagrams showing the manner in which the stereoscopic image display device disclosed in FIG. 1 and the like moves due to the inclination of the front seat, FIG. 12A shows the positional relationship when the position of the observer is within the normal vision region. (B) shows the positional relationship when the position of the observer is outside the normal viewing region. It is an external view of the seat which installed the inclination sensor in the moving object state detection means in FIG. Among illustration of calculation of the inclination angle by the inclination sensor shown in FIG. 13, FIG. 14 (A) shows an example Y _A-axis direction is equivalent gravitational acceleration direction and the acceleration coordinate system, FIG. 14 (B) gravity Y _a-axis direction of the acceleration direction and the acceleration coordinate system showing an example in which inequality. It is an external view of the seat which installed two inclination sensors. It is a figure which shows the time change of the acceleration by the inclination of the backrest part of a seat. Is an external view of a seat installed the gear rotation sensor, the inclination angle of the backrest portion of the seat's seat, when FIG. 17 (A) is a theta _S1, FIG. 17 (B) is larger theta _S2 than theta _S1 It is a figure which shows each case. It is the schematic which shows the positional relationship of the three-dimensional image display apparatus shown in FIG. 1 etc. installed in the seat back part, and an observer. Among the schematic views showing the joining relationship between the stereoscopic image display device and the seat back portion in FIG. 1 and the like, FIG. 19A is an external view when the seat back portion is viewed from the rear of the seat, and FIG. ) Is an external view when the side surface portion of the seat is viewed from the lateral direction of the seat. It is a figure which shows 3D crosstalk characteristic data. It is explanatory drawing which shows 3D crosstalk area | region corresponding to the threshold value set high among the optical model figures formed by the stereoscopic display panel means which the stereoscopic image display apparatus of FIG. 1 etc. has. It is explanatory drawing which shows the 3D crosstalk area | region corresponding to the threshold value set low rather than the optical model figure formed by the stereoscopic display panel means which the stereoscopic image display apparatus of FIG. 1 etc. has. Of the diagrams showing changes in the optical model due to individual differences of the stereoscopic display panel means included in the stereoscopic image display apparatus of FIG. 1 and the like, FIG. 23A shows the direction of the light beam at the center position of the stereoscopic display panel means in the front direction. In some cases, FIG. 23 (B) shows a case where the light beam direction is inclined by an allowable value of manufacturing error −Δθ _LIM , and FIG. 23 (C) shows a case where the light beam direction is inclined in the opposite direction by an allowable value of manufacturing error Δθ _LIM. FIG. 23D is a diagram in which the optical models (A), (B), and (C) are superimposed. It is a figure which shows the sample of the image data stored in the image data storage means which the stereoscopic image display apparatus of FIG. 1 etc. includes. It is explanatory drawing concerning a parallax image. It is a relationship diagram of image data and a parallax value. It is a figure which shows the sample of the image data group of various parallax values. It is a classification table corresponding to 3D crosstalk and reverse viewing according to a display setting adjustment method according to a difference in optical separation characteristics of the stereoscopic display panel means. Among the figures showing the effect of voltage control of the liquid crystal lens, it is a figure showing the cross section of the stereoscopic display panel means and the refractive index distribution in the X-axis direction of the liquid crystal lens when the applied voltage to the control electrode is low. Among the figures showing the effect of voltage control of the liquid crystal lens, it is a figure showing the cross section of the stereoscopic display panel means and the refractive index distribution in the X-axis direction of the liquid crystal lens when the applied voltage to the control electrode is high. It is explanatory drawing which shows the change of the optimal visual recognition distance by the refractive index change of a liquid crystal lens. It is the figure which showed the adjustment range of the optimal visual recognition distance by the refractive index change of a liquid crystal lens. It is a relationship figure of parallax tolerance with respect to observation distance. It is a figure which shows the luminance-viewing angle characteristic data of a three-dimensional display panel means. It is explanatory drawing which shows appearance of 3D moire by the inclination of the backrest part of a front seat. It is a classification table corresponding to 3D moire concerning the adjustment method of the display setting by the difference in the optical separation characteristic of a three-dimensional display panel means. 2 is a flowchart of an image processing operation in the stereoscopic image display device disclosed in FIG. 1 and the like. It is a block diagram of the stereo image display apparatus in 2nd Embodiment of this invention. FIG. 39 is an external view of the stereoscopic image display device disclosed in FIG. 38. FIG. 39 is a relationship diagram between captured image data captured by the imaging unit and the seat state in the stereoscopic image display device of FIG. 38. It is a related figure of the picked-up image data imaged similarly to FIG. 40, and a seat state. It is a figure which shows an example in which the variation | change_quantity of observation distance is dependent on the height of both eyes of an observer. It is an external view which shows the state by which the stereo image display apparatus which mounts an imaging means on the front upper part was installed in the seat back part. It is an external view which shows the case where an imaging means is installed in a seat among the states with which the three-dimensional image display apparatus was installed in the seat back part. It is a basic external view which shows the seat which installed the inclination sensor, and a three-dimensional image display apparatus. FIG. 46 is an external view showing a state in which the seat back portion is tilted from the state of FIG. 45 in the case where a tilt sensor is installed in the seat and the stereoscopic image display device. It is a relationship figure of the display coordinate system of a stereoscopic image display apparatus, and the camera coordinate system of an imaging means. It is a figure which shows the positional relationship of the stereoscopic image display apparatus installed in the seat back part, and an observer. It is a figure which shows the imaging environment which image | photographed the object of different observation distance with an imaging means. It is a figure which shows the sample of the captured image data which image | photographed the object of a different observation distance. It is a figure which shows the position change of the normal vision area | region by the refractive index change of a liquid crystal lens. It is a diagram showing the effect of voltage control of the liquid crystal lens is a sectional view according to the stereoscopic display panel unit in the case of applying the same voltage to the control electrode E ₁ and the control electrode E _4. It is a diagram showing the effect of voltage control of the liquid crystal lens is a sectional view according to the stereoscopic display panel unit in the case of applying the same voltage to the control electrode E ₂ and the control electrode E _1. It is an optical model diagram formed by the stereoscopic display panel means, and is a diagram for explaining a change in the formation position of the normal viewing region by the control of the liquid crystal lens. It is an optical model figure formed by a stereoscopic display panel means, and is a figure explaining the change of the formation position of the normal vision area | region by local change of lens power. It is a relationship figure of the parallax tolerance with respect to a viewing angle. 39 is a flowchart of an image processing operation in the stereoscopic image display device disclosed in FIG. 38 and the like. It is a block diagram of the stereo image display apparatus in 3rd Embodiment of this invention. It is an external view of the seat which installed the pressure sensor. It is a figure which illustrates the picked-up image data image | photographed with the imaging means. It is a figure which shows the notification screen displayed on a stereo image display apparatus at the time of registration of observer data. It is a figure which shows the change of the captured image data image | photographed with the imaging means. 59 is a flowchart according to observer data registration processing by the stereoscopic image display device disclosed in FIG. 58. 59 is a flowchart according to stereoscopic image display processing by the stereoscopic image display device disclosed in FIG. 58. It is a block diagram of the stereo image display apparatus in 4th Embodiment of this invention. FIG. 6 is a relationship diagram between the inclination of the seat back and the distance from the imaging means to the seat back. It is a relationship diagram between the captured image data imaged by the imaging means and the inclination of the seat back portion. FIG. 68 is a relationship diagram between captured image data captured by the imaging unit and the inclination of the seat back portion, and shows a state in which the seat back portion is inclined more than the state of FIG. 67. 66 is a flowchart of an image processing operation in the stereoscopic image display device disclosed in FIG. 65.

  DESCRIPTION OF EMBODIMENTS Hereinafter, embodiments for carrying out the present invention (hereinafter referred to as “embodiments”) will be described with reference to the accompanying drawings.

[First Embodiment]
A first embodiment of a stereoscopic image display apparatus according to the present invention will be described with reference to FIGS. Here, in the stereoscopic image display apparatus according to the first embodiment, each component is appropriately added or changed in the following descriptions, and the common reference numeral (11) is used as a generic name including these components. Shall.

(Overall configuration)
As shown in FIG. 1, the stereoscopic image display apparatus 11 according to the first embodiment includes a moving object state detection unit 110 that detects a state (position state) of a moving object, and images with different parallax for each adjacent space region. 3D display panel means 120 for projecting, and an arithmetic processing unit 131 for performing arithmetic processing related to various types of information.

  The arithmetic processing unit 131 calculates an observation distance representing a relative distance between the stereoscopic display panel unit 120 and a specific observer located on the display surface side based on state information that is a detection result by the moving object state detection unit 110. Device characteristic data for storing observation characteristic calculation means (relative distance calculation means) 140, image data storage means 150 for storing or receiving image data, and device characteristic data representing optical characteristics (display characteristics) of the stereoscopic display panel means 120 A storage unit 160; and a display setting adjustment unit 170 that adjusts the display setting of the stereoscopic image based on the observation distance calculated by the observation distance calculation unit 140 and the device characteristic data stored in the device characteristic data storage unit 160. Have. Note that the relative distance described in this specification refers to the distance in the depth direction between the stereoscopic image display device and the observer, and is synonymous with the observation distance.

  That is, after the display setting adjustment by the display setting adjustment unit 170, the stereoscopic display panel unit 120 separates the image data into a right eye image and a left eye image, and directs these to the observer's right eye and left eye. To project.

  As shown in the external view of FIG. 2, in the stereoscopic image display device 11, the apparatus main body 10 including the stereoscopic display panel unit 120 and the arithmetic processing unit 131 and the moving object state detection unit 110 are connected by wire. Yes.

  Here, in the first embodiment, a seat such as an airplane or a long-distance train is assumed as the moving object, and the backrest portion of the seat is movable. For this reason, the moving object state detection means 110 is provided by bonding or the like on the seat where the corresponding apparatus main body 10 is installed.

  That is, the moving object state detection unit 110 detects a seat state such as a seat fall state and transmits information on the seat state (state information) to the observation distance calculation unit 140 in the arithmetic processing unit 131.

  2 shows an example in which the apparatus main body 10 and the moving object state detection means 110 are connected by wire, and the above description has been made with reference to this, but instead of this wired connection, the apparatus main body 10 and A configuration that enables wireless communication with the moving object state detection unit 110 may be employed. That is, the moving object state detection unit 110 may be provided with a function of transmitting seat state information by wireless communication, and the wired connection may be eliminated.

  As shown in FIG. 2, the arithmetic processing unit 131 is arranged at the rear of the stereoscopic display panel unit 120, and performs various types of arithmetic processing using state information input from the moving object state detection unit 110. It is configured.

  The stereoscopic display panel unit 120 is an image display panel as an electro-optical unit in which a plurality of pixels including at least a sub-pixel that displays an image for a first viewpoint and a sub-pixel that displays an image for a second viewpoint are arranged in a matrix. And a light beam separating panel as a light beam separating means capable of separating the respective viewpoint images in predetermined different directions.

That is, an image display panel employing a liquid crystal method, an organic EL method, a plasma method, or the like can be used as the electro-optical means, and the light beam separation means includes a lenticular lens, a liquid crystal lens, a parallax barrier, or the like. Panels can be used.
Among these, the refractive index of the lens is unchanged for the lenticular lens, but the distribution of the refractive index of the lens can be changed by voltage control for the liquid crystal lens.

  In FIG. 3, which shows an example of the stereoscopic display panel means 120 in an enlarged manner, a liquid crystal display panel is employed as the electro-optical means, a lenticular lens is employed as the optical separation means, and these are combined.

  In FIG. 3, a left-eye pixel 4L in the liquid crystal display panel represents a sub-pixel that displays an image for the left eye that is projected from the stereoscopic display panel means 120 onto the left eye of the observer, and similarly, a right-eye pixel 4R. Represents a sub-pixel that displays an image for the right eye to be projected onto the right eye of the observer. The left-eye pixels 4L and the right-eye pixels 4R are arranged so as to be alternately arranged.

  Next, the spatial region divided by the light beam separating means of the stereoscopic display panel means 120 will be described with reference to FIGS. 4 to 7 according to the lenticular lens type optical model. Each of these figures is a cross-sectional view of the observer and the periphery of the stereoscopic image display device 11 as viewed from above the observer.

  First, FIG. 4 shows an example of an optical model for projecting images with different parallaxes to the left and right eyes of the observer in the stereoscopic image display apparatus 11 employing the lenticular lens method.

  In FIG. 4, the viewer's eyes (right eye 55R and left eye 55L) are located on the observation surface 30 that is separated from the display surface 40 of the stereoscopic display panel means 120 by an optimal viewing distance (optimal observation distance) OD, and The positional relationship is such that the center of both eyes of the observer coincides with the center of the display panel.

  The image display panel (not shown) is composed of a light modulation element group (for example, a liquid crystal panel) that becomes pixels arranged in a matrix. FIG. 4 shows the right-eye pixels 4R and the left-eye arranged alternately. Of the pixels 4L (pixel group 4), only the pixels located at both ends and the center of the image display panel are shown.

The lenticular lens 3 that functions as means for projecting an image by dividing a spatial region is disposed on the front side of the image display panel as viewed from the observer.
The lenticular lens 3 is an optical element formed from a number of elongated cylindrical cylindrical convex lenses (hereinafter simply referred to as “lens: lens width L”) 3a, and the left eye pixel 4L and the right of the image display panel. The lens 3a is arranged so that the longitudinal direction (Y-axis direction) is orthogonal to the direction in which the ophthalmic pixels 4R are alternately arranged (pixel arrangement direction: X-axis direction).

  Further, a light source (not shown: so-called backlight) is installed in the back of the image display panel, and light emitted from this light source passes through the pixels in the image display panel and then passes through the lens 3a. Projected toward the observer. The projection direction of the right-eye pixel 4R and the projection direction of the left-eye pixel 4L are limited by the presence of the lens 3a.

  Here, as shown in FIG. 4, if the locus of the light passing through the pixel closest to each lens 3a out of the light emitted from each lens 3a is a light ray 20, all the right-eye pixels 4R corresponding thereto are shown. The right eye region 70R where the projected images of the left eye overlap (the space region where the image for the right eye is projected) and the left eye region 70L where the projected images of all corresponding left eye pixels 4L overlap (the projected image for the left eye Space area). That is, only the projected image from the right eye pixel 4R can be observed in the right eye region 70R, and only the projected image from the left eye pixel 4L can be observed in the left eye region 70L.

  Therefore, when a parallax image is projected from the stereoscopic display panel unit 120 when the right eye 55R of the observer is located in the right eye region 70R and the left eye 55L is located in the left eye region 70L, the observation is performed. A person can visually recognize a stereoscopic image. In other words, the observer can observe a desired stereoscopic image when the right eye 55R is located in the right eye region 70R and the left eye 55L is located in the left eye region 70L.

Here, when the distance between the observer and the stereoscopic display panel unit 120 (display surface 40) is shorter than the shortest viewing distance (shortest observation distance) ND, the observer's right eye 55R is outside the right eye region 70R, Since the left eye 55L is outside the left eye region 70L, the observer cannot visually recognize a stereoscopic image.
When the distance between the observer and the stereoscopic display panel unit 120 (display surface 40) is longer than the longest viewing distance (longest observation distance) FD, the observer's right eye 55R is outside the right eye region 70R, and the left Since the eye 55L is outside the left eye region 70L, the observer cannot similarly view the stereoscopic image.

The stereoscopic display panel unit 120 in FIG. 4 has the right-eye pixel 4R and the left-eye pixel at the optimum viewing distance OD so that the width of the right-eye region 70R and the left-eye region 70L is maximized on the observation surface 30. The projection images (width P ′) of the pixel 4L (pixel width P) are all designed to overlap.
That is, a configuration is adopted in which the projected image of each right-eye pixel 4R and the projected image of each left-eye pixel 4L are continuous without separation at the optimum viewing distance OD.

The width (pixel width projected on the observation surface) P ′ of the projected image is mainly determined by the distance h between the principal point of the lens 3a and the pixel, the pixel pitch P, and the optimum viewing distance OD.
If the width P ′ is widened, the width of the right eye region 70R and the left eye region 70L is widened, but the interpupillary distance indicating the observer's binocular distance is constant, and the both eyes of the observer correspond to each other. Since the range that can be positioned at the position is unchanged, the space area (stereoscopic viewing area) in which the stereoscopic image can be visually recognized does not necessarily expand.

  As shown in FIG. 4, it is preferable that the width P ′ is designed to be equal to the binocular distance e, where b is the distance between the eyes. This is because when the width P ′ is smaller than the binocular interval e, the region where stereoscopic vision can be performed is limited to the width P ′, while when the width P ′ is larger than the binocular interval e, both eyes This is because the two positions are located in the right eye region 70R or the left eye region 70L, resulting in an increase in the number of regions in which a stereoscopic image cannot be visually recognized.

  Next, FIG. 5 shows a spatial region that is divided when a parallax barrier is used instead of the lenticular lens as the light beam separating means of the stereoscopic display panel means 120. That is, the configuration shown in FIG. 5 is different from the configuration shown in FIG. 4 only in that a parallax barrier 6 is used instead of the lenticular lens 3.

  The parallax barrier 6 is a barrier (light-shielding plate) in which a number of thin vertical stripe-like slits 6a are formed. The parallax barrier 6 has a barrier against the direction in which the left-eye pixels 4L and the right-eye pixels 4R are arranged on the image display panel. Are arranged so that their longitudinal directions are orthogonal to each other. The cross-sectional view of FIG. 5 shows a state in which the barriers 6b and the slits 6a having the barrier width S are alternately arranged.

  The intensity of light emitted from a light source such as a backlight is modulated in the pixels in the image display panel, and then passes through the slit 6a and is projected toward the observer. The projection direction of the right-eye pixel 4R and the projection direction of the left-eye pixel 4L are limited by the presence of the slit 6a.

  Here, as shown in FIG. 5, assuming that the light trajectory passing through the pixel closest to each slit 6 a among the light emitted from the slits 6 a is a light ray 20, all the right eyes are similar to the case of FIG. 4. A right eye region 70R where the projection images of the pixels 4R for use overlap and a left eye region 70L where the projection images of all the left eye pixels 4L overlap are obtained.

  Next, it is located in a space region (backward viewing region) where the viewer can see the stereoscopic image normally and deviate from the spatial region (normal viewing region) where the projection direction and depth direction of the stereoscopic image are reversed. The case will be described with reference to FIG.

  In FIG. 6, since the observer has moved to the right, the right eye 55R moves out of the right eye region 70R and is positioned in the left eye region 72L, and the left eye 55L moves out of the left eye region 70L and moves to the right eye. It is sectional drawing seen from the observer's upper side when located in the area | region 70R.

  At this time, the light beam 20 that passes through the principal point (vertex) of the cylindrical lens 3a that is closest among the light emitted from the left-eye pixel 4L and the right-eye pixel 4R reaches the position of the observer's right eye 55R. Absent. However, paying attention to light passing through the principal point (vertex) of the second closest cylindrical lens 3b in the light emitted from the left-eye pixel 4L, and assuming that this is the light beam 21 (the one-dot chain line in FIG. 6), this light beam 21 that the second left eye region 72L is obtained.

  In this way, in FIG. 6, the observer observes the projection image from the left eye pixel 4L with the right eye 55R, and observes the projection image from the right eye pixel 4R with the left eye 55L. Since the pop-out direction and the depth direction are opposite (so-called reverse view), a desired stereoscopic image cannot be visually recognized.

  Here, for the right eye 55R, the right eye region 70R is a normal viewing region, and the left eye regions 70L and 72L are reverse viewing regions. For the left eye 55L, the left eye regions 70L and 72L are normal vision regions, and the right eye region 70R is a reverse vision region.

  Next, a case where the observer is out of the normal viewing area and positioned in the 3D crosstalk area will be described with reference to FIG.

  In FIG. 7, since the distance between the observer and the stereoscopic display panel unit 120 is shorter than the shortest viewing distance ND, the right eye 55R is positioned near the boundary of the right eye region 70R, and the left eye 55L is the left eye region. It is sectional drawing seen from the observer's head upper side when located in the boundary line of 70L.

  At this time, a light beam 22 passing through the principal point (vertex) of the closest cylindrical lens 3a among the light emitted from the right-eye pixel 4R at the right end of the liquid crystal display panel is located at the position of the right eye 55R of the observer. Both the light beam 23 (shown by a two-dot chain line) passing through the principal point of the second closest cylindrical lens 3b in the light emitted from the left-eye pixel 4L is projected.

Therefore, in the situation shown in FIG. 7, when the observer observes the stereoscopic image, the right eye 55R observes the projection image from both the right eye pixel 4R and the left eye pixel 4L, that is, the right eye 55R. Since the image reflected on the eye 55R is a double image in which the image for the right eye and the image for the left eye are overlapped (so-called 3D crosstalk), a desired stereoscopic image cannot be visually recognized.
Here, a spatial region near the boundary line between the right eye region 70R and the left eye region 70L or the left eye region 72L is a 3D crosstalk region.

  A light beam 24 passing through the principal point (vertex) of the closest cylindrical lens 3c among the light emitted from the left-eye pixel 4L at the left end of the liquid crystal display panel also at the position of the left eye 55L of the observer; Since both the light beam 25 (shown by a two-dot chain line) passing through the principal point of the second closest cylindrical lens 3d in the light emitted from the right-eye pixel 4R is projected, the image reflected in the left eye 55L is also The right-eye image and the left-eye image are overlapped, and a desired stereoscopic image cannot be visually recognized.

  As described above, in the autostereoscopic image display device, when the observation distance is changed and the observer deviates from the normal viewing area, the effect of double image or reverse vision due to 3D crosstalk appears, and the display quality of the stereoscopic image is displayed. Can cause a problem of significant decrease in

  Next, the positional relationship between the seat and the stereoscopic image display device 11 will be described with reference to FIG. 8 showing the appearance when the stereoscopic image display device 11 is installed on the back surface of the seat as a moving object.

  In the situation illustrated in FIG. 8, the stereoscopic image display device 11 is installed on the seat back surface portion 61 </ b> B of the seat 61 via the joining member 61 </ b> A. By the rotation mechanism of the joining member 61A interposed between the seat back portion 61B, the stereoscopic image display device 11 can be rotated and moved on the Y-axis-Z-axis plane (rotated around the X axis). Yes.

  Without the rotation mechanism of the joining member 61A, when the seat back surface portion 61B is inclined, the display surface of the stereoscopic display panel means 120 is maintained in a downward state, so that the seating surface portion (sitting portion) 61C of the seat is seated. A suitable image cannot be viewed by a viewer who is viewing. That is, here, the rotation mechanism is provided in order to avoid the display surface from being directed downward, and thereby the orientation of the display surface of the stereoscopic display panel means 120 is changed.

Further, the display coordinate system of the stereoscopic image display device 11 is defined as shown in FIG.
That is, the origin position of the display coordinate system is the center position of the display surface of the stereoscopic display panel means 120, the horizontal direction (here, the longitudinal direction) on the display surface of the stereoscopic display panel means 120 is the X-axis direction, and the display surface The vertical direction (the short direction here) is the Y-axis direction, and the direction perpendicular to the display surface of the stereoscopic display panel means 120 is the Z-axis direction.

In the subsequent drawings, the observation distance (relative distance between the stereoscopic image display device 11 and the observer) representing the distance in the depth direction between the stereoscopic image display device 11 and the observer is displayed on the stereoscopic image display device 11. It is described in a coordinate system, and each explanation is given based on this.
For example, as shown in FIG. 10 described later, the distance from the center position of the display surface of the stereoscopic display panel unit 120 to the observer in the Z-axis direction is the observation distance Z _OD . Here, in FIG. 10 etc. (FIGS. 11 and 18), the position of the observer's eyes is shown as the position of the right eye of the observer (O) for convenience.

  Next, another example in which the stereoscopic image display device 11 is installed on the seat back portion will be described with reference to an external view shown in FIG.

  In the stereoscopic image display device 11 shown in FIG. 9, an outer frame portion 62D integrated with the stereoscopic display panel means 120 is provided on the seat 62 via a joining member 62A. The outer frame portion 62D is provided on the back of the seat. The unit 61B is fixed and installed. The first moving object state detection unit 111 provided in the outer frame part 62D is a component for detecting the inclination angle of the seat back surface part 61B, and has the same function as the moving object state detection unit 110 described above. Have.

  That is, the moving object state detection unit 110 shown in FIG. 8 is not limited to the configuration in which the moving object state detection unit 110 is installed in the seat back surface part 61B. You may make it install.

  As described above, when the first moving object state detection unit 111 is provided in the outer frame portion 62D that moves integrally with the seat back portion 61B, a stereoscopic image display is performed when the seat back portion 61B is inclined. The inclination angle detected by the outer frame portion 62D of the device 11 matches the inclination angle of the seat back portion 61B.

  Further, the stereoscopic display panel means 120 can be rotated on the Y-axis / Z-axis plane (rotational movement with the X axis as the rotation axis) by a rotation mechanism using the joining member 62A as shown in FIG. The position can be adjusted so that the observer is perpendicular to the panel display surface.

  Further, as shown in FIG. 9, a configuration may be adopted in which second moving object state detection means 112 for detecting the rotation angle of the stereoscopic display panel by the rotation mechanism is also added to the stereoscopic display panel means 120. In this way, it is possible to perform an observation distance calculation process that also takes into account the positional relationship between the seat back portion 61B (backrest portion) and the stereoscopic display panel means 120.

  Next, FIG. 10 shows a schematic diagram when observing the stereoscopic image display device 11 on the back surface of the front seat while the observer is seated on the seat. FIG. 10 shows a state where both the observer's seat 63 and the front seat 64 are at a normal inclination angle.

Here, the inclination angle of the observer's seat 63 from the vertical direction (Y-axis direction in the figure) is set as θ _SO , and the inclination of the observer's (O) front seat 64 from the vertical direction (Y-axis direction in the figure). the angle is denoted by θ _SP. In this state, the observation distance representing the distance in the depth direction (Z-axis direction in the figure) between the display surface of the stereoscopic display panel unit 120 of the stereoscopic image display device 11 and the observer (O) is defined as Z _OD .

Then, from the state of FIG. 10 shows a schematic view of a backrest of the front seat 64 is inclined (if the inclination angle is changed to theta _{SP 'from} theta _SP) in FIG. 11.

The stereoscopic image display device 11 installed on the seat back portion of the front seat 64 moves with the inclination of the back portion of the front seat 64.
In other words, the stereoscopic image display device 11 under such a situation has an abrupt change in the observation distance Z _OD even when the observer (O) does not move and the backrest portion of the front seat 64 is inclined due to the convenience of the passenger. To do. FIG. 11 shows a state in which the observation distance changes to become Z _OD ′.

  Next, FIG. 12 shows the positional relationship between the position of the observer (O) and the normal viewing area defined by the optical characteristics of the stereoscopic display panel means 120.

In the situation of FIG. 12A showing a case where both eyes of the observer (O) are located in the normal vision region, the observer (O) can visually recognize a normal stereoscopic image.
On the other hand, in the situation of FIG. 12B showing a case where the observation distance changes rapidly (changes from Z _OD to Z _OD ′) with the inclination of the front seat 64, the position of both eyes of the observer (O) is normal. Since it is outside the region, a double image or reverse view due to 3D crosstalk appears, and the observer (O) cannot visually recognize a normal stereoscopic image.

In consideration of such a change in the situation, the stereoscopic image display apparatus 11 according to the first embodiment calculates the amount of change from the observation distance Z _OD due to the inclination of the front seat 64, and the observation distance after the change. A configuration for adjusting the display setting of the stereoscopic image in accordance with Z _OD 'was adopted.

The calculation method of observation distance (change amount from observation distance _ZOD ) is described below.
In calculating the observation distance, first, the seat state information (state information) representing the inclination angle θ _SO of the seat 63 of the observer (O) and the inclination angle θ _SP of the front seat (front seat) 64 is moved. The object state detection means 110 is configured to detect.

  That is, the moving object state detection means 110 is installed on the back surface (seat back surface) of both the seat 63 and the front seat 64 of the observer (O). First, referring to FIGS. A method of calculating the inclination angle of the seat 60 as a generic name of these seats will be described.

FIG. 13 shows an example in which a tilt sensor 110 </ b> A for detecting the tilt angle θ _S of the backrest portion is installed on the back surface portion of the seat 60. An example of the tilt sensor 110A is a biaxial acceleration sensor. FIG. 13 shows an example in which the acceleration sensor is installed on the back of the seat as the tilt sensor 110A. That is, the moving object state detection means 110 connected to the apparatus main body 10 by wire or wirelessly detects the state of the seat 60 that is a moving object based on the detection value (detection data) by the inclination sensor 110A. It is configured.

Here, FIG. 14 shows an enlarged view of a biaxial acceleration sensor as the tilt sensor 110A.
Biaxial acceleration sensor is configured to detect the acceleration of Y _A-axis direction and Z _A-axis direction with respect to the acceleration coordinate system. Here, the acceleration coordinate system is any direction defined as Y _A-axis direction, the coordinate system which defines the Y _A-axis direction and any direction perpendicular as Z _A-axis direction with respect to the acceleration sensor. At this time, the direction of X _A axis perpendicular to the Y _A-axis and Z _A-axis of the acceleration coordinate system (not shown) is set to coincide with the X-axis direction of the display coordinate system.

To FIG. 14 (A) to Y _A-axis direction of the gravitational acceleration direction and the acceleration coordinate system showing an example is equivalent, in FIG. 14 (B), Y _A-axis direction of the gravitational acceleration direction and the acceleration coordinate system with unequal Here is an example.

Acceleration sensor because it has a function of detecting a gravitational acceleration G, it is possible to calculate the inclination angle theta _A relative to the direction of the gravitational acceleration from the detected values on the Y _A-axis and Z _A axis plane. That is, the inclination angle θ _{A with} respect to the gravitational acceleration G is configured to be calculated from the following equation (1).

In this equation (1), Y _A represents the acceleration in the Y _A axis direction detected by the acceleration sensor, and Z _A represents the acceleration in the Z _A axis direction.

When the gravitational acceleration direction and the vertical direction of the seat surface portion of the seat coincide with each other, the inclination angle θ _S of the seat back portion coincides with the inclination angle θ _A of the acceleration sensor with respect to the gravitational acceleration.

However, in the seat of such aircraft, because the aircraft is tilted in flight, that the direction perpendicular to the seating surface of the gravitational acceleration direction and the seat do not coincide is assumed, in this case, the inclination angle of the seat back portion theta _S Does not coincide with the inclination angle θ _A of the acceleration sensor with respect to the gravitational acceleration.

Therefore, a method for detecting the tilt angle in the case where the gravitational acceleration direction and the direction perpendicular to the seat surface do not coincide will be described with reference to FIG. Here, it is assumed that the aircraft is pitched and tilted obliquely.
That is, in consideration of the situation in which the fuselage is pitched and tilted, in the case shown in FIG. 15, the tilt sensor is installed not only on the seat back portion (tilt sensor 110A (first tilt sensor)) but also on the seat surface portion of the seat. (Inclination sensor 110B (second inclination sensor)).

As described above, when the stereoscopic image display device 11 is mounted on a seat of an airplane or the like in which the aircraft is tilted, these two tilt sensors are provided, and the tilt sensor installed on the seat surface portion of the seat is provided in the moving object state detection unit 110. A function of calculating a difference value between the inclination angle detected by 110B and the inclination angle detected by the inclination sensor 110A installed on the back surface of the seat is provided, and the inclination angle θ _S of the back surface of the seat is calculated by this function. Also good.

On the other hand, if only the calculation of the angle difference value of the inclination angle (θ _SO : FIG. 10) of the seat back portion on which the observer is seated and the inclination angle (θ _SP : FIG. 10) of the front seat rear portion is shown, As shown in FIG. 13, a configuration may be adopted in which a tilt sensor is installed only in the seat back portion, and the moving object state detection means 110 obtains the difference value of the tilt angle detected by the tilt sensor.

When the aircraft yaws, the relationship between the vertical direction of the seat surface portion of the seat and the direction of gravity acceleration does not change. In addition, when the aircraft is rolling, the relationship between the vertical direction and the gravitational acceleration direction of the seat surface portion of the seat is changed, but the ratio of the gravitational acceleration detected by the Y _A-axis direction and Z _A-axis direction does not change Therefore, the inclination angle θ _A can be calculated from the above equation (1). (However, if the aircraft is tilted 90 ° by rolling, since the gravitational acceleration detected by the Y _A-axis direction and Z _A-axis direction is 0, the inclination angle theta _A becomes impossible calculated.)

  In addition, when an acceleration sensor is used as the tilt sensor as described above, it is possible to detect the timing at which the seat back portion falls down by detecting the amount of change in acceleration.

Here, as an example, the time variation of the acceleration Z _A of the acceleration sensor installed in the seat back portion is detected in FIG. 16. Here, the vertical axis represents the acceleration Z _A in the Z _A axis direction, and the horizontal axis represents the detection time of the acceleration Z _A.

The acceleration sensor mainly detects only gravitational acceleration when the seat back is stationary. However, if the seat back portion is moved collapsed, because in addition to the gravitational acceleration to detect the acceleration with respect to movement of the seat back portion, the acceleration Z _A is increased. Therefore, in order to cope with such a situation, an arbitrary threshold value Z _A0 is set in advance, and when the acceleration Z _A exceeds the threshold value Z _A0 , it is determined that the seat back portion has fallen and moved. It may be configured.

  With the above processing, the moving object state detection unit 110 can detect the timing at which the seat back portion falls.

Further, by acceleration and deceleration of the aircraft itself, but changes in acceleration Z _A occurs, a change in acceleration Z _A due to acceleration and deceleration of the aircraft itself, affects the entire seat in the airplane.
Therefore, when the acceleration Z _A of the acceleration sensor of the entire seat is detected is changed all at once, it is determined that due to the acceleration and deceleration of the aircraft itself, have fallen seat back portion, even if in excess of the arbitrary threshold Z _AO The moving object state detection unit 110 may be configured to determine that there is no.

In the above description, an example in which an acceleration sensor is used as the inclination sensor that detects the inclination angle θ _S of the seat back portion is not limited to this, but a gear rotation detection sensor is used instead of the acceleration sensor. Alternatively, an electric motor rotation detection sensor or the like may be used.

Here, FIG. 17 shows an example in which the gear rotation detection sensor is installed at the joint portion between the seat surface portion and the backrest portion of the seat. 17A shows a case where the inclination angle of the seat back portion is θ _S1 , and FIG. 17B shows a case where the inclination angle of the seat back portion is θ _S2 .

In the gear rotation detection sensor, the gear position (gear meshing position) changes depending on the inclination angle θ _S of the seat back portion. Therefore, by previously registering the relationship between the gear position and the inclination angle θ _S , the inclination angle θ _S can be detected from the gear value.

Alternatively, the rotational speed of the gear (the number of movements of the meshing position of the gear) when the seat back is tilted is measured, and the tilt angle θ _S of the seat back is detected from the rotational speed. .

Next, the observation distance calculation unit 140 calculates the observation distance Z _OD from the inclination angle θ _S of the seat back portion detected by the moving object state detection unit 110 and the seat reference information registered in the observation distance calculation unit 140 in advance. It has a function to calculate.
Here, the pre-registered seat reference information includes distance information Z _SS (see FIG. 18) of the installation interval between the observer's seat and the preceding seat, and the three-dimensional image display device 11 installed on the back of the seat. Installation position information (see FIG. 19) is included.

In FIG. 18, as an example, the distance information Z _SS of the installation interval is a distance from the position of the rear leg of the observer's seat 63 to the position of the rear leg of the front seat 64.

  Further, in FIG. 19 showing the installation position information, FIG. 19A is an external view when the back of the seat is viewed from the back of the seat, and FIG. 19B is a side view of the seat from the lateral direction of the seat. It is an external view when seen.

The installation position information includes the joining member attachment length L _SP indicating the length from the fulcrum position of the movable part of the backrest part to the attachment position of the seat back part and the joining member, and the attachment position of the joining member in the Y-axis direction. , The backrest width Z _SP indicating the distance from the position of the display surface of the stereoscopic display panel means 120 in the Z-axis direction to the position of the front surface of the seat backrest in the Z-axis direction (the position of the attachment position of the joining member in the Y-axis direction) From the position in the Z-axis direction of the display surface of the stereoscopic display panel means 106 at the same position in the Y-axis direction, the front Z of the seat back portion at the position in the Y-axis direction equal to the position in the Y-axis direction of the attachment position of the joining member A backrest width Z _SP ) indicating the distance to the position in the axial direction.

In the stereoscopic image display apparatus 11 according to the first embodiment, the observation distance calculation unit 140 includes the seat reference information Z _SS , the joining member attachment length L _SP , and the backrest width Z _SP registered in advance, and the back of each seat. By using the inclination angle θ _S (θ _SO , θ _SP ), the observation distance Z _OD can be calculated by the following equation (2). Here, θ _SO indicates the inclination angle of the seat 63 of the observer, and θ _SP indicates the inclination angle of the front seat.

However, the observation distance Z _OD calculated from this equation (2) is obtained from the display surface of the stereoscopic display panel means 120 of the stereoscopic image display device 11+ installed on the back of the seat in front of the observer (O). This is the distance to the front position of the backrest portion of the seat 63.
That is, the distance _ZOO from the front position of the backrest portion of the seat on which the observer (O) is seated to the position of the eyes of the observer (O) is not considered in the observation distance _ZOD .

By the way, this distance _ZOO substantially coincides with the length from the back of the observer (O) to the binocular position. According to the 2006 human anthropometric data reported by the Human Life Engineering Research Center as a commissioned project by the Ministry of Economy, Trade and Industry, the length from the back of the general observer to the binocular position (brows) The average value of (long) is about 19 cm.

Therefore, the distance _ZOO from the front position of the back portion of the seat on which the observer sits to the binocular position of the observer is assumed to be about 19 cm (19 cm is adopted as the distance _ZOO ), and the above equation (2) the calculated viewing distance Z _OD value obtained by subtracting the distance Z _OO from, may be observed distance calculating unit 140 calculates the viewing distance.
Thereby, a calculated value corresponding to the observation distance Z _OD in FIG. 10 or Z _OD ′ in FIG. 11 can be obtained.

In the above formula (2), the eye height (position in the Y-axis direction) of the observer (O) is the height (position in the Y-axis direction) of the attachment position of the joining member of the stereoscopic image display device 11. The observation distance _ZOD was calculated on the assumption that they coincided.

  With the above processing, the observation distance calculation unit 140 realizes calculation of an observation distance (relative distance between the stereoscopic display panel unit 120 and the observer) that represents the distance in the depth direction between the observer and the stereoscopic image display device 11.

The display setting adjustment unit 170 refers to the observation distance Z _OD calculated by the observation distance calculation unit 140 and the device characteristic data stored in the device characteristic data storage unit 160, and appears as the seat back portion tilts. It is a structural member that adjusts the display setting of a stereoscopic image so as to reduce the influence of crosstalk and reverse viewing.

  Here, the device characteristic data in the device characteristic data storage unit 160 represents the optical characteristics of the stereoscopic display panel unit 120 as described above. As an example of the device characteristic data, 3D crosstalk shown in FIG. Characteristic data can be listed.

In FIG. 20, the horizontal axis represents the viewing angle θ _P [degree], and the vertical axis represents the 3D crosstalk amount [%]. The 3D crosstalk amount indicates a ratio at which the left-eye image is mixed with the right-eye image and a ratio at which the right-eye image is mixed with the left-eye image.

  The 3D crosstalk characteristic data takes different values depending on the optical characteristics of the stereoscopic display panel unit 120 and is determined when the stereoscopic display panel unit 120 is designed. Further, 3D crosstalk characteristic data can also be obtained by measuring the stereoscopic display panel means 120 with an evaluation device for 3D crosstalk.

In the stereoscopic image display device 11, the right eye region, the left eye region, and the 3D crosstalk region are determined depending on the 3D crosstalk characteristic data. As an example, if the viewer is defined as: ₂ the threshold value of 3D crosstalk amount can successfully visually recognize the stereoscopic image beta (see the two-dot chain lines in FIG. 20), the region of the viewing angle theta _P2 through? _P2 right eye The region up to the region of viewing angles θ _{P2 to} θ _P4 is the 3D crosstalk region, and the region of viewing angles θ _{P4 to} θ _P8 is the left eye region.

  Here, FIG. 21 shows an optical model that projects the image for the right eye and the image for the left eye toward the observer's binocular position corresponding to FIG.

In FIG. 21, the portions of the viewing angles θ _{P2 to} θ _P4 are 3D crosstalk regions. Therefore, compared to the case of FIG. 6, the right eye region to be formed as in the right eye region 80R and the left eye regions 80L and 82L. And the left eye area becomes narrower. For the right eye 55R, the right eye region 80R is a normal viewing region, the left eye regions 80L and 82L are reverse viewing regions, and the other regions are 3D crosstalk regions.

Other examples of, the 3D crosstalk amount threshold when defined as beta ₁ or less (see the one-dot chain lines in FIG. 20), to the region of the viewing angle theta _P1 through? _P5 becomes 3D crosstalk area, otherwise The viewing angle θ _P is the right eye region or the left eye region. An optical model of the stereoscopic image display device 11 in such a case is shown in FIG.

In FIG. 22, the viewing angle θ _{P1 to} θ _P5 is a 3D crosstalk region. Therefore, the right eye region 90R and the left eye region 90L are narrower than the case of FIG. 21 as the right eye region and the left eye region. , 92L is formed. For the right eye 55R, as in the case of FIG. 6, the right eye region 90R is a normal viewing region, the left eye regions 90L and 92L are reverse viewing regions, and the other regions are 3D crosstalk regions.

  As described above, the normal viewing region, the reverse viewing region, and the 3D crosstalk region are determined depending on the 3D crosstalk characteristic data.

  Note that the threshold value of the 3D crosstalk amount can be determined from optical measurement and subjective evaluation of the stereoscopic image display device 11.

  In addition, as an apparatus capable of optically measuring 3D crosstalk, there are measurement apparatuses that employ various systems such as a conoscope system, a goniometer system, and a Fourier system. According to such a measuring apparatus, the luminance distribution with respect to the viewing angle can be measured, and the 3D crosstalk amount can be calculated from the following equation (3).

Here, 3D-CT (θ _P ) represents the 3D crosstalk amount with respect to the viewing angle θ _P. Further, Y and (LBRW) Y and (LBRB) Y (LWRB) represents the luminance value with respect to the viewing angle theta _P. Y (LBRW) is a luminance value when the left-eye image is black and the right-eye image is white; Y (LBRB) is a luminance value when the left-eye image is black and the right-eye image is black; Y (LWRB) represents a luminance value when the left-eye image is white and the right-eye image is black.

  Even when measurement is performed using a measurement apparatus employing any of the above-mentioned methods, a large difference is not seen in the qualitative results, but quantitative numerical values differ depending on the measurement method and apparatus specifications. When a general measurement result and a subjective stereoscopic viewing evaluation result are collated, a stereoscopic image can be visually recognized if 3D crosstalk is approximately 10% or less, and this value is used as a threshold value for the 3D crosstalk amount. be able to.

According to the optical model of FIG. 21, when the observation distance Z _OD is equal to the optimal viewing distance OD, the observer can visually recognize a normal stereoscopic image, but the observation distance Z _OD is the shortest viewing distance due to the inclination of the seat back portion. If it becomes shorter than ND, an observer visually recognizes a double image by 3D crosstalk, and thus a normal stereoscopic image becomes invisible.

  By the way, the 3D display panel means 120 has individual differences in device characteristic data indicating optical characteristics due to variations in manufacturing. The variation at the time of manufacture is mainly caused by a positional deviation when the liquid crystal display panel serving as the electro-optic means of the stereoscopic display panel means 120 and the lenticular lens serving as the optical separation means are bonded.

However, if the amount of positional deviation is equal to or less than a predetermined allowable value (± Δθ _LIM ), equivalent or representative device characteristic data is substituted even if it is not the same as the device characteristic data unique to the stereoscopic display panel means 120. It is possible. Here, the device characteristic data corresponding to the stereoscopic display panel means 120 and a device equivalent thereto, which can be adopted in the first embodiment and each of the following embodiments, is referred to as “device characteristic data relating to the stereoscopic display panel means 120”. Called.

  As an example, FIG. 23 shows an optical model diagram in which the direction of light rays projected from the center position of the stereoscopic display panel means 120 is inclined due to variations in manufacturing.

FIG. 23A shows an optical model diagram when the light beam direction is projected in the front direction (Δθ = 0 °) without the positional deviation, and FIG. 23B shows the light beam direction due to the positional deviation. FIG. 23C shows an optical model diagram when tilting to a predetermined allowable value -Δθ _LIM (Δθ = −Δθ _LIM ), and FIG. 23C shows Δθ _LIM which is a predetermined allowable value in which the light direction Δθ is in the opposite direction. An optical model diagram in the case of tilting up to (Δθ = Δθ _LIM ) is shown.

FIG. 23D shows an optical model diagram in which the results of FIGS. 23A, 23B, and 23C are overlaid. As shown in FIG. 23D, when the manufacturing variation is equal to or smaller than a predetermined allowable value (± Δθ _LIM ), the optimal viewing distance OD and the stereoscopic viewing area of the stereoscopic display panel unit 120 are substantially equivalent. The value of ± Δθ _{LIM serving as} the allowable value can be arbitrarily set by subjective evaluation according to the stereoscopic display size, the stereoscopic viewing area size, and the type of application to be applied.

  Therefore, if the device characteristic data of the typical stereoscopic display panel unit 120 such as the result of FIG. 23A is stored in the device characteristic data storage unit 160, for example, the device characteristic data becomes the same model. It can also be used for other stereoscopic display panel means 120.

The image data storage unit 150 has a function of storing or receiving image data.
Here, FIG. 24 shows an example of image data stored in the image data storage unit 150.

In this example, an L image and an R image are stored in the image data storage unit 150 as image data of stereoscopic image content. The L image is an image for the left eye projected on the left eye region, and the R image is an image for the right eye projected on the right eye region. As a value of each pixel relating to the LR image (both L image and R image), a luminance value (RGB value) is held, and this LR image is displayed on the stereoscopic display panel 120.
Here, the u-axis direction of the image data matches the X-axis direction of the display coordinate system of the stereoscopic image display device 11, and the v-axis direction matches the Y-axis direction of the display coordinate system.

  In the above example, the L image and the R image are stored in the image data storage unit 150. However, in addition to these images, a parallax image representing a parallax value between the L image and the R image is added. And may be stored. FIG. 25 shows the relationship between the parallax image and the parallax value.

The right diagram in FIG. 25 is a diagram showing a parallax value PA for the pixel column extracted from the parallax image (the left diagram in FIG. 25) from the pixel column of the arbitrary value v ₁ on the v-axis. Here, the parallax value PA indicates a positional shift amount of the pixel position of the R image corresponding to the pixel position of the L image with reference to the L image.

As a specific example, FIG. 26 shows a relationship diagram between parallax values and LR images.
Disparity value PA of the position of the parallax image (u _1, v _2), as shown in equation (4) below, the position of the pixels of the L image and the (u _1, v _2), the R image corresponding thereto This is a difference value from the pixel position (u ₂ , v ₂ ).

Here, the parallax image detects the feature points of the L image and the R image, matches the feature points of the R image corresponding to the feature points of the L image, and calculates the parallax value from the amount of positional deviation between the feature points. Alternatively, it may be generated based on the parallax value.
Further, a depth image may be used instead of the parallax image. This depth image is an image in which the value of each pixel represents the depth distance of the stereoscopic image content.

  In addition, a plurality of LR images having various parallax values may be stored in the image data storage unit 150 in advance. An example of LR image groups having various parallax values stored in the image data storage unit 150 is shown in FIG.

The LR image at the top of FIG. 27 represents an LR image having a parallax value originally held in the stereoscopic image content, and the LR image at the bottom of FIG. 27 is an LR image (LR image) having a parallax value of 0. Are the same image and become a planar image). In addition, the LR image group in the middle part of FIG. 27 is an LR image group adjusted to an arbitrary parallax value.
By storing LR image groups having various parallax values in the image data storage unit 150 in advance, it becomes possible to immediately display LR images having arbitrary parallax values.

The display setting adjustment unit 170 reduces the effects of 3D crosstalk and reverse viewing that appear with the inclination of the back of the seat so that a good 3D image can be displayed on the display surface of the 3D display panel unit 120. This is a component that adjusts the display setting of the stereoscopic image display device 11 with reference to the observation distance Z _OD calculated by the observation distance calculation means 140 and the device characteristic data stored in the device characteristic data storage means 160.

  In the first embodiment, the display is different between the case where the optical separation characteristic of the optical separation unit included in the stereoscopic display panel unit 120 can be dynamically changed and the case where the optical separation characteristic is static and cannot be changed. Perform setting adjustment processing.

  Here, FIG. 28 shows a classification table (classification table I) of adjustment methods that can be adopted when the change of the light separation characteristics is possible or impossible. An element capable of dynamically changing the optical separation characteristics of the optical separation means of the stereoscopic display panel means 120 is called an active element, and an element whose light separation characteristics are static and cannot be changed is called a static element.

When the optical separation characteristic of the optical separation means of the stereoscopic display panel means 120 can be dynamically changed, the display setting adjustment means 170 changes the optical separation characteristic to change the optimum viewing distance OD, thereby observing. It is possible to perform display setting adjustment processing according to the distance Z _OD .

  An example of the optical separation means using an active element is a liquid crystal lens. The liquid crystal lens can control the refractive index distribution in the liquid crystal lens by controlling the voltage, thereby changing the lens power. In other words, the display setting adjusting unit 170 can change the optical model formed by the stereoscopic display panel unit 120 and arbitrarily change the optimum viewing distance OD by controlling the voltage.

Here, the lens power represents the degree to which the optical element collects or diverges the light beam, and means the refractive power by which the lens bends the traveling direction of the light beam. When the lens power is strong, the light beam is greatly refracted, so that the focal length of the lens is shortened.
As described above, the display setting adjustment unit 170 is configured to change the optimum viewing distance OD by changing the lens power, and to perform a display setting adjustment process in accordance with the observation distance _ZOD .

  This state will be described with reference to FIGS. 29 and 30 exemplifying the stereoscopic display panel means 120 including the liquid crystal lens 120A and the display panel 120B.

In the examples shown in these drawings, the control electrodes E _{1 to} E ₄ are installed on the upper surface of the liquid crystal lens 120A, and the common electrode E ₀ is installed on the lower surface.

Here, the control electrodes E _{1 to} E ₄ on the upper surface and the common electrode E ₀ on the lower surface may be interchanged in the upper and lower surfaces. That is, set up a common electrode _{E 0} to the upper surface of the liquid crystal lens 120A, may be adopted a configuration that placing the control electrodes _E 1 to E ₄ on the lower surface.

The control electrode is composed of four types of electrodes (E ₁ , E ₂ , E ₃ , E ₄ ) as shown in FIGS. 29 and 30, and is different for each of the electrodes (E _{1 to} E ₄ ). It is comprised so that a voltage can be applied. Since the refractive index of the liquid crystal lens changes according to the applied voltage value, the display setting adjustment unit 170 controls the applied voltage value to the control electrodes E _{1 to} E ₄ to control the refractive index distribution of the liquid crystal lens. Thus, the lens power changing process is realized.

  In FIG. 29 and FIG. 30, the voltage application conditions to the control electrode are different, and the voltage value applied to the control electrode is higher in FIG. 30 than in FIG. Also, the lower figure of each of these figures shows the cross-sectional structure of the stereoscopic display panel 120, and the upper figure of each figure shows the refractive index distribution in the X-axis direction of the liquid crystal lens 120A.

First, in FIG. 29, a high condition even the voltages _{V 1} than the voltage _{V 2} (voltages _{V 1>} Voltage _{V 2),} i.e., the voltages _{V 1} to the control electrode _{E 1} and the control electrode _{E 4,} a control electrode _{E 2} The state of light rays in the stereoscopic display panel means 120 when the voltage V ₂ is applied to the control electrode E ₃ (lower diagram) and the refractive index distribution in the X-axis direction (upper diagram) are shown.

The difference between the maximum refractive index corresponding to the lens apex (position X _{2 in the} above diagram) and the minimum refractive index corresponding to the lens valley (positions X ₁ and X _{3 in the} above diagram) corresponds to the lens power. In FIG. 29, the value is Δn ₁ .
Also, the unit lenses, representing the position corresponding to the lens valley to a position corresponding to the next lens valley lens portion (e.g., from position X ₁ to position X _3).

Next, in FIG. 30, the voltages _{V 1} higher voltage _{V 3} than (Fig. 29) to the control electrode _{E 1} and the control electrode _{E 4,} the voltage _{V 2} to the control electrode _{E 2} and the control electrode _{E 3} The state of light rays in the stereoscopic display panel means 120 when applied respectively (lower diagram) and the refractive index distribution in the X-axis direction (upper diagram) are shown.

The lens power, which is the difference between the maximum refractive index and the minimum refractive index under such conditions, has a value of Δn2 that is larger than Δn1 shown in FIG.
As described above, the lens power is increased by controlling the voltage and the light ray 20 is largely refracted as shown in the cross-sectional view below, whereby the optimum viewing distance OD can be shortened.

An example of an optical model corresponding to the voltage control of the liquid crystal lens is shown in FIG.
FIG. 31 (A) represents the optical model when the optimum viewing distance OD of the stereoscopic display panel unit 120 is OD _1. FIG. 31B shows an optical model when the lens power is increased by the voltage control of the liquid crystal lens as described in FIG. 30 and the optimum viewing distance is reduced from OD ₁ to OD ₂ . However, since the adjustment range of the lens power of the liquid crystal lens by voltage control is finite, the adjustment range of the optimum viewing distance OD also takes a finite value.

Next, FIG. 32 shows an example of the adjustment range of the optimum viewing distance OD.
In FIG. 32, the optimum viewing distance (OD _MIN ) represents the distance when the lens power of the liquid crystal lens is increased to the maximum by voltage control and the optimum viewing distance OD is minimized. The optimum viewing distance (OD _MAX ) represents the distance when the lens power is reduced by voltage control and the optimum viewing distance OD is maximized.

Therefore, the adjustment range of the optimum viewing distance OD is a range from the shortest optimum viewing distance (OD _MIN ) to the longest optimum viewing distance (OD _MAX ), as shown in FIG.

In the display setting adjustment process by the display setting adjustment unit 170, the lens power of the liquid crystal lens is changed by voltage control so that the observation distance _ZOD calculated by the observation distance calculation unit 140 matches the optimum viewing distance OD. .

Here, the liquid crystal lens used for stereoscopic display panel unit 120, calculates a variation range of viewing distance Z _OD with the slope of the advance seat back portion, even after changing the viewing distance Z _OD within the variation range, It is desirable to select a liquid crystal lens having a lens power with which the optimum viewing distance OD of the stereoscopic display panel means 120 can be adjusted.

  Thus, by controlling the refractive index distribution of the liquid crystal lens, the refraction of the light beam can be adjusted, and the optimum viewing distance can be adjusted. Then, the stereoscopic viewing range can be adjusted by adjusting the refraction of the light beam and adjusting the optimum viewing distance.

In the above example, an example in which the optimal viewing distance OD is changed by using a liquid crystal lens as the optical separation means of the stereoscopic display panel means 120 is shown, but instead of the liquid crystal lens, a parallax barrier with a variable barrier pitch is used. A configuration in which the optical separation characteristic is dynamically changed may be adopted.
For example, a parallax barrier is provided with a barrier (light-shielding plate) having a barrier pitch sufficiently smaller than the pixel pitch, the position of the barrier that blocks light is selected, and the position of the slit 6a shown in FIG. Change the viewing distance OD.

As described above, in the display setting adjustment process using a liquid crystal lens or a parallax barrier whose optical separation characteristics can be dynamically changed, the optical separation characteristics of the stereoscopic display panel unit 120 are changed, and the optimum viewing distance OD is changed. Then, the display setting of the stereoscopic image was adjusted according to the observation distance _ZOD .

Next, when the optical separation characteristic of the optical separation means of the stereoscopic display panel means 120 is static and cannot be changed, the image data (L image and R) displayed on the stereoscopic display panel means 120 by the display setting adjustment means 170. by changing the disparity value PA of the image), it employs a configuration of adjusting the display settings in accordance with the viewing distance Z _OD.

  Examples of the optical separation means using a static element whose optical separation characteristics are static and cannot be changed include a lenticular lens whose lens power cannot be changed and a parallax barrier whose barrier pitch is not changed.

The specific parallax value PA changing process by the display setting adjusting unit 170 is performed by referring to the observation distance _ZOD calculated by the observation distance calculating unit 140 and the 3D crosstalk characteristic data stored in the device characteristic data storage unit 160. The parallax limit value (parallax allowable value PA _th ) at which a stereoscopic image can be displayed is calculated, and the parallax value PA of the image data is changed to be equal to or smaller than the parallax allowable value PA _th .

Here, an example of a change in the parallax allowable value PA _th corresponding to the observation distance Z _OD is shown in FIG.
If the observation distance Z _OD is near the optimum visual recognition distance OD, the value of the parallax allowable value PA _th increases. Conversely, if the observation distance Z _OD is away from the optimal visual recognition distance OD, the value of the parallax allowable value PA _th decreases. Therefore, the parallax value PA of the image data transmitted to the stereoscopic display panel unit 120 is changed in accordance with the change in the parallax allowable value _PAth .

Specifically, first compares the parallax maximum value PA _max of the parallax allowable value PA _th image data, when the larger parallax maximum value PA _max of the image data than the parallax allowable value PA _th is a parallax adjustment value PA _C is calculated by the following equation (5).

Then, the calculated parallax adjustment value PA _C by multiplying the disparity value PA of the image data, the disparity maximum value PA _max of the image data is changed disparity value PA of the image data to be equal to or less than the parallax allowable value PA _th To do.

Accordingly, as the observation distance Z _OD deviates from the optimum viewing distance OD, the stereoscopic display panel means 120 displays image data with a reduced parallax value PA, so that the observation distance Z _OD changes. using the calculated parallax adjustment value PA _C, it may be to adjust the disparity value PA of the stereoscopic image data to be displayed.

  The details of the display setting adjustment processing for changing the parallax value PA of the image data with reference to the 3D crosstalk characteristic data and the observation position are disclosed in the above-mentioned Patent Document 7.

  Here, as shown in the classification table of FIG. 28, the display setting adjustment process for changing the parallax value PA of the image data uses an optical separation means (liquid crystal lens or the like) whose optical separation characteristics can be dynamically changed. It is also applicable to cases.

  In this way, by changing the parallax value of the stereoscopic image data in accordance with the observation position, it is possible to reduce the influence of 3D crosstalk and reverse viewing, and to reduce discomfort to the observer.

  Next, a situation where 3D moire occurs will be described with reference to FIGS. 34 and 35. FIG.

First, an example of luminance-viewing angle characteristic data of the stereoscopic display panel unit 120 is shown in FIG.
The brightness - in the viewing angle characteristic data, the horizontal axis represents the viewing angle theta _P, the vertical axis represents luminance value Y on the display surface of the stereoscopic display panel unit 120.

The luminance distributions of Y (LWRB) and Y (LBRW) in FIG. 34 intersect at a point (X1, Y1) in the vicinity of the viewing angle θ _{P3 that} is the front position of the stereoscopic display panel means 120. They also meet at a point (XR2, YR2) in the vicinity of viewing angle theta _P6, intersect at a point (XL2, YL2) in the vicinity of viewing angle theta _P0. The spacing in the θ direction of the point and (X1, Y1) and a point (XR2, YR2), corresponds to the width _{P R} 'is a projected width of the right-eye image, a point (X1, Y1) and a point (XL2, YL2 ) spacing in the theta _P direction and corresponds to the width P _{L 'is} the projection width of the left-eye image.

Here, although a decrease in luminance is observed near the point (X0, Y0), this luminance decrease is called 3D moire. When the left eye is in the range of θ _P1 to θ _P2 and the right eye is in the range of θ _P4 to θ _P5 , it is difficult to visually recognize the 3D moire, but one or both of the left and right eyes are in the other range. when present in (theta such as in the range of _{P2 ~θ P3 ~θ P4)} is, 3D moire is visible.

  This 3D moire is easily visible when the observer moves into the 3D crosstalk region, and the influence of the 3D moire depends on the observation distance representing the distance in the depth direction between the observer and the stereoscopic image display device 11. The appearance position of luminance unevenness due to 3D moire can be calculated from the luminance-viewing angle characteristic data shown in FIG.

  Here, the luminance fluctuation value on the display surface of the stereoscopic display panel means 120 calculated from the luminance-viewing angle characteristic data is shown in FIG. FIG. 35 (A: A-1, A-2, A-3) shows a situation in which a stereoscopic image is normally visible, and FIG. 35 (B: B-1, B-2, B-3). ) Shows a situation where a stereoscopic image cannot be normally visually recognized due to the appearance of luminance unevenness due to 3D moire.

FIG. 35 (A-1) shows the positional relationship between the observation position of the observer (O) and the normal viewing area of the stereoscopic display panel means 120 when the observation distance Z _OD matches the optimal viewing distance OD. FIG. 32 (B-1) shows an observer when the unevenness of brightness due to 3D moire appears when the observation distance Z _OD changes due to the inclination of the seat back portion to become Z _OD ′, becomes shorter than the shortest viewing distance ND. The positional relationship between the observation position of O) and the normal viewing area of the stereoscopic display panel means 120 is shown.

  35A-2 and FIG. 35B-2 show luminance fluctuation values corresponding to positions in the horizontal direction (X-axis direction) at specific Y positions on the display surface of the stereoscopic display panel means 120. FIG. In each of these drawings, the vertical axis represents the luminance value on the display surface, and the horizontal axis represents the position of the display surface of the stereoscopic display panel means 120 in the X-axis direction. In FIG. 35A-2, the luminance value does not vary with respect to the X-axis direction, whereas in FIG. 35B-2, the luminance value varies with respect to the X-axis direction.

  FIGS. 35A-3 and 35B-3 show the image display state on the display surface of the stereoscopic display panel unit 120 when a white image is displayed. A stereoscopic image having no luminance unevenness is displayed on the display surface of the stereoscopic display panel unit 120 of FIG. On the other hand, in FIG. 35 (B-3), a stereoscopic image in which linear luminance unevenness appears on the display surface of the stereoscopic display panel means 120 is displayed at the X-axis position where the luminance value decreases.

As a countermeasure against 3D moire that appears when the observation distance Z _OD deviates from the optimum viewing distance OD, it is conceivable to adopt a configuration in which the display setting of the stereoscopic image display device 11 is adjusted, similarly to the countermeasure against 3D crosstalk. .
In this display setting adjustment process, different display settings are used depending on whether the optical separation characteristic of the optical separation means of the stereoscopic display panel means 120 can be changed dynamically or when the optical separation characteristic is static and cannot be changed. Perform the adjustment process.

  Here, FIG. 36 shows a classification table (classification table II) of adjustment methods that can be adopted when the change of the light separation characteristics is possible or impossible.

When the optical separation characteristics can be dynamically changed, the display is adjusted to the observation distance Z _OD by changing the optical separation characteristics and changing the optimum viewing distance OD in the same manner as the 3D crosstalk countermeasure described above. Perform setting adjustment processing.
When a liquid crystal lens is used as the optical separating means, the 3D moire countermeasure may be taken by completely turning off the lens power and displaying a planar image.

If the optical separation characteristic is static and cannot be changed, the display setting is adjusted according to the observation distance Z _OD by changing the luminance value of the image data displayed on the stereoscopic display panel unit 120. In this luminance value changing process, the luminance variation value of 3D moire appearing on the display surface of the stereoscopic display panel unit 120 is calculated with reference to the luminance-viewing angle characteristic data. The calculation of the luminance fluctuation value of 3D moire is more preferable in consideration of not only the observation distance Z _OD (Z-axis direction) but also the observation position including the position in the X-axis direction.

However, in the first embodiment, the viewing distance because it measures the Z _OD, the position of the X-axis direction is always assumed to be constant, the luminance - the viewing angle characteristic data and viewing distance Z _OD 3D moire only The brightness fluctuation value is calculated. Then, by adjusting the luminance value of the image data so that the luminance fluctuation value due to the 3D moire becomes flat, the influence of the 3D moire can be reduced.

  The details of the display setting adjustment processing for changing the luminance value of the image data with reference to the luminance-viewing angle characteristic data and the observation position are disclosed in Patent Document 7.

  In this way, by changing the luminance value of the stereoscopic image data in accordance with the observation position, it is possible to reduce the influence of 3D moire and to reduce discomfort to the observer.

  As shown in FIG. 36 (Classification Table II), the display setting adjustment process for changing the luminance value of the image data uses an optical separation means (liquid crystal lens or the like) whose optical separation characteristics can be dynamically changed. It can be applied even if

(Description of operation)
Next, the contents of the image processing operation (stereoscopic image processing method) in the stereoscopic image display device 11 will be described based on the flowchart shown in FIG.

  The stereoscopic image display apparatus 11 that has received a command signal for displaying a stereoscopic image by an observer's operation or the like first detects the seat state of the observer and the seat state of the front seat by the moving object state detection unit 110. . Each seat state here refers to the inclination angle of the seat back portion. (FIG. 37: Step S101).

  Next, the observation distance calculation unit 140 calculates an observation distance (relative distance between the observer and the stereoscopic image display device 11) that represents the distance in the depth direction between the position of the observer and the stereoscopic image display device 11. More specifically, while referring to the inclination angle (seat state) of the back of the seat of the observer detected by the moving object state detection means 110 and the inclination angle (seat state) of the back of the seat in front of the observer, the observation distance is calculated. The means 140 calculates the observation distance using the seat reference information (seat installation interval distance information, installation position information) registered in itself. (FIG. 37: Step S102).

Next, the display setting adjustment unit 170 acquires 3D crosstalk characteristic data or luminance-viewing angle characteristic data from the device characteristic data storage unit 160 as device characteristic data.
As described above, an example of 3D crosstalk characteristic data is shown in FIG. 20, and an example of luminance-viewing angle characteristic data is shown in FIG. 34 (FIG. 37: step S103).

  At the same time, the display setting adjustment unit 170 obtains image data as stereoscopic image content from the image data storage unit 150 (FIG. 37: step S104).

  The stereoscopic image display apparatus 11 uses the display setting adjustment unit 170 to observe the observation distance calculated by the observation distance calculation unit 140 (step S102) and the device characteristic data acquired from the device characteristic data storage unit 160 (step S103). With reference to Fig. 37, the display setting adjustment process according to the observation distance is performed (Fig. 37: step S105).

  As the display setting adjustment processing, a method of controlling the optical separation unit of the stereoscopic display panel unit 120 so that the observation distance and the optimum viewing distance coincide with each other, or the image data acquired from the image data storage unit 150 (step S104 above). For example, a method of changing the parallax value and the luminance value according to the observation distance and the device characteristic data can be employed.

  Subsequently, the image data acquired from the image data storage unit 150 (step S104) is displayed on the image display panel of the stereoscopic display panel unit 120 by the display setting adjustment unit 170 according to the display settings adjusted in step S105. That is, the stereoscopic image that has been subjected to the display setting adjustment processing is displayed and provided to the observer (FIG. 37: step S106).

Next, it is set whether the stereoscopic image display process is to be stopped or continuously executed (FIG. 37: step S107).
For example, when the power of the stereoscopic image display device 11 is turned off or when the observer instructs to interrupt the stereoscopic image display, the stereoscopic image display process is stopped (FIG. 37: Yes in Step S107).
On the other hand, if there is no event for stopping the stereoscopic image display process, the process returns to step S101 to continuously execute the stereoscopic image display process, and the above-described series of processing contents (steps S101 to S107) are repeatedly executed. To do.

  With the above flowchart processing, even if the back portion of the seat is inclined and the display position of the stereoscopic image display device 11 is moved, the inclination angle of the seat rear portion is detected, and the stereoscopic image display device 11 installed on the seat rear portion Since the relative distance (observation distance) with the observer can be calculated, the influence of double images, reverse viewing, and 3D moire due to 3D crosstalk can be reduced with only an inexpensive measurement device, and the observer does not feel uncomfortable. A stereoscopic image display device can be provided.

  In the optical model (FIGS. 21 and 22) of the stereoscopic display panel unit 120 of the first embodiment, an example in which two different viewpoint images (L image and R image) are projected from the stereoscopic display panel unit 120 is shown. However, the stereoscopic image display device 11 in the first embodiment is not limited to the configuration having two viewpoints, and can also be applied to the stereoscopic display panel unit 120 that projects multi-viewpoint images.

  Here, the execution contents of each step in the above steps S101 to S107 (FIG. 37) are programmed, and this series of each control program is realized by a computer provided in advance in the stereoscopic image display device 11. May be.

(Effect of 1st Embodiment)
In the first embodiment, the state information relating to the position state of the seat as the moving object (the tilted state of the backrest portion and the front and back positions) is detected, and a stereoscopic image is obtained using the observation distance calculated based on the state information. Therefore, it is possible to effectively reduce the effects of double image, reverse viewing, and 3D moire caused by 3D crosstalk with an inexpensive configuration, and the viewer does not feel uncomfortable. A significant stereoscopic image can be displayed.

[Second Embodiment]
A second embodiment of the stereoscopic image display apparatus according to the present invention will be described with reference to FIGS. Here, the same reference numerals are used for the same components as those in the first embodiment described above, and the same reference numeral (12) is also used as a generic name for the stereoscopic image display apparatus in the second embodiment.

(Overall configuration)
In the second embodiment, by using an inexpensive image input device (imaging device), only the observation distance Z _OD from the display surface of the stereoscopic display panel unit 120 of the stereoscopic image display device installed on the back of the seat to the observer is used. Instead of calculating the observation position _POD indicating the relative position of the observer's observation position with respect to the center position of the display surface of the stereoscopic display panel means 120 (including the relative position in the X-axis direction and the Y-axis direction). it is characterized in accordance with the P _OD in that employs a configuration of adjusting the display settings of the three-dimensional image display device.

  As shown in FIG. 38, the stereoscopic image display device 12 according to the second embodiment includes an arithmetic processing unit 132 that performs various arithmetic processes in addition to the moving object state detection unit 110 and the stereoscopic display panel unit 120, and an observer. And imaging means 280 for recording the image data and recording the image data.

The arithmetic processing unit 132 includes an image data storage unit 150 and a device characteristic data storage unit 160, and an observation position P _OD indicating the relative position of the observer's observation position with respect to the center position of the display surface of the stereoscopic display panel unit 120. Based on the observation position calculation means (relative position calculation means) 290 for calculating the image, the observation position calculated by the observation position calculation means 290, and the device characteristic data stored in the device characteristic data storage means 160 Display setting adjusting means 270 for adjusting the setting.

  Hereinafter, functions of each unit included in the stereoscopic image display device 12 will be described. Here, the moving object state detection unit 110, the stereoscopic display panel unit 120, the image data storage unit 150, and the device characteristic data storage unit 160 are the same as the units denoted by the same reference numerals in the first embodiment. It is the composition.

  The imaging unit 280 has a function of capturing an image of the observer and recording it as captured image data on a two-dimensional plane. As an example of the hardware device of the imaging unit 280, an inexpensive imaging device represented by a USB camera, a small camera module in a mobile device, or the like can be given.

In the first embodiment described above, the observation distance Z _OD is calculated on the assumption that the height of both eyes of the observer coincides with the height of the attachment position of the joining member. Then, the imaging unit 280 is employed, and the observation position calculation unit 290 detects the height of both eyes of the observer using the captured image data, and calculates the observation distance Z _OD using the height information. The configuration is to be adopted. The observation position calculation unit 290 is configured to calculate an observation position P _OD including a relative position in the X-axis direction and the Y-axis direction from the captured image data captured by the imaging unit 280 and the observation distance Z _OD. Yes.

  The imaging unit 280 is installed at the upper front of the stereoscopic image display device 12 as shown in FIG. 39 which shows an external view of the stereoscopic image display device 12, and images an observer in front of the stereoscopic image display device 12.

Next, FIG. 40 (A) and FIG. 41 (A) show an example of captured image data obtained by photographing the observer (O) with the imaging unit 280. FIG.
40B shows the state of the back of the observer (O) and the seat when the captured image data of FIG. 40A is captured, and FIG. 41B shows the state of FIG. The state of the observer (O) and the backrest of the seat when the captured image data is captured is shown.

That is, FIG. 40 is an example in which the length L _SE1 of the seat back portion corresponding to the height of both eyes of the observer (O) corresponds to the center position of the length L _SB of the entire seat back portion. FIG. 41 is an example in which the length L _SE2 of the seat back corresponding to the height of both eyes of the observer (O) corresponds to 70% of the length L _SB of the entire seat back. .

In FIGS. 40B and 41B, the seat inclination angle θ _S is 0 °, and the front surface of the seat back portion and the imaging surface of the imaging means 280 are in parallel. The u axis representing the horizontal axis direction of the captured image data matches the X axis direction in the display coordinate system of the stereoscopic image display device 12, and the v axis representing the vertical axis direction of the captured image data is the Y axis direction in the display coordinate system. Matches.

In the captured image data of FIGS. 40A and 41A, the observer (O) and the backrest portion of the seat are photographed. A face image area of the observer from the captured image data (O), detects an image area of the backrest of the seat, the height of the eyes of the observer (O) from the back portion total length L _SB seat The length L _{SE of the} corresponding seat back portion (the length along the back back from the lower surface of the seat surface portion to the eyes of the observer (O) in the second embodiment) is detected. This length L _SE is the length L _SE1 in FIG. _40B , and the length L _SE2 in FIG. _41B .

  In the process of detecting the face image area of the observer from the captured image data, template data is generated in advance from the feature amount (eyes, nose, mouth, jaw, etc.) of the facial image, and the captured image data and the template data are used. The observation position calculation means 290 performs the matching.

  In this detection process, the observation position calculation means 290 also detects the image positions (u-axis position and v-axis position) of both eyes of the observer (O). The template data is generated from the face image of the observer (O) using a machine learning method such as support vector machine (SVM) or vector quantization.

  Similarly, in the process of detecting the image area of the entire seat back portion from the captured image data, the observation position calculation means 290 uses the feature amount of the seat back portion (contour, color, pattern information, etc. of the back portion) in advance as a template. This is performed by generating data and matching the captured image data with the template data.

Further, the observation position calculation means 290 detects the length L _ISB of the image area of the entire seat back from the image area of the entire seat back, and the image position (v-axis position) of the observer's eyes from the face image area. And the length L _ISE of the image region corresponding to the height of both eyes of the observer (the length L _ISE1 in FIG. _{40B and the} length L _ISE2 in FIG. _41B ). Configured to detect.

Then, the observation position calculation means 290 uses the following equation (6) to calculate the length L _ISB of the image area of the entire seat back and the length L _ISE of the image area corresponding to the height of both eyes of the observer. The ratio R _S is calculated.

Here, since the length L _{SB of the} entire seat back portion is constant, the observation position calculation unit 290 is configured to register the information as the seat reference information in advance, so that the observation position calculation means 290 can be used for both eyes of the observer. The length L _SE of the seat back portion corresponding to the height can be calculated from the ratio R _S and the length L _{SB of the} entire seat back portion by the following formula (7).

For the viewing position calculating means 290 uses the length L _SE of the back portion of the seat corresponding to the height of the eyes of the observer calculated by the above, the viewing distance Z _OD with the inclination of the seat back portion The change amount Z _ODC is configured to be calculated.

Here, FIG. 42 shows an example in which the change amount Z _ODC of the observation distance depends on the height of both eyes of the observer.
42A, the length of the seat back portion corresponding to the height of both eyes of the observer (O) (the length along the back from the lower surface of the seat surface portion to both eyes of the observer (O)). ) _Becomes L _SE1 as in FIG. 40, and in FIG. _42B , the length of the seat back corresponding to the height of both eyes of the observer (O) becomes L _SE2 as in FIG. It is.

The observation distance change amount Z _ODC when the inclination angle θ _S is changed from 0 ° to θ _{S2 due} to the inclination of the back surface of the seat is a value shown in the following equation (8) (L in the case of FIG. 42A). _{In the case of SE1} sinθ _S2 , 42 (B), L _SE2 sinθ _S2 ).

Here, the length L _SE of the back portion of the seat corresponding to the height of the eyes of the observer, take different values de 42 (A) and FIG. 42 (B).

More specifically, the length L _SE1 of the seat back portion corresponding to the height of both eyes of the observer (O) in FIG. 42A is the center position of the length L _SB of the entire seat back portion. Therefore, the following formula (9) is obtained by substituting the value of the ratio R _S (0.5) into the above formula (7). Further, in FIG. 42B, the length of the seat back portion corresponding to the height of both eyes of the observer (O) is L _{SE2, which} is 70% of the total length L _SB of the seat back portion. Therefore, the following equation (10) is similarly obtained.

As described above, the observation position calculating means 290, by using the captured image data by the imaging unit 280, by detecting the length L _SE of the backrest of the corresponding seat to the height of the eyes of the observer, this variation _{Z ODC} viewing distance which depends on the length _{L SE} can be calculated.

  Next, as shown in the external view of FIG. 43, the stereoscopic image display device 12 installed on the seat back surface portion 61B has a Y coordinate-Z axis plane of the display coordinate system by the rotation mechanism of the joining member 61A on the seat back surface portion 61B. It is configured to move by rotating on the top.

With this rotation mechanism, even if the display surface of the stereoscopic image display device 12 is inclined downward as the seat back surface portion 61B is inclined, the installation inclination angle θ _SD of the stereoscopic image display device 12 described later (see FIGS. 45 to 47). ) Can be changed to adjust the orientation of the display surface.

Here, the adjustment of the installation angle of inclination theta _SD is to the viewer may be performed manually, automatically changing the installation angle of inclination theta _SD of the three-dimensional image display device 12 in accordance with the inclination angle of the seat back portion You may take the structure of doing.

  In FIG. 43, an example in which the imaging unit 280 is installed on the upper front of the stereoscopic image display device 12 is described. However, as shown in FIG. 44, the imaging unit 280 is separated from the stereoscopic image display device 12 and directly to the seat. You may make it install in. However, when such a configuration is adopted, the imaging unit 280 is installed at a position where the observer in front of the stereoscopic image display device 12 can be photographed, and the relative position of the stereoscopic image display device 12 with respect to the imaging unit 280 is known. Is the premise.

As shown in FIG. 43, when the imaging unit 280 and the stereoscopic image display device 12 are integrated, the imaging unit even if the installation inclination angle θ _SD of the stereoscopic image display device 12 is changed by the rotating mechanism of the joining member. The relative position of the stereoscopic image display device 12 with respect to 280 is always kept constant.

However, as shown in FIG. 44, when the imaging unit 280 is separated from the stereoscopic image display device 12 and installed directly on the seat back portion, the installation inclination angle θ of the stereoscopic image display device 12 by the rotating mechanism of the joining member. _{When the SD} is changed, the relative position of the stereoscopic image display device 12 with respect to the imaging unit 280 changes. Therefore, it is necessary to detect the installation inclination angle θ _SD of the stereoscopic image display device 12 by the rotating mechanism of the joining member and calculate the relative position P _SD between the imaging unit 280 and the stereoscopic image display device 12.

Therefore, the installation inclination angle θ _SD of the stereoscopic image display device 12 is detected with reference to FIGS. 45 and 46 showing examples in which inclination sensors (110A, 110C) are installed on the seat back portion and the stereoscopic image display device 12, respectively. An example will be described.

When the installation angle of inclination theta _SD of angle when the display surface direction of the seat back portion surface direction and the stereoscopic image display apparatus 12 of a parallel to 0 °, the installation angle of inclination theta _SD of the three-dimensional image display device 12, FIG. 45 As shown in FIG. 4, the inclination angle θ _{S of the} back of the seat detected by the inclination sensor 110A installed on the back of the seat and the inclination angle θ _{D of} the stereoscopic image display device 12 detected by the inclination sensor 110C installed on the stereoscopic image display device 12 The added value of

In other words, the observation position calculation unit 290 determines the relative position P of the stereoscopic image display device 12 with respect to the imaging unit 280 from the inclination angle θ _S of the seat back portion detected by each inclination sensor and the inclination angle θ _D of the stereoscopic image display device 12. _SD is calculated.

The relative position P _SD includes a relative position P _SQ from the imaging position T of the imaging means 280 to the rotation center position Q of the joining member, and a center position D of the display surface of the stereoscopic display panel means 120 from the rotation center position Q of the joining member. Up to the relative position _PQD .

Here, as shown in FIGS. 45 and 46, the distance from the imaging position T of the imaging means 280 to the rotation center position Q of the joining member is always constant, and this distance is set to L _SQ . The distance from the rotation center position Q of the joining member to the center position D of the display surface of the stereoscopic display panel means 120 is always constant, and this distance is set to L _QD .

Since the distance L _SQ and the distance L _QD are known values, the relative position P of the stereoscopic image display device 12 with respect to the imaging unit 280 is determined from the inclination angle θ _S of the seat back portion and the inclination angle θ _D of the stereoscopic image display device 12. _The observation position calculation means 290 is configured to calculate _SD from the following equation (11).

Here, P _SD (x) is the position of the relative position P _{SD in} the X-axis direction, P _SD (y) is the position of the relative position P _{SD in} the Z-axis direction, and P _SD (z) is the relative position P _SD . Each position in the Z-axis direction is shown.
P _SD (x) does not depend on the installation inclination angle θ _SD of the stereoscopic image display device 12 and is always constant. In the above equation (11), the value of P _SD (x) is assumed on the assumption that the photographing position T of the imaging means 280 and the center position D of the display surface of the stereoscopic display panel means 120 coincide with each other in the X-axis direction. Was set to 0.

In addition, in such a configuration, the relationship between the world coordinate system of the camera of the imaging unit 280 and the display coordinate system of the stereoscopic image display device 12 changes as the installation inclination angle θ _SD of the stereoscopic image display device 12 changes. .

Therefore, FIG. 47 shows the world coordinate system of the camera of the imaging means 280 and the display coordinate system of the stereoscopic image display device 12, and the configuration related to the coordinate system conversion processing will be described. The world coordinate system of the camera is represented by orthogonal coordinates by the C _X axis, the _CY axis, and the C _Z axis, and the display coordinate system is represented by orthogonal coordinates by the X axis, the Y axis, and the Z axis. The world coordinate system of the imaging unit 280 rotates on the Y-axis / Z-axis plane of the display coordinate system of the stereoscopic image display device 12.

Since the rotation matrix on the Y-axis / Z-axis plane is obtained from the installation inclination angle θ _SD of the stereoscopic image display device 12, the arbitrary position (c _X , c _Y , c _Z ) of the world coordinate system of the camera is displayed. In order to convert to a system, the following equation (12) may be used for calculation.

Here, (x, y, z) indicates a position after an arbitrary position (c _X , c _Y , c _Z ) in the world coordinate system of the camera is converted into a display coordinate system.

By performing the above processing, even if the installation inclination angle θ _SD of the stereoscopic image display device 12 is changed by the rotation mechanism of the joining member and the relative position P _SD of the stereoscopic image display device 12 with respect to the imaging unit 280 changes, calculating the relative position P _SD after the change, it is possible to convert the position of the world coordinate system of the camera taken by the image pickup means 280 to the position of the display coordinate system of the three-dimensional image display device 12.

Then, the observation position calculation unit 290 refers to the inclination angle θ _{S of the} back of the seat detected by the moving object state detection unit 110 and the face image area of the observer reflected in the captured image data captured by the imaging unit 280. Thus, the observation position _POD is calculated.

By the way, as for the observation distance Z _OD , as in the first embodiment described above, the inclination angle θ _{SO of the} back of the viewer's seat detected by the moving object state detection unit 110 and the inclination angle θ _SP of the seat in front of it are detected. The observation position calculating means 290 calculates using the above. However, in this second embodiment, in order to use the length L _SE of the back portion of the seat corresponding to the height of the eyes of the observer, calculation formula of the viewing distance Z _OD, rather than the equation (2) The following formula (13) is obtained.

FIG. 48 shows the positional relationship between the observer's seat and the front seat related to the calculation of the observation position _ZOD . As described above, since the average value of the length (head length) from the back of the head of a general observer to the binocular position (brow between the eyebrows) is about 19 cm (report data of anthropometric data), the first embodiment the same, the value assumed from the front position of the backrest portion of the seat a distance Z _OO to binocular observer position approximately 19cm, by subtracting the distance Z _OO from viewing distance Z _OD calculated by the above formula (13) ( Z _OD −Z _OO ) may be adopted as the observation distance as shown in FIG.

Then, in order to calculate the observation position _{P OD,} observation position calculating means 290, the observation position of the X-axis direction from the captured image data captured by the imaging means 280 _P OD (X) and Y-axis direction of the observation position _{P OD} ( Y) is calculated.
As an example, FIG. 49 shows an imaging environment when the imaging surface of the imaging unit 280 and the display surface of the stereoscopic display panel unit 120 are parallel. The imaging unit 280 has a function of projecting an object in a three-dimensional space onto an imaging surface on a two-dimensional plane and recording it as captured image data.

Place the object in an arbitrary position _{Y 1} of the Y-axis direction, when moving the distance (Z-axis direction) from the imaging unit 280 to the object from the viewing distance _{Z OD1} to viewing distance _{Z OD2,} photographing an object by the image pickup means 280 The obtained captured image data is shown in FIG.

FIG. _50A shows captured image data when an object at the observation distance Z _OD1 is photographed, and FIG. _50B shows captured image data when an object at the observation distance Z _OD2 is photographed. As shown in each figure, the u-axis direction of the captured image data matches the X-axis direction, and the v-axis direction matches the Y-axis direction.

Since the imaging unit 280 projects an object in a three-dimensional space onto a two-dimensional plane imaging surface, even if the object is an arbitrary value Y ₁ in the same Y-axis direction, imaging is performed depending on the difference in the observation distance Z _OD. The v-axis position of the object projected in the image data changes.

The position (X ₁ , Y ₁ , Z ₁ ) of the object in the three-dimensional space is determined by the observation position calculation means 290 using the focal length f and the observation distance Z _OD of the image pickup means 280 by the following formulas (14) and ( 15) and calculation by equation (16).

Here, u ₁ indicates the image position of the object in the u-axis direction of the captured image data, and v ₁ indicates the image position of the object in the v-axis direction. Therefore, the observation position P _OD (X) in the X-axis direction and the observation position P _OD (Y) in the Y-axis direction are calculated by the following formulas (17) and (18).

In each of these equations, u _E indicates the image position of the observer's eyes captured in the captured image data in the u-axis direction, and v _E indicates both of the observer images captured in the captured image data in the v-axis direction. Indicates the image position of the eye. Each _{P SD} indicates the relative position of the stereoscopic image display device 12 with respect to the imaging unit 280 calculated by the above formula (11).

As described above, the observation position calculation unit 290 can calculate the observation position P _OD from the tilt angle of the seat back portion detected by the moving object state detection unit 110 and the captured image data captured by the imaging unit 280.

  The display setting adjustment unit 270 refers to the observation position calculated by the observation position calculation unit 290 and the device characteristic data stored in the device characteristic data storage unit 160, and 3D crosstalk that appears as the seat back portion tilts. The display setting of the stereoscopic image display device 12 is adjusted so that a favorable stereoscopic image can be displayed on the display surface of the stereoscopic display panel means 120 while reducing the influence of reverse viewing.

In the first embodiment described above, the display setting adjustment process is performed on the assumption that the position of the observer in the X-axis direction is always constant. However, in the second embodiment, the observation position calculation unit 290 performs the display setting adjustment process. With reference to the calculated observation position P _OD , display setting adjustment processing is performed corresponding to the movement of the observer in the X-axis direction.

When the optical separation characteristics of the optical separation means of the stereoscopic display panel means 120 can be changed dynamically, the display setting adjustment process is performed according to the observation position _POD by changing the optical separation characteristics. Configuration can be adopted.

In the case where a liquid crystal lens is used as an optical separation means whose optical separation characteristics can be dynamically changed, an area where an observer can visually recognize a stereoscopic image normally by changing the lens power of the liquid crystal lens locally ( the combined stereoscopic viewing space) in the observation position P _OD configured to move.

FIG. 51 shows an example in which the lens power of the liquid crystal lens is locally changed by changing the voltage of the liquid crystal lens and the position of the normal viewing region is changed.
51A shows an optical model in which a normal viewing area is formed at the center front position of the display surface of the stereoscopic display panel unit 120, and FIG. 51B shows the center front position of the display surface of the stereoscopic display panel unit 120. 3 represents an optical model in which a normal vision region is formed at a position moved from the right to the right (X-axis direction).

  In the first embodiment, the lens power of the liquid crystal lens is changed to change the optimum viewing distance OD of the stereoscopic display panel unit 120. However, in the second embodiment, the lens power of the liquid crystal lens is locally changed. Thus, not only the optimal viewing distance OD but also the position of the normal viewing area is moved in the X-axis direction.

  This will be described with reference to FIGS. 52 and 53 showing an example of the stereoscopic display panel means 120 including the liquid crystal lens 120A and the display panel 120B.

  The basic configuration in FIGS. 52 and 53 is the same as the configuration shown in the lower view (cross-sectional view) of FIGS. 29 and 30 described above. 52 and 53, the refractive index distribution has the same value as that shown in the upper diagram of FIG.

First, in FIG. 52, at the voltages _{V 1} higher than the voltage _{V 2} conditions (voltages _{V 1>} the voltage _{V 2),} the voltages _{V 1} to the control electrode _{E 1} and the control electrode _{E 4,} a control electrode _{E 2} By applying the voltage V ₂ to the control electrode E ₃ , the position in the X-axis direction where the light beam 20 is condensed in the unit lens is the boundary position between the control electrode E ₂ and the control electrode E ₃ (for the right eye). Boundary line position between the pixel and the pixel for the left eye).

  52 and 53, it should be noted that the position of the unit lens in the X-axis direction with respect to the unit pixel position differs by a width corresponding to one control electrode.

That is, in FIG. 53, the voltage V ₁ is applied to the control electrode E ₂ and the control electrode E ₁ , the voltage V ₂ is applied to the control electrode E ₃ and the control electrode E _4, and the position of the unit lens is set in the positive direction of the X axis ( by moving the control electrode a wide width to the left), the position of the X-axis direction beam 20 is focused is, control electrodes E ₃ and control boundary position of the electrode E ₄ (center position of the right-eye pixels) and , The light beam 20 is emitted while being shifted in the minus direction (right direction) of the X axis.

  Here, FIG. 54 shows an optical model of the stereoscopic display panel means 120 formed by the liquid crystal lens 120A controlled to the state of FIG. 52, and FIG. 55 shows an optical model of the liquid crystal lens 120A controlled to the state of FIG. Show.

  In the case of FIG. 54, since the position in the X-axis direction where the light beam 20 is collected by the liquid crystal lens is the boundary position between the right-eye pixel and the left-eye pixel, the normal viewing area is the central front position of the stereoscopic display panel means 120. Formed.

  On the other hand, in the case of FIG. 55, the position in the X-axis direction where the light beam 20 is collected by the liquid crystal lens is the center position of the right-eye pixel. It is formed at a position moved by the width of one control electrode to the right (minus direction of the X axis).

As described above, by changing the applied voltage to each of the control electrodes E _{1 to} E ₄ and locally controlling the lens power of the liquid crystal lens, the position of the normal vision region can be set only in the Z-axis direction. In addition, it is possible to move in the X-axis direction.
Further, the amount of movement of the normal viewing region in the X-axis direction can also be changed by increasing or decreasing the number of control electrodes and adjusting the pitch.

Besides, high voltages _{V 1} than the voltage _{V 2,} at higher conditions than the voltage _{V 2} is the voltage _{V 3} (voltages _{V 1>} Voltage _{V 2>} Voltage _{V 3),} the control electrodes _{E 1} and the control electrode _{E 4} The liquid crystal lens may be controlled by applying the voltage V ₁ to the control electrode E ₂ , the voltage V ₂ to the control electrode E ₂ , and the voltage V ₃ to the control electrode E ₃ .
Taking such a configuration, since the voltage applied to the control electrode E ₂ and the control electrode E ₃ is different from the orientation distribution of the liquid crystal has an asymmetry, it becomes asymmetrical refraction direction of the light beam 20 passing through the liquid crystal lens, The optical axis of the liquid crystal lens is tilted. That is, a configuration may be adopted in which the formation position of the normal viewing region is moved by the inclination of the optical axis.

  As described above, by adopting a configuration capable of controlling the refractive index distribution of the optical separation element, it is possible to adjust the position of the normal viewing region and the stereoscopic viewing region range.

In the above example, an example in which a liquid crystal lens is used as the optical separation unit of the stereoscopic display panel unit 120 is shown, but a parallax barrier with a variable barrier position may be used instead of the liquid crystal lens. Again, a plurality of provided a parallax barrier control electrode in the unit pixel, a predetermined voltage is applied to the control electrode, by employing a configuration of controlling the barrier position, the combined stereoscopic viewing space the observation position P _OD Can be moved.

  As described above, in the display setting adjustment process using a liquid crystal lens, a parallax barrier having a variable barrier position, or the like, the display setting adjustment unit 270 controls the optical separation unit of the stereoscopic display panel unit 120 to determine the position of the viewing region. By changing the configuration, the display setting adjustment process according to the observation position was realized.

  Next, display setting adjustment processing when the optical separation characteristic of the optical separation means of the stereoscopic display panel means 120 is static and cannot be changed will be described.

In this case, since the position of the normal viewing area of the stereoscopic display panel unit 120 is unchanged, the observation position P _OD is changed by changing the parallax value of the image data (L image and R image) displayed on the stereoscopic display panel unit 120. Configure to adjust the display settings to match.

As a measure of the double image by the 3D crosstalk observation position P _OD appears in departing from the stereoscopic viewing space, and the like to reduce and adjust the disparity value PA by effect of double image of the image data.
Specifically, the display setting adjustment unit 270 can display a stereoscopic image with reference to the observation position _POD calculated by the observation position calculation unit 290 and the 3D crosstalk characteristic data stored in the device characteristic data storage unit 160. The parallax limit value (parallax allowable value PA _th ) is calculated, and the parallax value PA is adjusted to be equal to or smaller than the parallax allowable value PA _th .

Here, FIG. 56 shows an example of the parallax allowable value PA _th corresponding to the viewing angle θ _P of the stereoscopic display panel means 120 calculated from the observation position P _OD .

As shown in FIG. 56, if the viewing angle θ _P is within the normal viewing area, the value of the parallax allowable value PA _th increases. Conversely, if the viewing angle θ _P is within the 3D crosstalk area, the value of the parallax allowable value PA _th is Decrease. Therefore, the parallax value PA of the image data transmitted to the stereoscopic display panel unit 120 is changed in accordance with the change in the parallax allowable value _PAth .
Thus, if the observation position _POD is within the 3D crosstalk area, the stereoscopic display panel unit 120 displays image data with a reduced parallax value PA.

The details of the display setting adjustment process for changing the parallax value of the image data with reference to the 3D crosstalk characteristic data and the observation position _POD are disclosed in the above-mentioned Patent Document 7. Similarly to FIG. 28 (classification table I) referred to in the first embodiment, the display setting adjustment process for changing the parallax value of the image data is an optical separation whose optical separation characteristics can be dynamically changed. The present invention is also applicable when using means (liquid crystal lens or the like).

As a measure of 3D moire observation position P _OD appears in departing from the stereoscopic viewing space, and the like to reduce the influence of 3D moire performed brightness adjustment processing of the image data. In the first embodiment described above, the luminance fluctuation value on the display surface of the stereoscopic display panel unit 120 is calculated on the assumption that the observation position P _OD (X) in the X-axis direction is always constant. In the embodiment, a configuration is adopted in which the display setting adjustment unit 270 calculates the luminance fluctuation value with reference to the observation position _POD calculated by the observation position calculation unit 290.

In this luminance fluctuation value calculation process, the luminance fluctuation value of 3D moire appearing on the display surface of the stereoscopic display panel means 120 is calculated with reference to the observation position _POD and the luminance-viewing angle characteristic data. Then, the display setting adjustment unit 270 adjusts the luminance value of the image data based on the calculated value so that the luminance fluctuation value due to the 3D moire becomes flat, thereby reducing the influence of the 3D moire. .

The details of the display setting adjustment process for changing the luminance value of the image data with reference to the luminance-viewing angle characteristic data and the observation position _POD are disclosed in the above-mentioned Patent Document 7.
Similarly to FIG. 36 (classification table II) referred to in the first embodiment, the display setting adjustment process for changing the luminance value of the image data is an optical separation whose optical separation characteristics can be dynamically changed. The present invention is also applicable when using means (liquid crystal lens or the like).

  As described above, by adopting a configuration in which the luminance value of the stereoscopic image data is changed in accordance with the observation position, it is possible to reduce the influence of 3D moire and to reduce discomfort to the observer.

(Description of operation)
Next, the content of the image processing operation (stereoscopic image display method) in the stereoscopic image display device 12 will be described based on the flowchart shown in FIG.

  As in the first embodiment, the stereoscopic image display device 11 that has input a command signal related to stereoscopic image display by a user operation or the like uses the moving object state detection unit 110 to determine the seat state of the observer and The seat state of the seat is detected (FIG. 57: step S201).

Next, a 2D image including an observer in front of the stereoscopic image display device 12 is captured using the imaging unit 280, and the observation position calculation unit 290 acquires captured image data on a two-dimensional plane (FIG. 57). : Step S202).
Using this captured image data, the observation position calculation means 290 detects the face image area of the observer and the image area of the seat back (FIG. 57: step S203).

  Next, the observation position calculation unit 290 calculates an observation position representing a relative position of the observer with respect to the stereoscopic image display device 12. At that time, while referring to the inclination angle of each seat detected in step S201 and the captured image data stored in step S202, the observation position is calculated using seat reference information registered in advance (see FIG. 57: Step S204).

  Next, as in steps S103 and S104 in the first embodiment described above, device characteristic data is acquired from the device characteristic data storage unit 160 by the display setting adjustment unit 270 (FIG. 57: step S205), and image data storage unit is obtained. Image data that is stereoscopic image content is acquired from 150 (FIG. 57: step S206).

  Next, the display setting adjustment unit 270 refers to the observation position calculated in step S203 and the device characteristic data acquired in step S204, and performs display setting adjustment processing according to the observation position. As the display setting adjustment process, the optical separation unit of the stereoscopic display panel unit 120 is controlled to move the normal viewing area according to the observation position, and the parallax value and the luminance value of the image data acquired in S205 are used as the observation position. And a method of changing according to the device characteristic data (FIG. 57: step S207).

  As in the first embodiment (steps S106 and 107), the display setting adjusting unit 270 obtains the image data acquired from the image data storage unit 150 according to the display setting adjusted in step S206. 120 is displayed on the image display panel 120 (FIG. 57: step S208), and then whether or not to stop the stereoscopic image display process is set (FIG. 57: step S209).

  Even if the display position of the stereoscopic image display device is moved with the inclination of the back of the seat, the processing according to the above flowchart refers to the inclination angle of the back of the seat and the captured image data, and Since the relative position (observation position) of the observer with respect to the installed stereoscopic image display device is calculated and the display setting adjustment processing is performed using this, the double image or reverse view by 3D crosstalk can be performed only with an inexpensive measurement device. The effect of 3D moire can be reduced, and a stereoscopic image that does not give the viewer a sense of incongruity can be provided.

  Also in the second embodiment, the number of viewpoints is not limited to two, and the present invention can also be applied to the stereoscopic display panel means 120 that projects a multi-viewpoint image.

  Here, the execution contents of each step in the above steps S201 to S208 (FIG. 57) may be programmed, and the series of control programs may be realized by a computer.

(Effect of 2nd Embodiment)
In the second embodiment, the relative position (observation position) of the observer with respect to the stereoscopic display panel means 120 is calculated using the imaged image data obtained by the imaging means together with the state information of the moving object, and this is used to calculate the stereoscopic image. Since the configuration of adjusting the display settings of the three-dimensional images can be realized, it is possible to realize the adjustment processing of the display settings of the three-dimensional images in consideration of the height of both eyes of the observer. It is possible to display.
About another structure and operation | movement, it is the same as that of what was shown in 1st Embodiment, and the effect which arises elsewhere is also the same.

[Third Embodiment]
A third embodiment of the stereoscopic image display apparatus according to the present invention will be described with reference to FIGS. Constituent members equivalent to those in the first and second embodiments described above are denoted by the same reference numerals.

(Overall configuration)
In the third embodiment, size information (observer data) indicating the size of the body of the observer in front of the stereoscopic image display device is registered, and the stereoscopic data of the observer's observation position is registered using the observer data. A configuration is adopted in which an observation position P _OD representing a relative position with respect to the center position of the display surface of the display panel is calculated, and a display setting adjustment process of the stereoscopic image display device is performed in accordance with the observation position P _OD .

That is, in the first and second embodiments described above, the observation distance Z _OD and the observation position P _OD are calculated on the assumption that the observer is leaning on the seat back portion. in not only the state in which the observer leaning against the backrest of the seat, even when away from the backrest portion of the seat, to a point that is configured to calculate the observation position P _OD using observer data There are features.

  As shown in FIG. 58, the stereoscopic image display device 13 in the third embodiment includes an arithmetic processing unit 133 that performs various arithmetic processes in addition to the moving object state detection unit 110, the stereoscopic display panel unit 120, and the imaging unit 280. And observer state detecting means 310 for detecting observer state information indicating whether or not the observer is in close contact with the seat back portion.

The arithmetic processing unit 133 includes an image data storage unit 150, a device characteristic data storage unit 160, and a display setting adjustment unit 270, and the observer state information detected by the observer state detection unit 310 and the imaging unit 280. An observer data storage processing unit 350 that detects and stores observer data with reference to the captured image data, and an observation position P that indicates a relative position of the observer's observation position with respect to the center position of the display surface of the stereoscopic display panel unit 120. Observation position calculation means (relative position calculation means) 390 for calculating _OD .

Furthermore, the observation position calculation means 390 is in a state in which the observer is in close contact with the backrest portion of the seat based on the detection means 390A for detecting the face image area of the observer from the captured image data and the observer state information. A determination means 390B for determining whether or not the object is in close contact with the determination means 390B, and the state information detected by the moving object state detection means 110 and the face image area calculating an observation position P _OD with bets, when the observer determines that in a state away from the backrest portion of the seat, the observation position P _OD by using the above observer data and the face image area It is configured to calculate.

  Hereinafter, functions of each unit included in the stereoscopic image display device 13 will be described. Here, the moving object state detection unit 110, the stereoscopic display panel unit 120, the image data storage unit 150, the device characteristic data storage unit 160, the display setting adjustment unit 270, and the imaging unit 280 are described in the first or second embodiment. It is the structure similar to each means which attached | subjected the same code | symbol in the form.

  The observer state detecting means 310 is configured to detect observer state information indicating whether the observer is in a state of being in close contact with the backrest portion of the seat or in a separated state. This observer state information can be configured so that, for example, a pressure sensor is installed on the backrest portion of the seat, and the observer state detector 310 detects the pressure state sensor using the pressure sensor.

  In FIG. 59 showing an example of a seat provided with a pressure-sensitive sensor, FIG. 59 (A) shows a state where the observer (O) is in close contact with the backrest portion of the seat, and FIG. 59 (B) shows that the observer (O) It shows the state away from the seat back.

In FIG. 59A, pressure is applied to the pressure-sensitive sensor 310A installed on the backrest portion of the seat depending on the weight of the observer (O), so that the output voltage value of the pressure-sensitive sensor 310A increases. On the other hand, in FIG. 59B, since pressure is not applied to the pressure sensor 310A, the output voltage value of the pressure sensor 310A does not increase.
Thus, the observer state information can be detected by measuring the output voltage value of the pressure-sensitive sensor 310A that changes depending on the positional relationship between the observer and the seat.

  The observer data storage processing unit 350 refers to the observer state information detected by the observer state detection unit 310 and the captured image data obtained by imaging by the imaging unit 280, and indicates the size of the face image area of the observer. It is configured to detect and store observer data.

  In the observer data detection process, the observer data storage processing unit 350 refers to the observer state information first detected by the observer state detection unit 310, and when the observer is in close contact with the seat back portion. Then, the observer is photographed by the imaging means 280, and captured image data is acquired. Next, the observer data storage processing unit 350 detects the face image area of the observer from the captured image data as in the first embodiment described above, and detects the size of the face image area as the observer data.

Here, FIG. 60 shows an example of captured image data captured by the imaging means 280.
FIG. 60 shows the width F _IW of the face image area in the u-axis direction detected by the observer data storage processing unit 350 from the contour position of the face image area of the observer.

If the observer is in close contact with the seat back, the observation distance Z _OD can be calculated in the same manner as in the second embodiment. The actual observer's face width _FW is calculated from the following equation (19) using the calculated observation distance Z _OD and the face image area width F _IW detected from the captured image data. To do.

Here, f represents the focal length of the imaging means 280.
The observer data storage processing unit 350 stores the calculated actual observer face width _FW as observer data.

The actual observer's face width _FW may be calculated from the ratio of the face image area to the image area of the seat back portion.
In this case, in addition to the face image area width _FIW , the seat image area width _SIW is detected from the contour information of the seat back portion. The actual width S _W of the backrest of the seat is fixed, by previously registered as a seat reference information, the actual observer's face width F _W can be calculated from the following equation (20).

In the above example, the observer's face width _FW is stored as the observer data, but the observer data may be size information indicating the size of the observer's body, and the observer's face width _FW. It is not just specific.
For example, the pupil distance between both eyes of the observer may be stored as observer data.

  Further, in the above, an example is shown in which the observer state information detected by the observer state detection unit 310 is referred to at the time of the observer data detection process to acquire the captured image data for calculating the observer data. Instead of referring to the state information, the observer may be notified that the observer data is detected from the stereoscopic image display device 13, and the captured image data may be acquired after the notification.

One example of a method for notifying the observer is to display a notification screen as shown in FIG. 61 on the stereoscopic image display device 13. For example, a confirmation button or the like for notifying the completion of preparation is provided on the screen (an operation button or the like provided in advance on the stereoscopic image display device 13 or the like may be substituted), and a signal resulting from an observer's press is provided. A configuration may be adopted in which the acquisition of captured image data is executed.
In addition, for the sake of safety, the passenger of the airplane is instructed to lean on the back of the seat at the time of takeoff. At that time, the photographed image data may be acquired and the observer data may be stored. .

  The observation position calculation unit 390 detects the observer's face image area from the captured image data photographed by the imaging unit 280 and based on the observer state information detected by the observer state detection unit 310. The determination means 390B determines whether or not the observer is in close contact with the backrest.

When the observer is in close contact with the seat back, the observation position calculation unit 390 uses the seat state information detected by the moving object state detection unit 110 and the imaging unit 280 as in the second embodiment described above. The observation position _POD is calculated with reference to the taken captured image data.

On the other hand, when the observer is away from the seat back, the observation position calculation unit 390 refers to the observer data stored in the observer data storage processing unit 350 and the captured image data captured by the imaging unit 280. Thus, the observation position _POD is calculated.

Here, with reference to FIG. 62 showing an example of captured image data photographed at different observation distances _ZOD , a change in the width of the face image area due to the position variation of the observer will be described. FIG. 62 (A) shows captured image data when the observer is in close contact with the seat back, and FIG. 62 (B) is when the observer is away from the seat back (the observer approaches the front seat). ) Shows captured image data.

The width F _IW of the face image area of the observer increases as the observer moves away from the backrest portion of the seat and approaches the imaging unit 280. For example, in the case of FIG. 62 (A), the width is _FIW1 , but in the case of FIG. 62 (B) in which the observer is close to the imaging means 280, the width is increased to _FIW2 .

Since the actual observer's face width _FW is stored as observer data, the observation position calculation means 390 can calculate the observation distance Z _OD by the following equation (21).

The observation position calculation unit 390 calculates the observation position P _OD (X) in the X-axis direction and the observation position P _OD (Y) in the Y-axis direction as in the second embodiment. .

In the third embodiment, since the configuration as described above is adopted, it is possible to calculate the observation position _POD of the observer even when the observer is away from the backrest portion of the seat.
Further, the display setting adjustment unit 170 performs display setting adjustment processing of the stereoscopic image display device 13 in accordance with the calculated observation position _POD of the observer, so that the observer is away from the backrest portion of the seat. Even in such a case, it is possible to reduce the influence of double image, reverse viewing, and 3D moire due to 3D crosstalk with only an inexpensive measurement device, and as a result, it is possible to provide a stereoscopic image display device that does not give the viewer a sense of incongruity. It becomes possible.

(Description of operation)
Next, the content of the image processing operation (stereoscopic image display method) in the stereoscopic image display device 13 will be described based on the flowcharts shown in FIGS. 63 and 64.

<Observer data registration process>
First, the observer state detection unit 310 detects an observer state indicating whether or not the observer is in close contact with the backrest portion of the seat (FIG. 63: step S301).

  Next, the observer data storage processing unit 350 refers to the observer state detected in step S301, and determines whether or not the observer is in close contact with the backrest (FIG. 63: step S302).

  At this time, if the observer is not in close contact with the backrest (FIG. 63: Step S302 / No), the process returns to Step S301, and the observer state is detected again. Here, prior to the detection, the observer may be notified that the observer data is to be detected, and urge the observer to be in close contact with the backrest portion.

  On the other hand, if the observer is in close contact with the backrest (FIG. 63: Step S302 / Yes), the imaging means 280 is used to photograph the observer in front of the stereoscopic image display device 13 as a 2D image, The captured image data is stored (FIG. 63: step S303).

  Next, the observer data storage processing unit 350 acquires the captured image data stored in step S303 and detects the observer's face image area captured in the captured image data (FIG. 63: step S304). .

With reference to the face image area detected in step S304, the observer data storage processing unit 350 calculates observer data representing the face size of the actual observer (FIG. 63: step S305) and stores this. (FIG. 63: Step S306).
An example of the observer data is the face width _FW of the observer.

  The observer data can be registered by the above flowchart processing.

<Stereoscopic image display processing>
According to the flowchart of the stereoscopic image display processing method shown in FIG. 64, first, the observer state detection means 310 detects an observer state indicating whether or not the observer is in close contact with the backrest part of the seat (FIG. 64: Step S401).

  With reference to the observer state detected in step S401 (FIG. 64: step S402), if the observer is in close contact with the backrest (FIG. 64: step S402 / yes), the observer state detection means 310 Each seat state is detected (proceeding to step S403), and if the observer is not in close contact with the backrest (FIG. 64: step S402 / yes), the observer data stored in the observer data storage processing unit 350 is stored. Obtain (proceed to step S412).

  The processing content from step S403 to step S411 in FIG. 64 is the same as the processing content from step S201 to step S209 (FIG. 57) in the second embodiment described above, and is therefore omitted here.

  The observation position calculation means 390 that acquired the observer data stored in the observer data storage means 310 (FIG. 64: step S412) uses the image pickup means 280 in the same manner as in step S404, and uses the imaging means 280 in front of the stereoscopic image display device 13. The observer is photographed, and captured image data is acquired (FIG. 64: step S413).

  Next, the observation position calculation unit 390 calculates the observation position with reference to the observer data acquired in step S412 and the captured image data acquired in step S412 (FIG. 64: step S414).

  Then, as shown in FIG. 64, the processing contents from step S407 to step S411 that are the same as the processing contents from step S205 to step S209 (FIG. 57) in the second embodiment described above are executed.

By the above process, by calculating and registering in advance the observer data when the observer is in close contact with the seat back, even if the observer is away from the seat back, The observation position _POD of the observer can be calculated using only an inexpensive measuring device. In addition, by adjusting the display settings according to the calculated observation position _POD of the observer, the influence of double images, reverse vision, and 3D moire due to 3D crosstalk can be reduced with only an inexpensive measurement device, As a result, it is possible to provide a stereoscopic image display device that does not give the viewer a sense of discomfort.

  Also in the third embodiment, the number of viewpoints is not limited to two, and can be applied to the stereoscopic display panel means 120 that projects a multi-viewpoint image.

(Effect of the third embodiment)
In the third embodiment, the observer refers to the observer data in a state in which the observer is in close contact with the backrest portion of the seat as a reference, and the positional relationship between the observer and the backrest portion also in the adjustment processing of the stereoscopic image display setting Therefore, it is possible to calculate a more flexible observation position according to the state of the observer, and to realize a stereoscopic image display based on highly accurate adjustment processing using this. It becomes.
About another structure and operation | movement, it is the same as that of what was shown by 1st and 2nd embodiment mentioned above, and the effect which arises similarly is also the same.

[Fourth Embodiment]
A second embodiment of the stereoscopic image display apparatus according to the present invention will be described with reference to FIGS. Here, the same code | symbol shall be used about the structural member equivalent to 1st thru | or 3rd embodiment mentioned above.

(Overall configuration)
In the fourth embodiment, by detecting the seat state representing the tilt angle θ _S of the seat back surface from the captured image data captured by the image capturing unit 280, the moving object state detecting unit such as the posture sensor is not used. A feature is that the observation position P _OD is calculated, and the display setting adjustment processing of the stereoscopic image display apparatus is performed in accordance with the observation position P _OD .

As shown in FIG. 65, the stereoscopic image display device 14 includes a stereoscopic display panel unit 120, an imaging unit 280, and an arithmetic processing unit 134 that performs various arithmetic processes.
In addition, the arithmetic processing unit 134, together with the image data storage unit 150, the device characteristic data storage unit 160, and the display setting adjustment unit 270, calculates an observation position that calculates an observation position indicating the relative position of the observer with respect to the stereoscopic display panel unit 120. Means (relative position calculation means) 490 is provided.

  Hereinafter, functions of each unit included in the stereoscopic image display device 14 will be described. Here, the 3D display panel unit 120, the image data storage unit 150, the device characteristic data storage unit 160, the display setting adjustment unit 270, and the imaging unit 280 are denoted by the same reference numerals in the first to third embodiments described above. It is the same structure as each attached means.

The observation position calculation unit 490 refers to the captured image data captured by the imaging unit 280 and calculates the observation position _POD . In addition, the observation position calculation unit 490 of the fourth embodiment detects a seat state representing the inclination angle θ _S of the seat back portion with reference to the captured image data.

Here, FIG. 66 shows the distance (Z-axis direction) from the imaging means 280 to the seat back portion that changes with the inclination angle θ _S of the seat back portion.
Since the length L _SUD of the backrest part from the upper part of the seat to the lower part of the seat is constant, if it is registered in advance as seat reference information, the inclination angle θ _S of the rear part of the seat can be calculated from the following equation (22) It can be calculated using the distance _{Z SD} in the Z-axis direction to the seat upper 280, and a distance _{Z SU} in the Z-axis direction from the imaging means 280 to the seat bottom.

The distance Z _SD from the imaging means 280 to the upper part of the seat and the distance Z _SU from the imaging means 280 to the lower part of the seat are taken image data obtained by photographing the observer's seat in front of the stereoscopic image display device 14 by the imaging means 280. Is calculated by the observation position calculation means 490.

FIG. 67 (A) shows an example of photographed image data obtained by photographing the observer's seat. FIG. 68 (A) shows captured image data obtained by photographing the observer's seat when the inclination angle θ _S of the seat back portion is inclined as compared with the case of FIG. 67B shows a seat state when the photographed image data of FIG. 67A is photographed, and FIG. 68B shows a seat when the photographed image data of FIG. 68A is photographed. Indicates the state.

Here, the inclination angle of the seat back portion shown in FIG. 67 is θ _S1, and the inclination angle of the seat back portion shown in FIG. 68 is θ _S2 (θ _S1 <θ _S2 ). Further, the image area width of the seat lower _{W ISD} Distant, an image area width of the seat upper and _{W ISU.}

67 and 68, since the distance from the image pickup means 280 to the seat back portion changes as the inclination angle θ _S of the seat back portion increases, the image area width W of the lower portion of the seat accordingly. _{The ISD} and the image area width W _ISU above the seat change. (As shown in these figures, the _WISU changes particularly greatly.)

Here, the actual width W _{SU of the} upper part of the seat and the width W _SD of the lower part of the seat are constant and are known values, and are registered in advance as seat reference information. Thereby, the distance (Z-axis direction) Z _SU from the imaging means 280 to the upper part of the seat is detected based on the following formula (23) by using the image area width W _ISU of the upper part of the seat from the photographed image data. It can be calculated.

Similarly, the distance Z _SD from the imaging means 280 to the lower part of the seat can be calculated based on the following formula (24) by detecting and using the image area width _WISD of the lower part of the seat from the captured image data.

F in each of these equations indicates the focal length of the image pickup means 280.
As described above, in the situation where the image area widths W _ISU and W _{ISD of the} upper and lower seats can be detected by the imaging unit 280, the image acquisition unit 280 acquires the image without using the moving object state detection unit such as the tilt sensor. The seat state representing the inclination angle θ _S of the seat back portion can be detected from the captured image data.

In the above example, the seat backrest contour information is detected from the captured image data, and the seat upper and lower image area widths W _ISU and W _ISD are detected to calculate the seat back portion inclination angle θ _S. The image information detected from the captured image data may be other image information.
As an example, a configuration is adopted in which a pre-registered mark is printed on the seat back as a seat pattern, and the mark is detected from the captured image data to calculate the inclination angle θ _S of the seat back portion. Can do.

Note that the observation position P _OD is configured to be obtained by the observation position calculation means 390 by the same calculation method as that of the second embodiment described above with reference to the inclination angle θ _S of the seat back portion calculated from the captured image data. Has been.

(Description of operation)
Next, the content of the image processing operation (stereoscopic image display method) in the stereoscopic image display device 14 will be described based on the flowchart shown in FIG.

  First, an observation position calculation unit 490 that has captured a 2D image including an observer in front of the stereoscopic image display device 14 using the imaging unit 280 and acquired captured image data (FIG. 69: step S501), The face image area of the observer and the image area of the seat backrest are detected from the captured image data (FIG. 69: step S502).

  Next, the observation position calculation unit 490 calculates the inclination angle of the seat back portion from the image area information of the seat back portion detected in step S502 (FIG. 69: step S503).

  The processing content from step S504 to step S509 is the same as the processing content from step S204 to step S209 in the second embodiment described above.

By the above flowchart processing, the tilt angle θ _S of the seat back portion is calculated from the captured image data, and the observation position P _OD representing the relative position of the observer with respect to the stereoscopic image display device is calculated, thereby moving the moving object such as the tilt sensor. Provided is a stereoscopic image display device that can reduce the effects of double images, reverse viewing, and 3D moire caused by 3D crosstalk, and does not give a sense of incongruity to an observer, even if there is no state detection means. It becomes possible.
Also in the fourth embodiment, the number of viewpoints is not limited to two, and can be applied to the stereoscopic display panel means 120 that projects a multi-viewpoint image.

(Effect of 4th Embodiment)
The fourth embodiment employs a configuration in which the inclination angle θ _S (seat state) of the seat back portion is detected from the captured image data captured by the imaging unit, and therefore the moving object state detection unit such as a posture sensor is used. It is possible to adjust the display setting of the stereoscopic image in accordance with the calculated observation position _POD without performing this, so that the effects of double image due to 3D crosstalk, reverse viewing, and 3D moire can be reduced. Therefore, the stereoscopic image can be effectively reduced and the stereoscopic image can be displayed without giving the viewer a sense of incongruity.
About another structure and operation | movement, it is the same as that of what was shown in the 1st thru | or 3rd embodiment mentioned above, and the effect which arises similarly is also the same.

  Each embodiment mentioned above is a suitable concrete example in a stereoscopic image display device, a stereoscopic image display method, and its program, and may have various technically desirable limits. However, the technical scope of the present invention is not limited to these embodiments unless specifically described to limit the present invention.

  Although part or all of the above-described embodiments can be described as in the following supplementary notes, the present invention is not limited to the following configurations.

(Supplementary note 1: first embodiment)
In a stereoscopic image display device installed on a moving object,
Moving object state detection means (110) for detecting the state of the moving object;
Three-dimensional display panel means for projecting images with different parallax to the left and right eyes of an observer by dividing a spatial region for projecting a stereoscopic image and projecting images with different parallax to each of the divided spatial regions. 120)
Observation distance calculation means (140) for calculating the observation distance between the stereoscopic display panel means (120) and the observer from the state information of the moving object detected by the moving object state detection means (110),
Device characteristic data storage means (160) for storing device characteristic data including display characteristics of the stereoscopic display panel means (120) corresponding to the observation distance;
A stereoscopic image display device (11) comprising display setting adjustment means (170) for adjusting display settings of the stereoscopic image with reference to the observation distance and the device characteristic data.

(Supplementary Note 2: Second Embodiment)
In a stereoscopic image display device installed on a moving object,
Moving object state detection means (110) for detecting the state of the moving object;
Three-dimensional display panel means for projecting images with different parallax to the left and right eyes of an observer by dividing a spatial region for projecting a stereoscopic image and projecting images with different parallax to each of the divided spatial regions. 120)
Imaging means (280) for capturing images of the observer and capturing a captured image;
Observation representing the relative position of the observer with respect to the stereoscopic display panel means (120) from the state information of the moving object detected by the moving object state detection means (120) and the captured image taken by the imaging means (280) Observation position calculation means (290) for calculating the position;
Device characteristic data storage means (160) for storing device characteristic data including display characteristics of the stereoscopic display panel means (120) for the observation position;
A stereoscopic image display device (12) comprising display setting adjustment means (270) for adjusting display settings of the stereoscopic image with reference to the observation position and the device characteristic data.

(Supplementary Note 3: Third Embodiment)
In the stereoscopic image display device installed on the movable backrest of the seat, which is a moving object,
Moving object state detection means (110) for detecting the state of the moving object;
Three-dimensional display panel means for projecting images with different parallax to the left and right eyes of an observer by dividing a spatial region for projecting a stereoscopic image and projecting images with different parallax to each of the divided spatial regions. 120)
Imaging means (280) for capturing images of the observer and capturing a captured image;
The moving object is a seat, a backrest portion of the seat is movable, and an observer state detecting means (310) for detecting a seating state of the observer on the seat on which the observer is seated,
Observer data storage means (350) for storing observer data representing the size information of the observer;
An observation position calculating means (390) for calculating an observation position representing a relative position of the observer with respect to the stereoscopic display panel means (120);
Device characteristic data storage means (160) for storing device characteristic data including display characteristics of the stereoscopic display panel means corresponding to the observation position;
With reference to the observation position and the device characteristic data, display setting adjustment means (270) for adjusting the display setting of the stereoscopic image, and
The observation position calculation means (390) detects the ratio of the face image area of the observer to the image area of the backrest portion of the seat on which the observer is seated from the photographed image photographed by the imaging means (280),
When the observer is in close contact with the backrest of the seat on which the observer is seated, the observation position is determined from the seat state information detected by the moving object state detection means (110) and the ratio of the face image area. Calculate
The stereoscopic image display device (13), wherein the observation position is calculated from the observer data and a ratio of the face image area in a state away from a backrest portion of a seat on which the observer is seated.

(Supplementary Note 4: Fourth Embodiment)
In a stereoscopic image display device installed on a moving object,
Three-dimensional display panel means for projecting images with different parallax to the left and right eyes of an observer by dividing a spatial region for projecting a stereoscopic image and projecting images with different parallax to each of the divided spatial regions. 120)
An imaging means (280) for capturing an image of the observer and capturing the captured image;
An observation position representing a relative position of the observer with respect to the stereoscopic display panel means by detecting the state of the moving object from the photographed image photographed by the imaging means and using the state information of the moving object and the photographed image. Observation position calculation means (490) for calculating
Device characteristic data storage means (160) for storing device characteristic data including display characteristics of the stereoscopic display panel means for the observation position;
A stereoscopic image display device (14) comprising display setting adjustment means (270) for adjusting display settings of the stereoscopic display panel means with reference to the observation position and the device characteristic data.

(Appendix 5)
A stereoscopic image display device that is installed on a moving object and displays a stereoscopic image,
Stereoscopic display panel means (120) for projecting images with different parallax for each adjacent spatial region;
Moving object state detection means (110) for detecting state information related to the position state of the moving object;
Relative distance calculating means (140) for calculating the relative distance between the stereoscopic display panel means (120) and a specific observer located on the display surface side from this state information;
Device characteristic data storage means (160) for storing device characteristic data applied to the stereoscopic display panel means (120);
A stereoscopic image display device, comprising: display setting adjustment means (170) for adjusting display settings of the stereoscopic image with reference to the relative distance and the device characteristic data.

(Appendix 6)
In the stereoscopic image display device according to appendix 5,
The moving object is a seat for the observer, and a back portion of the seat is movable;
The moving object state detection means (110) is installed on a backrest portion of the seat, and detects information relating to an inclination state of the backrest portion as the state information.

(Appendix 7)
In the stereoscopic image display device according to appendix 5,
The moving object is a seat for the observer, and a back portion of the seat is movable;
The moving object state detection means (110) detects the state information based on inclination information of a seat on which the observer is seated and a backrest portion of each of the front seats of the seat. apparatus.

(Appendix 8)
In the stereoscopic image display device according to appendix 5,
The moving object is a seat for the observer, and a back portion of the seat is movable;
The moving object state detection means (110) determines the state information based on an output value of a first inclination sensor installed on a backrest portion of the seat and an output value of a second inclination sensor installed on a seating portion of the seat. A stereoscopic image display device characterized by detecting.

(Appendix 9)
In the stereoscopic image display device according to any one of the supplementary notes 5 to 8,
The relative distance calculation means (140) has installation position information between two seats arranged in front and rear, and calculates the relative distance using the installation position information and the state information. Image display device.

(Appendix 10)
In the stereoscopic image display device according to any one of the supplementary notes 5 to 9,
The stereoscopic display panel means includes:
A display panel in which a plurality of pixels including at least a first sub-pixel that displays an image for a first viewpoint and a second sub-pixel that displays an image for a second viewpoint are arranged in a matrix;
3D image display apparatus, comprising: light beam separating means for distributing light beams emitted from the sub-pixels in different directions.

(Appendix 11)
In the stereoscopic image display device according to appendix 10,
The light beam separating means comprises an active element whose light beam separating direction can be changed,
The stereoscopic image display device, wherein the display setting adjusting means (170) adjusts the stereoscopic viewing area range by controlling the refractive index distribution of the light beam separating means in accordance with the relative distance.

(Appendix 12)
In the stereoscopic image display device according to any one of the supplementary notes 5 to 11,
The stereoscopic image display device, wherein the display setting adjusting means (170) changes a parallax value or a luminance value of the stereoscopic image in accordance with the relative distance.

(Appendix 13)
A stereoscopic image display device that is installed on a moving object and displays a stereoscopic image,
Stereoscopic display panel means (120) for projecting images with different parallax for each adjacent spatial region;
The front of the display surface of the stereoscopic display panel (120) is imaged together with an observer, and imaging means (280) for recording as captured image data,
Relative position calculating means (observation position calculating means: 290, 390, 490) for calculating the relative position of the observer with respect to the stereoscopic display panel means (120) using the captured image data;
Device characteristic data storage means (160) for storing device characteristic data applied to the stereoscopic display panel means (120);
A stereoscopic image display apparatus comprising: a display setting adjustment unit (270) that adjusts display settings of the stereoscopic image with reference to the relative position and the device characteristic data.

(Appendix 14)
In the stereoscopic image display device according to appendix 13,
A moving object state detecting means (110) for detecting state information related to the position state of the moving object;
The relative position calculation means (290, 390) uses the captured image data and the state information when calculating the relative position.

(Appendix 15)
In the stereoscopic image display device according to appendix 14,
The moving object is a seat for the observer, and a back portion of the seat is movable;
The moving object state detection means (110) is installed on a backrest portion of the seat, and detects information relating to an inclination state of the backrest portion as the state information.

(Appendix 16)
In the stereoscopic image display device according to appendix 15,
The relative position calculation means (290, 390) detects a ratio of the face image area of the observer to an image area of a backrest portion of a seat on which the observer is seated from the captured image data, and information related to the ratio and the information A stereoscopic image display device that calculates the relative position using state information.

(Appendix 17)
In the stereoscopic image display device according to appendix 15,
Observer state detection means (310) for detecting observer state information on the sitting state of the observer;
Observer data storage processing means (350) for detecting and storing observer data indicating the size information of the observer using the observer state information and the captured image data, and
The relative position calculating means (390)
Detection means (390A) for detecting the observer's face image area from the captured image data, and determination for determining whether the observer is in close contact with the backrest based on the observer state information Means (390B), and
When it is determined by the determination means (390B) that the subject is in a close state, the relative position is calculated using the state information and the face image region, and the observer moves away from the backrest portion. A stereoscopic image display device characterized by calculating the relative position using the observer data and the face image area when it is determined that the state is in a state.

(Appendix 18)
In the stereoscopic image display device according to appendix 17,
The observer data storage processing means (350) uses the photographed image data when the observer is in close contact with the backrest portion when detecting the observer data. .

(Appendix 19)
In the stereoscopic image display device according to appendix 13,
The relative position calculation means (490) detects state information related to the position state of the moving object using the captured image data, and calculates the relative position based on the detected state information. apparatus.

(Appendix 20)
In the stereoscopic image display device according to appendix 13,
The moving object is a seat for the observer, and a back portion of the seat is movable;
The relative position calculation means (490) detects a ratio of the face image area of the observer to an image area of a backrest portion of a seat on which the observer is seated from the captured image data, and uses information related to the ratio. And calculating the relative position.

(Appendix 21)
In the stereoscopic image display device according to any one of the supplementary notes 13 to 20,
The stereoscopic display panel means includes:
A display panel in which a plurality of pixels including at least a first sub-pixel that displays an image for a first viewpoint and a second sub-pixel that displays an image for a second viewpoint are arranged in a matrix;
3D image display apparatus, comprising: light beam separating means for distributing light beams emitted from the sub-pixels in different directions.

(Appendix 22)
In the stereoscopic image display device according to appendix 21,
The light beam separating means comprises an active element whose light beam separating direction can be changed,
The stereoscopic image display device, wherein the display setting adjusting means (270) adjusts the stereoscopic viewing area range by controlling the refractive index distribution of the light beam separating means in accordance with the relative position.

(Appendix 23)
In the stereoscopic image display device according to any one of the supplementary notes 13 to 22,
The stereoscopic image display device, wherein the display setting adjusting means (270) changes a parallax value or a luminance value of the stereoscopic image in accordance with the relative position.

(Appendix 24)
In the stereoscopic image display device according to the above supplementary notes 5 to 12,
The device characteristic data is information corresponding to the relative distance.

(Appendix 25)
In the stereoscopic image display device according to the supplementary notes 13 to 23,
The device characteristic data is information corresponding to the relative position.

(Appendix 26)
A stereoscopic image display method in a stereoscopic image display device that has a stereoscopic display panel means (120) for projecting images with different parallax for each adjacent spatial region and displays a stereoscopic image installed on a moving object,
A moving object state detection step of detecting state information relating to the position state of the moving object;
A relative distance calculating step of calculating a relative distance between the stereoscopic display panel means (120) and a specific observer located on the display surface side from this state information;
A device characteristic data receiving step for receiving device characteristic data according to the stereoscopic display panel means (120);
A display setting adjustment step of adjusting display settings of the stereoscopic image with reference to the relative distance and the device characteristic data;
A stereoscopic image display method for displaying the stereoscopic image by projecting images with different parallaxes to the respective spatial regions based on the display settings after adjustment. .

(Appendix 27)
A stereoscopic image display method in a stereoscopic image display device that has a stereoscopic display panel means (120) for projecting images with different parallax for each adjacent spatial region and displays a stereoscopic image installed on a moving object,
The front of the display surface of the stereoscopic display panel (120) is imaged together with an observer, and an imaging process for recording as captured image data;
A relative position calculating step of calculating the relative position of the observer with respect to the stereoscopic display panel means (120) using the captured image data;
A device characteristic data receiving step for receiving device characteristic data according to the stereoscopic display panel means (120);
A display setting adjustment step of adjusting display settings of the stereoscopic image with reference to the relative position and the device characteristic data;
A stereoscopic image display method for displaying the stereoscopic image by projecting images with different parallaxes to the respective spatial regions based on the display settings after adjustment. .

(Appendix 28)
In the stereoscopic image display method according to appendix 27,
A moving object state detection step of detecting state information related to the position state of the moving object;
In the relative position calculating step, the relative position is calculated by referring to the state information together with the captured image data.

(Appendix 29)
In the stereoscopic image display method according to appendix 27,
In the case where the moving object is a seat for the observer and a backrest portion of the seat is movable,
Prior to the relative position calculation step,
A moving object state detection step of detecting state information relating to the position state of the moving object;
An observer state detecting step of detecting observer state information relating to the sitting state of the observer;
In the relative position calculating step,
The face image area of the observer is detected from the captured image data, and it is determined whether or not the observer is in close contact with the backrest based on the observer state information, and is in close contact When the determination is made, the three-dimensional image display method is characterized in that the relative position is calculated using the state information and the face image area.

(Appendix 30)
In the stereoscopic image display method according to appendix 27,
In the case where the moving object is a seat for the observer and a backrest portion of the seat is movable,
Prior to the relative position calculation step,
A moving object state detection step of detecting state information relating to the position state of the moving object;
An observer state detecting step of detecting observer state information relating to the sitting state of the observer;
An observer data storage process for detecting and storing observer data indicating the size information of the observer using the observer state information and the captured image data, and
In the relative position calculating step,
The face image area of the observer is detected from the captured image data, and it is determined whether or not the observer is in close contact with the backrest based on the observer state information. A determination calculation step of calculating the relative position using the observer data and the face image area when it is determined that the object is separated from the backrest part. .

(Appendix 31)
In the stereoscopic image display method according to appendix 27,
In the case where the moving object is a seat for the observer and a backrest portion of the seat is movable,
Prior to the relative position calculation step,
A moving object state detection step of detecting state information relating to the position state of the moving object;
An observer state detecting step of detecting observer state information relating to the sitting state of the observer;
An observer data storage process for detecting and storing observer data indicating the size information of the observer using the observer state information and the captured image data, and
In the relative position calculating step,
Detecting the face image area of the observer from the captured image data, and determining whether the observer is in close contact with the backrest based on the observer state information;
When it is determined that it is in a close state, the relative position is calculated using the state information and the face image region, and when it is determined that the observer is away from the backrest portion, A stereoscopic image display method, wherein the relative position is calculated using the observer data and the face image area.

(Appendix 32)
In the stereoscopic image display method according to appendix 27,
In the relative position calculating step, state information relating to the position state of the moving object is detected based on the captured image data, and the relative position is calculated based on the state information.

(Appendix 33)
In the stereoscopic image display method according to appendix 27,
In the relative position calculating step, a ratio of the face image area of the observer to an image area of a backrest portion of a seat on which the observer is seated is detected from the captured image data, and the relative position is detected using information on the ratio. A three-dimensional image display method characterized by calculating a position.

(Appendix 34)
A stereoscopic image display program to be applied to a stereoscopic image display device that has a stereoscopic display panel means (120) for projecting images with different parallax for each adjacent spatial region and displays a stereoscopic image installed on a moving object,
A moving object state detection function for detecting state information related to the position state of the moving object;
A relative distance calculation function for calculating a relative distance between the stereoscopic display panel means (120) and a specific observer located on the display surface side from this state information,
Device characteristic data receiving function for receiving device characteristic data according to the stereoscopic display panel means (120),
A display setting adjustment function for adjusting display settings of the stereoscopic image with reference to the relative distance and the device characteristic data;
A stereoscopic image display function for displaying the stereoscopic image by projecting the images having different parallaxes to the respective spatial regions based on the display settings after adjustment;
Is realized by a computer provided in advance in the stereoscopic image display device.

(Appendix 35)
A stereoscopic image display program to be applied to a stereoscopic image display device that has a stereoscopic display panel means (120) for projecting images with different parallax for each adjacent spatial region and displays a stereoscopic image installed on a moving object,
An imaging function for photographing the front of the display surface of the stereoscopic display panel (120) together with an observer and recording it as captured image data,
A relative position calculation function for calculating the relative position of the observer with respect to the stereoscopic display panel means (120) using the captured image data;
Device characteristic data receiving function for receiving device characteristic data according to the stereoscopic display panel means (120),
A display setting adjustment function for adjusting display settings of the stereoscopic image with reference to the relative position and the device characteristic data;
A stereoscopic image display function for displaying the stereoscopic image by projecting the images having different parallaxes to the respective spatial regions based on the display settings after adjustment;
Is realized by a computer provided in advance in the stereoscopic image display device.

(Appendix 36)
In the stereoscopic image display program according to attachment 35,
In the case where the moving object is a seat for the observer and a backrest portion of the seat is movable,
A moving object state detection function for detecting state information related to the position state of the moving object;
An observer state detection function for detecting observer state information according to the sitting state of the observer;
A face image area detection function for detecting the face image area of the observer from the captured image data;
A close state determination function for determining whether or not the observer is in close contact with the backrest based on the observer state information,
The close position determination function calculates the relative position using the state information and the face image area when it is determined that the close state is present, and the observer is in a state away from the backrest portion. A close state dependence calculation function that calculates the relative position using the observer data and the face image area when it is determined
3D image display program characterized by causing the computer to realize the above.

  The present invention is applicable to a stereoscopic image processing system and a stereoscopic image display system having a function of displaying stereoscopic image content on a stereoscopic image display device. Further, the present invention is not limited to the contents of the above-described embodiments and the like, and can be appropriately changed without departing from the gist thereof.

3 Lenticular lens 3a, 3b, 3c, 3d Cylindrical lens (lens)
4 pixel group 4L pixel for left eye 4R pixel for right eye 6 barrier (parallax barrier)
6a Slit (Parallax Barrier)
11, 12, 13, 14 Stereoscopic image display device 20, 21, 22, 23, 24, 25 Light beam 30 Observation surface 40 Display surface (display surface of stereoscopic display panel means)
55L Left eye 55R Right eye 60, 61, 62 Seat 61A, 62A Joint member 61B Seat rear surface portion 61C Seat seat surface portion 62D Outer frame portion 63 Observer seat 64 Front seat 70R, 70R ', 80R, 90R Right eye region 70L , 70L ′, 72L, 80L, 82L, 90L, 92L Left eye area 110 Moving object state detection means 110A, 110B, 110C Inclination sensor 111 First moving object state detection means 112 Second moving object state detection means 120 Stereoscopic display panel means 120A liquid crystal lens 120B display panel 131, 132, 133, 134 arithmetic processing unit 140 observation distance calculation means (relative distance calculation means)
150 Image data storage means 160 Device characteristic data storage means 170, 270 Display setting adjustment means 280 Imaging means 290, 390, 490 Observation position calculation means (relative position calculation means)
310 observer state detector 310A pressure sensor 350 observer data storage processing means E ₀ common electrode _{E 1, E 2, E 3} , E 4 the control electrode P pixel pitch (pixel width)
P 'Projected image width (pixel width projected on the observation surface)
e Binocular OD Optimal viewing distance (optimal observation distance)
ND Shortest viewing distance (shortest observation distance)
FD Longest viewing distance (longest viewing distance)
L Lens width (Cylindrical lens width)
S Barrier width h Distance from the image display panel to the light separation means (distance between the main point of the lens and the pixel)

Claims (15)

A stereoscopic image display device that is installed on a moving object and displays a stereoscopic image,
Stereoscopic display panel means for projecting images with different parallax for each adjacent spatial region;
Imaging means for photographing an observer in front of the display surface of the stereoscopic display panel and recording it as captured image data;
A relative position calculating means for calculating a relative position of the observer with respect to the stereoscopic display panel means using the captured image data;
Device characteristic data storage means for storing device characteristic data according to the stereoscopic display panel means;
A stereoscopic image display device comprising: display setting adjustment means for adjusting display settings of the stereoscopic image with reference to the relative position and the device characteristic data. The stereoscopic image display device according to claim 1,
A moving object state detecting means for detecting state information related to the position state of the moving object;
The relative position calculation means uses the captured image data and the state information when calculating the relative position. The stereoscopic image display device according to claim 2,
The moving object is a seat, and the back portion of the seat is movable;
The moving object state detection means is installed on a backrest portion of the seat, and detects information relating to an inclined state of the backrest portion as the state information. The stereoscopic image display device according to claim 3,
The relative position calculating means detects a ratio of the face image area of the observer to an image area of a backrest portion of a seat on which the observer is seated from the captured image data, and information related to the ratio and the state information A stereoscopic image display device, wherein the relative position is calculated using The stereoscopic image display device according to claim 4,
Observer state detection means for detecting observer state information relating to the sitting state of the observer;
Observer data storage processing means for detecting and storing observer data indicating the size information of the observer using the observer state information and the captured image data,
The relative position calculating means includes
Detecting means for detecting a face image area of the observer from the captured image data; and determining means for determining whether the observer is in close contact with the backrest based on the observer state information; And having
When the determination means determines that the state is close, the relative position is calculated using the state information and the face image area, and the observer is in a state away from the backrest part. When the determination is made, the stereoscopic image display apparatus calculates the relative position using the observer data and the face image area. The stereoscopic image display device according to claim 5,
The observer data storage processing means uses the captured image data when the observer is in close contact with the backrest portion when detecting the observer data. The stereoscopic image display device according to claim 1,
The relative position calculation means detects state information concerning the position state of the moving object using the captured image data, and calculates the relative position based on the state information. The stereoscopic image display device according to claim 1,
The moving object is a seat, and the back portion of the seat is movable;
The relative position calculation means detects a ratio of the face image area of the observer to an image area of a backrest portion of a seat on which the observer is seated from the captured image data, and uses the information relating to the ratio to calculate the relative position. A stereoscopic image display device characterized by calculating a position. The stereoscopic image display device according to any one of claims 1 to 8,
The stereoscopic display panel means includes:
A display panel in which a plurality of pixels including at least a first sub-pixel that displays an image for a first viewpoint and a second sub-pixel that displays an image for a second viewpoint are arranged in a matrix;
3D image display apparatus, comprising: light beam separating means for distributing light beams emitted from the sub-pixels in different directions. The stereoscopic image display device according to claim 9,
The light beam separating means comprises an active element whose light beam separating direction can be changed,
The stereoscopic image display apparatus, wherein the display setting adjusting unit adjusts a stereoscopic viewing range by controlling a refractive index distribution of the light beam separating unit in accordance with the relative position. In the three-dimensional image display device according to any one of claims 1 to 10,
The display setting adjustment unit changes a parallax value or a luminance value of the stereoscopic image in accordance with the relative position. A stereoscopic image display method in a stereoscopic image display device that has stereoscopic display panel means for projecting images with different parallax for each adjacent spatial region and displays a stereoscopic image installed on a moving object,
An imaging step of photographing an observer in front of the display surface of the stereoscopic display panel and recording it as captured image data;
A relative position calculating step of calculating a relative position of the observer with respect to the stereoscopic display panel means using the captured image data;
A device characteristic data receiving step of receiving device characteristic data according to the stereoscopic display panel means;
A display setting adjustment step of adjusting display settings of the stereoscopic image with reference to the relative position and the device characteristic data;
A stereoscopic image display method for displaying the stereoscopic image by projecting images with different parallaxes to the respective spatial regions based on the display settings after adjustment. . In the three-dimensional image display method according to claim 12,
A moving object state detection step of detecting state information related to the position state of the moving object;
In the relative position calculating step, the relative position is calculated by referring to the state information together with the captured image data. In the three-dimensional image display method according to claim 12,
When the moving object is a seat and the back portion of the seat is movable,
Prior to the relative position calculation step,
A moving object state detection step of detecting state information relating to the position state of the moving object;
An observer state detecting step of detecting observer state information relating to the sitting state of the observer;
An observer data storage process for detecting and storing observer data indicating the size information of the observer using the observer state information and the captured image data, and
In the relative position calculating step,
Detecting the face image area of the observer from the captured image data, and determining whether the observer is in close contact with the backrest based on the observer state information;
When it is determined that it is in a close state, the relative position is calculated using the state information and the face image region, and when it is determined that the observer is away from the backrest portion, A stereoscopic image display method, wherein the relative position is calculated using the observer data and the face image area. In the three-dimensional image display method according to claim 12,
In the relative position calculating step, state information relating to the position state of the moving object is detected based on the captured image data.

Images