JP4856775B2 - 3D image presentation device - Google Patents

Description

  The present invention relates to a stereoscopic image presentation device that presents a stereoscopic image, for example, a device that stereoscopically represents a cultural property such as a Buddha image and presents it to an observer, and presents a stereoscopic image according to the movement or operation of the observer It can be used for an interactive device having a bidirectional function, a stereoscopic video system for medical education, and the like.

  Conventional stereoscopic images are displayed on an image presenting surface installed in front of the observer, and a sense of depth is produced by reproducing the object before and after that. On the other hand, a horizontal display type 3D image in which an image presentation surface is installed horizontally and a 3D image is reproduced in the vertical direction can express “height”, unlike a normal 3D image. The inventors of the present application have conducted research and development focusing on horizontal display of stereoscopic images since 1993, and applied for patent applications (see Patent Document 1), medical education fields, etc. (for example, see Non-Patent Documents 1 and 2). Have been working on.

  By the way, when the image presentation surface is installed horizontally, that is, in parallel with the ground and the stereoscopic image is observed obliquely from above, the viewpoint of the observer is assumed, and the average parallax amount over the entire presentation surface is zero. It is necessary to set the amount of parallax so that an appropriate stereoscopic image is reproduced, for example, by adjusting the perspective or changing the perspective by keystone correction. Further, several proposals have been made domestically and internationally for this parallax amount setting method, particularly a method for changing the perspective (see Patent Documents 2 to 6).

For example, as shown in FIGS. 12 and 13, a square 901 as a subject drawn on a horizontal plane 900 is photographed by a parallel method using left-eye and right-eye live-action cameras 902 and 903. To do. Here, the imaging surfaces 904 and 905 of the left and right live-action cameras 902 and 903 are normally arranged at right angles to the shooting direction of the camera (the optical axis direction of the lens) as shown in the figure. Images captured by the surfaces 904 and 905 are images that are projected onto a plane parallel to the imaging surfaces 904 and 905, that is, a projection plane 906 that is perpendicular to the shooting direction of the camera, and the space in which the subject exists. In FIG. 5, the oblique surface, not the horizontal surface, becomes the projection surface 906. Therefore, as shown in FIG. 13, the square 901 appears in the trapezoidal shapes 907 and 908 that are reduced in height and distorted in the left-right direction in the left-eye image and the right-eye image. A point at the left end of the side of the square is reflected in the points A _1L and A _1R of the trapezoids 907 and 908, and a point B in the center of the square 901 is reflected in the points B _1L and B _1R of the trapezoids 907 and 908, and the square 901 the right end of the point C of the near side of the edge of, caught on _{C 1L} point and _{C 1R} point of the trapezoid 907, 908.

In general, when the parallel method is used, the subject is shown on the right side in the image for the left eye and the same subject is shown on the left side in the image for the right eye as shown in FIGS. When the left-eye image and the right-eye image are displayed on the same image display surface without any shift, the left and right lines of sight intersect, and the stereoscopic image is entirely in front of the image display surface (observer side). ). Therefore, when the parallel image is taken, the left-eye image and the right-eye image are shifted in the same direction, and the B _1L point of the trapezoid 907 and the B _1R point of the trapezoid 908 are made coincident with each other. Adjustment is made so that the overall parallax amount becomes zero.

  However, even when the amount of parallax is adjusted by shifting in the same direction as described above, when the captured left-eye image and right-eye image are displayed on the horizontally set image display surface 909, this is observed. When the left and right eyes 910 are observed from obliquely above, an image in a state of being projected on the projection surface 911 is reflected on the observer's eyes 910 as in the case of shooting with the live-action cameras 902 and 903. Therefore, as shown in FIG. 13, the images reflected in the left and right eyes 910 of the observer are trapezoids 907 and 908 displayed on the horizontal image display surface 909, and the height is further reduced, and the horizontal direction is further increased. It becomes an image of the state of trapezoids 912 and 913 that are distorted.

In FIG. 13, the parallax amount S _A1 between the A _1L point of the trapezoid 907 and the A _1R point of the trapezoid 908 when the B _1L point of the trapezoid 907 and the B _1R point of the trapezoid 908 coincide with each other, and the C _{1L of the} trapezoid 907 If the parallax amount S _C1 between the point and the C _1R point of the trapezoid 908 is an amount of parallax for reproducing an appropriate stereoscopic image, the B _2L point of the trapezoid 912 and the B _2R point of the trapezoid 913 are matched. When the amount of parallax S _A2 between the A _2L point of the trapezoid 912 and the A _2R point of the trapezoid 913 is larger than the appropriate parallax amount S _A1 , the amount of deviation in the same side direction is larger. Compared to the reproduction, the point A is reproduced on the back side of the image presentation surface. On the other hand, the parallax amount _{S C2} of the _{C 2R} point _{C 2L} point and trapezoidal 913 of trapezoidal 912 when is matched with the _{B 2R} point _{B 2L} point and trapezoidal 913 of trapezoidal 912, an appropriate parallax amount _{S C1} Compared with the case where an appropriate stereoscopic image is reproduced, the point C is reproduced on the near side of the image display surface because the amount of deviation in the crossing direction is larger than that.

  Considering the above in terms of a three-dimensional subject, FIG. 14 and FIG. 15 are obtained. As shown in FIG. 14, when a quadrangular prism 921, which is a subject standing upright from a horizontal plane 920, is photographed obliquely from above with a left-eye and right-eye shooting camera, each imaging surface 922, 923 of the left and right shooting cameras is captured. In the left-eye image and the right-eye image imaged in step 4, rectangular columns 924 and 925 having a reduced height as shown in FIG. This corresponds to the trapezoids 907 and 908 shown in FIG. Then, when the left eye image and the right eye image in which the quadrangular prisms 924 and 925 with reduced heights are displayed are displayed on the horizontally provided image display surface, similarly to the case of FIG. 13 described above. In the eyes of the observer, a quadrangular column whose height is further reduced than that of the quadrangular columns 924 and 925 is shown in the state of the quadrangular columns 924 and 925. This corresponds to the trapezoids 912 and 913 in FIG. Therefore, in reality, the quadrangular column 921 that stands up vertically from the horizontal plane 920 appears to the viewer's eyes in a tilted direction toward the back side of the image display surface.

  In order to solve this problem, the left-eye image and right-eye image captured by the camera are subjected to correction processing that eliminates the perspective (arithmetic processing for converting the trapezoid into a rectangle), and then the image display surface installed horizontally Need to be displayed. When such a correction process for eliminating the perspective is performed, as shown in FIG. 15, the quadrangular columns 924 and 925 having a reduced height are stretched and the width of the quadrangular columns 926 and 927 is increased as the upper portion is expanded. It becomes. The quadrangular columns 926 and 927 in the corrected image correspond to the quadrangular columns 928 and 929 obtained by projecting the quadrangular column 921 onto the horizontal plane 20, as shown in FIG. That is, if the left-eye image and the right-eye image displayed on the horizontally provided image presentation surface are in the same state as the image projected on the horizontal plane 20, an appropriate stereoscopic image can be obtained.

  Note that not only when shooting with a live-action camera, but also when displaying a computer graphics image generated by performing a rendering process using a virtual camera for computer graphics image generation on a horizontally installed image presentation surface The same can be said for.

  Further, in the above description, the case of photographing by the parallel method has been described. However, it is generally known that when photographing by the intersection method is performed as shown in FIG. 16, a keystone distortion as shown in FIG. 17 occurs. (See Non-Patent Document 3, p. 108). In FIG. 16, when the subject 942 is photographed by the intersection method with the left-eye and right-eye live-action cameras 940 and 941, the left-eye images captured by the imaging surfaces 943 and 944 of the left and right live-action cameras 940 and 941 and The image for the right eye is an image projected on planes parallel to the imaging planes 943 and 944, that is, projection planes 945 and 946 orthogonal to the optical axis of the camera. Accordingly, when these left-eye image and right-eye image are displayed on an elevation on the image display surface 947 arranged in front of the observer as shown by a two-dot chain line in FIG. 16, the image is displayed as shown in FIG. The left and right images are distorted at the periphery of the presentation surface 947, causing a vertical shift (referred to as vertical parallax), which causes a visual burden. Here, the description has been made assuming that the image presenting surface is an upright surface, but it is the same even if the image presenting surface is assumed to be horizontal and the subject is photographed from above. Keystone distortion occurs in a stereoscopic video presented on a simple image presentation surface.

  On the other hand, various methods of presenting stereoscopic images using binocular parallax have been devised, but there are no perfect methods yet. For example, in the lenticular method used for autostereoscopic presentation of stereoscopic images (see Non-Patent Document 3, p. 76-77), the resolution is high in the binocular system but the viewing area is narrow, and the viewing area is wide in the multi-view system. However, there arises a problem that the resolution is lowered.

  In addition, as a 3D image presentation method using multiple image presentation surfaces including horizontal display, the University of Illinois is designed to perform elevation display on the front (front) and left and right sides and horizontal display on the floor. The CAVE (Cave Automatic Virtual Environment) invented in 1) can be said to be a representative example, but the image presentation method is implemented only by the time division method using the liquid crystal shutter glasses, that is, the same image presentation on all image presentation surfaces. Currently, the system is adopted.

JP-A-7-261118 (Claim 1, FIG. 1, Abstract) JP 2004-178579 A (Claim 1, FIG. 8) Japanese Unexamined Patent Publication No. 2004-178581 (Claim 1, FIG. 8, Summary) JP 2004-206672 A (FIG. 23, summary) US Pat. No. 6,389,236 US Pat. No. 6,614,427

Takashi Kawai, Kagenoro Noro, “Surgical Skills Education and Stereoscopic Imaging System”, Medical Instrumentation, Japanese Society of Medical Instrumentation, 1999, Vol. 69, no. 3, p. 130-134 Takashi Kawai, Kagenoro Noro et al., “Recording and Presentation of Work Environments Using Virtual Reality”, Human Science, Human Science Foundation, 1997, Vol. 9, no. 2, p. 57-63 Takashi Kawai and Miwa Tanaka, “Introduction to Next Generation Media Creator [1], Stereoscopic Image Expression”, First Edition, Cut System Co., Ltd., December 10, 2003, p. 76-77, p. 108

  As described above, when stereoscopic display is performed on an image display surface installed horizontally, a correction process (see Patent Documents 2 to 6 described above) that eliminates the perspective that has been performed conventionally is a live-action camera or a computer graphics image. This is a secondary correction process for a stereoscopic image after an image is captured or generated using a generation virtual camera. For this reason, complicated arithmetic processing must be performed, and there is a problem that the processing load is large and takes time.

  Also, correction processing to eliminate the perspective is necessary not only when performing horizontal display but also when the image presentation surface is tilted, as long as the shooting direction of the camera is oblique to the image presentation surface. It becomes. However, even when the image display surface is tilted, it may be possible to reproduce an appropriate stereoscopic image by applying a correction processing method that eliminates the perspective that has been used in the past. As in the case of, since this is merely a secondary correction process after the image is captured or generated, the problem that it has is the same as in the case of horizontal display.

  Accordingly, it is desired to construct a system that can capture or generate an image so that an appropriate (natural) stereoscopic image is reproduced when a stereoscopic image is presented on a horizontal or inclined image presentation surface.

  Furthermore, in the above-mentioned CAVE of the University of Illinois, a stereoscopic image without distortion is generated in real time on the horizontal image presentation surface (floor surface). However, since the photographing method using the virtual camera is a parallel method to the last, the intersection method is used. Therefore, it is desirable to construct a system that can reproduce an appropriate stereoscopic image even when shooting with the camera.

  As described above, various stereoscopic video presentation methods using binocular parallax have been devised, but none are yet perfect. The glasses-equipped method is of course incomplete, but even in the naked-eye method that does not require glasses, it is necessary to sacrifice the viewing zone to improve the resolution and the resolution to enlarge the viewing zone. Therefore, it is desirable to construct a complex system that can complement these conflicting requirements and achieve both resolution and viewing zone. The above-mentioned CAVE of the University of Illinois has a plurality of image presentation surfaces, but since there is only one image presentation method (time division method using liquid crystal shutter glasses), both resolution and viewing zone are compatible. It is not possible.

  In addition, the position of the eyes or head of the viewer of the stereoscopic image is not always fixed relative to the image display surface, and the relative relationship between the two changes dynamically. There is also. That is, while the position of the observer's eye or head is fixed, the image display surface is moved to change its inclination, or conversely, the observer is close to or away from the fixed image display surface. If the action is taken or these movements are combined, the environment when the stereoscopic image is presented to the observer changes. In order to present an optimal 3D image according to the situation at that time (an inclination angle of the image display surface, a viewing distance from the observer to the image display surface), the above-described perspective is eliminated. It is necessary to perform correction processing or processing equivalent to it, or adjustment processing between the resolution and the viewing zone described above, depending on the environment during playback. Did not exist until. For this reason, there has been a problem that precise and flexible expression of stereoscopic images is restricted. Therefore, rather than unilaterally presenting the stereoscopic video to the observer, it is possible to input the observer's movements and operations and present the optimal stereoscopic video according to the observer's movements and operations. In order to realize a stereoscopic video presentation device with (bidirectionality), it is desirable to construct a system that can perform image presentation control according to the environment during reproduction (inclination angle and viewing distance of the image presentation surface). It is.

  An object of the present invention is to provide a three-dimensional image presentation device that can naturally and precisely represent a three-dimensional image.

  The stereoscopic video presenting apparatus of the present invention includes a plurality of image presenting surfaces, and each of the image presenting methods of these image presenting surfaces includes a plurality of types of image presenting methods, and among these image presenting methods, At least one type is a stereoscopic video presenting system.

  Here, “a plurality of types of image presentation methods are included” means that when the number of image presentation surfaces is two, the image presentation methods of the two image presentation surfaces are different from each other. When the number of presentation surfaces is three or more, the image presentation methods of all the image presentation surfaces may be different, or some image presentation surfaces of the same image presentation method may be included. The purpose. For example, when the image presentation surface of the same image presentation method is included in part, for example, the front surface (front surface, that is, the surface directly facing the observer), the left and right side surfaces (elevation surface), and the floor surface (horizontal surface) are substantially narrow In the case of arranging four image presentation surfaces (see FIG. 9 described later), the front surface of these four image presentation surfaces is the first image presentation method (for example, a twin-lens lenticular method), The left and right side surfaces and the floor surface are set to the second image display method (for example, multi-lens lenticular method), or the front and left and right side surfaces are set to the first image display method (for example, twin-lens lenticular method). The floor surface is a second image presentation method (for example, a multi-lens lenticular method), and the front surface is a first image presentation method (for example, a twin-lens lenticular method). To the second image presentation method ( For example, a multi-lens type (8-eye type, etc. lenticular method) and a floor surface is a third image presentation type (for example, a multi-eye type (16-eye type, etc.) lenticular method with a larger number of eyes). Etc. are included.

  In addition, the “image presentation method” includes not only a stereoscopic video presentation method that presents a stereoscopic video image but also a planar video presentation method that presents a planar video image. Therefore, in the present invention, "at least one of the image presentation methods is a stereoscopic video presentation method", all the image presentation methods of a plurality of image presentation surfaces may be a stereoscopic video presentation method, This means that the stereoscopic video presentation method and the planar video presentation method may be combined. For the stereoscopic image presentation method, for example, as a glasses type, for example, a polarized glasses type (a method in which lights having different polarization directions formed by two projectors are superimposed on a screen, a micropole method, etc.), a liquid crystal shutter type, etc. As a method without glasses, for example, a lenticular method (two-lens type lenticular method, multi-lens type (three-lens type, eight-eye type, etc.) lenticular method, etc.), parallax barrier method (image splitter method, Double image splitter method, etc.), backlight division method, integral photography method (IP method), and the like. In the present invention, for example, with regard to the lenticular method, different images are used when the number of eyes is different, such as the binocular lenticular method and the multi-lens (three-lens type, eight-eye type, etc.) lenticular method. It shall be a presentation method. The same applies to other methods, and the image presentation method in the present invention is a subdivided method.

  Further, the “image presentation surface” includes a screen constituting a head-mounted display (HMD) that is worn on the head of the observer.

  The “image display surface” includes only a display screen (including a large or small screen on which a projector performs projection, a small monitor screen, or a display screen of a portable device such as a mobile phone or a portable information terminal). In addition, it also includes image presentation surfaces (printed live-action images, printed computer graphics images, printed animation images, etc.) that are presented by printed materials. Both the presentation method and the planar image presentation method can be adopted.

  In such a stereoscopic video presenting apparatus of the present invention, by displaying images (including printing) by different image presenting methods on a plurality of image presenting surfaces, a combination of a plurality of types of image presenting methods can be used. It is possible to present a stereoscopic image that complements the shortcomings of the method. For example, it is possible to present a stereoscopic image that achieves both resolution and viewing area. For this reason, it becomes possible to express a stereoscopic image naturally and precisely, thereby achieving the object.

  In the stereoscopic video presenting apparatus described above, it is desirable that each of the image presentation methods on the plurality of image presentation surfaces includes a plurality of types of stereoscopic video presentation methods.

  Here, “a plurality of types of stereoscopic video presentation methods are included” means that all the video presentation planes may have different stereoscopic video presentation schemes, or partly the same stereoscopic video presentation scheme image presentation plane May be included, and an image presentation surface of a planar video presentation method may be partly included.

  Thus, when it is set as the structure which includes several types of three-dimensional video presentation system, the image for left eyes and the image for right eyes are displayed on a several image presentation surface by a different three-dimensional video presentation system (a printing is included). Accordingly, it is possible to present a stereoscopic video that combines a plurality of types of stereoscopic video presentation methods and complements the drawbacks of the respective methods. For this reason, it becomes possible to express stereoscopic images more naturally and precisely, thereby achieving the object.

  Furthermore, in the above-described stereoscopic video presenting apparatus, an image presented on at least one of the plurality of image presentation surfaces is an inclination angle of an imaging surface of a real camera or a virtual camera for generating a computer graphics image. It is desirable that the image is a photographed or generated image with the tilt angle parameter of the image pickup surface matched or substantially matched with the tilt angle of each image presentation surface.

  Here, the image presenting method of the image presenting surface that presents the image captured or generated by adjusting the tilt angle or the tilt angle parameter of the imaging surface as described above is a stereoscopic video presenting method using binocular parallax. In this case, the image for the left eye and the image for the right eye presented on the image presentation surface are the inclination angles of the imaging surfaces of the left and right live-action cameras or the imaging surfaces of the left and right virtual cameras for computer graphics image generation. Are taken or generated by making the inclination angle parameter coincide with or substantially coincide with the inclination angle of the image display surface.

  The “tilt angle of the imaging surface of the live-action camera” or “inclination angle parameter of the imaging surface of the virtual camera for computer graphics image generation” here refers to the relative of the imaging surface to the housing of the live-action camera or virtual camera. It is not an absolute inclination angle, but an absolute inclination angle of the imaging surface in a space where a subject (a computer graphics model) exists. Therefore, “match or substantially match the inclination angle of the image presentation surface” means that the imaging surface is arranged in parallel or substantially parallel to the image presentation surface. The same applies to the following inventions.

  As described above, when an image captured or generated in a state where the tilt angle of the imaging surface of the camera matches or substantially matches the tilt angle of the image display surface, the image is displayed on the image display surface ( (Including printing), the correction processing for eliminating the perspective, which has been performed conventionally, that is, the arithmetic processing that is secondarily performed after the photographing or generation of the image by the real camera or the virtual camera can be omitted. When the shooting or generation of the image is completed, an image without a perspective can be obtained and displayed (including printing) on the image presenting surface. For this reason, it is possible to obtain a stereoscopic image expressed more naturally and precisely, and it is not necessary to perform complicated arithmetic processing for eliminating the perspective described in Patent Documents 2 to 6 described above. The processing burden can be reduced.

  As a configuration using an image captured or generated in a state where the tilt angle of the imaging surface of the camera matches or substantially matches the tilt angle of the image presentation surface, more specifically, the following configuration is given. be able to.

  That is, in the stereoscopic video presenting device described above, at least one of the plurality of image presenting surfaces presents a real image captured in real time by a real camera, and has a configuration in which the tilt angle can be changed. An imaging surface provided on the live-action camera so that the tilt angle can be changed, an image display processing means for performing processing for displaying a live-action image captured on the imaging surface on the image presentation surface, and driving the imaging surface for imaging. An imaging surface driving means for changing the tilt angle of the surface, an image presenting surface angle detecting means for detecting the tilt angle of the image presenting surface, and an inclination angle of the image presenting surface and imaging based on a detection signal by the image presenting surface angle detecting means An imaging surface control unit that generates a control signal for matching or substantially matching the tilt angle of the surface and transmits the control signal to the imaging surface driving unit can be provided.

  Here, when the image presentation method of the image presentation surface is a stereoscopic video presentation method using binocular parallax, each of the left and right live-action cameras that capture the left-eye image and the right-eye image for stereoscopic video presentation An imaging surface capable of changing the inclination angle is provided, and the imaging surface control means determines the inclination angle of the image presentation surface and the inclination angle of each imaging surface of the left and right live-action cameras based on the detection signal from the image presentation surface angle detection means. A control signal for matching or substantially matching each other is generated and transmitted to the imaging surface driving means (for example, in the case of an image presenting surface arranged on the front surface of FIG. 1 to be described later). The imaging surface driving means may be provided in each of the left and right live-action cameras and separately drive the imaging surfaces of the left and right live-action cameras, or drive the imaging surfaces of the left and right live-action cameras at the same time. It is good also as a structure.

  In this way, when the live-action camera is provided with an imaging surface that can change the tilt angle, the live-action image taken in real time by the live-action camera is presented, and an image presentation surface that can change the tilt angle is provided. The image presentation surface angle detection means detects the inclination angle of the image presentation surface, and the imaging surface control means matches the inclination angle of the image presentation surface with the inclination angle of the imaging surface based on the detection signal from the image presentation surface angle detection means. Alternatively, a control signal for substantially matching is generated and transmitted to the imaging surface driving means, and the imaging surface driving means receives the control signal from the imaging surface control means and drives the imaging surface to set the inclination angle of the imaging surface. Then, the image display processing means performs processing for displaying the actual image captured on the imaging surface after adjusting the tilt angle on the image presentation surface. For this reason, since it becomes possible to acquire an image by changing the tilt angle of the imaging surface in accordance with the environment at the time of reproduction (the tilt angle of the image presentation surface), it is possible to present an appropriate video to the observer. Is possible. In particular, when presenting a stereoscopic image, a natural stereoscopic image from which distortion has been removed is reproduced. In addition, since it is possible to acquire an image by changing the tilt angle of the imaging surface in real time, it is possible to express a flexible and diverse image, particularly in the case of stereoscopic image expression. .

  In the above-described stereoscopic video presenting apparatus, at least one of the plurality of image presenting surfaces is generated by performing a real-time rendering process using a virtual camera for computer graphics image generation. Model information storage means for presenting a graphics image and changing the tilt angle, storing information about a model for computer graphics, and image presenting surface angle detection for detecting the tilt angle of the image presenting surface And the tilt angle parameter of the imaging surface of the virtual camera matches or substantially coincides with the tilt angle of the image presenting surface using information on the model and the model stored in the model information storage unit based on the detection signal from the image presenting surface angle detecting unit Computer graphics by rendering Computer graphics image generating means for generating an image, and image display processing means for performing processing for displaying the computer graphics image generated by the computer graphics image generating means on the image presentation surface. it can.

  Here, when the image presenting method of the image presenting surface is a stereoscopic image presenting method using binocular parallax, the computer graphics image generating means presents the tilt angle parameters of the respective image capturing surfaces of the left and right virtual cameras. The left and right computer graphics images are generated by performing rendering processing in accordance with or substantially in agreement with the inclination angle of the surface (see FIG. 5 described later).

  In this way, it is possible to set the tilt angle parameter of the imaging surface of the virtual camera, present the computer graphics image generated by performing the rendering process in real time using the virtual camera, and change the tilt angle When a possible image presentation surface is provided, the inclination angle of the image presentation surface is detected by the image presentation surface angle detection means, and the model based on the detection signal from the image presentation surface angle detection means by the computer graphics image generation means. A computer graphics image is generated by performing rendering processing with the tilt angle parameter of the imaging surface of the virtual camera matched or substantially matched with the tilt angle of the image presentation surface using information on the model stored in the information storage means, Computer graphics image production by image display processing means It performs a process of displaying a computer graphics image generated by the means on the image presentation surface. For this reason, it is possible to generate a CG image by changing the tilt angle parameter of the imaging surface in accordance with the environment at the time of reproduction (inclination angle of the image presenting surface), so that an appropriate image is presented to the observer. It becomes possible to do. In particular, when presenting a stereoscopic image, a natural stereoscopic image from which distortion has been removed is reproduced. In addition, since it is possible to generate a CG image by changing the tilt angle parameter of the imaging surface in real time, it is possible to express a flexible and diverse video, especially in the case of stereoscopic video expression. become.

  Furthermore, in the above-described stereoscopic video presenting apparatus, at least one of the plurality of image presenting surfaces is rendered using a real camera image captured in advance by a real camera or a virtual camera for generating a computer graphics image. The pre-generated computer graphics image is presented, and the tilt angle of the imaging surface of the live-action camera or the tilt angle parameter of the imaging surface of the virtual camera matches or substantially matches the tilt angle of the image presentation surface. The image storage means for storing the image taken or generated in this manner, and the image display processing means for performing the process of displaying the image stored in the image storage means on the image presentation surface can be provided.

  Here, when the image presenting method of the image presenting surface is a stereoscopic image presenting method using binocular parallax, each image of the left and right virtual cameras or each of the left and right virtual cameras is stored in the image storage means. The image for the left eye and the image for the right eye, which are photographed or generated with the inclination angle parameter of the imaging surface being made to coincide with or substantially coincide with the inclination angle of the image presentation surface, are stored, and the image display processing means The eye image and the right eye image are configured to be displayed on the image presentation surface (for example, in the case of an image presentation surface arranged on a horizontal plane in FIG. 1 described later).

  When an image presentation surface for presenting a computer graphics image generated in advance by performing a rendering process using a live-action image or a virtual camera taken in advance by a live-action camera is provided in the image storage unit, An image captured or generated by storing the tilt angle parameter of the imaging surface of the real-time camera or the tilt angle parameter of the imaging surface of the virtual camera with the tilt angle of the image display surface is stored, and stored by the image display processing unit. Then, a process of displaying the image stored in the image storage means on the image presentation surface is performed.

  As described above, in the case of using a configuration in which an image captured or generated in advance and stored in the image storage unit is used instead of using an image captured or generated in real time, At least one of the image presentation surfaces presents a computer graphics image generated in advance by performing a rendering process using a real image captured in advance by a camera or a virtual camera for computer graphics image generation, And an image presentation surface angle detection means for detecting the inclination angle of the image presentation surface, and the image storage means includes an inclination angle of an imaging surface of a real camera or an imaging surface of a virtual camera. A plurality of images shot or generated by changing the tilt angle parameter of the image are stored, and image display processing means Based on a detection signal from the image presentation surface angle detection means, an image corresponding to the detected inclination angle of the image presentation surface is selected or interpolated from a plurality of images stored in the image storage means, and the image presentation surface is selected. It is good also as a structure which performs the process displayed on this.

  Here, “a plurality of images captured or generated by changing the tilt angle of the imaging surface of the real camera or the tilt angle parameter of the imaging surface of the virtual camera” means a certain angular interval (for example, an interval of 5 degrees, 10 It may be a plurality of images captured or generated at a degree interval, or a plurality of images captured or generated at unequal angular intervals.

  The “image corresponding to the inclination angle of the image presentation surface” means an image presentation surface in which the inclination angle of the imaging surface of the real camera or the inclination angle parameter of the imaging surface of the virtual camera is detected by the image presentation surface angle detection means It is an image photographed or generated in a state that coincides with or substantially coincides with the inclination angle. If there is no image captured or generated in a state of matching or substantially matching, an image captured or generated in the closest state may be selected, or an interpolation process is performed to generate a corresponding image. May be. For example, when there is an image photographed or generated by setting the tilt angle of the imaging surface of the real camera or the tilt angle parameter of the imaging surface of the virtual camera to 10 degrees and 20 degrees, the image presenting detected by the image presenting surface angle detecting means When the angle of inclination of the surface is 13 degrees, an image captured or generated at the nearest 10 degrees may be selected, or an image captured or generated at 10 degrees and captured or generated at 20 degrees An interpolated image may be generated using the image. At this time, the interpolated image may be generated by performing first-order linear interpolation using images captured or generated at front and rear angles (10 degrees and 20 degrees in the above example), or front and rear angles. The image may be generated by performing secondary or higher-order interpolation using an image other than the image photographed or generated in step (b).

  Furthermore, the image to be presented is a moving image (for example, a butterfly that repeats the same dance action at a certain period, a repeated image of a tropical fish that repeats the same migratory action at a certain period, or an explanation that does not repeat but completes with a story. , A series of images for PR, etc.) in the image storage means, a plurality of images captured or generated by changing the tilt angle of the imaging surface of the real camera or the tilt angle parameter of the imaging surface of the virtual camera. Store images in chronological order. That is, for each time, a plurality of images taken or generated by changing the tilt angle of the imaging surface of the live-action camera or the tilt angle parameter of the imaging surface of the virtual camera are prepared and stored (for example, a diagram described later) 11).

  In this way, an image presentation surface is provided that presents a computer graphics image that has been generated in advance by performing a rendering process using a photographed image or a virtual camera that has been previously photographed by a photographed camera, and the tilt angle can be changed. In this case, the image storage means stores a plurality of images taken or generated by changing the tilt angle of the imaging surface of the real camera or the tilt angle parameter of the imaging surface of the virtual camera, and detects the image presentation surface angle. The inclination angle of the image presentation surface is detected by the means, and the image presentation processing means detects the image presentation detected from the plurality of images stored in the image storage means based on the detection signal from the image presentation surface angle detection means. An image corresponding to the tilt angle of the surface is selected or generated by interpolation and displayed on the image display surface. For this reason, it is possible to display an image taken or generated in a state suitable for the environment according to the environment at the time of reproduction (inclination angle of the image presentation surface). Can be presented. In particular, when presenting a stereoscopic image, a natural stereoscopic image from which distortion has been removed is reproduced.

  Further, in the case of the configuration including the image presenting surface whose tilt angle can be changed and the image presenting surface angle detecting means for detecting the tilt angle of the image presenting surface as described above, Observer position detection means for detecting relative position information of the head or alternative information thereof, image presentation surface drive means for driving the image presentation surface to change the inclination angle of the image presentation surface, and observer position detection Based on the information detected by the means, a control signal for changing the inclination angle of the image presentation surface according to the relative position of the observer's eyes or head with respect to the image presentation surface is generated and transmitted to the image presentation surface driving means. It is good also as a structure provided with the image presentation surface control means.

  Here, the “alternative information” is not the relative position information itself of the observer's eyes or head, but grasps the relative position information of the observer's eyes or head by combining with other information. Information that can be used, or information that is used when an approximate viewing distance is sufficient without requiring an accurate viewing distance. In the case of the former, for example, distance information between the image display surface and the observer's foot or whole body, etc. If the height can be grasped by another method, for example, by allowing the observer to input the height, etc. By combining this height and the distance information of the observer (foot or whole body), it is possible to grasp a substantially accurate viewing distance.

  When the inclination angle of the image presentation surface is changed according to the relative position of the observer's eyes or head with respect to the image presentation surface in this way (see FIGS. 5, 6, and 10 described later), the observation is performed. The position detection means detects relative position information of the observer's eyes or head with respect to the image display surface or alternative information thereof, and based on this detection information, the observer's eyes or head is relative to the image display surface. An image corresponding to the detected inclination angle of the image presentation surface is detected by changing the inclination angle of the image presentation surface according to the position, and further detecting the changed inclination angle of the image presentation surface by the image presentation surface angle detecting means. (Images taken or generated in real time with the tilt angle of the imaging surface of the live-action camera or the tilt angle parameter of the imaging surface of the virtual camera matched or substantially matched with the detected tilt angle of the image display surface Or, shooting in a state close to the detected tilt angle of the image presenting surface from a plurality of images shot or generated by changing the tilt angle of the shooting surface of the real camera or the tilt angle parameter of the shooting surface of the virtual camera Alternatively, it is possible to present an image selected as a generated image, or an image generated by interpolating a plurality of images taken or generated in a close state. For this reason, the inclination angle of the image presentation surface is changed in accordance with the viewing distance, and an image suitable for this environment is formed in accordance with the reproduction environment (viewing distance and inclination angle of the image presentation surface) thus formed. Can be displayed, so that an appropriate image can be presented to the observer. In particular, when presenting a stereoscopic image, a natural stereoscopic image from which distortion has been removed is reproduced.

  Further, as described above, the inclination angle of the image presentation surface is changed based on the detection information by the observer position detection means, and further, the changed inclination angle of the image presentation surface is detected by the image presentation surface angle detection means described above. Instead of presenting an image corresponding to the detected inclination angle of the image presentation surface, the detection information by the observer position detection means is not based on the detection signal by the image presentation surface angle detection means as follows. A configuration may be adopted in which an image corresponding to the inclination angle of the image presentation surface is presented directly.

  That is, in the stereoscopic video presenting device described above, at least one of the plurality of image presenting surfaces presents a real image captured in real time by a real camera, and has a configuration in which the tilt angle can be changed. An imaging surface provided on the live-action camera so that the tilt angle can be changed, an image display processing means for performing processing for displaying a live-action image captured on the imaging surface on the image presentation surface, and driving the imaging surface for imaging. Imaging surface driving means for changing the inclination angle of the surface, observer position detecting means for detecting relative position information of the observer's eyes or head relative to the image presenting surface or alternative information thereof, and driving the image presenting surface The relative position of the observer's eyes or head with respect to the image display surface based on the information detected by the image display surface driving means for changing the inclination angle of the image display surface and the observer position detection means An image presentation surface control means for generating a control signal for changing the inclination angle of the image presentation surface according to the information and transmitting it to the image presentation surface drive means, and an image presentation surface based on the information detected by the observer position detection means The image pickup surface control means for generating a control signal for matching or substantially matching the inclination angle of the image pickup surface and the inclination angle of the image pickup surface and transmitting the control signal to the image pickup surface driving means may be provided.

  In the above-described stereoscopic video presenting apparatus, at least one of the plurality of image presenting surfaces is generated by performing a real-time rendering process using a virtual camera for computer graphics image generation. Model information storage means that presents a graphics image and is capable of changing the tilt angle and stores information relating to a computer graphics model, and the relative position of the observer's eyes or head with respect to the image presentation surface Detected by the observer position detecting means for detecting the position information or the alternative information, the image presentation surface driving means for driving the image presentation surface to change the inclination angle of the image presentation surface, and the observer position detecting means. Inclination of the image display surface according to the relative position of the observer's eyes or head relative to the image display surface based on information Information related to the model stored in the model information storage means based on the information detected by the observer position detection means and the image presentation surface control means for generating a control signal for changing the degree and transmitting it to the image presentation surface drive means A computer graphics image generating means for generating a computer graphics image by performing a rendering process by making the inclination angle parameter of the imaging surface of the virtual camera coincide with or substantially coincide with the inclination angle of the image presentation surface using An image display processing unit that performs a process of displaying the computer graphics image generated by the graphics image generation unit on the image presentation surface may be employed.

  Furthermore, in the above-described stereoscopic video presenting apparatus, at least one of the plurality of image presenting surfaces is rendered using a real camera image captured in advance by a real camera or a virtual camera for generating a computer graphics image. The computer graphics image generated in advance is presented and the tilt angle can be changed, and the tilt angle parameter of the imaging surface of the live-action camera or the tilt angle parameter of the imaging surface of the virtual camera is changed. Image storage means for storing a plurality of captured or generated images; observer position detection means for detecting relative position information of the observer's eyes or head relative to the image display surface or alternative information thereof; and image presentation The image presenting surface driving means for driving the surface to change the inclination angle of the image presenting surface and the observer position detecting means Image presentation that generates a control signal for changing the inclination angle of the image presentation surface according to the relative position of the observer's eyes or head relative to the image presentation surface based on the detected information, and transmits the control signal to the image presentation surface driving means Based on the information detected by the surface control means and the observer position detection means, an image corresponding to the set inclination angle of the image display surface is selected or interpolated from a plurality of images stored in the image storage means. The image display processing means for performing the process of displaying on the image presenting surface may be provided.

  In the stereoscopic video presenting device described above, at least one of the plurality of image presenting surfaces is rendered using a live-action image taken by a live-action camera or a virtual camera for generating a computer graphics image. The computer graphics image generated by processing can be presented in multiple types of image presentation methods, and the relative position information of the observer's eyes or head relative to the image presentation surface or alternative information thereof An observer position detecting means for detecting the image and a real image or computer by switching the image presentation method according to the relative position of the eyes or head of the observer with respect to the image presentation surface based on the information detected by the observer position detecting means A configuration comprising image display processing means for performing processing for displaying a graphics image on an image presentation surface; It may be.

  Here, the image presentation surface that can switch the image presentation method may be an image presentation surface that can change the tilt angle, or may be a fixed image presentation surface that cannot change the tilt angle. .

  In addition, as described above, the “image presentation method” to be switched includes not only a stereoscopic video presentation method for presenting a stereoscopic video but also a planar video presentation method for presenting a planar video. Therefore, not only switching from the stereoscopic video presentation method to another stereoscopic video presentation method, such as switching the image presentation method from the multi-lens lenticular method to the twin-lens lenticular method, but also from the planar video presentation method to the stereoscopic video Switching to a presentation system or switching from a stereoscopic video presentation system to a planar video presentation system is also included.

  When the image presentation method is switched in accordance with the relative position of the observer's eyes or head with respect to the image presentation surface as described above (see FIGS. 5, 6, and 10 to be described later), observer position detection means Thus, the relative position information of the observer's eyes or head with respect to the image presentation surface or alternative information thereof is detected, and the image display processing means is used to detect the relative position of the image presentation surface based on the information detected by the observer position detection means. The image presentation method is switched according to the relative position of the observer's eyes or head, and a real image or a computer graphics image is displayed on the image presentation surface. Therefore, it is possible to switch the image presentation method according to the environment (viewing distance) at the time of playback and display an image suitable for this environment, so that it is possible to present an appropriate video to the observer It becomes.

  As described above, according to the present invention, since a plurality of types of image presentation methods are combined, there is an effect that a stereoscopic video can be expressed naturally and precisely.

BRIEF DESCRIPTION OF THE DRAWINGS The whole block diagram of the three-dimensional image presentation apparatus of 1st Embodiment of this invention. FIG. 3 is an elevation view (viewed from the side) for explaining a shooting situation by the left and right live-action cameras when shooting an image to be displayed on a first image presentation surface arranged on the front surface in the first embodiment. The top view explaining the imaging | photography condition with the right-and-left real camera at the time of imaging | photography the image displayed on the 1st image presentation surface arrange | positioned in the front in 1st Embodiment (viewed from the top). The elevation view (figure seen from the side) explaining the imaging | photography condition by the left and right live-action camera at the time of imaging | photography the image displayed on the 2nd image presentation surface arrange | positioned on the horizontal surface in 1st Embodiment. The whole block diagram of the three-dimensional image presentation apparatus of 2nd Embodiment of this invention. Explanatory drawing which shows the state which the image presentation system and inclination | tilt angle (theta) of an image presentation surface change according to the observer's relative position (viewing distance D) with respect to an image presentation surface in 2nd Embodiment. The figure of the flowchart which shows the flow of the stereo image presentation process by the stereo image presentation apparatus of 2nd Embodiment. The block diagram which shows the 1st modification of this invention. The block diagram which shows the 2nd modification of this invention. The block diagram which shows the 3rd modification of this invention. The block diagram which shows the 4th modification of this invention. The 1st explanatory view of the amendment processing which loses the conventional perspective. The 2nd explanatory view of the amendment processing which loses the conventional perspective. The 3rd explanatory view of the amendment processing which loses the conventional perspective. The 4th explanatory view of the amendment processing which loses the conventional perspective. The 1st explanatory view of keystone distortion which arises by photography by a crossing method. The 2nd explanatory drawing of the keystone distortion which arises by photography by a crossing method.

  Embodiments of the present invention will be described below with reference to the drawings.

[First Embodiment]
FIG. 1 shows the overall configuration of a stereoscopic image presentation device 10 according to the first embodiment of the present invention. 2 and 3 are elevation views (viewed from the side) for explaining the shooting situation with the left and right live-action cameras 60 and 70 when shooting an image to be displayed on the first image presentation surface 21 arranged on the front surface. FIG. 4 is a plan view (viewed from above), and FIG. 4 is a shooting situation of the left and right live-action cameras 60 and 70 when shooting an image to be displayed on the second image presentation surface 31 arranged on the horizontal plane. It is an elevation view (figure seen from the side) explaining

  In FIG. 1, a stereoscopic image presentation device 10 is a display 20 disposed in front (front) of an observer 1, a display 30 disposed horizontally, and an inclination angle of the display 20 (that is, a screen of the display 20. Image presenting surface angle detecting means 40 for detecting the inclination angle θ) of the image presenting surface 21, an image processing device 50 for processing images displayed on the displays 20 and 30, and a subject 2 placed on the horizontal surface 3 are photographed. And left-eye and right-eye live-action cameras 60 and 70.

  The display 20 is a device that presents a stereoscopic image by the first image presenting method (stereoscopic image presenting method) on the image presenting surface 21 that is the screen. The image presenting surface 21 can be freely changed in inclination angle by the operation of the observer 1. In this embodiment, the left-eye and right-eye images taken in real time by the left and right live-action cameras 60 and 70 are used. An image is displayed.

  The display 30 is a device that presents a stereoscopic image by the second image presenting method (stereoscopic image presenting method) on the image presenting surface 31 that is the screen. The image presentation surface 31 is used while being fixed to a horizontal plane, and in this embodiment, left-eye and right-eye photographed images taken in advance by the left and right photographed cameras 60 and 70 are displayed.

  Here, as the first image presentation method of the image presentation surface 21 arranged on the front surface and the second image presentation method of the image presentation surface 31 arranged on the horizontal surface, for example, both are lenticular methods in which no glasses are used. In the case of the method, the image presenting surface 21 arranged on the front surface with a viewing distance adopts the binocular lenticular method as a first image presenting method with priority on the resolution, On the image presentation surface 31 arranged on the horizontal plane where the amount of parallax increases, a multi-lens lenticular method with a wide viewing zone can be adopted as the second image presentation method. Further, a multi-lens lenticular system such as an 8-eye system is adopted as the first image presentation system, and a 16-eye system having a larger number of eyes than the first image presentation system is employed as the second image presentation system. A multi-lens lenticular system such as the above may be adopted. Note that the first and second image presentation methods are not limited to the lenticular method, and may be, for example, a parallax barrier method, an integral photography method (IP method), or the like. By making the image presentation methods 21 and 31 different from each other, a plurality of types of image presentation methods may be combined so that a natural and precise stereoscopic image space is constructed in the observer's brain.

  The configuration of the image presentation surface angle detection unit 40 is arbitrary as long as the inclination angle θ of the image presentation surface 21 can be detected, and can be realized by, for example, a rotary encoder, a gap sensor, a gyro sensor, or the like. Note that the installation position, size, and shape of the image presentation surface angle detection means 40 shown in FIG. 1 are merely examples, and the present invention is not limited thereto.

  The image processing apparatus 50 is configured by a computer, for example, and includes an imaging surface control unit 51, an image display processing unit 52, and an image storage unit 53.

  The imaging surface control unit 51 determines the inclination angles θ and φ (see FIGS. 2 and 3) of the image presentation surface 21 based on the detection signal of the inclination angle θ by the image presentation surface angle detection unit 40, and the left and right eyes. Control signals for matching or substantially matching the tilt angles α and β (see FIGS. 2 and 3) of the imaging surfaces 61 and 71 of the actual shooting cameras 60 and 70 for imaging are generated, and the generated control signals are used as the imaging surfaces. Processing to transmit to the driving means 62 and 72 is performed. Here, the inclination angles θ and φ (see FIGS. 2 and 3) of the image presentation surface 21 and the inclination angles α and β of the imaging surfaces 61 and 71 of the left-eye and right-eye live-action cameras 60 and 70 (see FIG. 2 or 3) means that the image presentation surface 21 and the imaging surfaces 61 and 71 are parallel to each other, and X that forms a three-dimensional space (XYZ space). This means that the tilt angles around any of the axis, the Y axis, and the Z axis are matched. Further, as shown in FIGS. 2 and 3, the inclination angles α and β of the imaging surfaces 61 and 71 are defined as inclination angles in the absolute space, not relative to the housing of the live-action cameras 60 and 70, as shown in FIGS. is doing. The inclination angle θ of the image presentation surface 21 and the inclination angle α of the imaging surfaces 61 and 71 are orthogonal to the upper and lower edge portions of the display 20 (that is, the image presentation surface 21), that is, orthogonal to the paper surface of FIG. The inclination angle φ of the image presentation surface 21 and the inclination angle β of the imaging surfaces 61 and 71 are inclinations around the axis extending in the vertical direction, that is, the direction orthogonal to the paper surface of FIG. Is an angle.

  The image display processing means 52 displays the left-eye image and the right-eye image captured in real time by the left-eye and right-eye live-action cameras 60, 70 on the image presentation surface 21, and the real-shoot camera 60, Processing for displaying the left-eye image and the right-eye image captured in advance by 70 and stored in the image storage means 53 on the image presentation surface 31 is performed.

  As shown in FIG. 4, the image storage means 53 uses the left-eye and right-eye live-action cameras 60 and 70 to match the inclination angles of the imaging surfaces 61 and 71 with the inclination angle of the horizontal image presentation surface 31. Alternatively, the image for the left eye and the image for the right eye that are previously captured are stored in a substantially matched state, that is, in a state where the imaging surfaces 61 and 71 and the horizontal image presentation surface 31 are parallel to each other.

  The imaging surface control means 51 and the image display processing means 52 are a central processing unit (CPU) provided inside a computer or the like constituting the image processing apparatus 50, and one or more that defines the operation procedure of this CPU. Realized by multiple programs.

  The image storage means 53 is preferably realized by, for example, a hard disk or the like, but ROM, EEPROM, flash memory, RAM, MO, CD-ROM as long as the storage capacity and access speed do not cause problems. CD-R, CD-RW, DVD-ROM, DVD-RAM, FD, magnetic tape, or a combination thereof may be employed.

  The live-action cameras 60 and 70 are arranged assuming the positions of the left and right eyes of the observer 1 and shoot a left-eye image and a right-eye image including the subject 2 placed on the horizontal plane 3 by the intersection method. Imaging surfaces 61 and 71 provided such that the inclination angles α and β (see FIGS. 2 and 3) can be freely changed, and the imaging surfaces 61 and 71 are driven to drive the imaging surfaces 61 and 71. And imaging surface driving means 62 and 72 for changing the inclination angles α and β of 71. For convenience of explanation, it is described as if there are two live-action cameras 60 and 70 for the left eye and the right eye, including the illustration, but this is simply a live-action camera corresponding to the left eye and the right eye. However, in the multi-lens lenticular method, more live-action cameras are provided. For example, in the 8-eye lenticular system, eight live-action cameras are provided.

The imaging surfaces 61 and 71 are, for example, complementary metal oxide semiconductors (CMOS: Complementary
Metal-oxide Semiconductor) and charge coupled devices (CCD: Charge Coupled)
It is a light receiving surface of an imaging device such as (Device).

  The imaging surface driving means 62 and 72 are realized by, for example, a motor or a cylinder device. In the present embodiment, the imaging surface driving means 62 and 72 are individually provided in the left and right live-action cameras 60 and 70. However, the imaging surface driving means that can drive the imaging surfaces 61 and 71 together at the same time. May be provided.

  In such a first embodiment, a stereoscopic video is presented by the stereoscopic video presentation device 10 as follows.

  First, the observer 1 adjusts the inclination angle θ of the image display surface 21 to a desired angle at which he or she can easily observe a stereoscopic image by pushing or pulling the front display 20 by hand. Then, the image presentation surface angle detection means 40 detects the inclination angle θ of the image presentation surface 21 after the angle adjustment. Note that the angle detection by the image presentation surface angle detection means 40 is performed every time in the loop processing described below, but in the processing such as photographing after the angle detection, the detected inclination angle θ is compared with the previously detected angle. It may be performed only when it changes, or may be performed every time.

  Subsequently, the imaging surface control means 51 determines the inclination angle θ (see FIG. 2) of the image presentation surface 21 based on the detection signal of the inclination angle θ by the image presentation surface angle detection means 40, and for the left and right eyes. A control signal for making the inclination angles α (see FIG. 2) of the imaging surfaces 61 and 71 of the live-action cameras 60 and 70 coincide with each other, that is, the image presentation surface 21 and the imaging surfaces 61 and 71 are made parallel. Control signals are generated, and the generated control signals are transmitted to the imaging surface driving means 62 and 72. Note that the inclination angle φ (see FIG. 3) of the image presentation surface 21 and the inclination angles β (see FIG. 3) of the imaging surfaces 61 and 71 of the left-eye and right-eye live-action cameras 60 and 70 change. Since they do not match, they remain in agreement or nearly identical.

When receiving the control signal from the imaging surface control means 51, the imaging surface driving means 62 and 72 drive the imaging surfaces 61 and 71 to change the inclination angle α of the imaging surfaces 61 and 71, and thereby incline the image presentation surface 21. Match the angle θ. For example, as shown in FIG. 2, when the inclination angle θ of the image presentation surface 21 is set to θ _A , the inclination angle α of the imaging surfaces 61 and 71 changes to α _A (= θ _A ).

  In this state, the subject 2 is photographed by the live-action cameras 60 and 70, and the image for the left eye and the image for the right eye obtained by photographing are displayed on the image presentation surface 21 in real time by the image display processing unit 52. As described above, when the change in the inclination angle θ of the image presentation surface 21 is not detected by the angle detection by the image presentation surface angle detection means 40, the photographing and the image of the subject 2 by the live-action cameras 60 and 70 are detected. The display content updating process of the image presentation surface 21 by the display processing unit 52 may be omitted. Simultaneously with the display processing on the image presentation surface 21, the image display processing means 52 is used for the left eye image and the right eye image that are previously captured by the live-action cameras 60 and 70 and stored in the image storage means 53. The image is displayed on the image presentation surface 31. In the present embodiment, the display content of the image presentation surface 31 is fixed.

  Then, again, angle detection by the image presentation surface angle detection means 40 is performed, and if the inclination angle θ of the image presentation surface 21 has changed, the inclination angle α of each of the imaging surfaces 61 and 71 according to the state after the change. The image is taken while changing, and thereafter the same loop processing is repeated.

  According to such 1st Embodiment, there exist the following effects. That is, since the left-eye image and the right-eye image are displayed on the plurality of image presentation surfaces 21 and 31 by different image presentation methods, a plurality of types of three-dimensional video presentation methods are combined to complement each other's disadvantages. Such stereoscopic images can be presented. For example, it is possible to present a stereoscopic video that achieves both resolution and viewing area. For this reason, stereoscopic images can be expressed naturally and precisely.

  In addition, the image presenting surfaces 21 and 31 were photographed in a state where the inclination angles of the imaging surfaces 61 and 71 of the live-action cameras 60 and 70 coincide with or substantially coincide with the inclination angles of the image presenting surfaces 21 and 31. Since the stereoscopic image is presented using the left-eye image and the right-eye image, correction processing for eliminating the perspective that has been performed conventionally, that is, arithmetic processing that is secondarily performed after the image is captured by the live-action camera The image without the perspective can be obtained at the time when the photographing of the images by the live-action cameras 60 and 70 is completed, and this can be displayed on the image presentation surfaces 21 and 31. Therefore, it is possible to obtain a stereoscopic image expressed more naturally and precisely, and it is not necessary to perform complicated arithmetic processing for eliminating the perspective described in Patent Documents 2 to 6 described above. Can be reduced.

  Furthermore, since the image can be acquired by changing the inclination angle α of each of the imaging surfaces 61 and 71 according to the environment during reproduction (inclination angle θ of the image presentation surface 21) (see FIG. 2), distortion is removed. Thus, a natural stereoscopic image can be reproduced, and an appropriate stereoscopic image can be presented to the observer. In addition, since the inclination angle α of each of the imaging surfaces 61 and 71 is changed in real time, a flexible and diverse image can be expressed.

  Then, the image presenting surfaces 21 and 31 were photographed in a state where the inclination angles of the imaging surfaces 61 and 71 of the live-action cameras 60 and 70 coincide with or substantially coincide with the inclination angles of the image presenting surfaces 21 and 31. Since the stereoscopic image is presented using the image for the left eye and the image for the right eye (see FIG. 3), keystone distortion (see FIGS. 16 and 17) does not occur even when photographing by the crossing method is performed. A stereoscopic image can be presented, and in this respect, a natural stereoscopic image from which distortion has been removed can be reproduced.

  In addition, the inclination angle θ of the image display surface 21 moved by the operation of the observer 1 is detected, and the inclination angle α of the imaging surfaces 61 and 71 of the live-action cameras 60 and 70 is automatically changed in real time to thereby change the image. Since the acquisition process is performed, it is possible to realize the stereoscopic video presenting apparatus 10 having interactiveness (bidirectionality), and for example, it is possible to improve the diversity of entertainment video expression and the improvement of game play.

[Second Embodiment]
FIG. 5 shows an overall configuration of a stereoscopic video presenting apparatus 200 according to the second embodiment of the present invention. 6 shows a state in which the image presentation method and the inclination angle θ of the image presentation surface 211 change according to the relative position (viewing distance D) of the observer with respect to the image presentation surface 211, and FIG. A flow of stereoscopic video presentation processing by the stereoscopic video presentation device 200 is shown in a flowchart.

  In FIG. 5, the stereoscopic video presenting apparatus 200 includes a display 210, an image presentation surface angle detection unit 220 that detects an inclination angle of the display 210 (that is, an inclination angle θ of the image presentation surface 211 that is a screen of the display 210), An image presentation surface driving means 230 that drives the display 210 to change the inclination angle θ of the image presentation surface 211 of the display 210, and an observation that detects the relative position (approximate viewing distance D) of the observer 201 with respect to the image presentation surface 211 A person position detecting means 240 and an image processing device 250 for processing an image displayed on the image presenting surface 211 are provided.

  The display 210 is a device that presents a stereoscopic video on the image presentation surface 211 that is the screen. The image presentation surface 211 is configured such that the inclination angle θ automatically changes according to the relative position (approximate viewing distance D) of the observer 201 with respect to the image presentation surface 211. In this embodiment, the left and right virtual cameras The left-eye computer graphics image and the right-eye computer graphics image generated in real time by performing a rendering process using 260 are displayed.

  The image presentation surface angle detection unit 220 may have any configuration as long as the inclination angle θ of the image presentation surface 211 can be detected, and can be realized by, for example, a rotary encoder, a gap sensor, a gyro sensor, or the like. Here, the inclination angle θ is an inclination angle around an axis extending in a direction parallel to the upper and lower end edges of the display 210 (that is, the image presentation surface 211), that is, a direction orthogonal to the paper surface of FIG. Note that the installation position, size, and shape of the image presentation surface angle detection unit 220 illustrated in FIG. 5 are merely examples, and the present invention is not limited thereto.

  The image presentation surface driving unit 230 is realized by, for example, a motor, a cylinder device, or the like.

  The observer position detection means 240 is realized by, for example, a laser distance sensor, an infrared sensor, a global positioning system (GPS), a position detection device by image processing, or the like. In the present embodiment, the observer position detection unit 240 does not accurately detect the relative position information of the eyes or head of the observer 201 with respect to the image presentation surface 211, and the observer 201 is used as alternative information. The distance to the observer 201 is detected by capturing the whole body, and the approximate visual distance D is detected. For example, more accurate viewing distance may be detected by measuring or manually inputting the height of the observer 201 or considering the size of the image presentation surface 211. Further, the installation position, size, and shape of the observer position detection means 240 shown in FIG. 5 are merely examples, and the present invention is not limited to this.

  The image processing apparatus 250 is configured by, for example, a computer, and includes an image presentation surface control unit 251, a computer graphics image generation unit 252, an image display processing unit 253, and a model information storage unit 254.

  The image presentation surface control unit 251 generates a control signal for changing the inclination angle θ of the image presentation surface 211 according to the magnitude of the viewing distance D based on the viewing distance D detected by the observer position detection unit 240. The process of transmitting the generated control signal to the image presentation surface driving unit 230 is performed. The correspondence between the viewing distance D and the inclination angle θ is determined in advance and stored in a memory (not shown), and is referred to by the image display surface control unit 251.

  The computer graphics image generation unit 252 uses the information about the display target model stored in the model information storage unit 254 based on the detection signal from the image presentation surface angle detection unit 220 to capture each image of the left and right virtual cameras 260. The value α of the inclination angle parameter of the surface 261 is made to coincide with or substantially coincide with the inclination angle θ of the image presentation surface 211, that is, the computer graphics image is rendered by performing rendering processing with the imaging surface 261 and the image presentation surface 211 in parallel. The process to generate is performed.

  The left and right virtual cameras 260 are set so as to assume the positions of the left and right eyes of the observer 201, and a display target geometric model 203 placed on a horizontal plane 202 in a virtual three-dimensional space is provided. It is a camera for generating the drawn image for the left eye and the image for the right eye. In setting the parameters of the left and right virtual cameras 260, a gazing point (a point on which the camera is paying attention) in a three-dimensional space is usually given as a coordinate value, or three rotation angles of pan, tilt, and roll are given. In the present embodiment, in addition to this, the inclination angle α of the imaging surface 261 of the virtual camera 260 is given as a parameter. Therefore, in a normal rendering process, a plane orthogonal to the camera axis is a screen (perspective projection plane) for drawing an object represented by the geometric model 203. In the present embodiment, a screen for drawing an object. Is parallel to the imaging surface 261 in the state of the inclination angle α set as a parameter, and is therefore set to be parallel to the image presenting surface 211, and thus is a surface inclined with respect to the camera axis. Other settings, such as color and texture settings, light settings, and the like, are the same as those in normal rendering processing. For convenience of explanation, the left and right virtual cameras 260 are described, but this merely indicates that at least one set of virtual cameras corresponding to the left eye and the right eye is set. In the multi-lens lenticular method, more virtual cameras are set. For example, in the 8-eye lenticular method, eight virtual cameras are set.

  The image display processing unit 253 performs processing for displaying the left-eye computer graphics image and the right-eye computer graphics image generated by the computer graphics image generation unit 252 on the image presentation surface 211.

  The model information storage unit 254 stores information related to the geometric model 203 to be reproduced as a stereoscopic image on the image presentation surface 211.

  The image presentation surface control means 251, the computer graphics image generation means 252, and the image display processing means 253 are a central processing unit (CPU) provided inside a computer or the like constituting the image processing device 250, and this This is realized by one or a plurality of programs that define the operation procedure of the CPU.

  The model information storage means 254 is preferably realized by, for example, a hard disk, but ROM, EEPROM, flash memory, RAM, MO, CD-, as long as the storage capacity and access speed do not cause problems. ROM, CD-R, CD-RW, DVD-ROM, DVD-RAM, FD, magnetic tape, or a combination thereof may be employed.

  In the second embodiment, a stereoscopic video is presented by the stereoscopic video presenting apparatus 200 as follows.

  As shown in FIG. 6, the observer 201 observes the stereoscopic video presented on the image presentation surface 211 while gradually approaching the display 210.

  In FIG. 7, first, a program is started by the image processing apparatus 250 and a stereoscopic video presentation process is started (step S <b> 1), and then an approximate viewing distance D to the observer 201 is detected by the observer position detection unit 240. (Step S2).

  Subsequently, the image processing apparatus 250 determines whether the viewing distance D is large or small (step S3). (1) When the viewing distance D is 10 m or more, the inclination angle θ of the image presentation surface 211 is set to 90 degrees. For this purpose, a control signal is transmitted from the image presentation surface control means 251 to the image presentation surface drive means 230 to arrange the image presentation surface 211 so as to be vertical (step S4), and as an image presentation method for the image presentation surface 211. Then, a planar video presentation method for presenting a planar image (2D but generated by rendering 3DCG) is selected (step S5).

  (2) When the viewing distance D is 5 m or more and less than 10 m, the image presentation surface control unit 251 transfers to the image presentation surface driving unit 230 in order to set the inclination angle θ of the image presentation surface 211 to 90 degrees. A control signal is transmitted to arrange the image presentation surface 211 so as to be vertical (step S6), and the multi-lens lenticular method is selected as the image presentation method of the image presentation surface 211 (step S7).

  Further, (3) when the viewing distance D is 1 m or more and less than 5 m, in order to set the magnitude of the inclination angle θ of the image presentation surface 211 according to the magnitude of the viewing distance D (the smaller the viewing distance D is, the smaller the viewing distance D is). In order to increase the tilt angle θ, that is, to fall down, the control unit 251 transmits a control signal to the image display surface driving unit 230 to drive the image display surface 211 (step S8). ) The multi-lens lenticular method is selected as the image presenting method of the image presenting surface 211 (step S9).

  (4) When the viewing distance D is less than 1 m, a control signal is sent from the image presentation surface control means 251 to the image presentation surface driving means 230 in order to set the inclination angle θ of the image presentation surface 211 to 180 degrees. The image presenting surface 211 is transmitted and arranged horizontally (step S10), and the binocular lenticular method is selected as the image presenting method for the image presenting surface 211 (step S11).

  Thereafter, the computer graphics image generation means 252 sets the parameters of the virtual camera 260 (step S12), and performs rendering processing using the geometric model 203 stored in the model information storage means 254, thereby providing an image presentation surface. An image to be displayed on 211 is generated (step S13). Here, when the plane image presentation method is selected (step S5), the generated image is a planar view image, and when the multi-lens lenticular method is selected (steps S7 and S9). ) Is the number of images for the left eye and the image for the right eye corresponding to multiple eyes, and when the binocular lenticular method is selected (step S11), the image for the left eye and the image for the right eye It is an image.

  At this time, in setting the parameters of the virtual camera 260, as shown in FIG. 5, the inclination angle parameter α of the imaging surface 261 of the virtual camera 260 and the inclination angle θ of the image presentation surface 211 are made to coincide. Further, the set number of virtual cameras 260 is set in accordance with the selected image presentation method. That is, when the plane image presentation method is selected (step S5), one unit is set, and when the multi-view lenticular method is selected (steps S7 and S9), it corresponds to multi-view. The number of units (for example, 8 units in the case of an 8-eye system) is set, and when the 2-lens lenticular system is selected (step S11), 2 units are set.

  Then, the image display processing unit 253 displays the computer graphics image generated by the computer graphics image generation unit 252 on the image presentation surface 211 by the selected image presentation method.

  Then, it is determined whether or not to continue the process (step S15). If the process is continued, the process returns to step S2 again. Thereafter, the processes of steps S2 to S15 are repeated until it is determined that the process is not continued. On the other hand, if the process is not continued, the stereoscopic video presenting process is terminated (step S16).

  When the loop processing as described above is repeated, when the observer 201 gradually approaches the display 210, the following stereoscopic video is presented.

  In FIG. 6, first, (1) when the viewing distance D is 10 m or more, the image presentation surface 211 is vertical and a planar view image is presented, and (2) the viewing distance D is 5 m or more and less than 10 m. When entering the range, the image presentation surface 211 remains vertical, and the display is switched to the presentation of a stereoscopic image by the multi-lens lenticular method. Further, (3) when the viewing distance D enters the range of 1 m or more and less than 5 m, While the stereoscopic image is presented by the ocular lenticular method, the inclination angle θ of the image presentation surface 211 increases, that is, falls, and finally, (4) when the viewing distance D becomes less than 1 m, the image is presented. The tilt angle θ of the surface 211 is 180 degrees and the plane 211 is completely tilted and becomes horizontal, and the display is switched to the presentation of a stereoscopic image by the two-lens lenticular method. On the other hand, when the observer 201 gradually moves away from the display 210, a stereoscopic image opposite to the above flow is presented.

  According to such 2nd Embodiment, there exist the following effects. That is, on the image presentation surface 211, a stereoscopic video and an image generated using an image generated in a state in which the inclination angle parameter α of the imaging surface 261 of the virtual camera 260 matches or substantially matches the inclination angle θ of the image presentation surface 211, and Since a plane image is presented, correction processing for eliminating the perspective that has been performed conventionally, that is, arithmetic processing that is secondarily performed after generation of a CG image by rendering processing can be omitted, and CG by rendering processing can be omitted. When the generation of the image is finished, an image without a perspective can be obtained and displayed on the image presentation surface 211. Therefore, it is possible to obtain a natural and finely expressed stereoscopic image or an appropriate plane image, and it is not necessary to perform complicated arithmetic processing for eliminating the perspective described in Patent Documents 2 to 6 described above. Therefore, the processing burden can be reduced.

  In addition, since the image can be acquired by changing the tilt angle parameter α of the imaging surface 261 according to the environment at the time of playback (inclination angle θ of the image presentation surface 211), a natural stereoscopic image from which distortion has been removed is reproduced. And an appropriate stereoscopic image can be presented to the observer. In addition, since the tilt angle parameter α of the imaging surface 261 is changed in real time, a flexible and diverse image can be expressed.

  Further, on the image presentation surface 211, a stereoscopic video image is generated using an image generated in a state in which the inclination angle parameter α of the imaging surface 261 of the virtual camera 260 matches or substantially matches the inclination angle θ of the image presentation surface 211. Since the presentation is performed, a stereoscopic image can be presented without causing keystone distortion (see FIGS. 16 and 17) even when photographing by the crossing method is performed. 3D images can be reproduced.

  And since the image presentation method is switched according to the environment (viewing distance D) at the time of reproduction | regeneration, the presentation of the stereo image which makes a resolution and a viewing zone compatible can be performed.

  Further, the position (viewing distance D) of the observer 201 is detected, and the image presentation method of the image presentation surface 211 is automatically switched in real time, or the inclination angle θ of the image presentation surface 211 is automatically changed in real time, Accordingly, since the image acquisition process is performed by automatically changing the tilt angle parameter α of the imaging surface 261 of the virtual camera 260 in real time, the stereoscopic video presenting apparatus 200 having interactive properties (bidirectionality) is realized. For example, it is possible to improve the variety of entertainment video expressions, improve the playability, and the like.

[Deformation form]
Note that the present invention is not limited to the above-described embodiments, and modifications and the like within a range in which the object of the present invention can be achieved are included in the present invention.

  That is, in the first embodiment, the left eye image and the right eye image that are previously captured by the live-action cameras 60 and 70 and stored in the image storage unit 53 are displayed on the image presentation surface 31. However, as shown in FIGS. 1 and 4, the horizontal image presentation surface 31 is configured so that the inclination angle can be freely changed similarly to the front image presentation surface 21. , 71 may be adjusted to display the left-eye image and the right-eye image captured in real time.

  In the first embodiment, the real image is displayed on both of the image presentation surfaces 21 and 31. However, the computer graphics image can be used to display a stereoscopic image by a plurality of types of image presentation methods on a plurality of image presentation surfaces. Presentation may be realized.

  Furthermore, in the second embodiment, as shown in FIG. 6, when (2) the viewing distance D is 5 m or more and less than 10 m and (3) the viewing distance D is 1 m or more and less than 5 m, When a stereoscopic image is presented by the lenticular method, and (4) when the viewing distance D is less than 1 m, the stereoscopic image is presented by the two-lens lenticular method. Switching is not limited to this. For example, in the case of (2) and (3), a stereoscopic image is presented by a multi-lens (for example, 16-eye) lenticular method with a large number of eyes. In the case of (4), a stereoscopic image may be presented by a multi-lens type (for example, 8-eye type) lenticular method with a smaller number of eyes, or in the case of (2), 16-eye lenticular system, (3) The, 8-eye type lenticular method, in the case of (4), presenting a stereoscopic image by binocular lenticular scheme may be performed. In short, if the observer 201 approaches the display 210 and the viewing distance D decreases, the resolution is increased while the viewing area is narrowed, and the image presentation method having some intention or concept is changed. Good.

  In the second embodiment, the threshold value of the viewing distance D is set to 10 m, 5 m, and 1 m when switching the image presentation method. However, the size and number of the threshold values are not limited to this and are arbitrary. It is.

  In the first and second embodiments, stereoscopic images are presented by the image presentation surfaces 21, 31, and 211 that are the screens of the displays 20, 30, and 210, but as shown in FIG. The stereoscopic image may be presented using a printed material instead of the display. In FIG. 8, the stereoscopic video presenting apparatus 300 includes an image presenting surface 301 disposed on the front surface (front surface) and an image presenting surface 302 disposed on the horizontal plane.

  The front image presentation surface 301 is formed by a printed surface of a printed matter (a photograph, CG, or a picture) depicting a subject to be presented (for example, a cultural asset such as a Buddha image), and the first image presentation. The three-dimensional image is presented by a method, and the horizontal image presentation surface 302 is a printed matter (a photograph, CG, or picture) drawn in a state where the same presentation object is viewed from another angle. A 3D image is formed by a second image presentation method.

  Here, as the first image presentation method for the front image presentation surface 301, for example, a multi-lens lenticular method or the like can be adopted, and the second image presentation method for the horizontal image presentation surface 302. For example, an integral photography system (IP system) or the like can be employed.

  Thus, when the image presentation surfaces 301 and 302 are formed by printed matter, there is an effect that the resolution can be increased as compared with a normal display.

  Further, in the first embodiment, the two image presentation surfaces 21 and 31 were used to present a stereoscopic video by a combination of two different types of image presentation methods (see FIG. 1). As described above, a stereoscopic video may be presented by a combination of a plurality of types of image presentation methods on three or more image presentation surfaces. In FIG. 9, the stereoscopic video presenting apparatus 400 includes an image presenting surface 402 disposed on the front surface (front surface, that is, a surface facing the observer 401), and image presenting surfaces 403 disposed on the left and right side surfaces (elevated surfaces). 404 and an image presenting surface 405 arranged on the floor surface (horizontal plane).

  Among these four image presentation surfaces 402 to 405, the front image presentation surface 402 is a first image presentation method (for example, a twin-lens lenticular method), and left and right side image presentation surfaces 403, 404 and The floor image presentation surface 405 may be a second image presentation method (for example, a multi-lens lenticular method). In addition, the front image display surface 402 and the left and right side image display surfaces 403 and 404 are a first image display method (for example, a twin-lens lenticular method), and the floor image display surface 405 is a second image display surface 405. An image presentation method (for example, a multi-lens lenticular method) may be used. Further, the front image display surface 402 is a first image display method (for example, a twin-lens lenticular method), and the left and right side image display surfaces 403 and 404 are a second image display method (for example, a multi-lens display method). The floor image display surface 405 is a third image display system (for example, a multi-lens system (16-eye system, etc.) lenticular system having a larger number of eyes). It is good.

  In the second embodiment, the image presentation method is switched based on the viewing distance D detected by the observer position detection unit 240 on one image presentation surface 211 (see FIGS. 5 and 6). 10) Using the two image presentation surfaces 501 and 502 as in the stereoscopic image presentation device 500 shown in FIG. 10, the image presentation method is switched based on the viewing distance D detected by the observer position detection means 503. May be.

  In FIG. 10, (1) When the viewing distance D is 10 m or more, the image presenting surface 501 on the near side as viewed from the observer 504 is vertical, and a planar view image is presented. At this time, the image presentation surface 502 on the back side is arranged vertically and is in an OFF state. Then, (2) when the viewing distance D is in the range of 5 m or more and less than 10 m, the image presentation surface 501 on the near side remains vertical, and the display is switched to presentation of a stereoscopic image by the multi-lens lenticular method. At this time, the image presentation surface 502 on the back side is arranged vertically and remains in the OFF state.

  Further, (3) When the viewing distance D is in the range of 1 m or more and less than 5 m, the image display surface 501 on the near side is still presenting a stereoscopic image by the multi-lens lenticular method, but the inclination angle θ is It gets bigger, that is, it falls down. At this time, the image presentation surface 502 on the back side is arranged vertically and remains in the OFF state. Finally, (4) when the viewing distance D is less than 1 m, the near-side image presentation surface 501 is still presented as a stereoscopic image by the multi-lens lenticular method, but the inclination angle θ is 180 degrees. Completely falls down and becomes horizontal. At this time, the image presentation surface 502 on the back side is switched from the OFF state to the presentation of stereoscopic video by the twin-lens lenticular method.

  If the image presentation method is switched using the two image presentation surfaces 501 and 502 in this way, the image presentation method is switched as in the case of the second embodiment (see FIGS. 5 and 6). In addition to obtaining the effect, it is also possible to obtain an effect by combining a plurality of types of image presentation methods as in the case of the first embodiment (see FIG. 1).

  Further, in the first embodiment, as shown in FIG. 4, the image storage means 53 (see FIG. 1) uses the left-eye and right-eye live-action cameras 60 and 70 to store the imaging surfaces 61 and 71, respectively. In the state where the inclination angle is coincident with or substantially coincides with the inclination angle of the horizontal image presentation surface 31, that is, in a state where the imaging surfaces 61 and 71 and the horizontal image presentation surface 31 are parallel to each other, The image for the eye and the image for the right eye were stored, but these images are used with the image presentation surface 31 fixed to a horizontal plane, and therefore only when the inclination angle of the image presentation surface 31 is one ( Since the subject 2 is a fixed object, it is a static image with no movement. On the other hand, when presenting a stereoscopic image of a moving object on an image presentation surface where the inclination angle changes, an image that has been captured or generated in advance is not captured or generated in real time. When used, as in the image storage means 600 shown in FIG. 11, for each object at each time T = t (1), t (2), t (3),..., T (n),. The left-eye image L (θ, t (n)) and the right-eye image R (θ, t (n)) captured or generated by changing the inclination angle θ of the presentation surface may be stored. For example, θ = 90 degrees when reproducing the object at time T = t (1), θ = 100 degrees when reproducing the object at time T = t (2), and time T = t (3 ) When θ = 110 degrees during the reproduction of the target object thereafter, L (90 degrees, t (1)) and R (90 degrees, t (1) as shown by the thick frame in FIG. )), L (100 degrees, t (2)) and R (100 degrees, t (2)), L (110 degrees, t (3)) and R (110 degrees, t (3)), ..., L A stereoscopic video is presented using each image in the order of (110 degrees, t (n)) and R (110 degrees, t (n)).

  As described above, the stereoscopic image presenting apparatus of the present invention presents a stereoscopic image in accordance with, for example, a device that stereoscopically represents a cultural property such as a Buddha image and presents it to an observer, and the movement or operation of the observer. It is suitable for use in a recreation device having bidirectionality, a stereoscopic video system for medical education, and the like.

10, 200, 300, 400, 500 Stereoscopic image presentation device 21, 31, 211, 301, 302, 402 to 405, 501, 502, image presentation surface 40, 220 image presentation surface angle detection means 51 imaging surface control means 52, 253 Image display processing means 53, 600 Image storage means 60, 70 Real-time camera 61, 71 Imaging surface 62, 72 Imaging surface driving means 230 Image-presenting surface driving means 240, 503 Observer position detection means 251 Image-presenting surface control Means 252 Computer graphics image generation means 254 Model information storage means 260 Virtual camera 261 Imaging surface of virtual camera θ Inclination angle of image presentation surface α Inclination angle of imaging surface of real camera or inclination angle parameter of imaging surface of virtual camera

Claims (4)

With multiple image presentation surfaces that enter the observer's field of view at the same time,
At least one image presentation surface of the plurality of image presentation surface, a computer graphics image generated by performing the rendering process using the virtual camera for computer graphics image generation, does not require glasses It is configured to be able to switch between multiple types of image presentation methods,
Observer position detection means for detecting relative position information of the observer's eyes or head relative to the image presentation surface for switching the image presentation method or alternative information thereof;
The computer graphics image by switching the image presentation method according to the observer's eye or the relative position of the head relative to the image presenting surface for the image presentation method switching based on the information detected by the observer position detection means Image display processing means for performing processing to display on the image presentation surface for switching the image presentation method ,
When the position of the observer's eyes or head enters the partition area closest to the image display surface for switching the image display method, glasses are required in each image display method of the plurality of image display surfaces. A stereoscopic video presentation apparatus characterized in that a plurality of types of stereoscopic video presentation methods are included . The stereoscopic image presentation device according to claim 1 ,
The image presentation surface for switching the image presentation method presents a computer graphics image generated by performing rendering processing in real time using a virtual camera for computer graphics image generation, and the tilt angle can be changed. The structure is
Model information storage means for storing information related to a model for computer graphics;
Image presentation surface driving means for driving the image presentation surface for switching the image presentation method to change the inclination angle of the image presentation surface for switching the image presentation method;
The image presentation based on the information detected by the observer position detection means when the position of the observer's eyes or head enters the second closest area to the image presentation surface for switching the image presentation method Generating a control signal for changing an inclination angle of the image presenting surface for switching the image presenting method according to a relative position of the observer's eyes or head with respect to the image presenting surface for switching the method; Image display surface control means for transmitting to the drive means;
Image presentation surface angle detection means for detecting an inclination angle of the image presentation surface for switching the image presentation method ;
When the position of the observer's eye or head enters the second closest area to the image presenting surface for switching the image presenting method, the model information storage is performed based on a detection signal from the image presenting surface angle detecting means. The computer performs rendering processing by using the information on the model stored in the means to make the tilt angle parameter of the imaging surface of the virtual camera match or substantially match the tilt angle of the image display surface for switching the image display method A computer graphics image generating means for generating a graphics image;
An image display processing unit for performing processing for displaying the computer graphics image generated by the computer graphics image generating unit on the image display surface for switching the image presentation method . The stereoscopic image presentation device according to claim 1 ,
The image presentation surface for switching the image presentation method presents a computer graphics image generated by performing rendering processing in real time using a virtual camera for computer graphics image generation, and the tilt angle can be changed. The structure is
Model information storage means for storing information related to a model for computer graphics;
And an image presenting surface driving means for changing the inclination angle of the driving image presentation surface for the image presentation method switching image presentation surface for the image presentation method switching,
The image presentation based on the information detected by the observer position detection means when the position of the observer's eyes or head enters the second closest area to the image presentation surface for switching the image presentation method wherein the image presentation surface and generates a control signal for changing the inclination angle of the image presentation surface for the image presentation method switching in response to the observer's eye or the relative position of the head relative to the image presenting surface for the method switching Image display surface control means for transmitting to the drive means;
The model information based on the information detected by the observer position detecting means when the position of the observer's eyes or head enters the second closest area to the image presentation surface for switching the image presentation method. Using the information related to the model stored in the storage means, a computer graphics image is generated by performing rendering processing with the tilt angle parameter of the imaging surface of the virtual camera matching or substantially matching the tilt angle parameter of the image presentation surface Computer graphics image generating means for performing,
An image display processing unit for performing processing for displaying the computer graphics image generated by the computer graphics image generating unit on the image display surface for switching the image presentation method . The stereoscopic video presenting device according to claim 2 or 3,
When the position of the observer's eyes or head is within the partition area farthest from the image presentation surface for switching the image presentation method, the image presentation surface for switching the image presentation method is arranged in the vertical direction, In addition, the computer graphics image in plan view generated by performing the rendering process is presented in a planar video presentation method,
When the position of the observer's eyes or head enters the third closest area to the image presentation surface for switching the image presentation method, the image presentation surface for switching the image presentation method is arranged in the vertical direction. And presenting stereoscopic images with multi-lens lenticular method,
When the position of the observer's eye or head enters the second closest area to the image presentation surface for switching the image presentation method, the image presentation surface for switching the image presentation method is the eye of the observer. Or, as the position of the head approaches, it falls to the back as seen from the observer, and presents a stereoscopic image with a multi-lens lenticular method,
When the position of the observer's eyes or head enters the partition area closest to the image presentation surface for switching the image presentation method, the image presentation surface for switching the image presentation method is arranged in a horizontal direction, and In addition to presenting a stereoscopic image by a multi-lens lenticular method, another image presenting surface of the plurality of image presenting surfaces is arranged in a vertical direction and presenting a stereoscopic image by a twin-lens lenticular method A stereoscopic image presentation device characterized by comprising:

Images