JP4523538B2 - 3D image display device - Google Patents

Description

  The present invention relates to a stereoscopic video display system that captures and displays a stereoscopic video, and more particularly, to a camera arrangement method in a camera array.

  An autostereoscopic display device is known as a display device that allows an observer to observe a stereoscopic image without using a special device such as glasses. This autostereoscopic display device displays stereoscopic images by various methods such as a lenticular method and a holography method. The fundamental principle of most of these methods realizes autostereoscopic vision by controlling the light ray information incident on the eyes of the observer and entering different light ray information on the left and right eyes.

  One such autostereoscopic display method is an integral photography method in which a light spot is generated at an arbitrary place by a plurality of lenses (see Non-Patent Document 1).

  An example of this integral photography system is shown in FIG. This autostereoscopic display device using the integral photography system includes a display 1 and a lens array 3 including a large number of lenses 2. Below each lens 2 are a plurality of pixels, one of which displays a light spot 4.

  FIG. 15 is a cross-sectional view taken along the line AA in FIG. When viewed from the viewpoint A, the pixel A is seen through each lens, and when viewed from the viewpoint B, the pixel B is seen through each lens. Accordingly, when the observer places the right eye at the viewpoint A and the left eye at the viewpoint B, different pixels can be seen by the left and right eyes, so that a stereoscopic image can be seen.

  In addition, a camera array is used to capture a video for displaying such a stereoscopic video. The camera array is a device in which a plurality of video photographing devices are regularly arranged. This camera array can acquire a larger amount of information (number of pixels) to increase the resolution of the captured image, and can capture images from more viewpoints.

As a configuration of the camera array, a method of arranging a large number of cameras in parallel at equal intervals is known (see Non-Patent Document 2). There is also known a rotating camera system in which a camera is installed on a circumference centered on an object and the circumference is horizontally rotated once to photograph an object (see Non-Patent Document 3).
Japanese Patent Laid-Open No. 7-7747 MGLippmann, “Epreuves reversibles donnant la sensation du relief” (France), Vol. 7, J. de Phys, 1908, p. 821-825 Furukawa, Hanuma, Takagi, “Acquisition of three-dimensional moving image by parallel camera array used for directional three-dimensional display”, three-dimensional image conference 2005 Takagi, Daikoku, "Texture Display with High-Density Directional Display 3D Display", 3D Image Conference 2005

  In the above-described autostereoscopic display using a camera array, the camera is usually installed so that the camera and the viewpoint correspond one-to-one.

  On the other hand, an integral photography autostereoscopic display has the highest resolution on the display surface and a low resolution of a stereoscopic image away from the display surface. Therefore, for example, in the camera array in which the optical axes are arranged in parallel on the plane on the plane, sampling is performed very densely on the display surface, and there is a problem that the resolution is lowered. In addition, in a camera array arranged so that the optical axis intersects the grating on the plane, there is a large difference in the distance to the subject at the center and end of the plane, and there is a problem that the influence of field vibration is greatly affected is there.

  In addition, the camera array system in which cameras are arranged and rotated around the circumference can only capture parallax images in the horizontal direction, and thus cannot be applied to autostereoscopic displays using the integral photography method.

  The present invention has been made in view of the above-described problems. An integral photography system is formed by arranging the positions of camera arrays on a spherical surface and directing the optical axis direction of the camera toward the center of the subject. An object of the present invention is to improve the resolution in the autostereoscopic display.

According to an embodiment of the present invention, a camera array including a plurality of cameras including an imaging lens and an imaging unit, a substantially spherical base for fixing the camera, and video data captured by the camera are corrected. A video processing apparatus, a video synthesis apparatus that synthesizes video data for each camera corrected by the video processing apparatus, and a first lens array including a plurality of first lenses, and the video synthesized by the video synthesis apparatus A stereoscopic video display system for displaying data as a stereoscopic video, wherein the camera has a latitude line of latitude with respect to a vertical axis of the spherical surface and a latitude line of latitude with respect to a horizontal axis of the spherical surface The object is located at the intersection of the spherical surface at a predetermined interval from the center of the spherical surface and is photographed at a substantial center of the spherical surface.

  According to the present invention, since the optical axes of the individual cameras in the camera array are installed so as to intersect at one point, it is possible to increase the resolution of the image on the surface where the optical axes intersect. Further, by arranging the cameras on a spherical surface, the focal lengths of the respective cameras can be matched at the intersection of the optical axes, and the viewing areas on the plane including the intersection of the optical axes can also be matched. As a result, it is possible to obtain an image with the highest resolution on the display surface, which is a feature of the integral photography system.

Embodiments of the present invention will be described below with reference to the drawings.
<First Embodiment>
FIG. 1 is a configuration diagram of a stereoscopic video shooting and display system according to the first embodiment of the present invention.

  This stereoscopic video shooting and display system includes a camera array 70, a video processing device 40, a video synthesis device 50, and a stereoscopic video display device 60.

  The camera array 70 acquires video data by photographing an object (subject) placed at the light spot 11. The camera array 70 includes a plurality of cameras 30 and a gantry 20. The camera 30 includes a lens 31 and an imaging unit 32. Each camera 30 is fixed at a predetermined position on the gantry 20, and the lens 31 is installed such that its optical axis is directed toward the center 11 of the gantry. Therefore, all the cameras 30 are installed so that the optical axes of the lenses 31 intersect at one point of the center 11.

  The video processing device 40 is connected to each camera 30, acquires video data captured by the camera 30, performs necessary processing on the acquired video data, and sends this to the video composition device 50.

  The video composition device 50 collects the video data sent from the respective video processing devices 40, synthesizes them, performs necessary processing for stereoscopic video display, and sends them to the stereoscopic video display device 60 as a predetermined video signal. send.

  The stereoscopic image display device 60 displays an image, and displays an image that can be observed as a stereoscopic image for an observer. The stereoscopic image display device 60 includes a display 1 and a lens array 3 including a large number of lenses 2. The image displayed on the display 1 is refracted by each lens 2 of the lens array 3 to connect the light spots 12. Accordingly, when the observer observes the stereoscopic video display device 60 at the light spot 12, the stereoscopic video can be observed due to the difference between the images connected to the right eye and the left eye.

  FIG. 2 is an explanatory diagram of the configuration of the camera array 70 described above.

  As described above, in the camera array 70, a plurality of cameras 30 are installed on the gantry 20, and the optical axis of each lens 31 is directed toward the center 11.

  The camera 30 is installed at a predetermined interval at a location where the latitude 21 and the longitude 22 from the center 11 that is the center point of the gantry 20 intersect in the substantially spherical gantry 20.

  In the example of FIG. 2, the three cameras 30 are arranged at 10 degrees, 0 degrees, and −10 degrees of longitude about the center 11 and about 10 degrees, 0 degrees, and −10 degrees of latitude. That is, nine cameras 30 are installed on the spherical surface of the gantry 20. Video data for stereoscopic video display is shot by shooting these nine cameras 30 at the center 11.

  It should be noted that the cameras 30 do not necessarily need to be equally spaced with respect to all latitudes 21 and longitudes 22; they may be evenly spaced at different intervals at different latitudes, or at different intervals at different longitudes. It may be arranged at intervals.

  For example, at 0 degrees latitude, cameras are installed at longitudes of −10 degrees, 0 degrees, and 10 degrees, and at latitudes of 10 degrees and longitudes of −10 degrees, the cameras are at longitudes of −15 degrees, −5 degrees, 5 degrees, and 15 degrees. Is installed. Therefore, the cameras 30 may be installed alternately. Further, the combination of longitude and latitude may be determined by pseudo random numbers, or all the cameras 30 may be installed at random. It suffices that all the cameras 30 are on the spherical surface of the gantry 20 and the optical axes intersect at one point.

  FIG. 3 is an explanatory diagram of another configuration of the camera array 70.

  In the example of FIG. 3, unlike the configuration of FIG. 2 described above, the camera 30 is installed at a location where a latitude 21 corresponding to the vertical axis and a latitude 22 corresponding to the horizontal axis intersect.

  In the configuration of FIG. 2 described above, the horizontal interval between the cameras 30 becomes narrower as the position of the camera 30 approaches the upper end (north pole) or the lower end (south pole). On the other hand, in the example of FIG. 3, the horizontal interval does not change greatly even near the upper end or the lower end. Therefore, compared with the camera array 70 of FIG. 2, the stereoscopic video displayed by the video data captured by the camera array 70 of FIG. 3 is a video with less horizontal distortion.

  FIG. 4 is an explanatory diagram of the optical axis of the lens 31 of the camera array 70.

  As described above, the camera 30 is installed on a spherical surface in the gantry 20, and the optical axes of the lenses 31 of all the cameras 30 intersect at one point of the center 11.

  The range that can be photographed depending on the angle of view of these lenses 31 is set to a range 33 with the center 11 as the center. Accordingly, the object placed in the range 33 is photographed by all the cameras 30 without leaving a surplus. In particular, since the camera 30 is installed on the gantry 20 which is a spherical surface with the center 11 as the center, the focal length of the lens 31 coincides with the center 11 and the range photographed by all the cameras 30 is a range 33. Match in Therefore, the captured video data has the highest resolution. Accordingly, the stereoscopic video displayed by the stereoscopic video display device 60 is a video with the highest resolution on the display surface of the stereoscopic video display device 60. Furthermore, the observer has little line-of-sight error, and the observer can observe a cleaner autostereoscopic image.

  5A to 5D are explanatory diagrams of logical configuration examples of the camera 30, the video processing device 40, the video synthesis device 50, and the stereoscopic video display device 60.

  FIG. 5A shows an example in which the video processing device 40 is connected to each camera 30 as described above with reference to FIG. The video data output by each video processing device 40 is synthesized by the video synthesis processing device 50, reconstructed by the stereoscopic video display device 60, and displayed as a stereoscopic video.

  FIG. 5B shows another configuration example. In the example of FIG. 5B, either the video processing device 40 or the stereoscopic video display device 60 executes processing that is executed in the video composition device 50. Alternatively, both the video processing device 40 and the stereoscopic video display device 60 execute processing executed in the video composition device 50.

  When the processing capability of the video processing device 40 or the stereoscopic video display device 60 is sufficiently high, it is possible to cause one or both of the processing to be executed by the video synthesis device 50 to be executed.

  FIG. 5C shows still another configuration example. In the example of FIG. 5C, one video processing device 40 processes image data acquired by a plurality of cameras 30 and outputs the data to the video composition processing device 50.

  When the processing capability of the video processing device 40 is sufficiently high, the image data acquired by the camera 30 can be processed by the video processing devices 40 that are fewer than the number of cameras 30.

  In the example of FIG. 5C as well, as described above with reference to FIG. 5B, the processing of the video composition processing device 50 may be executed by one or both of the video processing device 40 and the stereoscopic video display device 60.

  FIG. 5D shows still another configuration example. In the example of FIG. 5D, all the processes executed by the video processing device 40 and the video composition device 50 described above are executed by the stereoscopic video display device 60. That is, when the processing capability of the stereoscopic image display device 60 is sufficiently high, it is possible to acquire video data captured by the camera 30 and execute all subsequent processing in the stereoscopic image display device 60.

  Next, the processing of the stereoscopic video shooting and display system configured as described above will be described.

  FIG. 6 is an explanatory diagram of processing executed by the video processing device 40.

  Video data photographed by the camera 30 is sent to the video processing device 40. This video data is acquired by the video acquisition unit 41. The geometric correction unit 42 performs geometric correction on the acquired image data. Further, the color correction unit 43 performs color correction on the acquired image data. Then, the video data subjected to the geometric correction and the color correction is sent to the video composition device 60.

  Geometric correction and color correction are generally called camera calibration, and appropriate correction is performed according to the characteristics of the image capturing unit such as the CCD of the camera 30 and the characteristics of the lens 31. The Various methods are known for this camera calibration. Note that the camera 30 itself may execute a camera calibration function. Further, when the characteristics of the CCD and the lens 31 of the camera 30 are sufficiently good or when it is necessary to improve the effective performance, the camera calibration need not be executed.

  FIG. 7 is an explanatory diagram of processing executed by the video composition device 50.

  All video data shot by each camera 30 and processed by the video processing device 40 is sent to the video composition device 50. These video data are input to the video composition unit 51.

  The video composition unit 51 adds unique light beam information corresponding to each pixel of the video data to the video data. Then, the video data to which the light ray information is added is converted into synthesized data. As a result, stereoscopic video data that can be displayed as a stereoscopic video by the stereoscopic video display device 60 is generated. In addition, by adding light ray information to video data, not only integral photography autostereoscopic displays, but also autostereoscopic displays using other methods, such as binocular and multi-view types. 3D video can be displayed.

  Next, the encoding unit 52 performs encoding and encryption as necessary on the stereoscopic video data to which the light ray information is added. For example, when the video composition device 50 and the stereoscopic video display device 60 are connected by a network line that is slower than the internal bus, the stereoscopic video data is converted into data suitable for the bandwidth of the network line. And need to send. In addition, when a public line such as the Internet is used, processing for concealing stereoscopic video data may be necessary.

  Therefore, the encoding unit 52 executes an encoding process for reducing the amount of information of the stereoscopic video data to be transmitted and a process such as encryption. Note that an existing method (for example, MPEG method or RSA method) is used for data encoding and encryption. In addition, since various methods are known for these encoding methods and encryption methods, any method may be used.

  Note that the encoding unit 52 is necessary when the video composition device 50 and the stereoscopic video display device 60 are connected by a high-speed internal bus, or when the stereoscopic video display processing unit 60 executes the processing of the video composition device 50. Absent.

  FIG. 8 is an explanatory diagram of processing executed by the stereoscopic video display device 60.

  The stereoscopic video data generated by the video composition device 50 is sent to the stereoscopic video display device 60. In the stereoscopic video display device 60, first, the decoding unit 61 executes a process of restoring the data encoded or encrypted by the encoding unit 52 of the video composition device 50 to the original video data. Note that. When the encoding unit 52 does not execute the encoding or encryption process, the decoding unit 61 does not execute the process in the same manner.

  The stereoscopic video data restored by the decoding unit 61 is necessary for the stereoscopic video generation conversion unit 62 to display the stereoscopic video by the stereoscopic video display unit 64 based on the light ray information and the information of the stereoscopic video display unit 64. Convert to data.

  Next, the stereoscopic video display control unit 63 controls the operation of the stereoscopic video display unit 64 to display the data generated by the stereoscopic video generation unit 64 on the stereoscopic video display unit 64 as a stereoscopic video.

  More specifically, the stereoscopic video generation conversion unit 62 is a general-purpose computer such as a personal computer. The stereoscopic video display control unit 63 is a controller, a driver, or the like for displaying liquid crystal. The stereoscopic video display unit 64 includes the display 1 and the lens array 3 described above. The display 1 uses a liquid crystal panel.

  Note that various combinations of the stereoscopic video display unit 64 are possible other than this. For example, a combination of the lens array 3 and a flat panel display may be used. As the flat panel display, a liquid crystal display, a plasma display, an organic EL display, a field emission display, electronic paper, or the like can be used. Further, the stereoscopic image display unit 64 is not necessarily a flat flat panel display, and a combination of a cathode ray tube or several liquid crystals may be used.

  FIG. 9 is an explanatory diagram of light ray information.

  The light ray information is information set for each pixel of the image taken by the camera 30 by the video composition unit 51, and is determined by the position and orientation of the camera 30 and the position of the pixel in the video data. By adding this light ray information to the stereoscopic video data, the stereoscopic video display unit 64 can display the stereoscopic video.

  Ray information is represented as vector information. In general, any vector can be determined by two points and two angles.

  As shown in FIG. 9, in the three-dimensional coordinate x-axis y-axis and z-axis, the angle formed by the vector and the z-axis is θ, and this vector is projected onto the xy plane by the vector and the y-axis. Let the angle made be φ.

  As described above, the ray information is information of four-dimensional parameters having the position (x, y) on the xy plane, the angle θ, and the angle φ.

  FIG. 10 is a flowchart of the processing of the video composition unit of the video composition device 50.

  Here, a case where four video data are input from four cameras 30 will be described.

  First, the video composition unit 51 assigns a video data number that is a unique identifier to the received video data. Specifically, a value of 0 to 3 is assigned to each of the four video data. The video data number may be determined for each camera 30 in advance.

  Then, the video composition unit 51 sets 0, which is an initial value, to the video data number n for processing the video data, and determines the video data to be processed first (step S100).

  Next, since each received video data is a two-dimensional video, in order to process each pixel in this video data, the video composition unit 51 has an initial value y indicating the ordinate in the video data. 0 is set (step S110). Subsequently, 0 which is an initial value is set to x indicating the abscissa in the video data (step S120).

  Note that the setting method of the two-dimensional coordinates in the video data may be 1 as an initial value instead of 0. Further, as long as the vertical and horizontal positions of each pixel of the video data are orthogonal, the vertical axis and the horizontal axis may be set in any manner.

  Next, the video composition unit 51 determines the position and orientation of the camera 30 and the position of the pixel in the video data for the pixel (x, y) of the video data of the video data number n. Light ray information having dimension parameters (x, y, θ, φ) is calculated (step S130). More specifically, since the vector with the object is determined from the position of the camera 30 that captured the video data and the position of the corresponding pixel in the video data, the ray information is determined based on this vector.

  Then, the video composition unit 51 generates stereoscopic video data in which the calculated light ray information is associated with the pixel data in the video data, and stores the generated stereoscopic video data in a buffer in the video synthesis unit 51 (Step S1). S140). Note that for stereoscopic video, video data and corresponding ray information may be set as individual data, and these sets may be stored as stereoscopic video data. In addition, other parameters and corresponding pixel data may be sequentially stored as one data in accordance with an arbitrary parameter of light ray information (for example, x-axis information of light ray information).

  Next, the video composition unit 51 adds 1 to the value of x and prepares for the processing of the next pixel (step S150). Then, it is determined whether or not the value of x is equal to or less than the number of horizontal pixels of the video data (step S60). If the value of x is equal to or less than the number of horizontal pixels of the video data, the process returns to step S130 and the corresponding pixel processing is executed. If the value of x exceeds the number of horizontal pixels of the video data, the process proceeds to step S170.

  In step S170, the video composition unit 51 adds 1 to the value of y and prepares for the processing of the next pixel (step S170). Then, it is determined whether or not the value of y is equal to or less than the number of vertical pixels of the video data (step S180). If the value of y is equal to or less than the number of pixels of the vertical width of the video data, the process returns to step S120 and the corresponding pixel processing is executed. If the value of y exceeds the horizontal width of the video data, the processing for all the pixels of the video data has been completed, and the process proceeds to step S190.

  In step S190, the video composition unit 51 prepares for the processing of the next video data by adding 1 to the video data number n. Then, it is determined whether or not the video data number n is equal to or less than the number of video data (here, 3) (step S200). If the video data number n is less than or equal to the number of video data, the process returns to step S110 to execute the corresponding video data processing. When the video data number n exceeds the number of video data, the stereoscopic video data generated by the above processing is output to the encoding unit 52, and the processing is terminated.

  Through the processing as described above, the video composition unit 51 calculates light ray information corresponding to each pixel of each video data, and generates stereoscopic video data to which the light ray information is added.

  FIG. 11 is a flowchart of the process of the stereoscopic video generation / conversion unit 62.

  The stereoscopic video generation conversion unit 62 receives the stereoscopic video data generated by the video composition device 50. In addition, the stereoscopic video generation / conversion unit 62 holds a stereoscopic video display unit profile that is information on the characteristics of the display and lens array of the stereoscopic video display unit 64 in advance. The stereoscopic video generation / conversion unit 62 generates data for displaying a stereoscopic video based on the stereoscopic video display unit profile and the input stereoscopic video data.

Since the stereoscopic video display unit 64 often uses a two-dimensional video display device such as a liquid crystal panel, a process for displaying a stereoscopic video on the two-dimensional video display device will be described here. If the stereoscopic video display unit 64 is a device that accepts 3D video data, it is only necessary to generate data having parameters in the z direction. An initial value of 0 is set in y indicating “S” (step S300). Subsequently, 0 which is an initial value is set to x indicating the abscissa of the stereoscopic video display unit 64 (step S310).

  The setting method of the two-dimensional coordinates of the stereoscopic video display unit 64 may be set in any way according to the coordinates corresponding to each pixel of the stereoscopic video display unit 64, and the initial value may be 1 instead of 0.

  Next, the stereoscopic video generation conversion unit 62 refers to the stereoscopic video display unit profile and refers to the four-dimensional parameters (x, y, θ) for the stereoscopic video displayed by the pixels corresponding to the x and y coordinates. , Φ) is calculated (step S320). More specifically, since the vector with the light spot 12 is determined from the position of the pixel on the video display unit 64, the light ray information is determined based on this vector.

  Then, based on the calculated ray information, the stereoscopic image generation / conversion unit 62 selects a pixel of the stereoscopic image data having a parameter of ray information closest to the ray information (step S330).

  This pixel selection may be performed by weighting each parameter and selecting one pixel by a method such as linear interpolation, or by selecting several points of approximate ray information, and further by linear interpolation or the like. The corresponding pixel may be obtained by calculation using a method. Further, instead of linear interpolation, a conversion table may be created in advance and used.

  Next, the stereoscopic video generation conversion unit 62 adds 1 to the value of x and prepares for the processing of the next pixel (step S340). Then, it is determined whether or not the value of x is equal to or smaller than the horizontal width of the stereoscopic video display unit 64 (step S350). If the value of x is equal to or less than the horizontal width of the stereoscopic video display unit 64, the process returns to step S320 and the corresponding pixel process is executed. When the value of x exceeds the horizontal width of the stereoscopic video display unit 64, the process proceeds to step S360.

  In step S360, the stereoscopic video generation conversion unit 62 adds 1 to the value of y and prepares for the processing of the next pixel. Then, it is determined whether or not the value of y is equal to or less than the vertical width of the stereoscopic video display unit 64 (step S370). If the value of y is less than or equal to the vertical width of the stereoscopic video display unit 64, the process returns to step S310 and the corresponding pixel processing is executed. When the value of y exceeds the vertical width of the stereoscopic video display unit 64, the data of the selected pixel is transmitted to the stereoscopic video display unit 64 via the stereoscopic video display control unit 63 to display the stereoscopic video.

  Through the processing as described above, the stereoscopic video display unit 64 can display a stereoscopic video based on the stereoscopic video data.

  As described above, in the first embodiment of the present invention, the optical axes of the lenses 31 of the individual cameras 30 in the camera array 70 are installed so as to intersect at a single point at the center 11, so the surfaces where the optical axes intersect. Video resolution can be increased. Further, by arranging the cameras on the spherical base 20, the focal lengths of the respective cameras can be matched at the center 11 and the range including the center 11 can be matched. As a result, it is possible to display a stereoscopic image having the highest resolution on the display surface, which is a feature of the integral photography system.

Note that the video processing device 40, the video composition device 50, and the stereoscopic video display device 60 are functionally different, and are illustrated as separate, but all can be executed by one personal computer. In this case, each function may be structurally divided by software, or all functions may be implemented collectively by one software. In addition, although the video composition device 50 and the stereoscopic video display device 60 are normally connected via a network via a cable, all video data captured by the camera array 70 may be sent directly to the stereoscopic video display device 60.
<Second Embodiment>
Next, a second embodiment will be described.

  FIG. 12 is a configuration diagram of a stereoscopic video shooting and display system according to the second embodiment of the present invention. In addition, the same code | symbol is attached | subjected to the structure same as 1st Embodiment, and the description is abbreviate | omitted.

  The second embodiment is substantially the same as the first embodiment described above, but the arrangement method of the object (subject) at the center 11 is different. Specifically, a lens array 311 is provided at a location corresponding to the range 33 (FIG. 4). An object to be photographed by the camera 30 is placed on the back surface of the lens array 311. The camera 30 captures an image of the object refracted by the lens array 311.

  A refractive image of the object is displayed on the lens array 311 for each lens. Therefore, the camera 30 can take images of the same number of objects as the number of lenses in the lens array 311.

  In order to display a stereoscopic video with higher resolution, it is necessary to increase the amount of information, that is, the number of viewpoints in the stereoscopic video by increasing the number of cameras 30. However, in the method of installing the plurality of cameras 30 on the gantry 20 as described above, the number of viewpoints cannot be increased because of the physical limitations of the camera 30.

  Therefore, in the present embodiment, a method of increasing the number of viewpoints by increasing the number of objects photographed by the camera 30 instead of increasing the number of cameras 30 is adopted. More specifically, the camera array 70 can acquire images corresponding to [the number of cameras 30 × the number of lenses of the lens array 311]. Therefore, the number of viewpoints can be increased by the number of images. As a result, the stereoscopic video display device 60 can display a fine stereoscopic video with higher resolution.

Note that the lens array 311 does not have to have the same characteristics as the lens array 3 provided in the stereoscopic video display device 60.
<Third Embodiment>
Next, a third embodiment will be described.

  FIG. 13 is a configuration diagram of a stereoscopic video shooting and display system according to the third embodiment of the present invention. In addition, the same code | symbol is attached | subjected to the structure same as 1st Embodiment, and the description is abbreviate | omitted.

  The third embodiment is substantially the same as the first embodiment described above, but the configuration of the lens 31 of the camera 30 is different. Specifically, a lens array 312 is provided between the lens 31 and the imaging unit of the camera 30. Thereby, substantially the same effect as that of the second embodiment described above can be obtained.

  In other words, in the camera 30, a refraction image of the object is displayed for each lens by the lens array 312. Accordingly, the camera 30 can take images of the same number of objects as the number of lenses in the lens array 312. Thus, as in the second embodiment, the camera array 70 can acquire [number of cameras 30 × number of lenses of the lens array 312] images. Therefore, the number of viewpoints can be increased by the number of videos, and the stereoscopic video display device 60 can display a fine stereoscopic video with higher resolution.

  The lens array 312 does not need to have the same characteristics as the lens array 3 provided in the stereoscopic video display device 60.

  The present invention can be applied to an amusement device such as a videophone and a game machine, a stereoscopic image display device for CAD and various contents production.

1 is a configuration diagram of a stereoscopic video shooting and display system according to a first embodiment of the present invention. It is explanatory drawing of a structure of the camera array mentioned above of the 1st Embodiment of this invention. It is explanatory drawing of another structure of the camera array of the 1st Embodiment of this invention. It is explanatory drawing of the optical axis of the camera array of the 1st Embodiment of this invention. It is explanatory drawing of the logical structural example of the camera of 1st Embodiment of this invention, a video processing apparatus, a video synthesizing | combining apparatus, and a three-dimensional video display apparatus. It is explanatory drawing of another logical structural example of the camera of 1st Embodiment of this invention, a video processing apparatus, a video synthesizing | combining apparatus, and a three-dimensional video display apparatus. It is explanatory drawing of another logical structural example of the camera of 1st Embodiment of this invention, a video processing apparatus, a video synthesizing | combining apparatus, and a three-dimensional video display apparatus. It is explanatory drawing of another logical structural example of the camera of 1st Embodiment of this invention, a video processing apparatus, a video synthesizing | combining apparatus, and a three-dimensional video display apparatus. It is explanatory drawing of the process performed by the video processing apparatus of the 1st Embodiment of this invention. It is explanatory drawing of the process performed by the video composition apparatus of the 1st Embodiment of this invention. It is explanatory drawing of the process performed by the stereoscopic video display apparatus of the 1st Embodiment of this invention. It is explanatory drawing of the light ray information of the 1st Embodiment of this invention. It is a flowchart of a process of the video composition part of the video composition device of a 1st embodiment of the present invention. It is a flowchart of the process of the stereo image production | generation conversion part of the 1st Embodiment of this invention. It is a block diagram of the three-dimensional-video imaging | photography display system of the 2nd Embodiment of this invention. It is a block diagram of the three-dimensional image | video imaging | photography display system of the 3rd Embodiment of this invention. It is explanatory drawing of the conventional integral photography system. It is AA sectional drawing of FIG.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Display 2 Lens 3 Lens array 11 Center of mount 12 Light spot 20 Mount 30 Camera 31 Lens 32 Image pick-up part 40 Image processing apparatus 50 Image composition apparatus 60 Three-dimensional image display apparatus 70 Camera array

Claims (10)

A camera array including a plurality of cameras including an imaging lens and an imaging unit; and a substantially spherical base that fixes the camera;
A video processing device for correcting video data captured by the camera;
A video synthesizing device that synthesizes video data for each of the cameras corrected by the video processing device;
A stereoscopic video display system comprising: a first lens array including a plurality of first lenses; and a stereoscopic video display device that displays video data synthesized by the video synthesis device as a stereoscopic video,
The camera is disposed on the gantry at a predetermined interval from the center of the spherical surface at an intersection of a predetermined latitude latitude line with respect to the vertical axis of the spherical surface and a predetermined latitude latitude line with respect to the horizontal axis of the spherical surface. A three-dimensional video display system characterized by photographing a subject at substantially the center. 2. The stereoscopic image display system according to claim 1, wherein the imaging lens has an optical axis directed toward a center of the spherical surface and is focused on a substantial center of the spherical surface. The stereoscopic image display system according to claim 1, wherein a subject photographed by the camera is disposed at a center of the spherical surface. The gantry includes a second lens array including a plurality of second lenses at the center of the spherical surface, and the camera photographs a subject refracted by the second lens array. 3D image display system described in 1. The camera includes a third lens array including a plurality of third lenses between the imaging lens and the imaging unit, and is focused by the imaging lens and refracted by the third lens array. The three-dimensional image display system according to claim 1, wherein the three-dimensional image display system is photographed. A plurality of cameras provided with an imaging lens and an imaging unit; and a substantially spherical frame for fixing the camera;
A video processing apparatus that corrects video data captured by the camera, a video synthesis apparatus that combines video data for each camera corrected by the video processing apparatus, and a first lens that includes a plurality of first lenses A camera array connected to a stereoscopic video display system comprising an array, and a stereoscopic video display device that displays video data synthesized by the video synthesis device as a stereoscopic video,
The camera is disposed on the pedestal at a predetermined distance from the center of the spherical surface at an intersection of a latitude line with a predetermined latitude with respect to the vertical axis of the spherical surface and a latitude line with a predetermined latitude with respect to the horizontal axis of the spherical surface. A camera array characterized by photographing a subject located substantially at the center. The camera array according to claim 6, wherein the imaging lens has an optical axis directed toward a center of the spherical surface and is focused on a substantial center of the spherical surface. The camera array according to claim 6, wherein a subject photographed by the camera is arranged at a center of the spherical surface. 7. The gantry includes a second lens array including a plurality of second lenses at the center of the spherical surface, and the camera photographs a subject refracted by the second lens array. The camera array described in 1. The camera includes a third lens array including a plurality of third lenses between the imaging lens and the imaging unit, and is focused by the imaging lens and refracted by the third lens array. The camera array according to claim 6, wherein the camera array is photographed.