JP2000201359A - Three-dimensional image photographing device and device and method for three-dimensional image display - Google Patents

Abstract

PROBLEM TO BE SOLVED: To actualize a stereoscopic moving picture display in the true sense of the word with simple constitution. SOLUTION: Light from a body 10 is made incident on a CCD 15 through a deflecting plate 11, a condenser lens 12, a pinhole member 13, and a condenser lens 14. When a three-dimensional image is photographed, different photography directions by pixels are set and changed in order by the detecting plate 11. In all photography directions which can be set, two-dimensional image information of low resolution is obtained and while pixels to which the respective photography directions are assigned are changed, a process for obtaining twodimensional image information of low resolution is repeated to obtain two-dimensional image information of high resolution in all the photography directions which can be set. When a three-dimensional image is displayed, the two-dimensional image information is projected by the pixels in directions corresponding to the photography directions at the time of the photography to generate the three-dimensional image.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001] The present invention relates to a three-dimensional image capturing apparatus and method for obtaining image information necessary for displaying a three-dimensional image of an object in space, and a plurality of two-dimensional image information of the same object having different observation directions. The present invention relates to a three-dimensional image display apparatus and method for displaying a three-dimensional image of an object in space by projecting the object in a direction corresponding to the observation direction.

[0002]

2. Description of the Related Art In recent years, with the development of optical technology, various proposals have been made for a technology for displaying a stereoscopic image. One of them is that, for example, an image obtained by superimposing an image for the left eye and an image for the right eye, such as the IMAX Theater (trade name), can be rendered three-dimensional by wearing special glasses. There is a binocular stereoscopic viewer device. In this device, stereoscopic expression is enabled by a stereogram using parallax between left and right eyes.

[0003] In addition, three-dimensional display is also performed by holographic technology using coherent light (coherent light) such as a laser. In this technology, holography is previously formed on a dry plate or the like using object light and reference light, and reproduction light is obtained by irradiating the holography with the original reference light to perform three-dimensional image display. Things.

As a stereoscopic image display technique that does not require special glasses, a so-called IP (Integral Photograph) is used.
y) method and parallax method.

The IP method was proposed by Lippman,
First, a photographic dry plate is placed on the focal plane of a lens plate called a fly-eye lens composed of a number of small convex lens groups.
After exposing object light through this lens plate to record a large number of small object images on the photographic plate, develop this photographic plate, place it in exactly the same position as before, and irradiate light from the back. It is like that.

[0006] The parallax method is a method of observing a strip-shaped image separately through a vertical lattice-shaped aperture disposed in front of a strip-shaped image corresponding to each of the left and right eyes.

[0007]

Among the above, in the above-mentioned three-dimensional viewer, it is inconvenient for a viewer because special glasses must be worn, and it is easy to get tired because of an unnatural image. Not suitable for watching time.

In addition, the above-mentioned three-dimensional display technology based on the holography technology requires coherent light such as a laser.
Further, the image quality is deteriorated due to the speckle interference pattern peculiar to the laser. Further, the holography technique is for performing three-dimensional display using holography created on a photographic plate in advance, and thus is suitable for still images but not for three-dimensional display of moving images. This is the same in the above-described IP method, and is not suitable for a moving image since a step of recording a large number of small object images on a photographic plate in advance is required.

In addition, the parallax method that does not require special glasses performs pseudo three-dimensional display using parallax between the left and right eyes, and enables three-dimensional display in a true sense. Not something. For this reason, although the stereoscopic effect in the horizontal direction of the screen can be displayed, the stereoscopic effect in the vertical direction cannot be expressed, and for example, the user cannot lie down and see. Also, because of the parallax utilization technology, even if the viewpoint is changed, the same image is merely seen with a three-dimensional effect (a sense of depth).
Shaking his head left and right did not reveal the sides of the object.

In order to realize the parallax method, an object is photographed by a plurality of cameras from different directions.
After developing the film obtained by each camera, it is necessary to form a strip-shaped image by printing each film on photographic paper through an aperture by a plurality of image projectors (projectors). Therefore, a large-scale apparatus is required to realize the parallax method.

From the above, it has been difficult for the conventional technology to realize a stereoscopic moving image display in a true sense with a simple configuration.

The present invention has been made in view of the above problems, and has as its object to provide a three-dimensional image photographing apparatus and method and a three-dimensional image photographing method capable of realizing a three-dimensional moving image display with a simple structure. An image display device and method are provided.

[0013]

A three-dimensional image photographing apparatus according to the present invention is a three-dimensional image photographing apparatus for obtaining image information necessary for displaying a three-dimensional image of an object in space,
Photographing means for photographing an object to generate two-dimensional image information of the object; photographing direction setting means capable of setting a different photographing direction for each pixel of the two-dimensional image information; To obtain two-dimensional image information of a lower resolution than the resolution of the photographing means for all settable photographing directions, and to change the pixels to which each photographing direction is assigned, thereby obtaining a low-resolution two-dimensional image. It is provided with a photographing control means for repeatedly executing a process of generating information to obtain two-dimensional image information having the same resolution as that of the photographing means for all settable photographing directions.

In this three-dimensional image photographing apparatus, two-dimensional image information of the object is generated by the photographing means. The photographing direction setting means is controlled by the photographing control means, so that two-dimensional image information having a resolution lower than the resolution of the photographing means is obtained for each settable photographing direction, and each photographing direction is assigned. While changing the pixels
The process of generating low-resolution two-dimensional image information is repeatedly executed, and two-dimensional image information having the same resolution as the resolution of the photographing means is obtained for all settable photographing directions.

Further, in the three-dimensional image photographing apparatus of the present invention,
For example, the imaging control unit divides the area of the two-dimensional image into a plurality of small areas each including A pixels (A is an integer of 2 or more), and sets all settable imaging directions in each of the small areas. By setting for one pixel, low-resolution two-dimensional image information in which the resolution is 1 / A of the resolution of the photographing means is obtained. The process of generating the two-dimensional image information of the resolution is repeatedly executed A times to obtain the two-dimensional image information of the same resolution as that of the photographing unit. In this case, the photographing control means repeatedly executes, for example, a process of dividing all settable photographing directions into A photographing directions and obtaining low-resolution two-dimensional image information for the A photographing directions. By doing so, low-resolution two-dimensional image information is obtained for all settable shooting directions.

Further, in the three-dimensional image photographing apparatus of the present invention,
The photographing direction setting unit may be, for example, a unit that is disposed between the object and the photographing unit and has a deflecting unit that selects the direction of incident light and deflects the light.

A three-dimensional image photographing method according to the present invention comprises: photographing means for photographing an object and generating two-dimensional image information of the object;
A method for obtaining image information necessary for displaying a three-dimensional image of an object in space by using a photographing direction setting means capable of setting a different photographing direction for each pixel of the two-dimensional image information with respect to the photographing means. A three-dimensional image photographing method, wherein a photographing direction setting unit is controlled so that all settable photographing directions are
A first procedure for obtaining two-dimensional image information having a resolution lower than the resolution of the photographing means and a first procedure are repeatedly executed while changing the pixels to which each photographing direction is assigned,
A second procedure for obtaining two-dimensional image information having the same resolution as the resolution of the photographing means for each of all settable photographing directions.

In this three-dimensional image photographing method, in the first procedure, the photographing direction setting means is controlled, and two-dimensional image information having a resolution lower than the resolution of the photographing means is respectively obtained for all settable photographing directions. can get. Also, the second
In the above procedure, the first procedure is repeatedly executed while changing the pixels to which the respective photographing directions are assigned, and two-dimensional image information having the same resolution as that of the photographing means is obtained for each of the settable photographing directions. Can be

In the three-dimensional image photographing method of the present invention,
For example, the first procedure is to divide the area of the two-dimensional image into a plurality of small areas each including A pixels (A is an integer of 2 or more), and to set all settable shooting directions in the small area. To obtain a low-resolution two-dimensional image information in which the resolution is 1 / A of the resolution of the photographing means, and the second procedure is to reduce the pixels to which each photographing direction is assigned. The first procedure is repeatedly executed A times while changing within the region to obtain two-dimensional image information having the same resolution as that of the photographing means. In this case, the first procedure is, for example, a process of dividing all settable photographing directions into A photographing directions and obtaining low-resolution two-dimensional image information for the A photographing directions. By executing, two-dimensional image information of low resolution is obtained for all settable photographing directions.

The three-dimensional image display device of the present invention projects a plurality of two-dimensional image information items of the same object, which are viewed in different directions, in directions corresponding to the respective viewing directions.
A three-dimensional image display device for displaying a three-dimensional image of an object in space, comprising: a projection unit that projects two-dimensional image information of the object; and a projection direction that is different for each pixel of the two-dimensional image information with respect to the projection unit. The control unit controls the settable projection direction setting unit and the projection direction setting unit to project two-dimensional image information having a resolution lower than the resolution of the projection unit, for all the settable projection directions. While displaying the three-dimensional image, the process of projecting the low-resolution two-dimensional image information is repeatedly executed while changing the pixel to which each projection direction is assigned, so that the three-dimensional image having the same resolution as that of the projection unit is displayed. Display control means.

In this three-dimensional image display device, two-dimensional image information of the object is projected by the projection means. Further, the projection direction setting means is controlled by the display control means, and two-dimensional image information having a resolution lower than the resolution of the projection means is projected for each of the settable projection directions, thereby providing a low-resolution three-dimensional image. Is displayed, and the low resolution 2
By repeatedly executing the process of projecting the three-dimensional image information, a three-dimensional image having the same resolution as that of the projection unit is displayed.

Also, in the three-dimensional image display device of the present invention,
For example, the display control unit divides the area of the two-dimensional image into a plurality of small areas each including A pixels (A is an integer of 2 or more), and sets all the settable projection directions in the small area. By setting for one pixel, low-resolution two-dimensional image information whose resolution is 1 / A of the resolution of the projection means is projected, and a low-resolution three-dimensional image is displayed. The process of projecting the low-resolution two-dimensional image information is repeated A times while changing the assigned pixels within the small area, and a three-dimensional image having the same resolution as that of the projection means is displayed. In this case, for example, the display control unit divides all settable projection directions into A projection directions, and repeatedly executes a process of projecting low-resolution two-dimensional image information for the A projection directions. By doing so, low-resolution two-dimensional image information is projected for all settable projection directions.

Further, in the three-dimensional image display device of the present invention,
The projection direction setting means may have, for example, a deflecting means for selecting the direction of the emitted light and deflecting the light.

According to the three-dimensional image display method of the present invention, two-dimensional
Using a projection unit that projects two-dimensional image information and a projection direction setting unit that can set a different projection direction for each pixel of the two-dimensional image information with respect to the projection unit, a plurality of two-dimensional images having different observation directions with respect to the same object are used. A three-dimensional image display method for displaying a three-dimensional image of an object in space by projecting three-dimensional image information in directions corresponding to observation directions, respectively.
A first method of controlling the projection direction setting means to project two-dimensional image information having a lower resolution than the resolution of the projection means for all settable projection directions, thereby displaying a low-resolution three-dimensional image. It includes a procedure and a second procedure of repeatedly executing the first procedure while changing the pixels to which each projection direction is assigned, and displaying a three-dimensional image having the same resolution as that of the projection means.

In this three-dimensional image display method, in the first procedure, the projection direction setting means is controlled, and two-dimensional image information having a resolution lower than the resolution of the projection means is obtained for all settable projection directions. It is projected and a low-resolution three-dimensional image is displayed. In the second procedure, the first procedure is repeatedly performed while changing the pixels to which each projection direction is assigned, and a three-dimensional image having the same resolution as that of the projection means is displayed.

Further, according to the three-dimensional image display method of the present invention,
For example, a first procedure divides the area of a two-dimensional image into a plurality of small areas each including A pixels (A is an integer of 2 or more), and sets all settable projection directions within the small area. Is set for one pixel, low-resolution two-dimensional image information whose resolution is 1 / A of the resolution of the projection means is projected, and a low-resolution three-dimensional image is displayed. Describes a process of projecting low-resolution two-dimensional image information while changing the pixels to which each projection direction is assigned within a small area.
It is repeatedly executed three times to display a three-dimensional image having the same resolution as that of the projection means. In this case, the first procedure is, for example, a process of dividing all settable projection directions into A projection directions and projecting low-resolution two-dimensional image information for the A projection directions. By executing this, low-resolution two-dimensional image information is projected for all settable projection directions.

[0027]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS A three-dimensional image photographing apparatus and method and a three-dimensional image display apparatus and method according to an embodiment of the present invention will be described below in detail with reference to the drawings.

First, with reference to FIGS. 1 to 19, a description will be given of a technology (hereinafter, referred to as a prerequisite technology) which is a premise of an embodiment of the present invention. First, the principle of shooting and displaying a three-dimensional image in the base technology will be described with reference to FIGS.

FIG. 1 is an explanatory diagram showing a schematic configuration of a three-dimensional image photographing apparatus in the base technology. The three-dimensional image capturing apparatus includes a deflecting plate 11 that can select a direction of incident light and a direction of emitted light within a predetermined angle range,
A condensing lens 12 arranged to face one surface of the deflecting plate 11, and a pinhole member 13 sequentially arranged on the opposite side of the deflecting plate 11 in the condensing lens 12,
It includes a condenser lens 14 and a CCD (charge coupled device) 15. The pinhole member 13 has a pinhole through which light passes.

In this three-dimensional image photographing apparatus, the deflection plate 11
The surface on the side opposite to the condenser lens 12 is directed to the object 10 as the photographing target. The deflecting plate 11 corresponds to a photographing direction setting unit in the present invention. The condensing lens 12 condenses the light so that the outgoing light has the smallest diameter at the position of the pinhole of the pinhole member 13 when the parallel light is incident vertically from the deflecting plate 11 side. I have. As the condenser lens 12, for example, a Fresnel lens is used. The condensing lens 14 condenses light diffused through the pinhole and forms an image of the object 10 on the imaging surface of the CCD 15. The condenser lens 12, the pinhole member 13, the condenser lens 14, and the CCD 15 correspond to a photographing unit in the present invention.

Here, the operation of the three-dimensional image photographing apparatus shown in FIG. 1 will be described. Light from the object 10 is reflected by the deflector 1
Incident on 1. The deflecting plate 11 is provided with
Only light having a predetermined angle with respect to the surface of the deflecting plate 11 is selectively passed, and emitted as parallel light perpendicular to the surface of the deflecting plate 11. The condensing lens 12 condenses the parallel light from the deflecting plate 11. This light passes through the pinhole of the pinhole member 13, is collected by the condenser lens 14, and
The light enters the CD 15. A two-dimensional image of the object 10 viewed from a predetermined direction is formed on an imaging surface of the CCD 15. In this three-dimensional image photographing apparatus, photographing is performed assuming that the observation point 16 is located at a position facing the object 10 with the polarizing plate 11 and the condenser lens 12 interposed therebetween. The angle of the incident light selected in the deflecting plate 11 is sequentially changed with time.

As described above, in the three-dimensional image photographing apparatus shown in FIG. 1, the object 10 is photographed by one photographing means (such as the CCD 15), and two-dimensional image information of the object 10 is generated, and the photographing direction is obtained. Are sequentially changed. Therefore, the image information output from the CCD 15 is a plurality of two-dimensional image information whose shooting direction changes with time, which is image information necessary for displaying a three-dimensional image of an object in space.

FIG. 2 is an explanatory diagram showing a schematic configuration of a three-dimensional image display device in the base technology. The three-dimensional image display device is a transmissive liquid crystal display element (hereinafter, referred to as an LCD) 21 as a spatial light modulator that spatially modulates passing light based on two-dimensional image information, and the LCD 21.
A condensing lens 22, a pinhole member 23, a condensing lens 24, and a deflecting plate 25 arranged in this order on the light emission side. The pinhole member 23 has a pinhole through which light passes.

The condensing lens 22 condenses the light emitted from the LCD 21 so as to have the smallest diameter at the position of the pinhole of the pinhole member 23. Condensing lens 2
Reference numeral 4 designates light passing through the pinhole as parallel light. As the condenser lens 24, for example, a Fresnel lens is used. The deflecting plate 25 emits the light from the condenser lens 24 as parallel light that forms a predetermined angle with respect to the surface of the deflecting plate 25. The LCD 21, the condensing lens 22, the pinhole member 23, the condensing lens 24 and the deflecting plate 25 correspond to the projection means in the present invention.
The deflecting plate 25 corresponds to the projection direction setting means in the present invention.

Here, the operation of the three-dimensional image display device shown in FIG. 2 will be described. The LCD 21 spatially modulates light based on two-dimensional image information obtained by the three-dimensional image photographing device shown in FIG. The light modulated by the LCD 21 is condensed by the condenser lens 22, passes through the pinhole of the pinhole member 23, and
The light is converted into parallel light by 4 and enters the deflection plate 25. The deflecting plate 25 emits the light from the condenser lens 24 as parallel light that forms a predetermined angle with the surface of the deflecting plate 25. The angle of the light emitted from the deflecting plate 25 is sequentially changed with time so as to coincide with the angle of the incident light on the deflecting plate 11 during imaging.

As described above, in the three-dimensional image display device shown in FIG. 2, based on the two-dimensional image information obtained by the three-dimensional image photographing device shown in FIG.
The light is modulated by the LCD 21 to reproduce a two-dimensional image. This two-dimensional image is used as the deflection plate 11 at the time of shooting.
Is emitted from the deflecting plate 25 at an angle that matches the angle of the incident light. Thus, a three-dimensional image (stereoscopic image) 20 of the object 10 is formed in the space. An observer 26 located on the light emission side of the deflecting plate 25 is a three-dimensional image 20
Can be observed.

The two-dimensional image information given to the LCD 21 is two-dimensional image information obtained by inverting the two-dimensional image information obtained by the three-dimensional image photographing apparatus shown in FIG. 1 in the vertical and horizontal directions. However, when displaying a three-dimensional three-dimensional image only in the left-right direction, two-dimensional image information obtained by inverting the two-dimensional image information obtained by the three-dimensional image capturing apparatus shown in FIG. Just give it. In this case, it is necessary to provide a diffusion plate for diffusing light in the vertical direction on the light emission side of the deflection plate 25. This diffuser plate is configured by, for example, arranging a large number of minute crab-shaped lenses extending in the horizontal direction in the vertical direction.

Next, referring to FIGS. 3 and 4, taking the case of displaying a stereoscopic three-dimensional image only in the horizontal direction as an example, the positions of the three-dimensional image photographing apparatus and the three-dimensional image display apparatus in the base technology The relationship will be described conceptually. FIG.
Corresponds to the optical system of the three-dimensional image capturing apparatus shown in FIG.
FIG. 3 is an explanatory diagram showing an optical system when the optical systems of the three-dimensional image display device shown in FIG. FIG. 4 is an explanatory diagram showing an optical system when the optical system of the three-dimensional image photographing device shown in FIG. 1 is superimposed on the optical system of the three-dimensional image display device shown in FIG. In the optical systems shown in these figures, a virtual half mirror 27 is disposed between the condenser lens 12 and the pinhole member 13. The half-half mirror 27 is arranged such that the normal to the reflection surface forms an angle of 45 degrees with the optical axis of the optical system of the three-dimensional image capturing apparatus. The light from the condenser lens 12 is transmitted to the half mirror 2.
The pinhole member 23, the condensing lens 22, and the LCD 21 of the three-dimensional image display device are arranged in the direction in which the light is reflected and travels at 7.

At the time of photographing, an image of the object 10 is formed on the CCD 15. At this time, assuming that the light from the condenser lens 12 is reflected by the half mirror 27 and forms an image on the LCD 21, the image formed on the LCD 21 is an image obtained by inverting the image formed on the CCD 15 in the horizontal direction. It is. At the time of display, the LCD 21 is driven so that this inverted image is formed.

Next, the configuration of the three-dimensional image photographing apparatus in the base technology will be described in detail with reference to FIG. FIG. 5 is a block diagram illustrating a configuration of a three-dimensional image photographing device according to the base technology. This three-dimensional image photographing apparatus is shown in FIG.
And a signal processing circuit 32 for processing an output signal of the CCD 15 and outputting an image signal, and a signal processing circuit 32 for processing the output signal of the CCD 15.
2, a display position conversion circuit 33 for performing a display position conversion process to be described later as necessary, and an operation for giving the display position conversion circuit 33 information on the amount of movement of the display position. And an output circuit 35 that superimposes a synchronization signal on the output of the display position conversion circuit 33 and outputs it as a video signal. The three-dimensional image capturing device further includes:
A deflecting plate driving circuit 36 for driving the deflecting plate 11, an angle pattern generating circuit 37 for providing the spatial and temporal pattern information of the angle of the incident light to be selected to the deflecting plate driving circuit 36; And a timing control circuit 38 for controlling the operation timing of the circuit.

The CCD 15 may be for a monochrome image or a color image. CCD for color image
For example, a single-plate type color filter system provided with R, G, and B color filters may be used as the reference number 15, or a color separation unit that separates incident light into R, G, and B colors and light separated from each other may be used. Including three monochrome CCDs that receive light
A plate type may be used.

Here, the operation of the three-dimensional image photographing apparatus shown in FIG. 5 will be described. The deflecting plate driving circuit 36 drives the deflecting plate 11 so that the angle of the incident light selected by the deflecting plate 11 changes sequentially at a constant cycle. In the following description, the angle of the incident light selected by the deflecting plate 11 is from θ1 to θ.
It is assumed that it changes at intervals of Δθ up to 60. Δθ is, for example, 1 degree.

The CCD driving circuit 31 is synchronized with the driving of the deflecting plate 11 by the deflecting plate driving circuit 36 so that one sheet of two-dimensional image information can be obtained for each angle of the incident light selected by the deflecting plate 11. To drive the CCD 15. The output signal of the CCD 15 is processed by the signal processing circuit 32 to be an image signal. This image signal is subjected to display position conversion processing by a display position conversion circuit 33 as necessary, and is sent to an output circuit 35. Then, the output circuit 35 outputs a video signal. The configuration and operation of the display position conversion circuit 33 will be described later in detail.

FIG. 6 is an explanatory diagram showing the correspondence between the angle of the incident light selected by the deflecting plate 11 and the image captured by the CCD 15. As shown in this figure, the angle of the incident light selected by the deflecting plate 11 is the angle Δθ (= 1) from θ1 to θ60.
Degrees) at intervals. The CCD 15 sets each angle θi (i =
1, 2,..., 60)
Capture a two-dimensional image. Here, one two-dimensional image captured for each angle θi is called an image for one field. Accordingly, a two-dimensional image for 60 fields can be obtained by scanning the angle of the incident light from the angles θ1 to θ60. In the following description, a set of two-dimensional images obtained by scanning from the angles θ1 to θ60 is referred to as an image for 60 spatial fields. One three-dimensional still image is formed from images for 60 space fields. Therefore, the 60 spatial fields from the angles θ1 to θ60 are referred to as one spatial frame. The image capture at each angle from θ1 to θ60 is performed at timing t1.
Ｔt60.

When the image capture for 60 spatial fields from the angles θ 1 to θ 60 is completed, the next timing t
From 61 to t120, the angle θ1 is further increased to 60 from the angle θ1 to θ60.
An image for the spatial field is captured. In the same manner, the capture of the image for each of the 60 spatial fields is repeated. By repeating this operation 60 times, an image for a total of 3600 fields can be obtained. At this time, focusing on a certain angle θi, the timings ti to t
At (i + 60x59), an image for 60 fields has been obtained. In the following description, a two-dimensional image obtained at timings ti to t (i + 60x59) at each angle θi is referred to as an image for a 60-hour field.

Here, assuming that the change in the angle of the incident light from the angles θ 1 to θ 60 and the capture of the image for 60 spatial fields are performed in 1/60 second, the cycle of the angle change of the incident light and the image capture The period Δt is 1/3600 seconds, and an image for 3600 fields can be obtained in one second.

Next, an example of the configuration of the deflecting plate 11 in the three-dimensional image photographing apparatus will be described. FIG. 7 shows the deflection plate 1.
1 shows a configuration of a liquid crystal element used in Example 1. The liquid crystal element 40 is composed of a polymer dispersed liquid crystal (PDLC).
sed Liquid Crystal) or polymer / liquid crystal composite (Liquid
d Crystal Polymer Composite). This polymer-dispersed liquid crystal device applies a voltage to the composite of polymer and liquid crystal to align the liquid crystal molecules in the direction of the electric field, and uses the effect of the refractive index matching between the polymer and liquid crystal to see It has a function of switching between a cloudy state and a transparent state depending on the direction.

The liquid crystal element 40 comprises a polymer / liquid crystal composite layer 43 formed by dispersing needle-like liquid crystal molecules 42 of several microns or less in a polymer material 41, and a polymer / liquid crystal composite layer 4.
The microscopic stripe electrodes 44 and 45 are formed on the entrance surface and the exit surface of the third electrode 3 so as to be opposed to each other with the polymer / liquid crystal composite layer 43 interposed therebetween and to extend in a direction perpendicular to the paper surface.
And The stripe electrodes 44 and 45 are
As described above, the stripes may be arranged so that the directions of the stripes (the longitudinal directions of the electrodes) are parallel to each other. For example, a so-called simple matrix arrangement in which the directions of the stripes are orthogonal to each other may be used. Alternatively, an active matrix arrangement using a TFT (thin film transistor) or the like may be adopted. In these cases, it is possible to control the deflection direction in two directions.

The stripe electrodes 44 and 45 are made of, for example, IT
It is formed of a transparent conductive film such as O (Indium Tin Oxide) and extends in a direction (vertical direction) perpendicular to the plane of the drawing. A predetermined voltage is selectively applied between the stripe electrode 44 and the stripe electrode 45. 1Px in the figure represents an area for one pixel. The pitch of the arrangement of the stripe electrodes 44 and 45 is 60 angles θ1.
Is set as small as possible to the extent that .theta.60 can be realized.

When no voltage is applied to the liquid crystal molecules 42, the liquid crystal optical axis (long axis)
Are pointing in random directions. In this state, the effective refractive index of the liquid crystal molecules 42 does not coincide with the refractive index of the polymer material 41, and the light scattering effect at the interface between the liquid crystal molecules 42 and the polymer material 41 causes the polymer / liquid crystal composite. The entire layer 43 has an opaque white state. On the other hand, the stripe electrode 4
When a voltage is selectively applied between 4, 4 and 45, the direction of the optical axis of the liquid crystal molecules 42 is aligned with the direction of the electric field within the range of the sandwiched electric field generated by this, and the apparent refraction of the liquid crystal molecules 42 The ratio is a value n corresponding to the ordinary ray of the liquid crystal molecules 42.
It becomes 0. For this reason, if a polymer material 41 having a refractive index substantially equal to n0 is used, there is no difference in the refractive index at the interface between the liquid crystal molecules 42 and the polymer material 41, and the light scattering effect is weakened in the direction of the electric field. Polymer
The liquid crystal composite layer 43 becomes transparent. That is, light passes only in the direction of the electric field.

Here, for example, the polymer / liquid crystal composite layer 43
Is L, and the pitch of the arrangement of the stripe electrodes 44 and 45 is p. In this case, the angle formed by the direction of the light passing through the polymer / liquid crystal composite layer 43 with respect to the normal to the surface of the polymer / liquid crystal composite layer 43 is δi, and the stripe electrode 44,
The value of the number of pitches in the horizontal direction between 45 is represented by ni.
When the value of the horizontal displacement between the stripe electrodes 44 and 45 is represented by di, the stripe electrode 4 for obtaining the predetermined angle δi is given by tanδi = di / L = p × ni / L.
The number of horizontal shift pitches ni between 4, 45 is expressed by the following equation (1). Here, i = 1, 2,..., 60.

Ni = L × tan δi / p (1)

FIG. 8 shows the structure of the deflecting plate 11 using the liquid crystal element 40 described above. As shown in this figure, as the deflection plate 11 in the three-dimensional image photographing device,
One having a structure in which two liquid crystal elements 40 are overlapped is used. Hereinafter, the liquid crystal element 40 on the incident side of the deflecting plate 11 is denoted by reference numeral 40A, and the liquid crystal element 40 on the output side is denoted by reference numeral 40B.
Expressed by Note that illustration of the stripe electrodes 44 and 45 is omitted in FIG. The interface between the liquid crystal elements 40A and 40B is a light scattering surface.

The driving of the deflecting plate 11 is performed as follows. In the liquid crystal element 40A, the angle δ of the passing light
so that i is the angle θ1 to θ60 of the selected incident light,
The application of a voltage to the stripe electrodes 44 and 45 is controlled. The light that has passed through the liquid crystal element 40A is
A and 40B are scattered by the light scattering surface. Liquid crystal element 40
In B, the stripe electrodes 44 and 4 are arranged such that, of the light that has passed through the liquid crystal element 40A and is scattered by the light scattering surface, only light that is perpendicular to the surface of the liquid crystal element 40B passes through the liquid crystal element 40B.
5 is controlled. As a result, FIG.
As shown in (1), only the light incident at the angle θi passes through the deflecting plate 11 and is emitted perpendicular to the surface of the deflecting plate 11.

FIG. 9 shows the operation of the deflecting plate 11 when the angle of the incident light is θ1, and FIG. 10 shows the operation of the deflecting plate 11 when the angle of the incident light is θ60. It is. As shown in these figures, each liquid crystal element 40A, 4A
0B, the voltage application to the stripe electrodes 44 and 45 is controlled by maintaining the angle between the straight line connecting the pair of electrodes to which the voltage is applied and the surface of the deflecting plate 11 at θi. Are sequentially shifted, for example, from left to right in the figure as shown by arrows in the figure. More specifically, in synchronization with scanning (hereinafter, referred to as voltage application scanning) in which pulse voltages are sequentially applied to the stripe electrodes 45 arranged on the incident surface side at predetermined time intervals (hereinafter, referred to as voltage application scanning), the light emitting surface side. A voltage application scan for applying a pulse voltage to each of the stripe electrodes 44 arranged in sequence is performed. At this time, control is performed so that a horizontal shift distance corresponding to the angle θi is maintained between the stripe electrode 45 to which the voltage on the incident surface side is applied and the stripe electrode 44 to which the voltage on the emission surface side is applied. Done. Such an operation is performed simultaneously in each area corresponding to each pixel.

The voltage application scan for one angle θi is performed at a time period of 1/3600 seconds. Therefore, the time required for voltage application scanning for all angles from the angles θ1 to θ60 is 1/60 second.

The polymer / liquid crystal composite layer 43 is formed, for example, by applying a solution of a polymer and a liquid crystal on a substrate and then evaporating the solvent, or when the polymer of the polymer material is cured by polymerization, the liquid crystal becomes high. It is formed by a method utilizing the effect that liquid crystal droplets are formed by precipitation from a molecular material, but can be formed by other methods. For example, it has a structure in which a nematic liquid crystal is dispersed in an aqueous solution of polyvinyl alcohol (PVA) or the like and microcapsules of liquid crystal droplets are microencapsulated, or a structure in which a small amount of a polymer material is dispersed in a gel state in the liquid crystal. Is also good. In the conventional polymer-dispersed liquid crystal, spherical liquid crystal molecules are used, but in applications where directivity is required as in this example, the liquid crystal molecules may have a needle shape as described above. desirable. In order to form such a needle-like liquid crystal, for example, there is a method in which the liquid crystal is precipitated in a uniform magnetic field and microencapsulated. In this method, needle-like liquid crystal molecules 42 are formed by the tide effect in the direction of the magnetic field.

Next, the configuration of the three-dimensional image display device in the base technology will be described in detail with reference to FIG.
FIG. 11 is a block diagram illustrating a configuration of a three-dimensional image display device according to the base technology. This three-dimensional image display device
In addition to the configuration shown in FIG. 2, a light source unit 50 that supplies illumination light parallel to the LCD 21, a video signal is input, a synchronization signal is separated from the video signal, and a synchronization signal that outputs a video signal and a synchronization signal is output. A separation circuit 51, a signal processing circuit 52 that performs signal processing on the basis of the video signal output from the synchronization separation circuit 51 and outputs an image signal, and an output signal of the signal processing circuit 52, In response, a display position conversion circuit 53 for performing a display position conversion process described later, an operation unit 54 for giving information of the movement amount of the display position to the display position conversion circuit 53, LCD drive circuit 55 for driving LCD 21 based on the output signal
And The three-dimensional image display apparatus further provides a deflection plate driving circuit 56 for driving the deflection plate 25 and information on the spatial and temporal pattern of the angle of the selected incident light to the deflection plate driving circuit 56. An angle pattern generation circuit 57 and a timing control circuit 58 that receives a synchronization signal output from the synchronization separation circuit 51 and controls the operation timing of each circuit in synchronization with the synchronization signal are provided.

The LCD 21 may be for forming a monochrome image or for forming a color image. In the case of forming a color image, for example, a single-panel color filter system having R, G, and B color filters is used as the LCD 21. The liquid crystal portion of the LCD 21 includes, for example, a ferroelectric liquid crystal capable of operating at high speed.
(FLC: Ferroelectric Liquod Crystal) is used.
In place of the light source unit 50 and the LCD 21, a white light source and a color separation unit such as a dichroic mirror or a dichroic prism for separating light emitted from the white light source into R, G, and B colors, and the color separation. Three monochrome LCDs for spatially modulating each of the lights separated by the means in accordance with image signals of R, G, and B, respectively;
A synthesizing means for synthesizing and emitting R, G, and B lights modulated by the monochrome LCDs may be provided.

Here, the operation of the three-dimensional image display device shown in FIG. 11 will be described. A video signal obtained by, for example, the three-dimensional image photographing device shown in FIG. 5 is input to the three-dimensional image display device. The synchronization separation circuit 51 separates a synchronization signal from an input video signal and outputs a video signal and a synchronization signal. The video signal is supplied to the signal processing circuit 52
Is processed into an image signal. This image signal is subjected to display position conversion processing by a display position conversion circuit 53 as necessary, and is sent to an LCD drive circuit 55.
Then, the LCD drive circuit 55 drives the LCD 21 based on the image signal.

The parallel illumination light emitted from the light source unit 50 is spatially modulated by the LCD 21. Thereby, a two-dimensional image is formed. The output light of the LCD 21 is
After passing through the condenser lens 22, the pinhole of the pinhole member 23 and the condenser lens 24, the light enters the deflection plate 25 as a parallel light flux.

The deflecting plate drive circuit 56 drives the deflecting plate 25 so that the angle of the light emitted from the deflecting plate 25 changes sequentially at a constant cycle. Here, the angle of the light emitted from the deflecting plate 25 is determined for each two-dimensional image formed by the LCD 21.
Control is performed so as to match the angle of incident light at the time of shooting by the three-dimensional image shooting device. Such angle control is performed by the timing control circuit 58 based on the synchronization signal separated by the synchronization separation circuit 51.

FIG. 12 is an explanatory diagram showing the correspondence between the two-dimensional image formed by the LCD 21 and the angle of the light emitted from the deflecting plate 25. Note that, here, three-dimensional 3
It is assumed that a two-dimensional image is displayed. Therefore, as shown in FIG. 12, a diffusion plate 29 for vertically diffusing light is provided on the light emission side of the deflection plate 25. FIG. 13 is a perspective view showing the condenser lens 24, the deflection plate 25, and the diffusion plate 29. As shown in this figure, the diffusing plate 29 diffuses the light emitted from the deflecting plate 25 in the vertical direction at a predetermined angle α.

As shown in FIG. 12, the angle of the light emitted from the deflecting plate 25 changes from θ1 to θ60 at intervals of an angle Δθ (= 1 degree). The LCD 21 displays each angle θi (i = 1, 2,
, 60), a two-dimensional image corresponding to the angle is formed. Therefore, two-dimensional images for 60 spatial fields are projected in different directions by scanning the angles of the emitted light from the angles θ1 to θ60. The formation of the two-dimensional image at each angle of θ1 to θ60 is performed at timings t1 to t, respectively.
Done at 60.

When the formation of the image for 60 space fields from the angles θ1 to θ60 is completed, the next timing t61 to t61
At t120, an image for 60 spatial fields from angles θ1 to θ60 is further formed. In the same manner, formation of an image for each of the 60 spatial fields is repeated. By performing this repetition 60 times, a two-dimensional image for a total of 3600 fields is projected.

Next, an example of the configuration of the deflection plate 25 in the three-dimensional image display device will be described. FIG. 14 and FIG.
5 shows the configuration of the deflection plate 25. As shown in these figures, the deflection plate 25 is provided with a single liquid crystal element 40.
It is constituted by. The incident side surface of the deflecting plate 25 is
The light scattering surface 49 is provided. Therefore, the light that has entered the deflecting plate 25 is scattered by the light scattering surface 49, and only the light in the selected direction is emitted through the liquid crystal element 40.

In the deflecting plate 25, the application of the voltage to the stripe electrodes 44 and 45 of the liquid crystal element 40 is controlled so that the angle of the emitted light sequentially becomes θ1 to θ60. FIG.
4 shows the operation of the deflecting plate 25 when the angle of the outgoing light is θ1, and FIG. 15 shows the operation of the deflecting plate 25 when the angle of the outgoing light is θ60. As shown in these figures, control of voltage application to the stripe electrodes 44 and 45 in the liquid crystal element 40 is performed by changing the angle formed by a straight line connecting a pair of electrodes to which a voltage is applied with respect to the surface of the deflection plate 25 to θi. The pair of electrodes to which a voltage is applied is sequentially shifted from the left side to the right side of the figure, for example, as shown by the arrow in the figure. More specifically, each stripe electrode 44 arranged on the incident surface side
In synchronization with the voltage application scanning for applying a pulse voltage one after another at predetermined time intervals, voltage application scanning for sequentially applying a pulse voltage to each stripe electrode 45 arranged on the emission surface side is performed. . At this time, control is performed so that a horizontal shift distance corresponding to the angle θi is maintained between the stripe electrode 44 to which the voltage on the incident surface side is applied and the stripe electrode 45 to which the voltage on the output surface side is applied. Done. Such an operation is performed simultaneously in each area corresponding to each pixel.

The voltage application scan for one angle θi is performed at a time period of 1/3600 seconds. Therefore, the time required for voltage application scanning for all angles from the angles θ1 to θ60 is 1/60 second.

Since the alignment of the liquid crystal molecules 42 has a hysteresis, the alignment state is maintained for some time even after the electric field moves. Therefore, after such orientation is performed over the entire surface of the deflection plate 25, an image may be displayed on the LCD 21 at a period of 1/3600 seconds. More specifically, the scanning duty ratio defined as the ratio of the actual required time to the period of the voltage application scanning (= 1/3600 seconds) is set to, for example, 50% or less, and the scanning duty ratio to the display period (= 1/3600 seconds) of the LCD 21 is set. Assuming that the display duty ratio defined as the ratio of the actual display time is also 50% or less, one voltage application scan and one image display on the LCD 21 are performed within 1/3600 seconds. Becomes Also,
When the matrix electrodes are used instead of the stripe electrodes 44 and 45 as described above, the liquid crystal molecules 42
By randomly disturbing the orientation direction of the liquid crystal molecules once, only a part of the liquid crystal molecules 42 in the area for one pixel is oriented at the angle θi, so that the display of the intermediate gradation can be realized.

Next, the principle of the display position conversion process in the base technology will be described with reference to FIG. FIG.
2 shows a schematic configuration of a three-dimensional image display device in the base technology as in FIG. In this figure,
The three-dimensional image displayed when the display position conversion process is not performed is represented by reference numeral 20A, and is displayed when the display position conversion process of moving the display position by a distance a in the front-rear direction with respect to the three-dimensional image 20A is performed. Code of the three-dimensional image
Expressed by To perform such a display position conversion process, the position of the two-dimensional image from which light is emitted from the deflecting plate 25 at an angle θi is set on the deflecting plate 25 in the in-plane direction of the two-dimensional image information, that is, in the horizontal direction. What is necessary is just to move by b. Where b is
This is a value represented by the following equation (2).

B = a × tan θi (2)

Here, a takes a negative value when the three-dimensional image approaches the observer 26, and takes a positive value when the three-dimensional image moves away from the observer 26. Further, θi takes a negative value when the light emitted from the deflection plate 25 faces the left side in FIG.
When turning to the right, a positive value is assumed. Also, b
Takes a positive value when moving the position of the two-dimensional image on the deflection plate 25 to the right in FIG. 16, and takes a negative value when moving to the left.

Therefore, the movement amount a of the display position of the three-dimensional image
By shifting the position of the two-dimensional image projected on the deflection plate 25 by b according to the angle θi of the light emitted from the deflection plate 25, the display position of the three-dimensional image can be moved. In order to shift the position of the two-dimensional image projected on the deflecting plate 25 by b, the position of the two-dimensional image on the LCD 21 is calculated by multiplying b by a constant ratio, that is, by a value proportional to b. You only have to shift it horizontally. When obtaining a stereoscopic video having a viewing angle also in the vertical direction (vertical direction), the same conversion is performed in the vertical direction.

The display position conversion circuit 33 in FIG. 5 and the display position conversion circuit 53 in FIG. 11 shift the position of the two-dimensional image in the horizontal direction in order to convert the display position of the three-dimensional image based on the above principle. Perform processing.

FIG. 17 is a block diagram showing an example of the configuration of the display position conversion circuits 33 and 53. Here, it is assumed that the image signals input to the display position conversion circuits 33 and 53 are digital signals. Display position conversion circuits 33, 53
Has a frame memory 61 for storing an input image signal in a two-dimensional image unit, and a write / read address control circuit 62 for controlling a write address and a read address of the frame memory 61. The write / read address control circuit 62 includes the operation units 34 and 5
4, the information of the movement amount of the display position is provided. The write / read address control circuit 62 is provided with a timing signal from the timing control circuits 38 and 58.

In the display position conversion circuits 33 and 53, the input image signal is transferred to the write / read address control circuit 6
Under the control of 2, the data is written to the frame memory 61, read, and output to the subsequent stage. Here, the write / read address control circuit 62 operates the operation units 34 and 5.
4 based on the information of the movement amount of the display position given by the control unit 4 and the timing signals from the timing control circuits 38 and 58.
The shift amount of the position of the two-dimensional image is obtained. The information on the movement amount of the display position provides a value corresponding to the movement amount a in Expression (2). The timing signal is represented by the angle θi in equation (2).
Provide information. Then, the write / read address control circuit 62 shifts the position of the two-dimensional image represented by the output image signal by the calculated amount of deviation from the position of the two-dimensional image represented by the input image signal.
Control the write address and read address.

When the input image signal is an analog signal, it is stored in the frame memory 61 after analog-digital conversion.

Such a display position conversion process is performed by the display position conversion circuit 33 in the three-dimensional image photographing apparatus shown in FIG.
Or by the display position conversion circuit 53 in the three-dimensional image display device shown in FIG. Therefore, one of the display position conversion circuits 33 and 53 may be omitted.

Next, an example of a more effective method of capturing and displaying a three-dimensional image will be described with reference to FIGS. FIG. 18 shows a schematic configuration of the three-dimensional image photographing device as in FIG. 1, and FIG. 19 shows a schematic configuration of the three-dimensional image display device as in FIG. In FIG. 18, a mirror 70 is arranged on the rear side of the object 10 as an object to be photographed. In this case, the rear surface of the object 10 is projected on the mirror 70. When the three-dimensional image capturing device captures an image of the object 10 and the mirror 70 and supplies the obtained two-dimensional image information to a three-dimensional image display device to display a three-dimensional image, the three-dimensional image is displayed as shown in FIG. The mirror 70 is located behind the three-dimensional image 20 of the object 10 as viewed from the person 26.
Is displayed. And this mirror 7
In the three-dimensional image 71 of 0, an image of the rear surface of the object 10 is displayed. Just as the appearance of the three-dimensional image 20 of the object 10 changes according to the observation direction, the appearance of the image of the rear surface of the object 10 projected on the three-dimensional image 71 of the mirror 70 also changes according to the observation direction. . Therefore,
As compared with the case where the mirror 70 is not provided, the display of a three-dimensional image with a more three-dimensional effect can be realized.

Further, the position of the mirror surface of the mirror 70 in the three-dimensional image 71 is changed by the display position conversion process.
If the display position of the three-dimensional image is converted so as to coincide with the position of the surface of the surface 5, the surface of the deflection plate 25 looks like a mirror surface, which is more effective.

Next, the first embodiment of the present invention will be described in detail. In the present embodiment, when capturing a three-dimensional image, a different capturing direction is set for each pixel to generate one piece of two-dimensional image information, and the capturing direction for each pixel is sequentially changed to continuously Generate two-dimensional image information. Further, in the present embodiment, when displaying a three-dimensional image, continuous two-dimensional image information obtained as described above is projected for each pixel in a direction corresponding to the shooting direction at the time of shooting. Thus, a three-dimensional image is formed.

First, referring to FIGS. 20 to 25,
A format representing a shooting direction and a projection direction for each pixel in the present embodiment will be described. In the following description, a two-dimensional image of N pixels in the horizontal direction and M pixels in the vertical direction is expressed as a two-dimensional image of N × M pixels. In the present embodiment, the resolution of the two-dimensional image information photographing means in the three-dimensional image photographing device and the resolution of the two-dimensional image information projecting means in the three-dimensional image display device are 640 × 480 pixels. Is composed of 640 × 480 pixels. The shooting direction and the projection direction are θ1
It is assumed to be 60 directions of ~ θ60. 20 to 25, the numerals 1 to 60 in the drawings correspond to the directions θ1 to θ, respectively.
Represents 60. Further, in the present embodiment, one spatial frame is formed by five spatial fields. One spatial frame forms one three-dimensional still image. Further, a three-dimensional image for one second is formed by the twelve spatial frames.

In the present embodiment, 640 × 480
The two-dimensional image area of the pixel is divided into 160 horizontal areas and 160 vertical areas. The small area is composed of 4 × 3 pixels.

FIG. 20 shows the first to fifth spatial fields Fd1 to Fd5 constituting the first spatial frame Fm1. The area of 4 × 3 pixels in the figure represents a small area. Looking at the direction of each pixel in each small region in the scanning direction, in the first spatial field Fd1 of the first spatial frame Fm1, the direction of each pixel in each small region is set to θ1 to θ12. I have. In the second spatial field Fd2, the direction of each pixel in each small area is θ13 to θ13.
It is set to 24. In the third spatial field Fd3,
The direction of each pixel in each small area is set to θ25 to θ36. In the fourth spatial field Fd4, the direction of each pixel in each small area is set to θ37 to θ48. In the fifth space field Fd5, the direction of each pixel in each small area is set to θ49 to θ60.

FIG. 21 shows the first to fifth spatial fields Fd1 to Fd5 constituting the second spatial frame Fm2. The area of 4 × 3 pixels in the figure represents a small area. Looking at the direction of each pixel in each small area in the scanning direction, in the first spatial field Fd1 of the second spatial frame Fm2, the direction of each pixel in each small area is set to θ2 to θ12, θ1. Have been. In the second spatial field Fd2, the direction of each pixel in each small area is θ
14 to θ24 and θ13. In the third spatial field Fd3, the direction of each pixel in each small area is θ26 to θ3.
6, is set to θ25. Fourth spatial field Fd4
Then, the direction of each pixel in each small area is θ38 to θ48, θ37
Is set to In the fifth spatial field Fd5, the direction of each pixel in each small area is set to θ50 to θ60 and θ49.

FIG. 22 shows the first to fifth spatial fields Fd1 to Fd5 constituting the third spatial frame Fm3. The area of 4 × 3 pixels in the figure represents a small area. Looking at the direction of each pixel in each small area in the scanning direction order, in the first spatial field Fd1 of the third spatial frame Fm3, the direction of each pixel in each small area is θ3 to θ12, θ1, θ2. Is set to Second
In the spatial field Fd2, the direction of each pixel in each small area is set to θ15 to θ24, θ13, and θ14. In the third spatial field Fd3, the direction of each pixel in each small area is set to θ27 to θ36, θ25, and θ26. In the fourth spatial field Fd4, the direction of each pixel in each small area is set to θ39 to θ48, θ37, and θ38. In the fifth spatial field Fd5, the direction of each pixel in each small area is θ
51 to θ60, θ49, and θ50 are set.

Hereinafter, similarly, each of the spatial fields Fd1 to Fd1
Although the combination of directions assigned to each small area in Fd5 is the same, the pixels assigned to each direction are shifted by one pixel in the scanning direction in each small area every time the spatial frame advances.

FIG. 23 shows the first to fifth spatial fields Fd1 to Fd5 constituting the twelfth spatial frame Fm12. The area of 4 × 3 pixels in the figure represents a small area. Looking at the direction of each pixel in each small area in the scanning direction, the twelfth spatial frame Fm
In the first spatial field Fd1 of No. 3, the direction of each pixel in each small area is set to θ12, θ1 to θ11. Second
In the spatial field Fd2, the direction of each pixel in each small area is set to θ24, θ13 to θ23. In the third spatial field Fd3, the direction of each pixel in each small area is θ3
6, is set to θ25 to θ35. In the fourth spatial field Fd4, the direction of each pixel in each small area is θ48, θ37.
It is set to ~ θ47. In the fifth space field Fd5, the direction of each pixel in each small area is set to θ60, θ49 to θ59.

In FIGS. 20 to 23, the directions θ12, θ24, θ36, θ48, and θ60 are used in order to understand how a pixel to which a certain direction is assigned changes.
Are indicated by surrounding squares with pixels.

FIG. 24 and FIG. 25 show directions assigned to each pixel in one small area. FIG.
4 is a first spatial frame Fm1 to a sixth spatial frame Fm
FIG. 25 shows the seventh spatial frame Fm7 to the twelfth spatial frame Fm7.
This represents the spatial frame Fm12.

The configuration of the three-dimensional image photographing apparatus according to the present embodiment is the same as that of FIG. In the present embodiment, the angle pattern generation circuit 37 generates an angle pattern indicating the direction of each pixel according to the above-described format, and supplies the generated angle pattern to the deflection plate driving circuit 36. The deflecting plate drive circuit 36 sets the angle of the incident light for each pixel of the deflecting plate 11 according to the supplied angle pattern. The CCD drive circuit 31, the deflecting plate drive circuit 36, the angle pattern generation circuit 37, and the timing control circuit 38 in FIG. 5 correspond to a photographing control unit in the present invention.

The configuration of the three-dimensional image display device according to the present embodiment is the same as that of FIG. In the present embodiment, the angle pattern generation circuit 57 generates an angle pattern indicating the direction of each pixel according to the above-described format, and supplies the generated angle pattern to the deflection plate driving circuit 56. The deflection plate drive circuit 56 sets the angle of the emitted light for each pixel of the deflection plate 25 according to the supplied angle pattern. The LCD drive circuit 55, the deflection plate drive circuit 56, the angle pattern generation circuit 57, and the timing control circuit 58 in FIG. 11 correspond to a display control unit according to the present invention.

The angle pattern at the time of displaying a two-dimensional image must match the angle pattern at the time of shooting for each two-dimensional image. This can be realized by synchronizing a change in the spatial frame and the spatial field of the two-dimensional image with a change in the angle pattern based on a synchronization signal included in the video signal.

As described above, in the present embodiment,
3 in one spatial frame consisting of 5 spatial fields
A two-dimensional still image is formed. In one spatial field, still images having a resolution of 160 × 160 pixels are simultaneously formed in 12 directions. And, with five spatial fields, ie one spatial frame, 60
Still images with a resolution of 160 × 160 pixels are formed in all directions. Therefore, a three-dimensional image with a resolution of 160 × 160 pixels can be displayed by one spatial frame. Further, with the 12 spatial frames, a three-dimensional image can be displayed with a resolution of 640 × 480 pixels, that is, a maximum resolution, in all 60 directions. Moreover, from one direction, almost complete,
It is possible to observe a three-dimensional moving image of 60 fields / second.

In the present embodiment, each spatial field forms an image in 12 directions out of 60 total directions, and 5 spatial fields (ie, one spatial frame) form 60 images. Are formed in all directions. Further, in this embodiment, a three-dimensional image having a resolution of 160 × 160 pixels is formed by each spatial frame, but the pixels to which each direction is assigned are changed for each frame. Thus, a three-dimensional image having a resolution of 640 × 480 pixels is formed by the twelve spatial frames. Therefore, in the present embodiment, it can be said that information necessary for displaying a three-dimensional image is configured by a temporal and spatial interlace method.

According to the present embodiment, it is possible to display a three-dimensional moving image that can withstand observation in terms of the image update cycle and resolution while reducing the number of fields per second.

According to the present embodiment, an object is photographed by one photographing means while sequentially changing the photographing direction, and a plurality of two-dimensional image information having different photographing directions is obtained. Image information required to display a three-dimensional image of an object on a computer can be obtained with a simple configuration.

Further, according to the present embodiment, an object can be continuously photographed by one photographing means. Therefore, even if the object is a moving object, a three-dimensional image of the object can be moved in space. Image information required to be displayed on the screen can be obtained with a simple configuration. Therefore, according to the three-dimensional image photographing apparatus and method according to the present embodiment, it is possible to realize stereoscopic moving image display in a true sense with a simple configuration.

Further, according to the present embodiment, the display position of the three-dimensional image can be reduced by a simple configuration in which the display position conversion circuits 33 and 53 are added and a simple process in which the position of the two-dimensional image is shifted. Can be converted, and a three-dimensional image can be displayed at a desired position in space.

In this embodiment, one spatial frame is formed by five spatial fields, and a three-dimensional image for one second is formed by 12 spatial frames (60 spatial fields). However, the following various changes are possible.

For example, one spatial frame may be formed by four spatial fields, and a three-dimensional image for one second may be formed by fifteen spatial frames (60 spatial fields). In this case, for example, the small area is 5 × 3
As a pixel, a two-dimensional still image having a resolution of 128 × 160 pixels is projected in one direction in one spatial field.

Further, one spatial frame may be formed by three spatial fields, and a three-dimensional image for one second may be formed by twenty spatial frames (60 spatial fields). In this case, for example, the small area is 5 × 4 pixels, and one spatial field has one direction in one direction.
A two-dimensional still image with a resolution of 28 × 120 pixels is projected.

Further, one spatial frame may be formed by two spatial fields, and a three-dimensional image for one second may be formed by 30 spatial frames (60 spatial fields). In this case, for example, the small area is set to 5 × 6 pixels, and one space field has one direction in one direction.
A two-dimensional still image with a resolution of 28 × 80 pixels is projected.

Also, one spatial frame may be formed by one spatial field, and a three-dimensional image for one second may be formed by 60 spatial frames (60 spatial fields). In this case, for example, the small area is 10 × 6
In this case, two-dimensional still images having a resolution of 64 × 80 pixels are projected in one direction in one spatial field.

In the present embodiment, the number of spatial fields per second is set to 60. However, if the number of spatial fields is increased, a three-dimensional moving image with smoother motion can be displayed. For example, assuming that the number of spatial fields per second is 120, the change of the angle pattern for 60 fields described in the present embodiment can be repeated twice per second, and the motion can be expressed more smoothly. Becomes possible.

In the present embodiment, the two-dimensional image is 6
Although the configuration is made up of 40 × 480 pixels, a more precise (fine) three-dimensional image display becomes possible by increasing the number of pixels. For example, if the two-dimensional image is 1024
Let us consider the case of being composed of × 768 pixels. In this case, assuming that the space is divided into 60 at every predetermined angle and a three-dimensional image is formed with 60 fields, for example, a small area is 4 × 3 pixels, and an image area of 1024 × 768 pixels is 256 pixels. It is divided into small areas of × 256. Also, for example, one spatial frame is formed by five spatial fields, and 12 spatial frames (60 spatial fields)
Forms a three-dimensional image for one second. Note that the size of the small area may be changed, the number of divisions into which the space is divided at every predetermined angle may be increased for the purpose of improving the spatial resolution or the viewing angle, or may be performed per second. The number of fields may be increased.

If the two-dimensional image is composed of 1024 × 768 pixels and the number of fields per second is 120, it is possible to display a three-dimensional moving image with extremely high precision and smooth motion. In order to realize this, 1024
A pixel number of × 768 pixels is required, and a high rate such as 120 fields / second is required. However, this can be sufficiently realized due to the recent increase in the number of pixels of the CCD or LCD, the technology of the CCD compatible with the non-interlace method, and the like.

In the present embodiment, when the display position conversion processing is executed, the two-dimensional image information for 60 spatial fields having different shooting directions and different projection directions for each pixel is obtained by using each of the 60 shooting directions and After conversion into two-dimensional image information for each projection direction, a display position conversion process is performed on the two-dimensional image information after the conversion, and then a two-dimensional image for 60 spatial fields in which the shooting direction and the projection direction are different for each pixel What is necessary is just to convert it into information.

Next, a second embodiment of the present invention will be described with reference to FIG. This embodiment is an example in which the present invention is applied to a video conference system. FIG.
FIG. 1 is an explanatory diagram illustrating a configuration of a video conference system according to the present embodiment. The video conference system includes two three-dimensional image capturing and displaying devices 201 and 202. The two three-dimensional image capturing and displaying devices 201 and 202 are connected via a signal transmission path 203 that transmits signals in two directions.

Three-dimensional imaging and display devices 201 and 202
Is a device in which a three-dimensional image capturing device and a three-dimensional image display device are integrated. Three-dimensional image capturing and displaying device 201,
In No. 02, the half mirror 211 is disposed between the condenser lens 12 and the pinhole member 13 in the three-dimensional image capturing apparatus shown in FIG. This half mirror 211
Are arranged such that the normal to the reflecting surface is at 45 degrees to the optical axis of the optical system of the three-dimensional image capturing apparatus. The pinhole member 23, the condenser lens 22, and the LCD 21 of the three-dimensional image display device are arranged in a direction in which the light from the condenser lens 12 is reflected by the half mirror 211 and travels. Although not shown, the circuit configurations of the three-dimensional image capturing and displaying devices 201 and 202 have both a circuit in the three-dimensional image capturing device and a circuit in the three-dimensional image displaying device. The configurations of the three-dimensional image capturing devices and the three-dimensional image display devices included in the three-dimensional image capturing and displaying devices 201 and 202 are the same as those in the first embodiment.

Next, the operation of the video conference system according to the present embodiment will be described. The three-dimensional image capturing and displaying devices 201 and 202 simultaneously capture and display a three-dimensional image. That is, in the deflecting plate 11, the photographing direction and 2
The projection direction of the two-dimensional image information is selected at the same time. The light incident on the deflecting plate 11 is condensed by the condenser lens 12 and the half mirror 2.
11, through the pinhole member 13, and the condenser lens 14, C
The light enters the CD 15. Light from the LCD 21 passes through the condenser lens 22, the pinhole member 23, the half mirror 211, and the condenser lens 12, and is projected by the deflecting plate 11.

Here, for example, it is assumed that the three-dimensional image capturing and displaying device 201 captures an image of the object 220, and the three-dimensional image capturing and displaying device 202 captures the object 230. The three-dimensional imaging and display device 201 performs signal processing on an output signal of the CCD 15 to generate a video signal. This video signal is transmitted to a three-dimensional image capturing and displaying device 202 via a signal transmission path 203.
Is transmitted to Then, the three-dimensional image capturing and displaying device 202
, Two-dimensional image information is formed by the LCD 21 based on the transmitted video signal, and the two-dimensional image information is projected by the deflection plate 11 in the selected direction. Thereby, the three-dimensional image 221 of the object 220 is displayed by the three-dimensional image capturing and displaying device 202.

Similarly, the three-dimensional image capturing and displaying device 202
Performs signal processing on an output signal of the CCD 15 to generate a video signal. This video signal is transmitted to the three-dimensional image capturing and displaying device 201 via the signal transmission path 203. And
In the three-dimensional image capturing and displaying device 201, two-dimensional image information is formed by the LCD 21 based on the transmitted video signal, and the two-dimensional image information is projected by the deflecting plate 11 in the direction selected. Thereby, the three-dimensional image 2 of the object 230 is
31 is displayed.

When the objects 220 and 230 are both humans, a person on the three-dimensional image capturing and displaying device 201 side can observe a three-dimensional image of a person on the three-dimensional image capturing and displaying device 202 side. The person on the side of the three-dimensional image capturing and displaying device 202 can observe a three-dimensional image of the person on the side of the three-dimensional image capturing and displaying device 201.

Therefore, according to the video conference system of the present embodiment, the video conference can be performed while watching the three-dimensional image of the other party's face up close, and the video conference with a sense of reality can be performed. In addition, according to this system, the light incident portion for capturing a three-dimensional image and the light emitting portion for displaying the three-dimensional image are shared, so that the three-dimensional image of the other party's face can be displayed in front. Will be displayed. Therefore, it is possible to talk while looking at the other party's eyes, and a more realistic TV conference can be held.

The three-dimensional image capturing and displaying apparatus according to the present embodiment is installed at three or more places and connected to each other via a signal transmission path. By switching and displaying or synthesizing and displaying video signals sent from the image capturing and displaying device, it is possible to hold a video conference between three or more locations.

Other configurations, operations and effects of the present embodiment are the same as those of the first embodiment.

The present invention is not limited to the above embodiments, and various changes can be made. For example, a means for capturing a two-dimensional image in a three-dimensional image capturing apparatus includes a CCD.
Other image sensors other than the above may be used. Means for displaying a two-dimensional image on the three-dimensional image display device includes LC
A display element other than D may be used.

The means for changing the direction of the incident light in the three-dimensional image photographing apparatus and the direction of the outgoing light in the three-dimensional image display apparatus are not limited to the means used in each of the above-described embodiments. A prism, a rotating mirror, or the like may be used.

[0120]

As described above, according to the three-dimensional image photographing apparatus or the three-dimensional image photographing method of the present invention, the photographing direction setting means is controlled so that the photographing can be performed for each of the settable photographing directions. 2 of lower resolution than the resolution of the means
While obtaining the two-dimensional image information and changing the pixels to which each imaging direction is assigned, the process of obtaining the low-resolution two-dimensional image information is repeatedly executed, and the resolution of the imaging means and the resolution of the imaging means are set for all settable imaging directions. 2 of the same resolution
Since the three-dimensional image information is obtained, it is possible to display a three-dimensional moving image that can withstand observation in terms of the image update cycle and resolution, and has an effect that a true three-dimensional moving image display can be realized with a simple configuration. .

Further, according to the three-dimensional image display device or the three-dimensional image display method of the present invention, the projection direction setting means is controlled so that each of the settable projection directions is
Projecting low-resolution two-dimensional image information by projecting two-dimensional image information having a lower resolution than that of the projection means, and displaying a low-resolution three-dimensional image while changing pixels to which each projection direction is assigned. Since the processing is repeatedly executed to display a three-dimensional image having the same resolution as that of the projection means, it becomes possible to display a three-dimensional moving image that can withstand observation in terms of the image update cycle and resolution. Thus, there is an effect that stereoscopic moving image display can be realized with a simple configuration.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram illustrating a schematic configuration of a three-dimensional image photographing apparatus according to a base technology of an embodiment of the present invention.

FIG. 2 is an explanatory diagram illustrating a schematic configuration of a three-dimensional image display device according to the base technology of the embodiment of the present invention.

FIG. 3 is an explanatory diagram for explaining a positional relationship between a three-dimensional image photographing device and a three-dimensional image display device according to the base technology of the embodiment of the present invention.

FIG. 4 is an explanatory diagram for explaining a positional relationship between a three-dimensional image photographing device and a three-dimensional image display device according to the base technology of the embodiment of the present invention.

FIG. 5 is a block diagram illustrating a configuration of a three-dimensional image capturing apparatus according to the first embodiment of the present invention.

FIG. 6 is an explanatory diagram showing a correspondence relationship between an angle of incident light selected by a deflection plate in FIG. 5 and an image captured by a CCD.

FIG. 7 is an explanatory diagram showing a configuration of a liquid crystal element used for the deflection plate in FIG.

FIG. 8 is an explanatory diagram showing a configuration of a deflection plate in FIG. 5;

FIG. 9 is an explanatory diagram for explaining the operation of the deflection plate shown in FIG. 8;

FIG. 10 is an explanatory diagram for explaining an operation of the deflection plate shown in FIG. 8;

FIG. 11 is a block diagram illustrating a configuration of a three-dimensional image display device according to the first embodiment of the present invention.

12 is an explanatory diagram showing a correspondence relationship between a two-dimensional image formed by the LCD in FIG. 11 and angles of light emitted from a deflecting plate.

FIG. 13 is a perspective view showing a condenser lens, a deflection plate, and a diffusion plate in FIG.

FIG. 14 is an explanatory diagram for explaining the operation of the deflection plate in FIG. 11;

FIG. 15 is an explanatory diagram for explaining the operation of the deflection plate in FIG. 11;

FIG. 16 is an explanatory diagram for describing a principle of a display position conversion process according to the base technology of the embodiment of the present invention.

FIG. 17 is a block diagram showing an example of a configuration of a display position conversion circuit in FIGS. 5 and 11;

FIG. 18 is an explanatory diagram illustrating an example of a method of capturing a three-dimensional image according to the base technology of the embodiment of the present invention.

FIG. 19 is an explanatory diagram illustrating an example of a method of displaying a three-dimensional image according to the base technology of the embodiment of the present invention.

FIG. 20 is an explanatory diagram showing a format representing a shooting direction and a projection direction for each pixel according to the first embodiment of the present invention.

FIG. 21 is an explanatory diagram showing a format representing a shooting direction and a projection direction for each pixel according to the first embodiment of the present invention.

FIG. 22 is an explanatory diagram showing a format representing a shooting direction and a projection direction for each pixel according to the first embodiment of the present invention.

FIG. 23 is an explanatory diagram showing a format representing a shooting direction and a projection direction for each pixel according to the first embodiment of the present invention.

FIG. 24 is an explanatory diagram showing a format representing a shooting direction and a projection direction for each pixel according to the first embodiment of the present invention.

FIG. 25 is an explanatory diagram showing a format representing a shooting direction and a projection direction for each pixel according to the first embodiment of the present invention.

FIG. 26 is an explanatory diagram illustrating a configuration of a video conference system according to a second embodiment of the present invention.

[Explanation of symbols]

11: polarizing plate, 12: condenser lens, 13: pinhole member, 14: condenser lens, 15: CCD, 21: LCD,
Reference numeral 22: condenser lens, 23: pinhole member, 24: condenser lens, 25: polarizing plate, 31: CCD drive circuit, 33:
Display position conversion circuit, 36: deflection plate drive circuit, 37: angle pattern generation circuit, 38: timing control circuit, 53 ...
Display position conversion circuit, 55: LCD drive circuit, 56: deflection plate drive circuit, 57: angle pattern generation circuit, 58: timing control circuit.

Claims (14)

[Claims] 1. A three-dimensional image photographing apparatus for obtaining image information necessary for displaying a three-dimensional image of an object in a space, wherein the photographing of the object is performed to generate two-dimensional image information of the object. Means, a photographing direction setting means capable of setting a different photographing direction for each pixel of two-dimensional image information with respect to the photographing means, controlling the photographing direction setting means, and for all photographable directions which can be set, In each case, two-dimensional image information having a lower resolution than the resolution of the photographing means is obtained, and the low resolution 2D image information is obtained while changing the pixel to which each photographing direction is assigned.
And a photographing control unit for repeatedly executing a process of generating two-dimensional image information to obtain two-dimensional image information having the same resolution as that of the photographing unit for all settable photographing directions. Three-dimensional image capturing device. 2. The imaging control means divides a two-dimensional image area into a plurality of small areas each including A pixels (A is an integer of 2 or more), and sets all settable imaging directions, One pixel in the small area is set to obtain low-resolution two-dimensional image information whose resolution is 1 / A of the resolution of the photographing means, and a pixel to which each photographing direction is assigned is set to the small pixel. 2. The processing for generating the low-resolution two-dimensional image information is repeated A times while changing within a region to obtain two-dimensional image information having the same resolution as the resolution of the photographing unit. Three-dimensional image capturing device. 3. The photographing control means divides all settable photographing directions into A photographing directions, and
3. The low-resolution two-dimensional image information is obtained for all settable shooting directions by repeatedly executing a process of obtaining low-resolution two-dimensional image information for each of the shooting directions. Three-dimensional image capturing device. 4. The apparatus according to claim 1, wherein the photographing direction setting means includes a deflecting means disposed between the object and the photographing means, for deflecting the light by selecting a direction of incident light. 3. The three-dimensional image photographing apparatus according to any one of claims 3 to 3. 5. A photographing means for photographing an object to generate two-dimensional image information of the object, and a photographing direction setting means capable of setting a different photographing direction for each pixel of the two-dimensional image information for the photographing means. A three-dimensional image capturing method for obtaining image information necessary for displaying a three-dimensional image of an object in space using For each direction, a first procedure for obtaining two-dimensional image information having a resolution lower than the resolution of the photographing unit, and the first procedure are repeatedly executed while changing the pixels to which each photographing direction is assigned, and the setting is performed. A second procedure for obtaining two-dimensional image information having the same resolution as the resolution of the photographing means for each of all possible photographing directions. 6. The first procedure is to divide a region of a two-dimensional image into a plurality of small regions each including A pixels (A is an integer of 2 or more), and to set all settable photographing directions. Setting for one pixel in the small area to obtain low-resolution two-dimensional image information whose resolution is 1 / A of the resolution of the photographing means. The first procedure is repeated A times while changing the pixel to which the direction is assigned in the small area, and the second procedure having the same resolution as that of the photographing means is performed.
6. The method according to claim 5, wherein two-dimensional image information is obtained.
Dimensional imaging method. 7. The first procedure is a process of dividing all settable photographing directions into A photographing directions and obtaining low-resolution two-dimensional image information for the A photographing directions. 7. The method according to claim 6, wherein low-resolution two-dimensional image information is obtained for all settable photographing directions by repeatedly executing the method. 8. A three-dimensional image display device for displaying a three-dimensional image of an object in space by projecting a plurality of two-dimensional image information of the same object having different observation directions in directions corresponding to the observation directions. Controlling projection means for projecting two-dimensional image information of the object, projection direction setting means capable of setting a different projection direction for each pixel of the two-dimensional image information with respect to the projection means, and controlling the projection direction setting means Then, for all settable projection directions, two-dimensional image information having a lower resolution than the resolution of the projection unit is projected, and the three-dimensional image information having a lower resolution is projected.
The process of projecting the low-resolution two-dimensional image information is repeatedly executed while changing the pixel to which each projection direction is assigned, while displaying a three-dimensional image, and displaying a three-dimensional image having the same resolution as that of the projection means. A three-dimensional image display device comprising: 9. The display control means divides the area of the two-dimensional image into a plurality of small areas each including A pixels (A is an integer of 2 or more), and sets all settable projection directions to: A low-resolution three-dimensional image is displayed by setting one pixel in the small area and projecting low-resolution two-dimensional image information whose resolution is 1 / A of the resolution of the projection means. In addition, the process of projecting the low-resolution two-dimensional image information is repeatedly executed A times while changing the pixel to which each projection direction is assigned in the small area, and a three-dimensional image having the same resolution as the resolution of the projection means is executed. The three-dimensional image display device according to claim 8, wherein is displayed. 10. The display control means divides all settable projection directions into A projection directions each,
The method of projecting low-resolution two-dimensional image information for all settable projection directions by repeatedly executing a process of projecting low-resolution two-dimensional image information for A projection directions. 9. The three-dimensional image display device according to 9. 11. The method according to claim 8, wherein the projection direction setting means includes a deflecting means for selecting a direction of the emitted light and deflecting the light.
Dimensional image display device. 12. The same projecting means for projecting two-dimensional image information of an object, and a projecting direction setting means capable of setting a different projecting direction for each pixel of the two-dimensional image information for the projecting means. Displaying a three-dimensional image of an object in space by projecting a plurality of two-dimensional image information items having different observation directions with respect to the object in directions respectively corresponding to the observation directions.
A two-dimensional image display method, wherein the projection direction setting means is controlled to project two-dimensional image information having a resolution lower than the resolution of the projection means, for all settable projection directions, respectively. 3
A first procedure for displaying a three-dimensional image, and a second procedure for displaying a three-dimensional image having the same resolution as that of the projection means by repeatedly executing the first procedure while changing the pixels to which each projection direction is assigned. A three-dimensional image display method. 13. The first procedure divides a two-dimensional image region into a plurality of small regions each including A pixels (A is an integer of 2 or more), and sets all settable projection directions. , A low-resolution three-dimensional image is displayed by setting low-resolution two-dimensional image information in which the resolution is set to 1 / A of the resolution of the projection means by setting for one pixel in the small area. The second step is to repeatedly execute the process of projecting the low-resolution two-dimensional image information A times while changing the pixels to which each projection direction is assigned within the small area, and to execute the resolution of the projection unit. 13. The three-dimensional image display method according to claim 12, wherein a three-dimensional image having the same resolution is displayed. 14. The first procedure is to divide all settable projection directions into A projection directions each,
14. The low-resolution two-dimensional image information is projected for all settable projection directions by repeatedly executing a process of projecting the low-resolution two-dimensional image information for the plurality of projection directions. The three-dimensional image display method described in the above.