JPH08205200A - Three-dimensional image pickup device - Google Patents

Abstract

PURPOSE: To provide the three-dimensional image pickup device which can easily obtain a three-dimensional image in such a state that it is almost similar to one visible to the naked eye when an image is picked up by the three- dimensional image pickup device and is made smaller in size. CONSTITUTION: The three-dimensional image pickup device which obtains the three-dimensional image by utilizing the parallax between both the eyes is equipped with image pickup element 2L and 2R for obtaining right and left independent images and an image pickup element position changing means which changes respective image areas for the right and left eyes; and the positions of the image pickup elements 2L and 2R are changed by controlling segmentation areas of the image pickup elements 2L and 2R and the positions of the image pickup elements 2L and 2R are also changed according to variation in convergence vision.

Description

Detailed Description of the Invention

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to a stereoscopic image pickup device, and more particularly to a stereoscopic image pickup device for obtaining a stereoscopic image by utilizing binocular parallax.

[0002]

2. Description of the Related Art In recent years, in order to obtain a stereoscopic image, two optical systems of image pickup devices (cameras) are arranged side by side, and the images picked up by the respective image pickup devices are made independent to the left and right eyes. Various proposals have been made for a stereoscopic imaging device and a stereoscopic video reproducing device that are adapted to reproduce, that is, a so-called stereoscopic image is obtained by utilizing binocular parallax.

The stereoscopic image reproducing device reproduces the left and right images picked up by the stereoscopic image pickup device independently for the left and right eyes.
For example, Head Mounted Display (Head M
ounted Display; hereinafter referred to as HMD. ), A liquid crystal shutter spectacle system, or a polarized spectacle system. Then, the stereoscopic image can be observed by reproducing the image captured by the stereoscopic image capturing device by the stereoscopic image reproducing device.

Here, the appearance of the stereoscopic image reproduced by the stereoscopic image reproducing device changes depending on the image capturing state of the stereoscopic image capturing device, the reproduction state of the stereoscopic image reproducing device, and the like.

Therefore, in order to obtain a good stereoscopic image,
The angle formed by the optical axis intersections of the optical system of the stereoscopic imaging device matches the vergence angle of the eye when the observer directly sees it with the naked eye (binocular vergence), and is reproduced by the stereoscopic image reproducing device. It is necessary to set such that the position where the stereoscopic image is formed, that is, the virtual image position is formed at the same position as the actual distance to the object (focal position of the observer's eye).

In other words, a good stereoscopic image means that the stereoscopic image reproduced by the stereoscopic image reproducing apparatus is the same image as when the observer directly sees it with the naked eye, that is, in a state close to the naked eye. When it is set to be played.

Therefore, when a stereoscopic image is picked up by the stereoscopic image pickup device, the main factors for obtaining a good stereoscopic image are the distance to the optical axis intersection of the optical system of the stereoscopic image pickup device, the base line length, and the like. Settings can be given.

Therefore, in order to obtain a good stereoscopic image, for example, JP-A-63-153987 and JP-A-64-
Japanese Patent No. 11254 discloses a means for changing the angle formed by the optical axis intersections of the optical system of the stereoscopic imaging device.

The stereoscopic image taking optical device disclosed in Japanese Patent Laid-Open No. 63-153987 mentioned above fixes one of the optical systems of two image pickup devices provided for obtaining a stereoscopic image. Then, the other optical system is rotationally driven to change the angle formed by the optical axis intersection points of the optical system of the image pickup device to perform image pickup, which causes the fatigue of the eyes of the observer during reproduction of the stereoscopic image. And so on.

The stereoscopic image pickup device disclosed in the above-mentioned Japanese Patent Laid-Open No. 64-11254 is used when the angle between the optical axis intersections of the optical systems of the two image pickup devices is changed.
The optical system of the image pickup device of the stand is driven to rotate at the same time and evenly so as to perform image pickup, thereby reducing discomfort, fatigue and the like of the eyes of the observer during reproduction of the stereoscopic image.

[0011]

However, the above-mentioned JP-A-63-153987 and JP-A-64-11.
According to the means disclosed in Japanese Laid-Open Patent Publication No. 254, the optical axis of the optical system of the stereoscopic image pickup device is rotated, so that space efficiency deteriorates in the range in which the optical system of the image pickup device rotates. At the same time, there is a problem that the stereoscopic imaging device itself becomes large.

Further, since the amount of rotation for rotating the optical system of the image pickup apparatus is very small, there is a problem that the driving mechanism becomes complicated and it becomes difficult to obtain its accuracy.

An object of the present invention is to solve the above-mentioned problems of the prior art, and more easily obtain a stereoscopic image close to the naked eye when an image is captured by a stereoscopic image pickup device, and further downsize. A stereoscopic imaging device is provided.

[0014]

According to the stereoscopic image pickup device of the present invention, in a stereoscopic image pickup device for obtaining a stereoscopic image by utilizing binocular parallax, an image pickup element for obtaining left and right independent images and a left image pickup device are provided. The image pickup device position changing means for changing each image area for the eye and the right eye is provided, and the position of the image pickup device is changed by controlling the cutout area of the image pickup device. And

Then, the position of the image pickup device is changed according to the change of vergence vision.

[0016]

DESCRIPTION OF THE PREFERRED EMBODIMENTS The present invention will be described below with reference to the illustrated embodiments. FIG. 1 is a diagram showing an outline of a system using a stereoscopic imaging device and a stereoscopic video reproducing device according to a first embodiment of the present invention. Although the first embodiment is an example of a system in which a stereoscopic image pickup device and a stereoscopic image reproduction device are used to perform remote control of the device and the like, the stereoscopic image pickup device and the stereoscopic image reproduction device can be replaced by other systems. May be applied for, for example, general stereoscopic image pickup and viewing.

As shown in FIG. 1, in the first embodiment, the stereoscopic image pickup device 11 is arranged on a device for remote control, for example, on a machine for civil engineering work. The stereoscopic image pickup device 11 includes a left and right camera unit having two lens units arranged so that the optical axes of its optical system are arranged substantially parallel to each other, an image processing circuit unit, a camera operation circuit unit, and the like. It is configured by the transmitter unit 12 and the like.

On the other hand, on the operator side of the device for remote control, a transmitter unit 13 including a video receiving unit, an operation command transmitting unit, etc., a control panel 15 for operating the entire system, and a stereoscopic video reproducing device. The HMD 14 and the like are provided.

Then, the stereoscopic image obtained by the stereoscopic image pickup device 11 is processed in the image processing circuit unit or the like in the transmitter unit 12 to the image receiving unit of the transmitter unit 13 on the operator side. For example, a signal transmitted by wireless means or the like and received by the video receiving unit of the transmitter unit 13 on the operator side is sent to the HMD 14 connected to the transmitter unit 13 by, for example, a cable or the like. It has become.

By reproducing the left and right eyes independently by the HMD 14, a stereoscopic image can be obtained by utilizing the binocular parallax, and an operator such as a device for performing the remote operation described above. While watching the stereoscopic image reproduced by the HMD 14, the operation panel 15
By operating the device or the like and the stereoscopic imaging device 1 described above.
It is designed to be used for remote control of the first class.

FIG. 2 is a cross-sectional view showing the outline of the stereoscopic image pickup apparatus according to the first embodiment of the present invention.

As shown in FIG. 2, the stereoscopic image pickup device 11
Are composed of a right-eye camera unit 11R and a left-eye camera unit 11L, respectively, and are configured by exactly the same optical system.

The right-eye camera section 11R has a right-eye lens section 1R, and the left-eye camera section 11L.
Has a left-eye lens unit 1L.

The right-eye lens unit 1R and the left-eye lens unit 1L are set to be parallel to each other at regular intervals and to have the same height.

The right-eye lens unit 1R and the left-eye lens unit 1L include first group lenses 3R and 3L, second group lenses (zoom units) 4R and 4L, iris sections 5R and 5L, third group lenses 6R and 6L, 4 group lens (focus section) 7R, 7L,
Filter (low-pass filter, infrared cut filter)
It is composed of 8R, 8L and the like.

At the image forming positions behind the right-eye lens unit 1R and the left-eye lens unit 1L, the right-eye image pickup device 2R and the left-eye image pickup device 2L, which are, for example, CCDs, are respectively provided. The image pickup devices 2R and 2L are arranged so that their optical axes coincide with the center positions of the image pickup devices 2R and 2L, respectively, and their configurations are similar to those of a general video movie or the like.

However, since it is unlikely that the cutout area is shifted inward, the image pickup elements 2R and 2L may be arranged so that the center positions of the image pickup elements are shifted outward by a predetermined amount with respect to the optical axis. As a result, even if the horizontal dimension of the image sensor is small, it is possible to perform a shift correction (correction amount δ) process described later. Further, when the dimensions of the image sensor are the same as those shown in FIG. 3, which will be described later, the control range of the convergence angle can be widened.

The right-eye camera section 11R and the left-eye camera section 11L are electrically connected to the video processing circuit section and the like in the transmitter section 12 by, for example, cables.

As described above, since the camera units 11R and 11L are set to be parallel to each other, so-called parallel viewing can be performed.

The right-eye and left-eye image pickup devices 2R and 2L shown in FIG. 3 to be described later are generally NTSC (Nat
It is possible to secure a wider imaging range (area) in the horizontal direction than the imaging range (area) of the ional television system committee system.

By the way, when image pickup is performed in a state where the left-eye camera unit 11L and the right-eye camera unit 11R of the stereoscopic image pickup device 11 are arranged in parallel, the distance to the target object Depending on the distance, the state of the object imaged on each of the left-eye and right-eye image pickup devices 2L and 2R changes.

3 and 4 show the left-eye camera unit 11L and the right-eye camera unit 11R of the stereoscopic image pickup device 11 when the image pickup is performed in a state in which the left-eye camera unit 11L and the right-eye camera unit 11R are arranged in parallel. FIG. 3 is a diagram showing a state of an object formed on each of the image pickup devices 2L and 2R for the right eye, and FIG.
FIG. 4 shows the case of so-called parallel vision, and FIG. 4 shows the case of so-called vergence.

As shown in FIG. 3, when parallel viewing is performed, the object imaged by the left-eye camera unit 11L and the right-eye camera unit 11R of the stereoscopic image pickup device 11 is at a relatively long distance. This is the case.

In this case, the image of the object to be gazed enters from the center of the optical axis of the optical system of each of the camera sections 11L and 11R, and the image pickup elements 2L for the left eye and the right eye. , 2R effective imaging range (area) BL, B
Since the image is formed substantially at the center position of R, a stereoscopic image close to the naked eye can be obtained, but as shown in FIG. 4, the left-eye camera unit 11L and the right-eye camera unit of the stereoscopic imaging device 11 are obtained. When the object imaged by 11R is at a relatively short distance, vergence vision is performed.

In this case, the image of the object formed on each of the left-eye and right-eye image pickup devices 2L and 2R is incident on the optical system of each of the camera units 11L and 11R and then, An image is formed at a position deviated by a certain amount from the center position of each of the left-eye and right-eye image pickup elements 2L and 2R.

Therefore, in order to obtain a good stereoscopic image close to the naked eye, the deviation amount from the center position of the image of the object formed on each of the image pickup devices 2L and 2R is corrected, and Effective image pickup area (area) B of each image pickup element 2L, 2R
It suffices to form an image of the object at the approximate center position of L and BR.

The deviation correction amount δ (mm; CCD movement amount) at this time is the focal length f of the optical system of the stereoscopic image pickup device 11.
(Mm) and the baseline length a (mm) of the stereoscopic imaging device,
It can be calculated by the following equation (1) according to the relationship with the gazing point distance L (mm; distance to the object). That is, δ = (a / 2) · (f / L) (1) Here, for example, a stereoscopic imaging device for a general video movie or the like, that is, a base line length a = 70 mm of the stereoscopic imaging device, When the focal length f of the optical system of the imaging device is 5 to 50 mm and the gazing point distance (distance to the object) L is 5 m, the deviation correction amount δ (mm) is as shown in Table 1. .

[0038]

[Table 1] According to the equation (1), the shift correction amount δ has a smaller value as the gazing point distance L, that is, the distance to the target object is larger (larger), and the base line length a of the stereoscopic imaging device, that is, , The larger the distance between the left-eye camera unit and the right-eye camera unit, the larger the deviation correction amount δ tends to be.
Since the amount of correction is small in both cases, it is possible to sufficiently correct the amount of deviation by processing the imaging range (area) on each of the left-eye and right-eye image sensors 2L and 2R. Is.

Therefore, in the stereoscopic image pickup device 11 of the present embodiment, as shown in FIGS. 3 and 4, within the image pickup range (area) A of the left-eye and right-eye image pickup elements 2L, 2R. As the effective image pickup range (area), the effective image pickup range (area) BL in the left eye image pickup device 2L and the effective image pickup range (area) BR in the right eye image pickup device 2R are cut out. Is what you are doing.

On the other hand, in order to detect the change of the vergence, the HMD 14 which is a stereoscopic image reproducing device is provided with a visual axis detecting system. With this line-of-sight detection system, it is possible to detect which point in the image being reproduced the viewer is gazing when reproducing the stereoscopic image on the HMD 14.

FIG. 5 is a cross-sectional view showing an outline of the HMD 14 which is the stereoscopic image reproducing apparatus of the first embodiment.

As shown in FIG. 5, inside the HMD 14 which is a stereoscopic image reproducing device, the display unit 2 including an LCD or the like is provided.
1 and an eyepiece lens 22 which is an optical system of the HMD 14.
An objective lens 23, an infrared light emitting diode 24, a dichroic mirror 27, a condenser lens 25, and a line-of-sight detection C
A line-of-sight detection system and the like including the CD 26 and the like are provided, respectively.

The line-of-sight detection system is based on the HMD 14
This is to detect the direction of the line of sight of an observer who observes the reproduced video. That is, by causing the infrared light emitting diode 24 to emit infrared light or the like to the observer's pupil,
After this infrared light is reflected by the observer's pupil and then reflected by the dichroic mirror 27, its optical path is bent downward, and through the condenser lens 25 disposed below the HMD 14, The light is focused on the line-of-sight detection CCD 26. Thereby, the line-of-sight detection CC
The direction of the line of sight of the observer can be detected by the position of the infrared light focused on D26.

The line-of-sight detection system is based on the HM
Since it suffices to be able to detect the line of sight of at least one of the left eye and the right eye of the observer observing the reproduced image of D14, it suffices if the line of sight is provided on at least one display unit side of the HMD14. You may make it arrange | position in both the display part for eyes and the right eye.

Further, not limited to the above-mentioned line-of-sight detection system,
The same applies even if another system for detecting the line-of-sight direction of the observer is applied.

The above-mentioned stereoscopic image pickup device 1 configured as described above.
An outline of the operation when the stereoscopic video imaged by No. 1 is reproduced by the HMD 14 which is the stereoscopic video reproduction device will be briefly described below with reference to the flowchart of FIG.

As shown in FIG. 6, first, in the process of step S1, the vergence is changed, that is, which object in the image reproduced by the observer is gazing. Is detected.

That is, the line-of-sight detection system in the HMD 14 detects the line-of-sight direction, and at the same time, the distance measurement information (autofocus (AF) information, etc.) in the photographing condition data at the time of image pickup by the stereoscopic image pickup device 11 is performed. The distance information to the object is detected.

Next, in the processing of step S2, the sight line detection information detected in step S1 described above,
On the basis of the distance information and the like, the calculation means such as the CPU in the HMD 14 calculates the shift correction amount δ (CCD movement amount) of the left-eye and right-eye image pickup devices 2L and 2R. The same is true if the above calculation is performed based on the subject distance information obtained during AF without using the line-of-sight detection information, and in this case, the processing speed becomes faster.

Then, in the processing of step S3, by the CCD image pickup area control unit or the like which is the image pickup element position changing means, the shift correction processing on the image pickup elements 2L and 2R, that is, each image for the left eye and the image for the right eye. The area is changed (control of the cutout area).

The left-eye and right-eye image pickup elements 2 are provided.
The shift correction amounts δ of L and 2R are the same. That is, the change (cutout area) of each of the left-eye and right-eye image areas is performed within the same range.

At this time, control of the effective image pickup range (area) on each of the left-eye and right-eye image pickup elements 2L and 2R,
That is, when setting the control of the cutout area, the gazing point of the observer, that is, the distance to the target object, or by setting a little behind the distance to the target object, a state close to the naked eye. It has become possible to obtain good stereoscopic images. That is, in the case of such a setting, the eyes of the left and right eyes of the observer tend to be parallel or slightly crossed, so that they are in a state close to macroscopic vision, and a good stereoscopic image can be obtained.

As described above, according to the first embodiment, the imaging range (area) of the left-eye image pickup element 2L and the right-eye image pickup element 2R of the stereoscopic image pickup apparatus 11 is set to the general NTSC system. Even in the case of vergence vision, stereoscopic video reproduction is possible even in the case of vergence vision by securing a wider area in the horizontal direction than the one and changing each image area for the left eye and the right eye by the image sensor position changing means. It is possible to observe a stereoscopic image reproduced on the device. Therefore, it is possible to reduce a feeling of discomfort, fatigue, and the like that occur when observing a stereoscopic image.

Further, by controlling the cut-out area of the image pickup device in accordance with the change of vergence, the center of the image light beam of the stereoscopic image pickup device 11 and the image pickup devices 2L and 2R for the left and right eyes are detected. Since it is possible to match the center positions, it is possible to change the angle formed by the optical axis intersection points by driving the left-eye and right-eye camera units 11L and 11R of the stereoscopic imaging device 11. The same effect can be obtained more easily.

Therefore, since a drive mechanism for driving the left-eye and right-eye camera units 11L and 11R of the stereoscopic image pickup device 11 is not required, good space efficiency is obtained and the stereoscopic image pickup device itself is provided. It can contribute to miniaturization.

Further, when the stereoscopic image pickup device 11 is assembled, the amount of deviation between the optical axes of the optical systems of the camera parts 11L and 11R and the center positions of the image pickup devices 2L and 2R is picked up by a CPU or the like. CCD as a device position changing means
By pre-storing it in the imaging area control unit or the like, it is possible to simplify adjustment of the deviation amount that occurs during manufacturing.

It should be noted that a driving mechanism may be provided to move the image pickup devices 2L and 2R relatively in parallel with the optical axis of the optical system of the stereoscopic image pickup device 11.
It is possible to obtain exactly the same effect.

FIG. 7 is a diagram showing a stereoscopic image pickup apparatus according to the second embodiment of the present invention, in which the left-eye camera section 11L and the right-eye camera section 11R of the stereoscopic image pickup apparatus 11 are arranged in parallel. FIG. 7 is a diagram showing a state of an object formed on each of the left-eye and right-eye image pickup elements 2L and 2R when image pickup is performed in a state in which the object is formed. The configuration of the second embodiment is basically the same as that of the above-described first embodiment, and therefore detailed description thereof will not be repeated.

Further, in the above-described first embodiment, the image pickup devices 2L and 2R for both the left and right eyes are
The cutout area is controlled. In the second embodiment, the image pickup elements 2L,
The difference is that the cutout area is controlled for only one of the 2R image pickup elements.

That is, as shown in FIG. 7, for example, the left-eye image pickup device 2L is fixed, and the cut-out area of the right-eye image pickup device 2R, that is, the effective image pickup range (area) BR is controlled. It was done.

Therefore, the deviation correction amount δ of the cutout area of the image pickup device on the control side is twice as large as that in the case of controlling both of the image pickup devices 2L and 2R described in the first embodiment. Is the correction amount.

Also in the second embodiment, as in the case of the first embodiment shown in FIG. 3, the image pickup device 2 is arranged so that the center position of each image pickup device coincides with the optical axis.
Although R and 2L are arranged, the center position of the image sensor 2R may be arranged so as to be shifted outward by a predetermined amount with respect to the optical axis. The effect of arranging in this way is
This is exactly the same as that described in the first embodiment.

As described above, according to the second embodiment, one of the left-eye and right-eye image pickup elements 2L and 2R is placed in the horizontal direction more than the general NTSC type. Since a wide area is ensured and the cutout area is controlled, the same effect as that of the first embodiment can be obtained.

Further, as the other one of the image pickup elements on the non-control side, an image pickup element having a normal image pickup range (area), that is, an image pickup element of a general NTSC system or the like can be applied. It can contribute to the reduction of manufacturing cost.

FIG. 8 is a cross-sectional view of a main part showing an outline of a stereoscopic image pickup apparatus according to the third embodiment of the present invention. Note that, in FIG. 8, in order to avoid complication of the drawing, only a portion directly related to the present invention is simply shown.

Further, the stereoscopic image pickup apparatus of the third embodiment is
As shown in FIG. 8, a so-called one lens 1CC including one optical system 33 and one image sensor 2a.
This is a D-type stereoscopic imaging device.

That is, the image on the right eye side of the object is polarized by the first polarizing filter 31R for the right eye, reflected by the total reflection mirror 32 at an angle of 90 degrees, and further split by the splitter 33 by an angle of 90 degrees. The light is reflected to form an image on the image pickup device 2a such as a CCD through the optical system 34 of the stereoscopic image pickup device and the second polarizing filter 35R for the right eye.

On the other hand, the image on the left eye side of the object is polarized by the first polarizing filter 31L for the left eye, passes through the splitter 33 provided behind it, and passes through the optical system of the stereoscopic image pickup apparatus. 34 and the second polarization filter 35L for the left eye to form an image on the image pickup device 2a.

Further, the first polarizing filter 31L for the left eye and the first polarizing filter 31R for the right eye, which are provided on the front side, have different characteristics from each other, and The optical system 34 and the image pickup device 2a
The second polarizing filter 35L for the left eye and the second polarizing filter 35R for the right eye, which are arranged between
Each has different characteristics.

The first polarizing filter 3 for the left eye
The 1L and the second polarization filter 35L, and the first polarization filter 31R and the second polarization filter 35R for the right eye have the same characteristics, respectively.

On the other hand, the optical system 34 and the image pickup device 2a
The second polarizing filter 35L for the left eye and the second polarizing filter 35R for the right eye, which are arranged between the second polarizing filter 35L and the second polarizing filter 35R, are arranged in parallel.
L and 35R are directions orthogonal to the optical axis of the optical system 34,
That is, by moving integrally in the direction of the arrow Y in FIG. 8, the image formed on the image pickup device 2a is switched between the left eye and the right eye.

The second polarization filters 35L, 35L, 3 described above are provided.
As described above, the 5R drive mechanism may be integrally moved in the direction (Y direction) orthogonal to the optical axis of the optical system 34. Therefore, a general drive mechanism is applied, and its detailed description and illustration are omitted in particular.

With such a structure, in the third embodiment, the image pickup device 2a picks up images for the left eye and the right eye by time division.

That is, in the case of picking up an image for the right eye, the second polarizing filter 35R is moved to the optical axis of the optical system 34, passes through the first polarizing filter 31R for the right eye, and The image reflected on the total reflection mirror 32, reflected by the splitter 33, incident on the optical system 34, transmitted through the second polarizing filter 35R for the right eye, and imaged on the image sensor 2a is displayed on the right. It is designed to be captured as an eye image.

In the case of picking up an image for the left eye,
The second polarization filter 35L for the left eye is moved onto the optical axis of the optical system 34, and the first polarization filter 31L for the left eye is moved.
Through the splitter 33, enters the optical system 34, passes through the second polarizing filter 35L for the left eye, and forms an image on the image sensor 2a. It is designed to be captured as a video.

In this way, when the left and right images are alternately captured in a time division manner and are reproduced by the stereoscopic image reproducing device or the like, the left and right images are reproduced independently for the left and right eyes.

Then, in accordance with the timing of capturing the image for the left eye and the image for the right eye by the image pickup device 2a,
When capturing the image for the left eye, the cutout area of the image sensor 2a is moved to the left side, that is, in the direction of the arrow XL in FIG. 8, and when capturing the image for the right eye, the image sensor 2a is moved. The shift correction amount δ is adjusted by moving the cutout area on the right side, that is, in the arrow XR direction in FIG.

As described above, according to the third embodiment, even in the one-lens / one-CCD stereoscopic image pickup apparatus,
By controlling the cut-out area of the image pickup device 2a, exactly the same as in the case where the conventional stereoscopic image pickup device, that is, the left-eye and right-eye camera units are driven to change the angle formed by the optical axes thereof. The effect of can be obtained.

Therefore, it is possible to obtain the same effect as that of the above-described first embodiment, and since the one-lens-one-CCD system with one optical system and one image pickup element is adopted, the cost and the size can be reduced. Can contribute to.

FIG. 9 is a horizontal cross-sectional view of a main part showing an outline of a stereoscopic image pickup apparatus according to a fourth embodiment of the present invention and a view showing an image formation state on an image pickup element. Note that, in FIG. 9, in order to avoid complication of the drawing, only the portion directly related to the present invention is simply shown.

Further, the stereoscopic image pickup apparatus of the fourth embodiment is
As shown in FIG. 9, a so-called one-lens-one-CCD stereoscopic image pickup device is composed of one optical system 43 and one image pickup device 2b, as in the third embodiment.

That is, the image for the right eye is the first mirror 41.
The light is transmitted through the optical system 43 and the cylindrical lens 44 via the R and the second mirror 42R, and an image is formed on the BR portion on the image pickup device 2b including a CCD or the like. , First mirror 41L, second mirror 4
BL on the image sensor 2b formed of a CCD or the like, passing through the optical system 43 and the cylindrical lens 44 via 2L.
The image is formed on the part.

The cylindrical lens 44 is adapted to compress the image transmitted through the cylindrical lens 44 in the lateral direction, whereby the left eye on the one image pickup device 2b as shown in FIG. The image for the right eye and the image for the right eye can be formed side by side.

The image pickup device 2b has effective image pickup ranges (areas) BL and BR at the time of reproducing images for the left eye and the right eye.
It has a slightly wider imaging range (area) A in the horizontal direction than the above, and the cutout area is changed by controlling the effective imaging ranges (areas) BL and BR.

The control of the cutout area at this time may be performed by performing at least one or both of the images for the left eye and the right eye.

When the stereoscopic image picked up by the stereoscopic image pickup device is reproduced by the stereoscopic image reproducing device, the right eye image formed on the BR portion on the image pickup element 2b and the BL portion are formed. The formed images for the left eye are individually taken out, and after being subjected to image processing such as up / down / left / right inversion processing and horizontal expansion processing, they can be viewed by a playback device such as an HMD. Has become. That is, the image compressed by the cylindrical lens 44 is processed to be restored.

As described above, according to the fourth embodiment, the same effect as that of the third embodiment can be obtained.

[Supplementary Note] (1) In a stereoscopic image pickup apparatus which obtains a stereoscopic image by utilizing binocular parallax, an image pickup element for obtaining left and right independent images and change of each image area for left eye and right eye And an image pickup element position changing means for controlling the cutout area of the image pickup element.

According to this apparatus, each video area can be easily changed.

(2) The stereoscopic image pickup device according to attachment 1, wherein the amount of change in the cutout area is the same amount on the left and right.

According to this apparatus, the control of the cutout area of the image pickup device becomes simple.

[0092]

According to the first aspect of the invention, the image areas for the left eye and the right eye can be changed by the image pickup element position changing means, which contributes to downsizing of the stereoscopic image pickup apparatus. In addition, it is possible to reduce the discomfort, fatigue, and the like that occur when the stereoscopic image reproducing apparatus reproduces the stereoscopic image by obtaining the stereoscopic image in a state close to the naked eye.

According to the second aspect of the invention, the positions of the left-eye and right-eye image pickup elements are changed by controlling the cutout areas of the image pickup elements. You can make changes. This makes it possible to obtain a stereoscopic image in a state close to that of the naked eye, so that it is possible to reduce a feeling of strangeness, fatigue, and the like that occur when the stereoscopic image reproducing apparatus reproduces the stereoscopic image.

According to the third aspect of the present invention, the positions of the left-eye and right-eye image pickup elements are changed in accordance with the change in vergence, so that each image area can be changed more easily. Can be done. Therefore, it is possible to obtain a stereoscopic image in a state close to that of the naked eye, and it is possible to reduce a feeling of discomfort, a feeling of fatigue, or the like that occurs when the stereoscopic image is reproduced by the stereoscopic image reproducing device.

[Brief description of drawings]

FIG. 1 is a diagram showing an outline of a system using a stereoscopic imaging device and a stereoscopic video reproducing device according to an embodiment of the present invention.

FIG. 2 is a cross-sectional view showing the outline of the stereoscopic image pickup apparatus of FIG.

FIG. 3 is a diagram illustrating an object to be imaged on left-eye and right-eye image pickup devices in a state where left-eye and right-eye camera units of the stereoscopic image pickup apparatus of FIG. 1 are arranged in parallel. It is a figure which shows a state and is a figure which shows the case of parallel view.

4 is a diagram illustrating an object imaged on each of the left-eye and right-eye image pickup devices in a state where the left-eye and right-eye camera units of the stereoscopic image pickup apparatus of FIG. 1 are arranged in parallel. It is a figure which shows a state and is a figure which shows the case of vergence vision.

5 is a transverse cross-sectional view showing an outline of an HMD which is the stereoscopic image reproducing device of FIG.

6 is a flowchart showing an outline of an operation when a stereoscopic image captured by the stereoscopic image capturing apparatus of FIG. 1 is reproduced by an HMD which is a stereoscopic image reproducing apparatus.

FIG. 7 is a diagram showing a stereoscopic imaging device according to a second embodiment of the present invention.

FIG. 8 is a lateral cross-sectional view showing the outline of a three-dimensional image pickup apparatus according to a third embodiment of the present invention.

FIG. 9 is a cross-sectional view of a main part showing an outline of a stereoscopic image pickup apparatus according to a fourth embodiment of the present invention, and a diagram showing an image formation state on an image pickup element.

[Explanation of symbols]

 1 (L, R) ... Lens section 2L, 2R, 2a, 2b ... Imaging element 11 (L, R) ... Camera section 11 ... Stereoscopic imaging apparatus 12 ... Transmitter section (apparatus side) 13 ... Transmitter Unit (operator side) 14 ... HMD (stereoscopic image reproducing device) 15 ... Operation panel 21 ... Display unit 22 ... Eyepiece 23 ... Objective lens 24 ... Infrared light emitting diode (visual axis detection system) 25 ... … Condensing lens (line-of-sight detection system) 27 …… Dichroic mirror (line-of-sight detection system) 26 …… CCD for line-of-sight detection (line-of-sight detection system) 31 (L, R) …… first polarizing filter 32 …… total reflection mirror 33 ...... Splitter 34,43 ...... Optical system 35 (L, R) ...... Second polarization filter 41 (L, R) ...... First mirror 42 (L, R) ...... Second mirror 44 ...... Cylindrical Lens A: Imaging range (area) BL, BR: Effective imaging range (area) L: Distance to object (gazing point distance) a: Baseline length (stereoscopic imaging device side) θ: Stereoscopic imaging device Formed by the optical axis intersection point of δ ... Deviation correction amount (CCD movement amount)

 ─────────────────────────────────────────────────── ─── Continued Front Page (72) Masayoshi Imaizumi 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Co., Ltd. (72) Masaji Hankawa 2-43-2 Hatagaya, Shibuya-ku, Tokyo Olympus Optical Industry Co., Ltd.

Claims (3)

[Claims] 1. A stereoscopic image pickup apparatus for obtaining a stereoscopic image using binocular parallax, an image pickup element for obtaining left and right independent images, and an image pickup for changing each image area for the left eye and the right eye. A three-dimensional image pickup device comprising: an element position changing unit; 2. The stereoscopic image pickup apparatus according to claim 1, wherein the position of the image pickup element is changed by controlling a cutout area of the image pickup element. 3. The stereoscopic image pickup apparatus according to claim 1, wherein the position of the image pickup element is changed in accordance with a change in vergence vision.