JP2001016620A - Image pickup device, its convergence distance decision method, storage medium and optical device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide an image pickup device that automates convergence control so as to relieve a load of a photographer at photographing and to photograph a natural stereoscopic video image. SOLUTION: A viewer inputs a numeral P that is normalized by a view distance up to a display screen of a display device -from a mode changeover section operated by the viewer (S11). A parallax amount S (P) on the display screen is calculated from the numeral P and a human pupil distance IPD (S12). A convergence distance is calculated through a geometrical calculation using the obtained parallax amount S (P), a base length, a focal distance of a lens, an image side of an image pickup section (CCD), a screen size of the display screen, a detected object distance and a deviation of a position to detect the distance from an optical axis (S13). A mirror is driven until a mirror angle corresponding to the calculated convergence distance is obtained.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention relates to an imaging device for capturing left and right parallax images, a method of determining a convergence distance, a storage medium, and an optical device.

[0002]

2. Description of the Related Art In recent years, various types of stereoscopic image display devices have been proposed for displaying images taken by an image pickup device such as a video camera or an electronic still camera of this type. Conventionally, in a stereoscopic image display device in which left and right parallax images are displayed on a monitor, and an observer observes them with liquid crystal shutter glasses, the state of the left and right liquid crystals of the liquid crystal shutter glasses is synchronized with a video signal. Even if the image for the right eye and the image for the left eye are displayed alternately on the monitor, the observer always observes the image for the right eye for the right eye and the image for the left eye for the left eye. And an image with depth is observed. In other words, while the right-eye image is displayed on the monitor, the right liquid crystal is transmitted and the left liquid crystal is not transmitted, while while the left-eye image is displayed on the monitor. The liquid crystal for the right eye is non-transmitting, and the liquid crystal for the left eye is transmitting.

In recent years, head-mounted and eyeglass-type displays, so-called head-mounted displays, have been developed. In these displays, similarly, the image for the right eye is displayed on the right eye and the image for the left eye is displayed. By displaying an image selectively with the left eye, it is possible to observe a stereoscopic image with depth.

Further, by combining a liquid crystal display with a lenticular sheet having a predetermined pitch or a mask having openings and non-openings formed in a predetermined pattern, directivity is given to the light from the liquid crystal display. By matching the image pattern to be displayed on the display, the right eye can see the right eye image, the left eye can see the left eye image, and the observer can see the deep image. You.

Conventionally, these display images have been taken by a twin-lens camera having two lenses.
Was common. A camera that does not require two lenses has also been proposed (Japanese Patent Publication No. 8-27499,
Shooting device for stereoscopic television). This camera has two liquid crystal shutters, a total reflection mirror and a half mirror, and alternately captures left and right parallax images through one lens.

In a twin-lens camera, a lens that captures left and right images in a time-division manner needs to adjust the parallax of the left and right images at the time of shooting, that is, so-called convergence adjustment. It was common to be done.

[0007]

However, the above-mentioned conventional twin-lens camera shoots an image for the right eye and an image for the left eye for each lens. Differences, for example, magnification, deviation of the optical axis, color, brightness, distortion, differences in performance such as image plane tilt,
When it occurs between two lenses, when observing a stereoscopic image,
Since you may feel tired or unable to fuse, it is necessary to increase the precision of the parts to match the performance of both lenses, or if the performance is not achieved only with the precision of the parts, adjustment will be required, Furthermore, special measures such as electrical correction of the image had to be taken to absorb the difference in performance.

Further, in the case of a zoom lens, it is necessary to interlock the zooming operation of the two right and left lenses in a state in which these performances are matched at the time of zooming, so that the cost is high, the production is troublesome, and the mass productivity is reduced. It was poor.

[0009] Further, in order to observe an image photographed by a twin-lens camera, two monitors are required as they are, which is not practical. Further, when recording these two videos, it is necessary to record the two video signals in a synchronized state, and a special recording device for this is required.

In order to avoid this, it has been considered to convert two video signals into one video signal. For this purpose, a special method for alternately displaying and recording left and right parallax images is considered. Needed a converter.

Therefore, the twin-lens camera is very large and expensive because the camera itself is larger than a normal single-lens camera and the entire system requires special equipment as described above. The lack of mobility made it difficult to spread the word to the world.

On the other hand, in the camera proposed in Japanese Patent Publication No. Hei 8-27499, the optical paths of the right and left parallax images are coupled to each other by a half mirror and guided to a lens. There is a problem that the amount of light is halved when an image is incident. Further, in the configuration of this camera, the optical path lengths of the left and right parallax images are different in principle, resulting in a difference in magnification between the left and right images. This means
When observing an image photographed with this configuration, there is a problem in that it causes fatigue, cannot be fused, and cannot be stereoscopically viewed.

SUMMARY OF THE INVENTION It is an object of the present invention to provide a small, low-cost imaging device capable of capturing high-quality stereoscopic images with high mobility and expandability, a method of determining a convergence distance, a storage medium, and an optical device. I do.

Further, the present invention provides an image pickup apparatus capable of reducing a burden on a photographer at the time of photographing and automating a natural stereoscopic image by automating convergence control, a method for determining a convergence distance, a storage medium, and a storage medium. It is another object to provide an optical device.

[0015]

According to an aspect of the present invention, there is provided an image pickup apparatus, comprising: an image pickup means for picking up an image of a subject; an optical system for forming an image on the image pickup means; A pair of shutters arranged symmetrically with respect to the optical axis of the optical system and transmitting the left and right parallax images in a time-division manner, and arranged symmetrically with respect to the optical axis of the optical system and transmitted through the pair of shutters. A pair of mirrors that reflect the left and right parallax images to guide the optical system to the optical system, a subject distance information detecting unit that detects a subject distance, and determine a convergence distance between the pair of mirrors based on the detected subject distance. A convergence distance determining unit; and a driving unit that drives the pair of mirrors so as to reach the determined convergence distance.

According to a second aspect of the present invention, in the imaging apparatus according to the first aspect, the first mode in which the convergence distance is shorter than the subject distance, and the second mode in which the convergence distance is the same as the subject distance. And a third mode in which the convergence distance is behind the subject distance, wherein the convergence distance determination means determines the convergence distance based on the first mode, the second mode, or the third mode. It is characterized by doing.

According to a third aspect of the present invention, there is provided the imaging apparatus according to the second aspect, further comprising a selection unit for selecting the first mode, the second mode, or the third mode by a manual operation of a photographer, The convergence distance determining means determines based on the selected mode.

In the image pickup apparatus according to the fourth aspect, the third aspect is provided.
In the imaging device according to the above, the selection means selects a mode by designating a numerical value.

According to a fifth aspect of the present invention, in the imaging apparatus according to the fourth aspect, there is provided a display unit for displaying the photographed image, and the numerical value designated by the selection unit is displayed on the display unit. Numerical value normalized by viewing distance to screen, diopter to subject distance, distance to subject distance, numeric value normalized to subject distance, viewing distance to display screen of display means, display of display means It is at least one of a diopter with respect to a viewing distance to a screen and a distance with respect to a viewing distance to a display screen of the display means.

According to a sixth aspect of the present invention, in the imaging apparatus according to the fifth aspect, a screen size of the display screen, a base line length of the optical system, an image size of the imaging means, and a position for detecting a distance are determined. It is characterized by comprising a storage means for storing a deviation amount from the optical axis as data.

In the image pickup apparatus according to the seventh aspect, the sixth aspect is provided.
In the imaging device according to the above, the numerical value is a numerical value normalized by a viewing distance to a display screen of the display means, the convergence distance determination means, on the display screen from the normalized numerical value and pupil distance Calculating the amount of parallax, based on the calculated amount of parallax, the base line length, the image size, the screen size, the subject distance and the amount of deviation from the optical axis, the convergence distance is calculated. I do.

According to an eighth aspect of the present invention, in the imaging apparatus according to the third aspect, there is provided storage means for storing data of a convergence distance corresponding to the selected mode and the detected subject distance as a table. It is characterized by having.

According to a ninth aspect of the present invention, in the imaging device of the first aspect, the imaging apparatus comprises a detachable optical unit and a photographing unit, wherein the optical unit includes the pair of shutters, the pair of mirrors, and the optical unit. And a driving unit, wherein the photographing unit includes the imaging unit.

According to a tenth aspect of the present invention, there is provided a method for determining a convergence distance of an image pickup apparatus, wherein a camera for photographing an image, an optical system for forming an image on the camera, and a symmetrical arrangement with respect to an optical axis of the optical system. A pair of shutters for transmitting the left and right parallax images in a time-division manner, and symmetrically disposed with respect to the optical axis of the optical system,
A pair of mirrors for reflecting the left and right parallax images transmitted through the pair of shutters and guiding the parallax images to the optical system, and a distance measuring unit for detecting a subject distance, and driving the pair of mirrors to the determined convergence distance In the convergence distance determination method of the imaging apparatus, the first mode in which the convergence distance is shorter than the object distance by the step of detecting the object distance and the manual operation of the photographer, wherein the convergence distance is the same as the object distance A step of selecting one of a certain second mode and a third mode in which the convergence distance is behind the subject distance, and determining the convergence distance based on the selected mode and the detected subject distance And a process.

A storage medium according to claim 11, a camera for taking an image, an optical system for forming an image on the camera, and a left-right parallax image arranged symmetrically with respect to an optical axis of the optical system. And a pair of mirrors that are arranged symmetrically with respect to the optical axis of the optical system and reflect left and right parallax images transmitted through the pair of shutters and guide the parallax images to the optical system. A distance measurement unit that detects a subject distance, and a storage medium that is executed by a computer that controls an imaging device that drives the pair of mirrors at the determined convergence distance and stores a program that determines the convergence distance. A first mode in which the convergence distance is shorter than the object distance, and a program in which the convergence distance is shorter than the object distance. Second mode is the same as the body length,
And selecting a third mode in which the convergence distance is behind the subject distance, and determining the convergence distance based on the selected mode and the detected subject distance. It is characterized by.

An optical system according to a twelfth aspect of the present invention is an optical system for forming an image on an image pickup means, and a pair of optical systems arranged symmetrically with respect to the optical axis of the optical system and transmitting the left and right parallax images in a time-division manner. A pair of mirrors that are arranged symmetrically with respect to the optical axis of the optical system, reflect left and right parallax images transmitted through the pair of shutters, and guide the parallax images to the optical system,
Subject distance information detecting means for detecting a subject distance, convergence distance determining means for determining a convergence distance of the pair of mirrors based on the detected subject distance, and the pair of convergence distances so as to be the determined convergence distance. Driving means for driving the mirror.

The optical device according to the thirteenth aspect provides the optical device according to the first aspect.
2. The optical device according to 2, wherein the first mode in which the convergence distance is shorter than the subject distance, the second mode in which the convergence distance is the same as the subject distance, and a second mode in which the convergence distance is behind the subject distance. There are three modes, and the convergence distance determination means determines the convergence distance based on the first mode, the second mode, or the third mode.

The optical device according to the fourteenth aspect provides the optical device according to the first aspect.
3. The optical device according to 3, further comprising a selection unit that selects the first mode, the second mode, or the third mode by a manual operation of a photographer, wherein the convergence distance determination unit is based on the selected mode. It is characterized in that it is determined.

According to a fifteenth aspect of the present invention, in the optical device according to the fourteenth aspect, the selecting means selects a mode by designating a numerical value.

The optical device according to the sixteenth aspect is the optical device according to the first aspect.
5. The optical device according to 5, further comprising a display unit for displaying the photographed image, wherein the numerical value specified by the selecting unit is a numerical value normalized by a viewing distance to a display screen of the display unit, a subject distance Diopter, distance to subject distance, numerical value normalized by subject distance, viewing distance to the display screen of the display means, diopter to viewing distance to the display screen of the display means, and The distance is at least one of the viewing distance to the display screen.

The optical device according to the seventeenth aspect provides the optical device according to the first aspect.
6. The optical device according to 6, further comprising a storage unit that stores, as data, a screen size of the display screen, a base line length of the optical system, an image size of the imaging unit, and a shift amount of a position for detecting a distance from an optical axis. It is characterized by having.

In the optical device according to the eighteenth aspect, in the optical device according to the seventeenth aspect, the numerical value is a numerical value normalized by a viewing distance to a display screen of the display means,
The convergence distance determining means calculates a parallax amount on the display screen from the normalized numerical value and the pupil distance, and calculates the calculated parallax amount, the base line length, the image size, the screen size, and the subject distance. And calculating the convergence distance based on a shift amount from the optical axis.

The optical device according to the nineteenth aspect provides the optical device according to the first aspect.
The optical apparatus according to Item 4, further comprising a storage unit that stores data of the convergence distance according to the selected mode and the detected subject distance as a table.

[0034]

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS Embodiments of an imaging apparatus, a convergence distance determining method thereof, a storage medium and an optical apparatus according to the present invention will be described. The imaging device according to the present embodiment is applied to a stereoscopic video imaging device. FIG. 1 is a diagram showing a basic configuration of a stereoscopic video photographing apparatus. In the figure, reference numeral 1 denotes an interchangeable lens unit (simply referred to as a lens unit),
0, a liquid crystal control circuit 123, an IG driver 124, motor drivers 125 and 126, a lens microcomputer 127 for controlling them, a video input terminal (Line in) 128,
Mode switching unit 20, ROM 130, standardized lens mount (not shown), and contact block (not shown)
Having.

Reference numeral 2 denotes a camera body, and a three-plate imaging unit 20
0 and the imaging elements 201 and 20 constituting the imaging unit 200
Amplifiers 204, 20 connected corresponding to 2, 203
5, 206; a signal processing circuit 207 connected to the amplifiers 204, 205, 206; a camera microcomputer 208 connected to the signal processing circuit 207;
And a video output terminal (Line out) 209 connected to a zoom switch and an AF switch (not shown)
, An electronic viewfinder (EVF) 3, a standardized camera mount (not shown), and a contact block (not shown).

This camera mount has a structure detachable from the lens mount of the lens unit 1. By attaching the lens mount to the camera mount, the contact block of the lens unit 1 and the contact block of the camera body 2 are brought into contact with each other, and the signals indicated by arrow 7 in the figure can be exchanged.

That is, the lens microcomputer 127 and the camera microcomputer 208 perform predetermined data communication according to a predetermined protocol. The power supply from the camera body 2 to the lens unit 1 is performed via the contact blocks of the camera body 2 and the lens unit 1, respectively.

Reference numeral 100 denotes a photographing optical system;
Reference numeral 2 denotes a total reflection mirror that is rotatable around a predetermined axis, and is driven by driving units 9 and 11, respectively. In the present embodiment, a stepping motor is used for the driving units 9 and 11. The driving units 9 and 11 are not limited to the step motor, but may be a DC motor or an ultrasonic motor.

Drivers 10 and 12 receive control signals from the lens microcomputer 127 and send drive signals to the drive units (step motors) 9 and 11. Lens microcomputer 127
Detects the rotation angle of the step motor by counting the number of steps of the step motors 9 and 11. When a DC motor or an ultrasonic motor is used, the rotation angle of the mirror can be detected by separately providing an encoder for detecting the rotation angle of the mirror. In addition, by driving the step motors 9 and 10, the mirrors 107 and 112 rotate around a predetermined axis to change the directions of the optical axes 4 and 5.
In the present embodiment, the rotation center of the mirror is the optical axis 4,
A rotation axis is a straight line passing through the vicinity of the point where the mirror 5 and the mirrors 107 and 112 intersect and perpendicular to the paper surface, that is, the vertical direction of the screen. Further, the optical axes 4 and 5 of the left and right images are substantially in the same plane, and substantially intersect at a predetermined position including the point at infinity (hereinafter, referred to as “infinity”).
Congestion).

As described above, the mirrors 107 and 112 are rotatable around a predetermined axis, and the positions of convergence can be changed by rotating each other. It is indispensable to change the convergence position in order to capture a natural stereoscopic image.

The optical axes 4, 5 and the mirrors 107, 112
In the present embodiment, the interval between the intersections with the reflection surface (hereinafter, referred to as a base line length) is not particularly limited, but is around 63 mm. This is set near 63 mm, which is the average human pupil distance, in order to capture a natural stereoscopic image.

Reference numeral 8 denotes a subject distance detecting unit (distance measuring unit) for measuring a distance by triangulation. FIG.
FIG. 4 is a diagram showing a measurement principle by triangulation. The distance measuring unit 8 includes a light emitting lens, a light receiving lens, and an IR
It has an ED, a line sensor (sensor array) having a plurality of light receiving units in a line, and a calculating unit (not shown) for calculating an object distance L by receiving an output from the line sensor. I
The light emitted from the RED is reflected by the subject, collected by the light receiving lens L and the light receiving lens R, and forms an image on the line sensor L and the line sensor R. At this time, depending on where on each line sensor the light is received, that is, by calculating the difference (X1-Xr), the known light receiving lenses L,
The focal length fj of R and the distance between the light receiving lenses L and R (base line length)
From B, the subject distance L can be obtained by the calculation unit.

In the present embodiment, the subject distance information is calculated by triangulation. However, it is also possible to obtain the subject distance information from the position information of each lens group of the photographing optical system. May be obtained.

Reference numerals 108, 113, and 115 denote one or more lens units having a negative refractive power. 116, 11
Reference numerals 7 and 119 denote one or more lens units having a positive refractive power. A prism 110 has a total reflection mirror surface on the surface 109 and the surface 111. 101, 103, 10
Reference numerals 4 and 106 denote polarizing plates. 102 and 105 are liquid crystal elements having a shutter function.

By combining the polarizing plates 101 and 103 and the liquid crystal element 102 and applying an electric field to the liquid crystal, the luminous flux is transmitted.
It becomes a state of non-transmission. The same applies to the case where the polarizing plates 104 and 106 and the liquid crystal element 105 are combined. In this embodiment, FLC (ferroelectric liquid crystal) is used as a liquid crystal element, but the present invention is not limited to this, and TN, S
It is also possible to use liquid crystal such as TN. Further, the polarizing plates 101 and 103 and the polarizing plates 104 and 106 may be fixed to the liquid crystal elements 102 and 105 by bonding or the like, or may be separately arranged.

Reference numeral 114 denotes a stop as a light amount adjusting means. In the present embodiment, by disposing the stop on the object side,
It has been realized to reduce the effective light flux system of the front lens.
120 is an IG meter, 121 and 122 are step motors. Reference numerals 108, 113, and 115 are fixed lens groups. Reference numeral 116 denotes a variator lens. 117 is a compensator lens. Reference numeral 119 denotes a movable lens group having a focusing function.

In the present embodiment, the lenses 116 and 117 are movably arranged in the optical axis direction in a mechanically interlocked manner by a cam cylinder 118.
18 is rotationally driven. The method of driving the lenses 116 and 117 is not limited to this, and the lenses 116 and 117 may be individually driven without using a cam barrel. The step motor 122 is connected to the lens 11
9 is driven. These drives are not limited to step motors, but may be electromagnetic motors such as DC motors, fixed motors such as ultrasonic motors, solid motors such as ultrasonic motors, and electrostatic motors. Not done.

The positions of the lenses 116, 117 and 119 in the direction of the optical axis are detected by counting the driving pulses for driving the stepping motor to convert the positions of the lenses. still,
The means for detecting the position of the lens is not particularly limited to the one that counts the driving pulses of the step motor,
An optical type such as a variable resistance type, a capacitance type, a PSD (position detecting element), and an IRED (infrared light emitting diode) may be used.

The IG meter 120 controls the light amount by driving the aperture 114. Further, an ND filter (not shown) is arranged in the photographing optical system 1. The zoom type is a rear focus zoom type. That is, the lenses 116, 1
Reference numerals 17 and 119 denote lens microcomputers 127 when zooming.
Thus, the driving is controlled in conjunction with a predetermined relationship. still,
The zoom type is not particularly limited to this.

On the other hand, in the camera body 2, the signal processing circuit 207 has a camera signal processing circuit 207a and an AF signal processing circuit 207b. Camera signal processing circuit 20
7a is output as a video signal, and the output of the camera microcomputer 208 is output to the lens microcomputer 12 of the lens unit 1.
7 is supplied.

In the three-plate imaging unit 200, a first prism,
The incident light imaged by the imaging optical system 100 is color-separated into three primary colors by a second prism and a third prism (hereinafter, referred to as color separation prisms). The red component of the three primary colors is imaged on the image sensor 201, and the green component is the image of the image sensor 20.
2, and the blue component is formed on the image sensor 203. The subject images formed on the respective image pickup devices 201, 202, and 203 are each subjected to photoelectric conversion and supplied as electric signals to the corresponding amplifiers 204, 205, and 206.

Each electric signal amplified to an optimum signal level by each of the amplifiers 204, 205, and 206 is converted into a standard television signal by a camera signal processor 207a and output as a video signal. It is supplied to the processing circuit 207b. AF signal processing circuit 20
7b generates an AF evaluation value signal using the signals of the three primary colors from the amplifiers 204, 205, and 206.

The camera microcomputer 208 executes the AF signal processing circuit 20 by using a data read program stored in advance.
The AF evaluation value signal generated in 7b is read and transferred to the lens microcomputer 127. The lens microcomputer 127 drives and controls the lens 119 based on the transferred AF evaluation value signal to perform focusing.

FIG. 3 is a block diagram showing an electrical configuration of the lens microcomputer 127. The lens microcomputer 127 includes a well-known CPU 151, a ROM 152, a RAM 153, an I / O
O interface (IF) 154, communication I / F15
5, a configuration in which a counter 156 and the like are connected via a bus 157.

Next, the left and right parallax images are captured by the image sensor 200.
Will be described. Video output terminal 209 of camera body 2 and video input terminal 1 of lens unit 1
28 is connected by a cable 129, and a captured video signal is input to the liquid crystal control circuit 123.

The video signal is an NTSC interlace signal. Therefore, 60 video signals are output per second. These video signals are synchronized by a vertical synchronization signal and a horizontal synchronization signal. The vertical synchronizing signal is superimposed on the head of the 60 video signals. FIG. 4 is a timing chart showing signal waveforms of various parts of the liquid crystal control circuit 123. FIG. 5 is a block diagram showing a configuration of the liquid crystal control circuit 123.

The liquid crystal control circuit 123 separates a vertical synchronizing signal every 1/60 second from the input video signal. Further, an odd / even signal for determining whether the field is an odd field or an even field is generated from the input video signal.

Whether the odd field or the even field is distinguished is that the vertical synchronizing signal coincides with the edge of the horizontal synchronizing signal (odd field) or is delayed by 1 / 2H (H is the horizontal synchronizing cycle) (even field). Can be done with

Next, a left-eye liquid crystal drive signal and a right-eye liquid crystal drive signal are generated and output from the vertical synchronizing signal and the odd / even signals, respectively.

The left and right liquid crystal drive signals are drive signals for picking up right and left parallax images by the image pickup unit (CCD) 200 alternately in a time-division manner. The liquid crystal shutter corresponding to the parallax image is in a transmissive state, and the other liquid crystal shutter is in a non-transmissive state.

As shown in FIG. 4, when the liquid crystal for the right eye is opaque when the positive voltage is applied and the light is transmitted when the negative voltage is applied, the left eye is not opaque while the liquid crystal for the right eye is opaque. A liquid crystal driving signal is supplied to the liquid crystals 102 and 105 so that the liquid crystal for transmission is transmitted and the liquid crystal for right eye is not transmitted while the liquid crystal for right eye is transmitted.

The liquid crystal 1 is driven alternately in this manner.
02 is non-transparent, an image transmitted through the liquid crystal 105 is captured by the imaging unit (CCD) 200, and while the liquid crystal 105 is non-transparent, an image transmitted through the liquid crystal 102 is captured by the imaging unit (CCD) 20.
0 is imaged.

In this embodiment, since even / odd field signals are included as information, a video signal for the left eye is picked up in the odd field, and a video signal for the right eye is picked up in the even field. By such an operation, the parallax image for the left eye and the parallax image for the right eye are alternately picked up by the image pickup unit (CCD) 200 for 30 images per second, 30 images per second.

The timing of reading from the image pickup unit (CCD) 200 is also synchronized with this, so that the parallax image for the left eye and the parallax image for the right eye are alternately output as video signals as signal processing circuits 20.
7 is output.

The method of vertical synchronization separation and the method of field detection are known techniques and are not particularly limited. In the present embodiment, the video signal is input to the liquid crystal control circuit 123 via the cable 129. However, in the data communication between the lens microcomputer 127 and the camera microcomputer 208, the vertical synchronization signal information and the even / odd field information are transmitted. You may communicate.

In FIG. 4, the falling and rising of the right-eye liquid crystal driving signal and the left-eye liquid crystal driving signal coincide with each other in synchronization with the falling of the vertical synchronizing signal. The falling and rising of the liquid crystal driving signal and the liquid crystal driving signal for the left eye correspond to the vertical blanking period (20) of the video signal.
H).

In the present embodiment, the left-eye video signal is picked up in the odd-numbered field, and the right-eye video signal is picked up in the even-numbered field. , And a left-eye video signal may be captured in the even field.

Furthermore, in the present embodiment, a monocular EVF is used. Since the left and right parallax images are alternately displayed in the video signal in time series, the left and right parallax images are observed as a double image by the EVF. This can be avoided by displaying the left and right parallax images on a separate display unit from the time-division video signal. For example, it is realized by using a so-called HMD having this function. Therefore, an HMD may be used as the EVF. Further, a function of displaying only one side signal may be added to the EVF.

FIG. 6 is a flowchart showing the congestion control processing procedure. This processing program is executed by the lens microcomputer 12.
7, and is also executed by the CPU 151 in the lens microcomputer 127.

When the lens microcomputer 127 starts the convergence control, the lens microcomputer 127 determines the convergence distance of the mirror only when the change in the subject distance is equal to or more than a predetermined value and for a predetermined time or more in order to eliminate the influence of noise or the like. Then, the following processing is performed.

That is, the main subject distance Lk is detected by the distance measuring unit 8 (step S1). It is determined whether or not the absolute value of the difference between the detected main subject distance Lk and the previously updated main subject distance Lref is larger than a predetermined value ΔL (step S2). Here, the predetermined value ΔL is set to a value within a range of a subject distance that can be fused without difficulty due to the current convergence.

The absolute value of the difference between the main subject distances is a predetermined value ΔL.
If the following is true, that is, if the detected change in the main subject distance is small, the counter 1 in the lens microcomputer 127
The value k of 56 is reset to "1" (step S3), and the process returns to step S1. Here, the value k of the counter is
It is used to measure the time during which a large change in subject distance continues.

On the other hand, when the absolute value of the difference between the subject distances is larger than the predetermined value ΔL, that is, when the detected change in the subject distance is large, the counter value k is increased by “1” (step S4). Then, it is determined whether or not the value k of the counter has become larger than the predetermined value n (step S).
5). Here, the predetermined value n is a value corresponding to a time set for eliminating a change in the main subject distance due to noise or the like, and is set to a multiple of the field frequency in the present embodiment. If the counter value k is not larger than the predetermined value n, the process returns to step S1.

On the other hand, when the value k of the counter is larger than the predetermined value n, the main object distance Lk detected this time is updated to the object distance Lref to be referred next (step S6).
Then, the value k of the counter is reset to "1" (step S7).

Thereafter, the convergence distance is determined (step S
8). The process of determining the convergence distance will be described later.
Then, the lens microcomputer 127 sends a signal to the drivers 10 and 12 until the mirror angle corresponding to the determined convergence distance is reached, and the drivers 10 and 12 drive the mirrors 107 and 112 in the directions of arrows 13 and 15 (step S9). . As a result, the optical axes 4 and 5 rotate in the directions of arrows 14 and 16 to cause convergence. Thereafter, the process returns to step S1.

Next, the process of determining the convergence distance in step 8 will be described. The present embodiment has a plurality of modes (modes 1, 2, and 3) for determining the convergence distance. In mode 1, the convergence distance is set shorter than the main subject distance. In mode 2, the convergence distance is set to the main subject distance. In mode 3, the convergence distance is set behind the main subject distance. By performing photographing in each of these modes, it is possible to change the stereoscopic effect of the main subject at the same distance during observation.

In this embodiment, the photographer operates the display device (E
The mode is selected by inputting a numerical value normalized by the viewing distance to the display screen of VF3) from the mode switching unit 20. That is, by inputting a numerical value, one of the modes 1, 2, and 3 is automatically selected.

FIG. 7 is a flowchart showing the procedure of the convergence distance determination process in step S8. This processing program is stored in the ROM 152 in the lens microcomputer 127, and is also stored in the CPU 15 in the lens microcomputer 127.
1 is performed. First, a numerical value P normalized by the viewing distance from the mode switching unit 20 operated by the observer to the display screen of the display device (EVF3) is input (step S11). Here, the numerical value P is a numerical value representing a ratio of a distance from a human (observer) eye to the display image and a distance from the display screen of the display image. In the present embodiment, the numerical value P is adjusted by adjusting the scale to the numerical value to be adjusted using the volume-type scaled dial arranged in the mode switching unit 20.
Is sent to the lens microcomputer 127.

Subsequently, the amount of parallax S (P) on the display screen is calculated (step S12). Assuming that the human pupil interval is IPD, the parallax amount S (P) can be obtained from Expression (1). In the present embodiment, the IPD is set to 63 mm, but this may be a value corresponding to the human pupil interval, and is not particularly limited to this value.

S (P) = IPD × P (1) In the present embodiment, the parallax amount S (P) is calculated by the equation (1), but the parallax amount S (P) corresponding to the numerical value P Is stored in the ROM 130, and the numerical value P
Is given, the parallax amount S is referred to this table.
(P) may be read.

Then, the parallax amount S obtained in step S12
(P), base line length, focal length of lens, imaging unit (CCD)
The convergence distance is calculated by a geometric calculation using the 200 image size, the screen size of the display screen (screen size), the detected subject distance, and the amount of deviation from the optical axis of the position at which the distance is detected ( Step S13).

Here, the base line length, the focal length, and the image size are stored in the ROM 130 in advance, and the CPU 151 in the lens microcomputer 127 performs the processing in step S13.
Is read by The screen size may be directly input by the photographer, or may be stored in advance in the ROM 130 as data. When the photographer inputs directly, menu operation in the electronic viewfinder 3
You may make it input using a dial (not shown).

When the photographer inputs a predetermined mode (here, numerical value P) through a series of processes described above, the mirror converges to a convergence distance corresponding to the mode and the subject distance.

According to the flowchart of FIG.
Instead of calculating the convergence distance according to the mode and the subject distance, data of the convergence distance corresponding to each mode and the subject distance is stored in the ROM 130 in advance as a table, and when the subject distance is determined in step S6, the determination is made. Alternatively, the subject distance and the convergence distance corresponding to the selected mode may be read from the ROM 130 and determined. In this case, the photographer can select a mode by a manual operation using a dial or the like.

Further, in the above embodiment, the photographer sets the numerical value normalized by the viewing distance to the display screen of the display device as:
The mode is selected by inputting from the mode switching unit 20, but the numerical value input for selecting the mode is not limited to this, and may be the following numerical value. That is, in addition to the numerical value normalized by the viewing distance to the display screen of the display device, the diopter for the subject distance L,
Distance to subject distance L, numerical value normalized by subject distance L, viewing distance to display screen of display device, diopter for viewing distance to display screen of display device, and viewing distance to display screen of display device The photographer sets at least one of the distances to the viewing distance by a mechanical or electronic mode switching unit 2.
It is also possible to select a mode by inputting from 0. Also, there is no particular limitation on which mode these numerical values correspond to.

As described above, in the imaging apparatus according to the present embodiment, by automating the convergence control, it is possible to reduce the burden on the photographer at the time of photographing, and to photograph a stereoscopic image with high quality and less fatigue. it can. Further, the photographer can set the control of the three-dimensional effect, and the intention of the photographer can be reflected on the photographing.

Further, the parallax image on the left and right can be photographed with one lens without the need for two lenses, whereby the size and cost of the apparatus can be reduced, and the difference between the left and right lenses can be reduced. The influence can be eliminated, and a high-quality stereoscopic video can be captured with a simple configuration.

Further, by disposing the mirror and the liquid crystal shutter symmetrically with respect to the optical axis of the lens, it is possible to make the optical path lengths of the left and right parallax images to the subject equal, thereby providing a magnification difference between the left and right images. , And high-quality stereoscopic video can be shot.

Further, since the left and right parallax images can be photographed by one imaging device through the photographing optical system, an unnecessary electric circuit is not required, and the size and cost of the apparatus can be reduced.

Further, it can be provided as one lens unit of the interchangeable lens system. In other words, the camera unit does not need to have any special parts for capturing a stereoscopic image, and a normal two-dimensional lens unit can be used in the same camera unit. Therefore, scalability is high and user merit is great. In addition, a plurality of lens units for capturing stereoscopic images having different specifications such as focal lengths can be used by the same camera.

It is needless to say that the present invention can be applied to a case where the present invention is attained by supplying a program to an image pickup apparatus. In this case, by reading out a storage medium storing a program represented by software for achieving the present invention into an imaging device, the device can enjoy the effects of the present invention.

FIG. 8 is a diagram showing a memory map of a ROM as a storage medium. The ROM 152 shown in FIG. 9A stores a congestion control processing program module shown in the flowchart of FIG. 6, a congestion distance determination processing program module shown in the flowchart of FIG. The ROM 130 shown in FIG. 4B stores data of a convergence distance corresponding to each mode and subject distance in addition to the base line length, the focal length, the image size of the image sensor, the screen (screen) size of the EVF, and the like. And the like are stored. Here, the ROM 152 and the ROM 130 may be configured by the same storage medium. The storage medium for supplying the program module is not limited to the ROM,
For example, a floppy (registered trademark) disk, a hard disk, a nonvolatile memory card, or the like can be used.

[0093]

According to the present invention, it is possible to provide an imaging apparatus which is small in size, low in cost, has high mobility and expandability, and can capture high-quality stereoscopic images.

Further, by automating the convergence control, the burden on the photographer at the time of photographing can be reduced, and natural stereoscopic video photographing can be performed.

Furthermore, the photographer can set the control of the three-dimensional effect, and the photographer's intention can be reflected on the photographing.

[Brief description of the drawings]

FIG. 1 is a diagram illustrating a basic configuration of a three-dimensional video photographing apparatus.

FIG. 2 is a diagram illustrating a measurement principle by triangulation.

FIG. 3 is a block diagram illustrating an electrical configuration of a lens microcomputer 127.

FIG. 4 is a timing chart showing signal waveforms of various parts of the liquid crystal control circuit 123.

FIG. 5 is a block diagram illustrating a configuration of a liquid crystal control circuit 123.

FIG. 6 is a flowchart illustrating a congestion control processing procedure.

FIG. 7 is a flowchart showing a convergence distance determination processing procedure in step S8.

FIG. 8 is a diagram showing a memory map of a ROM as a storage medium.

[Explanation of symbols]

 Reference Signs List 1 lens unit 2 camera unit 3 electronic viewfinder (EVF) 8 distance measuring unit 20 mode switching unit 102, 105 liquid crystal shutter 127 lens microcomputer 130, 152 ROM 151 CPU 200 imaging unit 201, 202, 203 imaging element 208 camera microcomputer

 ──────────────────────────────────────────────────続 き Continued on the front page F-term (reference) 2H059 AA03 AA13 5C022 AA01 AB44 AB45 AB62 AC03 AC52 AC54 AC74 CA00 5C061 AA03 AA13 AB03 AB06 AB08 AB11 AB21 5C065 AA07 BB35 CC01 DD02 EE02 FF01 GG22 GG23 GG32GG44

Claims (19)

[Claims] 1. An image pickup means for photographing an image of a subject, an optical system for forming an image on the image pickup means, and symmetrically arranged with respect to an optical axis of the optical system, the left and right parallax images are time-divided. A pair of shutters for transmitting light, a pair of mirrors arranged symmetrically with respect to the optical axis of the optical system, for reflecting left and right parallax images transmitted through the pair of shutters and guiding the parallax images to the optical system; Object distance information detecting means for detecting, convergence distance determining means for determining a convergence distance of the pair of mirrors based on the detected object distance, and driving the pair of mirrors to be the determined convergence distance An imaging device comprising: 2. A first mode in which the convergence distance is shorter than the subject distance, a second mode in which the convergence distance is the same as the subject distance, and a third mode in which the convergence distance is behind the subject distance. The imaging apparatus according to claim 1, further comprising: the convergence distance determination unit determines the convergence distance based on the first mode, the second mode, or the third mode. 3. A convergence distance determining means for selecting the first mode, the second mode, or the third mode by a manual operation of a photographer, wherein the convergence distance determining means determines the convergence distance based on the selected mode. The imaging device according to claim 2, wherein: 4. The imaging apparatus according to claim 3, wherein said selection means selects a mode by designating a numerical value. 5. A display unit for displaying the photographed image, wherein the numerical value specified by the selecting unit is a numerical value normalized by a viewing distance to a display screen of the display unit, Degree, distance to subject distance, numerical value normalized by subject distance, viewing distance to display screen of display means, diopter to viewing distance to display screen of display means, and display screen of display means The imaging device according to claim 4, wherein the distance is at least one of distances to a viewing distance up to. 6. A storage means for storing, as data, a screen size of the display screen, a base line length of the optical system, an image size of the imaging means, and a shift amount of a position for detecting a distance from an optical axis. 6. The method according to claim 5, wherein
An imaging device according to any one of the preceding claims. 7. The numerical value is a numerical value normalized by a viewing distance to a display screen of the display means, and the convergence distance determining means is configured to calculate the convergence distance on the display screen from the normalized numerical value and the pupil distance. Calculating a parallax amount, and calculating the convergence distance based on the calculated parallax amount, the base line length, the image size, the screen size, the subject distance, and a shift amount from the optical axis. The imaging device according to claim 6. 8. The imaging apparatus according to claim 3, further comprising storage means for storing data of a convergence distance according to the selected mode and the detected subject distance as a table. 9. An optical unit, comprising: a detachable optical unit and a photographing unit, wherein the optical unit includes the pair of shutters, the pair of mirrors, the optical system, and the driving unit, and the photographing unit includes the imaging unit. The imaging device according to claim 1, further comprising: 10. A camera for photographing an image, an optical system for forming an image on the camera, and a pair of symmetrically disposed optical axes of the optical system for transmitting left and right parallax images in a time-division manner. A shutter, a pair of mirrors arranged symmetrically with respect to the optical axis of the optical system, and reflecting the left and right parallax images transmitted through the pair of shutters and guiding the parallax images to the optical system; A convergence distance determining method for the imaging device that drives the pair of mirrors at the determined convergence distance, wherein a step of detecting a subject distance; and a manual operation of a photographer, wherein the convergence distance is greater than the subject distance. A step of selecting one of a first mode that is a near side, a second mode in which the convergence distance is the same as the subject distance, and a third mode in which the convergence distance is behind the subject distance, Deciding the convergence distance based on the selected mode and the detected subject distance. 11. A camera for photographing an image, an optical system for forming an image on the camera, and a pair of symmetrically disposed optical axes of the optical system for transmitting left and right parallax images in a time-division manner. A shutter, a pair of mirrors arranged symmetrically with respect to the optical axis of the optical system, and reflecting the left and right parallax images transmitted through the pair of shutters and guiding the parallax images to the optical system; A storage medium that is executed by a computer that controls an imaging device that drives the pair of mirrors at the determined convergence distance, and that stores a program that determines the convergence distance. A first mode in which the convergence distance is shorter than the subject distance, and a second mode in which the convergence distance is the same as the subject distance, by a detection procedure and a manual operation of a photographer. And selecting a third mode in which the convergence distance is behind the subject distance, and determining the convergence distance based on the selected mode and the detected subject distance. A storage medium comprising: 12. An optical system for forming an image on an image pickup means, a pair of shutters symmetrically arranged with respect to an optical axis of the optical system, and transmitting time-division left and right parallax images, and A pair of mirrors arranged symmetrically with respect to the optical axis, for reflecting left and right parallax images transmitted through the pair of shutters and guiding the parallax images to the optical system; subject distance information detecting means for detecting a subject distance; An optical device comprising: a convergence distance determining unit that determines a convergence distance between the pair of mirrors based on the determined subject distance; and a driving unit that drives the pair of mirrors so that the convergence distance is determined. 13. A first mode in which the convergence distance is shorter than the subject distance, a second mode in which the convergence distance is the same as the subject distance, and a third mode in which the convergence distance is behind the subject distance. 13. The optical device according to claim 12, further comprising: the convergence distance determination unit determines the convergence distance based on the first mode, the second mode, or the third mode. 14. A convergence distance determining means for selecting one of the first mode, the second mode and the third mode by a manual operation of a photographer, wherein the convergence distance determining means makes a determination based on the selected mode. The optical device according to claim 13, wherein: 15. The optical apparatus according to claim 14, wherein said selection means selects a mode by designating a numerical value. 16. A display unit for displaying the photographed image, wherein the numerical value specified by the selecting unit is a numerical value normalized by a viewing distance to a display screen of the display unit, Degree, distance to subject distance, numerical value normalized by subject distance, viewing distance to display screen of display means, diopter to viewing distance to display screen of display means, and display screen of display means The optical device according to claim 15, wherein the optical device is at least one of distances to a viewing distance up to. 17. A storage unit for storing, as data, a screen size of the display screen, a base line length of the optical system, an image size of the imaging unit, and a shift amount of a position for detecting a distance from an optical axis. The optical device according to claim 16, wherein: 18. The numerical value is a numerical value normalized by a viewing distance to a display screen of the display means, and the convergence distance determining means is configured to calculate the convergence distance on the display screen from the normalized numerical value and the pupil distance. Calculating a parallax amount, and calculating the convergence distance based on the calculated parallax amount, the base line length, the image size, the screen size, the subject distance, and a shift amount from the optical axis. The optical device according to claim 17. 19. The optical apparatus according to claim 14, further comprising a storage unit configured to store data of a convergence distance according to the selected mode and the detected subject distance as a table.