JPH1048701A - Photographing device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To correct parallax well with a simple constitution in a photographing device photographing or observing the same object by using plural optical systems whose optical axes are different. SOLUTION: This photographing device photographs the same object 3 by a wide angle lens 1 and a telephoto lens 2, and a distance between the lenses 1 and 2, and the object 3 is measured by a range finder 8. The specified part of the video of the object 3 photographed by the lens 1, for example, the position of a face is detected by a specified position detector 5. The deviation amount of the optical axis obtained in the case the optical axes of the lenses 1 and 2 cross at a specified distance is stored in a ROM 7. An arithmetic device 6 arithmetically calculates an angle to be deflected in order to align the optical axis of the lens 2 with the specified part of the object 3 based on the measured distance, the stored deviation amount of the optical axis, and the position of the specified part, controls an optical axis deflection device 9, and deflects the optical axis of the lens 2 by the found angle.

Description

DETAILED DESCRIPTION OF THE INVENTION

[0001]

BACKGROUND OF THE INVENTION 1. Field of the Invention The present invention uses a plurality of optical systems having different optical axes, for example, a photographing lens and a finder lens in a silver halide camera, a video camera, or a surveillance camera, or a photographing lens and a photometric / distance measuring lens. And a photographing apparatus for photographing or observing the same subject.

[0002]

2. Description of the Related Art Originally, in a system of a photographing apparatus for photographing or observing the same subject with a plurality of optical systems, the optical axes of the respective optical systems do not coincide with each other, and so-called parallax (optical axis shift) occurs. Each system removes or corrects this parallax in a manner appropriate for the state of use.

For example, regarding the parallax of a photographic lens and a finder in a lens shutter camera, the relationship between the distance of a subject and the amount of parallax is stored in advance in Japanese Patent Application Laid-Open No. 4-264536, and the finder is stored in the finder according to the amount of parallax. A technique has been disclosed in which the field of view of the photographing lens and the field of view of the viewfinder are made to match by appropriately applying a mask.

[0004] In addition, for auto-focusing of a lens shutter camera, a video camera, or the like, light such as infrared light is projected onto a subject from a light emitting element provided outside the taking lens, and the position of reflected light is detected by a sensor. The so-called external measurement active autofocus system that calculates the distance of the camera is used. However, even in this system, there is a parallax between the photographing lens and the projection system lens. A method is employed in which the optical axis of the light projecting lens is turned mechanically in association with the movement of the ring.

Further, Japanese Patent Publication No. 6-70636 discloses a system in which two TV cameras are photographed from different directions in order to measure the position of a three-dimensional measuring object. I have. Here, a mirror that rotates the optical axis of the imaging system in a direction orthogonal to each other is controlled by a servo system based on the null method so that the image of the object to be measured is always at the center of the imaging system, and from the rotation angle of the mirror at that time The position of the object to be measured is determined. That is, each camera independently rotates the optical axis so that the object to be measured comes to the optical axis, thereby eliminating parallax of the two lenses.

[0006]

However, in the above-mentioned conventional example, first, regarding the photographing lens in the lens shutter camera and the parallax correcting means of the finder, the optical axis itself of the finder is not moved. As a result, the optical axes do not coincide with each other, and the profiles of the optical characteristics such as the amount of light, resolution, and distortion, which are generally generated in rotational symmetry with respect to the optical axis, do not coincide.

In this case, since the use of the optical system for correcting parallax is a finder, such a mismatch in optical characteristics does not matter. However, for example, one of the two types, such as the relationship between a photographing lens and a distance measuring / photometric lens, is used. When the other lens supplementarily measures and observes the operating condition of the lens (for example, a distance measurement of a subject or a luminance measurement system or a finder), it is not desirable that such optical characteristic mismatch occurs between these optical systems. It is desirable that the measurement / observation system lens captures the subject under the same conditions as much as possible with respect to the system lens.

Next, the parallax correction method in the external measuring active autofocus system is effective when the subject is located near the optical axis.
If not, the subject to be captured by the photographing system lens and the subject to be captured by the light projecting lens are separated and are not effective.

Further, in a system in which the viewpoints of two cameras are matched as in Japanese Patent Publication No. Hei 6-70636, parallax is corrected or eliminated as a result, but as in a general servo system, unstable such as hunting occurs. A phenomenon may occur. In addition, since each lens system independently performs measurement object detection, drive, and servo, there is a disadvantage that the entire system is enlarged and complicated.

It is an object of the present invention to enable parallax correction to be satisfactorily performed with a simple configuration in this type of photographing apparatus.

[0011]

According to the present invention, there is provided, according to the present invention, first and second optical systems having different optical axes, and a subject is photographed or observed by the first optical system. And an optical axis deflecting means for deflecting an optical axis of the second optical system, wherein the first and second optical systems deflect an optical axis of the second optical system. Distance measuring means for measuring the distance between the optical system and the subject, and the optical axes of the first and second optical systems when the optical axes of the first and second optical systems are set to intersect at a predetermined distance. Storage means for storing the shift amount of the optical system, and the light of the second optical system based on the distance information of the measurement result by the distance measuring means and the information of the shift amount of the optical axis at a predetermined distance stored in the storage means. The angle to be deflected to align the axis with the subject along with the optical axis of the first optical system Determined by calculation, adopting the structure having an arithmetic control means for angular deflection was determined the optical axis of the second optical system by controlling the optical axis deflecting unit.

According to such a configuration, the distance between the first and second optical systems and the subject is measured by the distance measuring means while the optical axis of the first optical system is aligned with the subject. The optical axis of the second optical system is deflected together with the optical axis of the first optical system to align with the subject based on the information on the measured distance and the information on the amount of deviation of the optical axis at the predetermined distance stored. The power angle is obtained by calculation, and the optical axis deflecting means is controlled to deflect the optical axis of the second optical system at the obtained angle. Thereby, the optical axis of the second optical system is aligned with the subject, and parallax is corrected.

[0013] Further, there is provided a specific position detecting means for detecting a position of a specific part in an image of a subject photographed or observed by the first optical system, and the arithmetic control means comprises:
The second optical system, based on the information on the detection result of the specific position detecting means, together with the distance information of the measurement result by the distance measuring means and the information on the deviation amount of the optical axis at a predetermined distance stored in the storage means. An angle to be deflected to match the optical axis of the first optical system with the specific part of the subject where the optical axis of the first optical system is aligned is obtained by calculation, and the optical axis deflecting means is controlled to control the optical axis of the second optical system. Is configured to deflect the angle as described above, the optical axis of the second optical system is aligned with the specific portion of the subject where the optical axis of the first optical system is aligned. After photographing or observing the subject, a specific portion of the subject can be photographed or observed by the second optical system.

[0014]

Embodiments of the present invention will be described below with reference to the drawings. Here, a configuration for parallax correction in a photographing apparatus, for example, a video camera, which photographs the same subject by using a wide-angle lens and a telephoto lens as a photographing optical system as two optical systems will be described. First, the principle configuration of the present embodiment will be described with reference to FIGS.

The system of the photographing apparatus according to the present embodiment is shown in FIG.
As shown in FIG. 1, a system for photographing a subject 3 such as a person by using a wide-angle lens 1 and a telephoto lens 2 having a longer focal length. Assuming that the subject 3 is a person and a specific part is a human face, for example, a system in which the object is extracted by a telephoto lens 2 and a specific part is a person's face, an image of the wide-angle lens 1 shown in FIG. A system for obtaining an image of the telephoto lens 2 in which the face 3a is enlarged as shown in b).

For this purpose, the optical axis of the telephoto lens 2 can be deflected in the x-direction (horizontal direction) and the y-direction (vertical direction) with respect to the optical axis of the wide-angle lens 1. The angle of the optical axis of the telephoto lens 2 is set to a predetermined value such that the optical axis of the telephoto lens 2 intersects the axis at an arbitrary predetermined distance A (may be an infinity or a distance close thereto),
When the optical axis of the wide-angle lens 1 is aligned with the subject 3, the optical axis of the telephoto lens 2 is deflected from the angle of the initial state,
Assume that it matches the face 3a of the subject 3.

At this time, in order to determine the angle at which the optical axis of the telephoto lens 2 is deflected in the x and y directions, the optical axis center Pw of the wide angle lens 1 in the image of the wide angle lens 1 shown in FIG. Xw, which is the amount of displacement between the face 3a and the face 3a in the x and y directions.
yw is obtained, and as shown in FIG. 2C, the distance x0, y0 between the optical axis center Pw of the wide-angle lens 1 and the optical axis center Pt of the telephoto lens 2 in the initial state in the x and y directions. Ask for. Note that the distance of these shift amounts is a value normalized with respect to the size of the image, and is converted into the deflection angle of the optical axis of the telephoto lens 2.

To determine the distances xw, yw between the optical axis center Pw of the wide-angle lens 1 and the face 3a, the position of the face 3a is detected first. Means for detecting the position of a human face from image information is disclosed in JP-A-61-45911 and JP-A-63-1184.
No. 73 and the like. By these means, x of the face 3a in the image of the wide-angle lens 1 shown in FIG.
The position in the direction and in the y direction can be known as an absolute value on the image, and based on this, the distances xw and yw of the shift amount between the optical axis center Pw and the position of the face 3a can be obtained.

Further, the distance x0, y0 of the shift amount between the optical axis center Pw of the wide-angle lens 1 and the optical axis center Pt of the telephoto lens 2 in the initial state is a wide angle when set so as to intersect at a predetermined distance A. Angle θ3 of the difference between the angle θ1 of the shift amount of the optical axis of the lens 1 and the telephoto lens 2 and the angle θ2 of the shift amount when intersecting at the distance B (see FIG. 1; angle in the y direction). If the distance A, the angle θ1, and the distance B are known, the angle θ2 is obtained by calculating a trigonometric function,
Further, the angle θ3 can be obtained.

For this reason, in the present embodiment, the distance A in the initial state and the angle θ1 of the shift amount of the optical axis of the lenses 1 and 2 at that time are stored in association with each other, and the lenses 1 and 2 are used during photographing. Then, the distance B between the object 3 and the subject 3 is measured, and the angle θ3 corresponding to the shift amounts x0, y0 is calculated based on these data.

In this way, the shift amounts xw, yw and x
By calculating 0 and y0 and further adding both, FIG.
The shift amounts xt and yt in the x and y directions between the optical axis center Pt of the telephoto lens 2 and the position of the face 3a shown in FIG. That is, xt = x0 + xw yt = y0 + yw. The optical axis of the telephoto lens 2 is aligned with the face 3a by deflecting the optical axis of the telephoto lens 2 in the x and y directions from the position in the initial state by an angle in the x and y directions corresponding to the shift amount thus obtained. Thus, an enlarged image of the face 3a in FIG.

Next, a specific configuration of the photographing apparatus according to the present embodiment will be described with reference to FIGS.

FIG. 3 shows the configuration of the entire photographing apparatus.
In the configuration shown here, images of the subject 3 are respectively imaged by the wide-angle lens 1 and the telephoto lens 2 into the imaging devices 10 and 11.
An image is formed thereon, and the output signals of the imaging devices 10 and 11 undergo necessary processing in the camera signal processing circuits 4 and 12 and are output as video signals.

As described above, the optical axis deflecting device 9 is provided to deflect the optical axis of the telephoto lens 2. The configuration for deflecting the optical axis of the telephoto lens 2 is specifically configured as shown in FIG. 4 or FIG.

In the configuration shown in FIG. 4, the telephoto lens 2 is held by a holder 13 having a so-called gimbal structure so as to be rotatable in the x and y directions corresponding to the x and y directions. By rotating the telephoto lens 2 in the x and y directions by the rotation drive units 9a and 9b, the optical axis is deflected in the x and y directions.

In the configuration shown in FIG. 5, a mirror 14 is used which fixes the telephoto lens 2 and which is held rotatably in the x and y directions by a holder 13 having a gimbal structure.
Is rotated in the x and y directions by the rotary drive units 9a and 9b, so that the optical axis of the telephoto lens 2 is deflected in the x and y directions.

Here, the mirror 14 may be rotated for deflection in one direction of the x and y directions, and the telephoto lens 2 may be rotated for deflection in the other direction. Telephoto lens or mirror 2
Instead of the gimbal structure, a pivot structure such as a ball bearing or a universal joint may be used as the holding structure rotatable in the direction.

The mechanism for deflecting the optical axis is described in, for example, JP-A-3-132174 and JP-A-6-13.
No. 307, Japanese Patent Application Laid-Open No. 7-104335, and Japanese Patent Publication No. 6-70636, which is also mentioned in the section of the prior art, and the like. .

Each of the rotary drive units 9a and 9b is composed of an actuator as a rotary drive source, a rotary angle detector for detecting a rotation angle of the telephoto lens 2 or the mirror 14, and an actuator driver as a drive circuit for driving the actuator. Is controlled by the arithmetic unit 6 as described later.

The actuator may be a DC motor, a stepping motor, a voice coil motor, an ultrasonic motor, or the like. The rotation angle detector includes a combination of a light emitting element and a light receiving element (for example, an infrared light emitting diode and a photodiode), a combination of a magnet and a magnetic sensor such as a Hall element, triangulation of laser, sound wave, light, and the like. For example, a method may be used in which the amount of movement of one point of the rotating unit is measured and converted into an angle. When a stepping motor is used for the actuator, the rotation angle per drive pulse is determined by design items such as the reduction ratio and lever ratio of the reduction mechanism used for the drive mechanism, and reset by a photo interrupter or leaf switch. The rotation angle can be detected by counting the number of pulses from the initial position.

Referring again to FIG. 3, the arithmetic unit 6 is composed of a microcomputer or the like, and controls the optical axis deflecting device 9 composed of the above-mentioned rotary drive units 9a and 9b.
The deflection of the optical axis of the telephoto lens 2 is controlled.

The arithmetic unit 6 is connected to a ROM 7 which, together with data such as a control program necessary for the arithmetic unit 6, intersects the optical axes of the wide-angle lens 1 and the telephoto lens 2 at a distance A. Wide-angle lens 1
And the data of the distance A of the optical axis of the telephoto lens 2 and the data of the distance A (hereinafter referred to as parallax data) are stored in association with each other.

The specific position detecting device 5 is connected to the arithmetic device 6. The device 5 analyzes a video signal output from the camera signal processing circuit 4, that is, information of a video image formed on the image sensor 10 by the wide-angle lens 1, and
In this case, the position of a specific part, here, the position of a human face is detected as an absolute position on a video image.
No. 45911 and the like are used.

Further, a distance measuring device 8 is connected to the arithmetic device 6. This distance measuring device 8 measures the distance B between the wide-angle lens 1, the telephoto lens 2 and the subject 3, and is a so-called triangulation method for obtaining the distance from the positional relationship where the projected light is reflected and received by the subject. And a so-called phase difference method for obtaining a distance from an image forming positional relationship between optical systems having different pupil positions.

Next, the operation of the configuration shown in FIG. 5 will be described. In the initial state, the optical axes of the wide-angle lens 1 and the telephoto lens 2 are distance A
The angle of the optical axis of the telephoto lens 2 is set so as to intersect.

From this state, the fixed optical axis of the wide-angle lens 1 is aligned with the subject 3, an image of the subject 3 is formed on the image sensor 10, and an output signal of the image sensor 10 corresponding to the image is a camera signal. The signal is subjected to required processing by the processing circuit, and is output as a video signal corresponding to a video, for example, as shown in FIG.

This video signal is input to a specific position detection device 5, which analyzes the video signal and detects the position of the face of the subject 3 as a specific position in the video. The data is input to the arithmetic unit 6.

The distance B between the wide-angle lens 1, the telephoto lens 2 and the subject 3 is measured by the distance measuring device 8, and the data of the measurement result is input to the arithmetic device 6.

The arithmetic unit 6 calculates the optical axis center Pw of the wide-angle lens 1 on the image of the wide-angle lens 1 shown in FIG. The shift amounts xw and yw in the y direction are calculated. In addition, the data of the distance B of the measurement result of the distance measuring device 8 and the ROM 7
The deviation amount of the optical axis in the x and y directions at the measurement distance B is calculated by the calculation based on the parallax data of the distance A stored in the distance A, and the difference between the deviation amounts of the distance A and the distance B, that is, FIG. The shift amounts x0 and y0 in the x and y directions between the optical axis center Pw of the wide-angle lens 1 and the optical axis center Pt of the telephoto lens 2 on the image of the wide-angle lens 1 shown in FIG. Then, x, between the optical axis center Pt of the telephoto lens 2 and the position of the face 3a,
The shift amounts xt and yt in the y direction are obtained by the calculation of xt = x0 + xw yt = y0 + yw, and the shift amounts xt and yt are converted into corresponding deflection angles θx and θy of the optical axis of the telephoto lens 2 in the x and y directions. The optical axis deflecting device 9 is controlled to deflect the optical axis of the telephoto lens 2 in the x and y directions by θx and θy.

As a result, the optical axis of the telephoto lens 2 is
2C, an enlarged image of the face 3a shown in FIG. 2C is formed on the image sensor 11, and the output signal of the image sensor 11 is subjected to required processing by the camera signal processing circuit 12 to obtain the face. The video signal is output as a video signal corresponding to the enlarged video of 3a.

As described above, according to the present embodiment, the optical axis of the telephoto lens 2 is deflected, and the optical axes of the wide-angle lens 1 and the telephoto lens 2 are made to coincide with the subject 3, so that the optical axes of the two lenses are adjusted. Not only can the parallax correction be performed satisfactorily by matching the characteristics, but also the enlarged image can be obtained by adjusting the optical axis of the telephoto lens 2 to a specific part of the subject such as a human face. Further, since only the optical axis of the telephoto lens 2 is deflected, the configuration is simple.

In the above-described embodiment, a human face is given as an example of a specific part of an extraction target to be enlarged and photographed with a telephoto lens. However, this is not limited to a face. For example, eyes, nose, mouth, hands, hands, etc.
Not only human body parts such as feet, but also non-human things, such as one character in a printed matter such as a book or newspaper, one part of a mechanical part being assembled, or a tree or cloud in the scenery can be Of course.

Further, in the above-described embodiment, as shown in FIG. 2C, the optical axis of the telephoto lens 2 is shifted by xt, The control for adjusting the optical axis center Pt of the telephoto lens 2 to the position of the face 3a by deflecting by an angle corresponding to yt is performed, but the optical axis of the telephoto lens 2 is deflected by an angle corresponding to the shift amount x0, y0. Alternatively, only the parallax correction control for making the optical axis center Pt of the telephoto lens 2 coincide with the optical axis center Pw of the wide-angle lens 1 may be performed.

In the above-described embodiment, the predetermined distance A
Although the deflection angle of the optical axis of the telephoto lens 2 is determined based on only the parallax data, the parallax data at each of a plurality of different (more is better) distances is stored in the ROM 7 and the plurality of parallax data is stored. The deflection angle may be obtained based on the data. In this case, of the plurality of data, the deviation amount of the optical axis of the parallax data at the distance closest to the measured distance between the lens and the subject is used as an approximate value as it is, or the deviation amount is measured as the closest distance. What is necessary is just to correct by calculation according to the distance difference and use it.

[0045]

As is apparent from the above description, according to the present invention, there are provided first and second optical systems having different optical axes, and after photographing or observing a subject with the first optical system, Second
An optical axis deflecting means for deflecting an optical axis of said second optical system, said first and second optical systems, and an object. Distance measuring means for measuring the distance between the first optical system and the optical axis of the first and second optical systems when the optical axes of the first and second optical systems are set to intersect at a predetermined distance. The optical axis of the second optical system based on the distance information of the measurement result obtained by the distance measuring means and the information of the deviation amount of the optical axis at a predetermined distance stored in the storing means. Calculation control means for calculating the angle to be deflected to match the subject together with the optical axis of the optical system, and controlling the optical axis deflection means to deflect the optical axis of the second optical system by the calculated angle. With a simple configuration,
An excellent effect that the parallax correction can be favorably performed by matching the optical characteristics of the first and second optical systems can be obtained.

[Brief description of the drawings]

FIG. 1 is an explanatory diagram showing an optical axis shift between a wide-angle lens and an imaging lens and a deflection of an optical axis of a telephoto lens in an embodiment of an imaging apparatus according to the present invention.

FIG. 2 is an explanatory diagram showing a difference between an image formed by a wide-angle lens and a telephoto lens, an optical axis center of the wide-angle lens and a telephoto lens, and a position of a human face of a subject in the embodiment.

FIG. 3 is a block diagram showing a configuration of the entire photographing apparatus of the embodiment.

FIG. 4 is an explanatory diagram showing an example of a specific configuration for deflecting the optical axis of a telephoto lens in the device of the embodiment.

FIG. 5 is an explanatory diagram showing another example of a specific configuration for deflecting the optical axis of the telephoto lens.

[Description of Signs] 1 Wide-angle lens 2 Telephoto lens 3 Subject 4 Camera signal processing circuit 5 Specific position detecting device 6 Computing device 7 ROM 8 Distance measuring device 9 Optical axis deflecting device 9a, 9b Rotary drive unit 10 Image sensor 11 Image sensor 12 Camera signal processing circuit 13 Holder 14 Mirror

Claims (2)

[Claims] A first optical system having different optical axes for photographing or observing a subject by the first optical system and then photographing or observing the same subject by the second optical system; An optical axis deflecting means for deflecting an optical axis of the second optical system; a distance measuring means for measuring a distance between the first and second optical systems and a subject; Storage means for storing a shift amount between the optical axes of the first and second optical systems when the optical axes of the first and second optical systems are set so as to intersect with the optical axis of the second optical system at a predetermined distance; The optical axis of the second optical system is deflected together with the optical axis of the first optical system to match the subject based on the distance information and the information on the shift amount of the optical axis at a predetermined distance stored in the storage means. The power angle is obtained by calculation, and the second optical system is controlled by controlling the optical axis deflecting means. Imaging apparatus comprising: the operation control means for angular deflection was determined the optical axis, a. 2. The image processing apparatus according to claim 1, further comprising: a specific position detecting unit configured to detect a position of a specific part in an image of a subject photographed or observed by the first optical system, wherein the arithmetic control unit performs measurement by the distance measuring unit. Along with the resulting distance information and the information on the amount of deviation of the optical axis at a predetermined distance stored in the storage unit, the optical axis of the second optical system is set based on the information on the detection result of the specific position detection unit. Calculating an angle to be deflected in order to match a specific part of the subject with the optical axis of the first optical system aligned,
2. The photographing apparatus according to claim 1, wherein the optical axis deflecting unit is controlled to deflect the optical axis of the second optical system at the determined angle.