JP2012147082A - Image pickup device and control method thereof - Google Patents

Abstract

PROBLEM TO BE SOLVED: To control the field angle of an image pickup optical system on the wide-angle side of a camera having plural image pickup optical systems when the focal distance of an image pickup optical system on the narrow-angle side has been changed, thereby enabling the user to keep track of the main subject easily.SOLUTION: The image pickup device includes a first image pickup optical system 1 and a second image pickup optical system 2. A video signal processing unit 4 processes a first picture image photographed at a field angle of the first image pickup optical system 1 and a second picture image photographed at an angle wider than the first image pickup optical system 1 by the second image pickup optical system 2 and then outputs video signals of the first and the second picture images to a display unit 5. A control unit 3, when the focal distance of the first image pickup optical system 1 has been changed, outputs an instruction for changing a magnification of the second picture image according to the focal distance of the first image pickup optical system 1 to the video signal processing unit 4, thereby controlling a field angle of the second image pickup optical system 2.

Description

  The present invention relates to an imaging apparatus having a plurality of imaging optical systems and a control method thereof.

In recent years, compact digital cameras have come up with products with a long focal length and a high magnification lens, and can display far-field subjects on the display screen. However, on the other hand, even if the camera tilts or the main subject moves slightly due to slight camera shake, the user can easily miss the main subject from the angle of view. Once the main subject is missed from the angle of view, the user needs to temporarily return the focal length of the photographic lens to the wide-angle side in order to search for the main subject again, and to capture the main subject again by widening the angle of view.
Therefore, a camera having a plurality of imaging optical systems in a single camera housing has been proposed. For example, when a plurality of imaging optical systems are composed of a first imaging optical system and a second imaging optical system, the first imaging optical system is an optical system having a relatively narrow angle of view (hereinafter referred to as a tele-side optical system), The second imaging optical system is an optical system having a relatively wide angle of view (hereinafter referred to as a wide side optical system). In the apparatus disclosed in Patent Document 1, when the same main subject is photographed by both optical systems, the images photographed by the respective optical systems are simultaneously displayed as an entire image and an enlarged image.

  If the camera having such a configuration is used, an image photographed by the wide-side optical system can be confirmed even when the user misses the main subject from the angle of view when photographing with the high-power lens as described above. Therefore, the user can search for the main subject and capture it again without changing the angle of view of the tele-side optical system. The image and display state at that time are illustrated in FIG. FIG. 3A illustrates a first image in a state where the main subject (automobile in this example) is captured by the tele-side optical system, and FIG. 3B illustrates that the main subject deviates from the angle of view of the tele-side optical system. An example of an image that has been displayed is shown. Here, the angle of view of the tele-side optical system is indicated by a dotted frame in the image of the wide-side optical system. Since the second image captured by the wide-side optical system is displayed on the screen, the user can easily grasp where the main subject is and can capture the main subject again by the tele-side optical system.

JP 2007-74696 A

In the case of an apparatus using a high-power lens in the tele-side optical system in the prior art, even if the size of the subject image captured by the tele-side optical system is appropriate, if the wide-side optical system has a wide angle of view, it is wide. There is a problem with the display size of the subject image by the side optical system. As shown in FIG. 4A, if the main subject captured by the wide-side optical system is displayed small, it becomes difficult for the user to recognize the main subject. This is expected to become more prominent as the magnification increases further in the future.
Accordingly, an object of the present invention is to enable a user to control the angle of view of the wide-angle imaging optical system when the focal length of the narrow-angle imaging optical system is changed in a camera having a plurality of imaging optical systems. It is to make it easy to grasp the main subject.

  In order to solve the above-described problem, an apparatus according to the present invention is an imaging apparatus including display means for displaying each image captured by a first imaging optical system and a second imaging optical system, and the first imaging optical system And processing the first image picked up by the second image pickup optical system at a wider angle than the angle of view of the first image pickup optical system, and processing the first image and the second image. A video signal processing means for outputting a video signal indicating to the display means, and when the focal length of the first imaging optical system is changed in a direction that increases, the enlargement ratio of the second image is increased, Control means for controlling the display of the second image by outputting, to the video signal processing means, an instruction to reduce the enlargement ratio of the second image when the focal length of the image pickup optical system is changed in a direction that decreases. .

  According to the present invention, when the focal length of the first imaging optical system on the narrow angle side is changed, the user can easily grasp the main subject by controlling the angle of view of the second imaging optical system on the wide angle side. .

It is a figure which shows the structural example of the imaging device which concerns on 1st and 2nd embodiment of this invention. It is a flowchart which shows the process example in 1st Embodiment of this invention. It is a figure which shows the example of an image imaged with the some imaging optical system. It is a figure which shows the image example (A) for demonstrating the subject of this invention, and the image example (B) obtained by a some imaging optical system, when 1st Embodiment of this invention is applied. It is a flowchart which shows the process example in 2nd Embodiment of this invention. It is a figure which shows the structural example of the imaging device which concerns on 3rd and 4th embodiment of this invention.

  Embodiments of the present invention will be described below in detail with reference to the accompanying drawings.

[First Embodiment]
FIG. 1 shows a configuration example of an imaging apparatus according to the first embodiment of the present invention. The imaging apparatus shown in this example includes a first imaging optical system 1 and a second imaging optical system 2, and these are controlled by the control unit 3. Hereinafter, the first imaging optical system 1 will be described as a tele side optical system, and the second imaging optical system 2 will be described as a wide side optical system.
The difference between the first imaging optical system 1 and the second imaging optical system 2 is that only the first imaging optical system 1 has a zoom lens 13a. Since the rest of the configuration is the same, the components of the first imaging optical system 1 will be described below (the reference numerals are appended to distinguish them), and the components of the second imaging optical system 2 are labeled. A detailed description thereof will be omitted by adding a subscript b to.

The first imaging optical system 1 includes a zoom lens 13a, and further includes a shutter / aperture unit 14a, a shift lens 15a, and a focus lens 16a. The position of the zoom lens 13a can be changed along the optical axis direction, and the magnification is changed. The zoom drive control unit 19a drives the zoom lens 13a. A shutter / aperture unit 14a disposed at the rear stage of the zoom lens 13a adjusts the exposure amount. The shutter / aperture drive control unit 20a controls the exposure by adjusting the drive of the shutter / aperture unit 14a. The shift lens 15a can be repositioned in a plane substantially perpendicular to the optical axis, and constitutes a shake correction optical system. The shift lens drive control unit 21a controls the drive of the shift lens 15a. The focus lens 16a is a lens for performing focus adjustment, and its position can be changed along the optical axis direction. The focus drive controller 22a controls the focus lens 16a to adjust the focus.
The image sensor 17a receives light from a subject that has passed through the lens group and converts it into an electrical signal. The image sensor 17a generates an image signal related to the tele-side optical system. Note that the image pickup device 17b constituting the second image pickup optical system 2 generates an image pickup signal related to the wide side optical system.
The imaging signal processing unit 18 a converts the output signal of the imaging element 17 a into a video signal and outputs the image data to the video signal processing unit 4. The imaging signal processing unit 18 b of the second imaging optical system 2 processes the output signal of the imaging element 17 b and outputs image data to the video signal processing unit 4 and the motion vector detection unit 6. The video signal processing unit 4 performs predetermined image processing on the image data output from the imaging signal processing units 18 a and 18 b, and outputs a displayable image signal to the display unit 5. Further, the video signal processing unit 4 has a function of cutting out image data of the imaging signal processing unit 18b in response to a control instruction such as an image enlargement rate from the control unit 3 described later, and outputting an image signal enlarged by electronic zoom processing. Have.

The control unit 3 controls the entire system, for example, controls each drive control unit included in the imaging optical systems 1 and 2. The control unit 3 performs display control of the display unit 5 and displays an image on the display screen according to the image signal output from the video signal processing unit 4. The control unit 3 performs various processes according to a program interpreted and executed by a CPU (Central Processing Unit) (not shown) or the like.
The motion vector detection unit 6 detects a motion vector of the image from the image data output from the imaging signal processing unit 18b of the second imaging optical system 2. As an example of the motion vector detection method, the present embodiment employs a matching method in which the current field image and the previous field image are compared and contrasted for each predetermined representative point or pixel. Specifically, the motion vector detection unit 6 performs horizontal and vertical shift operations on the image of the previous field with respect to the image of the current field within the screen to collate both, and moves with the most suitable shift amount and direction. Let the magnitude and direction of the vector.

The zoom switch 7 is used by the user to operate the zoom lens 13 a, and the operation instruction signal is sent to the control unit 3. The external input / output terminal unit 8 mediates communication between the imaging device and an external device (not shown). Video signals and audio signals are input from the external device to the external input / output terminal unit 8, and video signals and audio signals are output from the external input / output terminal unit 8 to the external device.
In the shutter release switch 9, a first switch (hereinafter referred to as SW1) and a second switch (hereinafter referred to as SW2) are sequentially turned on in accordance with the push amount. When the user operates the shutter release button halfway, SW1 is turned on, and when the user further pushes the shutter release button deeply to the end, SW2 is turned on. The ON / OFF signals of SW1 and SW2 are transmitted to the control unit 3.
The storage unit 10 stores the image data output from the imaging signal processing units 18a and 18b, the image data output from the video signal processing unit 4, and the like. The storage unit 10 stores a control program that is interpreted and executed by the control unit 3. The power supply unit 11 supplies a power supply voltage to each unit of the imaging apparatus. The angular velocity sensor 12 for shake detection includes sensors for horizontal direction detection and vertical direction detection, and detects an angular velocity with respect to shake of the imaging apparatus. Based on the detection signal from the angular velocity sensor 12, the control unit 3 issues a control command to the shift lens drive control units 21a and 21b, and performs image stabilization control.

  The control method of the imaging apparatus of the present embodiment is realized by the control unit 3 controlling the drive control unit and the processing unit of the imaging apparatus, and the function of the imaging apparatus is realized by a computer program that is interpreted and executed by the CPU. . The computer program is provided by a readable recording medium or by network communication via a communication interface.

Next, automatic focus adjustment (AF) processing, automatic exposure (AE) processing, and zoom drive control processing in the imaging apparatus shown in FIG. 1 will be described.
When the user operates the shutter release switch 9 and an ON signal of SW1 is input to the control unit 3, the control unit 3 instructs the focus drive control units 22a and 22b to execute AF processing. Upon receiving the instruction from the control unit 3, the focus drive control units 22a and 22b drive the focus lenses 16a and 16b, respectively. The control unit 3 instructs the shutter / aperture drive control units 20a and 20b to execute the AE process. Specifically, the shutter / aperture drive controllers 20a and 20b drive the shutter / aperture units 14a and 14b, respectively, to set the exposure amount to an appropriate value.

Thereafter, when an ON signal of SW2 is input to the control unit 3, the control unit 3 instructs the imaging elements 17a and 17b to perform imaging. The imaging elements 17a and 17b convert the received light images into electric signals, and the imaging signal processing units 18a and 18b output image data, respectively. The video signal processing unit 4 outputs an image signal to the display unit 5 based on the image data. The display form of the image in the display unit 5 includes, for example, a form in which the captured images obtained by the imaging optical systems 1 and 2 are divided and displayed on the screen. Further, in a normal state, the display unit 5 displays an image by the second imaging optical system 2, and the control unit 3 displays an image by the first imaging optical system 1 by a turn-on signal of SW 1 and a part of the display screen of the display unit 5 There is a form to be displayed. Various display methods can be used depending on the situation.
The control unit 3 causes the storage unit 10 to store the image data output from the imaging signal processing units 18 a and 18 b and the image data output from the video signal processing unit 4. Further, the control unit 3 receives an operation signal when the user operates the zoom switch 7, and issues an instruction to the zoom drive control unit 19a. The zoom drive control unit 19a moves the zoom lens 13a to the zoom position instructed from the control unit 3, and performs zoom drive control.

Hereinafter, the operation of the imaging apparatus will be described with reference to the flowchart of FIG.
In S101, the control unit 3 detects the zoom switch 7. When the user operates the zoom switch 7, the process proceeds to S102, and when the operation of the zoom switch 7 is not detected, the determination process of S101 is repeated.
In S102, the zoom lens 13a of the first imaging optical system 1 is driven by the control instruction of the control unit 3, and the focal length is changed. In step S 103, the control unit 3 issues a control command to the video signal processing unit 4, changes the image cutting frame by the second imaging optical system 2 in accordance with the focal length of the first imaging optical system 1, and the electronic zoom magnification. To change. That is, when the focal length of the first imaging optical system 1 is increased, the video signal processing unit 4 increases the electronic zoom magnification by reducing the image cutting frame by the second imaging optical system 2. Conversely, when the focal length of the first imaging optical system 1 is reduced, a process for reducing the electronic zoom magnification by increasing the image cutout frame by the second imaging optical system 2 is performed. In this way, the magnification of the electronic zoom related to the second imaging optical system 2 is changed in accordance with the focal length of the first imaging optical system 1. In this case, the electronic zoom magnification according to the second imaging optical system 2 is constant so that the angle of view corresponds to a preset ratio (for example, 3 times) with respect to the angle of view of the first imaging optical system 1. It is possible to adopt a control form that changes at a rate of.

FIG. 4B shows an example of an image according to the present embodiment, the first image taken by the first imaging optical system 1 is shown on the right side, and the second image taken by the second imaging optical system 2 is shown on the left side. . The second image shows an example of a photographed image with a magnification obtained by the electronic zoom process, and the image is displayed at an angle of view at which the user can sufficiently recognize the subject. That is, at the time of super-telephoto shooting at a high magnification shown in FIG. 4A, it is difficult for the user to recognize the subject in the image by the wide-side optical system, but the second image on the wide side as shown in FIG. The subject image is displayed in an appropriate size.
In S104, the control unit 3 determines whether or not the power supply unit 11 has been turned off. If the power supply unit 11 is in the ON state, the process returns to S101, and if the power supply unit 11 is in the OFF state, the process ends.

  According to the first embodiment, in an imaging apparatus having a plurality of imaging optical systems, even when a high-magnification lens is used for the imaging optical system on the narrow angle side, the user mainly looks at an image captured by the imaging optical system on the wide angle side. You can easily grasp the subject. That is, even when the tele-side optical system is super-telephoto, the angle of view of the wide-side optical system is always properly controlled, so that it is possible to prevent the subject image from being difficult to see in the wide-side image.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. Since the configuration of the imaging apparatus according to the second embodiment is the same as the configuration illustrated in FIG. 1, detailed description of each unit is omitted by using the reference numerals used in the description of the first embodiment also in the second embodiment. .

Hereinafter, the operation of the imaging apparatus according to the second embodiment will be described with reference to the flowchart of FIG. The processing of S203 to S207, which is the difference from FIG. 2, will be described.
After S102 or when the operation of the zoom switch 7 is not detected in S101, the process proceeds to S203. The control unit 3 determines the change in the imaging state. As a result, when camera shake is detected by the angular velocity sensor 12, the process proceeds to S204. If the motion vector detection unit 6 detects a motion of the image during imaging, the process proceeds to S205. If the movement of the main subject (main subject) as a shooting target is detected by the video signal processing unit 4, the process proceeds to S206. If no change in the shooting state is detected in S203, the process is the same as in FIG. 2 (see S103), and the description thereof is omitted.
In S204, the control unit 3 obtains a detection signal from the angular velocity sensor 12 and calculates a camera shake amount. In S205, the motion vector detection unit 6 calculates the motion vector amount of the image, and the control unit 3 acquires the calculation result. Since the motion vector amount detection processing method is known, detailed description thereof is omitted. In S206, the control unit 3 calculates the distance between the main subject image and the angle of view frame of the first imaging optical system 1. That is, the control unit 3 calculates how far the main subject image in the image has deviated from the field angle frame of the first imaging optical system 1.

Here, the main subject specifying process will be described. For example, there is a method of specifying a main subject by a user operating a touch panel provided in an image display unit. In this method, the user determines the main subject image while looking at the image display unit, and selects the main subject by touching the touch panel at that position. The selection signal at this time is sent to the control unit 3 and used as position information of the main subject. In another specific method, the user instructs the imaging apparatus to perform the focusing process by operating SW1, and the control unit 3 recognizes the portion having the highest focusing evaluation value as the main subject, and sets the image pattern of the main subject image. The main subject is specified by storing it in the memory. In addition to these methods, there is a method for specifying a main subject by face detection or pattern matching processing with a previously registered image.
When camera shake, subject blur, main subject movement, or the like is detected in S204 to S206, the main subject may deviate not only from the tele-side optical system but also from the angle of view of the wide optical system. Therefore, in S207, the control unit 3 sends a control command to the video signal processing unit 4, and the main subject is changed when the image clipping frame by the second imaging optical system 2 is changed in accordance with the focal length of the first imaging optical system 1. The electronic zoom magnification is changed so as not to deviate from the angle of view of the second imaging optical system 2. For example, the angle of view of the second imaging optical system 2 which is normally set to 3 times the angle of view of the first imaging optical system 1 is set to a ratio (4 times, etc.) exceeding 3 times, and the angle of view. The process of expanding is performed. That is, the electronic zoom magnification is set so that the main subject does not deviate from the angle of view of the wide side optical system. Here, with respect to the value of the electronic zoom magnification for widening the angle of view of the wide-side optical system, the amount calculated in any of S204 to 206 along with the focal length of the first imaging optical system 1 changed in S102, or It is calculated using two or more of them.

  In the second embodiment, since the focal length of the first imaging optical system using the high magnification lens is large, when performing control to change the angle of view of the second imaging optical system in accordance with the focal length, the second imaging optical system This prevents the main subject from being removed from the angle of view. Therefore, even if the main subject deviates from the angle of view of the tele-side optical system due to camera shake or the like, the user can check the position of the main subject by looking at the display image of the wide-side optical system. The framing can be adjusted to the main subject in the optical system.

[Third Embodiment]
Next, a third embodiment of the present invention will be described. In the imaging apparatus according to the third embodiment, as shown in FIG. 6, the first imaging optical system 1 and the second imaging optical system 2 have the same configuration, both of which are a zoom lens (see 13a and 13b) and zoom drive control. Part (see 19a, 19b). Since the other configuration is the same as that of the first embodiment, the same reference numerals used in the first embodiment are also used in the second embodiment, and detailed description of each part is omitted.
In the operation of the imaging apparatus according to the third embodiment, S103 is a process different from FIG. Here, the control unit 3 issues a control command to the zoom drive control unit 19b of the second imaging optical system 2, and changes the focal length of the second imaging optical system 2 in accordance with the focal length of the first imaging optical system 1. That is, when the focal length of the first imaging optical system 1 is increased, the optical zoom magnification of the second imaging optical system 2 is increased, and conversely, when the focal length of the first imaging optical system 1 is decreased. Processing for reducing the optical zoom magnification of the second imaging optical system 2 is performed.
As described above, in the third embodiment, the optical zoom magnification according to the second imaging optical system 2 is changed in accordance with the focal length of the first imaging optical system 1.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described. Since the imaging apparatus according to the fourth embodiment has the same configuration as that illustrated in FIG. 6, the reference numerals used in the third embodiment are also used in the fourth embodiment, and detailed description of each unit is omitted.
In the operation of the imaging apparatus according to the fourth embodiment, S207 is a process different from FIG. Here, the control unit 3 issues a control command to the zoom drive control unit 19b of the second imaging optical system 2, and changes the focal length of the second imaging optical system 2 in accordance with the focal length of the first imaging optical system 1. That is, in the fourth embodiment, similarly to the third embodiment, a process of changing the optical zoom magnification of the second imaging optical system 2 is performed instead of changing the electronic zoom magnification. In addition, when the focal length of the first imaging optical system 1 is changed in S102 of FIG. 5, it is possible to change both the electronic zoom magnification and the optical zoom magnification according to the second imaging optical system 2 in S207. .

  As mentioned above, although preferable embodiment of this invention was described, this invention is not limited to these embodiment, A various deformation | transformation and change are possible within the range of the summary.

DESCRIPTION OF SYMBOLS 1 1st imaging optical system 2 2nd imaging optical system 3 Control part 4 Image | video signal processing part 5 Display part 6 Motion vector detection part 12 Angular velocity sensor 13a, 13b Zoom lens 17a, 17b Imaging element 19a, 19b Zoom drive control part

Claims (8)

An imaging apparatus comprising display means for displaying each image captured by a first imaging optical system and a second imaging optical system,
Processing the first image picked up at the angle of view of the first image pickup optical system and the second image picked up by the second image pickup optical system at a wider angle than the angle of view of the first image pickup optical system; Video signal processing means for outputting a video signal indicating one image and a second image to the display means;
The magnification of the second image is increased when the focal length of the first imaging optical system is increased, and the focal length of the first imaging optical system is decreased. An imaging apparatus comprising: control means for outputting an instruction to reduce the enlargement ratio of the second image to the video signal processing means to control display of the second image. The video signal processing means performs a process of changing an electronic zoom magnification by changing a cutout frame of the second image,
The control means reduces the cutout frame of the second image to increase the electronic zoom magnification when the focal length of the first imaging optical system is increased, and increases the electronic zoom magnification. 2. The video signal processing means is instructed to increase the cut-out frame of the second image and decrease the electronic zoom magnification when the focal length of the video signal is changed in a decreasing direction. Imaging device. An imaging apparatus comprising display means for displaying images captured by a first imaging optical system and a second imaging optical system each having a zoom lens and a drive control means,
Processing the first image picked up at the angle of view of the first image pickup optical system and the second image picked up by the second image pickup optical system at a wider angle than the angle of view of the first image pickup optical system; Video signal processing means for outputting a video signal indicating one image and a second image to the display means;
When the zoom magnification of the second imaging optical system is increased when the focal length of the first imaging optical system is increased, and when the focal length of the first imaging optical system is decreased. An image pickup apparatus comprising: a control unit that outputs an instruction to reduce the zoom magnification of the second image pickup optical system to the drive control unit. Provided with shake detection means for detecting shake applied to the imaging device;
The control means obtains a detection signal from the shake detection means, calculates the shake amount, changes the magnification rate of the second image, and performs control to widen the angle of view of the second imaging optical system. The imaging apparatus according to any one of claims 1 to 3, wherein Comprising a motion vector detection means for detecting a motion vector from an image;
The control means performs control to change an enlargement ratio of the second image in accordance with the magnitude and direction of the motion vector obtained from the motion vector detection means to widen the angle of view of the second imaging optical system. The imaging device according to any one of claims 1 to 4.   The control means specifies a main subject image from the first image and the second image, and when the main subject is out of the angle frame of the first imaging optical system, the distance between the angle frame and the main subject image 6. The image pickup apparatus according to claim 1, wherein control is performed to calculate an angle of view and change a magnification ratio of the second image to widen an angle of view of the second image pickup optical system. A control method executed by an imaging apparatus including a display unit that displays each image captured by a first imaging optical system and a second imaging optical system,
Obtaining a first image captured at an angle of view of the first imaging optical system, and acquiring a second image captured by the second imaging optical system at a wider angle than the angle of view of the first imaging optical system; When,
The magnification of the second image is increased when the focal length of the first imaging optical system is increased, and the focal length of the first imaging optical system is decreased. Outputting an instruction to reduce the enlargement ratio of the second image to the video signal processing means to perform display control of the second image;
A method for controlling an image pickup apparatus, comprising: outputting a video signal indicating the first image and the second image to the display means. A control method executed by an image pickup apparatus including a display means for displaying each image picked up by a first image pickup optical system and a second image pickup optical system each having a zoom lens and a drive control means,
Obtaining a first image captured at an angle of view of the first imaging optical system, and acquiring a second image captured by the second imaging optical system at a wider angle than the angle of view of the first imaging optical system; When,
When the zoom magnification of the second imaging optical system is increased when the focal length of the first imaging optical system is increased, and when the focal length of the first imaging optical system is decreased. Outputting to the drive control means an instruction to reduce the zoom magnification of the second imaging optical system;
A method for controlling an image pickup apparatus, comprising: outputting a video signal indicating the first image and the second image to the display means.

Images