JP2017207650A - Lens device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To provide a lens device capable of outputting an image without any discomfort by aligning animations of a real image and of a CG image when the CG image is synthesized by a virtual image synthesizer even under such conditions that an optical vibration-proof function is effective.SOLUTION: A lens device having a vibration-proof function is provided, which is to be applied for a virtual image system to synthesize an image captured by an image pickup device having a vibration-proof function with other images. The lens device includes: image blur correction means for correcting image blur caused by vibration occurring in the lens device; vibration-proof position detection means for detecting a position of the image blur correction means; vibration detection means for detecting vibration of the lens device; control means for controlling the image blur correction means on the basis of the detected vibration; and output means for outputting information about the position of the image blur correction means and of the vibration detected by the vibration detection means to the outside.SELECTED DRAWING: Figure 1

Description

  The present invention relates to a lens apparatus having an optical image stabilization function, and more particularly to an optical image stabilization system that is mounted on a camera body of an interchangeable lens of a television camera for broadcasting or business use and corrects image blur due to vibration or camera shake applied to the lens. The present invention relates to a lens device having a vibration function.

In recent years, a virtual video system has been introduced that synthesizes video produced by computer graphics (hereinafter referred to as CG video) with video taken by a camera in program production.
In the virtual video system, position data such as lens zoom, focus, aperture stop, etc. is output in addition to the video shot by the camera, and the CG video is synthesized with the video shot based on the positional information.

  In addition, there is a lens device for a broadcast or commercial television camera equipped with an optical image stabilization mechanism that corrects image shake due to vibration and camera shake applied to the lens, and an image shake correction optical system so as to cancel image shake caused by vibration. Is driven by an actuator to correct image blur. For example, in Patent Document 1, in order to correct fluctuations in aberration and peripheral light loss caused by the movement of the vibration-proof shift lens, position data such as zoom, focus, and iris, and an analog signal corresponding to the position of the vibration-proof shift lens Is disclosed to a camera.

Japanese Patent No. 5241019

  However, in the prior art disclosed in the above-mentioned patent document, in an optical image stabilization mechanism that corrects image shake due to vibration applied to a lens or camera shake, an image is corrected due to a response delay and control characteristics of a motor (actuator) that corrects image shake. In some cases, the shake cannot be completely corrected. In such a case, even if the lens itself is in a stationary state, an image is output from the camera as if the image stabilization was not corrected by the optical image stabilization mechanism and the remaining vibration was moved in the vertical and horizontal directions. When the video, the CG video, and the virtual video system are combined, the positions of the live-action video and the CG video do not match, resulting in a composite video with a sense of discomfort. In addition, when there is a large amount of residual vibration depending on the installation status of the lens, the optical image stabilization function of the lens must be temporarily disabled when using the virtual video system.

  Even when the optical image stabilization function of the lens is enabled, when the CG video is synthesized by the virtual video synthesizer, the motion of the real video and the CG video are matched so that there is no deviation caused by vibration. Provided is a lens device capable of synthesizing CG images and outputting images without a sense of incongruity.

  In order to achieve the above object, the lens device of the present invention is a lens device having an anti-vibration function, which is applied to a virtual video system that synthesizes an image captured by an imaging device having an anti-vibration function and other images. An image blur correction unit that corrects an image blur caused by the vibration generated in the lens device, an image stabilization position detection unit that detects a position of the image blur correction unit, and a vibration that detects the vibration of the lens device. Output that outputs information on detection means, control means for controlling the image shake correction means based on the detected vibration, position of the image shake correction means, and vibration detected by the vibration detection means to the outside And means.

  A lens apparatus according to another aspect of the present invention is a lens apparatus having an anti-vibration function, which is applied to a virtual video system that synthesizes an image captured by an imaging apparatus having an anti-vibration function and other images. An image blur correction unit that corrects an image blur caused by vibration generated in the lens device, an image stabilization position detection unit that detects a position of the image blur correction unit, a vibration detection unit that detects a vibration of the lens device, and Based on the detected vibration, control means for controlling the image shake correcting means, and based on the position of the image shake correcting means and the detected vibration, the residual vibration that could not be corrected by the image shake correcting means. And an output means for outputting information on the vibration calculated by the after vibration calculation means to the outside.

  According to the present invention, even if the optical image stabilization function of the lens is enabled, the motion of the live-action video and the CG video is matched by the synthesis of the CG video in the virtual video synthesis device, and there is no deviation caused by vibration. It is possible to provide a lens apparatus that can synthesize images and output images without a sense of incongruity.

1 is a configuration diagram of a lens device in Embodiment 1. FIG. 3 is an example of a live-action image of Example 1. It is an example of the CG image | video of Example 1. FIG. 2 is an example of a composite image of Example 1. FIG. FIG. 6 is a configuration diagram of a lens device in Embodiment 2.

  Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. FIG. 1 is a configuration diagram of a lens apparatus having an optical image stabilization function according to an embodiment of the present invention.

  Hereinafter, referring to FIG. 1, the image stabilization function applied to the virtual image system for synthesizing the image captured by the image capturing apparatus having the image stabilization function and the other image according to the first embodiment of the present invention. A configuration of the lens device having the above will be described.

  A camera (camera device) 3 that is an imaging unit is connected to the lens device 1, and an image captured by the camera 3 is connected to a virtual video composition device 4 via a video output unit 31 of the camera 3. . The lens device 1, the camera 3, and the virtual video composition device 4 constitute a virtual video system.

  In addition, the lens apparatus 1 includes an optical system that forms an optical image of a subject and a control unit that drives and controls the optical system. The optical system has a focus lens 11 arranged to be movable in the optical axis direction for focus adjustment, a zoom lens 12 arranged to be movable in the optical axis direction for zoom adjustment, and can be opened and closed for brightness adjustment. And an optical anti-vibration lens (image blur correction means, correction lens) 17 for image stabilization (image blur correction) and other fixed lenses (not shown).

  The focus lens 11 is provided with a drive mechanism (not shown) for driving the focus lens 11 and a focus position detector (focus position detecting means) 14 for detecting the current position. The zoom lens 12 is provided with a drive mechanism (not shown) for driving the zoom lens 12 and a zoom position detector (zoom position detecting means) 15 for detecting the current position. The aperture stop 13 is provided with a drive mechanism (not shown) for driving the aperture stop 13 and an aperture stop position detector (aperture position detecting means) 16 for detecting the current position.

  The optical image stabilization lens 17 includes a pitch drive motor 18a that drives the optical image stabilization lens 17 in the pitch (up and down) direction and a yaw drive motor 18b that drives in the yaw (left and right) direction, and detects the current pitch position. And a yaw detector (anti-vibration position detection means) 19b for detecting the current yaw position.

Also, a pitch direction vibration detection sensor (vibration detection means) (gyro sensor or the like) 20a and a yaw direction vibration detection sensor (vibration detection means) 20b for detecting vibration generated in the lens device 1 are configured and output thereof. Is input to a CPU (control means) 21 which is a control unit. Further, the outputs of the position detectors 14, 15, 16, 19a, 19b of each optical member are input to the CPU 21. The detection values of the position detectors 14, 15, 16, 19 a, 19 b and the vibration detection sensors 20 a, 20 b of each optical member are output from the CPU 21 to the virtual video composition device 4 via the output unit (output means) 23.
In addition, command values such as setting positions and moving speeds of optical systems from operation members (not shown) are input to the CPU 21 from the input unit 22.

  The CPU 21 can control the drive mechanism of each optical member at a desired speed with respect to the focus lens 11, the zoom lens 12, and the aperture stop 13 in accordance with a control signal from the operation member. Position signals output from the position detectors 14, 15, and 16 are input to the CPU 21, whereby the current positions of the optical members 11 to 13 can be detected, and each of the optical members 11 to 13 is driven. Thus, it can be controlled to a desired position.

  In addition, the drive motors 18a and 18b for driving and controlling the optical image stabilization lens 17 in a direction having a component perpendicular to the optical axis can be driven at a desired speed in accordance with a drive signal from the CPU 21. ing. On the other hand, position signals output from the detectors 19a and 19b for detecting the position (pitch and yaw direction) of the optical image stabilization lens 17 are input to the CPU 21, thereby detecting the current position of the optical image stabilization lens 17. , And can be controlled to a desired position.

A vibration signal indicating vibration in each of the pitch direction and the yaw direction generated in the lens apparatus 1 is input to the CPU 21 from the vibration detection sensors 20a and 20b. It is controlled based on the shake signal. With respect to each of the pitch direction and the yaw direction, the CPU 21 calculates a correction amount that cancels the image blur caused by the vibration generated in the lens apparatus 1. Based on the correction amount, the control position of the optical image stabilization lens 17 is calculated, and the optical image stabilization lens 17 is driven. As a result, image blur due to vibration generated in the lens apparatus 1 is corrected. In the drive control of the optical image stabilization lens 17, the position signal from the zoom position detector 15 is also taken into account because the drive amount of the image stabilization lens and the moving amount of the image depend on the zoom position. Further, when the position of the focus lens affects the angle of view, drive control of the optical image stabilization lens 7 is performed in consideration of the position signal from the focus position detector 14.
The lens apparatus 1 and the camera apparatus 3 that captures a subject image formed by the lens apparatus constitute an imaging apparatus having an image stabilization function.

  On the other hand, based on the detection value received from the output unit 23 of the lens apparatus 1, the virtual video composition device 4 synthesizes the real image obtained from the video output unit 31 of the camera 3 and the CG video of the virtual video composition device 4. To create a composite image. For example, assume that an image as shown in FIG. 2 is acquired from a camera. Based on the position information acquired from the lens device 1, the CG image (FIG. 3) created and stored in the virtual image composition device 4 in advance and the live-action image (FIG. 2) are synthesized, so that FIG. Create a composite video like this. By displaying the created composite video on the monitor, it is possible to see a video as if the object created by the CG video in the live-action video exists.

  When the image blur correction function is enabled, the actual shot image output from the camera 3 to the virtual image synthesizing device 4 depends on the response delay and control characteristics of the drive motors 18a and 18b for driving and controlling the optical image stabilization lens 17. In some cases, image blur applied to the lens apparatus 1 cannot be completely corrected. In this case, an image is output as if the lens apparatus 1 was moved in the pitch (up and down) direction and the yaw (left and right) direction by an uncorrected amount of image blur correction.

  The virtual image synthesizing device 4 receives the vibration information detected by the vibration detection sensors 20a and 20b from the lens device 1 in addition to the position information detected by the detectors 14, 15, 16, 19a and 19b of each optical member. . Based on this, an uncorrected amount in which the image blur of the lens apparatus 1 cannot be corrected by the correction function is calculated, and the position of the CG image is corrected by the uncorrected amount to synthesize the image.

  As described above, even if there is an uncorrected amount in which the image blur cannot be corrected by the correction function in the lens device 1, an image is obtained from the position of each optical member output from the lens device 1 and the detection value of the vibration detection sensor. The position of the CG image is corrected and synthesized according to the uncorrected amount of the shake correction function. As a result, it is possible to synthesize the captured video and other images so that the motion of the actual captured video and the CG video match, and no deviation caused by vibration, and output a video with no sense of incongruity. Further, since the correction amount can be calculated by the external virtual image synthesizing device 4, the processing load on the CPU 21 of the lens device 1 can be reduced, and inexpensive parts can be used.

  In this embodiment, the detection values of the position detectors 14, 15, 16, 19 a, 19 b and the vibration detection sensors 20 a, 20 b of each optical member are output from the lens device 1 to the virtual image composition device 4. However, in the single focus lens, the effect of the present invention can be obtained by outputting the position of the optical image stabilization lens 17. In the zoom lens, the effect of the present invention can be obtained by outputting the position of the optical image stabilization lens 17 and the position of the zoom lens. Further, by outputting the position of the focus lens, it is possible to realize a more accurate synthesis of virtual video considering the influence on the focal length (view angle) due to the fluctuation of the focus position. Furthermore, by outputting the position of the focus lens, aperture stop, and zoom lens, more preferable virtual video that is adjusted not only for positional deviation between the captured video and virtual video, but also for blurring considering depth of field Synthesis can also be realized.

The configuration of the lens apparatus according to the second embodiment of the present invention will be described below with reference to FIG.
FIG. 5 is different from FIG. 1 in that an after vibration calculation unit (after vibration calculation means) 24 for calculating an uncorrected portion of the image blur correction function is provided in the lens apparatus 1. A configuration different from FIG. 1 will be described in detail below.

  The CPU 21 receives detection signals indicating vibrations in the pitch direction and the yaw direction generated in the lens device 1 from the vibration detection sensors 20a and 20b. Based on the detection signal, the optical image stabilization lens 17 is controlled so as to cancel the image blur. At this time, the uncorrected portion of the image blur correction function is left based on the vibration information detected by the vibration detection sensors 20a and 20b and the position information detected by the position detectors 19a and 19b of the optical image stabilization lens 17. The vibration calculation unit 24 performs the calculation. In the calculation of the uncorrected amount of the image blur correction function in the after-shake calculation unit 24, since the driving amount of the image stabilizing lens and the moving amount of the image depend on the zoom position, the position signal from the zoom position detector 15 is also taken into consideration. The Further, when the position of the focus lens affects the angle of view, a position signal from the focus position detector 14 is also considered. As a result of the calculation, in addition to the position information detected by the detectors 14, 15 and 16 of each optical member, the uncorrected pitch (up and down) and yaw (left and right) image blur correction functions obtained by the after vibration calculation unit 24 Minutes are output to the virtual video composition device 4 via the output unit 23. In the virtual image synthesizing device 4, the composition position of the CG image is determined based on the position information of the detectors 14, 15, 16 of each optical member received from the lens device 1 and the uncorrected amount of the image shake correction function in the vertical and horizontal directions. Create a composite video.

  In systems where the angle of view is affected by the position of the focus lens, by outputting the position of the focus lens, more precise virtual images that take into account the influence on the focal length (angle of view) due to the change in the focus position are taken into account. Synthesis can be realized. Furthermore, by outputting the position of the focus lens, aperture stop, and zoom lens, more preferable virtual video that is adjusted not only for positional deviation between the captured video and virtual video, but also for blurring considering depth of field Synthesis can also be realized.

  As described above, even if an uncorrected portion in which the image blur cannot be corrected by the correction function remains in the lens device 1, the position of each optical member output from the lens device 1 and the uncorrected portion of the image blur correction function. Thus, the composition position of the CG video is changed. Through this process, when the CG video is synthesized by the virtual video synthesizer 4, the motion of the live-action video and the CG video match, and the shot video and other images are synthesized so that there is no deviation caused by vibration, and the sense of incongruity It is possible to output a video without any noise. Further, since the uncorrected portion of the image blur correction function calculated in the lens device 1 and the position of each optical member are output and synthesized by the virtual video synthesizer 4, it is necessary to frequently communicate with the virtual video synthesizer 4. Therefore, it is possible to reduce communication delay processing.

  In the illustrated embodiment, the case where the image blur correction function is realized by an image blur correction lens that moves with a component perpendicular to the optical axis is illustrated. However, the present invention is limited to this configuration. Never happen. The present invention can also be realized by a mechanism that changes the optical axis direction using a variable apex angle prism. In addition, the image blur correction function may be configured such that the lens system does not have an image blur correction function and the position of the image sensor is moved in a direction having a component perpendicular to the optical axis. In that case, the position of the image sensor is also fed back to the control. Furthermore, the image blur correction function can be applied to an image blur correction function realized by image processing instead of movement of the optical components. In that case, instead of the position of the image blur correction lens and the image sensor, the direction and amount of shifting the image by image processing are used.

  The preferred embodiment of the present invention has been described above. However, a configuration may be adopted in which data is unilaterally transmitted from the lens device 1 to the virtual video composition device 4. Alternatively, each detection is performed when a trigger signal for determining the timing at which the output unit 23 outputs the above-described information necessary for the synthesis of the virtual video is input via the input unit (input unit) 22 from the virtual video synthesis device 4. A value or a calculation result may be output. The present invention is not limited to these embodiments, and various modifications and changes can be made within the scope of the gist.

1: Lens device 3: Camera (camera device)
4: Virtual image synthesizer 17: Lens for optical image stabilization (image blur correction means)
20a, 20b: Vibration detection unit (vibration detection means)
21: CPU (control means)
23: Output unit (output means)

Claims (11)

A lens apparatus having an image stabilization function applied to a virtual image system that synthesizes an image captured by an image capturing apparatus having an image stabilization function and other images,
Image blur correcting means for correcting image blur caused by vibration generated in the lens device;
Anti-shake position detecting means for detecting the position of the image shake correcting means;
Vibration detecting means for detecting vibration of the lens device;
Control means for controlling the image blur correction means based on the detected vibration;
An output means for outputting information on the position of the image blur correction means and the vibration detected by the vibration detection means;
A lens device comprising: A zoom lens, and zoom position detecting means for detecting the position of the zoom lens,
The control means controls the image blur correction means based on the position of the zoom lens and the detected vibration,
The output means outputs information on the position of the image shake correction means, the vibration detected by the vibration detection means, and the position of the zoom lens to the outside.
The lens device according to claim 1. A focus lens and focus position detection means for detecting the position of the focus lens;
The control means controls the image blur correction means based on the position of the zoom lens, the position of the focus lens, and the detected vibration,
The output means outputs information on the position of the image shake correction means, the vibration detected by the vibration detection means, the position of the zoom lens, and the position of the focus lens to the outside.
The lens apparatus according to claim 2. An aperture stop, and aperture position detecting means for detecting the position of the aperture stop,
The output means outputs information on the position of the image shake correction means, the vibration detected by the vibration detection means, the position of the zoom lens, the position of the focus lens, and the position of the aperture stop.
The lens device according to claim 2 or 3, wherein A lens apparatus having an image stabilization function applied to a virtual image system that synthesizes an image captured by an image capturing apparatus having an image stabilization function and other images,
Image blur correcting means for correcting image blur caused by vibration generated in the lens device;
Anti-shake position detecting means for detecting the position of the image shake correcting means;
Vibration detecting means for detecting vibration of the lens device;
Control means for controlling the image blur correction means based on the detected vibration;
Based on the position of the image blur correction unit and the detected vibration, a residual vibration calculation unit that calculates a residual vibration that could not be corrected by the image blur correction unit;
Output means for outputting information on vibrations calculated by the after vibration calculation means to the outside;
A lens device comprising: A zoom lens, and zoom position detecting means for detecting the position of the zoom lens,
The control means controls the image blur correction means based on the position of the zoom lens and the detected vibration,
The after vibration calculating means calculates an after vibration that could not be corrected by the image shake correcting means, based on the position of the zoom lens, the position of the image shake correcting means, and the detected vibration;
The lens device according to claim 5, wherein: A focus lens and focus position detection means for detecting the position of the focus lens;
The control means controls the image blur correction means based on the position of the zoom lens, the position of the focus lens, and the detected vibration,
The after-shake calculating means could not be corrected by the image shake correcting means based on the position of the zoom lens, the position of the focus lens, the position of the image shake correcting means, and the detected vibration. Calculate after vibration,
The lens device according to claim 6. An aperture stop, and aperture position detecting means for detecting the position of the aperture stop,
The output means outputs the information of the position of the optical system, the vibration calculated by the after vibration calculation means, and the position of the aperture stop,
The lens device according to claim 6 or 7, wherein The lens apparatus includes an input unit that inputs a trigger signal that determines a timing at which the output unit outputs the information.
The output means outputs the information to the outside based on the trigger signal from the input means.
The lens device according to claim 1, wherein the lens device is a lens device.   The lens apparatus according to claim 1, wherein the image blur correction unit is a correction unit including a correction lens that moves in a direction having a component perpendicular to the optical axis. The lens device according to any one of claims 1 to 10,
A camera device for capturing an optical image formed by the lens device;
Based on the information output from the output unit of the lens apparatus, even when image blur correction by the image blur correction unit of the lens apparatus is performed, the camera apparatus prevents the deviation due to vibration from occurring. A video synthesizer that synthesizes the captured video and other images;
A virtual video system.

Images