JP2017111430A - Control device and imaging device - Google Patents

Abstract

PROBLEM TO BE SOLVED: To achieve an image blur correction which facilitates framing by a photographer and a subject tracking control.SOLUTION: An image pickup device includes a shake correction angle calculation part 109, calculates a correction amount of an image blur by acquiring a shake detection signal, and performs a control of an image blur correction. A subject detection part 117 acquires position information of the subject by detecting a position of the subject in a photographing image. A track amount calculation part 118 performs a track control of the subject by moving a position of the subject inside the photographing image on the basis of the position information of the subject. The blur correction angle calculation part 109 changes an image blur correction effect according to a plurality of control states including a first state not set to a mode in which the tracking of the subject can be selected and a second state set to the mode in which the mode is set and the subject can be selected. The characteristic for calculating the correction amount is changed so that the image blur correction effect in the second state becomes higher than the image blur correction effect in the first state.SELECTED DRAWING: Figure 2

Description

  The present invention relates to a technology of a control device and an imaging device.

  Imaging devices include devices having an image blur correction function that suppresses image blur due to camera shake, a face detection function when a subject is a person, and a human body detection function. For example, a pattern for determining a person's face is determined in advance, and a portion that matches the pattern included in the captured image is detected as a person's face image. The detected face image of the person is referred to by focusing control, exposure control, or the like.

  When shooting a moving subject or shooting with a telephoto lens having a large focal length, there are the following problems. When the subject moves and deviates from the shooting angle of view, a special technique of the photographer is required to accurately track the moving subject only by manual operation. Further, when shooting with a camera having a telephoto lens, it is difficult to hold the main subject at the center of the shot image because the influence of image blur due to camera shake increases. When the photographer operates the camera to capture the subject within the angle of view, image blur correction is performed according to the amount of camera shake when the photographer intends to operate the camera. Therefore, depending on the influence of image blur correction control, it is difficult to perform fine adjustment operations performed by the photographer in order to capture the subject within the angle of view or to position the subject image at the center of the captured image.

  Patent Document 1 discloses an imaging apparatus that automatically tracks a subject by moving a part of an optical system in a direction intersecting an optical axis. The position of the subject is detected from the image signal acquired by the image sensor, and the subject tracking calculation amount is calculated. The imaging apparatus performs subject tracking control while correcting image blur by combining the subject tracking calculation amount with the blur correction calculation amount.

JP 2010-93362 A

In a system that performs subject tracking so that the position of the subject image is held at a specific position (for example, the center position) in the photographed image, there has not been sufficient study on performing subject tracking control and image blur correction simultaneously. It may be difficult for the photographer to perform framing.
An object of the present invention is to realize image blur correction and subject tracking control that are easy for a photographer to perform framing.

  An apparatus according to an embodiment of the present invention acquires a shake detection signal detected by a shake detection unit, calculates an image blur correction amount, and controls a correction control unit that controls the image blur correction unit that corrects the image blur. Detecting the position of the subject in the captured image and acquiring the position information of the subject in the captured image; and based on the position information of the subject acquired by the subject detecting means, Tracking control means for performing tracking control, and setting means for setting a control state of the tracking control means. The setting means includes a plurality of control states including a first state in which a subject tracking mode is not set and a second state in which the mode is set and a tracking target subject can be selected. The control state of the tracking control unit is set by selecting the control state to be set, and the correction control unit acquires the information of the control state selected from the setting unit, and the first control unit Control for changing the characteristic for calculating the correction amount is performed so that the image blur correction effect in the second state is higher than the image blur correction effect in the state.

  According to the present invention, it is possible to realize image blur correction and subject tracking control that are easy for a photographer to perform framing.

It is a figure explaining the shake direction of the imaging device and imaging device which concern on 1st Embodiment. It is a figure which shows the structural example of the imaging device which concerns on 1st Embodiment. It is a figure explaining tracking control of the detected subject. It is a functional block diagram of the tracking amount calculation part in 1st Embodiment. It is a figure explaining the subject specification method of tracking control in a 1st embodiment. It is explanatory drawing of the vibration-proof cutoff frequency setting according to the to-be-photographed object position in 1st Embodiment. It is a flowchart explaining the control in 1st Embodiment. It is a figure which shows typically the imaging device which concerns on 2nd Embodiment. It is a figure which shows the structural example of the imaging device which concerns on 2nd Embodiment. It is a figure which shows the structural example of the imaging device which concerns on 3rd Embodiment. It is a figure which shows the structural example of the imaging device which concerns on 4th Embodiment. It is a figure explaining the example of the state of an imaging device in tracking control which concerns on 4th Embodiment, and a timing chart. It is a figure explaining the example of the state of an imaging device in tracking control which concerns on 4th Embodiment, and a timing chart. It is a figure explaining the example of the state of an imaging device in tracking control which concerns on 4th Embodiment, and a timing chart. It is a figure explaining the example of the state of an imaging device in tracking control which concerns on 4th Embodiment, and a timing chart. It is a figure explaining the example of the state of an imaging device in tracking control which concerns on 4th Embodiment, and a timing chart. It is a figure explaining the warning notification method in the imaging device concerning a 4th embodiment. It is a figure explaining the warning notification method in the imaging device concerning a 4th embodiment.

  Hereinafter, each embodiment according to the present invention will be described in detail with reference to the drawings. Each embodiment exemplifies an imaging device equipped with a control device having a function of detecting shake and correcting image blur and a function of automatically tracking a subject. The present invention is not limited to a digital camera and a digital video camera, but can be applied to an imaging apparatus such as a surveillance camera, a Web camera, and a mobile phone. In addition, the present invention can be applied to either a lens interchangeable camera or a lens integrated camera.

[First Embodiment]
In the present embodiment, an example of a system that performs subject tracking so as to hold the position of the subject image at a specific position (for example, the center position) in the captured image will be described. In such a system, the photographer does not need to perform a framing operation to track the subject during tracking control. At this time, if the effect of blur correction (hereinafter referred to as image blur correction effect) is increased by widening the frequency band of the control characteristics when correcting image blur, it is possible to perform smooth subject tracking while eliminating the influence of camera shake and the like. Shooting is possible.

  However, when such subject tracking is performed, the photographer can perform tracking by designating a subject within the screen in order to photograph a desired subject, but it may be difficult to designate the subject itself. For example, when the focal length of the taking lens is very large (such as 1000 mm or more), the subject image moves due to the influence of camera shake, and it is difficult to frame the subject by capturing it within the angle of view. In this case, if the image blur correction control characteristic is widened to increase the image blur correction effect, the difficulty of framing due to the influence of camera shake can be suppressed. However, if the image blur correction effect is increased, the amount of camera shake when the photographer intentionally operates the camera even if the photographer operates the camera so that the subject falls within the shooting angle of view when the subject moves. Image blur correction will be performed. Depending on the degree of the image blur correction effect, it may be difficult to recapture the subject within the angle of view, or it may be difficult to finely adjust the position of the subject image to the center position of the captured image. Therefore, in the present embodiment, an imaging apparatus that includes a control device that performs image blur correction and subject tracking control and that can improve the ease of framing by a photographer will be described.

  FIG. 1 is a diagram for explaining a shake direction of an imaging apparatus according to each embodiment of the present invention. The control device mounted on the imaging device 101 includes an image blur correction device and a subject tracking control device. Since this control device controls the position of the subject image by image blur correction and subject tracking, it may be referred to as an image position control device in this specification. FIG. 2 is a diagram illustrating a configuration of the imaging unit of the imaging apparatus 101 and functional blocks of image blur correction processing and automatic tracking processing executed by a CPU (Central Processing Unit) 105 provided in the imaging apparatus 101.

  The image blur correction apparatus performs image blur correction with respect to angular shakes in the pitch direction and the yaw direction indicated by arrows 103p and 103y with respect to the optical axis 102, for example. In the three-dimensional orthogonal coordinate system, the Z-axis direction is defined as the optical axis direction, the first axis orthogonal to the Z-axis is defined as the X-axis, and the Z-axis and the second axis orthogonal to the X-axis are defined as the Y-axis. The direction around the X axis indicated by the arrow 103p is the pitch direction, and the direction around the Y axis indicated by the arrow 103y is the yaw direction.

  A release switch 104 for moving the shutter is provided in the main body of the imaging apparatus 101, and an open / close signal of the switch is sent to the CPU 105 by operating the release switch 104. The release switch 104 is a two-stage switch in which the first switch (SW1) and the second switch (SW2) are sequentially turned on according to the amount of pressing. SW1 is turned on when the release switch 104 is depressed about half, and SW2 is turned on when the release switch 104 is pushed to the end. When SW1 is turned on, focus adjustment is performed by driving the focus lens, and an appropriate exposure amount is set by driving the diaphragm. When SW2 is further turned on, image data obtained from the light image exposed to the image sensor 106 is recorded on the recording medium.

  The CPU 105 functions as a control device of this embodiment. This embodiment can be applied to any optical apparatus that includes the CPU 105. A shake correction lens (hereinafter also referred to as a correction lens) 108 and an image sensor 106 are positioned on the optical axis 102 of the imaging optical system. The correction lens 108 moves in a direction different from the optical axis 102 to correct image blur of the subject image on the screen. The imaging apparatus 101 includes angular velocity detection means (hereinafter referred to as an angular velocity meter) that detects angular velocity of angular shake. The angular velocity meter 103 detects angular fluctuations in the rotation direction (pitch direction) around the X axis indicated by the arrow 103p in FIG. 1 and in the rotation direction (yaw direction) around the Y axis indicated by the arrow 103y. The detection signal output from the angular velocity meter 103 is input to the CPU 105, and the shake correction angle calculation unit 109 calculates the shake correction angle. The output of the shake correction angle calculation unit 109 is input to the sensitivity adjustment unit 114.

When the automatic tracking control of the subject is not performed, the shake correction angle calculation unit 109 calculates the shake correction angle based on the output of the angular velocity meter 103. Specifically, the shake correction angle calculation unit 109 cuts a DC (direct current) component added to the angular velocity meter 103 as detection noise with respect to the detection signal output from the angular velocity meter 103 by the offset subtraction unit 110. . The integration filter unit 111 executes integration processing and outputs an angle signal. For example, an HPF (High Pass Filter) is used for cutting the DC component by the offset subtracting unit 110. The integral filter unit 111 uses a filter represented by the following formula (1). Equation (1) represents a filter that combines the integrator of the first term on the left side and the HPF of the second term on the left side. This filter is the same as a low-pass filter (LPF) expression with a time constant T multiplied by the time constant T.

  The output of the image stabilization characteristic changing unit 112 is input to the offset subtracting unit 110 and the integral filter unit 111. The output of the panning determination unit 113 is input to the image stabilization characteristic changing unit 112. The output of the tracking SW (switch) 121 is also input to the image stabilization characteristic changing unit 112, but the processing of the image stabilization characteristic changing unit 112 corresponding to the tracking SW 121 will be described later.

  The panning determination unit 113 acquires the shake correction angle, which is the output of the angular velocity meter 103 and the output of the integration filter unit 111, and determines whether the panning operation of the imaging device 101 is performed. Specifically, the panning determination unit 113 compares the angular velocity of the imaging device 101 detected by the angular velocity meter 103 with a predetermined threshold value. When a predetermined period (determination time) has elapsed since the detected angular velocity exceeds the threshold, it is determined that panning is in progress, and a determination signal is output to the image stabilization characteristic changing unit 112.

  When the panning determination unit 113 determines that panning is in progress, the driving force to the center of the control range is set so that the shake correction angle output from the integral filter unit 111 does not become too large for the image stabilization characteristic changing unit 112. Give instructions to set larger. The propulsive force means a control action that attempts to shift the shake correction angle to the center of the control range to approach it. If the panning determination unit 113 determines that panning is not being performed, the panning determination unit 113 instructs the image stabilization characteristic changing unit 112 to set the driving force toward the center of the control range to be small. Here, the driving force toward the center of the control range may be changed stepwise in accordance with the size of panning. The magnitude of panning is the magnitude of the detected angular velocity or the length of time that the angular velocity exceeds a threshold. In the present embodiment, a panning operation will be described as an example. Since the same processing is performed for the tilting operation except for the difference in direction, detailed description thereof is omitted.

  The anti-shake characteristic changing unit 112 changes the anti-shake characteristic (image blur correction characteristic) in accordance with the panning determination result and an instruction relating to the magnitude of the propulsive force toward the center of the control range according to the shake correction angle. For example, when the shake correction angle that is the output of the integral filter unit 111 is larger than a predetermined threshold, the shake prevention characteristic changing unit 112 changes the shake correction characteristic in order to shift the shake correction angle to the vicinity of the center of the control range. Control for making a transition to the vicinity of the center stepwise is performed according to the magnitude of the shake correction angle. Specifically, control is performed such that the propulsive force toward the center is increased as the shake correction angle is larger, and the propulsion force toward the center is decreased as the shake correction angle is smaller.

  The anti-vibration characteristic changing unit 112 changes the anti-vibration characteristic by changing the filter characteristics of the offset subtracting unit 110 and the integral filter unit 111. When the anti-vibration characteristic changing unit 112 is instructed to reduce the propulsive force, it sets the cutoff frequency of the HPF of the offset subtracting unit 110 to be small and sets the cutoff frequency of the integral filter unit 111 to be small. When the anti-vibration characteristic changing unit 112 is instructed to increase the propulsive force, the anti-vibration characteristic changing unit 112 sets the HPF cutoff frequency of the offset subtracting unit 110 to be large and sets the cutoff frequency of the integral filter unit 111 to be large.

  As described above, the shake correction angle calculation unit 109 performs a process of changing the driving force toward the center of the control range according to the panning determination result and the magnitude of the shake correction angle. As a result, the shake correction angle can be calculated while performing the panning determination process. The shake correction angle signal output by the shake correction angle calculation unit 109 is input to the sensitivity adjustment unit 114.

  The sensitivity adjustment unit 114 amplifies the output of the shake correction angle calculation unit 109 based on the zoom and focus position information 107 and the focal length and the shooting magnification obtained from the zoom and focus position information 107, and outputs a shake correction target value. The zoom position information is acquired from the zoom unit, and the focus position information is acquired from the focus unit. The reason for calculating the shake correction target value based on the zoom and focus position information 107 is that the shake correction sensitivity on the imaging surface with respect to the shake correction stroke of the correction lens 108 changes due to changes in optical information such as zoom and focus. is there. The sensitivity adjustment unit 114 outputs the shake correction target value to the addition unit 115.

  When the automatic tracking of the subject is not performed (when the tracking correction amount output from the tracking amount calculation unit 118 is 0), the addition unit 115 outputs the shake correction target value by the sensitivity adjustment unit 114. Only the output of the shake sensitivity adjustment unit 114 is input to the drive control unit 116. In this case, the correction lens 108 functions as a movable unit that shifts the position of the subject image in the captured image. The drive control unit 116 controls the correction lens 108 to perform shake correction.

  In the present embodiment, the drive control unit 116 performs image blur correction (optical image stabilization) by driving the correction lens 108 in a direction different from the optical axis direction. In the present embodiment, an optical image blur correction method using the correction lens 108 is adopted. However, the present invention is not limited to this, and a correction method for performing image blur by moving the image sensor in a plane perpendicular to the optical axis. May be applied. Alternatively, electronic image stabilization that reduces the influence of shake may be applied by changing the cutout position of the image of each shooting frame output by the image sensor. Alternatively, it is possible to combine a plurality of image blur correction methods. In addition, in the present embodiment, tracking control of the subject is performed by driving the correction lens or the image sensor and changing the cutout position of the image by using such optical image stabilization and electronic image stabilization techniques.

  Next, a subject position detection process performed by the subject detection unit 117 will be described in detail. The image sensor 106 acquires image information by photoelectrically converting reflected light from the subject into an electrical signal. The image information is converted into a digital image signal by the A / D conversion unit, and the digital image signal is sent to the subject detection unit 117. There are the following methods for automatically recognizing the main subject from a plurality of subjects when there are a plurality of images of the subject captured within the shooting angle of view.

  The first method of main subject detection is a method of detecting a person. In this case, the subject detection unit 117 detects the face and human body of the subject. In the face detection process, a pattern for determining a person's face is determined in advance, and a portion matching the pattern included in the captured image can be detected as a person's face image. The subject detection unit 117 calculates the reliability indicating the likelihood of each detected subject as the face of the subject. The reliability is calculated from, for example, the size of the face area in the image, the degree of matching with the face pattern, and the like. That is, the subject detection unit 117 functions as a reliability calculation unit that calculates the reliability of the subject based on the size of the subject in the photographed image or the degree of coincidence between the subject and a pre-stored subject pattern.

  The second method of main subject detection is a method that uses a histogram such as hue and saturation in a captured image. With respect to an image of a subject captured within a shooting angle of view, a distribution derived from a histogram such as hue and saturation is divided into a plurality of sections, and processing for classifying images captured for each section is executed. For example, a histogram of a plurality of color components is created for a captured image, divided by its mountain-shaped distribution range, images captured in regions belonging to the same combination of sections are classified, and the subject image region is Be recognized. By calculating the evaluation value for each image area of the recognized subject, the image area of the subject having the highest evaluation value can be determined as the main subject area.

  After the main subject area is determined, the main subject area is tracked by detecting an area similar to the feature quantity from images sequentially captured by live view operation, continuous shooting, or moving image capturing. it can. The feature amount of the main subject area is calculated from, for example, the hue distribution and size. The detected position information of the main subject is input to the tracking amount calculation unit 118. The tracking amount calculation unit 118 calculates the tracking correction amount so that the center position of the main subject image is located, for example, near the center (target position) of the captured image. In addition, the photographer designates the subject position on the display screen by operating the operation member of the image pickup device while watching the image displayed on the screen of the display unit of the image pickup device in accordance with the video signal output at any time. Is also possible. In this case, when the photographer performs an operation of designating the main subject from the images of the plurality of subjects displayed on the display screen, feature quantities such as hue distribution and size at the designated position are calculated. Using the calculated feature amount, it is possible to detect a region having a feature amount similar to the feature amount from images sequentially captured thereafter, and to track the detected region as a main subject region.

  Next, a subject tracking control method using the correction lens 108 will be described. The subject detection unit 117 illustrated in FIG. 2 acquires an image signal captured from the image sensor 106, and detects the image position (subject position) of the subject in the captured image. The subject position information is output to the tracking amount calculation unit 118. The tracking amount calculation unit 118 calculates a control amount used to track the subject by driving the correction lens 108 based on the zoom and focus position information 107 and the detected subject position information. Hereinafter, tracking correction is performed for the control amount (tracking control amount) for tracking the subject and positioning the subject image at a preset position (target position, center position in the present embodiment) on the screen (the range of the captured image). It is called quantity. The tracking amount calculation unit 118 calculates a tracking correction amount according to the state of the tracking SW 121. The tracking correction amount is input to the adding unit 115 and added to the shake correction target value that is the output of the sensitivity adjustment unit 114, whereby shake correction by driving the correction lens 108 and tracking control are performed simultaneously.

  FIG. 3 is a diagram for explaining the tracking control according to the present embodiment for the detected main subject. FIG. 3A illustrates a captured image 301a before the start of subject tracking control. FIG. 3B illustrates the captured image 301b after the start of subject tracking control. In the photographed image 301a in FIG. 3A, the black dot shown at the center indicates the screen center position 304. Before the tracking control is started, the image position of the subject 302a is separated from the screen center position 304. The subject center position 303a indicates the center position in the image of the subject 302a. When the CPU 105 starts subject tracking control, the distance between the subject center position 303a and the screen center position 304 gradually decreases with time. As shown in FIG. 3B, the subject center position 303a and the screen center position 304 substantially coincide with each other as a result of subject tracking control.

  Next, the tracking amount calculation processing of the tracking amount calculation unit 118 will be described with reference to FIG. FIG. 4 is a functional block diagram illustrating an example of the tracking amount calculation unit 118. The tracking amount calculation unit 118 calculates the tracking correction amount on each axis in the vertical and horizontal directions of the screen. For simplicity, only one axis will be described below.

  The subtraction unit 403 subtracts the coordinates of the screen center position 402 from the coordinates of the subject position (center position) 401 based on the subject position information output from the subject detection unit 117. Thereby, a difference amount (hereinafter referred to as a center shift amount) indicating how far the center position of the subject image is on the image from the screen center position 402 is calculated. The center shift amount is signed data in which the difference amount at the screen center position 402 is zero. The output of the subtraction unit 403 is input to a count value table reference unit (hereinafter simply referred to as a reference unit) 404.

The reference unit 404 calculates a count value for tracking based on the amount of center deviation, that is, the difference amount. Specifically, it is as follows.
When the center shift amount is equal to or smaller than the predetermined threshold A and equal to or larger than the predetermined threshold “−A”, the count value is set to zero or the minimum value. When the magnitude (absolute value) of the center shift amount is equal to or less than a predetermined threshold, a dead zone area that does not track within a predetermined range from the screen center position is set.
When the center shift amount is greater than the predetermined threshold A or less than the predetermined threshold “−A”, the count value is set to increase as the absolute value of the center shift amount increases. The sign of the count value is calculated according to the sign of the center shift amount.

  The output of the reference unit 404 is acquired as a first input by the signal selection unit 406. The signal selection unit 406 acquires the down count value output from the down count value output unit 405 as the second input. The signal selection unit 406 receives a signal indicating the state of the tracking SW (switch) 121 as a control signal. When the tracking SW 121 is set to ON, the signal selection unit 406 selects the output of the reference unit 404 and outputs it to the addition unit 407. When the tracking SW 121 is set to OFF, the signal selection unit 406 selects a down count value and outputs it to the addition unit 407. The down count value will be described later.

  The addition unit 407 acquires the output of the signal selection unit 406 and the previous sampling value related to the tracking amount, and adds both. The output of the addition unit 407 is input to the upper / lower limit value setting unit 408. The upper / lower limit setting unit 408 limits the tracking correction amount within a predetermined range. That is, the tracking correction amount is changed by a limiter so that the tracking correction amount does not exceed the predetermined upper limit value and does not become the predetermined lower limit value or less. The output of the upper / lower limit setting unit 408 is input to a delay unit 409 and an LPF (low pass filter) 410, respectively.

  The delay unit 409 outputs the tracking correction amount in the past for a predetermined sampling time from the current time, that is, the previous sampling value as the calculation result to the adding unit 407 and the downcount value output unit 405, respectively. The down count value output unit 405 outputs a down count value. The down-count value output unit 405 receives the previous tracking amount sampling value calculated in post-processing. When the tracking correction amount (previous sampling value) at the previous sampling time is a plus sign, the downcount value output unit 405 sets the downcount value to minus. When the previous sampling value is a minus sign, the downcount value output unit 405 sets the downcount value to plus. As a result, processing is performed so that the absolute value of the tracking correction amount becomes small. The downcount value output unit 405 sets the downcount value to 0 when the previous sampling value output from the delay unit 409 is within a range near zero (0 ± predetermined range). The down count value becomes a second input to the signal selection unit 406.

The LPF 410 cuts high frequency noise at the time of subject detection with respect to the output of the upper / lower limit setting unit 408, and outputs the processed signal to the correction lens driving amount conversion unit 411. The correction lens driving amount conversion unit 411 converts the output of the LPF 410 into a signal for performing a subject tracking operation by the correction lens 108. Thus, the final tracking correction amount is calculated, and the correction lens 108 is driven based on the tracking correction amount, so that the tracking correction processing is performed so that the center position of the subject image is gradually positioned near the center of the captured image. Is called.
Image blur correction control and subject tracking control can be performed simultaneously by driving the correction lens 108 based on the addition result of the blur correction amount and the tracking correction amount added by the adding unit 115 as described above. .

  When subject tracking is performed, the photographer can designate a subject in the screen in order to photograph a desired subject. A specific example of FIG. 5 will be described with respect to a subject designation method for tracking. FIG. 5A illustrates an example in which a touch panel 502 is installed on an LCD (liquid crystal display device) 501 provided on the back surface of the imaging device 101. When the photographer touches the display screen, processing for acquiring the coordinates of the subject 503 at the touched position and setting the subject to be tracked is executed. FIG. 5B shows an example in which an operation SW (switch) 515 for setting a subject tracking selectable mode (hereinafter referred to as a tracking selectable mode) is provided. When the photographer presses the operation SW 515, the mode changes to the tracking selectable mode. Since the subject designation icon 504 is displayed at the center of the screen, the subject 503 at the display position of the icon 504 can be set as the subject to be tracked by operating the SW1 of the release switch 104 or the like.

  In any of the methods shown in FIGS. 5A and 5B, when a subject is specified, a region similar to a feature amount from images sequentially captured using feature amounts such as hue distribution and size is subsequently used. A process of detecting is performed. FIG. 5C shows an example in which a main subject region extracted as a region similar to the feature amount is presented to the photographer in a frame 506 as a tracking region. When the photographer specifies a subject image in the display screen and performs subject tracking, there are the following problems before the subject is designated.

  For example, if the focal length of the lens is very large, such as 1000 mm or more, if the subject image moves due to the influence of camera shake, it is difficult to frame the subject by capturing it within the angle of view. In order to suppress the difficulty of framing due to the influence of camera shake, the characteristic is changed so as to reduce the propulsive force of the offset subtraction unit 110 toward the center of the control range, or the cut-off frequency of the integration filter unit 111 is set small. There is a method of increasing the shake correction control band. However, when the image stabilization characteristics of the camera shake correction are increased, the camera shake correction when the photographer intentionally operates the camera shake even if the camera operator operates the camera to return the subject within the angle of view. Will be done. For this reason, due to the influence of the image blur correction control, there may arise a problem that an operation for re-acquiring the subject within the angle of view and an operation for finely adjusting the subject image near the center of the photographed image become difficult. For example, before the photographer specifies the subject in the state in which the tracking selectable mode is set by the operation SW 515 in FIG. 5B, the icon 504 transitions to the position of the subject 503 in order to set the subject to be tracked. Thus, it is necessary to facilitate framing. When the tracking selectable mode is set, a setting is made to increase the shake correction suppression characteristics as compared to a state where the mode is not set. In this case, since the possibility of a large panning operation being performed in the tracking selectable mode setting state is low, the panning determination unit 113 sets the determination threshold value large. This makes it easier for the photographer to perform framing so that the icon 504 transitions to the position of the subject 503.

  After the subject is specified, in addition to image blur correction, correction for capturing the subject image at a specific position (for example, the center position) in the captured image is simultaneously performed by tracking control. At this time, in order to reduce the influence of camera shake as much as possible, a setting is made to increase the suppression characteristics related to image blur correction. In this case, the vibration suppression characteristics are set higher than before the subject is specified. Since the tracking of the designated subject has started, the possibility of a large panning operation is further reduced, so the panning determination unit 113 sets the determination threshold value larger than that before the subject is specified.

In the following, the default state that is not set to the tracking selectable mode is the first state, the subject is not specified and the tracking SW 121 is OFF in the second state that is set to the tracking selectable mode. State. The state in which the tracking selectable mode is set and the subject is specified and the tracking SW 121 is ON is the third state. Control is performed to make the correction effect of the blur correction in the second state stronger than the correction effect of the blur correction in the first state. In addition, control is performed to make the correction effect of the blur correction in the third state stronger than the correction effect of the blur correction in the second state. In the first state, the cutoff frequency of the integration filter unit 111 is expressed as fc1, and the panning determination threshold is expressed as Ah1. In the second state, the cutoff frequency of the integration filter unit 111 is expressed as fc2, and the panning determination threshold is expressed as Ah2. In the third state, the cutoff frequency of the integration filter unit 111 is expressed as fc3, and the panning determination threshold is expressed as Ah3. Each cut-off frequency and panning determination threshold have a relationship shown in the following formulas (2) and (3).
fc1>fc2> fc3 (2)
Ah1 <Ah2 <Ah3 (3)

  The degree of the image blur correction effect is changed between the first state before setting the tracking selectable mode, the second state where the tracking operation is not performed, and the third state where the tracking operation is performed. Is done. Accordingly, it is possible to perform optimum image blur correction control at the time of subject designation, tracking operation, etc., and perform shooting by smooth subject tracking.

  Next, processing for changing the degree of image blur correction effect according to the subject detection position will be described. While the tracking movable range is sufficient in the subject tracking control, the tracking control is performed so that the subject image transitions to the vicinity of the center of the screen. However, since the tracking movable range is finite, when the control position reaches the end (limit position) of the tracking movable range, further tracking control cannot be performed. At that time, the photographer performs framing of the camera himself and performs an operation of moving the subject image to the vicinity of the center of the screen. At this time, if image blur correction is performed on the amount of camera shake when the photographer intends to operate the camera, the effect of the correction becomes a problem. That is, there may be a problem that it is difficult for the photographer to re-operate the subject within the angle of view or to finely adjust the position of the subject image to the center of the captured image. Therefore, in the present embodiment, processing for changing the cutoff frequency (denoted as fc4) of the integration filter unit 111 is performed according to the subject detection position by the subject detection unit 117. A processing example will be described with reference to FIG.

  FIG. 6 illustrates a graph relating to the setting of the cutoff frequency fc4 (vertical axis) according to the subject detection position (horizontal axis). Coordinates are detected for the subject detection position in the two axial directions of the screen in the vertical and horizontal directions. In the lens control, a cutoff frequency fc4 of the integration filter unit 111 corresponding to the vertical pitch control and the horizontal yaw control is set. Further, regarding the subject detection position, the subject position is indicated by coordinates where the center position (target position) of the angle of view is zero.

  FIG. 6 shows a table of characteristics in which the cut-off frequency fc4 increases as the subject detection position moves away from the center position of the angle of view. P1 and P2 are threshold values in the positive value range, and -P1 and -P2 are threshold values in the negative value range. When the subject detection position is within the range of −P1 to + P1, the cutoff frequency fc4 is set to the default value D1. When the subject detection position is P2 or more or −P2 or less, the cutoff frequency fc4 is set to the frequency D2. “D2> D1”. In the interval from P1 to P2 and the interval from -P1 to -P2, the value fc4 calculated by linearly interpolating between D1 and D2 by a linear expression is set.

  The image stabilization characteristic changing unit 112 compares the calculated cut-off frequency fc4 with the cut-off frequency of the integral filter unit 111 determined so far according to the tracking selectable mode and the state of the tracking SW 121. As a result of the comparison, the larger cutoff frequency is set as the final cutoff frequency of the integration filter unit 111.

  In this way, by changing the cutoff frequency of the integration filter unit 111 in accordance with the subject detection position, the image blur correction effect is enhanced when the subject image is located near the center of the screen, and the subject image is centered on the screen due to the influence of camera shake. Can be prevented from coming off. When the subject image is far from the center of the screen, the subject image cannot be shifted to the center of the screen by tracking control (for example, the tracking movable range is near the control end). The control end is a limit position that can be corrected. In this case, the image blur correction effect is set slightly weak so that the photographer can operate the subject image near the center of the screen by framing. That is, it is possible to prevent image blur correction from being performed by a photographer's framing operation and to facilitate framing.

  A processing example of shake correction control and subject tracking control will be described with reference to the flowchart shown in FIG. The following process starts when the main power supply of the imaging apparatus 101 is turned on and is executed at a constant sampling cycle.

  First, in S701, the CPU 105 determines whether or not the image stabilization SW (switch) is ON. The image stabilization SW is an operation switch for instructing whether or not the user performs image blur correction control. If the image stabilization SW is ON, the process proceeds to S702. If the image stabilization SW is OFF, the process proceeds to S703. In S702, the CPU 105 takes in the output of the angular velocity meter 103, and proceeds to S704. In S703, the output of the angular velocity meter 103 is not captured, and after the angular velocity value is set to zero, the process proceeds to S704. By setting the angular velocity value to zero, the subsequent shake correction calculation result, that is, the shake correction amount becomes zero.

  In S704, the CPU 105 determines whether or not the tracking selectable mode is ON. For example, it is determined whether or not the tracking selectable mode is set to ON by the operation SW 515 in FIG. If the tracking enable selection mode is ON, the process proceeds to S705, and if the mode is OFF, the process proceeds to S708. In step S <b> 705, the CPU 105 determines whether the tracking SW 121 is ON. Whether the tracking SW 121 is ON / OFF can be determined by whether or not the subject is selected, for example, by the method described with reference to FIG. When the tracking SW 121 is ON, the process proceeds to S706, and when the tracking SW 121 is OFF, the process proceeds to S707.

  In S706, the cutoff frequency (denoted as fa) of the integration filter unit 111 is set to fc3. Further, the panning determination unit 113 sets the panning determination threshold (denoted as Tha) to Ah3, and the process proceeds to S709. In step S709, the subject detection unit 117 detects the subject position in the captured image. Here, it is assumed that the subject image on the LCD screen on which the captured image is displayed live is specified by the user operation when the tracking SW 121 is turned on in S705. That is, the imaging apparatus 101 recognizes the subject, and acquires the detection position coordinates of the subject by detecting the tracking of the subject.

  In the next step S710, the tracking amount calculation unit 118 calculates a tracking correction amount from the detected subject detection position, and the process proceeds to S711. In step S711, the CPU 105 calculates a cutoff frequency fc4 of the integration filter unit 111 based on the detected subject position. In step S712, the CPU 105 determines whether the current cutoff frequency fa is smaller than fc4. When fa <fc4, the process proceeds to S713, and when fa ≧ fc4, the process proceeds to S715. In S713, the CPU 105 sets the value by substituting the value of fc4 for fa, and the process proceeds to S715.

  In step S708, the CPU 105 sets the cutoff frequency fa of the integration filter unit 111 to fc1. The panning determination unit 113 sets the panning determination threshold value Tha to Ah1, and the process proceeds to S714. In S707, the CPU 105 sets the cutoff frequency fa of the integration filter unit 111 to fc2. The panning determination unit 113 sets the panning determination threshold value Tha to Ah2, and the process proceeds to S714. In S714, after the tracking correction amount is set to zero, the process proceeds to S715.

  In step S715, the shake correction angle calculation unit 109 calculates a shake correction amount. At that time, the angular velocity acquired in S702 or S703, the cutoff frequency fa of the integral filter unit 111 set in S705 to S713, and the panning determination threshold value Tha of the panning determination unit 113 are used. After calculating the shake correction amount, the process proceeds to S716. In S716, the addition unit 115 adds the shake correction amount and the tracking correction amount, and calculates the lens driving amount. In the next step S717, the CPU 105 controls the driving of the correction lens 108 by the driving control unit 116 based on the lens driving amount. Thereby, image blur correction and subject tracking control are performed. When the image blur correction and subject tracking control processes are completed, the process stands by until the next sampling time comes.

  The image position control apparatus of the present embodiment calculates the subject tracking amount based on the subject detection position in the captured image. The subject tracking amount is a control amount for shifting the subject image to a specific position (for example, a center position or a position designated by the user) on the screen. Further, the image position control device performs a calculation based on the angular velocity output as a shake detection signal and calculates a shake correction amount (image blur correction amount). The shake correction amount and the subject tracking amount are added, and image blur correction and subject tracking control are performed by driving the correction lens based on the added value. In this case, the characteristic for calculating the shake correction amount is changed according to the subject tracking control state. In other words, processing for changing the degree of image blur correction effect based on information indicating the result of determining whether the mode is the tracking selectable mode or ON / OFF setting information of the tracking switch, and image blur correction according to the subject position Processing for changing the degree of effect is performed. Therefore, it is possible to realize image blur correction control that allows a photographer to easily perform framing, and to improve performance of image blur correction and automatic subject tracking control.

In the present embodiment, an example of application to so-called optical image stabilization control in which the correction lens is moved in a plane perpendicular to the optical axis as means for image blur correction and automatic subject tracking control has been described. However, the present invention can also be applied to an image position control device having the following configuration.
(1) A configuration in which the image sensor is moved in a plane perpendicular to the optical axis.
(2) A configuration in which electronic control is performed by image processing for changing the cut-out position of each shooting frame output by the image sensor.
(3) A configuration including a mechanism unit that rotationally drives a lens barrel including the imaging element and the imaging lens group.
(4) A configuration in which a drive mechanism unit (for example, a rotary head that performs a panning operation or a tilting operation of the imaging device) provided separately from the imaging device is combined.
(5) A combination of a plurality of configurations shown in (1) to (4) above.
This also applies to third and fourth embodiments described later.

[Second Embodiment]
Next, a second embodiment of the present invention will be described. In the present embodiment, image blur correction and automatic subject tracking will be described in the case where a mechanism unit that rotationally drives a lens barrel including a photographing lens group and an image sensor 106 in addition to the correction lens 108. In this embodiment, the same components as those in the first embodiment are denoted by the same reference numerals as those used in the first embodiment, and detailed description thereof will be omitted. Differences will be mainly described. Omitting such description is the same in the embodiments described later.

  FIG. 8 is a diagram schematically illustrating the imaging apparatus 101 of the present embodiment. In FIG. 8, among the X, Y, and Z axes of the three-dimensional orthogonal coordinates, the direction around the X axis is defined as the pitch direction, and the direction around the Y axis is defined as the yaw direction. The Z-axis direction is the optical axis direction of the imaging device 101. An imaging apparatus 101 illustrated in FIG. 8A includes an operation member such as a release switch 104 and a display unit that displays a captured image. A display unit using an LCD or the like has a monitor function that displays live images in real time. The lens barrel 801 includes a photographing lens group and an image sensor 106 and is attached in a state where it can be driven by the image pickup apparatus 101. That is, a mechanism for rotating (tilting) the lens barrel 801 with respect to the imaging apparatus 101 is provided.

  FIG. 8B shows a structure relating to rotational driving of the lens barrel 801. The drive mechanism unit 802p includes a motor that rotates the lens barrel 801 in the pitch direction and a drive control unit thereof. The drive mechanism unit 802y includes a motor that rotates the lens barrel 801 in the yaw direction and a drive control unit thereof. The attitude of the lens barrel 801 can be independently controlled in the pitch direction and the yaw direction by the drive mechanism portions 802p and 803y.

FIG. 9 is a diagram illustrating a configuration of a main part of the imaging apparatus 101. Differences from the configuration of the first embodiment described in FIG. 2 are as follows.
(1) A rotation drive mechanism 802 for rotating the lens barrel 801 with a motor is provided. (2) The addition unit 115 that adds the shake correction amount and the tracking correction amount is deleted, and the shake correction amount output from the sensitivity adjustment unit 114 is input to the drive control unit 116.
(3) A drive control unit 901 that drives the rotation drive mechanism unit 802 is added, and the tracking correction amount output from the tracking amount calculation unit 118 is input to the drive control unit 901.
(4) The drive control unit 901 performs automatic subject tracking control by driving the rotation drive mechanism unit 802 based on the tracking correction amount calculated by the tracking amount calculation unit 118.

  The image position control apparatus according to the present embodiment performs image blur correction using the correction lens 108 and performs automatic subject tracking control using the rotation drive mechanism unit 802. Even in this case, the same effect as that of the first embodiment can be obtained, and image blur correction that is easy for the photographer to perform framing can be controlled.

  In this embodiment, the angular velocity meter 103 is attached to the lens barrel 801 or attached to a part of the imaging device 101 other than the lens barrel 801. When the angular velocity meter 103 is attached to the lens barrel 801, the relative angular velocity between the fixed portion of the imaging device 101 and the lens barrel 801 is subtracted from the output of the angular velocity meter 103. The relative angular velocity between the imaging device 101 and the lens barrel 801 is the rotational velocity of the lens barrel 801 rotated by the rotation driving mechanism 802, and is detected by a motor drive instruction signal, a rotation detection sensor, or the like. By subtracting the relative angular velocity from the output of the angular velocity meter 103, the shake amount of the imaging device 101 can be calculated.

In this embodiment, a correction lens and its driving mechanism are used as image blur correction means, and a lens barrel 801 including an image sensor and a photographing lens group and its rotation driving mechanism are used as automatic subject tracking means. The present invention is not limited to this, and the following configurations are applicable.
(1) A configuration including a mechanism for moving the image sensor in a plane perpendicular to the optical axis and a mechanism for driving the correction lens.
(2) A configuration including a processing unit that changes the image cutout position of each shooting frame output by the image sensor and a mechanism that drives the correction lens.
(3) A configuration including a processing unit that changes the image cutout position of each shooting frame output by the imaging device, and a mechanism that moves the imaging device in a plane perpendicular to the optical axis.
(4) A configuration provided with a mechanism for moving the image sensor in a plane perpendicular to the optical axis and a mechanism for rotationally driving a lens barrel including the photographing lens group.
(5) A configuration including a processing unit that changes the image cutout position of each shooting frame output by the imaging device, and a mechanism that rotationally drives a lens barrel including the shooting lens group.
(6) A combination of a plurality of configurations shown in (1) to (5) above.

[Third Embodiment]
Next, a third embodiment of the present invention will be described. The image blur correction and automatic subject tracking device of the present embodiment changes the characteristics of image blur correction based on subject detection information used for automatic subject tracking. The subject detection information is information indicating the subject detection status such as whether the subject is being detected or the subject has been lost, and information on the reliability of subject detection. Hereinafter, image blur correction and automatic subject tracking control reflecting subject detection information will be described.

FIG. 10 is a diagram illustrating a configuration of a main part of the imaging apparatus according to the present embodiment. The difference from the configuration described in FIG. 2 in the first embodiment is as follows.
(1) The subject detection unit 117 includes a subject detection state determination unit 1001 and a subject reliability determination unit 1002 in addition to the subject position detection unit 1000, and detection information and determination information are a tracking gain unit 1003 and an anti-vibration characteristic change unit 112. And input to the tracking amount calculation unit 118.
(2) A tracking gain unit 1003 is added, and the tracking correction amount, which is the output of the tracking amount calculation unit 118, is multiplied by a gain and input to the adding unit 115.

  The tracking gain unit 1003 receives determination information from a subject detection state determination unit (hereinafter referred to as a detection state determination unit) 1001 and a subject reliability determination unit (hereinafter referred to as a reliability determination unit) 1002, and a tracking gain unit 1003. Sets the gain according to each determination result. The gain value is 0 or more and 1 or less. The tracking gain unit 1003 and the image stabilization characteristic changing unit 112 will be described in detail below.

  The subject position detection unit 1000 corresponds to the subject detection unit 117 of the first embodiment, and detects the position of the subject using, for example, face detection or pattern matching. The detection state determination unit 1001 determines the first detection state or the second detection state. The first detection state is a state in which a subject can be detected. The second detection state is a state where detection is not possible because the subject is lost. Since tracking control can be performed in the first detection state, the tracking gain unit 1003 sets the gain value to 1. That is, the tracking correction amount calculated by the tracking amount calculation unit 118 is input to the addition unit 115 as it is. Since subject tracking control is performed, the image blur correction effect is set to be high. As described in the first embodiment, the characteristics of the offset subtraction unit 110 and the integration filter unit 111 are set to the characteristics according to the state of the tracking SW 121 and the determination result of the panning determination unit 113, and the shake correction amount is calculated. The

  On the other hand, when the detection state determination unit 1001 determines that the detection state is the second detection state, it is preferable to perform control to stop subject tracking. That is, when the second detection state is determined, the gain value is preferably set to 0. Moreover, the detection state determination unit 1001 may determine the detection state of the subject from three or more detection states instead of from the two states of the first detection state and the second detection state.

  For example, the first detection state is a state where the subject is highly likely to be detected, and the second detection state is a state where the subject is not likely to be detected. The third detection state is a state in which the subject is less likely to be detected than in the first detection state, but the subject is more likely to be detected than in the second detection state. For example, a case will be described where the subject is lost in a predetermined time after losing sight of the subject, but the state of searching for the subject (third detection state) can be taken as the determination result. Note that if the subject is detected again during the third detection state, the state transitions again to the first state, which is the subject detection state. However, if the subject lost state continues for a predetermined time, the search for the subject is stopped and the subject is not detected. It shall transition to the 2nd detection state which is a detection state. The third detection state may be set, for example, such that the possibility of subject detection decreases with the elapsed time since the subject lost state. In this case, a transition is made again to the first detection state, which is the subject detection state, but when the third detection state continues for a predetermined time, the control device stops searching for the subject and the second detection state is the second detection state. Transition to the detection state. The third detection state may be set, for example, such that the possibility of subject detection becomes smaller depending on the elapsed time from the time when the subject is lost. At this time, the tracking gain unit 1003 sets the gain value to 1 in the first detection state, sets the gain value to 0 in the second detection state, and sets the gain value to 0 in the third detection state. A large value less than 1 is assumed. The detection state determination unit 1001 may determine the detection state from a plurality of states set according to the possibility that the subject can be detected between the first detection state and the second detection state. In this case, the tracking gain unit 1003 finally sets the gain value to zero while setting the gain value to gradually decrease as the possibility of detecting the subject decreases. Since tracking control is not performed in the second detection state, it is set so that the subject image can be operated near the center of the screen by the framing operation of the photographer. In other words, the image stabilization characteristic changing unit 112 slightly reduces the image blur correction effect, prevents image blur correction from being performed for the framing operation, and changes the image stabilization characteristic to allow the photographer to easily perform framing. However, the image stabilization characteristic at this time is a characteristic that facilitates framing while applying image blur correction with a certain level of strength. The cutoff frequency of the integration filter unit 111 is set to fc2, and the panning determination threshold is set to Ah2. This setting is the same as that in S707 of FIG. 7 in which the subject is not specified and the tracking SW is OFF. The image stabilization characteristic changing unit 112 changes the image stabilization characteristic according to the determination result of the subject detection state by the detection state determination unit 1001, the state of the tracking SW 121, and the determination result of the panning determination unit 113. That is, among the image stabilization characteristics according to the determination result of the subject detection state and the image stabilization characteristics according to the state of the tracking SW 121 and the determination result of the panning determination unit 113, the image stabilization characteristic having the lowest image blur correction effect is determined. Is done. The offset subtraction unit 110 and the integration filter unit 111 are set according to the determined image stabilization characteristics.

  A reliability determination unit 1002 determines whether or not the detected subject image is reliable. The reliability of the subject image can be determined from the size of the subject image in the captured image, for example. Alternatively, the reliability of the main subject to be determined can be calculated based on the degree of coincidence between the pattern of the subject image stored when the subject is designated and the detected subject image. Further, when there are a plurality of subjects having the same pattern as the detected subject and there is a high possibility that the main subject is detected incorrectly, the reliability is calculated to be low. The reliability determination unit 1002 determines whether the detected subject image is reliable by comparing the calculated reliability with a threshold value. When the reliability of the subject image is high (when it is greater than or equal to the threshold value), subject tracking control is possible. In this case, the tracking gain unit 1003 sets the gain value to 1. The tracking correction amount calculated by the tracking amount calculation unit 118 is input to the addition unit 115 as it is. During the tracking control, in order to enhance the image blur correction effect, the characteristics of the offset subtraction unit 110 and the integration filter unit 111 are changed to calculate the shake correction amount.

  On the other hand, if the reliability determination unit 1002 determines that the reliability of the subject image is less than the threshold and the reliability is low, tracking may be undesired by the photographer, and thus tracking is stopped. Control is performed. The reliability determination unit 1002 preferably uses a plurality of thresholds to evaluate the reliability not only in two stages of whether or not it is reliable, but also in multiple stages. In this case, the tracking gain unit 1003 sets the gain value to 1 when the calculated reliability is the highest and is equal to or greater than the threshold (evaluated as the highest reliability), and the gain value is gradually increased according to the reliability. Keep it small. Then, the gain value is finally set to zero when the reliability is the smallest and less than the threshold value. At this time, the image stabilization characteristic is changed to slightly weaken the image blur correction effect. That is, the cutoff frequency of the integration filter unit 111 is set to fc2, and the panning determination threshold is set to Ah2. This makes it easy to perform framing while applying image blur correction to some extent. The image stabilization characteristic changing unit 112 is based on the determination result of the reliability determination unit 1002, the determination result of the subject detection state by the detection state determination unit 1001, the state of the tracking SW 121, and the determination result of the panning determination unit 113. To change. That is, the image stabilization characteristic according to the subject reliability as the determination result of the reliability determination unit 1002, the image stabilization characteristic according to the subject detection state, the state of the tracking SW 121 and the anti-shake according to the determination result of the panning determination unit 113. Vibration characteristics are compared. Among these image stabilization characteristics, the image stabilization characteristic having the lowest image blur correction effect is determined. The offset subtraction unit 110 and the integration filter unit 111 are set according to the determined image stabilization characteristics.

The tracking correction amount output from the tracking gain unit 1003 is input to the adding unit 115 and added to the target value of the blur correction amount that is the output of the sensitivity adjustment unit 114. Accordingly, it is possible to simultaneously perform image blur correction and tracking correction by driving the correction lens 108.
In the present embodiment, processing for changing the characteristics of image blur correction is performed according to the subject detection state and / or subject reliability. Therefore, since the image blur correction control that is easy for the photographer to perform framing can be realized, the performance of the image blur correction and the automatic subject tracking control can be improved.

[Fourth Embodiment]
Next, a fourth embodiment of the present invention will be described. The image blur correction and automatic subject tracking device of this embodiment determines whether tracking control is possible based on subject detection information used for automatic subject tracking, and displays the determination result on the screen of the display unit. . Accordingly, it is possible to notify the photographer whether or not the imaging apparatus is in a state in which the subject can be tracked, and to realize image blur correction and subject tracking control in which the photographer can easily perform framing.

  In a system that performs subject tracking so that the position of the subject is held at a specific position (for example, the center position) on the shooting screen, the camera automatically positions the subject near the center of the angle of view by tracking control during the tracking operation. To track. For this reason, the photographer does not need to perform a framing operation to follow the subject. However, since such subject tracking is performed by moving a part of the optical system, the movable range that can be tracked is limited. When the end of the tracking movable range is reached, no further tracking can be performed, so the photographer needs to shake the camera and follow the subject. However, when the optical system reaches the tracking movable end, it is difficult for the photographer to determine it immediately, so the framing operation of the photographer is delayed, and the subject may be missed from the shooting screen. . The same applies to the case where tracking is performed by changing the frame cutout range.

In the present embodiment, it is possible to improve the operability of the framing operation of the photographer by determining whether or not the tracking control is possible and displaying the determination result on the screen of the display unit.
FIG. 11 is a diagram illustrating a configuration of a main part of the imaging apparatus according to the present embodiment. The difference from the configuration described in FIG. 10 in the third embodiment is that a tracking state determination unit 120 and a tracking icon control unit 123 are provided. The determination result by the tracking state determination unit 120 is input to the tracking icon control unit 123, and the icons displayed on the screen of the display unit 122 are controlled by the tracking icon control unit 123.

  When subject tracking control is performed, tracking control is executed so that the position of the subject is held near the center of the screen while the tracking movable range is sufficient. However, since the tracking movable range is finite, no further tracking control can be performed when the correction lens 108 reaches the end of the movable range. In that case, the photographer needs to reframe the camera himself and bring the subject close to the center of the angle of view. However, it is difficult for the photographer to immediately determine whether or not tracking is no longer possible simply by looking at the live view image. For this reason, the photographer may not perform the operation of correcting the framing immediately after the correction lens 108 reaches the end of the movable range, and the subject may come off the screen as it is and may be lost. Therefore, the imaging apparatus 101 according to the present embodiment determines whether or not tracking control can be performed. Depending on the determination result, the tracking icon displayed on the screen is changed to notify the photographer whether or not the tracking is possible. When tracking is not possible, a process for urging the photographer to follow the subject by a framing operation is performed by a warning notification.

  FIG. 12 shows a rear view of the camera showing the operation and state of subject tracking, and a timing chart of the control state at that time. In the case of subject tracking, in order for the photographer to photograph a desired subject, it is desirable to perform tracking after the photographer specifies the subject in the screen. As a method for specifying a subject for performing the tracking operation, for example, there is a method using a touch panel. As shown in FIG. 12A, this is a method in which the coordinate position of the touched subject 503 is obtained by the touch panel 502 installed under the LCD 501 on the back surface of the imaging apparatus 101, and the subject to be tracked is set. is there.

  When a subject is specified by the method shown in FIG. 12A, a region similar to a feature amount from an image sequentially captured in a subsequent live view operation using a feature amount such as a hue distribution or a size after that. The main subject area is tracked by detecting. A frame 506 is displayed with the main subject area as the tracking area (FIG. 12B), and the tracking area is notified to the photographer. After the subject is specified, tracking control is performed so that the detected subject position moves to the center of the screen. In addition, a tracking icon 505 is displayed on the screen so that the photographer can know that the tracking control is being performed. While the subject tracking is not performed (while the subject is not designated), the tracking icon 505 is not displayed on the screen.

  FIG. 12B shows a state after the subject is designated. The change in the state of the screen displayed on the display unit of the imaging apparatus 101 as time elapses is illustrated in the order of (A) → (B) → (C) → (D) → (E). FIG. 12F shows the output of the adding unit 115 obtained by adding the shake correction amount and the tracking correction amount in this case. FIG. 12G shows the amount of center shift, which is the output of the subtracting unit 403, and FIG. 12H shows the display state of the tracking icon 505 (non-display, normal display, gray display). The horizontal axis in FIGS. 12F to 12H is a common time axis. When the subject position detection unit 1000 outputs the coordinates of the subject detected with the target position as the center coordinates, the output of the subject position detection unit can be regarded as the center shift amount. The tracking icon 505 is not displayed on the screen until time T1 when the subject is designated. When a subject is designated at time T1 as shown in FIG. 12B, a tracking icon 505 is displayed on the screen. Thereafter, even if the designated subject 503 moves and the subject 503 moves away from the center of the image (FIG. 12C), the tracking control is performed based on the tracking correction amount calculated by the tracking amount calculation unit 118. The subject 503 is returned to the center of the image (FIG. 12D). In the figure, the time when the subject moved from the center of the image is shown as T2, and the time when the subject was returned to the center of the image by the tracking control is shown as T3.

  Thereafter, when the subject further moves, tracking control is performed with a larger tracking correction amount. When the correction amount of the correction lens 108 reaches the tracking possible threshold value Th1 as shown in FIG. 12F, the tracking correction amount is limited so as not to exceed the correctionable amount Th2. The correction amount at this time is set between the threshold Th1 and the threshold Th2. A tracking icon 505 is displayed in gray on the photographer in order to inform the photographer that the subject cannot be tracked any more at time T5 when the state where the correction amount is equal to or greater than the threshold Th1 has passed the predetermined time TL. That is, processing for notifying the photographer that tracking is not possible is performed. The CPU 105 functioning as a tracking state determination unit and a tracking icon control unit determines that the tracking control is not possible when the state where the correction amount is equal to or greater than the threshold Th1 elapses for a predetermined time TL and then displays the tracking icon 505 in gray. Then, a warning instruction to notify the photographer is issued. The correctable amount Th2 corresponds to the amount until the correction lens 108 reaches the end of the movable range, and the trackable threshold Th1 can be appropriately set to a value less than Th2. For example, the trackable threshold Th1 may be set by multiplying the correctable amount Th2 by a coefficient greater than 0 and less than 1, or set by subtracting a fixed amount from the correctable amount Th2. Also good.

  When the correction lens 108 reaches the end of the movable range, no further tracking control can be performed, and thus the process of changing the display of the tracking icon 505 is performed as described above. Accordingly, it is possible to prompt the photographer to perform framing of the camera himself and move the subject to the center of the image.

  Next, another example of a method for notifying the photographer by changing the tracking icon 505 when the correction lens 108 exceeds the tracking movable range and tracking control cannot be performed will be described with reference to FIG. In the example of FIG. 13, the method for determining whether or not the tracking operation can be performed is different from the example of FIG. After the start of tracking control, if the position of the subject image cannot be moved to the vicinity of the center of the image and is at a position away from the center of the image for a long time, the correction lens 108 reaches the end of the movable range, It can be determined that the tracking control can no longer be performed. In this case, a warning icon display process for notifying that tracking control cannot be performed is executed.

  Whether or not the subject can be tracked is determined as follows. A time during which the center shift amount, which is the distance between the position of the subject image and the image center on the image, exceeds a predetermined threshold Th3 is measured. When the measured time becomes equal to or longer than the predetermined time T7, it is determined that the tracking operation cannot be performed. In other words, it is determined that the subject cannot be tracked when the state of the subject image being away from the target position by a predetermined distance or more continues for a predetermined time or longer. Further, it is determined that the subject can be tracked during the period in which the center shift amount is equal to or less than the threshold Th3. This determination is performed by the tracking state determination unit 120. By changing the tracking icon displayed on the screen according to the determination result, it is possible to notify the photographer whether or not the tracking is possible. When the subject cannot be tracked, a process for urging the photographer to follow the subject through a framing operation is executed.

  Similar to the method described with reference to FIG. 12A, in FIG. 13A, a subject is designated by a touch operation, tracking control is started, and a tracking icon 505 is displayed on the screen (FIG. 13B). FIGS. 13B to 13E are diagrams showing states after the designation of the subject. The change in the state of the screen displayed by the imaging apparatus 101 as time elapses is illustrated in the order of FIG. 13 (A) → (B) → (C) → (D) → (E). FIG. 13F shows the output of the adding unit 115 obtained by adding the shake correction amount and the tracking correction amount in this case. Further, the center shift amount is shown in FIG. 13G, and the display state of the tracking icon 505 is shown in FIG. The tracking icon 505 is not displayed on the screen until time T8 when the subject is designated. When a subject is specified at time T8, a tracking icon 505 is displayed on the screen. Thereafter, even if the designated subject 503 moves and the subject 503 moves away from the center of the image (FIG. 13C), tracking control is performed based on the tracking correction amount calculated by the tracking amount calculation unit 118. The subject 503 is returned to the center of the image (FIG. 13D). In the figure, the time when the subject moved from the center of the image is shown as T9, and the time when the subject was returned to the center of the image by the tracking control is shown as T10. In the period from T9 to T10, the detection position of the subject (center deviation amount) exceeds the predetermined threshold Th3, but the time exceeding Th3 does not exceed the predetermined time T7, so the display of the icon 505 is normal display. .

  Thereafter, when the subject further moves, tracking control is performed with a larger tracking correction amount. At that time, if the state in which the center shift amount is equal to or greater than the predetermined threshold Th3 as shown in FIG. 13G continues for the predetermined time T7 or longer, the display of the tracking icon 505 is changed to gray display. That is, a process for notifying the photographer that the subject tracking control cannot be performed any more is performed.

  As described above, when the subject detection position is away from the center of the image for a long time, the CPU 105 functioning as the tracking state determination unit 120 reaches the movable range end and cannot perform tracking control any more. It is determined that it is in a state. The CPU 105 also functions as the tracking icon control unit 123, and by changing the display state of the tracking icon 505, the photographer urges the photographer to frame the camera and move the subject to the center of the image.

  12 and 13 illustrate an example of icon display when it is difficult to perform tracking control of a subject due to a large movement of the subject in the image and a large correction amount for moving the subject position to the target position in the image. did. However, even when the correction amount is not large, it may be difficult to perform tracking control. Hereinafter, an example of a method of notifying the photographer by a change in the tracking icon 505 when tracking control cannot be performed due to a decrease in the detection state of the subject will be described with reference to FIGS. explain. It can be determined that tracking control cannot be performed while the reliability of the detected subject image is low. In that case, an icon for notifying that tracking control cannot be performed is displayed.

  The reliability determination unit 1002 determines whether or not the detected subject image is reliable. Since the reliability determination of the subject by the reliability determination unit 1002 is the same as that in the third embodiment, the details are omitted.

  Similar to the method described with reference to FIG. 12A, in FIG. 14A, a subject is designated by a touch operation, tracking control is started, and processing for displaying a tracking icon 505 on the screen is performed (FIG. 14A). B)). FIG. 14B is a diagram illustrating a state after the subject is specified. The change in the state of the screen displayed by the imaging apparatus 101 as time elapses is illustrated in the order of FIG. 14A → B → C) → D. FIG. 14E shows the output of the adding unit 115 obtained by adding the shake correction amount and the tracking correction amount in this case. Further, FIG. 14 (F) shows the center shift amount, FIG. 14 (G) shows the reliability of the subject image, and FIG. 14 (H) shows the display state of the tracking icon 505. Until time T11 when the subject is designated, the tracking icon 505 is not displayed on the screen. When a subject is specified at time T11, a tracking icon 505 is displayed on the screen. Thereafter, even if the designated subject 503 is separated from the center of the image, the tracking control is performed based on the tracking correction amount calculated by the tracking amount calculation unit 118. Therefore, as shown in FIG. Returned to In the figure, the time when the subject is specified and the position is detected is shown as T11, and the time when the subject is returned to the center of the image by the tracking control is shown as T12.

  After that, when the subject further moves as shown in FIG. 14C, the tracking correction amount is further increased and tracking control is performed. At that time, as shown in FIG. 14D, when a plurality of similar subjects similar to the main subject appear on the screen, the reliability of the subject image is set low. When the reliability of the subject image is lowered, the gain of the tracking gain unit 1003 is set to be small and is set not to perform tracking control. Therefore, as shown in FIG. 14G, when the subject reliability is equal to or lower than the predetermined threshold Th4, the display of the tracking icon 505 is changed to gray display. That is, a process for notifying the photographer that the tracking control cannot be performed any more is performed.

  As described above, the CPU 105 functioning as the tracking state determination unit 120 determines that the tracking control cannot be performed when the reliability of the subject image is lower than the threshold value. The CPU 105 also functions as the tracking icon control unit 123, and by changing the display state of the tracking icon 505, the photographer urges the photographer to frame the camera and move the subject to the center of the image.

  Next, another example of a method for notifying the photographer by a change in the tracking icon 505 when tracking control becomes impossible depending on the detection state of the subject will be described with reference to FIG. After the photographer designates the subject, tracking control is performed while the subject can be detected. However, if the subject is lost, the state is changed to the subject lost state. When the subject can be detected again from the subject lost state, the state transits to the subject detection state, but when the subject lost state continues for a predetermined time, it is determined that the tracking control cannot be performed. In that case, an icon for notifying that tracking control cannot be performed is displayed on the screen. When the subject lost state continues for a longer time, it is determined that there is no possibility of detecting the subject again, the subject detection is stopped, and the tracking icon 505 is not displayed. The detection state determination unit 1001 determines the subject detection state, and determines whether the subject is being detected, the subject is in a lost state, or the subject is not being detected.

  Similar to the method described with reference to FIG. 12A, the subject is designated by the touch operation in FIG. 15A, tracking control is started, and the tracking icon 505 is displayed on the screen (FIG. 15B). )). FIG. 15B is a diagram illustrating a state after the subject is specified. The change in the state of the screen displayed by the imaging apparatus 101 with the passage of time is illustrated in the order of FIG. 15A → (B) → (C) → (D). FIG. 15E shows the output of the adding unit 115 obtained by adding the shake correction amount and the tracking correction amount in this case. Further, the center shift amount is shown in FIG. 15 (F), the detection state of the subject is shown in FIG. 15 (G), and the display state of the tracking icon 505 is shown in FIG. 15 (H).

  The tracking icon 505 is not displayed on the screen until time T15 when the subject is designated. When a subject is designated as shown in FIG. 15B, a tracking icon 505 is displayed on the screen. After that, even if the designated subject 503 moves and moves away from the center of the image, the tracking control is performed based on the tracking correction amount calculated by the tracking amount calculation unit 118. Therefore, as shown in FIG. 503 is returned to the center of the image. In the figure, the time when the subject is specified and the position is detected is shown as T15, and the time when the subject is returned to the center of the image by the tracking control is shown as T16.

  Thereafter, when the subject further moves as shown in FIG. 15C, the tracking correction amount is further increased and tracking control is performed. As shown in FIG. 15D, when the subject to be tracked is hidden behind another subject and cannot be seen from the screen, the subject detection unit 117 (subject position detection unit 1000) detects the subject. The object is lost without being detected (time T17). When the subject is lost, the subject is lost during a predetermined time period T18. This state is a state where the subject can be returned to the subject detection state when the subject 503 is detected again while the subject is lost. After the transition to the subject lost state and the elapse of the period T18, it is determined that no more subjects can be detected, and the subject detection stopped state is entered. When the subject detection stop state is entered, even if the subject 503 appears again on the screen, the subject detection state is not entered. In order to enter the subject detection state while the subject detection is stopped, it is necessary to specify the subject again. Since there is a possibility that the subject can be detected again even during the subject lost state, subject tracking control is continued in a period T19 of a predetermined time from the time when the subject is lost. After the elapse of the period T19, the subject tracking control stops, and the previous tracking control amount (value calculated by the previous control sampling) is held as the tracking control amount that is the output of the tracking amount calculation unit 118. During the period until the period T18 ends, the previous tracking control amount is held as the tracking control amount. When the period T18 ends, processing for gradually returning the tracking control amount to 0 and returning the correction lens 108 to the position when the subject tracking control is not performed is performed.

  During the period T18 during which the subject is lost, the tracking icon 505 is displayed in gray, and the photographer is notified that tracking control cannot be performed. Further, when the period T18 has elapsed from the subject lost state and the subject detection is stopped, the tracking icon 505 is stopped (not displayed).

  As described above, the CPU 105 functioning as the tracking state determination unit 120 determines that tracking control cannot be performed according to the subject detection state. The CPU 105 also functions as the tracking icon control unit 123, and changes the display state of the tracking icon 505 (including stopping the display of the tracking icon 505). Accordingly, it is possible to prompt the photographer to move the subject to the center of the image by framing the camera, or to prompt the user to reset the subject to be tracked.

  Next, an example of a method for notifying the photographer by a change in the tracking icon 505 in the case where tracking control becomes impossible when the shake of the image pickup apparatus 101 exceeds the amount of shake that can correct image blurring. Will be described with reference to FIGS. If the detected shake amount of the imaging apparatus 101 is large, it can be determined that subject tracking control cannot be performed. In this case, processing for displaying an icon for notifying that tracking control cannot be performed is performed.

  Similar to the method described with reference to FIG. 12A, the subject is designated by a touch operation in FIG. 16A, tracking control is started, and a tracking icon 505 is displayed on the screen (FIG. 16B). FIG. 16B is a diagram illustrating a state after designation of the subject. The change in the state of the screen displayed by the imaging apparatus 101 as time elapses is illustrated in the order of FIG. 16 (A) → (B) → (C). FIG. 16D shows the output of the adding unit 115 obtained by adding the shake correction amount and the tracking correction amount in this case. Further, the center deviation amount is shown in FIG. 16E, the output of the angular velocity meter 103 is shown in FIG. 16F, and the shake correction angle that is the output of the shake correction angle calculation unit 109 is shown in FIG. The display state of the tracking icon 505 is shown in FIG.

  The tracking icon 505 is not displayed on the screen until the time T22 when the subject is designated. When a subject is designated as shown in FIG. 16B, a tracking icon 505 is displayed on the screen. After that, even if the designated subject 503 is away from the center of the image, tracking control is performed based on the tracking correction amount calculated by the tracking amount calculation unit 118, and as shown in FIG. Return to the center of the image. In the figure, the time when the subject is specified and the position is detected is shown as T22, and the time when the subject is returned to the center of the image by the tracking control is shown as T23.

  Thereafter, when the shake amount of the imaging apparatus 101 increases, the angular velocity that is the output of the angular velocity meter 103 increases, and accordingly, the shake correction angle that is calculated based on the output of the angular velocity meter also increases. If the blur correction limit is exceeded at this time, the captured image will be blurred, and the image of the subject 503 cannot be within a certain range as shown in FIG. In FIG. 16D, correction limits that can be corrected by moving the correction lens 108 are shown in (Th5, -Th5). The correction lens 108 cannot perform correction beyond the correction limit. Therefore, if the tracking state determination unit 120 determines that correction control cannot be performed within the range of Th5 to -Th5 at time T24, the tracking icon 505 is displayed in gray and the tracking control cannot be performed. Will be notified.

  As a method for determining whether or not the amount of shake is large and tracking is not possible, there is a method for determining using the output angular velocity of the angular velocity meter 103. The tracking state determination unit 120 performs tracking of a subject when the time during which the output angular velocity exceeds a predetermined threshold (Th6 or more or −Th6 or less) in a predetermined time period T20 is equal to or longer than a predetermined threshold time. It is determined that the state cannot be performed. Instead of comparing the time when the output angular velocity exceeds the threshold with the threshold time, the number of times the output angular velocity exceeds the threshold may be compared with a predetermined threshold. In that case, when the number of times exceeding the threshold detected at a predetermined sampling interval is equal to or greater than the predetermined number, it is determined that the subject cannot be tracked.

  As another method for determining that the amount of shake is large and tracking cannot be performed, there is a method for determining using the shake correction angle that is the output of the shake correction angle calculation unit 109. In this case, the tracking state determination unit 120 determines the time or number of times that the shake correction angle in FIG. 16G exceeds a predetermined threshold (Th7 or more or −Th7 or less) in a predetermined time period T21 as a predetermined threshold time. Or, compare with a predetermined number of times. When the time or number of times that the shake correction angle exceeds the predetermined threshold is equal to or longer than the predetermined threshold time or the predetermined number of times, it is determined that tracking is not possible.

  By any one of these methods, it is possible to detect that image blurring continues and image blur correction and tracking control are difficult. The photographer is notified that the subject tracking control cannot be performed by switching the display of the tracking icon 505.

  As described above, when a shake exceeding the magnitude of shake that can be corrected by the imaging apparatus has occurred, the CPU 105 functioning as the tracking state determination unit 120 determines that tracking control cannot be performed. The CPU 105 also functions as the tracking icon control unit 123, and changes the display state of the tracking icon 505 in response to the determination result of the tracking state determination unit 120. Thereby, it is possible to notify the photographer that the photographer needs to hold the image pickup apparatus firmly so that the shake of the image pickup apparatus 101 is reduced.

  As described above, the tracking state determination unit 120 of this embodiment determines whether or not the subject tracking control is possible. If it is determined that tracking is impossible, the notification by the icon can prompt the photographer to frame the imaging device himself and move the subject to the center of the image or to hold the imaging device firmly.

In the present embodiment, the method of performing the warning notification using the display of the tracking icon 505 has been described, but there are the following methods as other notification methods.
(1) A method of controlling the display state of the tracking icon 505. Specifically, there is a method of notifying the photographer in a state where tracking control cannot be performed by blinking an icon. The state in which the tracking control cannot be performed may be divided into a plurality of levels, and the corresponding level may be notified to the photographer by changing the blinking time according to the level.

(2) A method of controlling a predetermined light emitting unit. As shown in FIG. 17, there is a method in which an LED 1101 (light emitting unit) is provided in the imaging apparatus 101 and a warning notification is performed using the LED 1101. Specifically, when the tracking control cannot be performed, the photographer is notified by blinking the LED 1101. The state in which the tracking control cannot be performed may be divided into a plurality of levels, and the blinking time may be changed according to the level to notify the photographer of the level in which the tracking control cannot be performed. Further, the LED 1101 may be turned on when the subject can be tracked, and the LED 1101 may be turned off when the subject is not designated and tracking control is not performed.

(3) Notification method by vibration. As shown in FIG. 18, there is a method of providing a sheet-like actuator 1201 that generates vibration at a position where a photographer of the imaging apparatus 101 can easily place a finger when holding the camera. By vibrating the actuator 1201, the photographer is notified that the subject tracking control cannot be performed. As the actuator 1201, for example, a piezoelectric actuator using a piezoelectric element is used. The state in which the tracking control cannot be performed may be divided into a plurality of levels, and the magnitude of the vibration may be changed according to the level to notify the photographer of the level in which the tracking control cannot be performed.

  In addition, in FIGS. 12 to 16, an example in which whether or not subject tracking control can be performed is determined by one determination method, but tracking control can be performed by using a plurality of determination methods. Whether or not it may be determined. For example, when it is determined that the tracking control cannot be performed when a state where the correction amount is equal to or greater than the tracking threshold Th1 has elapsed for a predetermined time TL and a state where the positional deviation amount is equal to or greater than the threshold Th3 has elapsed for a predetermined time T7 It may be determined that tracking control cannot be performed. A plurality of determination methods can be appropriately combined. At this time, the warning display may be changed according to the determination method, or the warning display may be changed according to the reason why the tracking control cannot be performed. The reason is that the correction amount is large, the detection state of the subject is lowered, and the shake is large. However, if there are many types of warning indications, it may be complicated for the photographer. For this reason, even if it is a different determination method or a different reason, the same warning display is preferable because the control state that the tracking control cannot be performed is the same. For example, it is preferable to use the same warning display regardless of whether the correction amount is large or due to a decrease in the detection state of the subject. This is because even when the warning display is of one type, if the warning notification is given, the photographer can be prompted to follow the subject by the framing operation. In other words, because the control state in which tracking control cannot be performed for different judgment methods and reasons, and the purpose of prompting the photographer to perform the framing operation by the warning display, the warning display is the same. Preferably they are the same.

[Other Embodiments]
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

103 Angular velocity meter 105 CPU
109 shake correction angle calculation unit 116 drive control unit 117 subject detection unit 118 tracking amount calculation unit

Claims (18)

A correction control unit that acquires a shake detection signal detected by the shake detection unit, calculates a correction amount of the image blur, and controls an image blur correction unit that corrects the image blur;
Subject detection means for detecting the position of the subject in the photographed image and obtaining position information of the subject in the photographed image;
Tracking control means for performing tracking control of the subject based on the position information of the subject acquired by the subject detection means;
Setting means for setting a control state of the tracking control means,
The setting means includes a plurality of control states including a first state in which a subject tracking mode is not set and a second state in which the mode is set and a tracking target subject can be selected. The control state of the tracking control unit is set by selecting the control state to be set, and the correction control unit acquires the information of the control state selected from the setting unit, and the first control unit A control apparatus that performs control to change a characteristic for calculating the correction amount so that the image blur correction effect in the second state is higher than the image blur correction effect in the state. The plurality of control states include a third state in which a subject is selected and tracking control is performed,
The control device according to claim 1, wherein the correction control unit makes the image blur correction effect in the third state higher than the image blur correction effect in the second state.   The said correction control means is provided with the filter which calculates the said correction amount, The degree of an image blurring correction effect is changed by changing the characteristic of this filter, The Claim 1 or Claim 2 characterized by the above-mentioned. Control device.   When the correction control means obtains the shake detection signal, determines panning or tilting, changes the characteristic for calculating the correction amount according to the determination result, and determines that panning or tilting is performed Therefore, it is possible to perform control to change the degree of image blur correction effect by performing processing for further shifting the correction amount to the center of the control range than when it is determined that panning or tilting is not performed. The control device according to claim 1, wherein the control device is a control device. A correction control unit that acquires a shake detection signal detected by the shake detection unit, calculates a correction amount of the image blur, and controls an image blur correction unit that corrects the image blur;
Subject detection means for detecting the position of the subject in the photographed image and obtaining position information of the subject in the photographed image;
Tracking control means for performing tracking control of the subject by moving the position of the subject in the captured image based on the position information of the subject acquired by the subject detection means;
The control device, wherein the correction control means changes a degree of an image blur correction effect based on detection information of the subject by the subject detection means. A determination means for determining whether or not the subject is detected;
The correction control unit acquires the determination information by the determination unit, and the image blur correction effect in a state in which it is determined that the subject is detected is obtained in a state in which it is determined that the subject is not detected. The control device according to claim 5, wherein control is performed so that the image blur correction effect is higher. The tracking control means moves the position of the subject in the captured image to reduce the distance between the position of the subject in the captured image and a position set in advance in the captured image. Subject tracking control,
The correction control means is configured such that a distance between the subject position and the preset position is a threshold value rather than an image blur correction effect when a distance between the subject position and the preset position is less than the threshold value. The control apparatus according to claim 5, wherein control is performed to reduce an image blur correction effect in the above case. A reliability determination unit that determines the reliability of the image of the subject by comparing the reliability of the detected image of the subject with a threshold;
The correction control means is based on the determination result by the reliability determination means, and the image blur correction effect when the reliability is greater than or equal to the threshold than the image blur correction effect when the reliability is smaller than the threshold. The control device according to claim 5, wherein control is performed to increase the value.   The said correction control means is provided with the filter which calculates the said correction amount, The degree of an image blur correction effect is changed by changing the characteristic of this filter, The any one of Claim 5 thru | or 8 characterized by the above-mentioned. The control device described in 1. Determining means for determining whether or not the subject tracking control is possible;
Warning instruction means for giving an instruction to issue a warning when the determination means determines that the subject tracking control is not possible;
The control device according to claim 5, further comprising: Movable means for shifting the position of the subject in the captured image;
The tracking control means calculates a tracking correction amount that is a correction amount of the movable means necessary for moving the subject to a preset position in the captured image, and controls the movable means to control the movable means. The control device according to claim 5, wherein the subject is tracked. A correction control unit that acquires a shake detection signal detected by the shake detection unit, calculates a correction amount of the image blur, and controls an image blur correction unit that corrects the image blur;
Subject detection means for detecting the position of the subject image in the photographed image and obtaining position information of the subject in the photographed image;
Tracking control means for performing tracking control of the subject by moving the position of the subject image in the captured image based on the position information of the subject acquired by the subject detection means;
Determining means for determining whether or not the subject can be tracked;
A control apparatus comprising: warning instruction means for giving an instruction to issue a warning when it is determined by the determination means that the tracking of the subject image is not possible. Movable means for shifting the position of the subject in the captured image;
13. The control device according to claim 12, wherein the determination unit determines that the subject is not in a state where tracking is possible when a correction amount for driving the movable unit exceeds a threshold value.   The determination unit is not in a state in which the subject can be tracked when a state where the position of the subject image in the captured image is separated from a preset position by a predetermined distance or more continues for a predetermined time or more. The control device according to claim 12 or 13, wherein the control device is determined.   The determination unit determines that the subject is not in a state where tracking is possible when the reliability that the subject image in the captured image is a subject image to be tracked is smaller than a threshold. Item 15. The control device according to any one of Items 12 to 14.   The determination unit determines that the tracking target subject is not in a state where tracking is not possible when the tracking target subject is not detected from the tracking target subject detection state. The control device according to claim 12, wherein the control device is a control device.   The control device according to claim 12, wherein the determination unit determines whether or not the subject can be tracked based on a magnitude of shake of the control device. An image sensor for imaging a subject;
An image pickup apparatus comprising: the control device according to claim 1.