JP6833381B2 - Imaging equipment, control methods, programs, and storage media - Google Patents

Description

The present invention relates to an imaging device that assists in panning.

There is panning as a shooting technique that expresses the sense of speed of a moving subject. The purpose of the photographing technique is to make a moving subject stand still and let the background flow by panning the camera according to the movement of the subject.

Here, in the above-mentioned shooting technique, the photographer needs to pan according to the movement of the subject. However, if the panning speed is too fast or too slow, there is a difference between the moving speed of the subject and the panning speed. If it occurs, the image may be blurred even to the subject. To solve such a problem, panning assist has been proposed as a technique for assisting the photographer in panning photography. The panning assist is a method of absorbing the difference between the moving speed of the subject and the panning speed by moving the shift lens for image stabilization based on the panning speed and the motion vector of the subject detected from the image.

In Patent Document 1, it is possible to take a beautiful panning photograph by calculating the panning correction amount based on the motion vector amount of the subject image and the panning speed and moving the shift lens at the same time as the still image shooting. An imaging device is disclosed.

Japanese Unexamined Patent Publication No. 2015-197562

However, in the image pickup apparatus of Patent Document 1, the case where the calculated panning correction amount exceeds the range of motion of the shift lens (vibration-proof control lens) for camera shake correction is not considered. In addition, if the photographer cannot take a clear picture by panning, the camera shake correction by panning assist is not appropriate because the photographer's panning method was not appropriate or the camera misidentified the subject. It is necessary for the photographer to judge from the image. Furthermore, if the photographer's panning method is not appropriate, the photographer himself must make trial and error as to how to improve it.

The present invention provides an imaging instrumentation置等capable of feedback information indicating the result of the image stabilization control in the panning shot (panning assist) the photographer.

The image pickup device as one aspect of the present invention has a detachable lens device. The image pickup device includes an image pickup element that photoelectrically converts an optical image formed via a lens device, a motion vector detection means that detects a motion vector based on an image signal output from the image pickup element, a motion vector, and an angular velocity. The result of the calculation means for calculating the angular velocity information indicating the angular velocity or the angular velocity of the subject based on the angular velocity detected by the detection means, and the vibration isolation control executed in the lens device based on the angular velocity information during still image shooting. It has an acquisition means for acquiring the image from the lens device after shooting a still image, and a control means for controlling the display means to display information indicating the result of anti-vibration control together with the still image obtained by shooting the still image. The information indicating the result of the anti-vibration control includes information indicating the success or failure of the anti-vibration control, information indicating the subject position in the still image, information on the angular velocity information during the still image shooting, and calculation before the still image shooting. It is characterized by including at least one of information on the predicted angular velocity of the subject and information on the direction for correcting the panning direction .

The control method as another aspect of the present invention is applied to an imaging device to which a lens device can be attached and detached. The control method includes a step of detecting a motion vector based on an image signal output from an image signal that photoelectrically converts an optical image formed through a lens device, the motion vector, and an angular velocity detecting means. The step of calculating the angular velocity information indicating the angular velocity or the angular acceleration of the subject based on the angular velocity, and the result of the anti-vibration control executed in the lens device based on the angular velocity information during the still image shooting are obtained by the lens device after the still image shooting. It has a step of acquiring from the image and a step of controlling the display means to display information indicating the result of the anti-vibration control together with the still image obtained by shooting the still image. The information indicating the result of the anti-vibration control includes information indicating the success or failure of the anti-vibration control, information indicating the subject position in the still image, information on the angular velocity information during the still image shooting, and calculation before the still image shooting. It is characterized by including at least one of information on the predicted angular velocity of the subject and information on the direction for correcting the panning direction .

A program as another aspect of the present invention causes a computer to perform a process according to the above control method.

A storage medium as another aspect of the present invention stores the program.

Other objects and features of the present invention will be described in the following examples.

According to the present invention, as information indicating the result of anti-vibration control (follow-up assist) in panning photography, not only information indicating success or failure of anti-vibration control, but also information indicating the subject position in a still image, during still image photographing. At least one of the information on the angular velocity information, the information on the predicted angular velocity of the subject calculated before shooting the still image, and the information on the direction for correcting the panning direction is displayed to the photographer together with the still image obtained by shooting. can do.

It is a block diagram of the camera system in each embodiment. It is a flowchart of the image pickup synchronous communication process by the camera body in each Example. It is a flowchart of the exposure setting process by the camera body in each Example. It is a flowchart of still image shooting by a camera body in each embodiment. It is a flowchart of the reception processing of the synchronous signal communication by the interchangeable lens in each embodiment. It is a flowchart of the reception process of the setting communication of the lens angular velocity detection period by the interchangeable lens in each embodiment. It is a flowchart of the reception process of subject angular velocity communication by an interchangeable lens in each embodiment. It is a flowchart of the reception process of the still image shooting start timing communication by the interchangeable lens in Example 1. It is a flowchart of the reception process of the panning assist result communication by the interchangeable lens in each embodiment. It is a timing chart of the panning assist processing by the camera system in each embodiment. This is an example of a captured image displayed on the camera body in each embodiment. It is a flowchart of the still image shooting start timing communication reception processing by an interchangeable lens in Example 2.

Hereinafter, examples of the present invention will be described in detail with reference to the drawings.

First, the camera system according to the first embodiment of the present invention will be described with reference to FIG. FIG. 1 is a block diagram of the camera system 10 (imaging apparatus or imaging system) in this embodiment. In this embodiment, the camera system 10 includes a camera body 100 (imaging device or imaging device body) and an interchangeable lens 200 (lens device) that can be attached to and detached from the camera body 100. However, this embodiment is not limited to this, and can be applied to an imaging device in which an imaging device main body and a lens device are integrally configured.

As shown in FIG. 1, an interchangeable lens 200 is detachably attached to the camera body 100 of this embodiment via a lens mount portion 12. The interchangeable lens 200 that can be attached to the camera body 100 is provided with an imaging optical system including a focus lens 201, a zoom control unit 202, an aperture 203, and an anti-vibration control lens 204. Note that FIG. 1 shows one lens as the focus lens 201, the zoom control unit 202 (zoom lens), or the anti-vibration control lens 204, and each lens is composed of a plurality of lenses. It may be a lens group. The luminous flux formed through the image pickup optical system is guided to the image pickup element 102 and is imaged as an optical image on the image pickup element 102.

First, the configuration of the camera body 100 will be described. The shutter 101 controls the amount of exposure to the image sensor 102. The image pickup device 102 includes a CCD sensor and a CMOS sensor, and converts an optical image of a subject into an analog image signal. That is, the image sensor outputs an image signal by photoelectrically converting an optical image formed via the image pickup optical system. Further, the image sensor 102 may have a plurality of pixels (focus detection pixels) used for focus detection. The A / D conversion unit 103 converts the analog image signal output from the image sensor 102 into a digital image signal, and outputs the digital image signal to the image processing unit 140 and the memory control unit 105. The optical image of the subject can be observed by the optical finder 114 through the mirrors 112 and 113 while the mirror 112 is down. The timing generation unit 104 supplies a clock signal and a synchronization signal to the image sensor 102, the A / D conversion unit 103, the image processing unit 140, the memory control unit 105, and the system control unit 130.

The image processing unit 140 performs predetermined pixel complementation processing and color conversion processing on the digital image signal from the A / D conversion unit 103 or the data from the memory control unit 105 to generate image data. Further, the image processing unit 140 performs a predetermined arithmetic process using the digital image signal. The image processing unit 140 determines the position of the subject and tracks the subject based on the color and shape of the subject. Further, the image processing unit 140 has a motion vector detection unit 141. The motion vector detection unit 141 detects a motion vector (motion vector amount) from the subject positions over a plurality of frames of the tracked subject. The subject position is composed of the upper left coordinate of the subject, the height and the width. The calculation result of the image processing unit 140 is output to the system control unit 130 via the memory control unit 105.

The memory control unit 105 controls the A / D conversion unit 103, the timing generation unit 104, the image processing unit 140, the memory 107, the recording unit 108, and the image display unit 106. The output data from the A / D conversion unit 103 is written to the memory 107 and the recording unit 108 via the image processing unit 140 and the memory control unit 105. The memory 107 and the recording unit 108 store captured still images and moving images. The memory 107 is composed of a volatile memory and is also used as a work area of the system control unit 130. The recording unit 108 is used as an image recording area composed of a non-volatile memory attached to the inside or the outside of the camera body 100.

The image display unit 106 (display means) is configured by using an LCD or the like, and displays an image output from the A / D conversion unit 103, or displays an image recorded on the recording unit 108. Further, the image display unit 106 can display the shooting conditions such as the shutter speed, the panning assist result, and the subject position on the image. As will be described later, the system control unit 130 (control means) controls the image display unit 106 to superimpose the still image and the information indicating the result of the vibration isolation control. The shutter control unit 110 controls the shutter 101 based on the control signal from the system control unit 130 in cooperation with the mirror control unit 111. The mirror control unit 111 controls the mirror 112 based on the control signal from the system control unit 130.

The system control unit 130 controls the entire camera system 10 including the camera body 100 according to input signals from the shutter switch 115 (SW1), the shutter switch 116 (SW2), the camera operation unit 117, the memory control unit 105, and the like. To do. That is, the system control unit 130 controls the interchangeable lens 200 and the like via the image sensor 102, the memory control unit 105, the shutter control unit 110, the mirror control unit 111, and the I / F 120 according to the above-mentioned input signals.

The shutter switch 115 (SW1) instructs the system control unit 130 to start operations such as AF processing, AE processing, and AWB processing. The shutter switch 116 (SW2) instructs the system control unit 130 to start exposure. Upon receiving the exposure start instruction, the system control unit 130 controls the interchangeable lens 200 via the mirror control unit 111, the shutter control unit 110, the memory control unit 105, and the I / F 120 to start the exposure of the image sensor 102. To do. The system control unit 130 ends the exposure when the shutter speed time has elapsed. Then, the system control unit 130 converts the still image exposed by the image sensor 102 into digital data via the A / D conversion unit 103, and holds it in the memory control unit 105. At this time, the memory control unit 105 holds the shooting conditions and the panning assist result together. After that, the system control unit 130 saves the still image held in the memory control unit 105 as JPEG or RAW data. The shooting conditions and the panning assist result are embedded in the still image data as EXIF information.

The camera operation unit 117 includes various buttons, a touch panel, a power on / off button, and the like, and outputs an instruction received by the photographer's operation to the system control unit 130. According to the operation of the photographer via the camera operation unit 117, the system control unit 130 performs each operation such as AF mode, AE mode, and panning assist mode, which are one of various functions mounted on the camera body 100. Switch modes. The camera power control unit 118 manages the external battery and the built-in battery of the camera body 100. When the battery is removed or the battery is exhausted, the camera power control unit 118 performs an emergency shutoff process for controlling the camera body 100. At this time, the system control unit 130 shuts off the power supplied to the interchangeable lens 200.

The AF control unit 131 is provided in the system control unit 130 and controls the AF processing of the camera body 100. During the AF process, the AF control unit 131 drives the focus lens 201 based on the lens information such as the focus position and focal length obtained from the interchangeable lens 200 via the I / F 120 and the AF evaluation value according to the AF mode. Calculate the quantity. The drive amount of the focus lens 201 is input to the interchangeable lens 200 via the lens communication control unit 133 provided in the system control unit 130 and the I / F 120. For example, in the phase difference AF mode, the AF control unit 131 makes the optical image of the subject incident on the focus detection unit (not shown) via the mirror 112 and the focus detection sub-mirror (not shown) to obtain the phase difference AF evaluation. The driving amount of the focus lens 201 is calculated based on the value and the like. In the contrast AF mode, the AF control unit 131 calculates the driving amount of the focus lens 201 based on the contrast AF evaluation value calculated by the image processing unit 140. In the imaging surface phase difference AF mode, the AF control unit 131 drives the focus lens 201 based on the imaging surface phase difference AF evaluation value output from the pixels of the imaging element 102 (pixels used for focus detection). Calculate the quantity. Further, the AF control unit 131 switches the position of the AF frame for calculating the evaluation value according to the AF evaluation modes such as the one-point AF mode, the multi-point AF mode, and the face detection AF mode.

The AE control unit 132 is provided in the system control unit 130 and controls the AE processing of the camera body 100. At the time of AE processing, the AE control unit 132 follows the AE mode, and based on the lens information such as the open F value and the focal length obtained from the interchangeable lens 200 via the I / F 120, and the AE evaluation value, the AE control amount. (Aperture control amount, shutter control amount, exposure sensitivity, etc.) are calculated. The aperture control amount is input to the interchangeable lens 200 via the lens communication control unit 133 and the I / F 120. The shutter control amount is input to the shutter control unit 110. The exposure sensitivity is input to the image sensor 102. For example, in the finder shooting mode, the AE control unit 132 determines the AE control amount based on the AE evaluation value obtained by incidenting the optical image of the subject on the brightness determination unit (not shown) via the mirror 112 and the mirror 113. Calculate. In the live view shooting mode, the AE control unit 132 calculates the AE control amount based on the AE evaluation value calculated by the image processing unit 140. Further, the AE control unit 132 switches the AE frame position and the weighting amount for calculating the evaluation value according to the metering modes such as the evaluation metering mode, the average metering mode, and the face detection metering mode.

The panning assist control unit 134 is provided in the system control unit 130, and controls the panning assist processing of the camera body 100. The panning assist function can be executed only when the live view shooting mode is set and the attached interchangeable lens 200 supports panning assist. When the panning assist function cannot be executed, the panning assist control unit 134 controls only the flow amount of the image according to the panning assist mode. Specifically, the panning assist control unit 134 AE controls the shutter control amount so that the deflection angle during exposure becomes an arbitrary amount based on the angular velocity information obtained from the angular velocity detection unit 208 of the interchangeable lens 200. Notify the unit 132 and control only the flow amount of the image.

On the other hand, when the panning assist function can be executed, the panning assist control unit 134 instructs the interchangeable lens 200 whether or not the panning assist processing can be executed according to the panning assist mode. Further, the subject such as the subject angular velocity and the subject angular acceleration is based on the lens angular velocity information obtained from the interchangeable lens 200 via the I / F 120, the lens information such as the focal length, and the amount of motion vector input from the image processing unit 140. Calculate the angular velocity information of. As described above, the panning assist control unit 134 is a calculation means for calculating the angular velocity information of the subject based on the motion vector and the angular velocity detected by the angular velocity detection unit 208.

Further, the panning assist control unit 134 calculates the set value of the lens angular velocity detection period based on the frame rate, the shutter speed, and the like so that the lens angular velocity detection period coincides with the motion vector detection period. The subject angular velocity information and the set value of the lens angular velocity detection period are input to the interchangeable lens 200 via the lens communication control unit 133 and the I / F 120. At this time, the set value of the lens angular velocity detection period includes the angular velocity ID information. The angular velocity ID information is added so that the panning assist control unit 134 determines in what period the lens angular velocity received from the interchangeable lens 200 is the acquired angular velocity. Therefore, the lens angular velocity information also includes the angular velocity ID information, and the angular velocity ID information and the lens angular velocity information are linked to each other and transmitted to the camera body 100.

The lens communication control unit 133 is provided in the system control unit 130, and controls communication processing between the camera body 100 and the interchangeable lens 200. When it is detected that the interchangeable lens 200 is attached via the I / F 120, the lens communication control unit 133 starts communication between the camera body 100 and the interchangeable lens 200, receives lens information as appropriate, and receives camera information and the like. Send a drive command, etc. For example, consider a case where the interchangeable lens 200 set in the live view shooting mode and mounted is compatible with panning assist. In this case, when the imaging synchronization signal is input from the timing generation unit 104, the lens communication control unit 133 performs the synchronization signal communication for notifying the communication start delay time from the imaging synchronization signal to the start of communication. When the exposure by the shutter switch 116 (SW2) is completed, the lens communication control unit 133 receives the panning assist result information from the interchangeable lens 200. In the live view shooting mode, when the imaging synchronization signal is input from the timing generator 104, the lens communication control unit 133 collectively receives the lens information (focus lens position, focus lens state, aperture state, focal length, etc.). To do.

The I / F 120 is a communication interface between the camera body 100 and the interchangeable lens 200. The I / F 120 transmits / receives lens information, control commands, and the like by performing communication using an electric signal between the system control unit 130 of the camera body 100 and the lens control unit 210 via the connector 20.

Next, the configuration of the interchangeable lens 200 will be described. The focus lens 201 moves in a direction along the optical axis OA (optical axis direction) to change the focus (focus state) of the imaging optical system. The focus control unit 205 is controlled by the lens control unit 210 to drive the focus lens 201. Further, the focus control unit 205 outputs focus information such as the position of the focus lens 201 to the lens control unit 210.

The zoom control unit 202 moves in the optical axis direction to change the focal length of the imaging optical system. The zoom control unit 206 is controlled by the lens control unit 210 to drive the zoom control unit 202. Further, the zoom control unit 206 outputs zoom information such as the focal length to the lens control unit 210. The aperture 203 (aperture value) of the aperture 203 is variable, and the amount of light is changed according to the aperture diameter. The aperture control unit 207 is controlled by the lens control unit 210 to drive the aperture 203. Further, the aperture control unit 207 outputs aperture information such as an aperture value (F value) to the lens control unit 210.

The anti-vibration control lens 204 moves in a direction orthogonal to the optical axis OA (direction orthogonal to the optical axis) to reduce image blur caused by camera shake due to camera shake or the like. The anti-vibration control unit 209 is controlled by the lens control unit 210 to drive the anti-vibration control lens 204. Further, the vibration isolation control unit 209 outputs vibration isolation information such as the vibration isolation possible range to the lens control unit 210.

The angular velocity detecting unit 208 (angular velocity detecting means) detects the angular velocity (velocities in the Yaw direction and the Pitch direction) of the interchangeable lens 200 and outputs the angular velocity to the lens control unit 210. The angular velocity detection unit 208 is controlled by the lens control unit 210. The angular velocity detection unit can also be provided on the camera body 100.

The lens operation unit 211 includes a focus ring, a zoom lens, an AF / MF switch, an IS on / off switch, and the like, and outputs an instruction received by the photographer's operation to the lens control unit 210. According to the operation of the photographer via the lens operation unit 211, the system control unit 130 switches the operation mode for various functions mounted on the interchangeable lens 200. The memory 212 is composed of a volatile memory.

The lens control unit 210 controls the focus control unit 205, the zoom control unit 206, the aperture control unit 207, the vibration isolation control unit 209, the angular velocity detection unit 208, and the like according to the input signal from the lens operation unit 211 or the I / F 220. To do. As a result, the lens control unit 210 controls the entire interchangeable lens 200. Further, the lens control unit 210 transmits the information input from each control unit, the detection unit, and the like to the camera body 100 via the I / F 220 in response to the lens information acquisition command received via the I / F 220. ..

The I / F 220 is an interface (communication means) for communication between the camera body 100 and the interchangeable lens 200. The I / F 220 transmits / receives lens information, control commands, and the like by performing communication using an electric signal between the system control unit 130 of the camera body 100 and the lens control unit 210 via the connector 20. As will be described later, the I / F 220 transmits the result of vibration isolation control (follow shot assist result) to the camera body 100 after shooting a still image.

Next, the image pickup synchronous communication process of the camera body 100 in this embodiment will be described with reference to FIG. FIG. 2 is a flowchart of imaging synchronous communication processing of the camera body 100, and is a camera body when the camera body 100 is in the live view shooting mode and the attached interchangeable lens 200 supports panning assist. It shows 100 operations. The image pickup synchronous communication process is a process started in the live view shooting mode, and is a process for the lens control unit 210 to communicate with the interchangeable lens 200 at the timing of the image pickup synchronous signal.

First, in step S201, the system control unit 130 determines whether or not live view shooting is continuing. If the live view shooting is continuing, the process proceeds to step S202. On the other hand, if the live view shooting is not continued, the imaging synchronous communication process of this flow is terminated.

In step S202, the system control unit 130 determines whether or not the imaging synchronization signal has been input. If the imaging synchronization signal is input, the process proceeds to step S203. On the other hand, if the imaging synchronization signal is not input, the process returns to step S201. In step S203, the system control unit 130 stores the time when the imaging synchronization signal is input as the imaging synchronization signal time in the internal memory (not shown) of the system control unit 130, the memory 107, or the like. Subsequently, in step S204, the system control unit 130 determines whether or not unprocessed lens communication remains. If unprocessed lens communication remains, the process proceeds to step S205. On the other hand, if there is no unprocessed lens communication remaining, the process proceeds to step S206. In step S205, the system control unit 130 completes the unprocessed lens communication and proceeds to step S206.

In step S206, the system control unit 130 determines whether or not to carry out synchronous signal communication. When the interchangeable lens 200 supports panning assist and the panning assist mode is effective, the system control unit 130 determines that synchronous signal communication is to be performed, and proceeds to step S207. On the other hand, if the system control unit 130 determines that the synchronous signal communication is not performed, the process returns to step S201.

In step S207, the system control unit 130 measures the elapsed time from the imaging synchronization signal time, and stores this elapsed time as a delay time (synchronization signal communication delay time) in the internal memory or the memory 107. Subsequently, in step S208, the system control unit 130 performs synchronous signal communication to the interchangeable lens 200 via the I / F 120. The transmission data of the synchronous signal communication includes the synchronous signal delay time. Subsequently, in step S209, the system control unit 130 transmits the set value communication of the lens angular velocity detection period to the interchangeable lens 200 via the I / F 120, and returns to step S201. Set value of lens angular velocity detection period As transmission data for communication, the system control unit 130 transmits the above-mentioned set value of the lens angular velocity detection period input from the panning assist control unit 134.

By performing the above processing, the image pickup synchronization signal can be notified from the camera body 100 to the interchangeable lens 200, and the lens angular velocity detection period can be set.

Next, the exposure setting process of the camera body 100 will be described with reference to FIG. FIG. 3 is a flowchart of the exposure setting process of the camera body 100, in which the camera body 100 is in the live view shooting mode and the attached interchangeable lens 200 supports panning assist. The operation of 100 exposure setting processing is shown. The exposure setting process is a process performed for each frame in the live view shooting mode, and is a process for controlling the exposure of the next frame.

First, in step S301, the system control unit 130 determines whether or not live view shooting is continuing. If the live view shooting is continuing, the process proceeds to step S302. On the other hand, if live view shooting is not ongoing, the exposure setting process of this flow is terminated.

In step S302, the system control unit 130 determines whether or not it is the exposure setting timing of the image sensor 102 of the next frame. If it is the exposure setting timing, the process proceeds to step S303. On the other hand, if it is not the exposure setting timing, the process returns to step S301.

In step S303, the system control unit 130 calculates the exposure set value based on the AE control amount, the camera mode, and the like. Further, the system control unit 130 controls the exposure of the next frame by outputting the exposure set value to the memory control unit 105. Subsequently, in step S304, the panning assist control unit 134 determines whether or not to perform the panning assist processing. When the interchangeable lens 200 supports panning assist and the panning assist mode is effective, the panning assist control unit 134 determines that the panning assist processing is to be performed, and proceeds to step S305. On the other hand, if the panning assist control unit 134 determines that the panning assist processing is not performed, the process returns to step S301.

In step S305, the panning assist control unit 134 synchronizes the imaging of the lens angular velocity detection period so that the motion vector detection period and the lens angular velocity detection period coincide with each other based on the exposure setting of the next frame and the like. Calculated as the relative time from the signal. The calculated lens angular velocity detection period setting value is transmitted to the interchangeable lens 200 in step S209 described above. The set value of the lens angular velocity detection period includes the angular velocity ID information. The angular velocity ID information is added so that the panning assist control unit 134 determines in which period the lens angular velocity received from the interchangeable lens 200 is the angular velocity acquired. Therefore, the lens angular velocity information also includes the angular velocity ID information, and the angular velocity ID information and the lens angular velocity information are linked to each other and transmitted to the camera body 100.

Subsequently, in step S306, the panning assist control unit 134 receives the lens information such as the lens angular velocity information and the focal length from the interchangeable lens 200, and the angular velocity of the subject based on the motion vector amount input from the image processing unit 140. Calculate the information. The subject angular velocity information includes the subject angular velocity and the subject angular acceleration. Further, the panning assist control unit 134 inputs the calculated angular velocity information of the subject to the lens communication control unit 133. The angular velocity information of the subject includes the lens angular velocity information acquisition time corresponding to the lens angular velocity information used for the calculation. Further, the panning assist control unit 134 holds the subject position detected by the image processing unit 140 in the memory 107 via the memory control unit 105. One or more subject positions including the latest values are held in the memory 107. After completing these processes, the system control unit 130 proceeds to step S307. In step S307, the lens communication control unit 133 performs subject angular velocity communication in order to transmit subject angular velocity information to the interchangeable lens 200, and returns to step S301. In this embodiment, the received data of the subject angular velocity communication includes the lens angular velocity information.

By performing the above processing, it is possible to control the exposure of the next frame and set the lens angular velocity detection period for notifying the interchangeable lens 200 with the next imaging synchronization signal. Further, the subject angular velocity can be notified to the interchangeable lens 200, and the lens angular velocity information can be acquired from the interchangeable lens 200.

Next, the live view still image shooting process of the camera body 100 will be described with reference to FIG. FIG. 4 is a flowchart of still image shooting (live view still image shooting processing) of the camera body 100. FIG. 4 shows the operation of the live view still image shooting process of the camera body 100 in the live view shooting mode and when the attached interchangeable lens 200 supports panning assist. The live view still image shooting process is a process started by a still image shooting start instruction via the shutter switch 116 in the live view shooting mode.

First, in step S401, the system control unit 130 notifies the interchangeable lens 200 that it is the still image shooting start timing by communication via the lens communication control unit 133. Subsequently, in step S402, the system control unit 130 controls the shutter control unit 110 and the image sensor 102 to perform a still image exposure process and acquire image data. The image data is held in the memory 107 via the image processing unit 140 and the memory control unit 105. When these processes are completed, the process proceeds to step S403. In step S403, the system control unit 130 notifies the interchangeable lens 200 of the still image shooting end timing by communication via the lens communication control unit 133.

Subsequently, in step S404, the lens communication control unit 133 determines whether or not to perform the panning assist process. When the interchangeable lens 200 supports panning assist and the panning assist mode is effective, the lens communication control unit 133 determines that the panning assist processing is to be performed, and proceeds to step S405. On the other hand, if the panning assist process is not performed, the process proceeds to step S406.

In step S405, the lens communication control unit 133 performs communication for receiving the panning assist result information from the interchangeable lens 200. Here, the lens communication control unit 133 (acquisition means) acquires the result of anti-vibration control (follow-up assist result) during still image shooting executed based on the angular velocity information of the subject. Preferably, the lens communication control unit 133 acquires the result of vibration isolation control from the interchangeable lens 200 by communicating with the interchangeable lens 200 after taking a still image.

Subsequently, in step S406, the system control unit 130 creates EXIF information to be added to the image file. The EXIF information is recorded in the memory 107 via the memory control unit 105. In this embodiment, the EXIF information includes the panning assist result information received in step S405 as well as the shooting conditions such as the lens information, the shutter speed, and the aperture value. The panning assist result information includes the success or failure of the panning assist, as well as the subject angular velocity V, the panning assist amount average value Ga, and the panning amount average value ga, which will be described later. Further, the EXIF information includes the latest subject position held in the memory 107 in step S306.

Subsequently, in step S407, the system control unit 130 controls the image processing unit 140 to create an image file from the image data and the EXIF information. Further, the system control unit 130 holds the image data in the memory 107 via the memory control unit 105, and then records the image data in the recording unit 108. Subsequently, in step S408, the system control unit 130 displays the image data held in the memory 107 on the image display unit 106 for a certain period of time. At that time, the system control unit 130 displays the shooting conditions included in the EXIF information of the image data, the panning assist result, and the subject position on the image (image data). The display contents of the image display unit 106 will be described later with reference to FIG.

By performing the above processing, the result of the panning assist performed at the time of exposure can be acquired from the interchangeable lens 200, and the panning assist result can be recorded in the acquired image data and displayed on the image display unit 106. It will be possible.

Next, the reception process of the synchronous signal communication by the interchangeable lens 200 will be described with reference to FIG. FIG. 5 is a flowchart of the reception process of the synchronous signal communication of the interchangeable lens 200. FIG. 5 shows a process started when the interchangeable lens 200 receives a synchronization signal communication from the camera body 100 in the live view shooting mode and the mounted interchangeable lens 200 supports panning assist. ing.

First, in step S501, the lens control unit 210 stores the time when the communication is performed by storing the current time of the free run timer used for time management in the interchangeable lens 200. This time is stored in the internal memory (not shown) of the lens control unit 210 or the memory 212.

Subsequently, in step S502, the lens control unit 210 determines whether or not communication is performed by the communication data length of the predetermined synchronization signal communication (whether or not all data transmission / reception is completed). If the communication (transmission / reception) of all data is not completed, step S502 is repeated until the communication of all data is completed. On the other hand, when the communication of all data is completed, the process proceeds to step S503. In step S503, the lens control unit 210 subtracts the delay time (synchronous signal delay time) included in the received data of the synchronous signal communication from the time (time when the communication is performed) stored in step S501. As a result, it is possible to calculate (set) the time of the in-lens imaging synchronization signal that coincides with the imaging synchronization signal timing in the camera body 100.

By performing the above processing, the interchangeable lens 200 can know the in-lens imaging synchronization signal time that coincides with the imaging synchronization signal timing in the camera body 100.

Next, with reference to FIG. 6, the reception process of the set value communication of the lens angular velocity detection period by the interchangeable lens 200 will be described. FIG. 6 is a flowchart of the reception process of the set value communication of the lens angular velocity detection period by the interchangeable lens 200. FIG. 6 shows when the interchangeable lens 200 receives the set value communication of the lens angular velocity detection period from the camera body 100 in the live view shooting mode and when the mounted interchangeable lens 200 supports panning assist. Indicates the process to be started.

First, in step S601, the lens control unit 210 determines whether or not communication is performed by the communication data length of the set value communication of the lens angular velocity detection period determined in advance (whether or not all data transmission / reception is completed). If the communication (transmission / reception) of all data is not completed, step S601 is repeated until the communication of all data is completed. On the other hand, when the communication of all data is completed, the process proceeds to step S602.

In step S602, the lens control unit 210 determines the lens angular velocity detection period included in the received data of the set value communication of the lens angular velocity detection period and the time of the in-lens imaging synchronization signal calculated in step S503 described above. Set the lens angular velocity detection period. The lens control unit 210 acquires the lens angular velocity in the lens angular velocity detection period from the angular velocity detection unit 208. Then, the lens control unit 210 adds the angular velocity ID information included in the set value communication of the lens angular velocity detection period and the lens angular velocity information acquisition time to the lens angular velocity information and stores them in the internal memory or the memory 212. Further, the lens control unit 210 stores in the memory 212 that the panning assist is effective.

By performing the above processing, the interchangeable lens 200 can set a lens angular velocity detection period that coincides with the motion vector detection period in the camera body 100.

Next, with reference to FIG. 7, the reception process of the subject angular velocity communication by the interchangeable lens 200 will be described. FIG. 7 is a flowchart of the reception process of the subject angular velocity communication by the interchangeable lens 200. FIG. 7 shows a process started when the interchangeable lens 200 receives the subject angular velocity communication from the camera body 100 in the live view shooting mode and the mounted interchangeable lens 200 supports panning assist. ing.

First, in step S701, the lens control unit 210 prepares (holds) the lens angular velocity information in the transmission buffer in order to transmit the lens angular velocity information stored in step S602 to the camera body 100. Subsequently, in step S702, the lens control unit 210 determines whether or not communication is performed by the communication data length of the predetermined subject angular velocity communication (whether or not all data transmission / reception is completed). If the transmission / reception (communication) of all data is not completed, step S702 is repeated until the communication of all data is completed. On the other hand, when the communication of all data is completed, the process proceeds to step S703. In step S703, the lens control unit 210 stores the subject angular velocity information in the internal memory or the memory 212 in preparation for the exposure start timing.

By performing the above processing, the interchangeable lens 200 can set a lens angular velocity detection period that coincides with the motion vector detection period of the camera body 100.

Next, with reference to FIG. 8, the reception process of the still image shooting start timing communication by the interchangeable lens 200 will be described. FIG. 8 is a flowchart of reception processing of still image shooting start timing communication by the interchangeable lens 200. FIG. 8 shows, in the present embodiment, when the interchangeable lens 200 mounted in the live view shooting mode supports panning assist, the interchangeable lens 200 receives the still image shooting start timing communication from the camera body 100. It shows the processing that is sometimes performed.

First, in step S801, the lens control unit 210 determines whether or not the panning assist processing should be performed for still image shooting. Specifically, the determination is made with reference to the area of the memory 212 to be written in step S602. When carrying out the panning assist process, the process proceeds to step S802. On the other hand, if the panning assist process is not performed, the process proceeds to step S808.

In step S802, the lens control unit 210 (prediction means) predicts the subject angular velocity at the current time from the subject angular velocity information stored in step S703 and the current time (predicted angular velocity of the subject before shooting a still image). To calculate). When the current time is T, the subject angular velocity at the current time T is V, the subject angular velocity and subject angular velocity included in the subject angular velocity information, and the lens angular velocity information acquisition time are v, a, and t, respectively, the lens control unit 210 Performs a prediction calculation as represented by the following equation (1).

However, the prediction operation is not limited to the equation (1), and other equations and methods may be used.

Subsequently, in step S803, the lens control unit 210 (vibration isolation control means) controls the vibration isolation control unit 209 using the angular velocity information of the subject at the current time, and executes the panning assist process. That is, the lens control unit 210 is using the angular velocity information of the subject calculated based on the angular velocity detected by the angular velocity detection unit 208 and the motion vector detected by the motion vector detection unit 141, and is taking a still image. Anti-vibration control is performed. For example, when the panning assist amount is G and the panning amount detected by the angular velocity detection unit 208 during still image shooting is g, the lens control unit 210 performs an operation as expressed by the following equation (2). Do.

However, the calculation method of the panning assist amount G is not limited to this. By controlling the anti-vibration control lens 204 by the amount of the panning assist amount during the still image shooting, it is possible to make the moving subject still.

Further, in step S803, the lens control unit 210 determines whether or not a still image is being photographed. Specifically, when the camera body 100 has not yet received the still image shooting end timing communication transmitted in step S403, the lens control unit 210 determines that the still image shooting is in progress. If a still image is being captured, the process proceeds to step S804. On the other hand, if the still image is not being photographed, the process proceeds to step S807.

In step S804, whether or not the lens control unit 210 is within the range of motion of the anti-vibration control lens 204 via the anti-vibration control unit 209 (whether or not the anti-vibration control lens 204 exceeds the range of motion during still image shooting). That is, whether or not the vibration isolation control end is reached) is determined. If it is within the range of motion of the anti-vibration control lens 204 (when the anti-vibration control lens 204 does not exceed the range of motion), the process proceeds to step S805. On the other hand, if the vibration isolation control lens 204 is out of the range of motion (when the vibration isolation control lens 204 exceeds the range of motion), the process proceeds to step S806.

In step S805, the lens control unit 210 executes the panning assist process. Specifically, the lens control unit 210 acquires the panning amount g from the angular velocity detection unit 208, and calculates the panning assist amount G using the equation (2). Further, the lens control unit 210 controls the vibration isolation control lens 204 by the amount of the panning assist amount G via the vibration isolation control unit 209. Further, the lens control unit 210 stores the panning assist amount G and the panning amount g in the memory 212. After executing step S805, the process returns to step S803.

In step S806, the lens control unit 210 saves the failure in the memory 212 as a panning assist result. Further, the lens control unit 210 sets the average value of the panning assist amount Ga and the average value of the panning assist amount Ga as the average value based on the subject angular velocity V calculated in step S802 and the panning assist amount G and the panning amount g saved in step S805. The average panning amount ga is calculated. Then, the lens control unit 210 stores the panning assist amount average value Ga and the panning amount average value ga in the memory 212 together with the panning assist amount result.

In step S807, the lens control unit 210 saves the success as a panning assist result in the memory 212. Further, the lens control unit 210 sets the average value of the panning assist amount Ga and the average value of the panning assist amount Ga as the average value based on the subject angular velocity V calculated in step S802 and the panning assist amount G and the panning amount g saved in step S805. The average panning amount ga is calculated. Then, the lens control unit 210 stores the panning assist amount average value Ga and the panning amount average value ga in the memory 212 together with the panning assist amount result.

In step S808, the lens control unit 210 performs normal camera shake correction by performing vibration isolation processing using only the angular velocity (camera shake amount) detected by the angular velocity detection unit 208.

By performing the above processing, the interchangeable lens 200 can transmit the panning assist result applied at the time of still image shooting (exposure) to the camera body 100, and the camera body 100 flows the acquired image data. The shooting assist result can be recorded.

Next, with reference to FIG. 9, the reception process of the panning assist result communication by the interchangeable lens 200 will be described. FIG. 9 is a flowchart of the reception process of the panning assist result communication by the interchangeable lens 200. FIG. 9 shows a process started when the interchangeable lens 200 receives the panning assist result communication from the camera body 100 in the live view shooting mode and the mounted interchangeable lens 200 supports panning assist. Is shown.

First, in step S901, the lens control unit 210 prepares (holds) the panning assist result in the transmission buffer in order to transmit the subject angular velocity and the like predicted and calculated in step S802 to the camera body 100 as the panning assist result. Subsequently, in step S902, the lens control unit 210 determines whether or not communication is performed by the communication data length of the predetermined panning assist result communication (whether or not all data transmission / reception is completed). If the communication (transmission / reception) of all data is not completed, step S902 is repeated until the communication of the previous data is completed. On the other hand, when the communication of all data is completed, the reception process of this flow is terminated.

According to this flow, the interchangeable lens 200 can transmit the panning assist result, the subject angular velocity V, the panning assist amount average value Ga, and the panning amount average value ga to the camera body 100.

Next, the panning assist process by the camera system 10 (camera body 100 and interchangeable lens 200) will be described with reference to FIG. FIG. 10 is a timing chart of the panning assist process by the camera system 10. FIG. 10 shows the processing timing of the camera system 10 in the panning assist mode when the interchangeable lens 200 mounted in the live view shooting mode supports panning assist.

The image pickup synchronization signal 1001 is a synchronization signal output by the timing generation unit 104. The image pickup storage 1002 is a storage period of the image pickup device 102, and receives the image pickup synchronization signal 1001 and starts reading in order from the upper part of the screen. The synchronous signal communication 1003 is the timing of the synchronous signal communication implemented in step S208 of FIG. The lens angular velocity detection period set value communication 1004 is the timing of the lens angular velocity detection period set value communication performed in step S209 of FIG.

The subject angular velocity communication 1005 is the timing of the subject angular velocity communication performed in step S307 of FIG. The still image shooting start timing communication 1006 is a timing for executing the still image shooting start timing communication carried out in step S401 of FIG. The panning assist result communication 1007 is the timing for executing the panning assist result communication performed in step S405 of FIG. The release timing 1018 is a timing at which the photographer issues a release instruction via the shutter switch 116.

The lens angular velocity detection period 1008 is the lens angular velocity detection period set in step S602 of FIG. When the lens angular velocity detection period is completed, the lens angular velocity corresponding to that period is calculated, and the angular velocity ID information included in the set value communication of the lens angular velocity detection period and the lens angular velocity information acquisition time are added to the lens angular velocity information. And remember. The angular velocity output 1009 is an output from the angular velocity detection unit 208. The lens control unit 210 samples the angular velocity output 1009 during the lens angular velocity detection period 1008.

The synchronization signal communication 1011 is executed in response to the imaging synchronization signal 1010, and the lens control unit 210 calculates the in-lens imaging synchronization signal time corresponding to the imaging synchronization signal 1010. After that, the set value of the lens angular velocity detection period calculated so that the motion vector detection period 1013 and the lens angular velocity detection period 1014 coincide with each other is transmitted to the interchangeable lens 200 by the set value communication 1012 of the lens angular velocity detection period. The lens angular velocity information obtained after the lens angular velocity detection period 1014 is completed is notified to the camera body 100 by the subject angular velocity communication 1015. The panning assist control unit 134 calculates the subject angular velocity information based on the lens angular velocity information at that time and the motion vector information obtained in the motion vector detection period 1013.

Upon receiving the release timing 1019, the system control unit 130 finally stops the exposure currently being performed with the synchronization signal. Further, the system control unit 130 prepares for still image shooting of the shutter 101 and the image sensor 102, and then performs still image shooting start timing communication 1016. At the same time, the shutter 101 is driven to start still image shooting. When the time of the shutter speed instructed by the photographer elapses, the system control unit 130 drives the shutter 101 to stop the exposure. After that, the system control unit 130 executes the panning assist result communication 1017.

Next, with reference to FIG. 11, a method of displaying a captured image in step S408 will be described when the interchangeable lens 200 mounted in the live view shooting mode is compatible with panning assist. FIG. 11 is an example of a photographed image (still image) displayed on the camera body 100, and the photographer has enabled the panning assist of the subject 1101 and displayed the photographed image taken by panning on the image display unit 106. It shows the state.

The system control unit 130 displays the subject position frame 1102 (information indicating the subject position of the still image) based on the subject position stored in the EXIF information. Further, the system control unit 130 displays the panning result 1103 (information indicating the result of the vibration isolation control) indicating the success or failure of the panning assist based on the panning assist result stored in the EXIF information. Here, as the panning shot result 1103, the case where the panning shooting assist result fails (“x mark”) is shown. On the other hand, if the panning assist result is successful, a "○" indicating success is displayed. The panning result 1103 is, for example, information on whether or not the anti-vibration control lens 204 exceeds the range of motion (whether or not the anti-vibration control lens 204 reaches the anti-vibration control end) during still image shooting.

Further, the system control unit 130 displays the subject moving direction 1104 (information regarding the predicted angular velocity of the subject) based on the subject angular velocity V stored in the EXIF information. Further, the system control unit 130 displays the panning direction 1105 (information on the angular velocity during still image shooting) based on the panning amount average value ga stored in the EXIF information. At this time, the subject moving direction 1104 and the panning direction 1105 are displayed so as to have the size of an arrow proportional to the absolute value of the angular velocity. Since the subject position is displayed superimposed on the captured image, the photographer can confirm whether or not the panning assist is applied to the subject intended by the photographer. Further, when the deviation between the subject moving direction 1104 and the panning direction 1105 is large, the photographer can grasp the panning direction and the speed to be corrected.

In this embodiment, a case has been described in which an image taken only for a certain period of time immediately after shooting and a panning assist result are superimposed and displayed on the image display unit 106. However, this embodiment is not limited to this, and can be applied to the case where the captured image is read from the recording unit 108 after shooting.

In this embodiment, the case where the subject moving direction 1104 and the photographer's panning direction 1105 are superimposed and displayed on the captured image has been described, but the photographer corrects the panning direction based on the panning assist amount average value Ga. The direction in which it should be displayed may be displayed. The direction in which the panning direction should be corrected coincides with the direction in which the panning assist amount G becomes 0.

According to this embodiment, if the panning method of the photographer is not appropriate or the camera misidentifies the subject, it is possible to determine whether the panning method of the photographer is not appropriate when the panning image is not taken clearly. In addition, if the panning method of the photographer is not appropriate, it is possible to give feedback to the photographer on how to improve the panning direction.

Next, Example 2 of the present invention will be described. In Example 1, a case where the anti-vibration control lens 204 reaches the outside of the anti-vibration movable range and is suddenly stopped during still image shooting has been described. On the other hand, in this embodiment, when it is expected that the panning assist amount G becomes large enough to reach the outside of the anti-vibration movable range, the panning assist amount is recalculated so as to be small. In this embodiment, the configuration of the camera system, the control flow of the camera body 100, and a part of the control flow of the interchangeable lens 200 are the same as those in the first embodiment, and thus the description thereof will be omitted. In this embodiment, among the control flows of the interchangeable lens 200, a control flow at the time of still image shooting start timing communication different from that of the first embodiment will be described.

The reception process of the still image shooting start timing communication by the interchangeable lens 200 will be described with reference to FIG. FIG. 12 is a flowchart of reception processing of still image shooting start timing communication by the interchangeable lens 200. FIG. 12 shows, in this embodiment, when the interchangeable lens 200 mounted in the live view shooting mode supports panning assist, the interchangeable lens 200 receives the still image shooting start timing communication from the camera body 100. It shows the processing that is sometimes performed. Note that FIG. 12 is different from FIG. 8 in that steps S1203, S1204, and S1209 are added. Since steps S1201, S1202, S1205-S1208, S1210, and S1211 in FIG. 12 are the same as steps S801 to S808 in FIG. 8, their description will be omitted.

In step S1203, the lens control unit 210 confirms (determines) whether or not the second panning assist amount, which is the value obtained by dividing the estimated panning assist amount Gs by the shutter speed Tv, is equal to or greater than a predetermined threshold value. The estimated panning assist amount Gs corresponds to, for example, the panning assist amount G calculated using the above equation (2). If the second panning assist amount is equal to or greater than a predetermined threshold value, the process proceeds to step S1204. On the other hand, if the amount of panning assist for a second is smaller than the predetermined threshold value, the process proceeds to step S1205.

In step S1204, the lens control unit 210 recalculates the subject angular velocity V by using the following equation (3) so that the second panning assist amount is equal to or less than the threshold value Gb.

Gs / Tv = (g-V) / Tv <Gb ... (3)
In step S1207, the lens control unit 210 acquires the panning amount g from the angular velocity detection unit 208, and calculates the panning assist amount G using the equation (2). At this time, when passing through step S1204 (when the subject angular velocity V is recalculated), the recalculated subject angular velocity V is used.

In step S1209, the lens control unit 210 determines whether or not the process has passed through step S1204 (whether or not the subject angular velocity V has been recalculated). When passing through step S1204, the process proceeds to step S1208. On the other hand, if it does not go through step S1204, the process proceeds to step S1210.

According to this embodiment, when the panning assist amount G becomes large enough to reach the outside of the anti-vibration movable range, the subject angular velocity is controlled to be recalculated so as to reduce the panning assist amount, and the photographer is informed. On the other hand, the result of panning shooting can be fed back. Further, when the panning assist control fails, the panning assist control suddenly stops in the first embodiment, but in the present embodiment, the panning assist control works slowly, so that unnatural still image shooting is suppressed.

(Other Examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiment to a system or device via a network or storage medium, and one or more processors in the computer of the system or device reads and executes the program. It can also be realized by the processing to be performed. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

According to the embodiments, panning correction amount when it exceeds the movable range of the image stabilization control lens, shot assist results imaging control apparatus capable of feedback to the user, an imaging apparatus, an imaging system, a control method , Programs, and storage media can be provided.

Although preferable examples of the present invention have been described above, the present invention is not limited to these examples, and various modifications and modifications can be made within the scope of the gist thereof.

130 System control unit (control means)
133 Lens communication control unit (acquisition means)
134 Follow-up assist control unit (calculation means)
141 Motion vector detection unit (motion vector detection means)

Claims (5)

An imaging device with a removable lens device
An image sensor that photoelectrically converts an optical image formed through the lens device,
A motion vector detecting means that detects a motion vector based on an image signal output from the image sensor, and
A calculation means for calculating angular velocity information indicating the angular velocity or angular acceleration of the subject based on the motion vector and the angular velocity detected by the angular velocity detecting means.
An acquisition means for acquiring the result of vibration isolation control executed in the lens device based on the angular velocity information during the still image shooting from the lens device after the still image shooting.
It has a control means for controlling the display means to display information indicating the result of the vibration isolation control together with the still image obtained by the still image shooting.
The information indicating the result of the vibration isolation control includes information indicating the success or failure of the vibration isolation control, and also includes information indicating the success or failure of the vibration isolation control.
At least one of information indicating the subject position in the still image, information on the angular velocity information during the still image shooting, information on the predicted angular velocity of the subject calculated before the still image shooting, and information on the direction for correcting the panning direction. An imaging device characterized by including one. The information indicating the success or failure of the vibration isolation control indicates success when the vibration isolation control lens of the lens device does not exceed the range of motion, and indicates failure when the vibration isolation control lens exceeds the range of motion. The imaging device according to claim 1. This is a control method for an image pickup device to which a lens device can be attached and detached.
A step of detecting a motion vector based on an image signal output from an image sensor that photoelectrically converts an optical image formed through the lens device, and a step of detecting a motion vector.
A step of calculating angular velocity information indicating the angular velocity or angular acceleration of the subject based on the motion vector and the angular velocity detected by the angular velocity detecting means.
A step of acquiring the result of anti-vibration control executed in the lens device based on the angular velocity information during the still image shooting from the lens device after the still image shooting.
It has a step of controlling so as to display information indicating the result of the vibration isolation control on the display means together with the still image obtained by the still image shooting.
The information indicating the result of the vibration isolation control includes information indicating the success or failure of the vibration isolation control, and also includes information indicating the success or failure of the vibration isolation control.
At least one of the information indicating the subject position in the still image, the information regarding the angular velocity information during the still image shooting, the information regarding the predicted angular velocity of the subject calculated before the still image shooting, and the information in the direction for correcting the panning direction. A control method characterized by including one. A program characterized by causing a computer to execute a process according to the control method according to claim 3. A storage medium for storing the program according to claim 4.