WO2023058347A1

WO2023058347A1 - Information processing device, information processing method, and program

Info

Publication number: WO2023058347A1
Application number: PCT/JP2022/031703
Authority: WO
Inventors: 孝平植村
Original assignee: ソニーグループ株式会社
Priority date: 2021-10-07
Filing date: 2022-08-23
Publication date: 2023-04-13

Abstract

The present invention appropriately determines a method for breathing compensation to be performed according to the situation of an imaging device.　An information processing device according to the present technology is provided with a compensation method determination unit that, on the basis of information related to the amount of movement of a focus lens group or scene recognition information, determines whether to perform breathing compensation by either of a first compensation method and a second compensation method, which are methods for the breathing compensation.

Description

Information processing device, information processing method, program

The present technology relates to an information processing device, its method, and a program, and particularly relates to processing technology for breathing correction, which is correction of a change in angle of view that accompanies focusing.

In a camera system configured to enable focusing, it is known that a phenomenon occurs in which the angle of view changes with focusing (so-called breathing).
Patent Literature 1 listed below discloses a technique for correcting breathing. Specifically, in Patent Document 1, in the case where breathing correction by driving the zoom lens group and breathing correction by trimming the captured image are possible, when the focus lens group is driven in the direction of increasing the shooting magnification, zooming is performed. A technology is disclosed in which breathing correction is performed by lens driving, and breathing correction is performed by trimming when the focus lens group is driven in a direction in which the photographing magnification is reduced.

JP 2012-168371 A

However, since correction by zoom lens driving takes longer than correction by trimming, when the correction method is switched according to the direction of change in the photographing magnification as in Patent Document 1, the direction of change in the photographing magnification is In the switching scene, the correction by the zoom lens drive may not catch up with the correction by the trimming, and there is a possibility that the angle of view is changed abruptly and the correction gives a sense of incongruity.
In addition, with the technique of Patent Document 1, correction by trimming is always performed with a probability of 1/2, and there is concern about deterioration in image quality.

This technology has been developed in view of the above circumstances, and aims to appropriately determine the method of breathing correction that should be performed according to the situation of the imaging device.

The information processing apparatus according to the present technology performs breathing correction by either one of the first correction method and the second correction method, which are methods of breathing correction, based on information related to the amount of movement of the focus lens group or scene recognition information. It has a correction method determination unit that determines whether or not to perform the correction.
In this specification, breathing refers to a phenomenon in which the angle of view changes with focusing, and breathing correction refers to correction of such a change in angle of view that accompanies focusing.
According to the above configuration, which one of the first and second correction methods should be used for the breathing correction is determined based on the information regarding the amount of movement of the focus lens or the scene recognition information. If the correction method is determined based on information related to the amount of movement of the focus lens group, for example, if the first and second correction methods are the breathing correction method by driving the zoom lens group and the breathing correction method by trimming the captured image, respectively. In the case of adopting a correction method by driving the zoom lens group, it is possible to estimate the time required for breathing correction from information related to the amount of movement of the focus lens group, and if the time required for correction is long, breathing correction by trimming It is possible to perform the procedure. This makes it possible to perform breathing correction while minimizing the use of trimming that causes image quality deterioration.
Further, if the correction method is determined based on the scene recognition information, for example, when the first and second correction methods are the breathing correction method by driving the zoom lens group and the breathing correction method by trimming the captured image, the quietness In a specific scene, it is possible to perform breathing correction by trimming without performing breathing correction by driving the zoom lens, which produces an operation sound associated with lens movement.

Further, in the information processing method according to the present technology, the information processing apparatus performs the following correction based on the information related to the amount of movement of the focus lens group or the scene recognition information, out of the first correction method and the second correction method, which are techniques for correcting breathing. This is an information processing method for determining which method of breathing correction is to be performed.
Further, a program according to the present technology is a program readable by a computer device, and is based on information relating to the amount of movement of the focus lens group or scene recognition information, and is a method of correcting breathing, namely a first correction method and a second correction method. It is a program that causes the computer device to realize a function of determining which of the correction methods should be used for the breathing correction.
These information processing methods and programs make it possible to realize the information processing apparatus as the present technology described above.

1 is a diagram showing a configuration example of a camera system as an embodiment according to the present technology; FIG. 1 is a block diagram showing an internal configuration example of an interchangeable lens and an imaging device (information processing device) as a first embodiment; FIG. FIG. 3 is an explanatory diagram of terms related to AF control; FIG. 10 is an explanatory diagram of an aspect of a change in angle of view as breathing and an outline of breathing correction; 3 is a functional block diagram showing functions related to focus-related processing as an embodiment of an imaging device as a first embodiment; FIG. FIG. 9 is a diagram showing an example of focus movement trajectory information; FIG. 4 is a diagram showing an example of an angle-of-view table; It is the figure which showed the example of the lens group moving speed table. FIG. 10 is a diagram showing an example of a trimming magnification table; FIG. 5 is an explanatory diagram of an example of a technique for acquiring position coordinates of a plurality of zoom lens groups; FIG. 10 is an explanatory diagram of an example of a method of acquiring a target zoom lens position in the embodiment; 7 is a flow chart showing a specific processing procedure example for implementing focus-related processing as the first embodiment; FIG. 11 is a block diagram showing an internal configuration example of a lens device and an imaging device that configure a camera system as a second embodiment; FIG. 10 is a functional block diagram showing functions according to the second embodiment that the imaging device of the second embodiment has; FIG. 5 is an explanatory diagram of lens positions when breathing correction is performed by a zoom lens correction method; It is the figure which showed the example of the lens group moving speed table in 2nd embodiment. FIG. 9 is a diagram showing an example of a focus group angle-of-view variation rate table; FIG. 10 is a diagram showing an example of a zoom group angle-of-view variation rate table; FIG. 11 is a flow chart showing a specific processing procedure example for realizing control as a second embodiment; FIG. 10 is a flowchart of processing as a first modified example; 10 is a flowchart of processing as a second modified example; 10 is a flowchart of processing as a third modified example; FIG. 11 is a simplified configuration explanatory diagram of a camera system as a fourth modified example;

Hereinafter, embodiments will be described in the following order.
<1. First Embodiment>
(1-1. Equipment configuration example)
(1-2. Focus-related processing as an embodiment)
(1-3. Processing procedure)
<2. Second Embodiment>
<3. Variation>
<4. Summary of Embodiments>
<5. This technology>

<1. First Embodiment>
(1-1. Equipment configuration example)
FIG. 1 is a diagram showing a configuration example of a camera system as an embodiment according to the present technology.
The camera system includes an interchangeable lens 1 and an imaging device (body) 2 that is an embodiment of an information processing device according to the present technology.

The interchangeable lens 1 is a lens unit that can be freely attached to and detached from the imaging device 2 .
Inside the interchangeable lens 1, there are various lenses such as a focus lens and a zoom lens. It has a mount part etc. with a connection function and a communication function. A specific configuration example of the interchangeable lens 1 will be described again with reference to FIG.

The imaging device 2 is configured as a digital camera device in which the interchangeable lens 1 is detachably attached. In this example, the imaging device 2 has not only a still image imaging function but also a moving image imaging function.
The imaging device 2 includes an imaging device 55 that captures a subject image incident through the interchangeable lens 1, a display unit 61 that can display an image captured by the imaging device 55, a GUI (Graphical User Interface) such as various operation screens, etc. An operation unit 65 and the like are provided for the user to perform various operation inputs.
As will be described with reference to FIG. 2 below, the imaging device 2 includes, in addition to the configuration shown in FIG. and a configuration for performing communication with the interchangeable lens 1, and the like.

FIG. 2 is a block diagram showing an internal configuration example of the interchangeable lens 1 and the imaging device 2. As shown in FIG.
The interchangeable lens 1 includes a mount section 11 detachably attached to a mount section 51 of the imaging device 2 . The mount section 11 has a plurality of terminals for electrical connection with the imaging device 2 .
The interchangeable lens 1 also includes a lens-side control section 12 , a zoom lens 13 , an image stabilization lens 14 , an aperture 15 , a focus lens 16 , an operation section 31 , a memory 32 and a power supply control section 33 .
Further, the interchangeable lens 1 includes a zoom lens driving section 21 , a camera shake control section 22 , an aperture control section 23 , a focus lens driving section 24 and a detection section 17 .

The lens-side control unit 12 includes, for example, a microcomputer having a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), and the like. The overall control of the interchangeable lens 1 is performed by reading the program stored in the storage device into the RAM and executing it.
For example, the lens-side control unit 12 adjusts the position of the zoom lens 13 based on an instruction from the imaging device 2 supplied via a predetermined communication terminal of the mount unit 11 or a user's operation received by the operation unit 31. Control. Specifically, the lens-side control unit 12 acquires the current position of the zoom lens 13 from the detection unit 17 having, for example, a magnetic sensor (MR sensor) or the like, and moves the zoom lens 13 to a predetermined position based on the acquired result. , and outputs the determined driving direction and driving amount to the zoom lens driving section 21 together with a movement command. The zoom lens drive unit 21 moves the zoom lens 13 in the optical axis direction based on the movement command supplied from the lens side control unit 12 so as to achieve the instructed drive direction and drive amount.

Here, the detection unit 17 comprehensively represents the configuration for detecting the state of the interchangeable lens 1, such as the positions of the zoom lens 13, the image stabilization lens 14, and the focus lens 16, the aperture diameter of the diaphragm 15, and the like. is. In the detection unit 17, detection of the lens position can be performed by, for example, a magnetic sensor, a photodiode array, a potentiometer, a reflective encoder, or the like.
Further, the detection unit 17 may be configured to include a temperature sensor for detecting temperature.

The lens-side control unit 12 controls the camera shake correction lens 14 so as to correct camera shake. Specifically, the lens-side control unit 12 determines the driving direction and driving amount of the camera shake correction lens 14 in the direction of canceling the camera shake amount based on the camera shake amount detected by the camera shake detection sensor provided in the detection unit 17. , the determined drive direction and drive amount are output to the camera shake control unit 22 together with a movement command. The shake detection sensor in the detection unit 17 is configured by, for example, both or either of a gyro sensor and a triaxial acceleration sensor. The gyro sensor is used to detect a deviation (shake) in the direction corresponding to pitch or yaw as the correction direction of the camera shake correction lens 14. It is used to detect a deviation (blur) in the directions of the X-axis and the Y-axis when they are taken as axes. Based on the movement command supplied from the lens-side control unit 12, the camera shake control unit 22 moves the camera shake correction lens 14 so as to achieve the instructed drive direction and drive amount.
Further, the lens-side control unit 12 performs control to mechanically lock the image stabilization lens 14 when the power supply is turned off. That is, in a state in which power is supplied from the imaging device 2 to the interchangeable lens 1, the camera shake correction lens 14 is kept at a predetermined position by control via the camera shake control unit 22. is turned off, the position control by the camera shake control unit 22 is stopped, and the camera shake correction lens 14 drops by a predetermined amount in the direction of gravity. The lens-side control unit 12 mechanically locks the camera-shake correction lens 14 via the camera-shake control unit 22 in accordance with the timing at which the power supply is turned off to prevent it from falling. The shake control section 22 mechanically locks the shake correction lens 14 based on the fixing command supplied from the lens side control section 12 .

In addition, the lens-side control section 12 controls (the aperture diameter of) the diaphragm 15 in accordance with an instruction or the like from the imaging device 2 supplied via a predetermined communication terminal of the mount section 11 . Specifically, the lens-side control unit 12 acquires the aperture diameter of the diaphragm 15 detected by the diaphragm detection sensor in the detection unit 17, and instructs the diaphragm control unit 23 to obtain the F value instructed by the imaging device 2. A command is issued to drive the diaphragm 15 . The diaphragm controller 23 drives the diaphragm 15 so that the aperture diameter instructed by the lens-side controller 12 is obtained.

Further, the lens-side control section 12 controls the position of the focus lens 16 based on instructions from the imaging device 2 supplied via a predetermined communication terminal of the mount section 11 .
Here, in this example, in the AF (Auto Focus) control, information on the target focus lens position (target focus lens position) is instructed from the imaging device 2 to the lens side control section 12 . The lens-side control unit 12 acquires the current position of the focus lens 16 from the detection unit 17, and moves the focus lens 16 based on the acquired information on the current position and the information on the target focus lens position instructed by the imaging device 2. A driving direction and driving amount for moving to a target position are determined, and the determined driving direction and driving amount are output to the focus lens driving section 24 together with a movement command. The focus lens driving unit 24 moves the focus lens 16 in the optical axis direction so as to achieve the instructed drive direction and drive amount.

Here, the focus lens 16 is configured as a "focus lens group" including one or more optical elements. When the focus lens group includes a plurality of optical elements, those optical elements are displaced together during focusing.
This point also applies to the zoom lens 13 . In other words, the zoom lens 13 is configured as a "zoom lens group" including one or more optical elements. It will be displaced.

In this example, the zoom lens 13 and the focus lens 16 are configured by one zoom lens group and one focus lens group, respectively, but it is also possible to configure each of them to have a plurality of zoom lens groups and focus lens groups. be.

Further, the lens-side control unit 12 captures the position of the zoom lens 13 (hereinafter referred to as "zoom lens position") detected by the detection unit 17 and the position of the focus lens (hereinafter referred to as "focus lens position"). Processing for transmission to the device 2 (body-side control unit 52) is performed.
These zoom lens position and focus lens position are used in AF processing performed on the imaging device 2 side, respectively. In this example, AF processing is performed for each frame of the captured image. Therefore, in the interchangeable lens 1 of this example, the detection unit 17 detects the zoom lens position and the focus lens position for each frame, and the lens-side control unit 12 detects the zoom lens position and the zoom lens position detected for each frame. and information on the focus lens position are sequentially transmitted to the imaging device 2 (body-side control unit 52).

The focus lens drive unit 24 can be configured to have, for example, an ultrasonic motor, a DC motor, a linear actuator, a stepping motor, a piezo element (piezoelectric element), etc., as a lens drive source.

It should be noted that focusing can also be configured to be performed according to the user's operation received by the operation unit 31.

The memory 32 is composed of a non-volatile memory such as an EEPROM (EEP: Electrically Erasable Programmable), and can be used to store an operation program for the lens-side controller 12 and various data.
In this example, the memory 32 stores focus movement locus information J1, an angle of view table J2, a lens group movement speed table J3, and a trimming magnification table J4, which will be described later.

The power supply control unit 33 detects the amount of power supplied from the imaging device 2, and based on the detected amount of power, supplies power to each unit (the lens-side control unit 12 and various driving units) in the interchangeable lens 1. Power is supplied by optimally distributing the amount.

The imaging device 2 on the body side is provided with a mount section 51 to which the interchangeable lens 1 is detachably attached. The mount section 51 has a plurality of terminals for electrical connection with the mount section 11 of the interchangeable lens 1 .
When the interchangeable lens 1 is attached to the mount section 51 of the imaging device 2 , corresponding terminals are electrically and physically connected between the mount section 51 and the mount section 11 of the interchangeable lens 1 . Terminals to be connected include, for example, a terminal for supplying power (power supply terminal), a terminal for transmitting commands and data (communication terminal), and a terminal for transmitting a synchronization signal (synchronization signal terminal). be.

The imaging device 2 further includes a body-side control unit 52, a shutter 53, a shutter control unit 54, an imaging device 55, an ADC (Analog to Digital Converter) 56, a frame memory 57, an image signal processing unit 58, a recording unit 59, a recording medium 60 , a display unit 61 , a memory 62 , a power control unit 63 , a power supply unit 64 and an operation unit 65 .

The power control unit 63 supplies the power supplied from the power supply unit 64 to each unit of the imaging device 2 including the body-side control unit 52 . The power control unit 63 also calculates the amount of power that can be supplied to the interchangeable lens 1 based on the operating state of the imaging device 2 and supplies power to the interchangeable lens 1 via the mount unit 51 .
The power supply unit 64 includes, for example, a secondary battery such as a NiCd battery, a NiMH battery, or a Li battery. The power supply unit 64 may be configured to be able to receive power supply from a commercial AC power supply via an AC adapter or the like.

The body-side control unit 52 includes a microcomputer having a CPU, a ROM, a RAM, etc. The CPU reads a program stored in a predetermined storage device such as the ROM or the memory 62 into the RAM and executes the program. It performs overall control of the imaging device 2 and the camera system.
The memory 62 is composed of a non-volatile memory such as an EEPROM, and can be used to store an operation program for the body-side control section 52 and various data.

The body-side control unit 52 causes the imaging device 55 to perform imaging processing based on the operation signal representing the user's operation supplied from the operation unit 65 . Furthermore, a predetermined command is transmitted to the interchangeable lens 1 side via the mount section 51 to drive the focus lens 16, the zoom lens 13, and the like.

Also, the body-side control unit 52 can acquire information indicating the lens position of the focus lens 16, information indicating the lens position of the zoom lens 13, and the like from the detection unit 17 in the interchangeable lens 1, for example.

The shutter 53 is arranged in front of the imaging device 55 (subject side) and opens and closes under the control of the shutter control section 54 . When the shutter 53 is in the closed state, the light from the subject that has passed through the optical system of the interchangeable lens 1 is blocked. The shutter control unit 54 detects the open/closed state of the shutter 53 and supplies information indicating the detection result to the body side control unit 52 . The shutter controller 54 drives the shutter 53 to open or close based on the control of the body-side controller 52 .

The imaging element 55 is configured as an image sensor such as a CCD (Charge Coupled Device) sensor, a CMOS (Complementary Metal Oxide Semiconductor) sensor, or the like, and images an object to generate and output captured image data.
If the imaging device 55 is composed of a CCD sensor or a CMOS sensor, an electronic shutter can be used, so the shutter 53 can be omitted. When the shutter 53 is omitted, the shutter control section 54 used for its control is also omitted.

In this example, the image pickup element 55 includes pixels for image pickup (RGB pixels) and pixels for acquiring detection information used in AF (Auto Focus) processing by the image plane phase difference method, that is, the position between the pair of images. and phase difference detection pixels for acquiring phase difference information (phase difference information between a pair of images formed by pupil division).
In the image pickup device 55, the phase difference detection pixels are discretely arranged on a pixel arrangement plane where RGB pixels are two-dimensionally arranged according to a predetermined arrangement pattern such as a Bayer arrangement.

Light receiving signals obtained by photoelectric conversion of RGB pixels in the image sensor 55 are converted into digital signals by the ADC 56 , temporarily stored in the frame memory 57 , and then input to the image signal processing section 58 .
In FIG. 2, the captured image signal obtained by digitally converting the received light signals of the RGB pixels as described above is denoted as "captured image signal Si".

On the other hand, in the imaging element 55 , the received light signal obtained by photoelectric conversion of the phase difference detection pixel is converted into a digital signal by the ADC 56 and supplied to the body side control section 52 .
In FIG. 2, the signal obtained by digitally converting the light receiving signal of the phase difference detection pixel is denoted as "phase difference pixel signal Sp".

The body-side control unit 52 analyzes the phase difference between the pair of images based on the phase difference pixel signal Sp supplied via the ADC 56, and adjusts the focus of the subject to be focused (focusing target). A shift amount, that is, a defocus amount DF is calculated.
The body-side control unit 52 performs AF control based on the defocus amount DF thus calculated, which will be described later.

Also, the body-side control unit 52 performs processing related to breathing correction.
Breathing here means a phenomenon in which the angle of view changes with focusing, and breathing correction means correction of such a change in angle of view that accompanies focusing.
In this example, the breathing correction is performed by driving the zoom lens 13 or trimming (electronically cutting out) the captured image. Specifically, in the camera system of this example, the breathing correction can be performed by switching between correction by driving the zoom lens 13 and correction by trimming the captured image.
Here, as a breathing correction method, a correction method by driving the zoom lens 13 is hereinafter referred to as a "zoom lens correction method", and a correction method by trimming a captured image is described as a "trimming correction method".
The details of the breathing correction processing performed by the body-side control unit 52 will be described later.

The image signal processing unit 58 performs predetermined image signal processing on the captured image input via the frame memory 57 . Examples of the image signal processing here include demosaic processing, white balance (WB) adjustment, gamma correction processing, and the like.
The image signal processing unit 58 performs image signal processing on the captured image as a RAW image input via the frame memory 57, converts it into image data in a predetermined file format, and transfers the data to a recording medium via the recording unit 59. Let 60 record.
The image signal processing unit 58 also converts the captured image after the image signal processing into an image signal in accordance with a predetermined display format, supplies the image signal to the display unit 61, and displays the captured image.

In addition, the image signal processing unit 58 in this embodiment in particular is capable of trimming the captured image. The image signal processing unit 58 performs trimming processing on the captured image based on the instruction from the body side control unit 52 .

The recording medium 60 is composed of a non-volatile memory, and the recording unit 59 is configured to be able to write data to the recording medium 60 and read data recorded on the recording medium 60 . Here, the recording medium 60 may be detachable from the imaging device 2 .

The display unit 61 is composed of a panel-type display device such as a liquid crystal panel or an organic EL panel, and is capable of displaying images.
The display unit 61 is mounted on the rear surface of the imaging device 2 opposite to the front surface where the mount unit 51 is arranged, and displays a so-called through image, an image read from the recording medium 60, various operation screens, and the like. It is possible to display the GUI as

The operation unit 65 includes various hardware keys such as a shutter button, a mode dial, and a zoom button, a touch panel provided to detect touch operations on the display screen of the display unit 61, and the like. It comprehensively represents the operators to perform.
The operation unit 65 receives a user's operation and supplies an operation signal corresponding to the operation to the body-side control unit 52 .

Here, in the following description, AF control will be described. Use "Lens position" and "Zoom lens position".
Definitions of these terms will be explained with reference to FIG.
First, the "subject position" literally represents the position where the subject exists, and the "subject distance" represents the distance from the imaging device 2 to the subject.
"Focus position" represents a position where focus is achieved, and can be rephrased as "focus position". "Focus distance" means the distance from the imaging device 2 to the focus position.
Here, as will be understood with reference to FIG. 3, the object distance and the focusing distance are distances to positions on the outside of the interchangeable lens 1, for example, 2 m, 3 m, 4 m, . It is a value represented by an actual distance such as

"Focus lens position" means the position of the focus lens 16 within the movable range of the focus lens 16 in the interchangeable lens 1 as illustrated in the drawing. 1 means the position of the zoom lens 13 within the movable range of the zoom lens 13 .

Here, if the "object position" in FIG. It represents. That is, the defocus amount DF in this case does not directly represent the error amount of the focus lens position.

As a basic flow of AF control premised in this example, the body side control unit 52 adjusts the focus lens 16 necessary for focusing on the focus target based on the defocus amount DF. A target position (hereinafter referred to as “target focus lens position”) is obtained, and information on the target focus lens position is instructed to the interchangeable lens 1 side.

In addition, with reference to FIG. 4, an aspect of the angle of view change as breathing and an overview of breathing correction will be described.
In FIG. 4, what is shown as "before correction" in the upper part is an example of change in angle of view with respect to change in focus position from infinity to the closest object. As shown in the figure, the size of the image in the captured image (the letter A in the example in the figure) is the largest at infinity, the size of the image is the smallest at the closest distance, and the focus is intermediate between infinity and the closest distance. At position the image size is smaller than at infinity and larger than at closest. As can be understood from this point, the change in the angle of view as breathing occurs when the angle of view is the narrowest at infinity, and the angle of view gradually widens as the focus position changes toward the closest point. .

For this reason, breathing correction is performed so that the angle of view gradually narrows from the infinity side to the closest distance side, and conversely, from the closest side to the infinity side, as indicated by "after correction" in the lower part of the figure. is performed so that the angle of view gradually widens.
Breathing correction by trimming is performed by setting the trimming magnification at infinity to "1.0" (that is, no trimming) and gradually increasing the trimming magnification in response to changes in the focus position toward the closest distance. will be
By performing breathing correction, it is possible to prevent the angle of view of the captured image from changing even if the focus position changes (that is, even if focusing is performed).

(1-2. Focus-related processing as an embodiment)
FIG. 5 is a functional block diagram showing functions related to focus-related processing as an embodiment of the body-side control unit 52 of the imaging device 2 as the first embodiment.
As illustrated, the body-side control section 52 has functions as an information acquisition processing section F1, an AF processing section F2, a first correction control section F3, a second correction control section F4, and a correction method determination section F5.

The information acquisition processing unit F1 performs acquisition processing of lens characteristic information used for breathing correction. Specifically, the information acquisition processing unit F1 in this example uses the focus movement locus information J1, the angle of view table J2, the lens group movement speed table J3, and the trimming magnification table J4 stored in the interchangeable lens 1 as the lens characteristic information. A process of acquiring from the interchangeable lens 1 is performed.
The information acquisition processing unit F1 requests the lens control unit 12 to transmit the lens characteristic information, and acquires the lens characteristic information transmitted from the lens control unit 12 to the imaging device 2 in response to the request.

FIG. 6 is a diagram showing an example of the focus movement trajectory information J1.
The focus movement locus information J1 is information indicating the relationship between the zoom lens position, the focus lens position, and the focus position. Specifically, the focus movement locus information J1 in this example is information indicating the focus lens position for each combination of the zoom lens position and the focus position, as shown in the drawing.
In the focus movement trajectory information J1, the zoom lens position indicated on the vertical axis ranges from the zoom lens position at one end of the movable range of the zoom lens shown in FIG. The focus position on the horizontal axis represents each focus position from the focus position corresponding to infinity to the focus position corresponding to the closest distance.
Here, in the focus movement trajectory information J1, the zoom lens position and the step size of the focus position are arbitrary.

By giving the information on the zoom lens position and the focus position from such focus movement locus information J1, it is possible to acquire the information on the focus lens position corresponding to the combination of the zoom lens position and the focus position. Further, by giving information on the zoom lens position and the focus lens position, information on the focus position corresponding to the combination of the zoom lens position and the focus lens position can also be obtained.

Since the characteristics of the focus movement trajectory information J1 as described above may differ depending on the type and individual of the interchangeable lens 1, in this example, the focus movement trajectory information J1 corresponding to the characteristics of each interchangeable lens 1 is stored in a memory. 32 is stored.

FIG. 7 is a diagram showing an example of the angle-of-view table J2.
The angle-of-view table J2 is information indicating the focal length (angle of view) for each combination of the zoom lens position and the focus position. Also in this case, the range of the zoom lens position, the focus position, and the increments of these positions are the same as in the case of the focus movement trajectory information J1.
The field angle table J2 shows the change characteristics of the field angle for each zoom lens position when the focus position is changed from infinity to the closest distance.
In this example, the angle-of-view table J2 is used to determine the amount of movement of the zoom lens 13 required when performing breathing correction by the zoom lens correction method, but this point will be explained later.

FIG. 8 is a diagram showing an example of the lens group moving speed table J3.
The lens group moving speed table J3 is information about the zoom group moving speed (mm/sec), which is the amount of movement of the zoom lens 13 (actuator in the zoom lens drive unit 21) when the zoom lens 13 is driven by a predetermined drive signal value. and is information indicating the change characteristics of the zoom group moving speed with respect to a predetermined speed change factor. Specifically, in this example, the lens group moving speed table J3 is information indicating the change characteristics of the lens group moving speed with respect to temperature.
With such a lens group moving speed table J3, the zoom group moving speed can be obtained with high accuracy with respect to speed change factors such as temperature.
In this example, the lens group moving speed table J3 is used when calculating the correction time (which can be rephrased as the movement time of the zoom lens 13 required for correction: a correction time Tla to be described later) when performing breathing correction by the zoom lens correction method. Used.

Regarding the lens group moving speed table J3, it is possible to apply other factors such as the amount of electric power supplied from the imaging device 2 to the interchangeable lens 1 in addition to the temperature as speed change factors.

FIG. 9 is a diagram showing an example of the trimming magnification table J4.
As shown, the trimming magnification table J4 is information indicating the trimming magnification for breathing correction for each combination of zoom lens position and focus position. Also in this case, the range of the zoom lens position, the focus position, and the step size of these positions are the same as in the case of the focus movement locus information J1.
Such a trimming magnification table J4 indicates, for each zoom lens position, the trimming magnification change characteristic for canceling out the change in the angle of view that accompanies the change in the focus position.
In AF, if a target focus position for focusing on an in-focus object is obtained based on the defocus amount DF, information on the target focus position and information on the current zoom lens position are used. In addition, information on the trimming magnification required for correction can be acquired based on the trimming magnification table J4.

7 to 9, the angle-of-view table J2, the lens group movement speed table J3, and the trimming magnification table J4 also use the type of the interchangeable lens 1, as with the focus movement locus information J1 shown in FIG. Therefore, in this example, the field angle table J2, the lens group moving speed table J3, and the trimming magnification table J4 are also set according to the characteristics of each interchangeable lens 1. The information obtained is stored in the memory 32 .

Incidentally, as described above, the zoom lens 13 and the focus lens 16 can be configured with a plurality of zoom lens groups and a plurality of focus lens groups, respectively. That is, there is a configuration in which zoom adjustment is performed by displacing a plurality of zoom lens groups, and a configuration in which focusing is performed by displacing a plurality of focus lens groups.
When a configuration is adopted in which zoom adjustment is performed by displacing a plurality of zoom lens groups, the "zoom lens position" is information on a combination of the positions of the zoom lens groups.
Similarly, when a configuration is adopted in which focusing is performed by displacing a plurality of focus lens groups, the information on the "focus lens position" is information on a combination of the positions of the focus lens groups.

In order to grasp the correspondence relationship between the "zoom lens position" which is the combination information of the positions of the plurality of zoom lens groups as described above and the position of each zoom lens group, for example, information as shown in FIG. It should be used.
Specifically, table information as shown in FIG. 10A and function information as shown in FIG. 10B may be used.
Here, an example in which the zoom lens 13 is composed of two lens groups, a first zoom lens group and a second zoom lens group, is shown. A table storing combination information of the positional coordinates of the zoom lens group and the positional coordinates of the second zoom lens group is used.
Further, as the function information in FIG. 10B, a function indicating the correspondence relationship between the positional coordinates of the first zoom lens group and the positional coordinates of the second zoom lens group, such as function Fz in the drawing (for example, "Y= ax̂5+bx̂4+cx̂3+dx̂2+ex+f'("̂" means exponentiation). In this case, the "zoom lens position" can be substituted for either the position of the first zoom lens group or the position of the second zoom lens group. It is still a combination of the position of the lens group and the position of the second zoom lens group.

　The table and function information illustrated in FIG.

When the focus lens 16 is composed of a plurality of focus lens groups, similar tables and functions are stored in the interchangeable lens 1, and the imaging device 2 acquires them as necessary. do it.

Returning to FIG.
The AF processing unit F2 performs AF-related processing, specifically, processing for obtaining the defocus amount DF described above, and obtains a target focus lens position for focusing on an in-focus object based on the defocus amount DF. Perform processing for

To obtain the target focus lens position from the defocus amount DF, information on the zoom lens position and focus lens position sequentially transmitted from the interchangeable lens 1 side, and focus movement locus information J1 are used.
Specifically, the AF processing unit F2 adjusts the focus object based on the current (current frame) zoom lens position and focus lens position information transmitted from the interchangeable lens 1 side, and the focus movement locus information J1. A focus position for focusing (hereinafter referred to as "target focus position") is obtained. That is, first, the current focus position is obtained based on the current zoom lens position and focus lens position information and the focus movement locus information J1. Then, a target focus position is calculated based on the current focus position and the defocus amount DF.
Next, the AF processing unit F2 acquires the target focus lens position based on the information on the target focus position, the current zoom lens position, and the focus movement trajectory information J1.

The AF processing unit F2 instructs the lens-side control unit 12 with the information on the target focus lens position acquired as described above. Thereby, in the interchangeable lens 1, the focus lens 16 is driven so that the focus lens position matches the target focus lens position, and AF is realized.

Here, as the focus movement trajectory information J1, it is not realistic in terms of data capacity to cover all zoom lens positions, focus positions, and focus lens positions. There may be cases where the combination of positions does not exist in the focus movement trajectory information J1. In that case, interpolation processing such as linear interpolation is performed to obtain the focus position corresponding to the combination of the current focus lens position and zoom lens position.

In the above example, the processing for obtaining the target focus lens position from the defocus amount DF is performed on the imaging device 2 side, but the processing for obtaining the target focus lens position from the defocus amount DF can also be performed on the interchangeable lens 1 side. is. In that case, the body-side control unit 52 transmits information on the defocus amount DF to the lens-side control unit 12, and the lens-side control unit 12 controls the target focus lens based on the focus movement locus information J1 stored in the memory 32. The position should be acquired.

The first correction control unit F3 and the second correction control unit F4 perform control for realizing correction of breathing correction by different correction methods. Specifically, in this example, the first correction control unit F3 performs control for realizing breathing correction by the zoom lens correction method, and the second correction control unit F4 performs control for realizing breathing correction by the trimming correction method. control.

In this example, the first correction control unit F3 instructs the lens-side control unit 12 about the information of the target zoom lens position for realizing the correction by the zoom lens correction method, which is obtained by the processing of the correction method determination unit F5, which will be described later. By doing so, the breathing correction by the zoom lens correction method is executed on the interchangeable lens 1 side.
Further, the second correction control unit F4 in this example outputs information on the trimming magnification acquired based on the trimming magnification table J4 as will be described later, that is, information on the trimming magnification for realizing the breathing correction by the trimming correction method. By instructing the signal processing unit 58, the image signal processing unit 58 is caused to execute trimming processing for correcting bleeding.

A correction method determination unit F5 determines which of the breathing correction method, the first correction method and the second correction method, should be used for the breathing correction based on the information related to the amount of movement of the focus lens group. . That is, in this example, the correction method to be executed is determined for the zoom lens correction method and the trimming correction method.

The determination of the correction method here is based on information relating to the amount of movement of the focus lens group, the correction time Tla in the case where the zoom lens correction method is adopted, and whether or not the correction time Tla is equal to or less than a predetermined threshold value Tth. as a judgment of

As a basic processing flow, first, when the zoom lens correction method is adopted for the change of the focus position due to focusing, the angle of view is determined to which position the zoom lens 13 should be moved for correcting breathing. It is specified using Table J2. In other words, the target position of the zoom lens position for breathing correction when the zoom lens correction method is adopted is specified.
Hereinafter, this target position will be referred to as "target zoom lens position".

A specific method will be described with reference to FIG.
Although FIG. 11 shows an example in which information on the angle of view is stored in the angle-of-view table J2, information on the focal length can also be stored.
For example, as indicated by (1) in the figure, the current zoom lens position (Zm[1] in the figure) accompanies the change in focus position (change from Fc[2] to Fc[1] in the figure). , the angle of view is changed from 17.0 (mm) to 16.8 (mm).
In this case, in order to realize the breathing correction, the original angle of view (before changing the focus position)=17 at the changed focus position (Fc[1]), as indicated by (2) in the figure. It can be seen that the zoom lens position should be changed from Zm[1] to Zm[2] so that .0 is kept. That is, the target zoom lens position in this case can be identified as Zm[2].

Thus, the target zoom lens position can be obtained by referring to the angle-of-view table J2 based on information on the current zoom lens position and the focus position after the change due to focusing. Specifically, a zoom lens position that can maintain the angle of view before the change at the changed focus position is acquired as the target zoom lens position.

Based on the acquired target zoom lens position, the correction method determination unit F5 calculates a correction time Tla, which is the time required for correction when performing breathing correction by the zoom lens correction method. Specifically, the amount of movement of the zoom lens 13 required for correction from the target zoom lens position and the current zoom lens position is calculated as the "correction zoom lens movement amount", and the correction zoom lens movement amount is The correction time Tla is calculated based on the zoom lens group moving speed information obtained based on the lens group moving speed table J3 shown in FIG.
In this example, since the lens group moving speed table J3 is information defining the zoom lens group moving speed with respect to temperature, the correction method determination unit F5 acquires temperature information of the interchangeable lens 1 detected by the detection unit 17. , information on the zoom lens group moving speed corresponding to the temperature is acquired based on the lens group moving speed table J3.
Then, the correction time Tla is calculated based on the obtained zoom lens group moving speed and the correction zoom lens moving amount. Specifically, the correction time Tla is calculated by dividing the correction zoom lens movement amount by the zoom lens group movement speed.

The correction method determination unit F5 determines whether the correction time Tla thus calculated is equal to or less than a predetermined threshold value Tth, and if the correction time Tla is equal to or less than the threshold value Tth, breathing correction is performed by the zoom lens correction method. When the correction time Tla is not equal to or less than the threshold Tth, the breathing correction is performed by the trimming correction method.

Here, when performing the breathing correction by the zoom lens correction method, the above-described first correction control unit F3 instructs the lens side control unit 12 of the target zoom lens position, so that the zoom lens correction method is applied to the interchangeable lens 1 side. Breathing correction is performed by

When performing breathing correction using a trimming correction method, the second correction control unit F4 instructs the image signal processing unit 58 to use the trimming magnification acquired based on the trimming magnification table J4. Execute trimming processing for correction.
Here, as can be seen with reference to FIG. 9, according to the trimming magnification table J4, if information on the focus position after changing by focusing is obtained, trimming for correction is performed based on the information on the current zoom lens position. Magnification can be obtained.

As for the trimming magnification table J4, it is not realistic in terms of data capacity to include information covering all combinations of zoom lens positions and focus positions. It may not exist in the magnification table J4. In that case, interpolation processing such as linear interpolation is performed to obtain the trimming magnification corresponding to the combination of the current zoom lens position and focus position.

(1-3. Processing procedure)
Next, a specific processing procedure example for realizing the focus-related processing as the first embodiment described above will be described with reference to the flowchart of FIG. 12 .
In this example, the processing shown in FIG. 12 is executed by the body-side control unit 52 as software processing based on the program stored in the aforementioned ROM or the like.
Also, here, a processing example will be described on the premise that focusing is performed by AF.

First, in step S101, the body-side control unit 52 waits for the start of moving image capturing. That is, a process of waiting for the moving image capturing operation to start is performed based on the user's operation input or the like.

When it is determined that moving image capturing has started, the body-side control unit 52 performs processing for acquiring the current zoom lens position and focus lens position in step S102. That is, the zoom lens position and the focus lens position sequentially transmitted from the lens side control unit 12 for each frame are acquired.

In step S103 following step S102, the body-side control unit 52 acquires the current focus position based on the focus movement trajectory information J1. That is, the current focus position is acquired based on the information on the current zoom lens position and focus lens position acquired in step S102 and the focus movement locus information J1.

In step S104 following step S103, the body-side control unit 52 acquires the defocus amount DF by AF. That is, the defocus amount DF is acquired based on the phase difference pixel signal Sp, as described as the processing of the AF processing unit F2.

In step S105 following step S104, the body-side control unit 52 calculates the target focus position based on the current focus position and the defocus amount DF.
Then, in step S106 following step S105, the body-side control unit 52 determines the zoom lens position for breathing correction, that is, the aforementioned target zoom lens position, based on the target focus position, the current zoom lens position, and the angle-of-view table J2. to get
In this case, the method of obtaining the target zoom lens position based on the angle-of-view table J2 should be the above-mentioned "focus position after change" as the target focus position, and other parts have already been explained. Avoid duplicate explanations.

In step S107 following step S106, the body-side control unit 52 calculates the zoom lens movement amount for breathing correction, that is, the correction zoom lens movement amount described above, based on the target zoom lens position and the current zoom lens position. do.
Next, in step S108, the body-side control unit 52 calculates the correction time Tla by the zoom lens based on the correction zoom lens movement amount and the lens group movement speed table J3.
Note that the method of calculating the correction time Tla has already been explained, so redundant explanation will be avoided.

In step S109 following step S108, the body-side control unit 52 determines whether or not the correction time Tla is equal to or less than the threshold value Tth.
If the correction time Tla is equal to or less than the threshold value Tth, the body-side control unit 52 proceeds to step S110 and performs zoom lens movement control to the target zoom lens position. That is, the target zoom lens position acquired in step S106 is instructed to the lens side control unit 12 to execute breathing correction by the zoom lens correction method.

On the other hand, if the correction time Tla is not equal to or less than the threshold value Tth, the body-side control unit 52 proceeds to step S111 and acquires the trimming magnification for breathing correction based on the trimming magnification table J4. Specifically, the trimming magnification for breathing correction is acquired based on the current zoom lens position acquired in step S102, the target focus position information acquired in step S105, and the trimming magnification table J4.
Then, in subsequent step S112, the body-side control section 52 instructs the image signal processing section 58 on the acquired trimming magnification. Thereby, breathing correction is realized by the trimming correction method.

The body-side control unit 52 advances the process to step S113 when the process of step S110 is executed and when the process of step S112 is executed.
In step S113, the body-side control unit 52 performs frame imaging standby processing. That is, it waits for the completion of the imaging operation for one frame.

In step S114 following step S113, the body-side control unit 52 waits whether or not the moving image capturing is finished. That is, it is a process of waiting for the end of the moving image capturing operation.

If it is determined that the moving image capturing has not ended, the body-side control unit 52 returns to step S102.
As a result, during moving image pickup, the processing from steps S102 to S113 is repeatedly executed in frame cycles as processing for breathing correction for focusing by AF.

On the other hand, when it is determined that the moving image capturing has ended, the body-side control unit 52 ends the series of processes shown in FIG. 12 .

Here, in the processing example assuming breathing correction for focusing by AF as described with reference to FIG. The information of the "current focus position" acquired based on the current focus position and the information of the "target focus position" obtained based on the current focus position and the defocus amount DF by AF correspond to this.

Further, the processing for switching the correction method described above can also be preferably applied when focusing is performed by manual operation instead of focusing by AF. In the case of supporting focusing by manual operation, the focus position after change by manual operation may be applied as the "changed focus position" in acquiring the target zoom lens position based on the angle-of-view table J2.
It should be noted that, in the case of handling focusing by manual operation, the "information on the amount of movement of the focus lens" corresponds to information on the amount of movement of the focus lens detected for displacement of the focus lens by manual operation.

Here, in the above description, for example, "acquire the current zoom lens position and focus lens position" (S102) or "acquire the current focus position based on the focus movement locus information J1" (S103). In this specification, the term “acquisition” of information refers to storing the target information in a predetermined storage device (for example, RAM, register, etc.) in a state that can be processed by the processor. Synonymous.

<2. Second Embodiment>
Next, a second embodiment will be described.
The second embodiment relates to processing to be executed during breathing correction by the zoom lens correction method.
In the following description, the same reference numerals will be given to the same parts as those already explained, and the explanation will be omitted.

FIG. 13 is a block diagram showing an internal configuration example of an interchangeable lens 1A and an imaging device 2A that configure a camera system according to the second embodiment.
Compared to the interchangeable lens 1 (see FIG. 2), the interchangeable lens 1A stores a lens group moving speed table J3A instead of the lens group moving speed table J3 in the memory 32, and further stores a focus group angle of view variation rate table J5. and the zoom group field angle variation rate table J6.
The lens group moving speed table J3A, the focus group angle of view variation rate table J5, and the zoom group angle of view variation rate table J6 will be described again.

The imaging device 2A differs from the imaging device 2 in that a body-side control section 52A is provided instead of the body-side control section 52. As shown in FIG. 14, the body-side control section 52A differs from the body-side control section 52 in functions.

FIG. 14 is a functional block diagram showing the functions of the body-side control section 52A according to the second embodiment.
Compared with the body-side control unit 52 (see FIG. 5), the body-side control unit 52A has an information acquisition processing unit F1A instead of the information acquisition processing unit F1, and a first correction control unit F3 instead of the first correction control unit F3. It differs in that it has a correction control section F3A.

The information acquisition processing unit F1A acquires focus movement trajectory information J1, an angle of view table J2, a lens group movement speed table J3A, a trimming magnification table J4, a focus group angle of view fluctuation rate table J5, and a zoom group angle of view fluctuation from the interchangeable lens 1A. A process of acquiring the rate table J6 is performed.

Compared with the first correction control unit F3, the first correction control unit F3A performs the zoom lens movement control processing in step S110 performed during breathing correction by the zoom lens correction method, which is the processing described in the first embodiment. are different in that they perform different processing.

Here, FIG. 15 shows the target zoom lens position, the position of the zoom lens 13 before moving to the target zoom lens position, the target focus lens position by AF, and the target when breathing correction is performed by the zoom lens correction method. It schematically shows the positional relationship of the focus lens 16 before it is moved to the focus lens position.
When correcting breathing caused by AF focusing, the focus lens 16 moves from the current focus lens position toward the target focus lens position, and the zoom lens 13 moves toward the target zoom lens position.
At this time, if there is a difference in moving speed between the zoom lens 13 and the focus lens 16, the change in angle of view due to breathing cannot be sufficiently corrected, and the user may perceive the change in angle of view. .

The first correction control unit F3A performs the following processing in order to suppress the change in angle of view caused by the difference in moving speed between the focus lens 16 and the zoom lens 13.

Here, in the present embodiment, it is assumed that the driving of the zoom lens 13 and the focus lens 16 is performed in a cycle with a minute time δt as a unit period.
Further, in the following description, as an example, on the premise that the zoom lens 13 is driven with the drive signal value of the zoom lens 13 set to a fixed value such as a maximum value, the moving speed (speed Vf described later) of the focus lens 16 is changed. Let me give you an example.

The first correction control unit F3A performs a process of displacing the zoom lens position and the focus lens position to their respective target positions while adjusting the focus group moving speed Vf so as to satisfy the condition of [Equation 1] below.

|Vz×Az−Vf×Af|≦Gth [Formula 1]

Here, in [Equation 1], Vz means the zoom group movement speed (see FIG. 8), and Vf means the focus group movement speed, which is the movement speed of the focus lens 16 . Az means the rate of change in angle of view (%/mm) per unit drive of the zoom lens 13 when the zoom group moving speed Vz is a predetermined reference speed (hereinafter referred to as "zoom group angle of view change rate Az ”). The "unit drive" referred to here means lens drive for one cycle by the minute time .delta.t described above.
Af means the rate of change in angle of view per unit drive of the focus lens 16 when the focus group moving speed Vf is a predetermined reference speed (hereinafter referred to as "focus group angle of view change rate Af").
That is, if the moving speed of the zoom lens 13 as the zoom group moving speed Vz is fast (if the value is large), the angle of view variation rate due to the zoom lens movement calculated by "Vz×Az" in [Equation 1] is Similarly, if the movement speed of the focus lens 16 as the focus group movement speed Vf is fast (if the value is large), the angle of view due to the movement of the focus lens calculated by "Vf×Af" in [Equation 1] The volatility also increases.

The first correction control unit F3A calculates the rate of change in angle of view “Vz×Az” due to the movement of the zoom lens and the change in angle of view due to the movement of the focus lens each time one cycle of driving is performed with a minute time δt. A rate “Vf×Af” is obtained, and whether the absolute value of their difference (|Vz×Az−Vf×Af|) is equal to or less than the threshold Gth that defines the rate of view angle variation permissible within a unit time as one cycle. determine whether or not

If |Vz×Az−Vf×Af| is equal to or less than the threshold value Gth, the first correction control unit F3A drives the zoom lens 13 and the focus lens 16 for one cycle, and the zoom lens 13 is driven at the zoom group moving speed Vz and the focus lens 16 is driven at a speed indicated by the focus group moving speed Vf.

On the other hand, when |Vz×Az−Vf×Af| is not equal to or less than the threshold value Gth, the first correction control unit F3A obtains the focus group moving speed Vf that satisfies the condition of [Formula 1], and obtains the focus group moving speed Vf. , the focus lens 16 and the zoom lens 13 are driven for one cycle by the zoom group moving speed Vz.

Here, the focus group moving speed Vf can be acquired based on the lens group moving speed table J3A illustrated in FIG. In the lens group moving speed table J3A, information indicating change characteristics of the focus group moving speed Vf with respect to a predetermined speed change factor (in this case, temperature is also used as an example) is added to the lens group moving speed table J3 described above. It becomes what was done.
With such a lens group moving speed table J3A, the zoom group moving speed Vz and the focus group moving speed Vf can be obtained with high accuracy with respect to speed change factors such as temperature.

Also, the focus group angle of view variation rate Af is acquired based on the focus group angle of view variation rate table J5 illustrated in FIG.
As illustrated, the focus group field angle variation rate table J5 is information indicating the focus group field angle variation rate Af for each combination of the zoom lens position and the focus lens position.
When the first correction control unit F3A makes a determination using [Equation 1], based on information on the current zoom lens position and focus lens position, the first correction control unit F3A responds based on the information content of the focus group angle of view fluctuation rate table J5. Information on the focus group angle-of-view variation rate Af is acquired.

Further, when performing the determination using [Formula 1], the first correction control unit F3A acquires the zoom group angle of view variation rate Az based on the zoom group angle of view variation rate table J6 illustrated in FIG.
As illustrated, the zoom group view angle variation rate table J6 is information indicating the zoom group view angle variation rate Az for each zoom lens position.
Based on the information on the current zoom lens position, the first correction control unit F3A acquires information on the corresponding zoom group angle of view variation rate Az based on the information content of the zoom group angle of view variation rate table J6.

FIG. 19 is a flow chart showing a specific processing procedure example for realizing the control as the second embodiment described above.
In the second embodiment, the body-side control section 52A executes the process shown in FIG. 19 as the process of step S110 shown in FIG.

In the process of step S110 in this case, the body-side control unit 52A first performs the process of acquiring the zoom group moving speed Vz and the focus group moving speed Vf in step S201. That is, based on the lens group moving speed table J3A illustrated in FIG. 16 and the temperature information of the interchangeable lens 1A detected by the detection unit 17, the zoom group moving speed Vz and the focus group moving speed Vf are obtained.

In step S202 following step S201, the body-side control unit 52A acquires the zoom group angle-of-view variation rate Az and the focus group angle-of-view variation rate Af corresponding to the driving of the current one cycle. That is, based on information on the zoom lens position and the focus lens position detected for the current period of one cycle, the zoom group angle of view variation rate table J6, and the focus group angle of view variation rate table J5, the current 1 A zoom group angle of view variation rate Az and a focus group angle of view variation rate Af corresponding to the periodic driving are acquired.
Specifically, based on the information on the zoom lens position, the corresponding zoom group view angle variation rate Az is acquired based on the zoom group view angle variation rate table J6, and based on the information on the zoom lens position and the focus lens position. Then, the corresponding focus group angle of view variation rate Af is obtained based on the focus group angle of view variation rate table J5.

In step S203 following step S202, the body-side control unit 52A determines whether or not |Vz×Az−Vf×Af| is equal to or less than the threshold value Gth.
If |Vz×Az−Vf×Af| is equal to or less than the threshold value Gth, the body-side control unit 52A proceeds to step S205, and moves the zoom lens 13 and the focus lens 16 at the zoom group moving speed Vz and the focus group moving speed Vf. Drive for one cycle is executed. That is, the zoom lens 13 is driven at the speed indicated by the zoom group moving speed Vz, and the focus lens 16 is driven at the speed indicated by the focus group moving speed Vf.

On the other hand, if |Vz×Az−Vf×Af| is not equal to or less than the threshold value Gth, the body-side control unit 52A proceeds to step S204 and performs processing to obtain the focus group moving speed Vf that satisfies the condition. That is, the focus group moving speed Vf that satisfies the condition of [Equation 1] is obtained.
Then, the body-side control unit 52A executes the process of step S205 using the focus group moving speed Vf obtained in step S204.
As a result, lens driving can be controlled so that the moving speed difference between the zoom lens 13 and the focus lens 16 does not exceed a constant speed difference based on the threshold value Gth. It is possible to suppress the resulting change in angle of view.

In step S206 following step S205, the body side control unit 52A determines whether or not the zoom lens 13 and the focus lens 16 have reached the target positions.
If the zoom lens 13 and focus lens 16 have not reached their respective target positions, the body-side controller 52A returns to step S202. As a result, until the zoom lens 13 and the focus lens 16 reach their respective target positions, the lens drive control based on [Equation 1] is executed for each period of the minute time δt described above.

On the other hand, when the zoom lens 13 and the focus lens 16 have reached their respective target positions, the body-side control section 52A ends the processing of step S110.

In the above description, it is assumed that the zoom lens is driven with the drive signal value of the zoom lens 13 set to a fixed value such as the maximum value, and the focus group moving speed Vf side is changed. Assuming that the zoom lens 13 is driven at a value lower than the maximum value, both the zoom group moving speed Vz and the focus group moving speed Vf are set so as to satisfy the conditions of [Equation 1]. An adjustable configuration is also possible.
Also, at this time, if there are a plurality of sets of solutions of the zoom group moving speed Vz and the focus group moving speed Vf that satisfy the condition of [Equation 1], a set in which the zoom group moving speed Vz and the focus group moving speed Vf are larger. may be selected.

<3. Variation>
It should be noted that the embodiment is not limited to the specific examples described above, and various modifications can be made.
For example, as in the processing as the first modified example shown in the flowchart of FIG. 20, even if the correction execution conditions for the trimming correction method based on the information related to the amount of movement of the focus lens are satisfied, the trimming correction method When the trimming magnification required for breathing correction exceeds a threshold value, it is possible to perform control so that breathing correction is performed by a zoom lens correction method.

Specifically, in the example of FIG. 20, when it is determined in step S109 that the correction time Tla is not equal to or less than the threshold value Tth, the body-side control unit 52 (or 52A; the same applies hereinafter) controls the information related to the movement amount of the focus lens. When the correction execution condition by the trimming correction method based on is satisfied, after performing the acquisition processing of the trimming magnification for correction in step S111, it is determined whether or not the trimming magnification is equal to or less than a predetermined threshold value Rth in step S301. conduct. This threshold value Rth is a value determined as a permissible value of the trimming magnification in terms of image quality.
When the trimming magnification is equal to or less than the threshold value Rth, the body-side control section 52 proceeds to step S112 and instructs the image signal processing section 58 on the trimming magnification to execute the breathing correction by the trimming correction method.
On the other hand, if the trimming magnification is not equal to or less than the threshold value Rth, the body-side control unit 52 proceeds to step S110 and performs zoom lens movement control to the target zoom lens position. That is, when the trimming magnification exceeds the threshold value Rth defined as an allowable value in terms of image quality, the breathing correction by the trimming correction method is not performed, and the breathing correction by the zoom lens correction method is performed.

With the processing as the first modified example as described above, even if correction should be performed by the trimming correction method in terms of correction time, if it is predicted that image quality deterioration due to trimming will increase, Correction by the zoom lens correction method is performed.
Therefore, while minimizing the use of trimming that causes image quality deterioration, it is possible to keep image quality deterioration within an allowable range when correction by trimming is performed.

Further, as in the processing as the second modified example shown in the flowchart of FIG. 21, even when the correction execution condition by the zoom lens correction method based on the information related to the movement amount of the focus lens is established, the scene recognition information If the scene is determined to be a specific scene based on the above, it is also possible to perform control so that breathing correction is performed by a trimming correction method.
Here, the "scene recognition information" means information for recognizing the scene of imaging.

In the example of FIG. 21, when it is determined in step S109 that the correction time Tla is equal to or less than the threshold value Tth, the body-side control unit 52 (or 52A; the same applies hereinafter) performs If the correction execution condition by the zoom lens correction method is established, it is determined in step S401 whether or not the scene requires silence. That is, it is determined whether or not the scene is a specific scene requiring silence based on the scene recognition information.
As the scene recognition information here, it is conceivable to use scene recognition information obtained by image recognition processing for a captured image. Scene recognition of a specific scene such as a scene of a concert or a wild animal such as a wild bird is performed by image recognition processing of the captured image.
Alternatively, a dark scene such as night can be regarded as a specific scene requiring silence, and a bright scene such as daytime can be regarded as a non-specific scene. In that case, the scene recognition information may be information based on a detection signal from an illuminance sensor or the like provided in the imaging device 2 (or 2A; the same shall apply hereinafter).
Alternatively, the scene recognition information may be recognition information based on an audio signal picked up by a microphone. For example, it is conceivable to determine whether or not a specific scene is a specific scene by pattern matching of audio waveforms, such as determining whether or not a characteristic audio waveform is obtained.
Scene recognition may also be performed based on detection signals from motion sensors such as acceleration sensors and angular velocity sensors. For example, it is determined whether or not a particular scene is present by pattern matching of the waveform of the motion detection signal, such as determining whether or not a characteristic waveform of the motion detection signal is obtained when the imaging device 2 is used in a particular scene. can be considered.
Furthermore, scene recognition may be image recognition processing using AI (artificial intelligence) technology.

If it is determined in step S401 that the specific scene does not require silence, the body-side control unit 52 proceeds to step S110. That is, in this case, breathing correction is performed by a zoom lens correction method.
On the other hand, if it is determined that the scene is a specific scene that requires silence, the body-side control unit 52 proceeds to step S111. That is, in this case, the breathing correction is performed by the trimming correction method by the processing of steps S111 and S112.

With the processing as the second modified example as described above, even if the correction should be performed by the zoom lens correction method in terms of correction time, in a specific scene where quietness is required, It is possible to perform correction using a trimming correction method that does not generate operation noise.
Therefore, it is possible to appropriately switch the breathing correction method according to the situation of the imaging device 2 .

It should be noted that the first modified example and the second modified example described above can be combined.
That is, although the trimming magnification exceeds the threshold value Rth and does not satisfy the requirements in terms of image quality, if it is determined that the specific scene requires silence, the breathing correction is performed by the trimming correction method. can be considered.
Alternatively, if the trimming magnification exceeds the threshold value Rth for a specific scene that requires quietness, breathing correction may be performed using a zoom lens correction technique.

As a third modification, as shown in the flowchart of FIG. 22, the first correction method (zoom lens correction method in this example) and the second correction method (trimming correction method in this example) are selected based on the scene recognition information. It is also possible to determine which method of breathing correction is to be performed.
Specifically, in the example of FIG. 22, the body-side control unit 52 (or 52A; the same applies hereinafter) performs processing for obtaining the target zoom lens position in step S106, and then performs processing for obtaining the trimming magnification in step S111. Next, in step S401, it is determined whether or not the scene requires silence. The processing of step S401 in this case is the same as that described with reference to FIG.
If the scene is determined to be a specific scene that requires silence, the body-side control unit 52 advances the process to step S112 (that is, breathing correction is performed using a trimming correction method).
On the other hand, if it is determined that the scene is not a specific scene that requires silence, the body-side control unit 52 advances the process to step S111 (that is, breathing correction is performed by the zoom lens correction method).

With the processing as the third modified example described above, in specific scenes where silence is required, correction is performed using the trimming correction method instead of performing correction using the zoom lens correction method that produces operation noise related to lens movement. It becomes possible to
Therefore, it is possible to appropriately switch the breathing correction method according to the situation of the imaging device 2 (or 2A).

Here, in the description so far, the breathing correction method is determined based on the correction time Tla obtained from the correction zoom lens movement amount, that is, the zoom lens movement amount required for the breathing correction by the zoom lens correction method. However, instead of this, it is also possible to determine the breathing correction method based on the amount of movement of the zoom lens for correction. In this case, it is determined whether or not the amount of movement of the zoom lens for correction is equal to or less than a predetermined threshold value Zth, and if the amount of movement of the zoom lens for correction is equal to or less than the threshold value Zth, breathing correction is performed by the zoom lens correction method. Breathing correction is performed by the trimming correction method unless the zoom lens movement amount is equal to or less than the threshold value Zth.
Since the correction zoom lens movement amount correlates with the correction time Tla, even if the determination is made based on the correction amount zoom lens movement amount as described above, the same effect as in the first and second embodiments can be obtained. can.

The breathing correction method can also be determined based on the amount of movement of the focus lens 16 during focusing. The amount of movement of the focus lens 16 by focusing can be obtained based on the current focus lens position and the target focus lens position in the case of AF focusing.
Since the amount of movement of the focus lens 16 also correlates with the correction time Tla, if the determination is made based on the amount of movement of the focus lens 16 as described above, for example, when the amount of movement of the focus lens is large (when the correction time Tla is If it is long), appropriate breathing correction can be determined based on the amount of movement of the focus lens 16, such as by performing correction using a trimming correction method.

Alternatively, the breathing correction method can be determined based on the trimming magnification (correction trimming magnification) when performing the breathing correction by the trimming correction method. As can be understood from the description so far, the trimming magnification for correction is obtained based on information on the focal position (target focal position in the case of AF) after the change due to focusing, the zoom lens position, and the trimming magnification table J4. be able to.
Since the correction trimming magnification also correlates with the correction time Tla, if the determination is made based on the correction trimming magnification as described above, for example, when the correction trimming magnification is large (when the correction time Tla is long), Appropriate breathing correction can be determined based on the trimming magnification for correction, such as by performing correction by a trimming correction method.

Also, in the description so far, an example has been given in which the lens characteristic information for correcting breathing is stored in the

interchangeable lens

1 or 1A, but this is not the only option.
For example, as a fourth modified example, the lens characteristic information can be stored in a cloud server, and the

imaging device

2 or 2A can be configured to acquire it from the cloud server as needed.

FIG. 23 shows a simplified configuration explanatory diagram of a camera system as a fourth modified example.
In the figure, the interchangeable lens 1A' stores the lens characteristic information (focus movement locus information J1, angle of view table J2, lens group movement speed table J3A, trimming magnification table J4, focus group angle of view) described in the second embodiment in the memory 32. It differs from the interchangeable lens 1A in that the fluctuation rate table J5 and the zoom group view angle fluctuation rate table J6) are not stored. In this case, the memory 32 stores lens identification information J7 for identifying the interchangeable lens 1A'.
In addition, the imaging device 2A' in the drawing differs from the imaging device 2A in that it includes a body-side control section 52A' in place of the body-side control section 52A and also includes a communication section . The communication unit 70 communicates with an external device via a network NT such as the Internet.
The cloud server 80 stores lens characteristic information for each interchangeable lens 1A' as the lens characteristic information described in the second embodiment.

In the imaging device 2A', the body-side control unit 52A' acquires the lens identification information J7 from the attached interchangeable lens 1A', and makes an inquiry to the cloud server 80 via the communication unit 70 using the acquired lens identification information J7. to acquire the lens characteristic information corresponding to the mounted interchangeable lens 1A'.

By adopting the system configuration as the fourth modified example as described above, there is no need to store the lens characteristic information in the interchangeable lens 1A' in realizing appropriate breathing correction according to the lens characteristic.
Therefore, it is possible to reduce the memory capacity of the interchangeable lens 1A'.

In the above, an example in which the configuration of the fourth modification is applied to the camera system of the second embodiment has been given, but the configuration of the fourth modification can also be applied to the camera system of the first embodiment. .

In the description so far, the breathing correction method is determined by determining which of the zoom lens correction method and the trimming correction method should be used for the breathing correction. It is not limited to the lens correction method and the trimming correction method.
For example, as the same zoom lens correction method, the zoom lens movement speed is slow but the zoom lens position control accuracy is high (that is, the breathing correction accuracy is high). In the case where there is a second zoom lens correction method with low position control accuracy, it is also possible to make a determination targeting these first zoom lens correction method and second zoom lens correction method.
In this case, if the correction time by the first zoom lens correction method is short (if it is equal to or less than the threshold value), correction by the first zoom lens correction method is performed, and the correction time by the first zoom lens correction method is If it is longer (if it is not equal to or less than the threshold value), it is conceivable to perform correction by the second zoom lens correction method.
As a result, it is possible to minimize omission of correction of changes in the angle of view due to response delay in correction, while enabling breathing correction using a technique with high correction accuracy.

In addition, in the description so far, an example in which an interchangeable lens is detachably configured in an imaging device has been given, but the present technology can also be suitably applied to a case where the imaging device adopts a lens-integrated device form. is.

Further, in the description so far, an example in which AF is performed by the image plane phase difference method has been described. It can be widely and suitably applied to.

Further, in the above description, the information processing device that determines the breathing correction method is configured as an imaging device that includes an imaging unit, but it is not essential that the information processing device includes an imaging unit. .

<4. Summary of Embodiments>
As described above, the information processing apparatuses (

imaging apparatuses

2, 2A, 2A′) of the embodiments use the first correction method, which is a breathing correction method, and the A correction method determination unit (F5 in the same) is provided for determining which of the second correction methods should be used for the breathing correction.
According to the above configuration, which one of the first and second correction methods should be used for the breathing correction is determined based on the information regarding the amount of movement of the focus lens group or the scene recognition information. If the correction method is determined based on information related to the amount of movement of the focus lens group, for example, if the first and second correction methods are the breathing correction method by driving the zoom lens group and the breathing correction method by trimming the captured image, respectively. In the case of adopting a correction method by driving the zoom lens group, it is possible to estimate the time required for breathing correction from information related to the amount of movement of the focus lens group, and if the time required for correction is long, breathing correction by trimming It is possible to carry out the procedure. This makes it possible to perform breathing correction while minimizing the use of trimming that causes image quality deterioration.
Further, if the correction method is determined based on the scene recognition information, for example, when the first and second correction methods are the breathing correction method by driving the zoom lens group and the breathing correction method by trimming the captured image, the quietness In a specific scene, it is possible to perform breathing correction by trimming without performing breathing correction by driving the zoom lens, which produces an operation sound associated with lens movement.
Therefore, according to the above configuration, it is possible to appropriately determine the breathing correction method to be executed according to the situation of the imaging apparatus.

Further, in the information processing apparatus of the embodiment, one of the first and second correction methods is a zoom lens correction method in which breathing correction is performed by driving the zoom lens group, and the other is a breathing correction method by trimming the captured image. This is a trimming correction method that performs
As a result, it is possible to determine an appropriate correction method according to the situation of the imaging apparatus, with respect to the zoom lens correction method that is advantageous in terms of image quality and the trimming correction method that causes image quality deterioration but is advantageous in terms of correction speed. .

Further, in the information processing apparatus of the embodiment, the correction method determination unit acquires the zoom lens movement amount required for breathing correction by the zoom lens correction method based on the information related to the movement amount of the focus lens group, Based on the amount of movement, it is determined whether the breathing correction should be performed using the zoom lens correction method or the trimming correction method.
The amount of zoom lens movement required for breathing correction by the zoom lens correction method correlates with the correction time when performing the breathing correction by the zoom lens correction method.
Therefore, according to the above configuration, for example, when the amount of movement of the zoom lens is large (when the correction time by the zoom lens correction method is long), correction by the trimming correction method is performed. Appropriate correction methods can be switched based on the amount of lens movement.

Furthermore, in the information processing apparatus of the embodiment, the correction method determination unit performs control so that breathing correction is performed by the zoom lens correction method when the zoom lens movement amount is equal to or less than a predetermined threshold value, and the zoom lens movement amount exceeds the threshold, the breathing correction is performed by the trimming correction method.
This makes it possible to perform breathing correction by the trimming correction method in response to the case where the correction time by the zoom lens correction method is estimated to be long from the amount of movement of the zoom lens for correction.
Therefore, it is possible to perform breathing correction while minimizing the use of trimming that causes image quality deterioration.

Further, in the information processing apparatus of the embodiment, the correction method determination unit acquires the correction time when breathing correction is performed by the zoom lens correction method based on the zoom lens movement amount, and based on the correction time, zoom lens correction is performed. A determination is made as to whether the breathing correction should be performed by either the method or the trimming correction method (see FIG. 12).
As a result, for example, when the correction time of the zoom lens correction method is long, it is possible to perform the breathing correction by the trimming correction method. It is possible to switch the appropriate correction method based on.

Further, in the information processing apparatus of the embodiment, the correction method determination unit performs control so that breathing correction is performed by the zoom lens correction method when the correction time is equal to or less than a predetermined threshold value (Tth), and the correction time is equal to or less than the threshold value. is exceeded, the breathing correction is performed by the trimming correction method (see FIG. 12).
Thereby, it is possible to perform breathing correction by the trimming correction method in response to the case where it is determined that the correction time by the zoom lens correction method is long.
Therefore, it is possible to perform breathing correction while minimizing the use of trimming that causes image quality deterioration.

Furthermore, in the information processing apparatus of the embodiment, the correction method determination unit acquires the focus lens movement amount, which is the movement amount of the focus lens group, based on the information related to the movement amount of the focus lens group, and obtains the focus lens movement amount. Based on the amount of movement, it is determined whether the breathing correction should be performed using the zoom lens correction method or the trimming correction method.
The focus lens movement amount correlates with the correction time when breathing correction is performed by the zoom lens correction method.
Therefore, according to the above configuration, for example, when the amount of movement of the focus lens is large (when the correction time of the zoom lens correction method is long), correction is performed by the trimming correction method. An appropriate correction method can be determined based on the above.

Further, in the information processing apparatus of the embodiment, the correction method determination unit includes information related to the amount of movement of the focus lens group, and trimming magnification characteristic information (trimming magnification Based on Table J4), a trimming magnification for performing breathing correction by a trimming correction method is acquired, and based on the trimming magnification, it is determined whether to perform breathing correction by either the zoom lens correction method or the trimming correction method. making judgments.
The trimming magnification in the case of performing the breathing correction by the trimming correction method also correlates with the correction time in the case of performing the breathing correction by the zoom lens correction method.
Therefore, according to the above configuration, for example, when the trimming magnification for breathing correction is large (when the correction time by the zoom lens correction method is long), the correction by the trimming correction method is performed. It is possible to determine an appropriate correction method based on the trimming magnification for .

Further, in the information processing apparatus of the embodiment, the correction method determination unit determines whether breathing by the trimming correction method is performed even when the correction execution condition by the trimming correction method based on the information related to the movement amount of the focus lens group is satisfied. When the trimming magnification required for correction exceeds the threshold value (Rth), control is performed so that breathing correction is performed by the zoom lens correction method (see FIG. 20).
As a result, even if the trimming correction method should be used in terms of correction time, the zoom lens correction method will be used when it is predicted that the image quality will deteriorate due to trimming. .
Therefore, while minimizing the use of trimming that causes image quality deterioration, it is possible to keep image quality deterioration within an allowable range when correction by trimming is performed.

Furthermore, in the information processing apparatus of the embodiment, the correction method determination unit determines whether the scene recognition information is determined to be a specific scene based on the above, the breathing correction is performed by the trimming correction method (see FIG. 21).
As a result, even if correction should be performed using the zoom lens correction method in terms of correction time, in specific scenes where quietness is required, the trimming correction method that does not generate operating noise related to lens movement can be used. A correction can be made.
Therefore, it is possible to appropriately switch the breathing correction method according to the situation of the imaging apparatus.

Further, in the information processing device (

imaging device

2A, 2A') of the embodiment, during the breathing correction by the zoom lens correction method, the zoom lens group or the A correction control section (first correction control section F3A) that controls the moving speed of at least one of the focus lens groups is provided (see FIG. 19, etc.).
As a result, it is possible to suppress variation in the angle of view caused by the difference in moving speed between the focus lens group and the zoom lens group during breathing correction by the zoom lens correction method.

Furthermore, in the information processing apparatus of the embodiment, the correction method determination unit determines, based on the scene recognition information, which of the first correction method and the second correction method should be used for the breathing correction ( See Figure 22).
As a result, for example, when the first and second correction methods are the breathing correction method by driving the zoom lens group and the breathing correction method by trimming the captured image, respectively, in a specific scene where silence is required, the operation noise associated with lens movement is reduced. It is possible to perform breathing correction by trimming without performing breathing correction by driving the zoom lens, which causes .
Therefore, it is possible to appropriately determine the breathing correction method according to the situation of the imaging apparatus.

Furthermore, in the information processing apparatus of the embodiment, one of the first and second correction methods is a zoom lens correction method in which breathing correction is performed by driving a zoom lens group, and the other is a breathing correction method by trimming a captured image. This is a trimming correction method for performing correction, and when the correction method determination unit determines that the scene is a specific scene based on the scene recognition information, it controls so that the breathing correction is performed by the trimming correction method, and determines that the scene is not a specific scene. If so, the breathing correction is performed by the zoom lens correction method (see FIG. 22).
As a result, it is possible to perform correction by the trimming correction method without performing the correction by the zoom lens correction method, which generates the operating sound associated with the lens movement, in a specific scene where quietness is required.
Therefore, it is possible to appropriately switch the breathing correction method according to the situation of the imaging apparatus.

In the information processing apparatus of the embodiment, the scene recognition information is information based on at least one of image recognition processing, a detection signal from an illuminance sensor, a sound pickup signal from a microphone, and a detection signal from a motion sensor. .
The image recognition processing, the detection signal from the illuminance sensor, the picked-up sound signal from the microphone, and the detection signal from the motion sensor are each information that enables recognition of the captured scene.
Therefore, it is possible to appropriately determine whether or not the scene is a specific scene, and to appropriately determine the breathing correction method according to the situation of the imaging apparatus.

Further, in the information processing apparatus of the embodiment, processing is performed to acquire lens characteristic information used for breathing correction from the lens device.
Accordingly, in order to realize appropriate breathing correction according to lens characteristics, it is sufficient to provide at least communication means with the lens device as communication means.
Therefore, it is possible to reduce the number of device parts and the cost.

Furthermore, in the information processing apparatus of the embodiment, processing is performed to acquire lens characteristic information used for breathing correction from the cloud server (see FIG. 23).
This eliminates the need to store the lens characteristic information in the lens device in order to realize appropriate breathing correction according to the lens characteristic.
Therefore, it is possible to reduce the memory capacity of the lens device.

Furthermore, the information processing apparatus according to the embodiment is configured as an imaging apparatus including an imaging unit.
That is, an information processing device configured as an imaging device determines which of the first and second correction methods the breathing correction should be performed based on information related to the amount of movement of the focus lens group or scene recognition information. It is a thing.
Therefore, it is possible to realize an image pickup apparatus that can appropriately determine a breathing correction method according to the situation of the own apparatus.

Further, in the information processing method of the embodiment, the information processing apparatus performs one of the first correction method and the second correction method, which are methods for correcting breathing, based on information related to the amount of movement of the focus lens group or scene recognition information. This is an information processing method for determining whether or not to perform breathing correction by the technique of (1).
According to such an information processing method, it is possible to obtain the same actions and effects as those of the information processing apparatus of the above-described embodiment.

Here, as an embodiment, it is possible to consider a program that causes a CPU, a DSP (Digital Signal Processor), etc., or a device including these, to execute the processing by the correction method determination unit F5 described with reference to FIGS. can.
That is, the program of the embodiment is a program readable by a computer device, and performs a first correction method and a second correction method, which are breathing correction methods, based on information related to the amount of movement of the focus lens group or scene recognition information. It is a program that causes a computer device to realize a function of determining which of the methods should be used for the breathing correction.
With such a program, the function of the above-described correction method determination unit F5 can be realized in a device such as the imaging device 2 or the like.

The program as described above can be recorded in advance in a HDD as a recording medium built in equipment such as a computer device, or in a ROM or the like in a microcomputer having a CPU.
Alternatively, flexible discs, CD-ROMs (Compact Disc Read Only Memory), MO (Magneto Optical) discs, DVDs (Digital Versatile Discs), Blu-ray discs (Blu-ray Discs (registered trademark)), magnetic discs, semiconductor memories, It can be temporarily or permanently stored (recorded) in a removable recording medium such as a memory card. Such removable recording media can be provided as so-called package software.
In addition to installing such a program from a removable recording medium to a personal computer or the like, it can also be downloaded from a download site via a network such as a LAN (Local Area Network) or the Internet.

Further, such a program is suitable for wide provision of the correction method determination unit F5 of the embodiment. For example, by downloading a program to a personal computer, a portable information processing device, a mobile phone, a game device, a video device, a PDA (Personal Digital Assistant), etc., the personal computer, etc. can be used as the correction method determination unit F5 of the present disclosure. It can function as a device for realizing processing.

Note that the effects described in this specification are merely examples and are not limited, and other effects may be provided.

<5. This technology>
Note that the present technology can also adopt the following configuration.
(1)
A correction method for determining which of the breathing correction methods, the first correction method and the second correction method, should be used for breathing correction based on information related to the amount of movement of the focus lens group or scene recognition information. An information processing device having a determination unit.
(2)
One of the first and second correction methods is a zoom lens correction method in which breathing correction is performed by driving a zoom lens group, and the other is a trimming correction method in which breathing correction is performed by trimming a captured image. ).
(3)
The correction method determination unit acquires a zoom lens movement amount required for breathing correction by the zoom lens correction method based on information related to the movement amount of the focus lens group, and determines the zoom lens movement amount based on the zoom lens movement amount. The information processing apparatus according to (2), wherein a determination is made as to which of the correction method and the trimming correction method should be used for the breathing correction.
(4)
The correction method determination unit performs control such that breathing correction is performed by the zoom lens correction method when the zoom lens movement amount is equal to or less than a predetermined threshold, and controls the breathing correction by the zoom lens correction method when the zoom lens movement amount exceeds the threshold. The information processing apparatus according to (3), wherein control is performed such that breathing correction is performed by a trimming correction method.
(5)
The correction method determination unit acquires a correction time when breathing correction is performed by the zoom lens correction method based on the zoom lens movement amount, and based on the correction time, the zoom lens correction method and the trimming correction method. The information processing apparatus according to (3) above, in which a determination is made as to which method of the breathing correction is to be performed.
(6)
The correction method determination unit controls to perform breathing correction by the zoom lens correction method when the correction time is less than or equal to a predetermined threshold, and performs control by the trimming correction method when the correction time exceeds the threshold. The information processing apparatus according to (5) above, wherein control is performed such that breathing correction is performed.
(7)
The correction method determination unit acquires a focus lens movement amount, which is the movement amount of the focus lens group, based on information related to the movement amount of the focus lens group, and performs the zoom lens correction based on the focus lens movement amount. The information processing apparatus according to (2), wherein a determination is made as to whether the breathing correction is to be performed by any one of the trimming correction method and the trimming correction method.
(8)
The correction method determination unit determines breathing by the trimming correction method based on information related to the amount of movement of the focus lens group and trimming magnification characteristic information indicating a trimming magnification characteristic for performing breathing correction by the trimming correction method. Obtaining a trimming magnification for correction, and determining whether breathing correction should be performed by either the zoom lens correction method or the trimming correction method based on the trimming magnification Information according to (2) above processing equipment.
(9)
The correction method determination unit determines that a trimming magnification required for breathing correction by the trimming correction method is a threshold value even when a correction execution condition by the trimming correction method based on information related to the amount of movement of the focus lens group is satisfied. The information processing apparatus according to any one of (2) to (7), wherein the breathing correction is performed by the zoom lens correction method when exceeding the above.
(10)
The correction method determination unit determines that the scene is a specific scene based on the scene recognition information even when a correction execution condition by the zoom lens correction method based on the information regarding the amount of movement of the focus lens group is satisfied. The information processing apparatus according to any one of (2) to (7) and (9) above, wherein, when the trimming correction method is performed, the breathing correction is performed by the trimming correction method.
(11)
Correction control for controlling the movement speed of at least one of the zoom lens group and the focus lens group based on the movement speed of the focus lens group and the movement speed of the zoom lens group during breathing correction by the zoom lens correction method. The information processing apparatus according to any one of (2) to (9) above, comprising a unit.
(12)
The correction method determination unit determines, based on the scene recognition information, which of the first correction method and the second correction method should be used for the breathing correction. information processing equipment.
(13)
One of the first and second correction methods is a zoom lens correction method in which breathing correction is performed by driving a zoom lens group, and the other is a trimming correction method in which breathing correction is performed by trimming a captured image,
The correction method determination unit controls to perform breathing correction by the trimming correction method when the scene is determined to be a specific scene based on the scene recognition information, and controls the breathing correction to be performed by the trimming correction method when the scene is determined not to be the specific scene. The information processing apparatus according to (12), wherein control is performed such that breathing correction is performed by a zoom lens correction method.
(14)
The information processing apparatus according to (12), wherein the scene recognition information is information based on at least one of an image recognition process, a detection signal from an illuminance sensor, a picked-up sound signal from a microphone, and a detection signal from a motion sensor.
(15)
The information processing apparatus according to any one of (1) to (14), wherein a process of acquiring lens characteristic information used for the breathing correction from the lens device is performed.
(16)
The information processing apparatus according to any one of (1) to (14), wherein a process of acquiring lens characteristic information used for the breathing correction from a cloud server is performed.
(17)
The information processing device according to any one of (1) to (16) above, configured as an imaging device including an imaging unit.
(18)
The information processing device
Determining which method of breathing correction to perform, out of the first correction method and the second correction method, is to be performed based on information related to the amount of movement of the focus lens group or scene recognition information. Method.
(19)
A program readable by a computer device,
A function of determining which of the breathing correction method, the first correction method and the second correction method, should be used for the breathing correction based on information related to the amount of movement of the focus lens group or scene recognition information; on the computer device.

1, 1A, 1A'

interchangeable lens

2, 2A, 2A' imaging device (body)
11 mount section 12, 12A lens side control section 13 zoom lens 14 image stabilization lens 15 aperture 16 focus lens 17 detection section 21 zoom lens drive section 22 camera shake control section 23 aperture control section 24 focus lens drive section 31 operation section 32 memory 33 power supply Control unit 51

Mount units

52, 52A, 52A' Body side control unit 53 Shutter 54 Shutter control unit 55 Image sensor 56 ADC
57 frame memory 58 image signal processing unit 59 recording unit 60 recording medium 61 display unit 62 memory 63 power control unit 64 power supply unit 65 operation unit 70 communication unit 80 cloud server J1 focus movement trajectory information J2 angle of view table J3, J3A lens group movement Speed table J4 Trimming magnification table J5 Focus group view angle variation rate table J6 Zoom group view angle variation rate table J7 Lens identification information F1, F1A Information acquisition processing unit F2 AF processing unit F3, F3A First correction control unit F4 Second correction control Part F5 correction method determination part

Claims

A correction method for determining which of the breathing correction methods, the first correction method and the second correction method, should be used for the breathing correction based on information related to the amount of movement of the focus lens group or scene recognition information. An information processing device having a determination unit.
1. One of the first and second correction methods is a zoom lens correction method in which breathing correction is performed by driving a zoom lens group, and the other is a trimming correction method in which breathing correction is performed by trimming a captured image. The information processing device according to .
The correction method determination unit acquires a zoom lens movement amount required for breathing correction by the zoom lens correction method based on information related to the movement amount of the focus lens group, and determines the zoom lens movement amount based on the zoom lens movement amount. 3. The information processing apparatus according to claim 2, wherein a determination is made as to whether the breathing correction is to be performed by either the correction method or the trimming correction method.
The correction method determination unit performs control such that breathing correction is performed by the zoom lens correction method when the zoom lens movement amount is equal to or less than a predetermined threshold, and controls the breathing correction by the zoom lens correction method when the zoom lens movement amount exceeds the threshold. The information processing apparatus according to claim 3, wherein control is performed such that breathing correction is performed by a trimming correction method.
The correction method determination unit acquires a correction time when breathing correction is performed by the zoom lens correction method based on the zoom lens movement amount, and based on the correction time, the zoom lens correction method and the trimming correction method. 4. The information processing apparatus according to claim 3, wherein a determination is made as to which method of breathing correction is to be performed.
The correction method determination unit controls to perform breathing correction by the zoom lens correction method when the correction time is less than or equal to a predetermined threshold, and performs control by the trimming correction method when the correction time exceeds the threshold. The information processing apparatus according to claim 5, wherein control is performed so that breathing correction is performed.
The correction method determination unit acquires a focus lens movement amount, which is the movement amount of the focus lens group, based on information related to the movement amount of the focus lens group, and performs the zoom lens correction based on the focus lens movement amount. 3. The information processing apparatus according to claim 2, wherein a determination is made as to whether the breathing correction is to be performed by either the trimming correction method or the trimming correction method.
The correction method determination unit determines breathing by the trimming correction method based on information related to the amount of movement of the focus lens group and trimming magnification characteristic information indicating a trimming magnification characteristic for performing breathing correction by the trimming correction method. 3. The information processing according to claim 2, wherein a trimming magnification for performing correction is acquired, and based on the trimming magnification, it is determined which of the zoom lens correction method and the trimming correction method should be used for the breathing correction. Device.
The correction method determination unit determines that a trimming magnification required for breathing correction by the trimming correction method is a threshold value even when a correction execution condition by the trimming correction method based on information related to the amount of movement of the focus lens group is satisfied. 3. The information processing apparatus according to claim 2, wherein control is performed such that breathing correction is performed by the zoom lens correction method when the value exceeds .
The correction method determination unit determines that the scene is a specific scene based on the scene recognition information even when a correction execution condition by the zoom lens correction method based on the information regarding the amount of movement of the focus lens group is satisfied. 3. The information processing apparatus according to claim 2, wherein when the trimming correction method is performed, the breathing correction is performed by the trimming correction method.
Correction control for controlling the movement speed of at least one of the zoom lens group and the focus lens group based on the movement speed of the focus lens group and the movement speed of the zoom lens group during breathing correction by the zoom lens correction method. The information processing apparatus according to claim 2, comprising a unit.
2. The information processing apparatus according to claim 1, wherein the correction method determination unit determines, based on the scene recognition information, which one of the first correction method and the second correction method should be used for the breathing correction.
One of the first and second correction methods is a zoom lens correction method in which breathing correction is performed by driving a zoom lens group, and the other is a trimming correction method in which breathing correction is performed by trimming a captured image,
The correction method determination unit controls to perform breathing correction by the trimming correction method when it is determined that the scene is a specific scene based on the scene recognition information, and when it is determined that the scene is not the specific scene. 13. The information processing apparatus according to claim 12, wherein control is performed such that breathing correction is performed by a zoom lens correction method.
The information processing apparatus according to claim 12, wherein the scene recognition information is information based on at least one of image recognition processing, a detection signal from an illuminance sensor, a sound pick-up signal from a microphone, and a detection signal from a motion sensor.
The information processing apparatus according to claim 1, wherein a process of acquiring lens characteristic information used for said breathing correction from a lens device is performed.
The information processing apparatus according to claim 1, wherein a process of acquiring lens characteristic information used for said breathing correction from a cloud server is performed.
The information processing apparatus according to claim 1, configured as an imaging apparatus including an imaging unit.
The information processing device
Determining which method of breathing correction to perform, out of the first correction method and the second correction method, is to be performed based on information related to the amount of movement of the focus lens group or scene recognition information. Method.
A program readable by a computer device,
A function of determining which of the breathing correction method, the first correction method and the second correction method, should be used for the breathing correction based on information related to the amount of movement of the focus lens group or scene recognition information; on the computer device.