JP2023070454A - Image processing device and method, and imaging apparatus - Google Patents

Abstract

To determine the presence/absence of an angle-of-view change which occurs when a function is started and stopped in order to eliminate an angle-of-view change caused by focusing.SOLUTION: An image processing device comprises: storage means for storing first information relating to an image magnification correction of a lens device; first acquisition means for acquiring second information including a position and a focal distance of a focus lens relating to the lens device; second acquisition means for acquiring an imaging condition; calculation means which calculates an angle-of-view correction value for correcting a change in an angle of view with a change in the position of the focus lens based on the first information, the second information and the imaging condition; image processing means which performs correction processing for correcting image data, which are obtained by performing imaging using the imaging condition, in accordance with the angle-of-view correction value; and determination means for determining whether or not the angle-of-view change occurs when the correction processing is started and stopped by the image processing means based on the first information and the second information.SELECTED DRAWING: Figure 1

Description

The present invention relates to an image processing apparatus and method, and an imaging apparatus, and more particularly to a technique for improving the image quality of an image captured through an optical system.

2. Description of the Related Art Conventionally, there have been developments related to high image quality technology in an imaging apparatus that corrects a change in angle of view when driving a focus lens. For example, Japanese Patent Application Laid-Open No. 2002-300000 discloses a technique for quickly and accurately correcting a change in the angle of view that accompanies movement of a focus lens using an electronic zoom. Further, in Japanese Patent Application Laid-Open No. 2002-200003, even if a lens that changes the angle of view due to focusing is used, a moving image that does not cause discomfort is acquired by performing trimming processing on the subject image signal so that the angle of view is constant. A digital camera is disclosed.

JP-A-11-23949 Japanese Unexamined Patent Application Publication No. 2008-42405

The field angle correction function for acquiring an image without a field angle change due to focusing in Patent Documents 1 and 2 is realized by processing an image signal. Therefore, for example, if the angle of view correction function is activated and focusing is performed when the distance to the subject is changing, the resolution of the image will change. It is conceivable that there may be a case where it is desired to restore the original resolution by stopping.

However, with the techniques disclosed in Patent Literatures 1 and 2, when the angle of view correction function is activated and stopped, the angle of view may unintentionally change abruptly. There was a problem that I could not recognize it. In particular, if an unintended sudden change in angle of view occurs during shooting of a moving image, the image quality of the obtained moving image deteriorates.

SUMMARY OF THE INVENTION The present invention has been made in view of the above problems, and it is an object of the present invention to determine whether or not there is a change in angle of view that occurs when a function for eliminating the change in angle of view caused by focusing is activated and stopped.

In order to achieve the above object, an image processing apparatus of the present invention comprises storage means for storing first information relating to image magnification correction of a lens device, and second information including the position and focal length of a focus lens relating to the lens device. a first acquisition means for acquiring the information of the focus lens, a second acquisition means for acquiring a photographing condition, the first information, the second information, and the photographing condition; a calculating means for obtaining an angle-of-view correction value for correcting a change in the angle of view due to a change in the position of the camera; Based on the image processing means for performing the correction process, the first information, and the second information, it is determined whether or not the angle of view changes when the correction process by the image processing means is activated and stopped. and determination means for determining.

According to the present invention, it is possible to determine whether or not there is a change in the angle of view that occurs when the function for eliminating the change in the angle of view caused by focusing is activated and stopped.

1 is a block diagram showing a schematic offensive of an imaging system according to a first embodiment of the present invention; FIG. FIG. 5 is a diagram showing an example of the relationship between the position of the focus lens and the image magnification correction magnification ratio according to the first embodiment; FIG. 5 is a diagram showing an example of the relationship between the position of the focus lens and the image magnification correction magnification ratio according to the first embodiment; 4 is a flow chart showing operations during moving image shooting in the first embodiment. FIG. 7 is a diagram showing a display example of a view angle change determination result according to the first embodiment; FIG. 11 is a diagram showing a display example of a field angle change occurrence area according to the second embodiment;

Hereinafter, embodiments will be described in detail with reference to the accompanying drawings. In addition, the following embodiments do not limit the invention according to the scope of claims. Although multiple features are described in the embodiments, not all of these multiple features are essential to the invention, and multiple features may be combined arbitrarily. Furthermore, in the accompanying drawings, the same or similar configurations are denoted by the same reference numerals, and redundant description is omitted.

<First embodiment>
FIG. 1 is a block diagram showing a schematic configuration of an imaging system including a lens device and an imaging device according to an embodiment of the present invention. Note that in this embodiment, as shown in FIG. 1, a case will be described in which the lens device 150 is detachably attached to the imaging device 100 via the lens mount section 180. However, the lens device 150 and the imaging device 100 may be configured integrally.

First, the internal configuration of the imaging apparatus 100 will be described.
A CCD sensor, a CMOS sensor, or the like, for example, is used as the imaging device 102, and converts the subject image formed by the lens device 150 into an electrical signal. Based on shake data detected by a gyro sensor 118, which will be described later, motion vectors between frame images, etc., the imager anti-vibration control unit 109 drives the image sensor 102 in a plane perpendicular to the optical axis of the lens device 150. Thus, imager vibration isolation can be performed.

The image generation unit 103 converts analog signals output from the image sensor 102 into digital signals to generate image data. The generated image data is input to the memory control section 105 and the image processing section 140 . The memory control unit 105 controls the image generation unit 103 , the timing generation unit 104 , the image display unit 106 , the memory 107 , the recording unit 108 and the image processing unit 140 . The image data output from the image generation unit 103 is written to the memory 107 and the recording unit 108 via the image processing unit 140 and memory control unit 105 .

The timing generator 104 supplies clock signals and synchronization signals to the image sensor 102 , image generator 103 , memory controller 105 , system controller 130 and image processor 140 .

The image display unit 106 is configured using a liquid crystal display, organic EL, or the like, and sequentially displays image data obtained by imaging with the image sensor 102, thereby realizing an electronic viewfinder (EVF) function. Further, the image display unit 106 displays images recorded in the memory 107 and the recording unit 108 during image reproduction. Furthermore, the image display unit 106 displays operation information and shooting information to the user.

The memory 107 stores captured still images and moving images, and is also used as a work area for the system control unit 130 . The memory 107 also stores data regarding optical aberration correction and data regarding image magnification correction, which are obtained through communication with the lens apparatus 150 . It should be noted that the data regarding the optical aberration correction and the data regarding the image magnification correction of the lens device 150 may be obtained not from the lens device 150 but from outside via an external communication interface (not shown). Alternatively, the memory 107 may store in advance design data regarding optical aberration correction of the lens device 150, design data regarding image magnification correction, and the like.

The recording unit 108 is configured by a non-volatile memory that is mounted in the imaging device 100 or removable from the imaging device 100, and stores captured still images and moving images.

A shutter control unit 110 controls driving of the shutter 101 based on a control signal from the system control unit 130 . A shutter switch 115 is a switch (hereinafter referred to as “SW1”) that is turned on by halfway operation (for example, half-press) of a release button (not shown), and performs AF processing, AE processing, and AWB according to the user's operation. A signal for instructing the system control unit 130 to start an operation such as processing is generated. The shutter switch 116 is a switch (hereinafter referred to as “SW2”) that is turned on when the operation of a release button (not shown) is completed (for example, fully pressed), and the system control unit 130 starts exposure according to the user's operation. generates a signal that directs

The system control unit 130 that has received the instruction to start exposure controls the image sensor 102, the memory control unit 105, the shutter control unit 110, and the lens device 150 via the I/F 120 to record image data in the recording unit 108. process to be performed.

The camera operation member 117 includes various buttons such as a video recording start/end button, an image magnification correction ON/OFF button 117a, a touch panel, a power ON/OFF button, and the like. Output. The image magnification correction ON/OFF button 117a is used for instructing ON/OFF of image magnification correction processing, which will be described later. Even if the image magnification correction ON/OFF button 117a is configured as a mechanical hardware button, it is configured as ON/OFF soft buttons 510 and 511 on the display screen 501 of the image display unit 106 as shown in FIG. Alternatively, a combination of hard buttons and soft buttons may be used as long as the ON/OFF operation is possible during shooting of moving images. In accordance with the user's operation of the camera operation member 117, the system control unit 130 performs switching of various functions installed in the imaging apparatus 100, and the like.

The gyro sensor 118 generates orientation information of the imaging device 100 and transmits a shake signal indicating shake of the imaging device 100 to the system control unit 130 . The system control unit 130 can perform imager stabilization by controlling the imager stabilization control unit 109 based on the shake signal.

An I/F (interface) 120 performs communication using electrical signals between a system control unit 130 in the imaging device 100 and a lens control unit 160 in the lens device 150 via a connector 190 . Accordingly, the imaging device 100 transmits and receives information on the lens device 150 and control commands to the lens device 150 .

The system control unit 130 is an in-camera CPU that controls various aspects of the imaging apparatus 100 . The system control unit 130 controls the entire system including the lens device 150 and the imaging device 100 according to inputs from SW1, SW2, the memory control unit 105, the camera operation member 117, and the like.

The AF control unit 131 is installed in the system control unit 130 and controls AF processing. In AF processing, the focus lens driving amount is calculated from lens information such as the position and focal length of the focus lens 151 obtained from the lens device 150 via the I/F 120 and AF evaluation values obtained within the imaging device 100. . The focus lens drive amount is input to the lens device 150 via the lens communication control section 133 and the I/F 120 .

The AE control unit 132 is installed in the system control unit 130 and controls AE processing. In the AE process, the exposure control amount (aperture control of the aperture 153 amount, shutter control amount of the shutter 101, exposure sensitivity (gain of the image sensor 102), etc.). The obtained aperture control amount is input to the lens device 150 via the lens communication control section 133 and the I/F 120 . Also, the shutter control amount is input to the shutter control unit 110 and the exposure sensitivity is input to the image sensor 102 .

The lens communication control unit 133 is installed in the system control unit 130 and controls communication processing between the imaging device 100 and the lens device 150 . When it is detected that the lens device 150 is attached via the I/F 120, the imaging device 100 and the lens device 150 start communication. For example, when the imaging device 100 transmits an information request signal, the lens device 150 transmits lens information regarding the lens device 150 to the imaging device 100 according to the flow of FIG. 5 described later.

The imaging device 100 and the lens device 150 communicate at arbitrary timings, but may communicate at timings other than arbitrary timings based on imaging synchronization signals output from the timing generator 104 . In the imaging synchronization signal communication mode, when the imaging synchronization signal is input from the timing generation unit 104, the lens device 150 obtains necessary lens information (focus lens position, focus lens state, aperture state, focal point) in the imaging synchronization signal communication mode. distance, aberration variable amount, etc.) may be transmitted.

The optical correction control unit 134 reads data regarding optical aberration correction including design data and data regarding image magnification correction from the memory 107 according to the received lens information, and performs correction according to the shooting state of the lens apparatus 150 from the read information. Calculate the correction value. The calculated correction value is set in the image processing unit 140, and controls related to optical aberration correction such as image magnification correction, distortion aberration correction, magnification chromatic aberration correction, peripheral light amount correction, and image restoration processing are performed.

The image processing unit 140 performs image processing on the image data from the image generation unit 103 or the image data from the memory control unit 105 . Image data after image processing is stored in the memory 107 and the recording unit 108 via the memory control unit 105 . The image processor 140 includes a resizer 141 , an image magnification corrector 142 , a distortion aberration corrector 143 , a chromatic aberration of magnification corrector 144 , a peripheral light amount corrector 145 and an image restorer 146 .

Although the details of the image magnification correction process will be described later, the image magnification correction unit 142 performs the image magnification correction process. The distortion aberration correction unit 143 receives the distortion aberration correction data calculated by the optical correction control unit 134, and performs distortion aberration correction processing on the image data. The chromatic aberration of magnification correction unit 144 receives the correction data of the chromatic aberration of magnification calculated by the optical correction control unit 134, and performs correction processing of the chromatic aberration of magnification on the image data. The peripheral light amount correction unit 145 receives the peripheral light amount correction data calculated by the optical correction control unit 134, and performs peripheral light amount correction processing on the image data. The image restoration unit 146 receives correction data for image restoration processing calculated by the optical correction control unit 134, and performs image restoration processing on the image data.

The image processing unit 140 further performs predetermined pixel interpolation processing and color conversion processing to generate image data. The image processing unit 140 also performs predetermined arithmetic processing and the like using the digital image data.

Next, the configuration inside the lens device 150 will be described.
The focus lens 151 moves in the optical axis direction to change the matching position of the imaging optical system. The zoom lens 152 moves in the optical axis direction to change the focal length of the imaging optical system. The diaphragm 153 has a variable aperture diameter (aperture value), and changes the amount of light according to the aperture diameter. The shift lens 154 is moved in a plane orthogonal to the optical axis direction, thereby reducing image blur caused by camera shake such as camera shake.

The focus control section 155 is controlled by the lens control section 160 or the lens operation member 161 to drive the focus lens 151 . It also outputs focus information such as the position of the focus lens 151 to the lens control unit 160 .

The zoom controller 156 is controlled by the lens controller 160 or the lens operation member 161 to drive the zoom lens 152 . It also outputs zoom information such as focal length to the lens control unit 160 . It should be noted that the zoom lens 152 may be composed of a plurality of lenses, and an aberration variable lens for changing the amount of aberration may be further mounted. In that case, the variable aberration lens is controlled by the zoom control unit 156 and can change the amount of optical aberration by moving in the optical axis direction. The zoom control section 156 outputs information regarding the variable amount of aberration to the lens control section 160 .

A diaphragm controller 157 is controlled by a lens controller 160 or a lens operating member 161 to drive a diaphragm 153 . It also outputs aperture information such as aperture value to the lens control unit 160 .

The angular velocity detector 158 is controlled by the lens controller 160 to detect the angular velocity (Yaw, Pitch) of the lens and output it to the lens controller 160 .
The optical image stabilization control unit 159 is controlled by the lens control unit 160 and drives the shift lens 154 based on the lens angular velocity information from the angular velocity detection unit 158 and the shake information from the imaging device 100 . It also outputs the positional information of the shift lens 154 to the lens control section 160 .

The lens information storage unit 165 stores lens information regarding the lens device 150 , such as design data regarding optical aberration of the lens device 150 and design data regarding image magnification correction, and outputs the lens information to the lens control unit 160 .

The lens control unit 160 operates a focus control unit 155, a zoom control unit 156, an aperture control unit 157, an angular velocity detection unit 158, an optical anti-vibration control unit 159, and a lens information storage unit according to an input from the lens operation member 161 or the I/F 170. 165 or the like controls the entire lens device 150 . In addition, according to the lens information acquisition command received via the I/F 170, information input from each control unit, detection unit, etc. is transmitted to the imaging device 100 via the I/F 170. FIG.

The lens operation member 161 includes a focus driving range limiting switch, a focus operation ring, a zoom operation ring, an AF/MF switch, an anti-vibration ON/OFF switch, an aberration variable control ring, etc. Output. In addition, the lens control unit 160 transmits operation details to the imaging device 100 via the I/F 170 based on instructions input from the lens operation member 161 . The system control unit 130 receives user operation details via the I/F 120 and switches operation modes of various functions provided in the lens device 150 .

The I/F 170 performs electrical communication between the system control unit 130 in the imaging device 100 and the lens control unit 160 in the lens device 150 via the connector 190 . information, control instructions, etc.

Next, image magnification correction processing in the first embodiment will be described.
The image magnification correction process, which is also described in Patent Documents 1 and 2, is a process for correcting a change in the angle of view when the focus lens is driven. By performing the processing, the change in the angle of view is corrected. In the present embodiment, a series of image processing for image magnification correction can be performed by setting a field angle correction value for correcting field angle variation in the image magnification correction section 142 of the image processing section 140. It has become. Further, a reference angle of view is predetermined, and the angle of view is corrected according to the position of the focus lens so as to achieve the reference angle of view.

Next, a method for calculating the field angle correction value will be described.
The system control unit 130 calculates a field angle correction value by referring to information on image magnification correction, information on the lens device 150, and information on the imaging device 100, which will be described later.

Information related to image magnification correction includes an image magnification correction enlargement rate for correcting a change in angle of view according to the position of the focus lens, a base magnification as a reference for the magnification rate, and a maximum magnification rate for limiting the maximum magnification rate. It changes according to the focal length, aberration variable amount, and focus drive range. Information on image magnification correction suitable for the lens device 150 is stored in the lens information storage unit 165 of the lens device 150 . It should be noted that other types of information may be used instead of the image-magnification correction magnification ratio. , the image magnification correction magnification can be easily obtained. The system control unit 130 communicates with the lens control unit 160 and stores information regarding image magnification correction in the memory 107 within the imaging apparatus 100 .

The system control unit 130 communicates information related to the lens device 150, such as focus lens position information, focal length information, and focus driving range of the lens device 150, with the lens control unit 160 at arbitrary timing and/or timing synchronized with the imaging frame. to get it.
The system control unit 130 also acquires information on shutter control and information on the imaging apparatus 100 such as shooting conditions specified by the user through the camera operation member 117 .
The optical correction control unit 134 calculates a field angle correction value from the information thus obtained.

Here, the information regarding the image magnification correction of the lens apparatus will be described in detail with reference to FIGS. 2 and 3. FIG.
FIG. 2 is a diagram showing an example of the relationship between the position of the focus lens 151 and the image magnification correction magnification ratio. For easy understanding, the horizontal axis indicates the focal distance converted from the position of the focus lens 151, and the vertical axis indicates the image magnification correction magnification ratio.

A solid line 201 indicates an example of the relationship between the focal distance and the image magnification correction magnification ratio. Assuming that the image magnification correction rate is 100% when the subject at the position of 100.3 m from the imaging device is in focus, the image magnification correction rate is 130% when the subject at the position of 0.5 m is in focus, and at infinity. The image magnification correction rate is 150% when an object at the position is in focus. By setting the image magnification correction enlargement ratio indicated by the solid line as the field angle correction value in the image magnification correction unit, it is possible to perform image magnification correction processing for correcting the field angle fluctuation when the focal length changes. The relationship indicated by the solid line 201 changes according to the focal length and the variable amount of aberration. The relationship between the focal length and the image magnification correction enlargement ratio corresponding to the focal length and the variable amount of aberration is stored in the lens information storage unit 165 of the lens device 150 .

FIG. 3 is a diagram showing an example of the relationship between the focal length and the image magnification correction enlargement ratio when the base magnification and maximum enlargement ratio for image magnification correction are set, and is indicated by a solid line 301 . A dotted line 302 indicates that the image magnification correction enlargement ratio when the focal distance is closer than 0.3 m is set to a base magnification of 100% (reference angle of view). A dotted line 303 indicates that the maximum magnification of 150% is the image magnification correction magnification when the focal length is infinite. Although the image magnification correction magnification ratio is limited between the base magnification ratio 302 and the maximum magnification ratio 303 according to the focusing distance, the image magnification correction can be performed from the closest focusing distance to the infinite focusing distance.

2 and 3 show the case where the image magnification correction rate is 100% (reference angle of view) when an object at a position of 0.3 m is in focus, but the reference position is 0. It is not limited to .3m. For example, if the image magnification correction rate is 100% (reference angle of view) when a subject at infinity is in focus, the image magnification correction rate is about 87 when a subject at a distance of 0.5 m is in focus. %, and the image magnification correction rate when a subject at a position of 0.3 m is in focus is about 67%. In this way, the matching distance at which the image magnification correction rate is 100% (reference angle of view) can be set as appropriate.

In the following, an example in which the relationship between the focal length and the image magnification correction enlargement ratio in the camera lens system of the present embodiment is indicated by the solid line 301 in FIG. 3 will be described. A method for determining whether or not there is an angle change will be described.

When the image magnification correction enlargement ratio is 100%, that is, when the current focus position is in the range of 0.3 m from the closest distance, the image magnification correction processing does not perform the enlargement processing. It is determined that the angle of view does not change. On the other hand, when the image magnification correction magnification rate is not 100%, that is, when the focus position is in the range from 0.3 m to infinity, the image magnification correction processing executes the enlargement processing. It is determined that the angle of view changes when the camera stops.

Next, the operation at the time of photographing in this embodiment will be described with reference to the flowchart of FIG. Here, it is assumed that image magnification correction processing is started at the start of photographing.

First, in S<b>401 , when lens communication becomes possible, such as when the user turns on the power of the imaging apparatus 100 or attaches the lens apparatus 150 , information on image magnification correction stored in the lens apparatus 150 is displayed. is acquired and stored in the memory 107 . In addition, information on the shutter control described above and information on the imaging apparatus 100 such as shooting conditions are acquired and stored in the memory 107 .

In S402, the system control unit 130 starts shooting when the imaging device 102 becomes ready for shooting and detects that the user has operated SW1/SW2 or the moving image recording start button. In S403, the system control unit 130 performs exposure control (AE), automatic focus detection control (AF), and the like. In S404, the system control unit 130 controls the shutter control unit 110 and the image pickup device 102 to store and read charges according to the amount of incident light, the image generation unit 103 generates image data, and the memory control unit Photographing is performed via 105 to be stored in the memory 107 .

In S405, the system control unit 130 acquires shooting information of the lens device 150 when shooting was performed in S404. Note that the shooting information acquired here includes information on the focal length and focal length (or the position of the focus lens) necessary for correcting the image magnification, and the variable amount of aberration.

In S<b>406 , a field angle correction value is calculated from the information about the image magnification correction enlargement ratio and the information about the imaging apparatus 100 obtained in S<b>401 and the information about the imaging condition obtained in S<b>405 , and set in the image magnification correction unit 142 .

In S407, based on the field angle correction value calculated in S406, it is determined whether or not there is a change in the field angle when the image magnification correction process is started and stopped. If it is determined that the field angle will change, the user is notified.

FIG. 5 is a diagram showing an example of notification. A display screen 501 of the image display unit 106 is shown, and an image captured by the camera lens system is displayed. A warning display 502 is displayed in the display screen 501 when it is determined that the angle of view will change when the image magnification correction process is activated or stopped. By checking this display, the user can recognize whether or not there is a change in the angle of view that occurs when the image magnification correction process is activated and stopped. Note that this warning display is only an example, and notification can be made by various methods such as display in a different shape, notification by sound, LED, or the like.

In S408, the ON/OFF state of the image magnification correction by the image magnification correction ON/OFF button 117a is determined, and if the image magnification correction is ON, the process proceeds to S409. In S409, the system control unit 130 controls the image processing unit 140, performs image processing including image magnification correction processing on the image data acquired in S404, and stores the corrected image data in the memory 107 and/or Record in the recording unit 108 .

On the other hand, if it is determined in S408 that the image magnification correction is OFF, the process advances to S410 to perform image processing that does not include image magnification correction processing on the image data acquired in S404. and/or recorded in the recording unit 108 .

In S411, if the user has issued an instruction to end shooting, the process ends. If the shooting instruction continues, the process returns to S403 to continue shooting. During moving image shooting, a series of continuously recorded images are converted into moving images and recorded in the recording unit 108 .

In the example shown in FIG. 4, it is assumed that after shooting is started in S402, it is determined in S407 whether or not there is a change in the angle of view when the image magnification correction process is activated and stopped, but the timing of determination is limited to this. It is not something that can be performed, and it may be performed during live view before the start of shooting. In this case, the user can decide whether or not to perform the image magnification correction process based on the determination result before the start of shooting. Also in this case, the user can instruct activation and termination of the image magnification correction process during shooting according to the determination result in S407.

As described above, according to the first embodiment, it is possible to determine whether or not there is a change in the angle of view that occurs when the image magnification correction process for eliminating the change in the angle of view caused by focusing is activated and stopped.

In addition, since the user can instruct activation and termination of the image magnification correction process depending on whether or not there is a change in the angle of view that occurs when the determined image magnification correction process is activated and stopped, an unintended It is possible to prevent the angle of view from changing.

<Modification>
If the image magnification correction process is activated and stopped under shooting conditions that are determined to cause a change in the angle of view when the image magnification correction process is activated and stopped, the angle of view will change, so the view angle will be displayed. This appears on the screen 501, and the display quality of the image is degraded. Therefore, if it is determined that the angle of view will change when the image magnification correction process is activated and stopped, immediately after the image magnification correction process is activated and stopped, the screen display unit is darkened for a certain period of time, and then the image magnification is changed again. Display the image after the correction process is activated and stopped. This prevents the switching of the angle of view from appearing directly on the display screen 501, thereby preventing deterioration in display quality.

<Second embodiment>
Next, a second embodiment of the invention will be described. Note that the configuration of the camera lens system in the second embodiment is the same as that shown in FIG. 1, so the description is omitted here.

In the second embodiment, a method of reducing the change in the angle of view that accompanies the image magnification correction process even when it is determined that the angle of view has changed will be described. In the second embodiment, it is assumed that the optical zoom position of the lens device 150 can be changed to any position.

The reason why the angle of view changes when it is determined that there is a change in the angle of view is that the image is trimmed after the image is enlarged according to the image magnification correction enlargement ratio in the image magnification correction process. Therefore, in the second embodiment, optical zooming is performed using the zoom lens 152 so as to cancel the change in the angle of view due to the image magnification correction process. To reduce the change in angle of view after image magnification correction.

A method of obtaining the optical zoom amount for canceling out the change in the angle of view will be described. Here, S1 is the angle of view while the image magnification correction process is stopped, S2 is the angle of view while the image magnification correction process is being activated, Z1 is the focal length while the image magnification correction process is being stopped, and Z1 is the focal length while the image magnification correction process is being activated. Let Z2 be the focal length, and α be the image magnification correction enlargement factor.

At this time, the angle of view S1 at which the image magnification correction process is stopped and the angle of view S2 at which the image magnification correction process is being activated can be obtained by equations (1) and (2), respectively.
S1=Z1×1/α (1)
S2=Z2×α (2)
If S1=S2, the angle of view does not change when the image magnification correction process is activated and stopped.

Here, since Z1 and α are known when the image magnification correction process is activated, by obtaining Z2 that satisfies S1=S2, the focal length that offsets the change in the angle of view due to the activation of the image magnification correction process can be obtained. can be done. Similarly, when the image magnification correction process is stopped, since Z2 and α are known, by obtaining Z1 satisfying S1=S2, it is possible to obtain the focal length that cancels out the change in the angle of view due to the stop of the image magnification correction process. can.

A change in the angle of view can be reduced by optically zooming to the focal length obtained in this way when the image magnification correction process is activated and stopped.

Further, by holding the focal length information before the optical zooming (before the change), it is possible to return to the state before the optical zooming after the automatic optical zooming.

However, when the shooting condition is near the zoom end of the zoom lens 152, the optical zoom cannot reach the focal length necessary to cancel out the change in the angle of view. It may not be possible to offset. In such a case, the user can correct the image magnification by emphasizing the focal length, as indicated by 602, on the display screen 601 of the image display unit 106 shown in FIG. It can be recognized that the angle of view changes before the process is started and stopped.

As described above, according to the second embodiment, it is possible to reduce the change in the angle of view when the image magnification correction process is activated and stopped.

<Other embodiments>
The present invention may be applied to a system composed of a plurality of devices (e.g., lens unit, camera body, etc.) or applied to a device composed of a single device (e.g., lens-integrated camera, etc.). good.

Further, the present invention supplies a program that implements one or more functions of the above-described embodiments to a system or device via a network or a storage medium, and one or more processors in the computer of the system or device executes the program. It can also be realized by a process of reading and executing. It can also be implemented by a circuit (for example, ASIC) that implements one or more functions.

The invention is not limited to the embodiments described above, and various modifications and variations are possible without departing from the spirit and scope of the invention. Accordingly, the claims are appended to make public the scope of the invention.

100: imaging device, 102: imaging element, 117: camera operation member, 117a: image magnification correction ON/OFF switch, 130: system control unit, 140: image processing unit, 142: image magnification correction unit, 150: lens device, 151: focus lens, 152: zoom lens/aberration amount variable lens, 160: lens control unit, 161: lens operation unit, 165: lens information storage unit

Claims (12)

storage means for storing first information relating to image magnification correction of the lens device;
a first acquisition means for acquiring second information about the lens device, including the position and focal length of the focus lens;
a second acquiring means for acquiring imaging conditions;
calculation means for calculating a field angle correction value for correcting a change in the field angle accompanying a change in the position of the focus lens, based on the first information, the second information, and the shooting conditions;
image processing means for performing correction processing for correcting image data obtained by photographing using the photographing conditions with the field angle correction value;
determination means for determining, based on the first information and the second information, whether or not a change in angle of view occurs when the correction processing by the image processing means is started and stopped. image processing device. The first information is information indicating an enlargement ratio of an angle of view at a plurality of matching distances with respect to an angle of view at a predetermined focusing distance,
The determination means determines whether the correction process by the image processing means is performed when the matching distance based on the position of the focus lens of the lens device is not the predetermined matching distance in the first information of the lens device. 2. The image processing apparatus according to claim 1, wherein it is determined that a change in angle of view occurs when starting and stopping. 3. The image according to claim 1, further comprising notification means for notifying a result of said determination when said determination means determines that a change in angle of view occurs when said correction processing is activated and stopped. processing equipment. An image is not displayed on the display means when the correction process is activated and stopped when the determining means determines that a change in angle of view occurs when the correction process is activated and stopped. Item 4. The image processing apparatus according to item 3. The lens device has zoom means for changing the focal length,
The image processing device changes the focal length to reduce the change in the angle of view when the determination means determines that the change in the angle of view occurs when the correction processing is activated and stopped. 3. The image processing apparatus according to claim 1, further comprising control means for controlling the a range of the focal length of the zooming means in which the focal length cannot be changed to reduce the change in the angle of view when the determination means determines that the change in the angle of view occurs when the correction processing is activated and stopped; 6. The image processing apparatus according to claim 5, further comprising notifying means for notifying. 7. The image processing apparatus according to claim 5, wherein when the focal length is changed, the storage means further stores the focal length before the change. 8. The image processing apparatus according to claim 1, wherein said first obtaining means further obtains said first information from said lens device. An image processing device according to any one of claims 1 to 8;
and an imaging device that performs imaging according to the imaging conditions and outputs image data. a storage step of storing first information relating to image magnification correction of the lens device in a storage means;
a first acquiring step of acquiring second information about the lens device, including the position and focal length of the focus lens;
a second acquisition step of acquiring imaging conditions;
a calculation step of obtaining a field angle correction value for correcting a change in the field angle accompanying a change in the position of the focus lens, based on the first information, the second information, and the shooting conditions;
an image processing step of performing a correction process of correcting image data obtained by photographing using the photographing conditions with the field angle correction value;
a determination step of determining, based on the first information and the second information, whether or not a change in angle of view occurs when the correction processing in the image processing step is activated and stopped. image processing method. A program for causing a computer to function as each means of the image processing apparatus according to any one of claims 1 to 8. A computer-readable storage medium storing the program according to claim 11 .

Images