JP6506440B2 - Imaging device, imaging method, and program - Google Patents

Description

  The present invention relates to an imaging device, and more particularly, to an imaging device, an imaging method, and a program capable of performing image processing that provides the same effect as so-called tilt imaging.

  At the time of shooting, the composition is determined in consideration of the horizontal line, but it is difficult to grasp the relationship between the subject and the horizontal line. Therefore, Patent Document 1 includes a detection unit that detects the attitude of the camera, and a display control unit that displays a grid-like pattern that indicates the degree of inclination in the horizontal direction and the degree of inclination in the elevation angle direction of the imaging optical system. There is disclosed a camera in which the posture of the camera can be known and the leveling can be easily performed by erasing the straight line in the vertical direction of the lattice pattern when the horizontal direction coincides with the horizontal direction of the actual shooting screen. .

  In addition, when a picture is taken looking up at a building etc., even if it is a square-shaped building, it is reflected in a trapezoidal shape. That is, the difference in the distance to the subject causes distortion in the shape of the subject. Therefore, in such a case, it is known to perform tilt shooting to eliminate distortion of the subject. Aberration photographing refers to photographing in which the optical axis of the lens of the camera and the photosensitive surface (imaging surface) of the film (imaging element) are consciously shifted or inclined. A dedicated lens barrel or the like is required for this aerial photography.

  In addition, in an imaging apparatus such as a digital camera or the like, when performing focus adjustment by AF, the AF point is set automatically or manually so that the AF point is in focus. After setting the AF point and detecting the focus, if the angle of view is changed by switching the aspect of the shooting screen, the AF point may be out of the angle of view. In this case, the AF point outside the angle of view is invalidated and a new AF point is set.

  There are also imaging devices such as digital cameras that enable enlarged display of a subject image during live view display in order to check the state of focusing.

Patent No. 3896505 gazette

  As described above, the film camera is a film camera and requires special equipment. However, an image pickup apparatus such as a digital camera performs the same image processing as that of the tilt photographing by image processing or the like. Is possible. However, tilt shooting is not effective for all subjects, and there are subjects in which the effect of tilt shooting tends to appear, and subjects in which it is difficult to appear. Even if a general photographer does not know when to take a skewed image, even if image processing equivalent to skewed shooting can be performed, this image processing (hereinafter, this image processing Processing) or “shift correction processing” can not be effectively used.

  In addition, when the tilt correction process is performed, the AF point may be out of the corrected image as a result of the correction process. In general, in many cases, the camera is fixed with a tripod or the like, and in this case, it is inconvenient because it is necessary to change the shift amount or change the cutout position in order to change the composition.

  In addition, when the tilt correction process is performed, enlarged display may be performed for confirmation of focus. In this case, since the resolution of the image is lowered due to the tilt correction processing, and the enlarged display is further performed, the resolution of the image is significantly lowered.

The present invention has been made in view of such circumstances, and as a result of tilt correction processing, an imaging apparatus, an imaging method, and a program that do not need to change the composition even when the AF point deviates from the corrected image. It shall be the purpose of providing.

An imaging apparatus according to a first aspect of the present invention for achieving the above object comprises an imaging section for photoelectrically converting an object image and outputting image data, an image display section for displaying the object image based on the image data, and The image of the subject is displayed on the image display unit based on an image processing unit that performs shift correction on data, an AF point selection unit that selects an AF point on the subject, and the image data on which the shift correction has been performed. When displaying, if the AF point selected by the AF point selection unit is outside the image display unit, the shift correction is performed so that the AF point is inside the image display unit And a control unit that moves the display position of the image data .

An imaging apparatus according to a second aspect of the present invention is the imaging device according to the first aspect, further including a first operation unit for setting a shift correction amount at the time of the shift correction. The shift correction is performed on the image data based on the shift correction amount set by the operation unit.
An imaging apparatus according to a third aspect of the present invention is the imaging apparatus according to the first aspect, further including a second operation unit for setting the cutout position of the image subjected to the shift correction. Based on the cutout position set by the operation unit, the image data is cut out from the image on which the shift correction is performed.
The imaging device according to a fourth aspect of the present invention is the imaging device according to the first aspect, wherein a part of the shift image on which the shift correction has been performed by the image processing portion is displayed on the image display portion.

An imaging method according to a fifth aspect of the invention photoelectrically converts an object image and outputs image data, displays the object image on an image display unit based on the image data, and performs shift correction on the image data. When the AF point is selected for the subject and the subject image is displayed on the image display unit based on the image data subjected to the shift correction, the selected AF point is outside the image display unit In the case where the image data is present, the display position of the image data subjected to the shift correction is moved so that the AF point is inside the image display unit .

A program according to a sixth aspect of the present invention photoelectrically converts an object image and outputs image data to a computer provided in an imaging device, and displays the object image on an image display unit based on the image data. The shift correction is performed on the subject, the AF point is selected for the subject, and the AF selected when displaying the subject image on the image display unit based on the image data subjected to the shift correction. When the point is outside the image display unit, the display position of the image data subjected to the shift correction is moved so that the AF point is inside the image display unit .

According to the present invention, the result of tilt correction, Ru can AF points provide unnecessary imaging device to change the composition even when deviated from the corrected image.

FIG. 1 is a block diagram mainly showing an electrical configuration of a camera according to an embodiment of the present invention. In the camera concerning one embodiment of the present invention, it is a figure showing the display picture at the time of performing shift amendment processing. The camera which concerns on one Embodiment of this invention WHEREIN: It is a figure which shows the relationship between shift operation and a display image. It is a flowchart which shows operation | movement of the camera which concerns on one Embodiment of this invention. It is a flowchart which shows operation | movement of the shift assist of the camera in one Embodiment of this invention. It is a flowchart which shows operation | movement of the correction effect determination of the camera in one Embodiment of this invention. It is a flow chart which shows operation of shift operation of a camera concerning one embodiment of the present invention. In the camera concerning one embodiment of the present invention, it is a figure showing the example of the advice of shift amendment. In the camera concerning one embodiment of the present invention, it is a chart showing the range of the amendment angle at the time of focal length change. FIG. 10 is a view showing AF point display of AF when shift correction processing is performed in the camera according to the embodiment of the present invention. In the camera concerning one embodiment of the present invention, it is a flow chart which shows operation of AF under shift. In the camera concerning one embodiment of the present invention, it is a figure showing the enlargement display at the time of performing shift amendment during live view display. In the camera concerning one embodiment of the present invention, it is a flow chart which shows operation of live view display.

  Hereinafter, an example applied to a digital camera as an embodiment of the present invention will be described. This digital camera has an imaging unit, converts an object image into image data by the imaging unit, and displays live view on a display unit in which the object image is disposed on the back of the main body or the like based on the converted image data. Do. The photographer determines the composition and the shutter chance by observing the live view display. At the time of release operation, image data is recorded on a recording medium.

  In addition, in the camera according to the present embodiment, when the shift correction mode (mode for performing image processing to give the same effect as tilt shooting) is set, an image in which the distortion of the object is removed according to the shift correction operation is displayed. When displayed on the unit and a release operation is performed, image data from which distortion of the subject has been removed is recorded. When the shift correction mode is not set, if the effect of shift correction appears during live view display, assist display is performed.

  FIG. 1 is a block diagram mainly showing an electrical configuration of a camera according to an embodiment of the present invention. This camera comprises a camera body 200, a lens unit 100 which can be detached therefrom, and a monitor 300 provided on the camera body 200. In the present embodiment, although the lens unit 100 is of the interchangeable lens type, the present invention is not limited to this, and it may be a digital camera of a type in which the lens unit is fixed to the camera body 200. Further, although the lens unit 100 can communicate between the camera body 200, a lens having no communication function may be mounted.

  In the lens unit 100, a photographing lens group 101, an aperture 103, a focus ring 105, a zoom ring 107, a lens position detection unit 111, a lens drive unit 113, an aperture control unit 115, a rotation detection unit 117, and a lens control unit 119 are provided. It is done.

  The photographing lens group 101 is composed of a plurality of optical lenses for forming an object image, and is capable of zooming (focal length change) and focusing (focus change). A diaphragm 103 is disposed at the rear of the photographing lens group 101 on the optical axis. The aperture 103 has a variable aperture diameter, and controls the light amount of the subject light flux that has passed through the photographing lens group 101. The aperture control unit 113 performs drive control of the aperture diameter of the aperture 103 in accordance with instructions from the camera body control unit 210 and the lens control unit 119.

  A rotatable zoom ring 105 and a focus ring 107 are provided on the outer periphery of the lens unit 100. The rotation detection unit 117 detects the rotation direction and the rotation amount of the zoom ring 105 and the focus ring 107, respectively, and outputs the rotation direction and the rotation amount to the lens control unit 119 and the like. The lens driving unit 113 moves the focus lens and the zoom lens of the photographing lens group 101 along the optical axis direction.

  The lens position detection unit 111 can detect the position of the lens of the photographing lens group 101. In this case, the position of the focus lens and the position of the zoom lens are detected, and transmitted to the camera body control unit 210 via the lens control unit 119.

  The lens control unit 119 controls the inside of the lens unit 100 in accordance with an instruction from the camera body control unit 210 in accordance with a program stored in a memory (not shown) provided in the lens unit 100. In addition, the lens control unit 119 changes the focal length according to the rotation of the zoom ring 105, and changes the focal position according to the rotation of the focus ring 107. The lens group 101 is driven. When the camera body 200 is set to the auto focus (AF) mode, the imaging lens group 101 is driven via the lens driving unit 113 in accordance with an instruction from the camera body control unit 210. In addition, the detection result of the lens position detection unit 111 is transmitted in response to a request from the camera body control unit 210.

  The shutter 201 provided in the camera body 200 is disposed on the optical axis of the photographing lens group 101 and on the front side of the imaging element 203. The shutter 201 controls the passage time of the subject light flux, and in the present embodiment, a known focal plane shutter is adopted. The focal plane shutter has a front curtain and a rear curtain and is normally open. A subject luminous flux that has passed through the taking lens group 101 and the aperture 103 passes through the shutter 201 in the open state and is guided to the image sensor 203. Then, in response to a photographing instruction, the front curtain is once closed and then opened again, and when the manually set or automatically set exposure time has elapsed, the rear curtain is closed. The exposure time is controlled by the shutter control unit 219.

  The imaging device 203 includes an image sensor such as a CCD image sensor or a C-MOS image sensor, and is controlled by the imaging control unit 213. In the image sensor, photodiodes constituting each pixel are two-dimensionally arranged in a matrix, each photodiode generates a photoelectric conversion current according to the amount of light received, and this photoelectric conversion current is connected to each photodiode Charge is accumulated by the capacitor. A Bayer-array RGB filter is disposed in front of each pixel. The imaging device 203 also has an A / D converter that converts an analog voltage based on the charge stored in the capacitor into a digital signal, and outputs a digital image signal corresponding to each pixel to the imaging control unit 213. The imaging element 203 functions as an imaging unit that photoelectrically converts an object image and outputs image data.

  The imaging control unit 213 controls an imaging operation by the imaging element 203 according to an instruction of the camera body control unit 210. That is, exposure control by the image sensor 203 and readout control of the image signal are performed, and the read digital image signal is output to the bus 237. In addition to the imaging control unit 213 described above, the AF auxiliary light 211, the shake / posture detection unit 215, the shake correction control unit 217, the shutter control unit 219, the AF control unit 221, the camera body control unit 210, and the memory 223 An image processing unit 225, a face detection unit 227, an exposure control unit 229, a display control unit 231, and an operation member detection 233 are connected.

  The image processing unit 225 processes the image data of the subject from the imaging device 203 and the imaging control unit 213, and generates image data for live view display on the finder monitor. Further, image data for storage is generated at the time of shooting, and moving image data is generated at the time of moving image shooting. In the present embodiment, an external memory (not shown) such as an SD card for storing storage image data and moving image data is provided, and is connected to the bus 237 via an I / F. The storage image data and moving image data generated by the image processing unit 225 are recorded in the external memory. Further, at the time of reproduction, the image processing unit 225 generates image data for reproducing and displaying the image data recorded in the memory on the finder monitor.

  Further, when the shift correction mode is set, the image processing unit 225 performs shift correction processing, which is image processing for making an image equivalent to tilt shooting, on the image data, and adjusts the distance of the object distance. Image data from which distortion based on the difference between This shift correction process is performed, for example, by changing the magnification of the length in the horizontal direction according to the distance from the bottom of the screen, with the vertical line in the screen as the center, and with the horizontal line of the screen as the center, This is performed by changing the magnification of the length in the vertical direction according to the distance from the left side or the right side of the screen. Of course, processing may be performed centering on the diagonal line in the screen. The image processing unit 225 functions as an image processing unit that performs shift correction on the image data.

  The image processing unit 225 also detects oblique lines in the subject image based on the image data. The shift correction determination is performed using this oblique line detection. Further, the image processing unit 225 performs enlargement processing on the image data in order to magnify and display the image displayed on the display unit 301 for confirmation of focus.

  The shake correction mechanism 205 has an actuator such as a motor, shifts the imaging device 203 in a two-dimensional direction, and rotates the imaging device 203 in a plane perpendicular to the optical axis of the imaging lens group 101. There is.

  The shake / posture detection unit 215 includes an angle sensor, an acceleration sensor, and the like, detects camera shake, vertical and horizontal attitude, tilt angle, and the like, and outputs a shake detection signal. The shake / posture detection unit 215 functions as an inclination detection unit that detects the inclination of the imaging device. The shake correction control unit 217 causes the shake correction mechanism 205 to perform shift drive and rotational drive based on the shake detection signal from the shake / posture detection unit 215. By this shake correction operation, even if the camera body shakes, the image formed on the image sensor 203 does not shake.

  In the present embodiment, the AF control unit 221 adjusts the focus of the imaging lens group 101 by so-called contrast AF. That is, the contrast evaluation value is detected from the image data from the imaging element 203 and the imaging control unit 213, and the lens control unit is positioned such that the focus lens of the imaging lens group 101 becomes the focus lens position corresponding to the peak position of the contrast evaluation value. 119, drive control is performed via the lens drive unit 113. In addition, as AF, you may carry out not only a contrast method but other methods, such as a phase difference method, for example.

  The AF auxiliary light 211 projects auxiliary light onto the subject in order to assist focus detection at low luminance in accordance with an instruction from the AF control unit 221. In addition, the AF auxiliary light 211 notifies the photographer who has left the camera of the operation state of the self-timer by lighting up and changing the blinking cycle at the time of lighting up. In this notification, it is also possible to adjust the amount of light by means of a current limiting circuit (or by adjusting the amount of light controlled by duty drive).

  The face detection unit 227 uses the image data from the imaging element 203 and the imaging control unit 213 to detect whether a face is included in the image. That is, the image data is compared with a predetermined face pattern to detect the face of the subject. In addition, when the face of the subject is detected, the position and size thereof are detected, and further, organs such as eyes and mouth are also detected by analyzing the detected face area.

  The exposure control unit 229 extracts subject brightness information based on image data from the imaging device 203 according to the mode setting of the camera, and based on the subject brightness information, an aperture, shutter speed, sensitivity, etc. for obtaining a proper exposure. Calculate the exposure control value. In calculating the proper exposure amount, the face detection information by the face detection unit 227 is used, and the flash emission amount is also calculated as necessary. The camera body control unit 210 controls the diaphragm 103 via the lens control unit 119 based on the calculated exposure control value, and controls the shutter 201 via the shutter control unit 219, whereby the appropriate subject light is obtained. It leads to the image sensor 203 with an appropriate exposure time.

  The memory 223 includes an electrically rewritable volatile memory and a non-volatile memory. The memory 223 is capable of programs and control data for controlling the entire camera, and is also used as a buffer for writing and reading data to an external memory (not shown) such as an SD card. The memory 223 also stores a table showing the relationship between the focal length and the correction angle shown in FIG. 9 described later.

  The display control unit 231 performs display control for displaying a live view image and a reproduced image on a monitor finder. Further, the display control unit 231 superimposes and displays setting information of the camera, exposure information, and OSD (On Screen Display) information such as shift assist display described later on the image.

  The operation member 235 is a member operable by the camera user, and includes a shutter button, a cross button 235c (see FIG. 3), a mode dial, a front dial 235b (see FIG. 3), a rear dial 235a (see FIG. 3), and a shift button. , Enlargement button etc. The shutter button is a two-stage type that can distinguish between half pressing and full pressing of the shutter button. The cross button is disposed on the back of the camera body or the like, and is provided with buttons for instructing four directions, up, down, left, and right, and can move the position of the cursor or icon displayed on the monitor.

  A mode dial in the operation member 235 sets various modes such as a photographing mode and a shift correction mode. The various modes can be set on a menu screen or the like displayed on the monitor as well as the mode dial. The front dial is provided on the upper side of the camera body, and can be rotated by a photographer with a finger from the front side of the camera (the side on which the lens unit 100 is disposed). The rear dial is provided on the upper side of the camera body, and can be rotated by a photographer with a finger from the rear side (opposite to the front) of the camera.

  The shift button is an operation button for setting the shift correction mode, and setting and release of the shift correction mode are alternately performed each time the shift button is operated. The enlargement button is an operation button for instructing the user to magnify and display a part of the image displayed on the display unit 301 in order to confirm the focus state.

  The operation member detection unit 233 detects the operation state of the operation member 235 and outputs the detection result to the camera body control unit 210. The camera body control unit 210 controls the camera according to the detection result of the operation state.

  The camera body control unit 210 has a CPU and the like, and controls each unit according to a program stored in the memory 223 to control the entire camera. In addition, the camera body control unit 210 functions as a determination unit that determines whether shift correction by the image processing unit is effective or not based on the inclination detected by the inclination detection unit (S37 in FIG. 5 and FIG. reference). The camera body control unit 210 also functions as an assist display control unit that performs assist display on the image display unit when the determination unit determines that the shift correction is valid (S41 in FIG. 5 described later). The camera body control unit 210 also functions as a focal distance information acquisition unit for acquiring focal distance information of the photographing lens (S1 in FIG. 4 and S31 to S35 in FIG. 5 described later).

  In addition, the camera body control unit 210 functions as an AF point selection unit that selects an AF point with respect to the subject (see S101 and the like in FIG. 11). Further, when displaying the subject image on the image display unit based on the image data subjected to the shift correction, the camera body control unit 210 causes the AF point selected by the AF point selection unit to be outside the image display unit. In some cases, it functions as a notification unit that notifies that it is on the outside (refer to S107 and the like in FIG. 10 and FIG. 11 described later).

  Further, when an image subjected to shift correction by the image processing unit is displayed on the image display unit, the camera body control unit 210 instructs the enlargement display unit to be performed by the enlargement instruction unit (enlargement button). The image data not subjected to shift correction is subjected to processing for enlargement display, and functions as an enlargement display control unit for enlargement display on the image display unit (see S129 in FIG. 12 and FIG. 13 described later).

  The monitor 300 is rotatably connected to the camera body 200 in the vertical direction and the like by a hinge or the like, and displays a live view image, a reproduced image, and other information images. The rotational state of the monitor 300 is detected by the monitor angle detection unit 310 and output to the camera body 200. The detection of the state of the monitor 300 includes at least the position stored in the camera body 200, the rotation direction (up and down), and the rotation angle. In the present embodiment, a pulse signal is generated while the monitor 300 is rotating.

  The display unit 301 in the monitor 300 includes a liquid crystal panel, an OLED (organic EL) panel, and the like, and the touch panel 303 is disposed on the front side of the display unit 301. The display unit 301 functions as an image display unit that displays the subject image based on image data.

  The touch panel 303 can detect a user's touch, for example, by a change in capacitance, and can execute an AF operation, a shutter operation, or the like according to a touch operation. Also, shift correction and movement of the image cutout position can be performed according to the position on the display unit 301 where the touch operation is performed and the operation such as the slide direction, pinch out, and pinch in. Note that pinch out refers to an operation of touching two fingers on the screen and then spreading the fingers, and pinch in refers to an operation of narrowing two fingers (operation of moving the operation target).

  Position detection unit 307 detects the state of monitor angle detection unit 310, and outputs the detection result to camera body control unit 210. The touch panel control unit 305 detects a touch position on the touch panel 303 and outputs the detected touch position to the camera body control unit 210.

  Next, a display image on the display unit 301 when shift correction is performed will be described using FIG. Since the appearance changes depending on the focal length of the taking lens group 101, FIG. 2 shows the case of short focus (WIDE) (upper stage) and the case of long focus (TELE) (lower stage). Images 10 and 20 shown in the leftmost column show images on imaging. The captured image is an image formed on the image sensor 203 by the imaging lens group 101. When the building is viewed from the bottom, even if it is essentially rectangular, the top of the building narrows because it is farther than the camera, and as shown in FIG. 2, it has a trapezoidal shape whose upper side is shorter than its base. As apparent from FIG. 2, the short focus case has a more distorted shape.

  In FIG. 2, images 12 and 22 shown in the second column from the left side show an image when the image processing unit 225 performs shift correction processing. In this shift correction process, image processing is performed such that the left and right become longer as it goes upward on the screen. For this reason, the to-be-photographed object image which was trapezoidal shape becomes an original rectangle. By performing the shift correction processing in this manner, distortion of the subject image is removed, and the original shape as seen from the front of the subject is obtained.

  In FIG. 2, images 14 a, 14 b, 24 a, 24 b shown in the third column from the left side show shift images to be displayed on the display unit 301 in live view. The image processing unit 225 performs shift correction on all the images, but the image display unit 301 displays a part of the shift image on which the shift correction has been performed.

  In live view display, the user can appropriately select the cutout position from the shift correction image as described later with reference to FIG. The images 14a and 24a are images obtained by cutting the upper part from the shift images 12 and 22, the images 14b and 24b are images obtained by cutting the lower part from the shift images 12 and 22, and these images are It is a first example of an image recorded in an external memory. These images 14a, 14b, 24a, 24b may be stored in an external memory.

  Images 16 and 26 shown in the fourth column (rightmost column) from the left in FIG. 2 are a second example of the images recorded in the external memory. In the images 16 and 26, white portions 16a and 26a are images generated by the shifted images 12 and 22, respectively. In addition, since the black parts 16b and 26b do not have image data at the time of shift correction, they are black. Further, the entire images 16 c and 26 c (images inside the broken line) indicate portions of the images 10 and 20 subjected to shift correction processing, which are displayed in live view.

  Next, the relationship between the shift operation and the display image will be described using FIG. In the present embodiment, when the shift button in the operation member 235 is operated, the shift correction mode is set, and the subject image subjected to the shift correction is displayed on the display unit 301. In FIG. 3, an image 30C before correction is a display image on the display unit 301, and is an original image before shift correction.

  When the user rotates the rear dial 235a while the shift correction mode is set, the image processing unit 225 generates an image in which the correction amount of the shift correction is changed according to the rotation amount. The generated image is displayed on the display unit 301 according to the rotation direction and the rotation amount of the rear dial 235a, as shown in the corrected image 30V in FIG. When the user rotates the front dial 235b, the image processing unit 225 generates an image in which the correction amount of the shift correction is changed in the direction perpendicular to the operation of the rear dial 235a according to the rotation amount. The generated image is displayed as an image on the display unit 301 according to the rotation direction and the rotation amount of the front dial 235b, as shown in the corrected image 30H of FIG.

  In the example of FIG. 3, ten images are shown as the correction image 30V, and ten images are shown as the correction image 30H. Even when any of the corrected images 30V and 30H is displayed, when the shift button is operated, it is possible to switch to the pre-correction image 30C. When the shift button is operated again, the corrected live view is displayed.

  Further, in the present embodiment, the cut-out positions of the corrected images 30V and 30H can be changed as described in the third column from the left in FIG. The change of the cutout position is performed by operating the cross button 235c. That is, when the corrected image 30V is displayed (vertical tilt shooting and pseudo display), the cutout position is changed by operating the upper and lower buttons of the cross button 235c. When the corrected image 30H is displayed (horizontal tilt shooting and pseudo display), the cutout position is changed by operating the left and right buttons of the cross button 235c. When changing the cutout position, the direction in which the cutout can be made is indicated by a mark such as a triangle.

  As described above, in the present embodiment, the image processing unit 225 includes the first operation unit (rear dial 235a, front dial 235b, etc.) for setting the shift correction amount at the time of shift correction. The shift correction is performed on the image data based on the shift correction amount set by the operation unit. Therefore, the user can obtain a shifted image in accordance with the user's intention by operating the first operation unit.

  Further, in the present embodiment, a second operation unit (such as the cross button 235c) for setting the cutout position of the image subjected to the shift correction is provided, and the image processing unit 225 is set by the second operation unit. Based on the clipping position, the image data is clipped from the image subjected to the shift correction. Therefore, the user can cut out the image intended by the user from the image subjected to the shift correction by operating the second operation unit.

  In the present embodiment, the shift correction amount and the cutout position are set by the rear dial 235a, the front dial 235b, the cross button 235c, etc. However, the present invention is not limited to this. The operation member of the above may be used, or a touch panel or the like may be used.

  Next, the tilt angle that can be corrected will be described with reference to FIG. As described above, when the shape of the subject is distorted due to the difference in the distance from the camera to the subject, the image processing unit 225 performs shift correction processing to generate an image similar to that obtained by pseudo-swinging. I am trying to do it. The range in which the distortion of the shape of the object can be corrected by this shift correction process is limited by the focal length and elevation angle of the camera. The relationship between the range of correction angles for shift correction and the focal length as shown in FIG. 9 is stored in the memory 223. Therefore, the image processing unit 225 performs shift correction within the range of the correction angle stored in the memory 223.

  FIG. 9 shows an example of a tilt angle (correction angle) that can be corrected for each lens focal length. In this example, when the focal length is 8 mm, the camera is at the correct position (when the camera is held in the longitudinal direction and the horizontal direction with the same horizontal direction), ± 18 degrees, and when the camera is in the vertical position (camera (In the case of holding the longitudinal direction at right angles to the horizontal line direction) is ± 16 degrees. Similarly, when the focal length is 150 mm, it is ± 64 degrees at the normal position and ± 62 degrees at the vertical position.

  In order to avoid a sense of incongruity at the time of focal length change due to zooming, the correction step is uniformly at ± 20 steps regardless of the focal length, and the elevation angle is equally divided. Therefore, correction of ± 20 steps in the vertical direction (vertical direction) and ± 20 steps in the horizontal direction (horizontal direction) is possible. After the shift correction, as shown in FIG. 3, it is possible to shift the cutout position of the image. The shift step in this case is uniformly 20 steps regardless of the correction amount.

  Next, the operation in the present embodiment will be described using the flowcharts shown in FIG. 4 to FIG. The operations in these flowcharts (including the flowcharts in FIG. 11 and FIG. 13 described later) are executed by controlling the respective units of the entire camera in accordance with a program stored in the memory 223 by the camera body control unit 210.

  In the flow shown in FIG. 4, first, lens communication is performed (S1). Here, lens communication is performed between the camera body control unit 210 and the lens control unit 119, and various lens information, for example, focal distance information of the imaging lens group 101, etc., is acquired from the lens unit 100. In the present embodiment, the focal length information is used to perform the image processing unit 225 shift correction processing.

  If lens communication is performed in step S1, then inclination detection is performed (S3). Here, information regarding the tilt of the camera is detected from the shake / posture detection unit 215 and the image processing unit 225. In this embodiment, the angle at which the camera is looking up from the horizon (elevation angle), or the angle looking down at it (depression angle), or the angle facing left from the vertical line obtained by detecting oblique lines in the image or The image processing unit 225 performs shift correction processing in accordance with the angle (right angle or correction angle) of these angles.

  If inclination detection is performed in step S3, then it is determined whether the shift button is on (S5). As described above, when the user sets or cancels the shift correction mode, the shift button is operated. In this step, the operation member detection unit 233 determines whether the shift button is operated.

  As a result of the determination in step S5, when the shift button is turned on, the normal mode and the shift correction mode are alternately changed (S7). When the shift correction mode is set, the mode is switched to the normal mode (mode in which the shift correction mode is canceled), and when the normal mode is set, the mode is switched to the shift correction mode.

  If the normal mode and the shift correction mode are alternately switched in step S7, or if the result of the determination in step S5 shows that the shift button is not on, it is next determined whether or not the shift correction mode is set (S9) . As described above, since the shift correction mode is set or canceled in steps S5 and S7, in this step, the determination is made based on the currently set mode.

  As a result of the determination in step S9, when the shift correction mode is not set, that is, when the normal mode is set, the normal operation is performed (S11). Here, processing is executed based on the mode set other than the shift correction mode.

  If normal operation is performed in step S11, shift assist is performed next (S13). Here, in the case of a subject image that is effective when image processing by shift correction is performed, the user is superimposed on live view display to notify that effect. In this case, a symbol (such as an icon) prompting for correction is displayed, and a corrected image is displayed by being superimposed and displayed semi-transparently. As described with reference to FIG. 2 and FIG. 3, the shape of the subject is distorted in the case of shooting such as looking up from below, but by performing shift correction, it is possible to obtain an image from which this distortion is removed. A general user often does not know what subject is appropriate for performing the shift correction, and in this embodiment, the shift correction mode is used for such a general user. Assist in the use of The detailed operation of this shift assist will be described later with reference to FIG.

  On the other hand, in the case of the shift correction mode as a result of the determination in step S9, the shift correction operation is performed (S15). Here, the image processing unit 225 performs shift correction processing on the image data from the imaging element 203. The detailed operation of this shift correction operation will be described later with reference to FIG.

  When the shift correction operation is performed in step S15 or shift assist is performed in step S13, live view display is performed (S17). Here, in the case of the shift correction mode, live view display is performed on the display unit 301 based on the image data subjected to the shift correction process in step S15. When the shift correction mode is not set, live view display is performed in the normal mode, and when assist display is performed based on the shift assist in step S13, the use of the shift correction mode in live view display is performed. Display recommended icons etc.

  When live view display is performed in step S17, it is next determined whether the shutter button is on (S19). As described above, the shutter button in the operation member 235 is a two-stage type, and it is determined here whether or not the shutter button has been half-pressed. If it is determined that the shutter button is not turned on, the process returns to step S1 to repeat the above-described live view display and the like.

  If the result of determination in step S19 is that the shutter button is on, AF is performed (S21). Here, the AF control unit 221 performs AF based on the so-called contrast method based on the image data from the imaging element 203 acquired at the timing when the shutter button is pressed halfway. That is, the contrast evaluation value is detected from the image data, and the focus lens position is moved to a position corresponding to the peak position of the contrast evaluation value.

  Once AF is performed in step S21, next shooting is performed (S23). When the user determines the composition and determines that it is a shutter chance, the shutter button is fully pressed. Therefore, in this step, the operation member detection unit 233 determines whether or not the shutter button is full-pressed. When the shutter button is full-pressed, the exposure time is controlled by the shutter 201, and imaging is performed after the exposure time has elapsed. After the image data is read out from the element 203, the image processing unit 225 performs image processing for recording, the image data is recorded in the memory 233, and when the recording is completed, the process returns to step S1.

  As described above, in the flow of the camera operation, when the shift correction mode is not set, the shift assist is displayed superimposed on the live view display in the case of a subject for which the shift correction process is effective (S13) On the other hand, when the shift correction mode is set, the image subjected to the shift correction process is displayed in live view (S13).

  Next, the detailed operation of the shift assist in step S13 will be described with reference to FIG. When the shift assist flow is entered, it is first determined whether or not lens communication is present (S31). Here, as in step S1, lens communication is performed to obtain the latest focal length information.

  As a result of the determination in step S31, when there is no lens communication, a manual focal length input value is adopted (S35). Depending on the camera system, lens communication may not be possible between the lens unit 100 and the camera body 200. For example, there may be a case where the lens unit 100 having no communication function is mounted, or a case where the lens unit 100 is mounted with a bellows or an intermediate lens barrel interposed. In this case, for example, focal length information input for shake prevention may be substituted, or the user may manually input focal length information using a menu screen or the like.

  On the other hand, if the result of determination in step S31 is that there is lens communication, focal length data is received (S33). Here, the focal length information transmitted from the lens control unit 119 is acquired.

  If focal length data is received in step S33, or if a manual focal distance input value is adopted in step S35, then correction effect determination is performed (S37). Here, if shift correction processing is performed using the focal length information acquired in steps S33 and S35 and the inclination information acquired in step S3, it is determined whether or not an image appears to have this effect. There are various methods for determining the correction effect, and the details will be described later with reference to FIG.

  Once the correction effect determination is performed in step S37, it is next determined whether there is a correction effect (S39). Here, the determination is made based on the result of the correction effect determination in step S37. As a result of this determination, if there is no correction effect, it is not necessary to recommend the user to use the shift correction, so nothing is done and the process returns to the original flow.

  On the other hand, if the result of determination in step S39 is that there is a correction effect, correction assist display is performed (S41). Here, a correction assist display (such as an icon) is suggested to be recommended to set the shift correction mode superimposed on the live view display. When the correction assist display is performed, the flow returns to the original flow.

  Next, the detailed operation of the correction effect determination in step S37 will be described using FIG. Three examples are shown in FIG. In the example shown in FIG. 6A, it is determined based on the elevation angle whether or not there is a correction effect.

  In the flow of the correction effect shown in FIG. 6A, first, it is determined whether or not the maximum correction angle / 2 is equal to or less than the turning angle (S51). Here, using the focal length information acquired in steps S33 and S35, the maximum value (maximum correction angle) of the correction angle for each focal length shown in FIG. 9 is obtained. Then, the determination is performed by comparing 1/2 of the maximum angle with the tilt information (the tilt angle) acquired in step S3.

  If the result of determination in step S51 is that the maximum correction angle / 2 is smaller than or equal to the turning angle, it is determined that there is a correction effect (S53). Here, the determination result is stored and used at the time of determination in step S39 (see FIG. 5) described above.

  If the correction effect is determined in step S53, next, a correction step corresponding to the swing angle is set (S55). In the present embodiment, the maximum and minimum ranges of the correction angle are set to 20 steps, and the correction step corresponding to the tilt information (the tilt angle) acquired in step S3 is set. By setting this correction step, it is possible to immediately carry out the corresponding shift correction process at the time of the shift correction operation described later (see S81 in FIG. 7).

  If the correction step is set in step S55, or if the result of determination in step S51 is No, the flow of correction effect determination is ended, and the original flow is returned.

  Next, the correction effect determination shown in FIG. 6 (b) will be described. In this correction effect determination, it is determined whether there is a correction effect according to whether or not there is an oblique straight line in the subject image. In the case of a building viewed from below, the shape is essentially rectangular, but as described above, it is trapezoidal. In this case, since there is a diagonal line, in this example, the diagonal line is detected and the correction effect determination is performed.

  In the flow of FIG. 6B, first, it is determined whether an oblique straight line has been detected (S61). Here, the image processing unit 225 or the like analyzes the image data from the imaging element 203, and determines whether or not the oblique line is included in the outline of the subject.

  As a result of the determination in step S61, when an oblique straight line is detected, it is determined that there is a correction effect (S63). Here, the determination result is stored and used at the time of determination in step S39 (see FIG. 5) described above.

  If the correction effect is determined in step S53, next, a correction step corresponding to the oblique line angle is set (S65). Since the oblique line angle is related to the elevation angle, the correction step is set based on the oblique line angle.

  If the correction step is set in step S65, or if the result of the determination in step S61 is No, the flow of correction effect determination is ended, and the process returns to the original flow.

  Next, the correction effect determination shown in FIG. 6C will be described. In this correction effect determination, when the face is at the upper part of the screen, it is easy to look up, so in this case, it is preferable to place the camera on the upper side and to shoot from the upper side. This is because the foot looks long when shooting from the bottom, but it looks angry from the shape of the mouth etc., while it looks like a smile when shooting from the top, and the shift correction is made so that the foot looks long It is because it is possible.

  In the flow of FIG. 6C, first, it is determined whether a face has been detected (S71). Here, it is determined whether the face detection unit 227 has detected a face. If a face is detected as a result of this determination, it is determined whether the face position is at the top of the screen (S73). Here, the face detection unit 227 detects the position of the face and makes a determination based on this position.

  If it is determined in step S73 that the face position is at the top, it is next determined that there is a correction effect (S75). Here, the determination result is stored and used at the time of determination in step S39 (see FIG. 5) described above.

  When it is determined in step S75 that the correction effect is present, next, the focal length maximum step / 2 is set based on the upper side of the image (S77). Here, the correction step is set based on, for example, half of the maximum step determined by the focal length with reference to the upper side of the image.

  If the correction step is set in step S77, or if the result of the determination in step S61 is No, the flow of correction effect determination is ended, and the original flow is returned.

  Since the correction effect determination flow shown in FIG. 6C is suitable for photographing a person, it is suitable when the self-timer mode or the portrait mode is set, and these modes are set. For the purpose, it is preferable to use the correction effect determination shown in FIG.

  In the example shown in FIG. 6C, when the face is detected and the position of the face is at the top, it is determined that the correction effect is present, and the correction assist display is performed. However, the present invention is not limited to this, and when the position of the face is in the middle or in the lower part, correction assist display recommended to the user may be performed so that the person is photographed from above.

  Although three examples of correction effect determination in step S37 (see FIG. 5) are shown in FIG. 6, these may be combined as appropriate, and may be combined with other correction effect determinations.

  FIG. 8 shows an example of the assist display. In this example, a person is photographed, and since the face is at the top of the screen (see FIG. 6C), the recommended photographing angle display 40 is displayed superimposed on the live view image. Note that, as described above, even if the face is at the top of the screen, if you take a person from the top as much as possible, the person looks like a smile, so if the face is not at the top, the camera's orientation from the top It is also possible to display a recommended shooting angle display 40 in which the direction of the camera is lowered so as to lower and shoot.

  Next, the detailed operation of the shift correction operation (see FIG. 4) in step S15 will be described using FIG. This flow shows the operation for displaying the image of the shift correction described with reference to FIG.

  When the flow of shift correction operation is entered, first, shift correction step setting is performed (S81). Here, the shift correction step is set based on the correctable tilt angle (correction angle) described with reference to FIG. The set value may be a correction amount corresponding to the elevation angle detection, or may be a manual set value (initial value ± 0 = no correction). In the present embodiment, as described above, 20 steps are used, but the number of steps may be different. Also, the user may set manually.

  When setting of the shift correction step is performed in step S81, next, setting of the clipping step is performed (S83). As shown in FIG. 3, the cutout position can be changed. In this step, the number of steps which can change the extraction position is set.

  After setting of the clipping step in step S83, next, it is determined whether or not the rear dial is rotated (S85). As described above, when the user wants to perform the shift correction process in the vertical direction (vertical direction), the user rotates the rear dial 235a. Therefore, in this step, the operation member detection unit 233 detects the operation state of the rear dial 235a, and determines whether or not the rotation operation has been performed based on the detection result.

  If the result of determination in step S85 is that the rear dial is rotating, V shift correction step updating is performed (S87). Here, in accordance with the operation state of the rear dial 235a, the V shift correction step corresponding to the corrected image 30V in FIG. 3 is changed.

  If the V shift correction step is updated in step S87, or if the result of the determination in step S85 shows that the rear dial is not rotating, it is next determined whether or not the front dial is rotating (S89). As described above, when the user wants to perform the shift correction process in the horizontal direction (horizontal direction), the user rotates the front dial 235b. Therefore, in this step, the operation member detection unit 233 detects the operation state of the front dial 235b, and determines whether or not the rotation operation has been performed based on the detection result.

  If it is determined in step S89 that the front dial is rotating, the H shift correction step is updated (S91). Here, in accordance with the operation state of the front dial 235b, the H shift correction step corresponding to the corrected image 30H of FIG. 3 is changed.

  If H shift correction step updating is performed in step S91, or if the result of determination in step S89 is that the front dial is not rotating, it is next determined whether the cross button is on (S93). As described with reference to FIG. 3, the user operates the cross button 235 c to change the cutout position of the corrected image. Therefore, in this step, the operation member detection unit 233 detects the operation state of the up, down, left, and right buttons of the cross button 235c, and makes a determination based on the detection result.

  If the result of determination in step S93 is that the cross button is on, the clipping step is updated (S95). Here, every time the cross button 235 c is operated, the clipping step is updated in the direction according to the operation of the up, down, left, and right buttons.

  If the cutout step is updated in step S95, or if the result of determination in step S93 is that the cross button is not on, it is next determined whether or not the OK button is on for 2 seconds (S97). The OK button is a button disposed at the center of the cross button 235c. In this step, the operation member detection unit 233 detects the operation state of the OK button, and makes a determination based on the detection result. Note that 2 seconds is an example, and it may be any time that is appropriate for the user to perform the reset operation.

  If the result of determination in step S97 is that the OK button is on for 2 seconds, the shift correction step and the clipping step are reset (S99). The reset value of the shift correction step may be a correction step without correction (30c in FIG. 3) or a shift step according to the inclination detection. In addition, reset of the cutout position is an image edge which is a reference of shift correction.

  If the cutout step reset of the shift correction step is performed in step S99, or if the result of the determination in step S97 shows that the OK button is not turned on for 2 seconds, the flow of the shift correction operation is ended, and the original flow is returned. . If it returns to the original flow, the process in shift correction operation will be reflected by the live view display in step S17.

  As described above, in the flow of the shift correction operation, the correction amount of the shift correction can be changed and the cutout position can be changed according to the operation of the rear dial 235a, the front dial 235b, the cross button 235c and the like. For this reason, it is possible to generate an image of the user's intentional tilt shooting.

  Next, setting of an AF point at the time of AF in step S21 (see FIG. 4) will be described using FIG. When the shift correction process is performed, not all the images are displayed, but only a part of the screen is displayed according to the change of the shift correction step and the change of the cutout position. With this change, the AF point may go out of the screen. In the present embodiment, since the image data of all the images are present, the AF point can be maintained, but the position of the AF point can not be displayed on the screen. In such a case, the direction in which the AF point is located is displayed.

  FIGS. 10 (a) and 10 (b) show all images not subjected to the shift correction process, and FIGS. 10 (c) and 10 (d) show shift corrected images subjected to the shift correction process. The shift correction image is only a part of the entire image to perform shift correction. Since the AF point 40a in FIG. 10A and the AF point 40b in FIG. 10B are all displayed, the AF point is also displayed.

  However, in the case of the shift correction image, the AF point may not be displayed because the entire image is not displayed. The AF point 40c in FIG. 10C is displayed because it is in the shift correction image, and focusing is performed on this AF point 40c. However, the AF point 40d in FIG. 10D does not have a corresponding position in the screen of FIG. 10D because the shift correction image is cut out. However, since the user is inconvenient for shooting when the AF point position is not known at all, the AF point 40 d is displayed, and the direction in which the AF point is present is indicated by the arrow 41.

  Next, the operation of displaying an AF point when shift correction is performed will be described using FIG. The display of the AF points described with reference to FIG. 10 is performed by the flowchart shown in FIG. This flow starts when the shutter button is pressed halfway in step S19 (FIG. 4).

  When the flow of AF during shifting shown in FIG. 11 is entered, first, AF is executed at a selection point (S101). The selection point for the AF is, for example, the position of the face detected by the face detection unit 227, a position arbitrarily designated by the user, or the like. When the selection point is determined, the AF control unit 221 performs AF control based on the image data from the selection point.

  If AF is executed at the selection point in step S101, it is next determined whether the AF point is within the live view image area (S103). As described above, when the shift correction operation is performed, the entire image is not displayed on the display unit 301. Therefore, the AF point may not be displayed. In this step, it is determined whether the point selected in step S101 is included in the live view image.

  As a result of the determination in step S103, when the AF point is within the area of the live view image, the AF point of the live view image is superimposed and displayed (S105). Here, as shown in FIG. 10C, the AF point 40c is superimposed on the live view image.

  On the other hand, as a result of the determination in step S103, when the AF point is in the vicinity of the live view image, the AF point and the arrow are superimposed and displayed (S107). Here, as shown in FIG. 10D, the AF point 40d and the arrow 41 are displayed superimposed on the live view image.

  After displaying the AF point or the like in step S105 or S107, next, in-focus mark display and in-focus sounding are performed (S109). As a result of the AF control, if the in-focus state is obtained, the in-focus mark 43 (see FIG. 10D) is performed, and a sound notifying that the in-focus state has been generated is generated. When this process is performed, the process of AF during shifting is ended, and the process returns to the original flow.

  As described above, in the shift AF, when the AF point is out of the shift corrected image as a result of the shift correction processing, the focus detection at the AF point is maintained, and the display of the AF point has the AF point I'm trying to show the direction. Therefore, the user can easily recognize that the AF point is out of the screen. In the present embodiment, the arrow is used to display the direction in which the AF point is located. However, the present invention is not limited to this, and it is not limited to the arrow if the direction is known.

  In the present embodiment, when the AF point is outside the display unit 301, the direction is indicated. However, the present invention is not limited to this. For example, the position of the image subjected to the shift correction processing may be moved so that the AF point is in the display unit 301. The amount of movement in this case may be such as to move to a position close to the peripheral portion within the display range.

  In addition, when the AF point is selected (for example, when the shutter button is pressed halfway), the shift correction mode is temporarily canceled, and all images are displayed in live view, and at that time, the AF point is superimposed and displayed. May be In this case, when the display of the AF point is performed for a predetermined time, the shift correction mode may be restored.

  Furthermore, when the AF point is selected, the entire image may be displayed as an auxiliary image in the right corner or the left corner, etc. in addition to the shift image, and the AF point may be displayed on the auxiliary image.

  Next, the enlarged display during live view display in step S17 (see FIG. 4) will be described using FIG. Enlarged display is useful for confirming the focus after AF or when used for manual focusing using a focus ring, and thus high resolution is required. FIG. 12B is an entire image in the case where shift correction is not performed. This whole image is distorted into a trapezoidal shape which is originally rectangular as shown in the figure. FIG. 12A shows an image subjected to shift correction processing so that a distorted trapezoid becomes an original rectangle.

  When the area 50A of FIG. 12A is enlarged as it is, it becomes an area 50a shown in FIG. However, the resolution of the image of the area 50A is lowered to perform the shift correction, and when the image is enlarged to the area 50a, the resolution is considerably reduced. Therefore, in the present embodiment, the image of the area 50B before the shift correction is enlarged as it is, and is displayed as the area 50b as shown in FIG. 12 (d). Since the area 50B is not shift-corrected, the resolution of the image is high, and even if this is enlarged, the resolution is sufficient.

  Next, the operation of enlarged display when shift correction is performed will be described with reference to FIG. The enlarged display described using FIG. 12 is executed by the flowchart shown in FIG. This flow is executed when an instruction for enlarged display is issued during execution of step S17 (FIG. 4).

  When the flow of live view display shown in FIG. 13 is entered, first, it is determined whether the enlargement button is on (S111). Here, it is determined whether the enlargement button in the operation member 235 has been operated.

  As a result of the determination in step S111, when the enlargement button is operated, switching between enlargement on and off is performed (S113). When the enlargement on is set, when the enlargement button is operated, the enlargement is turned off and the normal display is performed. Also, when the enlargement off is set, the enlargement button is turned on when the enlargement button is operated, and the display unit 301 displays the enlargement.

  If enlargement on / off is switched in step S113, or if the result of determination in step S111 is that the enlargement button is not on, next, enlargement frame coordinates are converted into imaging coordinates (S115). During normal (without shift correction) live view display, the enlargement frame coordinates on the monitor and the coordinates of the live view image match, but when shift correction is in progress, the enlargement frame display coordinates on the monitor are after shift correction. As it is superimposed and displayed on the corrected live view display, this is adjusted to the original image coordinates on imaging.

  After coordinate conversion is performed in step S115, it is next determined whether or not enlargement is in progress (S117). Here, the determination is made based on the setting of enlargement on or off in step S113.

  If the result of determination in step S117 is that enlargement is not in progress, full area pixel addition readout is performed (S119). Here, addition readout is performed on pixels in the entire area from the imaging element 203. Subsequently, it is determined whether shift correction is in progress (S121). When it is determined in step S9 (FIG. 4) that the shift correction mode is set, shift correction is performed in step S15. In this step, determination is made based on whether or not this shift correction is performed.

  If shift correction is not in progress as a result of the determination in step S121, a full image live view display without correction is performed (S125). Here, since the enlargement instruction has not been issued and shift correction is not in progress, the entire image without correction as shown in FIG. 12B is displayed.

  On the other hand, as a result of the determination in step S121, if shift correction is in progress, live view display of the corrected image is performed (S123). Here, since the enlargement instruction has not been issued and shift correction is in progress, an image on which shift correction has been performed as shown in FIG. 12A is displayed.

  Returning to step S117, as a result of this determination, if enlargement is in progress, enlargement area all pixel readout is performed (S127). Here, the image data of all the pixels of the image sensor 203 for this area is read out from the designated enlarged area.

  When the enlargement area all pixels are read out in step S127, next, the no-correction enlarged live view image is displayed (S129). Here, an enlarged image as shown in FIG. 12D is displayed using the image data for which shift correction has not been performed for the designated enlarged region. This enlarged image is not a shift-corrected image, but uses image data read from an enlarged area, so distortion remains in the shape, but as shown in FIG. Instead, high-resolution display can be performed.

  When live view display is performed in steps S123 and S125, superimposed display of the enlargement frame is performed (S131). Here, an enlargement frame indicating the position of the enlarged area is displayed superimposed on the live view display. When the enlargement frame superimposed display is performed, the original flow is returned.

  As described above, in the case where the enlargement display instruction is made when the shift correction mode is set, the enlargement display is performed using the image data which has not been subjected to the shift correction. For this reason, even if enlarged display is performed, the resolution of the image does not decrease, and accurate focus confirmation and focusing can be performed.

  As described above, in one embodiment of the present invention, it is determined whether shift correction by the image processing unit is valid (for example, see S37 in FIG. 4), and as a result of this determination, shift correction is determined to be valid. When it is determined, the assist display is performed on the image display unit (for example, see S39 and S41 in FIG. 4). For this reason, it is possible to advise the use of image processing equivalent to aerial shooting, and even a user who can not use aerial shooting can make effective use of shift correction.

  Further, in one embodiment of the present invention, the image of the subject is displayed on the image display unit based on the image data on which the AF point is selected for the subject (for example, refer to S101 in FIG. 11) and shift correction is performed. When the selected AF point is on the outside of the image display unit (for example, see S103 No in FIG. 11), it is notified that it is on the outside (for example, S107 in FIG. 11). reference). Therefore, there is no need to change the composition even if the AF point deviates from the corrected image as a result of the tilt correction process.

  In one embodiment of the present invention, the image display unit has an enlargement instruction unit (for example, an enlargement button in the operation member 235) for enlarging and displaying a part of the subject image, and the image processing unit performs shift correction. When the enlargement instruction unit instructs enlargement display while the displayed image is displayed on the image display unit (for example, S111 in FIG. 13), the image data not subjected to the shift correction is Processing for enlarged display is performed, and enlarged display is performed on the image display unit (for example, S129 in FIG. 13). For this reason, it is possible to prevent the reduction in the resolution of the image when the enlargement display is instructed when the tilt correction process is performed.

  In the embodiment of the present invention, although the digital camera is described as a device for photographing, the camera may be a digital single-lens reflex camera or a compact digital camera, such as a video camera or a movie camera. It may be a camera for moving pictures, and may be a camera built in a mobile phone, a smartphone, a personal digital assistant (PDA), a personal computer (PC), a tablet computer, a game machine or the like. In any case, the present invention can be applied to any device that can perform image processing that can obtain the same effect as that of tilt shooting.

  Further, among the techniques described in the present specification, the control mainly described in the flowchart is often settable by a program, and may be stored in a recording medium or a recording unit. The recording method of the recording medium and the recording unit may be recorded at the time of product shipment, may use the distributed recording medium, or may be downloaded via the Internet.

  In addition, with regard to the operation flow in the claims, the specification, and the drawings, even if it is described using words that express the order of “first”, “next”, etc. for convenience, in places that are not particularly described, It does not mean that implementation in this order is essential.

  The present invention is not limited to the above embodiment as it is, and at the implementation stage, the constituent elements can be modified and embodied without departing from the scope of the invention. In addition, various inventions can be formed by appropriate combinations of a plurality of constituent elements disclosed in the above embodiment. For example, some components of all the components shown in the embodiment may be deleted. Furthermore, components in different embodiments may be combined as appropriate.

100: lens unit, 101: shooting lens group, 103: aperture, 105: focus ring, 107: zoom ring, 111: lens position detection unit, 113: lens drive , 115: aperture control unit, 117: rotation detection unit, 119: lens control unit, 200: camera body, 201: shutter, 203: imaging device, 205: ... Shake correction mechanism 210: camera body control unit 211: AF auxiliary light 213: imaging control unit 215: shake / posture detection unit 217: shake correction control unit 219 · · Shutter control unit, 221 · · · AF control unit, 223 · · · · · · · · · · · · · image processing unit, 227 · · · face detection unit, 229 · · · exposure control unit, 231 · · · display control Part, 233 ... Operation part Detection part, 235 ... operation member, 237 ... bus, 300 ... monitor, 301 ... display part, 303 ... touch panel, 305 ... touch panel control part, 307 ... position detection part , 310 ... Monitor angle detection unit

Claims (6)

An imaging unit that photoelectrically converts an object image and outputs image data;
An image display unit for displaying the subject image based on the image data;
An image processing unit that performs shift correction on the image data;
An AF point selection unit that selects an AF point for the subject;
When displaying the subject image on the image display unit based on the image data subjected to the shift correction, if the AF point selected by the AF point selection unit is outside the image display unit A control unit for moving a display position of the image data subjected to the shift correction such that the AF point is inside the image display unit ;
An imaging apparatus characterized by having: A first operation unit for setting a shift correction amount at the time of the shift correction;
The image pickup apparatus according to claim 1, wherein the image processing unit performs the shift correction on the image data based on the shift correction amount set by the first operation unit. A second operation unit for setting the cutout position of the shift-corrected image;
2. The image processing unit according to claim 1, wherein the image processing unit cuts out from the image on which the shift correction has been performed on the image data, based on the cutout position set by the second operation unit. Imaging device.   The imaging apparatus according to claim 1, wherein a part of the shift image on which the shift correction has been performed by the image processing unit is displayed on the image display unit. Photoelectrically convert the subject image and output image data,
Displaying the subject image on an image display unit based on the image data;
Perform shift correction on the image data,
Select the AF point for the subject,
Based on the image data which the shift correction is performed, when displaying the object image on the image display unit, if the AF point selected is outside of the image display section, the AF point Moving the display position of the image data subjected to the shift correction so as to be inside the image display unit ;
An imaging method characterized by In a computer provided in an imaging device,
Photoelectrically convert the subject image and output image data,
Displaying the subject image on an image display unit based on the image data;
Perform shift correction on the image data,
Select the AF point for the subject,
Based on the image data which the shift correction is performed, when displaying the object image on the image display unit, if the AF point selected is outside of the image display section, the AF point Moving the display position of the image data subjected to the shift correction so as to be inside the image display unit ;
A program characterized by making things run.