JP6320251B2 - Imaging apparatus, imaging method, and program - Google Patents

Description

The present invention relates to an imaging apparatus, and more particularly, to an imaging apparatus , an imaging method, and a program capable of image processing that provides the same effect as so-called tilt shooting.

  At the time of shooting, the composition is determined in consideration of the horizon, but it is difficult to grasp the relationship between the subject and the horizon. Therefore, Patent Document 1 includes a detection unit that detects the posture of the camera, and a display control unit that displays a grid-like pattern that indicates the degree of inclination in the horizontal direction and the degree of inclination in the elevation angle direction of the imaging optical system. There is disclosed a camera that can be easily leveled by knowing the posture of the camera by erasing the vertical straight line of the grid pattern when the horizontal direction matches the horizontal direction of the actual shooting screen. .

  Further, if a picture is taken looking up at a building or the like, even a quadrangular building will appear as a trapezoid. That is, the shape of the subject is distorted due to the difference in distance to the subject. Therefore, in such a case, it is known to perform tilt shooting and eliminate the distortion of the subject. The tilt shooting is a shooting in which the optical axis of the camera lens and the photosensitive surface (imaging surface) of the film (imaging device) are intentionally shifted or tilted. A dedicated lens barrel or the like is required for this tilt shooting.

  Further, when focus adjustment is performed by AF in an imaging apparatus such as a digital camera, an AF point is set automatically or manually, and the AF point is focused. After the AF point is set and the focus is detected, if the angle of view is changed by changing the aspect of the shooting screen, the AF point may be outside the angle of view. In this case, the AF point outside the angle of view is invalidated and a new AF point is set.

  In some imaging apparatuses such as digital cameras, an object image can be enlarged and displayed during live view display in order to confirm the focus state.

Japanese Patent No. 3896505

  As described above, a film camera is used to shoot, and dedicated equipment is required. However, in an imaging device such as a digital camera, image processing equivalent to that performed for shooting is performed by image processing or the like. Is possible. However, tilt shooting is not effective for all subjects, and there are subjects where the effects of tilt shooting are likely to appear and subjects that are difficult to appear. Even though a general photographer does not know when to take a side shot, and can perform image processing equivalent to that for side shot shooting, Process "or" shift correction process ") cannot be used effectively.

  Further, when tilt correction processing is performed, the AF point may be outside the corrected image as a result of the correction processing. In general, the camera is often fixed with a tripod or the like. In this case, in order to change the composition, it is necessary to change the shift amount or the cutout position, which is inconvenient.

  In addition, when tilt correction processing is performed, an enlarged display may be performed for focus confirmation. In this case, the resolution of the image is lowered due to the tilt correction process, and further enlarged display is performed, so that the resolution of the image is significantly lowered.

The present invention has been made in view of such circumstances, tilt photographing the same image processing imaging device which can advise the use of, to the purpose to provide an imaging method, and program The

  In order to achieve the above object, an imaging apparatus according to a first invention includes an imaging unit that photoelectrically converts a subject image and outputs image data, an image display unit that displays the subject image based on the image data, and an imaging device An inclination detection unit that detects the inclination of the image, an image processing unit that performs shift correction on the image data, and whether or not the shift correction by the image processing unit is valid based on the inclination detected by the inclination detection unit A determination unit that determines whether or not the shift correction is effective by the determination unit, and an assist display control unit that performs assist display on the image display unit.

An imaging apparatus according to a second aspect of the present invention includes a focal length information acquisition unit that acquires focal length information of the photographing lens in the first aspect, and the determination unit is acquired by the focal length information acquisition unit. It is determined whether the shift correction is effective based on the focal length information.
In the imaging device according to a third aspect based on the first aspect, the image processing unit detects an oblique line in the image based on the image data, and the determination unit is detected by the image processing unit. Whether or not the shift correction is effective is determined based on the oblique line information in the obtained image.
An imaging device according to a fourth invention includes a face detection unit that detects a position of a face based on the image data in the first invention, and the determination unit is detected by the face detection unit. Based on the face position, it is determined whether the shift correction is effective.

An imaging apparatus according to a fifth aspect of the present invention includes the first operation unit for setting a shift correction amount at the time of the shift correction in the first aspect, and the image processing unit includes the first operation unit. Based on the shift correction amount set by the operation unit, the shift correction is performed on the image data.
An imaging apparatus according to a sixth aspect of the present invention includes the second operation unit for setting the shift position of the shift-corrected image in the first aspect, and the image processing unit includes the second operation unit. Based on the cutout position set by the operation unit, the image data is cut out from the image subjected to the shift correction.

An image pickup apparatus according to a seventh aspect of the present invention includes a storage unit that stores a relationship between a correction angle range and a focal length at the time of the shift correction in the first aspect. The shift correction is performed within the range of the correction angle stored in the storage unit.
In the imaging device according to an eighth aspect based on the first aspect, the image display unit displays a part of the shift image subjected to the shift correction by the image processing unit.

According to a ninth aspect of the present invention, there is provided an imaging method for photoelectrically converting a subject image and outputting image data, displaying the subject image on an image display unit based on the image data, detecting an inclination of the imaging device, and detecting the image data. Shift correction is performed, and based on the detected inclination, it is determined whether the shift correction is effective. If the determination determines that the shift correction is effective, the image display unit is assisted. Display.

According to a tenth aspect of the present invention, there is provided a program for photoelectrically converting a subject image into a computer provided in the imaging apparatus, outputting image data, displaying the subject image on an image display unit based on the image data, and the imaging apparatus. Is detected, and the image data is subjected to shift correction. Based on the detected inclination, it is determined whether the shift correction is effective. Based on the determination, the shift correction is determined to be effective. In this case, the assist display is performed on the image display unit.

According to the present invention, tilt-shift image taking equivalent image processing imaging device which can advise the use of Ru can provide imaging method, and a program.

1 is a block diagram mainly showing an electrical configuration of a camera according to an embodiment of the present invention. It is a figure which shows the display image at the time of performing a shift correction process in the camera which concerns on one Embodiment of this invention. FIG. 4 is a diagram illustrating a relationship between a shift operation and a display image in a camera according to an embodiment of the present invention. It is a flowchart which shows operation | movement of the camera which concerns on one Embodiment of this invention. It is a flowchart which shows the operation | movement of the shift assist of the camera in one Embodiment of this invention. It is a flowchart which shows the operation | movement of the correction effect determination of the camera in one Embodiment of this invention. It is a flowchart which shows the operation | movement of the shift operation of the camera which concerns on one Embodiment of this invention. It is a figure which shows the example of the advice of shift correction in the camera which concerns on one Embodiment of this invention. 6 is a chart showing a range of correction angles when changing a focal length in a camera according to an embodiment of the present invention. It is a figure which shows AF point display of AF at the time of performing the shift correction process in the camera which concerns on one Embodiment of this invention. 6 is a flowchart illustrating an operation during shifting AF in the camera of one embodiment of the present invention. It is a figure which shows the enlarged display at the time of performing shift correction during the live view display in the camera which concerns on one Embodiment of this invention. 6 is a flowchart showing an operation of live view display in the camera according to the embodiment of the present invention.

  Hereinafter, an example applied to a digital camera as an embodiment of the present invention will be described. This digital camera has an imaging unit, and the imaging unit converts the subject image into image data. Based on the converted image data, the subject image is displayed in a live view on a display unit arranged on the back surface of the main body. To do. The photographer determines the composition and the photo opportunity by observing the live view display. During the release operation, image data is recorded on the recording medium.

  In addition, the camera according to the present embodiment displays an image from which the distortion of the subject is removed in accordance with the shift correction operation when the shift correction mode (a mode for performing image processing that provides an effect equivalent to tilted shooting) is set. When the image is displayed on the screen and a release operation is performed, image data from which the distortion of the subject is removed is recorded. When the shift correction mode is not set, assist display is performed when the effect of shift correction appears during live view display.

  FIG. 1 is a block diagram mainly showing an electrical configuration of a camera according to an embodiment of the present invention. This camera includes a camera body 200, a lens unit 100 that can be attached to and detached from the camera body 200, and a monitor 300 provided in the camera body 200. In this embodiment, the lens unit 100 is an interchangeable lens type. However, the present invention is not limited to this, and a digital camera in which the lens unit is fixed to the camera body 200 may be used. In addition, the lens unit 100 can communicate between the camera main bodies 200, but a lens that does not have a communication function may be attached.

  In the lens unit 100, a photographing lens group 101, an aperture 103, a focus ring 105, a zoom ring 107, a lens position detection unit 111, a lens driving unit 113, an aperture control unit 115, a rotation detection unit 117, and a lens control unit 119 are provided. It has been.

  The taking lens group 101 includes a plurality of optical lenses for forming a subject image, and can perform zooming (focal length change) and focusing (focus change). A diaphragm 103 is arranged behind the taking lens group 101 on the optical axis. The aperture 103 has a variable aperture diameter and controls the amount of the subject luminous flux that has passed through the photographing lens group 101. The aperture control unit 113 performs drive control of the aperture diameter of the aperture 103 in accordance with instructions from the camera body control unit 210 and the lens control unit 119.

  A rotatable zoom ring 105 and a focus ring 107 are provided on the outer periphery of the lens unit 100, respectively. The rotation detection unit 117 detects the rotation direction and the rotation amount of the zoom ring 105 and the focus ring 107, respectively, and outputs them to the lens control unit 119 and the like. The lens driving unit 113 moves the focus lens and the zoom lens of the photographing lens group 101 along the optical axis direction.

  The lens position detection unit 111 can detect the position of the lens of the photographing lens group 101. In this case, the position of the focus lens and the position of the zoom lens are detected and transmitted to the camera body control unit 210 via the lens control unit 119.

  The lens control unit 119 performs control in the lens unit 100 in accordance with an instruction from the camera body control unit 210 according to a program stored in a memory (not shown) provided in the lens unit 100. In addition, the lens control unit 119 performs imaging via the lens driving unit 113 so as to change the focal length according to the rotation of the zoom ring 105 and to change the focal position according to the rotation of the focus ring 107. The lens group 101 is driven. When the camera body 200 is set to the autofocus (AF) mode, the photographing lens group 101 is driven via the lens driving unit 113 in accordance with an instruction from the camera body control unit 210. Further, the detection result of the lens position detection unit 111 is transmitted in response to a request from the camera body control unit 210.

  A shutter 201 provided in the camera body 200 is arranged on the optical axis of the photographing lens group 101 and on the front side of the image sensor 203. The shutter 201 controls the passage time of the subject luminous flux, and a known focal plane shutter is employed in this embodiment. The focal plane shutter has a front curtain and a rear curtain, and is normally open. The subject luminous flux that has passed through the photographing lens group 101 and the aperture 103 passes through the shutter 201 in the open state and is guided to the image sensor 203. In response to the shooting instruction, the front curtain is once closed and then opened again. When the exposure time set manually or automatically has elapsed, the rear curtain is closed. This exposure time is controlled by the shutter control unit 219.

  The imaging element 203 includes an image sensor such as a CCD image sensor or a C-MOS image sensor, and is controlled by the imaging control unit 213. In the image sensor, the photodiodes that constitute each pixel are arranged in a two-dimensional matrix, and each photodiode generates a photoelectric conversion current according to the amount of light received, and this photoelectric conversion current is connected to each photodiode. The charge is accumulated by the capacitor. A Bayer array RGB filter is arranged in front of each pixel. In addition, the image sensor 203 includes an A / D converter that converts an analog voltage based on the electric charge accumulated in the capacitor into a digital signal, and outputs a digital image signal corresponding to each pixel to the image capture controller 213. The imaging element 203 functions as an imaging unit that photoelectrically converts a subject image and outputs image data.

  The imaging control unit 213 controls the imaging operation by the imaging element 203 in accordance with instructions from the camera body control unit 210. That is, exposure control and image signal readout control by the image sensor 203 are performed, and the read digital image signal is output to the bus 237. In addition to the imaging control unit 213 described above, the bus 237 includes an AF auxiliary light 211, a shake / posture detection unit 215, a shake correction control unit 217, a shutter control unit 219, an AF control unit 221, a camera body control unit 210, and a memory 223. The image processing unit 225, the face detection unit 227, the exposure control unit 229, the display control unit 231, and the operation member detection 233 are connected.

  The image processing unit 225 processes the image data of the subject from the imaging element 203 and the imaging control unit 213, and generates image data for live view display on the finder / monitor. Further, image data for storage is generated at the time of shooting, and moving image data is generated at the time of moving image shooting. In the present embodiment, an external memory (not shown) such as an SD card for storing image data for saving and moving image data is provided and connected to the bus 237 via an I / F. The storage image data and moving image data generated by the image processing unit 225 are recorded in the external memory. Further, at the time of reproduction, the image processing unit 225 generates image data for reproducing and displaying the image data recorded in the memory on the finder monitor.

  In addition, when the shift correction mode is set, the image processing unit 225 performs a shift correction process that is an image process for making an image equivalent to the tilt shooting on the image data, so that the distance to the subject is near. The image data from which the distortion based on the difference is removed is generated. This shift correction processing is performed, for example, by changing the magnification of the length in the horizontal direction according to the distance from the bottom of the screen around the vertical line in the screen, and centering on the horizontal line of the screen, This is done by changing the magnification of the length in the vertical direction according to the distance from the left or right side of the screen. Of course, the processing may be performed around the diagonal line in the screen. The image processing unit 225 functions as an image processing unit that performs shift correction on the image data.

  Further, the image processing unit 225 detects diagonal lines in the subject image based on the image data. A shift correction determination is performed using the detection of the diagonal line. Further, the image processing unit 225 performs an enlargement process on the image data in order to enlarge and display an image to be displayed on the display unit 301 for focus confirmation.

  The blur correction mechanism 205 includes an actuator such as a motor, and has a structure that shifts the image sensor 203 in a two-dimensional direction and rotates the image sensor 203 in a plane perpendicular to the optical axis of the photographing lens group 101. Yes.

  The shake / posture detection unit 215 includes an angle sensor, an acceleration sensor, and the like, detects camera shake, vertical / horizontal posture, tilt angle, and the like, and outputs a shake detection signal. The shake / posture detection unit 215 functions as an inclination detection unit that detects the inclination of the imaging device. The shake correction control unit 217 causes the shake correction mechanism 205 to perform shift driving and rotation driving based on the shake detection signal from the shake / posture detection unit 215. By this blur correction operation, even if the camera body is shaken, the image formed on the image sensor 203 is not blurred.

  In this embodiment, the AF control unit 221 adjusts the focus of the photographing lens group 101 by so-called contrast AF. That is, the lens control unit detects the contrast evaluation value from the image data from the image sensor 203 and the imaging control unit 213 so that the focus lens of the photographing lens group 101 becomes the focus lens position corresponding to the peak position of the contrast evaluation value. 119, drive control is performed via the lens driving unit 113. The AF is not limited to the contrast method, and may be performed by another method such as a phase difference method.

  The AF auxiliary light 211 projects auxiliary light onto the subject in order to assist focus detection at low luminance in accordance with an instruction from the AF control unit 221. In addition, the AF auxiliary light 211 notifies the photographer away from the camera of the operation state of the self-timer by turning on and changing the blinking cycle at the time of lighting. In this notification, the light amount can be adjusted by a current limiting circuit (a light amount controlled by duty drive is also acceptable).

  The face detection unit 227 detects whether or not a face is included in the image, using the image data from the imaging element 203 and the imaging control unit 213. In other words, the face of the subject is detected by comparing the image data with a predetermined face pattern. Further, when the face of the subject is detected, its position and size are detected, and organs such as eyes and mouth are also detected by analyzing the detected face area.

  The exposure control unit 229 extracts subject luminance information based on the image data from the image sensor 203 according to the camera mode setting, and based on the subject luminance information, the aperture, shutter speed, sensitivity, etc. for obtaining an appropriate exposure are extracted. An exposure control value is calculated. In calculating the appropriate exposure amount, the face detection information by the face detection unit 227 is used, and the flash emission amount is also calculated as necessary. Based on the calculated exposure control value, the camera body control unit 210 controls the aperture 103 via the lens control unit 119, and controls the shutter 201 via the shutter control unit 219, thereby providing appropriate subject light. The image is guided to the image sensor 203 with an appropriate exposure time.

  The memory 223 includes an electrically rewritable volatile memory and a nonvolatile memory. The memory 223 is capable of a program and control data for controlling the entire camera, and is also used as a buffer for writing and reading data to an external memory (not shown) such as an SD card. The memory 223 also stores a table showing the relationship between the focal length and the correction angle shown in FIG. 9 described later.

  The display control unit 231 performs display control for displaying the live view image and the reproduced image on the monitor / finder. The display control unit 231 also superimposes and displays on the image OSD (on-screen display) information such as camera setting information, exposure information, and shift assist display described later.

  The operation member 235 is a member that can be operated by the camera user, and includes a shutter button, a cross button 235c (see FIG. 3), a mode dial, a front dial 235b (see FIG. 3), a rear dial 235a (see FIG. 3), and a shift button. , An enlarge button and the like. The shutter button is a two-stage type that can distinguish between half-press and full-press of the shutter button. The cross button is arranged on the back surface of the camera body and the like, and buttons for instructing four directions of up, down, left and right are provided, and the position of a cursor or icon displayed on the monitor can be moved.

  A mode dial in the operation member 235 sets various modes such as a photographing mode and a shift correction mode. Various modes can be set on a menu screen displayed on the monitor in addition to the mode dial. The front dial is provided on the upper side of the camera body, and can be rotated by a photographer with a finger from the front side of the camera (the side where the lens unit 100 is disposed). The rear dial is provided on the upper side of the camera body, and can be rotated by a photographer with a finger from the rear side (opposite the front side) of the camera.

  The shift button is an operation button for setting the shift correction mode, and the shift correction mode is set and released alternately every time it is operated. The enlarge button is an operation button for instructing the user to enlarge and display a part of the image displayed on the display unit 301 in order to confirm the focus state.

  The operation member detection unit 233 detects the operation state of the operation member 235 and outputs the detection result to the camera body control unit 210. The camera body control unit 210 controls the camera according to the detection result of the operation state.

  The camera body control unit 210 includes a CPU and the like, and controls each unit according to a program stored in the memory 223 to control the entire camera. The camera body control unit 210 functions as a determination unit that determines whether shift correction by the image processing unit is valid based on the tilt detected by the tilt detection unit (S37 in FIG. 5 and FIG. 6 described later). reference). The camera body control unit 210 also functions as an assist display control unit that performs assist display on the image display unit when the determination unit determines that the shift correction is effective (S41 in FIG. 5 described later). The camera body control unit 210 also functions as a focal length information acquisition unit that acquires focal length information of the photographing lens (S1 in FIG. 4 and S31 to S35 in FIG. 5 described later).

  Further, the camera body control unit 210 functions as an AF point selection unit that selects an AF point for the subject (see S101 in FIG. 11). Further, when the camera body control unit 210 displays the subject image on the image display unit based on the image data subjected to the shift correction, the AF point selected by the AF point selection unit is placed outside the image display unit. In some cases, it functions as a notification unit for notifying that it is on the outside (see S107 in FIG. 10 and FIG. 11 described later).

  Further, the camera main body control unit 210, when an image subjected to shift correction by the image processing unit is displayed on the image display unit, when an enlargement display unit (enlargement button) is instructed to enlarge display, The image data that has not undergone the shift correction is subjected to processing for enlarged display, and functions as an enlarged display control unit that performs enlarged display on the image display unit (see S129 in FIGS. 12 and 13 described later).

  The monitor 300 is connected to the camera body 200 by a hinge or the like so as to be rotatable in the vertical direction or the like, and displays a live view image, a reproduced image, and other information images. The rotation state of the monitor 300 is detected by the monitor angle detection unit 310 and output to the camera body 200. The detection of the state of the monitor 300 includes at least the position stored in the camera body 200, the rotation direction (up and down), and the rotation angle. In the present embodiment, a pulse signal is generated while the monitor 300 is rotating.

  The display unit 301 in the monitor 300 includes a liquid crystal panel, an OLED (organic EL) panel, and the like, and a touch panel 303 is disposed on the surface side of the display unit 301. The display unit 301 functions as an image display unit that displays the subject image based on image data.

  The touch panel 303 can detect a user's touch based on, for example, a change in capacitance, and can execute an AF operation, a shutter operation, or the like according to the touch operation. In addition, the position on the display unit 301 where the touch operation is performed, the slide direction, the pinch out, the pinch in, and the like can be performed according to the shift correction and the image cutout position. Note that pinch-out refers to an operation in which two fingers are touched on the screen and then the fingers are spread, and pinch-in refers to an operation in which the two fingers are narrowed (an operation to move the operation target to pinch).

  The position detection unit 307 detects the state of the monitor angle detection unit 310 and outputs the detection result to the camera body control unit 210. The touch panel control unit 305 detects a touch position on the touch panel 303 and outputs it to the camera body control unit 210.

  Next, a display image on the display unit 301 when the shift correction is performed will be described with reference to FIG. Since the appearance changes depending on the focal length of the photographic lens group 101, FIG. 2 shows a short focus (WIDE) case (upper) and a long focus (TELE) case (lower). Images 10 and 20 shown in the leftmost column indicate images on the imaging. This captured image is an image formed on the image sensor 203 by the photographing lens group 101. When the building is looked up from the bottom, even if it is originally a rectangular shape, the top of the building is narrowed because it is far from the camera, and as shown in FIG. 2, the top side is a trapezoidal shape shorter than the bottom side. As is apparent from FIG. 2, the short focus is more distorted.

  In FIG. 2, images 12 and 22 shown in the second column from the left side show images when the image data is subjected to shift correction processing in the image processing unit 225. In this shift correction process, image processing is performed so that the left and right sides become longer as it goes upward on the screen. Therefore, the trapezoidal subject image is an original rectangle. By performing the shift correction process in this way, the distortion of the subject image is removed, and the original shape as if the subject is viewed from the front is obtained.

  In FIG. 2, images 14 a, 14 b, 24 a, and 24 b shown in the third column from the left side indicate shifted images that are displayed in live view on the display unit 301. The image processing unit 225 performs shift correction on all images, but the image display unit 301 displays a part of the shift image subjected to shift correction.

  In live view display, as will be described later with reference to FIG. 3, the user can appropriately select a cut-out position from the shift-corrected image. The images 14a and 24a are images obtained by cutting out the upper part from the shift images 12 and 22, and the images 14b and 24b are images obtained by cutting out the lower part from the shift images 12 and 22, and these images are It is a 1st example of the image recorded on an external memory. These images 14a, 14b, 24a, and 24b may be stored in an external memory.

  In FIG. 2, images 16 and 26 shown in the fourth column from the left (the rightmost column) are a second example of images recorded in the external memory. Of these images 16 and 26, white portions 16a and 26a are images generated by the shift images 12 and 22, respectively. The black portions 16b and 26b are black because there is no image data at the time of shift correction. In addition, the entire images 16c and 26c (images inside the broken line) indicate portions of the images 10 and 20 that have been subjected to shift correction processing and are displayed in live view.

  Next, the relationship between the shift operation and the display image will be described with reference to FIG. In the present embodiment, when the shift button of the operation member 235 is operated, the shift correction mode is set, and the subject image subjected to the shift correction is displayed on the display unit 301. In FIG. 3, an uncorrected image 30C is a display image on the display unit 301, and is an original image before shift correction.

  When the user rotates the rear dial 235a with the shift correction mode set, the image processing unit 225 generates an image in which the correction amount of the shift correction is changed according to the rotation amount. This generated image is displayed on the display unit 301 in accordance with the rotation direction and the rotation amount of the rear dial 235a as shown in the corrected image 30V in FIG. When the user rotates the front dial 235b, the image processing unit 225 generates an image in which the shift correction amount is changed in a direction perpendicular to the case where the rear dial 235a is operated. This generated image is displayed as an image on the display unit 301 in accordance with the rotation direction and the rotation amount of the front dial 235b, as shown in a corrected image 30H in FIG.

  In the example of FIG. 3, 10 images are shown as the corrected image 30V, and 10 images are shown as the corrected image 30H. Regardless of which of the corrected images 30V and 30H is displayed, when the shift button is operated, the image can be switched to the pre-correction image 30C. When the shift button is operated again, the corrected live view display is displayed.

  In the present embodiment, the cutout positions of the correction images 30V and 30H can be changed as described in the third column from the left in FIG. The cutout position is changed by operating the cross button 235c. That is, when the corrected image 30V is displayed (vertical tilt shooting and pseudo display), the cutout position is changed by operating the up and down buttons of the cross button 235c. When the corrected image 30H is displayed (horizontal tilt shooting and pseudo display), the cutout position is changed by operating the left and right buttons of the cross button 235c. When the cutout position is changed, the cuttable direction is indicated by a triangle or the like.

  Thus, in the present embodiment, the first operation unit (rear dial 235a, front dial 235b, etc.) for setting the shift correction amount at the time of shift correction is provided, and the image processing unit 225 has the first operation unit. Based on the shift correction amount set by the operation unit, shift correction is performed on the image data. For this reason, the user can obtain a shift image according to the user's intention by operating the first operation unit.

  In the present embodiment, the image processing unit 225 includes a second operation unit (such as a cross button 235c) for setting the cut-out position of the shift-corrected image, and the image processing unit 225 is set by the second operation unit. Based on the cutout position, the image data is cut out from the image subjected to the shift correction. For this reason, the user can cut out the image intended by the user from the shift-corrected image by operating the second operation unit.

  In this embodiment, the shift correction amount and the cutout position are set by the rear dial 235a, the front dial 235b, the cross button 235c, and the like. However, the present invention is not limited to this. The operation member may be used, or a touch panel or the like may be used.

  Next, the tilt angle that can be corrected will be described with reference to FIG. As described above, when the distance from the camera to the subject is different and the shape of the subject is distorted, a shift correction process is performed by the image processing unit 225 to generate an image similar to that obtained by pseudo-tilting. Like to do. The range in which distortion of the shape of the subject can be corrected by this shift correction processing is limited by the focal length and elevation angle (tilt angle) of the camera. The relationship between the range of the correction angle at the time of shift correction and the focal length as shown in FIG. 9 is stored in the memory 223. Therefore, the image processing unit 225 performs shift correction within the range of the correction angle stored in the memory 223.

  FIG. 9 shows an example of a tilt angle (correction angle) that can be corrected for each focal length of the lens. In this example, when the focal length is 8 mm, when the camera is in the normal position (when the camera is gripped with the longitudinal direction of the camera aligned with the horizontal direction), it is ± 18 degrees, and when the camera is in the vertical position (camera In the case of gripping with the longitudinal direction at right angles to the horizontal direction) is ± 16 degrees. Similarly, when the focal length is 150 mm, the positive position is ± 64 degrees and the vertical position is ± 62 degrees.

  In order to avoid a sense of incongruity when the focal length changes due to zooming, the correction step is uniformly ± 20 steps regardless of the focal length, and the tilt angle is equally divided. Accordingly, it is possible to correct ± 20 steps in the vertical direction (vertical direction) and ± 20 steps in the horizontal direction (horizontal direction). After the shift correction, as shown in FIG. 3, it is possible to shift the cutout position of the image. In this case, the shift step is uniformly 20 steps regardless of the correction amount.

  Next, the operation in this embodiment will be described with reference to the flowcharts shown in FIGS. Operations in these flowcharts (including flowcharts of FIGS. 11 and 13 described later) are executed by the camera body control unit 210 controlling each part of the entire camera according to a program stored in the memory 223.

  If the flow shown in FIG. 4 is entered, first, lens communication is performed (S1). Here, lens communication is performed between the camera body control unit 210 and the lens control unit 119, and various lens information such as focal length information of the photographing lens group 101 is acquired from the lens unit 100. In the present embodiment, the image processing unit 225 shift correction processing is performed using the focal length information.

  If lens communication is performed in step S1, then tilt detection is performed (S3). Here, information relating to the tilt of the camera is detected from the shake / posture detection unit 215 and the image processing unit 225. In the present embodiment, the angle at which the camera is looking up from the horizontal line (elevation angle), the angle at which the camera is looking down (declining angle), the angle pointing left from a vertical line obtained by detecting an oblique line or the like in the image, or The image processing unit 225 performs shift correction processing in accordance with the angle facing right (collectively, these angles are tilt angles or correction angles).

  Once the inclination is detected in step S3, it is next determined whether or not the shift button is on (S5). As described above, since the user operates the shift button when setting or canceling the shift correction mode, in this step, the operation member detection unit 233 determines whether or not the shift button has been operated.

  If the result of determination in step S5 is that the shift button has been turned on, the normal mode and shift correction mode are alternately changed (S7). When the shift correction mode is set, the mode is switched to the normal mode (the mode in which the shift correction mode is canceled), and when the normal mode is set, the mode is switched to the shift correction mode.

  If the normal mode and the shift correction mode are alternately switched in step S7, or if the result of determination in step S5 is that the shift button is not on, it is next determined whether or not it is shift correction mode (S9). . As described above, since the shift correction mode is set or canceled in steps S5 and S7, in this step, the determination is made based on the currently set mode.

  As a result of the determination in step S9, when the shift correction mode is not set, that is, when the normal mode is set, normal operation is executed (S11). Here, processing based on a mode set other than the shift correction mode is executed.

  If normal operation is performed in step S11, then shift assist is performed (S13). Here, in the case of a subject image that is effective when image processing by shift correction is performed, the user is informed that this is superimposed on the live view display. In this case, a notification (such as an icon) that prompts correction is displayed, or the correction image is displayed in a semi-transparent manner. As described with reference to FIGS. 2 and 3, in the case of shooting such as looking up from below, the shape of the subject is distorted. By performing shift correction, an image from which this distortion is removed can be obtained. In many cases, a general user does not know what kind of subject it is appropriate to perform shift correction. In the present embodiment, the shift correction mode is not used for such a general user. Assist the use of. Detailed operation of this shift assist will be described later with reference to FIG.

  On the other hand, if the result of determination in step S9 is shift correction mode, a shift correction operation is performed (S15). Here, the image processing unit 225 performs shift correction processing on the image data from the image sensor 203. Detailed operation of this shift correction operation will be described later with reference to FIG.

  When a shift correction operation is performed in step S15 or a shift assist is performed in step S13, live view display is performed (S17). Here, in the shift correction mode, live view display is performed on the display unit 301 based on the image data on which the shift correction processing has been performed in step S15. When the shift correction mode is not set, live view display is performed in the normal mode. When assist display is performed based on the shift assist in step S13, the shift correction mode is used for live view display. Display recommended icons.

  If live view display is performed in step S17, it is next determined whether or not the shutter button is on (S19). As described above, the shutter button in the operation member 235 is a two-stage type, and here, it is determined whether or not the shutter button is half-pressed. If the result of this determination is that the shutter button is not on, processing returns to step S1 and the above-mentioned live view display and the like are repeated.

  If the result of determination in step S19 is that the shutter button is on, AF is carried out (S21). Here, based on the image data from the image sensor 203 acquired at the timing when the shutter button is half-pressed, the AF control unit 221 performs AF by a so-called contrast method. That is, the contrast evaluation value is detected from the image data, and the focus lens position is moved to a position corresponding to the peak position of the contrast evaluation value.

  Once AF is performed in step S21, next shooting is performed (S23). When the user determines the composition and determines that the photo opportunity is present, the user fully presses the shutter button. Therefore, in this step, the operation member detection unit 233 determines whether or not the shutter button has been fully pressed. If the shutter button has been fully pressed, the exposure time is controlled by the shutter 201, and imaging is performed after the exposure time has elapsed. Image data is read from the element 203, and after the image processing unit 225 performs image processing for recording, the image data is recorded in the memory 233. When the recording ends, the process returns to step S1.

  As described above, in the camera operation flow, when the shift correction mode is not set, in the case of a subject for which the shift correction processing is effective, the shift assist is displayed superimposed on the live view display (S13). On the other hand, when the shift correction mode is set, an image subjected to the shift correction process is displayed in live view (S13).

  Next, the detailed operation of the shift assist in step S13 will be described with reference to FIG. If the shift assist flow is entered, it is first determined whether or not there is lens communication (S31). Here, as in step S1, lens communication is performed to obtain the latest focal length information.

  If the result of determination in step S31 is that there is no lens communication, the manual focal length input value is adopted (S35). Depending on the camera system, lens communication may not be possible between the lens unit 100 and the camera body 200. For example, there is a case where the lens unit 100 having no communication function is mounted, or a case where the lens unit 100 is mounted via a bellows or an intermediate lens barrel. In this case, for example, the focal length information input for preventing camera shake may be substituted, and the user may manually input the focal length information using a menu screen or the like.

  On the other hand, if the result of determination in step S31 is that there is lens communication, focal length data is received (S33). Here, the focal length information transmitted from the lens control unit 119 is acquired.

  If the focal length data is received in step S33 or if the manual focal length input value is adopted in step S35, then a correction effect determination is performed (S37). Here, when the shift correction process is performed using the focal length information acquired in steps S33 and S35 and the tilt information acquired in step S3, it is determined whether or not an image in which this effect appears. There are various methods for determining the correction effect, and details will be described later with reference to FIG.

  Once the correction effect determination is made in step S37, it is next determined whether or not there is a correction effect (S39). Here, the determination is made based on the result of the correction effect determination in step S37. If the result of this determination is that there is no correction effect, there is no need to encourage the user to use shift correction, so nothing is done and the process returns to the original flow.

  On the other hand, if the result of determination in step S39 is that there is a correction effect, correction assist display is performed (S41). Here, correction assist display (icon etc.) that recommends setting the shift correction mode superimposed on the live view display is performed. When the correction assist display is performed, the original flow is restored.

  Next, detailed operation of the correction effect determination in step S37 will be described with reference to FIG. FIG. 6 shows three examples. In the example shown in FIG. 6A, it is determined whether there is a correction effect based on the tilt angle.

  If the correction effect flow shown in FIG. 6A is entered, it is first determined whether or not the maximum correction angle / 2 is equal to or smaller than the angle (S51). Here, the maximum value (maximum correction angle) of the correction angle for each focal length shown in FIG. 9 is obtained using the focal length information acquired in steps S33 and S35. The determination is made by comparing 1/2 of the maximum angle with the tilt information (tilting angle) acquired in step S3.

  If the result of determination in step S51 is that the maximum correction angle / 2 is less than or equal to the angle, it is determined that there is a correction effect (S53). Here, the determination result is stored and used for the determination in the above-described step S39 (see FIG. 5).

  If it is determined in step S53 that the correction effect is present, a correction step corresponding to the tilt angle is set (S55). In the present embodiment, the maximum and minimum range of the correction angle is 20 steps, and a correction step is set according to the tilt information (tilting angle) acquired in step S3. By setting this correction step, a corresponding shift correction process can be immediately performed at the time of a shift correction operation described later (see S81 in FIG. 7).

  If a correction step is set in step S55, or if the result of determination in step S51 is No, the correction effect determination flow is terminated and the original flow is returned to.

  Next, correction effect determination shown in FIG. 6B will be described. In this correction effect determination, it is determined whether or not there is a correction effect depending on whether or not there is an oblique straight line in the subject image. In the case of a building looked up from below, the shape is originally a rectangle, but as described above, it is a trapezoid. In this case, since there is an oblique line, in this example, the oblique line is detected and the correction effect determination is performed.

  If the flow of FIG. 6B is entered, it is first determined whether or not an oblique straight line has been detected (S61). Here, the image processing unit 225 or the like analyzes the image data from the image sensor 203 and determines whether or not a diagonal line is included in the outline of the subject.

  As a result of the determination in step S61, if an oblique straight line is detected, it is determined that there is a correction effect (S63). Here, the determination result is stored and used for the determination in the above-described step S39 (see FIG. 5).

  If it is determined that there is a correction effect in step S53, then a correction step corresponding to the oblique line angle is set (S65). Since the oblique line angle is related to the tilt angle, the correction step is set based on the oblique line angle.

  If a correction step is set in step S65, or if the result of determination in step S61 is No, the correction effect determination flow is terminated, and the original flow is returned to.

  Next, correction effect determination shown in FIG. 6C will be described. In this correction effect determination, when the face is at the top of the screen, it is easy to look up, so in this case, it is preferable to place the camera on the upper side and shoot from the upper side. This is because when you shoot from the bottom, the legs look long, but from the shape of the mouth, it looks angry, but when you shoot from the top, it looks like a smile and the shift is corrected so that the legs look long. Because it is possible.

  If the flow of FIG. 6C is entered, it is first determined whether or not a face has been detected (S71). Here, it is determined whether or not the face detection unit 227 has detected a face. If a face is detected as a result of this determination, it is determined whether or not the face position is at the top of the screen (S73). Here, the face detection unit 227 detects the position of the face and makes a determination based on this position.

  If the result of determination in step S73 is that the face position is at the top, it is next determined that there is a correction effect (S75). Here, the determination result is stored and used for the determination in the above-described step S39 (see FIG. 5).

  If it is determined that there is a correction effect in step S75, then the maximum focal length step / 2 is set on the basis of the upper side of the image (S77). Here, with the upper side of the image as a reference, the correction step is set based on, for example, 1/2 of the maximum step determined by the focal length.

  If a correction step is set in step S77 or if the result of determination in step S61 is No, the correction effect determination flow is terminated and the original flow is returned to.

  The correction effect determination flow shown in FIG. 6C is suitable for portrait photography, and is therefore suitable when the self-timer mode or portrait mode is set, and when these modes are set. For this, the correction effect determination shown in FIG.

  In the example shown in FIG. 6C, when a face is detected and the position of the face is at the top, it is determined that there is a correction effect, and correction assist display is performed. However, the present invention is not limited to this, and correction assist display recommended to the user may be performed so that a person is photographed from above when the face is in the middle or lower part.

  FIG. 6 shows three types of correction effect determination in step S37 (see FIG. 5), but these may be combined as appropriate, or may be combined with other correction effect determinations.

  FIG. 8 shows an example of assist display. In this example, a person is photographed. Since the face is at the top of the screen (see FIG. 6C), the recommended photographing angle display 40 is displayed superimposed on the live view image. Even if the face is at the top of the screen, as described above, shooting a person from the top as much as possible looks more smile, so if the face is not at the top, turn the camera from the top. A recommended shooting angle display 40 in which the orientation of the camera is lowered may be displayed so as to shoot at a lower position.

  Next, the detailed operation of the shift correction operation (see FIG. 4) in step S15 will be described with reference to FIG. This flow shows an operation for displaying the image of the shift correction described with reference to FIG.

  In the shift correction operation flow, first, a shift correction step setting is performed (S81). Here, the shift correction step is set based on the correctable tilt angle (correction angle) described with reference to FIG. As the set value, a correction amount corresponding to the tilt angle detection may be applied, or a manual set value (initial value ± 0 = no correction) may be used. In this embodiment, 20 steps are used as described above, but the number of steps may be different. Further, the user may set manually.

  Once the shift correction step is set in step S81, the cutout step is next set (S83). As shown in FIG. 3, the cutout position can be changed. In this step, the number of steps at which the cutout position can be changed is set.

  Once the cut-out step is set in step S83, it is next determined whether or not the rear dial is rotated (S85). As described above, when the user wants to perform shift correction processing in the vertical direction (longitudinal direction), the user rotates the rear dial 235a. Therefore, in this step, the operation member detection unit 233 detects the operation state of the rear dial 235a and determines whether or not the rotation operation is performed based on the detection result.

  If the result of determination in step S85 is that the rear dial has been rotated, V shift correction step updating is performed (S87). Here, according to the operation state of the rear dial 235a, it changes to the V shift correction step corresponding to the correction image 30V of FIG.

  If the V shift correction step is updated in step S87 or if the result of determination in step S85 is that the rear dial is not rotating, it is next determined whether or not the front dial is rotating (S89). As described above, when the user wants to perform shift correction processing in the horizontal direction (lateral direction), the user rotates the front dial 235b. Therefore, in this step, the operation member detection unit 233 detects the operation state of the front dial 235b and determines whether or not a rotation operation has been performed based on the detection result.

  If the result of determination in step S89 is that the front dial is rotating, H shift correction step updating is performed (S91). Here, the H shift correction step corresponding to the corrected image 30H of FIG. 3 is changed according to the operation state of the front dial 235b.

  If the H shift correction step update is performed in step S91, or if the result of determination in step S89 is that the front dial has not rotated, it is next determined whether or not the cross button is on (S93). As described with reference to FIG. 3, the user operates the cross button 235c to change the cutout position of the corrected image. Therefore, in this step, the operation member detection unit 233 detects the operation state of the up / down / left / right buttons of the cross button 235c and makes a determination based on the detection result.

  If the result of determination in step S93 is that the cross button is on, the cutout step is updated (S95). Here, every time the cross button 235c is operated, the cutout step is updated in the direction corresponding to the operation of the up / down / left / right button.

  If the cutout step is updated in step S95, or if the result of determination in step S93 is that the cross button is not on, it is next determined whether or not the OK button is on for 2 seconds (S97). The OK button is a button arranged at the center of the cross button 235c. In this step, the operation member detection unit 233 detects the operation state of the OK button and makes a determination based on the detection result. Note that 2 seconds is merely an example, and it may be an appropriate time for the user to perform the reset operation.

  If the result of determination in step S97 is that the OK button is on for 2 seconds, the shift correction step and cutout step are reset (S99). The reset value of the shift correction step may be no correction (30c in FIG. 3), or may be a shift step according to inclination detection. The reset of the cutout position is set to the edge of the image serving as a reference for shift correction.

  When the cut-out step reset of the shift correction step is performed in step S99, or if the result of determination in step S97 is that the OK button has not been turned on for 2 seconds, the shift correction operation flow is terminated and the original flow is returned to. . When returning to the original flow, the process in the shift correction operation is reflected in the live view display in step S17.

  As described above, in the flow of the shift correction operation, the shift correction correction amount can be changed and the cutout position can be changed according to the operation of the rear dial 235a, the front dial 235b, the cross button 235c, and the like. For this reason, it is possible to generate a tilt shot image intended by the user.

  Next, setting of the AF point at the time of AF in step S21 (see FIG. 4) will be described using FIG. When the shift correction process is performed, not all images are displayed, but only a part of the screen is displayed according to the change of the shift correction step or the change of the cutout position. With this change, the AF point may go out of the screen. In the present embodiment, since there is image data of all images, the AF point can be maintained, but the position of the AF point cannot be displayed on the screen. In such a case, the direction in which the AF point is present is displayed.

  10A and 10B show all images that are not subjected to shift correction processing, and FIGS. 10C and 10D show shift correction images that are subjected to shift correction processing. The shift-corrected image is only a part of the entire image in order to perform shift correction. Since both the AF point 40a in FIG. 10 (a) and the AF point 40b in FIG. 10 (b) display all images, the AF point is also displayed.

  However, in the case of the shift corrected image, since the entire image is not displayed, the AF point may not be displayed. The AF point 40c in FIG. 10C is displayed because it is in the shift correction image, and the AF point 40c is focused. However, the AF point 40d in FIG. 10D has no corresponding position in the screen of FIG. 10D because the shift-corrected image is cut out. However, since it is inconvenient for shooting if the user does not know the AF point position at all, the AF point 40d is displayed, and the direction in which the AF point exists is indicated by an arrow 41.

  Next, an AF point display operation when shift correction is performed will be described with reference to FIG. The AF point display described with reference to FIG. 10 is executed by the flowchart shown in FIG. This flow starts when the shutter button is half-pressed in step S19 (FIG. 4).

  When the in-shift AF flow shown in FIG. 11 is entered, first, AF is executed at a selected point (S101). The selection point for AF is, for example, the position of the face detected by the face detection unit 227, the position arbitrarily designated by the user, or the like. When the selection point is determined, the AF control unit 221 performs AF control based on the image data from the selection point.

  If AF is executed at the selected point in step S101, it is next determined whether or not the AF point is within the live view image area (S103). As described above, when the shift correction operation is performed, the entire image is not displayed on the display unit 301. For this reason, the AF point may not be displayed. In this step, it is determined whether or not the point selected in step S101 is included in the live view image.

  If the result of determination in step S103 is that the AF point is within the area of the live view image, the AF point of the live view image is superimposed and displayed (S105). Here, as shown in FIG. 10C, the AF point 40c is superimposed on the live view image.

  On the other hand, if the result of determination in step S103 is that the AF point is in the vicinity of the live view image, the AF point and an arrow are superimposed and displayed (S107). Here, as shown in FIG. 10D, the AF point 40d and the arrow 41 are superimposed and displayed on the live view image.

  When the AF point or the like is displayed in step S105 or S107, next, an in-focus mark display and in-focus sound generation are performed (S109). As a result of the AF control, if it is in focus, a focus mark 43 (see FIG. 10D) is performed, and a sound for notifying that the focus is achieved is generated. When this process is performed, the AF process during shifting is terminated and the process returns to the original flow.

  As described above, in the AF during the shift, when the AF point is outside the shift corrected image as a result of the shift correction process, the focus detection at the AF point is maintained, and the AF point is displayed at the AF point. The direction is displayed. For this reason, the user can easily recognize that there is an AF point outside the screen. In the present embodiment, the arrow is used to display the direction in which the AF point is present. However, the present invention is not limited to this, and is not limited to the arrow if the direction is known.

  In the present embodiment, when the AF point is outside the display unit 301, the direction is indicated. However, the present invention is not limited to this. For example, the position of the image subjected to the shift correction process may be moved so that the AF point is in the display unit 301. The amount of movement in this case may be such that it moves to a position close to the peripheral edge within the display range.

  Also, when an AF point is selected (for example, when the shutter button is half-pressed), the shift correction mode is temporarily canceled and all images are displayed in live view, and at that time, the AF point is superimposed and displayed. May be. In this case, after the AF point is displayed for a predetermined time, the shift correction mode may be restored.

  Further, when an AF point is selected, in addition to the shift image, the entire image may be displayed as an auxiliary image in the right corner, the left corner, etc., and the AF point may be displayed in this auxiliary image.

  Next, enlarged display during live view display in step S17 (see FIG. 4) will be described with reference to FIG. The enlarged display is useful for confirming the focus after AF, or for manual focusing using a focus ring. Therefore, high resolution is required. FIG. 12B shows an entire image when shift correction is not performed. In this whole image, as shown in the figure, the originally rectangular shape is distorted into a trapezoid. FIG. 12A shows an image obtained by performing shift correction processing so that a distorted trapezoid becomes an original rectangle.

  When the area 50A in FIG. 12A is enlarged as it is, the area 50a shown in FIG. However, in order to perform shift correction, the resolution of the image in the region 50A is lowered, and when the image is further enlarged in the region 50a, the resolution is considerably lowered. Therefore, in this embodiment, the image of the region 50B before the shift correction is enlarged as it is and displayed as a region 50b as shown in FIG. Since the region 50B is not shift-corrected, the resolution of the image is high, and even if it is enlarged, the resolution is sufficient.

  Next, an enlarged display operation when shift correction is performed will be described with reference to FIG. The enlarged display described with reference to FIG. 12 is executed by the flowchart shown in FIG. This flow is executed when an enlargement display instruction is given during execution of step S17 (FIG. 4).

  When the live view display flow shown in FIG. 13 is entered, it is first determined whether or not the enlarge button is on (S111). Here, it is determined whether the enlarge button in the operation member 235 has been operated.

  If the result of determination in step S111 is that the enlarge button has been operated, enlargement is switched on and off (S113). When the enlargement on is set, when the enlargement button is operated, the enlargement is turned off and the normal display is performed. When enlargement off is set, when the enlarge button is operated, enlargement is turned on and the display unit 301 displays the enlarged image.

  If enlargement on / off is switched in step S113, or if the result of determination in step S111 is that the enlargement button is not on, then the enlargement frame coordinates are converted to imaging coordinates (S115). During normal (without shift correction) live view display, the coordinates of the enlarged frame on the monitor and the coordinates of the live view image match. However, when shift correction is in progress, the coordinates of the enlarged frame on the monitor are the same after the shift correction. Since it is superimposed and displayed on the corrected live view display, this is matched with the original image coordinates on the imaging.

  Once the coordinates are converted in step S115, it is next determined whether or not enlargement is in progress (S117). Here, the determination is made based on the setting of enlargement on or off in step S113.

  If the result of determination in step S117 is that enlargement is not in progress, all region pixel addition readout is performed (S119). Here, addition reading is performed on the pixels in the entire region from the image sensor 203. Subsequently, it is determined whether or not shift correction is being performed (S121). If it is determined in step S9 (FIG. 4) that the shift correction mode is set, shift correction is performed in step S15. In this step, the determination is made based on whether or not this shift correction is performed.

  If the result of determination in step S121 is that shift correction is not in progress, live image display without correction is performed (S125). Here, since no enlargement instruction is given and shift correction is not being performed, all images without correction as shown in FIG. 12B are displayed.

  On the other hand, if the result of determination in step S121 is that shift correction is being performed, live view display of the corrected image is performed (S123). Here, since an enlargement instruction has not been given and shift correction is being performed, an image subjected to shift correction as shown in FIG. 12A is displayed.

  Returning to step S117, if the result of this determination is that enlargement is in progress, readout of all pixels in the enlarged region is performed (S127). Here, the image data of all the pixels of the image sensor 203 is read out from the designated enlarged region.

  Once all the pixels in the enlarged area have been read in step S127, an enlarged live view image without correction is displayed (S129). Here, an enlarged image as shown in FIG. 12D is displayed for the designated enlarged region using image data that has not undergone shift correction. Since this enlarged image is not a shift-corrected image but uses image data read from the enlarged region, distortion remains in the shape, but the resolution is not lowered as shown in FIG. And high-resolution display can be performed.

  When live view display is performed in steps S123 and S125, an enlarged frame is superimposed and displayed (S131). Here, an enlarged frame indicating the position of the enlarged area is displayed superimposed on the live view display. When the enlarged frame superimposed display is performed, the original flow is restored.

  In this way, when the shift correction mode is set and an enlargement display instruction is given, enlargement display is performed using image data that has not been subjected to shift correction. For this reason, even if enlarged display is performed, the resolution of the image does not decrease, and accurate focus confirmation and focusing can be performed.

  As described above, in one embodiment of the present invention, it is determined whether or not the shift correction by the image processing unit is effective (see, for example, S37 in FIG. 4), and the shift correction is determined to be effective as a result of this determination. In such a case, assist display is performed on the image display unit (see, for example, S39 and S41 in FIG. 4). For this reason, it is possible to advise use of image processing equivalent to tilt shooting, and even a user who cannot perform tilt shooting can effectively utilize shift correction.

  In one embodiment of the present invention, an AF point is selected for a subject (see, for example, S101 in FIG. 11), and the subject image is displayed on the image display unit based on the image data subjected to shift correction. When the selected AF point is outside the image display unit (for example, refer to S103 No in FIG. 11), the fact that it is outside is notified (for example, S107 in FIG. 11). reference). For this reason, it is not necessary to change the composition even when the AF point deviates from the corrected image as a result of the tilt correction process.

  In one embodiment of the present invention, the image display unit has an enlargement instruction unit (for example, an enlargement button in the operation member 235) for enlarging and displaying a part of the subject image, and shift correction is performed by the image processing unit. When the enlarged display is instructed by the enlargement instruction unit while the displayed image is displayed on the image display unit (for example, S111 in FIG. 13), the image data that has not undergone shift correction is Processing for enlargement display is performed, and enlargement display is performed on the image display unit (for example, S129 in FIG. 13). For this reason, when the tilt correction process is being performed and the enlargement display is instructed, it is possible to prevent a reduction in the resolution of the image.

  In the embodiment of the present invention, a digital camera is used as an apparatus for photographing. However, the camera may be a digital single-lens reflex camera or a compact digital camera, such as a video camera or a movie camera. It may be a camera for moving images, and may be a camera incorporated in a mobile phone, a smartphone, a personal digital assistant (PDA), a personal computer (PC), a tablet computer, a game machine, or the like. In any case, the present invention can be applied to any device capable of performing image processing capable of obtaining the same effect as tilt shooting.

  Of the techniques described in this specification, the control mainly described in the flowchart is often settable by a program and may be stored in a recording medium or a recording unit. The recording method for the recording medium and the recording unit may be recorded at the time of product shipment, may be a distributed recording medium, or may be downloaded via the Internet.

  In addition, regarding the operation flow in the claims, the specification, and the drawings, even if it is described using words expressing the order such as “first”, “next”, etc. It does not mean that it is essential to implement in this order.

  The present invention is not limited to the above-described embodiments as they are, and can be embodied by modifying the constituent elements without departing from the scope of the invention in the implementation stage. In addition, various inventions can be formed by appropriately combining a plurality of components disclosed in the embodiment. For example, you may delete some components of all the components shown by embodiment. Furthermore, constituent elements over different embodiments may be appropriately combined.

DESCRIPTION OF SYMBOLS 100 ... Lens part, 101 ... Shooting lens group, 103 ... Aperture, 105 ... Focus ring, 107 ... Zoom ring, 111 ... Lens position detection part, 113 ... Lens drive 115, aperture control unit, 117 ... rotation detection unit, 119 ... lens control unit, 200 ... camera body, 201 ... shutter, 203 ... image sensor, 205 ... Shake correction mechanism, 210 ... camera body control unit, 211 ... AF auxiliary light, 213 ... imaging control unit, 215 ... blur / posture detection unit, 217 ... blur correction control unit, 219 ..Shutter control unit, 221 ... AF control unit, 223 ... memory, 225 ... image processing unit, 227 ... face detection unit, 229 ... exposure control unit, 231 ... display control Part, 233... Operation part Detection unit, 235, operation member, 237, bus, 300, monitor, 301, display unit, 303, touch panel, 305, touch panel control unit, 307, position detection unit 310 ... Monitor angle detector

Claims (10)

An imaging unit that photoelectrically converts a subject image and outputs image data;
An image display unit for displaying the subject image based on the image data;
An inclination detector for detecting the inclination of the imaging device;
An image processing unit that performs shift correction on the image data;
A determination unit that determines whether or not the shift correction by the image processing unit is valid based on the tilt detected by the tilt detection unit;
An assist display control unit that performs an assist display on the image display unit when the determination unit determines that the shift correction is effective;
An imaging device comprising: A focal length information acquisition unit for acquiring focal length information of the photographing lens;
The imaging apparatus according to claim 1, wherein the determination unit determines whether the shift correction is valid based on the focal length information acquired by the focal length information acquisition unit. The image processing unit detects an oblique line in the image based on the image data,
The imaging apparatus according to claim 1, wherein the determination unit determines whether the shift correction is valid based on oblique line information in the image detected by the image processing unit. A face detection unit for detecting the position of the face based on the image data;
The imaging apparatus according to claim 1, wherein the determination unit determines whether the shift correction is effective based on the position of the face detected by the face detection unit. A first operation unit for setting a shift correction amount at the time of the shift correction;
The imaging apparatus according to claim 1, wherein the image processing unit performs the shift correction on the image data based on the shift correction amount set by the first operation unit. A second operation unit for setting the cut-out position of the shift-corrected image;
2. The image processing unit according to claim 1, wherein the image processing unit extracts the image data from the image on which the shift correction has been performed based on the extraction position set by the second operation unit. Imaging device. A storage unit for storing a relationship between a correction angle range at the time of the shift correction and a focal length;
The imaging apparatus according to claim 1, wherein the image processing unit performs the shift correction within a range of the correction angle stored in the storage unit.   The imaging apparatus according to claim 1, wherein the image display unit displays a part of the shift image subjected to the shift correction by the image processing unit. Photoelectrically convert the subject image and output image data,
The subject image is displayed on the image display unit based on the image data,
Detect the tilt of the imaging device,
Shift correction is performed on the above image data,
Based on the detected inclination, it is determined whether the shift correction is effective,
When the shift correction is determined to be valid by the determination, an assist display is performed on the image display unit.
An imaging method characterized by the above. In the computer provided in the imaging device,
Photoelectrically convert the subject image and output image data,
The subject image is displayed on the image display unit based on the image data,
Detecting the tilt of the imaging device,
Shift correction is performed on the above image data,
Based on the detected inclination, it is determined whether the shift correction is effective,
When the shift correction is determined to be valid by the determination, an assist display is performed on the image display unit.
A program characterized by causing execution.