JP2009111587A - Imaging apparatus - Google Patents

Abstract

<P>PROBLEM TO BE SOLVED: To provide an imaging apparatus which can easily acquiring a subject image of proper image quality. <P>SOLUTION: An imaging apparatus includes an imaging device including a Gr line L1 and a Gb line L2 comprising normal pixels 110, can outputting image signals relating to a subject light image passing a photographic optical system; and an AF line Lf, wherein a pair of pixels 11a and 11b receiving subject luminous fluxes passing through a pair of partial areas in an exit pupil of the photographic optical system are arranged in the horizontal direction; the imaging device having this configuration is exposed during actual photographing, to make he Gr line L1 and the Gb line L2 output image signals of a subject and to make the AF line (focus detection pixel column) Lf output a pixel column signal. Then focus restoration processing, based on a defocus amount obtained by performing focus detection in a phase difference detection system, on the basis of the pixel column signal is executed on the image signals, whereby the subject image of good image quality can be acquired readily. <P>COPYRIGHT: (C)2009,JPO&INPIT

Description

  The present invention relates to an imaging apparatus having a photographing optical system.

  In a single-lens reflex digital camera or the like, a phase difference that performs focus detection (hereinafter also referred to as “phase difference AF”) using an image sensor that generates an image signal and a phase difference detection method by receiving light from a subject. An apparatus provided with an AF module is known.

  However, in the imaging device and the phase difference AF module described above, the optical path for receiving the subject light that has passed through the photographing lens is different. Therefore, AF operation using the phase difference AF module (focus control) due to secular change or the like. The focus position (focus position) obtained by the above is shifted from the imaging surface of the image sensor, and a low-quality image with a blurred focus is generated by the image sensor.

  As a method for improving such a problem, there is an AF technique disclosed in Patent Document 1, for example. In this AF technique, after performing coarse focus adjustment by the phase difference AF module, fine focus adjustment is performed by focus detection (hereinafter also referred to as “contrast AF”) by a contrast detection method using an image sensor, thereby achieving focus adjustment. Acquisition of a good subject image with improved deviation is attempted.

JP 2006-84545 A

  However, since the AF technique of Patent Document 1 requires contrast AF, a control configuration thereof is necessary, and it is difficult to easily obtain a subject image with good image quality.

  Further, in the AF technique disclosed in Patent Document 1, when the subject moves between the AF completion time and the exposure start of the image sensor, the focus position may deviate from the imaging surface of the image sensor. In this case, a subject image with good image quality cannot be acquired appropriately.

  The present invention has been made in view of the above problems, and an object thereof is to provide an imaging apparatus that can easily acquire a subject image with good image quality.

  One aspect of the present invention is an imaging apparatus having a photographic optical system, wherein (a) a pixel array capable of outputting an image signal related to a subject optical image that has passed through the photographic optical system, and emission of the photographic optical system An imaging device having a focus detection pixel array in which two or more pairs of pixels that receive each of the subject luminous fluxes that have passed through the pair of partial regions in the pupil are arranged in a predetermined direction; and (b) exposing the imaging device. Output control means for outputting the image signal from the pixel array and outputting a pixel array signal from the focus detection pixel array; and (c) a phase difference detection method based on the pixel array signal output by the output control means (D) a predetermined image based on the defocus amount obtained by the focus detection unit with respect to the image signal output by the output control unit. Characterized in that it comprises an image processing means for executing management.

  According to the present invention, the image sensor is exposed to output an image signal related to a subject light image that has passed through the photographing optical system, and each of the subject light fluxes that has passed through a pair of partial areas in the exit pupil of the photographing optical system is received. Defocus amount obtained by outputting a pixel column signal from a focus detection pixel column in which two or more pairs of pixels are arranged along a predetermined direction and then performing focus detection by a phase difference detection method based on the pixel column signal The predetermined image processing based on the above is executed on the image signal. Thereby, a subject image with good image quality can be easily acquired.

<Appearance configuration of imaging device>
1 and 2 are diagrams showing an external configuration of an imaging apparatus 1 according to the embodiment of the present invention. Here, FIGS. 1 and 2 show a front view and a rear view, respectively.

  The imaging device 1 is configured as, for example, a single-lens reflex digital still camera, and includes a camera body 10 and an interchangeable lens 2 as a photographic lens that can be attached to and detached from the camera body 10.

  In FIG. 1, on the front side of the camera body 10, a mount part 301 to which the interchangeable lens 2 is mounted at the front center and a lens exchange button 302 arranged on the right side of the mount part 301 can be gripped. A grip section 303, a mode setting dial 305 disposed in the upper left portion of the front surface, a control value setting dial 306 disposed in the upper right portion of the front surface, and a shutter button 307 disposed on the upper surface of the grip portion 303 are provided. .

  In FIG. 2, on the rear side of the camera body 10, there are an LCD (Liquid Crystal Display) 311, a setting button group 312 arranged on the left side of the LCD 311, and a cross key 314 arranged on the right side of the LCD 311. And a push button 315 disposed in the center of the cross key 314. On the back side of the camera body 10, an optical finder 316 disposed above the LCD 311, an eye cup 321 surrounding the optical finder 316, and a main switch 317 disposed on the left side of the optical finder 316. An exposure correction button 323 and an AE lock button 324 disposed on the right side of the optical viewfinder 316, and a flash unit 318 and a connection terminal unit 319 disposed above the optical viewfinder 316.

  The mount 301 is provided with a connector Ec (see FIG. 5) for electrical connection with the mounted interchangeable lens 2 and a coupler 75 (see FIG. 5) for mechanical connection.

  The lens exchange button 302 is a button that is pressed when the interchangeable lens 2 attached to the mount unit 301 is removed.

  The grip part 303 is a part where the user grips the imaging device 1 at the time of photographing, and is provided with surface irregularities that match the finger shape in order to improve fitting properties. Note that a battery storage chamber and a card storage chamber (not shown) are provided inside the grip portion 303. A battery 69B (see FIG. 5) is housed in the battery compartment as a power source for the camera, and a memory card 67 (see FIG. 5) for recording image data of the photographed image is detachably housed in the card compartment. It has come to be. The grip unit 303 may be provided with a grip sensor for detecting whether or not the user has gripped the grip unit 303.

  The mode setting dial 305 and the control value setting dial 306 are made of a substantially disk-shaped member that can rotate in a plane substantially parallel to the upper surface of the camera body 10. The mode setting dial 305 is used for various shootings such as an automatic exposure (AE) control mode, an autofocus (AF) control mode, a still image shooting mode for shooting a single still image, and a continuous shooting mode for continuous shooting. This mode is used to selectively select a mode and a function installed in the imaging apparatus 1, such as a mode and a reproduction mode for reproducing a recorded image. On the other hand, the control value setting dial 306 is for setting control values for various functions installed in the imaging apparatus 1.

  The shutter button 307 is a push switch that can be operated in a “half-pressed state” that is pressed halfway and further operated in a “full-pressed state”. When the shutter button 307 is half-pressed in the still image shooting mode, a preparatory operation (preparation operation for setting an exposure control value, focus detection, etc.) for capturing a still image of the subject is executed, and the shutter button 307 is fully pressed. Then, a photographing operation (a series of operations for exposing the image sensor 101 (see FIG. 3), performing predetermined image processing on the image signal obtained by the exposure, and recording the image signal on a memory card or the like) is performed.

  The LCD 311 includes a color liquid crystal panel capable of displaying an image. The LCD 311 displays an image picked up by the image pickup device 101 (see FIG. 3), reproduces and displays a recorded image, and is mounted on the image pickup apparatus 1. Function and mode setting screen. Note that an organic EL or a plasma display device may be used instead of the LCD 311.

  The setting button group 312 is a button for performing operations on various functions installed in the imaging apparatus 1. The setting button group 312 includes, for example, a selection confirmation switch for confirming the content selected on the menu screen displayed on the LCD 311, a selection cancel switch, a menu display switch for switching the content of the menu screen, a display on / off switch, A display enlargement switch is included.

  The cross key 314 has an annular member having a plurality of pressing portions (triangle marks in the figure) arranged at regular intervals in the circumferential direction, and is not shown and provided corresponding to each pressing portion. The pressing operation of the pressing portion is detected by the contact (switch). The push button 315 is arranged at the center of the cross key 314. The cross key 314 and the push button 315 are used to change the shooting magnification (movement of the zoom lens 212 (see FIG. 5) in the wide direction or the tele direction), frame-by-frame feeding of a recorded image to be reproduced on the LCD 311 and the like, and shooting conditions (aperture value). , Shutter speed, presence / absence of flash emission, etc.) for inputting instructions.

  The optical viewfinder 316 optically displays a range where a subject is photographed. In other words, the subject image from the interchangeable lens 2 is guided to the optical finder 316, and the user can visually recognize the subject actually captured by the image sensor 101 by looking into the optical finder 316. .

  The main switch 317 is a two-contact slide switch that slides to the left and right. When the switch is set to the left, the power of the imaging apparatus 1 is turned on, and when the switch is set to the right, the power is turned off.

  The flash unit 318 is configured as a pop-up built-in flash. On the other hand, when attaching an external flash or the like to the camera body 10, the connection is made using the connection terminal portion 319.

  The eye cup 321 is a “U” -shaped light shielding member that has light shielding properties and suppresses intrusion of external light into the optical viewfinder 316.

  The exposure correction button 323 is a button for manually adjusting an exposure value (aperture value or shutter speed), and the AE lock button 324 is a button for fixing exposure.

  The interchangeable lens 2 functions as a lens window that captures light (light image) from a subject, and also functions as a photographing optical system that guides the subject light to the image sensor 101 disposed inside the camera body 10. It is. The interchangeable lens 2 can be detached from the camera body 10 by depressing the lens interchange button 302 described above.

  The interchangeable lens 2 includes a lens group 21 including a plurality of lenses arranged in series along the optical axis LT (see FIG. 5). The lens group 21 includes a focus lens 211 (see FIG. 5) for adjusting the focal point and a zoom lens 212 (see FIG. 5) for performing zooming. By driving in the direction (see FIG. 3), zooming and focus adjustment are performed. Further, the interchangeable lens 2 is provided with an operation ring that can rotate along the outer peripheral surface of the lens barrel at a suitable position on the outer periphery of the lens barrel. The zoom lens 212 can be operated by manual operation or automatic operation. It moves in the optical axis direction according to the rotation direction and rotation amount of the operation ring, and is set to a zoom magnification (imaging magnification) according to the position of the movement destination.

<Internal Configuration of Imaging Device 1>
Next, the internal configuration of the imaging apparatus 1 will be described. FIG. 3 is a longitudinal sectional view of the imaging apparatus 1. As shown in FIG. 3, the camera body 10 includes an image sensor 101, a finder unit 102 (finder optical system), a mirror unit 103, a phase difference AF module 107, and the like.

  The imaging element 101 is arranged in a direction perpendicular to the optical axis LT on the optical axis LT of the lens group included in the interchangeable lens 2 when the interchangeable lens 2 is attached to the camera body 10. . As the image sensor 101, for example, a CMOS color area sensor (CMOS type image sensor) in which a plurality of pixels configured with photodiodes are two-dimensionally arranged in a matrix is used. The image sensor 101 generates analog electrical signals (image signals) of R (red), G (green), and B (blue) color components related to the subject light image formed through the interchangeable lens 2, and R, Output as image signals of G and B colors. The configuration of the image sensor 101 will be described in detail later.

  On the optical axis LT, a mirror unit 103 is disposed at a position where subject light is reflected toward the viewfinder unit 102. The subject light that has passed through the interchangeable lens 2 is reflected upward by a mirror unit 103 (a main mirror 1031 described later). Part of the subject light that has passed through the interchangeable lens 2 passes through the mirror unit 103.

  The viewfinder unit 102 includes a pentaprism 105, an eyepiece lens 106, and an optical viewfinder 316. The pentaprism 105 has a pentagonal cross section, and is a prism for converting an object light image incident from the lower surface thereof into an upright image by changing the top and bottom of the light image by internal reflection. The eyepiece 106 guides the subject image that has been made upright by the pentaprism 105 to the outside of the optical viewfinder 316. With such a configuration, the finder unit 102 functions as a finder for confirming the object scene at the time of shooting standby before actual shooting.

  The mirror unit 103 includes a main mirror 1031 and a sub mirror 1032, and is provided on the back side of the main mirror 1031 so that the sub mirror 1032 is tilted toward the back of the main mirror 1031. Part of the subject light transmitted through the main mirror 1031 is reflected by the sub mirror 1032, and the reflected subject light enters the phase difference AF module 107.

  The mirror unit 103 is configured as a so-called quick return mirror, and during exposure (main photographing), as shown in FIG. 4, the mirror unit 103 jumps upward with a rotating shaft 1033 as a rotation fulcrum. At this time, the sub mirror 1032 is folded so as to be substantially parallel to the main mirror 1031 when the mirror unit 103 stops at a position below the pentaprism 105. As a result, the subject light from the interchangeable lens 2 reaches the image sensor 101 without being blocked by the mirror unit 103, and the image sensor 101 is exposed. When the imaging operation with the imaging element 101 is completed, the mirror unit 103 returns to the original position (position shown in FIG. 3).

  In addition, by setting the mirror unit 103 in the mirror-up state shown in FIG. 4 before the main shooting (shooting for image recording), the imaging device 1 can perform moving image processing based on image signals sequentially generated by the imaging device 101. In this manner, live view (preview) display in which the subject is displayed on the LCD 311 is possible. In other words, in the imaging apparatus 1 before the actual photographing, the composition of the subject can be determined by selecting the electronic viewfinder (live view mode) in which the live view display is performed or the optical viewfinder. Note that switching between the electronic viewfinder and the optical viewfinder is performed by operating the changeover switch 85 shown in FIG.

  The phase difference AF module 107 is configured as a so-called AF sensor including a distance measuring element (pixel) that detects focus information of a subject. The phase difference AF module 107 is disposed at the bottom of the mirror unit 103 and detects a focus position by phase difference detection type focus detection (hereinafter also referred to as “phase difference AF”). That is, when the user checks the subject with the optical viewfinder 316 during shooting standby, the light from the subject is guided to the phase difference AF module 107 with the main mirror 1031 and the sub mirror 1032 down as shown in FIG. At the same time, the focus lens 211 in the interchangeable lens 2 is driven based on the output from the phase difference AF module 107 to perform focusing.

  A shutter unit 40 is disposed in front of the image sensor 101 in the optical axis direction. The shutter unit 40 includes a curtain body that moves in the vertical direction, and a mechanical focal plane that performs an optical path opening operation and an optical path blocking operation of subject light guided to the image sensor 101 along the optical axis LT by the opening operation and the closing operation. It is configured as a shutter. The shutter unit 40 can be omitted when the image sensor 101 is an image sensor capable of complete electronic shutter.

<Electrical Configuration of Imaging Device 1>
FIG. 5 is a block diagram illustrating an electrical configuration of the imaging apparatus 1. Here, the same members and the like as those in FIGS. 1 to 4 are denoted by the same reference numerals. For convenience of explanation, the electrical configuration of the interchangeable lens 2 will be described first.

  The interchangeable lens 2 includes a lens driving mechanism 24, a lens position detection unit 25, a lens control unit 26, and a diaphragm driving mechanism 27 in addition to the lens group 21 described above.

  In the lens group 21, a focus lens 211 and a zoom lens 212, and a diaphragm 23 for adjusting the amount of light incident on the image sensor 101 provided in the camera body 10 are arranged in the lens barrel 22 with an optical axis LT (FIG. 3). ), And captures an optical image of the subject and forms it on the image sensor 101. In the AF control, focus adjustment is performed by driving the focus lens 211 in the optical axis LT direction by the AF actuator 71M in the interchangeable lens 2.

  The focus drive control unit 71A generates a drive control signal for the AF actuator 71M necessary for moving the focus lens 211 to the in-focus position based on the AF control signal given from the main control unit 62 via the lens control unit 26. Is to be generated. The AF actuator 71M is composed of a stepping motor or the like, and applies a lens driving force to the lens driving mechanism 24.

  The lens driving mechanism 24 includes, for example, a helicoid and a gear (not shown) that rotates the helicoid, and receives the driving force from the AF actuator 71M to drive the focus lens 211 and the like in a direction parallel to the optical axis LT. It is. Note that the movement direction and the movement amount of the focus lens 211 are in accordance with the rotation direction and the rotation speed of the AF actuator 71M, respectively.

  The lens position detection unit 25 moves integrally with the lens while being in sliding contact with the encode plate in which a plurality of code patterns are formed at a predetermined pitch in the optical axis LT direction within the movement range of the lens group 21. An encoder brush, and detects the amount of movement of the lens group 21 during focus adjustment. The lens position detected by the lens position detection unit 24 is output as the number of pulses, for example.

  The lens control unit 26 is composed of, for example, a microcomputer having a built-in memory such as a ROM that stores a control program and a flash memory that stores data related to status information.

  The lens control unit 26 has a communication function for performing communication with the main control unit 62 of the camera body 10 via the connector Ec. Thereby, for example, the state information data such as the focal length, the exit pupil position, the aperture value, the focusing distance, and the peripheral light amount state of the lens group 21 and the position information of the focus lens 211 detected by the lens position detection unit 25 are main-controlled. For example, the driving amount data of the focus lens 211 can be received from the main control unit 62.

  The aperture drive mechanism 27 receives the driving force from the aperture drive actuator 76M via the coupler 75 and changes the aperture diameter of the aperture 23.

  Next, the electrical configuration of the camera body 10 will be described. The camera body 10 includes an AFE (analog front end) 5, an image processing unit 61, an image memory 614, a main control unit 62, a flash circuit 63, and an operation unit 64 in addition to the image sensor 101 and the shutter unit 40 described above. , VRAM 65, card I / F 66, memory card 67, communication I / F 68, power supply circuit 69, battery 69B, mirror drive control unit 72A and mirror drive actuator 72M, shutter drive control unit 73A and shutter drive actuator 73M, aperture drive control A portion 76A and a diaphragm drive actuator 76M are provided.

  The image sensor 101 is composed of a CMOS color area sensor as described above, and the timing control circuit 51 described below starts (and ends) the exposure operation of the image sensor 101 and selects the output of each pixel included in the image sensor 101. The imaging operation such as readout of the pixel signal is controlled.

  The AFE 5 gives a timing pulse for causing the image sensor 101 to perform a predetermined operation, performs predetermined signal processing on the image signal output from the image sensor 101, converts the image signal to a digital signal, and outputs the digital signal to the image processing unit 61. To do. The AFE 5 includes a timing control circuit 51, a signal processing unit 52, an A / D conversion unit 53, and the like.

  The timing control circuit 51 generates a predetermined timing pulse (a pulse for generating a vertical scanning pulse φVn, a horizontal scanning pulse φVm, a reset signal φVr, etc.) based on the reference clock output from the main control unit 62, and the imaging device 101. And the imaging operation of the image sensor 101 is controlled. In addition, the operation of the signal processing unit 52 and the A / D conversion unit 53 is controlled by outputting predetermined timing pulses to the signal processing unit 52 and the A / D conversion unit 53, respectively.

  The signal processing unit 52 performs predetermined analog signal processing on the analog image signal output from the image sensor 101. The signal processing unit 52 includes a CDS (correlated double sampling) circuit, an AGC (auto gain control) circuit, a clamp circuit, and the like. The A / D conversion unit 53 converts the analog R, G, B image signals output from the signal processing unit 52 into a plurality of bits (for example, 12 bits) based on the timing pulse output from the timing control circuit 51. Is converted into a digital image signal.

  The image processing unit 61 performs predetermined signal processing on the image data output from the AFE 5 to create an image file, and includes a black level correction circuit 611, a white balance control circuit 612, a gamma correction circuit 613, and the like. Has been. The image data captured by the image processing unit 61 is temporarily written in the image memory 614 in synchronization with the reading of the image sensor 101. Thereafter, the image data written in the image memory 614 is accessed to access the image processing unit. Processing is performed in each of the 61 blocks.

  The black level correction circuit 611 corrects the black level of each of the R, G, and B digital image signals A / D converted by the A / D conversion unit 53 to a reference black level.

  The white balance correction circuit 612 performs level conversion (white balance (WB) adjustment) of digital signals of each color component of R (red), G (green), and B (blue) based on a white reference corresponding to the light source. Is what you do. That is, the white balance control circuit 612 identifies a portion that is originally estimated to be white based on luminance, saturation data, and the like in the photographic subject based on the WB adjustment data provided from the main control unit 62, and R, G of that portion. , B, the average of the respective color components, the G / R ratio and the G / B ratio are obtained, and the levels are corrected as R and B correction gains.

  The gamma correction circuit 613 corrects the gradation characteristics of the image data subjected to WB adjustment. Specifically, the gamma correction circuit 613 performs non-linear conversion and offset adjustment using a gamma correction table set in advance for each color component.

  The image memory 614 temporarily stores the image data output from the image processing unit 61 in the photographing mode, and is also used as a work area for performing predetermined processing on the image data by the main control unit 62. It is. In the playback mode, the image data read from the memory card 67 is temporarily stored.

  The main control unit 62 is composed of a microcomputer including a storage unit such as a ROM for storing a control program and a RAM for temporarily storing data, and controls the operation of each unit of the imaging apparatus 1.

  The flash circuit 63 controls the light emission amount of the external flash connected to the flash unit 318 or the connection terminal unit 319 to the light emission amount set by the main control unit 62 in the flash photographing mode.

  The operation unit 64 includes the mode setting dial 305, the control value setting dial 306, the shutter button 307, the setting button group 312, the cross key 314, the push button 315, the main switch 317, etc., and the operation information is sent to the main control unit 62. It is for input.

  The VRAM 65 has an image signal storage capacity corresponding to the number of pixels of the LCD 311 and is a buffer memory between the main control unit 62 and the LCD 311. The card I / F 66 is an interface for enabling transmission / reception of signals between the memory card 67 and the main control unit 62. The memory card 67 is a recording medium that stores image data generated by the main control unit 62. The communication I / F 68 is an interface for enabling transmission of image data and the like to a personal computer and other external devices.

  The power supply circuit 69 includes, for example, a constant voltage circuit, and generates a voltage for driving the entire imaging apparatus 1 such as a control unit such as the main control unit 62, the imaging element 101, and other various driving units. Note that energization control to the image sensor 101 is performed by a control signal supplied from the main control unit 62 to the power supply circuit 69. The battery 69B includes a primary battery such as an alkaline battery or a secondary battery such as a nickel metal hydride battery, and is a power source that supplies power to the entire imaging apparatus 1.

  The mirror drive control unit 72A generates a drive signal for driving the mirror drive actuator 72M in accordance with the timing of the photographing operation. The mirror drive actuator 72M is an actuator that rotates the mirror unit 103 (quick return mirror) to a horizontal posture or an inclined posture.

  The shutter drive control unit 73A generates a drive control signal for the shutter drive actuator 73M based on a control signal given from the main control unit 62. The shutter drive actuator 73M is an actuator that performs opening / closing driving (opening / closing operation) of the shutter unit 40.

  The diaphragm drive control unit 76A generates a drive control signal for the diaphragm drive actuator 76M based on the control signal given from the main control unit 62. The aperture driving actuator 76M applies a driving force to the aperture driving mechanism 27 via the coupler 75.

  In addition, the camera body 10 is based on the black level corrected image data output from the black level correction circuit 611 and performs a phase difference AF calculation circuit 77 that performs a calculation necessary for autofocus (AF) control using the image sensor 101. It has.

  The phase difference AF operation of the imaging apparatus 1 using the phase difference AF calculation circuit 77 will be described in detail.

<Regarding Phase Difference AF Operation of Imaging Device 1>
The imaging apparatus 1 has a configuration capable of phase difference AF by receiving transmitted light that has been transmitted (passed) through different portions of the exit pupil in the imaging element 101. The configuration of the image sensor 101 and the principle of phase difference AF using the image sensor 101 will be described below.

  6 and 7 are diagrams for explaining the configuration of the image sensor 101.

  The imaging device 101 has a configuration capable of detecting a focus by a phase difference detection method in each of a plurality of AF areas Ef defined in a matrix on the imaging surface 101f (FIG. 6).

  Each AF area Ef has a normal pixel composed of an R pixel 111, a G pixel 112, and a B pixel 113 in which R (red), G (green), and B (blue) color filters are arranged on a photodiode. (Hereinafter also referred to as “normal pixel”) 110 is provided, and pixels for performing phase difference AF (hereinafter also referred to as “AF pixel”) having light shielding plates 12 a and 12 b (parallel oblique line portions) described later. 11f is provided (FIG. 7).

  In the AF area Ef, the Gr line L1 in which the G pixel 112 and the R pixel 111 are alternately arranged in the horizontal direction as the horizontal line of the normal pixel 110, and the B pixel 113 and the G pixel 112 are alternately arranged in the horizontal direction. And a Gb line L2 arranged at the same position. By alternately arranging the Gr line L1 and the Gb line L2 in the vertical direction, a pixel array of a Bayer array is formed, and an image signal related to a subject light image that has passed through the interchangeable lens 2 can be output.

  In the AF area Ef, for example, AF lines (focus detection pixel rows) Lf in which AF pixels 11f are arranged in the horizontal direction for every six horizontal lines of the normal pixels 110 are formed. In the AF area Ef, for example, about 20 AF lines Lf are provided.

  Next, the principle of phase difference AF using the AF line Lf will be described in detail.

  FIG. 8 is a diagram for explaining the principle of phase difference AF using the AF line Lf.

  In the AF line Lf, the light shielding plate 12a, in which the position of the opening OP for separating the light beam Ta from the right portion Qa of the exit pupil and the light beam Tb from the left portion Qb of the interchangeable lens 2 is a mirror surface object, Two or more pairs of pixels 11a and 11b having 12b are arranged along the horizontal direction. More specifically, a pixel (hereinafter, also referred to as a “first AF pixel”) 11a having a light shielding plate 12a in which a slit-like opening OP is biased to the right with respect to the photoelectric conversion portion (photodiode) PD immediately below, and a slit Pixels having a light shielding plate 12b (hereinafter, also referred to as “second AF pixels”) 11b in which the apertures OP are biased to the left with respect to the photoelectric conversion unit PD immediately below are alternately arranged on the AF line Lf (see FIG. Fig. 7). As a result, the light beam Ta from the right part Qa of the exit pupil passes through the microlens ML and the opening OP of the light shielding plate 12a and is received by the photoelectric conversion unit PD of the first AF pixel 11a, and the light beam from the left part Qb of the exit pupil. Tb passes through the microlens ML and the opening OP of the light shielding plate 12b and is received by the photoelectric conversion unit PD of the second AF pixel 11b. In other words, the pair of pixels 11a and 11b receive the light beams Ta and Tb of the subject that have passed through the right and left portions (a pair of partial regions) Qa and Qb in the exit pupil of the interchangeable lens 2, respectively.

  Hereinafter, the pixel output of the first AF pixel 11a is referred to as “a series pixel output”, and the pixel output of the second AF pixel 11b is referred to as “b series pixel output”. For example, one AF line Lf The relationship between the a-series pixel output and the b-series pixel output obtained from the pixel array of the AF pixels 11f arranged in FIG. 9 will be described with reference to FIGS.

  In the AF line Lf, for example, as shown in FIG. 9, the light beams Ta and Tb from both sides of the exit pupil are received by the first AF pixel 11a and the second AF pixel 11b. Here, the a-sequence pixel output in the AF line Lf including the a-sequence pixels a1 to a3 arranged as shown in FIG. 9 is represented as a graph Ga (shown by a solid line) in FIG. On the other hand, the b-sequence pixel output in the AF line Lf including the b-sequence pixels b1 to b3 arranged as shown in FIG. 9 is represented as a graph Gb (shown by a broken line) in FIG. That is, a pair of image rows Ga and Gb represented by the graphs Ga and Gb are generated by the pixel outputs of the a series and b series.

  Comparing the graph Ga and the graph Gb shown in FIG. 10, the phase difference between the a-sequence pixel output and the b-sequence pixel output is the shift amount (shift amount) Sf in the direction (horizontal direction) of the AF line Lf. It can be seen that

  On the other hand, the relationship between the shift amount Sf and the amount of defocusing of the focal plane with respect to the imaging surface of the image sensor 101 (defocus amount) is represented by a linear function graph Gc shown in FIG. The The inclination of the graph Gc can be acquired in advance by a factory test or the like.

  Therefore, after obtaining the shift amount Sf by the phase difference AF calculation circuit 76 based on the output of the AF line Lf of the image sensor 101, the defocus amount is calculated based on the graph Gc in FIG. 11, and the calculated defocus amount is calculated. By giving the focus lens 211 a drive amount corresponding to the phase difference AF, the phase difference AF that moves the focus lens 211 to the in-focus position becomes possible.

  A focus restoration process of a captured image (an image acquired by actual imaging) in the imaging apparatus 1 capable of performing phase difference AF using the imaging element (an imaging element with a phase difference detection function) 101 as described above will be described below. .

<Focus restoration processing of captured image>
In the imaging apparatus 1, the focus for calculating the defocus amount as described above is based on the shift amount Sf (FIG. 10) of each image sequence obtained from the a-series and b-series pixel outputs (exposure data) regarding the AF line Lf. Detection is possible.

  If this focus detection is performed based on the exposure data of the AF line Lf sequentially acquired by the image sensor 101 in the live view mode (when the electronic viewfinder is used), the AF operation before the main photographing can be performed. On the other hand, if the image sensor 101 is used, it is possible to calculate the defocus amount at the time of actual photographing based on the exposure data of the AF line Lf acquired at the time of actual photographing.

  If the defocus amount at the time of actual photographing can be grasped, the focus restoration process for the image signal (captured image data) output from the pixel array of the normal pixels 110 can be easily performed based on the defocus amount. For this focus restoration process, a known focus restoration technique can be used, and an example thereof will be conceptually described below.

  Assuming that Ha and Hb are vectorized images of an out-of-focus state image (out-of-focus image) that is out of focus and an in-focus state image (in-focus image) that are in focus, respectively. The following formula (1) is established.

Ha = Mt · Hb (1):
Here, the matrix Mt in the above equation (1) corresponds to the image deterioration function, and can be calculated based on the defocus amount and the optical information of the interchangeable lens 2 (for example, information on the MTF curve).

Therefore, if the matrix Mt is obtained based on the optical information of the interchangeable lens 2 that is known information and the defocus amount at the time of the main photographing described above, and the inverse matrix Mt ⁻¹ is calculated, the following equation (2) is obtained. Thus, an in-focus image (vector) Hb is obtained.

Hj = M ⁻¹ · Ho (2):
Note that it is not essential to obtain the in-focus image by calculating the inverse matrix Mt ⁻¹ as described above, and it may be obtained by an iterative method such as a conjugate gradient method.

  In addition, the focus restoration process for the above-described photographed image data is not particularly required for a photographed image that is not out of focus. Therefore, the defocus amount at the time of actual photographing is set to a predetermined threshold value α, For example, when it is smaller than 1Fδ (F is the F number associated with the interchangeable lens 2 and δ is twice the pixel pitch of the image sensor 101) and the focus shift is small, focus restoration processing is omitted (prohibited) and the captured image data is processed. It is preferable to speed up the entire image processing process.

  As described above, the focus restoration process based on the defocus amount at the time of actual photographing obtained from the exposure data of the AF line Lf with respect to the photographed image data (image signal) output from the image sensor 101 exposed at the time of actual photographing. By executing (image processing), a focused image, that is, a subject image with good image quality can be easily acquired. Further, for example, a focused image can be appropriately acquired even for a subject (moving object) whose distance from the imaging apparatus 1 has changed between the time when AF is completed by the phase difference AF module 107 or the like and the start of exposure of the main photographing. .

  Next, a basic operation of the imaging apparatus 1 that performs such a focus restoration process will be described.

<Basic Operation of Imaging Device 1>
12 and 13 are flowcharts showing the basic operation of the imaging apparatus 1. This operation shows a series of operations from the power-on of the image pickup apparatus 1 to the end of the main photographing, and is executed by the main control unit 62.

  When the user operates the main switch 317 to turn on the power of the imaging apparatus 1, it is determined whether the electronic viewfinder (live view mode) is selected based on the setting state of the changeover switch 85 (step ST1). If the electronic viewfinder is selected, the process proceeds to step ST2, and if the optical viewfinder 316 is selected instead of the electronic viewfinder, the process proceeds to step ST14.

  In step ST2, the mirror drive control unit 72A drives the mirror drive actuator 72M to raise the main mirror 1031 and the sub mirror 1032 in the mirror unit 103 (see FIG. 4).

  In step ST3, the shutter drive control unit 73A drives the shutter drive actuator 73M to open the shutter unit 40.

  In step ST4, the image sensor 101 is activated in the live view mode. That is, the image pickup device 101 is activated by setting the read cycle of the image sensor 101 to 1/60 seconds, for example. Thereby, live view display on the LCD 311 is started.

  In step ST5, it is determined whether or not the optical viewfinder 316 has been switched. Specifically, it is determined whether or not the optical finder 316 has been selected by operating the changeover switch 85 by the user. If the optical finder 316 is switched, the process proceeds to step ST11. If the optical finder 316 is not switched, the process proceeds to step ST6.

  In step ST6, it is determined whether the shutter button 307 has been half-pressed by the user. Here, if half-pressed, the process proceeds to step ST7. If not half-pressed, the process returns to step ST5.

  In step ST7, phase difference AF by the image sensor 101 is performed. Specifically, the defocus amount is calculated based on the exposure data of the AF line Lf output from the imaging element 101 that is sequentially exposed for live view display, and the drive amount corresponding to the defocus amount is calculated as the focus lens. In-focus control is performed by giving to 211 and moving to the in-focus position.

  In step ST8, it is determined whether the shutter button 307 has been fully pressed by the user. Here, if it is fully pressed, the process proceeds to step ST9. If it is not fully pressed, the process returns to step ST5.

  In step ST9, actual photographing is performed. That is, a photographing operation for generating exposure data including photographed image data for recording is performed by the image sensor 101.

  In step ST10, the exposure data generated by the image sensor 101 by the main photographing in step ST9 is read. The captured image data included in the read exposure data can be recorded in the memory card 67 through the processing in the AFE 5 and the image processing unit 61.

  In step ST11, the mirror drive control unit 72A drives the mirror drive actuator 72M to lower the main mirror 1031 and the sub mirror 1032 in the mirror unit 103 (see FIG. 3).

  In step ST12, the shutter drive control unit 73A drives the shutter drive actuator 73M to perform the closing operation of the shutter unit 40.

  In step ST13, since the optical viewfinder is selected, the image sensor 101 and the LCD 311 necessary for the electronic viewfinder are turned off.

  In step ST14, it is determined whether or not the electronic viewfinder has been switched. Specifically, it is determined whether or not the electronic viewfinder has been selected by operating the changeover switch 85 by the user. If the electronic viewfinder is switched, the process returns to step ST2, and if not switched, the process proceeds to step ST15.

  In step ST15, it is determined whether the shutter button 307 has been half-pressed by the user. Here, if half-pressed, the process proceeds to step ST16. If not half-pressed, the process returns to step ST14.

  In step ST16, phase difference AF is performed by the phase difference AF module 107.

  In step ST17, it is determined whether the shutter button 307 has been fully pressed by the user. Here, if it is fully pressed, the process proceeds to step ST18. If it is not fully pressed, the process returns to step ST14.

  In step ST18, the mirror drive control unit 72A drives the mirror drive actuator 72M to raise the main mirror 1031 and the sub mirror 1032 in the mirror unit 103 (see FIG. 4).

  In step ST19, actual photographing is performed. In other words, a photographing operation is performed in which the image sensor 101 is exposed to generate exposure data including photographed image data for recording.

  In step ST20, the exposure data generated by the image sensor 101 by the main photographing in step ST19 is read. That is, exposure data (image signal) as photographed image data relating to the subject image is output from the pixel array of the normal pixels 110 in the exposed image sensor 101, and exposure for focus detection is performed from the AF line (focus detection pixel array) Lf. Data (pixel column signal) is output.

  In step ST20, the mirror drive control unit 72A drives the mirror drive actuator 72M to lower the main mirror 1031 and the sub mirror 1032 in the mirror unit 103.

  In step ST21, based on the exposure data read out in step ST20, a defocus amount at the time of actual photographing regarding the photographing subject is calculated. Specifically, the defocus amount is obtained by performing the above-described phase difference AF based on the exposure data of the AF line Lf generated by the image sensor 101 during the main photographing.

  In step ST22, it is determined whether the defocus amount calculated in step ST21 is greater than or equal to the threshold value α described above. That is, since it is not necessary to perform a focus restoration process on a captured image with a small defocus amount and no (or small) out-of-focus, it is determined whether or not this is the case. If the defocus amount is greater than or equal to the threshold value α, the process proceeds to step ST23. If the defocus amount is less than the threshold value α, the focus restoration process in step ST23 is prohibited and this flow is terminated.

  In step ST23, focus restoration processing based on the defocus amount calculated in step ST21 is performed on the captured image data included in the exposure data read in step ST20. A focused image can be easily acquired by such a focus restoration process, that is, an image restoration process that restores a subject image related to captured image data obtained by actual photographing to an in-focus image (in-focus image).

  Due to the operation of the imaging device 1 described above, since the focus restoration processing of the captured image data is performed based on the defocus amount calculated from the exposure data of the AF pixel 11f generated by the imaging element 101 during the actual shooting, the image quality is good. A focused image can be easily acquired.

  In the operation of the imaging apparatus 1, the operations of steps ST21 to ST23 (FIG. 13) may be performed after step ST10 (FIG. 12). Accordingly, it is possible to perform the focus restoration process on the captured image data captured in the live view mode (when using the electronic viewfinder), and it is possible to easily obtain a focused image with good image quality.

<Modification>
In the above embodiment, it is not essential to perform the focus restoration process based on the defocus amount on the captured image data, and other image processing such as a sharpness process based on the defocus amount may be performed. This also makes it possible to acquire a subject image with good image quality.

  In the above embodiment, it is not essential to prohibit the focus restoration processing of the captured image data when the defocus amount at the time of actual shooting is smaller than the threshold value α, and the luminance related to the captured image data (image signal) is determined in advance. The focus restoration process may be prohibited when the luminance is lower than the luminance. That is, the pixels of the phase difference AF module 107 are relatively large and can perform focus detection well even in a low-luminance scene, but the AF pixel 11f of the image sensor 101 is small, and the amount of received light is reduced by the light shielding plates 12a and 12b (FIG. 8). Since it is (substantially halved), the focus detection accuracy in a low brightness scene is lowered. Therefore, it is preferable to prohibit the focus restoration process based on the unreliable defocus amount obtained from the AF pixel 11f in the low brightness scene. As a result, it is possible to speed up the entire image processing process for captured image data by omitting an inappropriate focus restoration process.

  The AF pixels in the above embodiment are not necessarily arranged along the horizontal direction as shown in FIG. 7, but may be arranged in the vertical direction. In this case, the phase difference AF is performed by the amount of shift in the vertical direction with respect to a pair of image sequences (a-sequence image sequence and b-sequence image sequence) obtained by the AF pixels.

  In the above embodiment, it is not essential to perform the focus restoration process on the captured image acquired by the image sensor 101 at the time of actual shooting, and for the live view image sequentially acquired by the image sensor 101 in the live view mode. The focus restoration process may be performed. In this case, it is possible to perform live view display using a focused image with good focus, that is, a subject image with good image quality.

1 is a diagram illustrating an external configuration of an imaging apparatus 1 according to an embodiment of the present invention. 1 is a diagram illustrating an external configuration of an imaging apparatus 1. FIG. 1 is a longitudinal sectional view of an imaging apparatus 1. FIG. It is a figure which shows the state of the mirror up in the mirror part. 2 is a block diagram illustrating an electrical configuration of the imaging apparatus 1. FIG. FIG. 2 is a diagram for describing a configuration of an image sensor 101. FIG. 2 is a diagram for describing a configuration of an image sensor 101. It is a figure for demonstrating the principle of phase difference AF using AF line Lf. It is a figure for demonstrating the relationship between the pixel output of a series, and the pixel output of b series. It is a figure for demonstrating the relationship between the pixel output of a series, and the pixel output of b series. It is a figure which shows the relationship between shift amount Sf and defocus amount. 3 is a flowchart showing a basic operation of the imaging apparatus 1. 3 is a flowchart showing a basic operation of the imaging apparatus 1.

Explanation of symbols

DESCRIPTION OF SYMBOLS 1 Image pick-up device 2 Interchangeable lens 10 Camera body 11a 1st AF pixel 11b 2nd AF pixel 11f AF pixel 12a, 12b Light-shielding plate 62 Main control part 77 Phase difference AF arithmetic circuit 85 Changeover switch 101 Imaging element 101f Imaging surface 103 Mirror part 107 Phase difference AF module 110 Normal pixel 211 Focus lens 307 Shutter button 311 LCD
316 Optical viewfinder Ef AF area L1 Gr line L2 Gb line Lf AF line OP Shading plate opening Qa Exit pupil right side Qb Exit pupil left side Sf Shift amount

Claims (4)

An imaging apparatus having an imaging optical system,
(a) a pixel array capable of outputting an image signal related to a subject light image that has passed through the photographing optical system, and a pair of pixels that respectively receive a subject light flux that has passed through a pair of partial areas in an exit pupil of the photographing optical system. An imaging device having two or more focus detection pixel arrays arranged along a predetermined direction;
(b) output control means for exposing the image sensor and outputting the image signal from the pixel array and outputting a pixel column signal from the focus detection pixel column;
(c) based on the pixel column signal output by the output control means, focus detection means for performing a phase difference detection type focus detection to obtain a defocus amount;
(d) image processing means for executing predetermined image processing based on the defocus amount obtained by the focus detection means on the image signal output by the output control means;
An imaging apparatus comprising: The imaging device according to claim 1,
The imaging apparatus according to claim 1, wherein the predetermined image processing is image restoration processing for restoring a subject image related to an image signal output by the output control unit to an in-focus image. The imaging device according to claim 1,
(e) means for prohibiting the predetermined image processing by the image processing means when the defocus amount is smaller than a predetermined threshold;
An image pickup apparatus further comprising: The imaging device according to claim 1,
(f) means for prohibiting the predetermined image processing by the image processing means when the luminance related to the image signal output by the output control means is lower than the predetermined luminance;
An image pickup apparatus further comprising:

Images