JP2017050723A - Imaging apparatus and control program therefor - Google Patents

Abstract

PROBLEM TO BE SOLVED: To effectively utilize a defective pixel for phase difference detection and acquisition of an image signal.SOLUTION: An imaging apparatus generates an image signal using an output signal from a plurality of pixels of an imaging element 102, generates a phase difference signal using an output signal from a phase difference detection pixel group, and performs focus control over an imaging optical system using a phase difference detected from the phase difference image signal. The imaging apparatus has storage means 112 stored with information associated with a defective pixel included in the imaging element, and processing means 107 capable of performing defective pixel handling processing on the phase difference image signal and image signal when the phase difference detection pixel group includes the defective pixel. The processing means makes a choice of whether to perform the defective pixel processing on each of the phase difference image signal and image signal using the information associated with the defective pixel.SELECTED DRAWING: Figure 1

Description

  The present invention relates to an imaging apparatus such as a digital camera or a video camera, and more particularly to an imaging apparatus that performs focus detection by a phase difference detection method using an imaging element.

  An imaging device provided for acquiring a captured image in the imaging apparatus as described above includes a plurality of functions having a function of detecting an image shift amount (phase difference) of a subject image in order to perform focus detection of the imaging optical system. Some have pixels (hereinafter referred to as phase difference detection pixels). However, if the phase difference detection pixel includes a defective pixel, there may be a case where high-precision focus detection cannot be performed because good phase difference detection cannot be performed.

  Patent Document 1 discloses an imaging apparatus that selects whether or not to use a defective pixel in accordance with a set value of an aperture so that the defective pixel can be used within a range in which focus detection accuracy is ensured. ing. Patent Document 2 discloses an imaging apparatus that corrects a pixel signal from a phase difference detection pixel that is a defective pixel using a pixel signal from a phase difference detection pixel that is not a defective pixel. In Patent Document 3, when a defective pixel is included in a pixel area (focus adjustment area) where focus detection is performed, a focus adjustment area that does not include a defective pixel is moved in a predetermined direction from the focus adjustment area including the defective pixel. An imaging device to be set is disclosed.

JP2013-003282A JP 2009-163229 A JP 2001-177756 A

  However, in the imaging apparatus disclosed in Patent Document 1, since it is selected whether or not to use the defective pixel only with the aperture setting value, the optical manufacturing variation of the imaging element and the exit pupil distance of the imaging optical system The effect of variation on focus detection is not considered. Further, in the imaging device disclosed in Patent Document 2, if the phase difference detection pixels are discretely arranged on the imaging device, the sampling pitch becomes coarse, so that it is accurate particularly when imaging a subject having a high spatial frequency. It is difficult to correct the pixel signal of the defective pixel. Further, in the imaging device disclosed in Patent Document 3, there is a possibility that the focus adjustment is performed on a subject that the user does not want due to the change of the focus adjustment area.

  Furthermore, the phase difference detection pixel that is a defective pixel may also serve as an imaging pixel for acquiring a captured image. In this case, the signal level for determining whether or not to make the signal subject to correction processing differs between when the phase difference detection signal is read out from the defective pixel and when the captured image signal is read out. is there.

  The present invention provides an imaging apparatus in which defective pixels can be effectively used for phase difference detection (focus detection) and captured image acquisition.

  An imaging apparatus according to an aspect of the present invention includes an imaging device that photoelectrically converts a subject image formed by an imaging optical system using a plurality of pixels, and an image signal for display or recording using output signals from the plurality of pixels. A signal generation unit that generates a phase difference image signal having a phase difference corresponding to a focus state of the imaging optical system using an output signal from the phase difference detection pixel group among the plurality of pixels, and a phase difference A phase difference detection means for detecting a phase difference from the image signal, a focus control means for performing focus control of the image pickup optical system using the phase difference, a storage means for storing information on defective pixels included in the image pickup device, and a position And processing means capable of performing defective pixel correspondence processing on the phase difference image signal and the image signal when the phase difference detection pixel group includes a defective pixel. The processing means is characterized by separately selecting whether or not to perform the defective pixel correspondence processing for each of the phase difference image signal and the image signal, using information regarding the defective pixel.

  According to another aspect of the present invention, there is provided a control program that outputs an output signal from a plurality of pixels to a computer of an imaging apparatus having an image sensor that photoelectrically converts a subject image formed by the imaging optical system using the plurality of pixels. Is a computer program that performs an image generation process for generating an image signal for display or recording by using and a focus control process for performing focus control of an imaging optical system. The focus control process generates a phase difference image signal having a phase difference corresponding to the focus state of the imaging optical system using an output signal from the phase difference detection pixel group among a plurality of pixels, and generates a phase difference from the phase difference image signal. , And focus control is performed using the phase difference. The program causes a computer to acquire information related to a defective pixel included in an image sensor, and when a defective pixel is included in a phase difference detection pixel group, a defective pixel corresponding process is performed on the phase difference image signal and the image signal. It is possible to select whether or not to perform defective pixel correspondence processing for each of the phase difference image signal and the image signal using information regarding the defective pixel.

  An imaging device according to another aspect of the present invention includes an imaging device that photoelectrically converts a subject image formed by an imaging optical system using a plurality of pixels, and an output from a phase difference detection pixel group among the plurality of pixels. A signal generation unit that generates a phase difference image signal having a phase difference corresponding to a focus state of the imaging optical system using the signal; a phase difference detection unit that detects a phase difference from the phase difference image signal; and The defocus amount of the imaging optical system is calculated using the focus conversion coefficient, and focus control means for performing focus control of the imaging optical system in accordance with the defocus amount, and information regarding defective pixels included in the imaging element are stored Storage means and processing means capable of performing defective pixel correspondence processing on a phase difference image signal when a defective pixel is included in the phase difference detection pixel group. The focus control unit sets the defocus conversion coefficient according to the state of the imaging optical system and the position of the phase difference detection pixel group. The processing unit sets a threshold value for the defocus conversion coefficient using information on the defective pixel, and selects whether or not to perform the defective pixel correspondence process according to a result of comparing the defocus conversion coefficient and the threshold value. And

  According to another aspect of the present invention, there is provided a control program that outputs an output signal from a plurality of pixels to a computer of an imaging apparatus having an image sensor that photoelectrically converts a subject image formed by the imaging optical system using the plurality of pixels. Is a computer program that causes a focus control process to perform focus control of the imaging optical system using. The focus control process generates a phase difference image signal having a phase difference corresponding to the focus state of the imaging optical system using an output signal from the phase difference detection pixel group among a plurality of pixels, and generates a phase difference from the phase difference image signal. Is detected, the defocus amount of the imaging optical system is calculated using the phase difference and the defocus conversion coefficient, and the focus control of the imaging optical system is performed according to the defocus amount. The program causes a computer to acquire information related to a defective pixel included in an image sensor, and performs defective pixel correspondence processing on a phase difference image signal when a defective pixel is included in a phase difference detection pixel group. The defocus conversion coefficient is set according to the state of the imaging optical system and the position of the phase difference detection pixel group, and the threshold value for the defocus conversion coefficient is set using information on the defective pixel. And it is characterized by selecting whether to perform a defective pixel corresponding | compatible process according to the result of having compared the defocus conversion coefficient and the threshold value.

  According to the present invention, defective pixels can be effectively used for phase difference detection (focus control) and image signal acquisition.

1 is a block diagram illustrating a configuration of an imaging apparatus that is Embodiment 1 of the present invention. FIG. 3 is a diagram illustrating a configuration of one pixel of an imaging element used in the imaging apparatus according to the first embodiment. The front view which shows a part of pixel array of the said image pick-up element. The schematic diagram which shows the relationship between an exit pupil and the light which the said image pick-up element receives. FIG. 3 is a diagram illustrating a pixel circuit of the imaging element. 3 is a timing chart showing a driving pattern of the image sensor in the first embodiment. 5 is a flowchart showing focus control processing in Embodiment 1. FIG. 4 is a diagram illustrating a pixel signal when an AF pixel row in Example 1 includes a defective pixel. 6 is a flowchart illustrating defective pixel handling processing according to the first embodiment. FIG. 6 is a diagram for explaining pixel vignetting in the first embodiment. FIG. 3 is a diagram for explaining a center-of-gravity interval of a phase difference detection light beam in the first embodiment. FIG. 5 is another diagram for explaining pixel vignetting in the first embodiment. FIG. 5 is another diagram for explaining the center-of-gravity interval of the phase difference detection light beam in the first embodiment. 9 is a flowchart showing defective pixel handling processing in Embodiment 2 of the present invention. FIG. 10 is a diagram illustrating a relationship between a defect signal level and a conversion coefficient threshold value in the second embodiment.

  Embodiments of the present invention will be described below with reference to the drawings.

  FIG. 1 shows the configuration of an imaging apparatus such as a digital still camera or a digital video camera that is Embodiment 1 of the present invention. The imaging apparatus includes an optical barrel 101, an imaging element 102, a drive circuit 103, a signal processing unit 104, and a compression / decompression unit 105. Further, the imaging apparatus includes a phase difference detection unit 106, a control unit 107, a light emitting unit 108, an operation unit 109, an image display unit 110, an image recording unit 111, a storage unit 112, and a temperature detection unit 113. Have

  The optical barrel 101 houses an imaging optical system (not shown: hereinafter referred to as an imaging lens) that forms an image of light from a subject on the imaging element 102. The imaging lens includes a focus lens that performs focus adjustment and a focus mechanism unit 1011 that includes a focus control circuit that controls driving of the focus lens, and a zoom control circuit that controls driving of the zoom lens and zoom lens that performs zooming. And a zoom mechanism portion 1012. The imaging lens also includes a diaphragm mechanism unit 1013 that adjusts the amount of light incident on the imaging element 102 and a shutter mechanism unit 1014 that controls the exposure amount of the imaging element 102. The focus mechanism unit 1011, the zoom mechanism unit 1012, the aperture mechanism unit 1013, and the shutter mechanism unit 1014 operate according to a control signal from the control unit 107. The optical barrel 101 may be provided integrally with the imaging apparatus or may be provided so as to be attachable / detachable (exchangeable).

  The image sensor 102 is configured by a CMOS sensor or the like, and includes a pixel portion including a plurality of pixels, and an AD converter (not shown) that converts an analog output signal from the pixel portion into a digital output signal. The image sensor 102 is driven by a drive circuit 103 that operates in accordance with a control signal from the control unit 107, performs exposure (charge accumulation) and signal output (readout), and outputs an image signal as the digital output signal.

  The signal processing unit 104 is an image that is controlled by the control unit 107 and generates a display or recording image signal by performing white balance adjustment processing and color correction processing on an imaging signal obtained from all pixels of the imaging device 102. Perform the generation process. The signal processing unit 104 also performs AE (auto exposure) processing for setting an aperture value and a shutter speed according to the brightness of the subject detected from the imaging signal. Furthermore, the signal processing unit (signal generation unit) 104 generates phase difference image signals that are paired with each other, using an imaging signal from an AF pixel row described later in the imaging element 102. The pair of phase difference image signals have a phase difference corresponding to the focus state (defocus amount) of the imaging lens.

  The compression / decompression unit 105 is controlled by the control unit 107, and performs compression encoding processing on the image signal from the signal processing unit 104 in a still image data format such as JPEG method. The compression / decompression unit 105 performs decompression / decoding processing on the encoded data of the still image supplied from the control unit 107. The compression / decompression unit 105 may perform compression encoding / decompression decoding processing of a moving image by the MPEG method or the like.

  The phase difference detection unit 106 acquires a pair of phase difference image signals generated by the signal processing unit 104, and performs a correlation operation on the pair of phase difference image signals to obtain a phase difference between these phase difference image signals. Detect (calculate). Then, the detected phase difference is sent to the control unit 107. The control unit 107 calculates a defocus amount indicating the focus state of the imaging lens based on the phase difference. Further, the control unit 107 calculates a focus lens drive amount (hereinafter referred to as a focus drive amount) necessary to obtain a focused state from the calculated defocus amount, and outputs a focus control signal including the focus drive amount. This is sent to the focus mechanism unit 1011. The focus mechanism unit 1011 moves the focus lens by the focus drive amount in accordance with the focus control signal from the control unit 107. Thereby, AF (autofocus) as focus control by the imaging surface phase difference detection method is performed.

  The control unit 107 is a microcomputer including a CPU, a ROM, a RAM, and the like, and controls the entire imaging apparatus by executing a computer program stored in the ROM. The control unit 107 according to the present exemplary embodiment functions as a focus control unit that performs focus control of the imaging lens and a processing unit that performs a defective pixel handling process described later.

  The light emitting unit 108 irradiates the subject with illumination light when it is determined in the AE process in the signal processing unit 104 that the brightness of the subject is dark.

  The operation unit 109 includes various operation keys such as a shutter release button, a lever, a dial, and the like, and outputs an operation signal according to an input operation by the user to the control unit 107.

  The image display unit 110 includes a display device such as an LCD and an interface circuit for the display device, and displays an image on the display device by converting an image signal supplied from the control unit 107 into a display format.

  The image recording unit 111 includes a semiconductor memory, an optical disk, an HDD, a magnetic tape, and the like that can be attached to and detached from the imaging apparatus. The image recording unit 111 receives the image data file encoded by the compression / decompression unit 105 from the control unit 107 and stores it. . Further, the image recording unit 111 reads out an image data file in accordance with a read control signal from the control unit 107 and outputs the image data file to the control unit 107.

  The storage unit 112 stores control information in the imaging apparatus, correction data adjusted in the manufacturing / adjustment process for each individual imaging apparatus, and the like. Furthermore, the storage unit 112 stores information on defective pixels in the image sensor 102 (hereinafter referred to as defective pixel information). The defective pixel information includes information indicating an address (coordinates) of the defective pixel and information indicating a level of a signal output from the defective pixel.

  The temperature detection unit 113 detects the temperature of electronic components such as the image sensor 102 and the control unit 107 in the imaging apparatus, and sends information on the detected temperature to the control unit 107.

  FIG. 2 shows the configuration of one pixel of the image sensor 102 in this embodiment. The pixel 201 includes one microlens 202 and two photodiodes (PD) 203 and 204 as photoelectric conversion elements. Further, the pixel 201 includes transfer switches 205 and 206 that read out signals from the PD 203 and the PD 204, and a floating diffusion (FD) 207 that temporarily accumulates the signals from the PD 203 or the PD 204. The pixel 201 includes a plurality of components described later in addition to the illustrated components.

  FIG. 3 shows a pixel array in the image sensor 102. In the image sensor 102, a plurality of pixels are arranged in a two-dimensional array in order to acquire a two-dimensional image. Each pixel has the configuration shown in FIG. For example, in the pixels 301, 302, 303, and 304, 301L, 302L, 303L, and 304L correspond to the PD 203 shown in FIG. 2, and 301R, 302R, 303R, and 304R correspond to the PD 204 shown in FIG.

  As shown in FIG. 4, the light beam that has passed through the exit pupil of the imaging lens is incident on the image sensor 102 having the pixel array shown in FIG. In FIG. 4, 401 indicates a cross section of each pixel. As shown in the cross section 401, each pixel includes a color filter 403 in addition to the microlens 202, the PD 203, and the PD 204. The center of the light beam from the exit pupil 406 is defined as the optical axis 409 for the pixel having the central microlens 202. The light flux from the exit pupil 406 enters the image sensor 102 with the optical axis 409 as the center. Reference numerals 407 and 408 denote partial areas (hereinafter referred to as pupil areas) of the exit pupil 406 of the imaging lens. Outermost light rays from the pupil region 407 are indicated by 410 and 411, and outermost light rays from the pupil region 408 are indicated by 412 and 413.

  As shown in FIG. 4, among the light beams from the exit pupil 406, the upper light beam enters the PD 204 with the optical axis 409 as a boundary, and the lower light beam enters the PD 203. That is, PD 203 and PD 204 receive light beams from different pupil regions 407 and 408 in exit pupil 406, respectively. With this configuration, pupil division is performed.

  In the pixels 301, 302, 303, and 304 included in the pixel row 305 illustrated in FIG. 3, PDs 301L, 302L, and 303L corresponding to the PD 203 that photoelectrically converts the subject image (A image) formed by the light flux from one pupil region. , 304L is an A image signal. A signal obtained from PDs 301R, 302R, 303R, and 304R corresponding to PD 204 that photoelectrically converts a subject image (B image) formed by a light beam from the other exit pupil is referred to as a B image signal. The A image signal and the B image signal correspond to the above-described phase difference image signals that make a pair.

  FIG. 5 shows a configuration of an equivalent circuit of the pixel shown in FIG. Here, an equivalent circuit of pixels for three columns and one row is schematically shown. In FIG. 5, the same components as those in FIG. 2 are denoted by the same reference numerals. The transfer switches 205 and 206 of the pixel 201 are driven by transfer pulses φTX1 and φTX2, respectively, and transfer the photoelectric charges generated in the corresponding PDs 203 and 204 to the FD 207, respectively. The FD 207 functions as a buffer that temporarily accumulates charges. Reference numeral 501 denotes an amplification MOS amplifier that functions as a source follower, and reference numeral 502 denotes a selection switch that selects a pixel by a vertical selection pulse φSEL. A floating diffusion amplifier is composed of a constant current source (not shown) connected to the FD 207, the amplification MOS amplifier 501 and the vertical output line 503.

  The signal charge of the FD 207 of the pixel selected by the selection switch 502 is converted into a voltage by the floating diffusion amplifier, output to the vertical output line 503, and read to the reading circuit 103. Reference numeral 504 denotes a reset switch that receives the reset pulse φRES and resets the FD 207 with VDD.

  As described above, the PDs 203 and 204 have transfer switches 205 and 206 corresponding to the PDs 203 and 204, respectively, but the circuits used for signal readout in the circuits in the pixels after the FD 207 are shared. With such a configuration, the pixels can be reduced. Further, as shown in the drawing, the wirings that provide the transfer pulses φTX1 and φTX2 are shared by the pixels arranged in each row.

  Next, a method for driving the image sensor 102 will be described with reference to a timing chart of FIG. FIG. 6 shows a driving pattern in driving for reading out signals for one pixel row to the reading circuit 103.

  First, during time t601, the reset pulse φRES and the transfer pulses φTX1 and φTX2 are simultaneously set to a high potential (hereinafter referred to as H). As a result, the reset switch 504 and the transfer switches 205 and 206 are turned on, and the potentials of the PD 203, PD 204, and FD 207 are reset to the initial potential VDD. Thereafter, when transfer pulses φTX1 and φTX2 are set to a low potential (hereinafter referred to as LO), charge accumulation starts in PD 203 and PD 204.

  Next, after a lapse of a predetermined time determined based on the charge accumulation time, the selection pulse φSEL is set to H at time t603 and the selection switch 502 is turned on, so that a reading row is selected. A signal read operation is performed. At the same time, the reset pulse φRES is set to LO, and the reset of the FD 207 is released.

  When φTN is set to H during time t604 out of time t603, the readout circuit 103 reads and records the N signal that is a reset signal of the FD 207. Although not shown, the read circuit 103 reads and records the potential of the FD 207 via the vertical output line 503 based on the control of φTN, φS1, and φS2.

  Next, the transfer pulses φTX1 and φS1 are simultaneously set to H during the time t605 of the time t603 and the transfer switch 205 is turned on, whereby the first PD signal that is an addition signal of the optical signal of the PD 203 and the noise signal is turned on. Are read and recorded by the reading circuit 103.

  Next, with the reset switch 504 not turned on, the transfer pulses φTX1, φTX2, and φS2 are simultaneously set to H during the time t606 of the time t603, so that the transfer switches 205 and 206 are turned on. As a result, the second PD signal, which is an addition signal obtained by mixing the optical signal of the PD 203, the optical signal of the PD 204, and the noise signal, is read out and recorded by the readout circuit 103. At time t605, the transfer pulse φTX1 is once set on and the signal of the PD 203 is read out to the FD 207. Therefore, at time t606, the transfer pulse φTX1 may be off. Strictly speaking, the charge accumulation time t602 is from the end of the time t601 to the end of the time t606. Note that the timing for resetting the PD 204 by setting the transfer pulse φTX2 to H may be delayed by a time difference between the time t605 and the time t606.

  Based on the N signal, the first PD signal, and the second PD signal read out by the readout circuit 103 by the above operation, the A image signal obtained by subtracting the noise signal from the first PD signal and the image obtained by subtracting the noise signal from the second PD signal. The signal is output from the image sensor 102. Since this image signal is a signal (A + B image signal) obtained by synthesizing the signals of PD 203 and PD 204, a B image signal can be generated by subtracting the A image signal from the image signal.

  Next, focus control processing (focus control processing) performed in the imaging apparatus according to the present exemplary embodiment will be described with reference to the flowchart of FIG. The control unit 107 performs this focus control process according to a control program that is a computer program. Here, the case where the imaging plane phase difference detection AF is performed while performing image generation processing for generating a display image signal or a recording image signal as an electronic viewfinder image (live view image) on the image display unit 110 will be described. To do.

  First, in step S701, the control unit 107 determines whether or not the AF start button in the operation unit 109 has been turned on. If the operation has been turned on, the control unit 107 proceeds to step S702. Instead of determining whether or not the AF start button has been turned ON, it may be determined whether or not display of an electronic viewfinder image or recording of a moving image has started.

  In step S <b> 702, the control unit 107 acquires various setting information (lens information) of the imaging lens in the optical barrel 101.

  Next, in step S703, the control unit 107 causes the phase difference detection unit 106 to sequentially generate a phase difference image signal (A image signal) generated by the signal processing unit 104 based on the imaging signal from the AF pixel row of the imaging element 102. And B image signal). In this embodiment, the phase difference detection unit 106 generates the B image signal by subtracting the A image signal from the A + B image signal as described above.

  Next, in step S <b> 704, the control unit 107 performs selection processing of defective pixel correspondence processing for the phase difference image signal and the image signal. The defective pixel handling process and its selection process will be described in detail later.

  Next, in step S705, the control unit 107 causes the phase difference detection unit 106 to perform a correlation operation on the A image signal and the B image signal to detect the phase difference between these A image and B image signals. Further, the control unit 107 calculates the defocus amount of the imaging lens based on the phase difference.

  Next, in step S706, the control unit 107 calculates a focus drive amount based on the defocus amount calculated in step S704.

  Subsequently, in step S707, the control unit 107 sends a focus control signal including the focus drive amount to the focus mechanism unit 1011 to drive the focus lens. Thereby, AF is completed.

  After this, the process from step S701 may be repeated, or the process may be performed again by detecting a change in the state of the subject.

  Next, the defective pixel handling process selection process performed in step S704 will be described with reference to FIGS. In this embodiment, among all the pixels of the image sensor 102, a phase difference image signal is generated by photoelectrically converting at least a part of an optical image (subject image) of a subject that is a target for focusing an imaging lens by AF. A set of two or more pixels that output an imaging signal is defined as a phase difference detection pixel group. The phase difference detection pixel group is two or more pixels corresponding to a focus detection region selected in the imaging screen by the control unit 107 according to a user's selection operation or by a predetermined algorithm. In the following description, the phase difference detection pixel group is defined as a pixel row including two or more pixels arranged in one column in the horizontal direction, and this pixel row is referred to as an AF pixel row.

  In the selection process, the control unit 107 determines whether or not a defective pixel is included in the AF pixel row. Then, when a defective pixel is included in the AF pixel row, whether or not to perform defective pixel correspondence processing on the phase difference image signal and the image signal is selected according to the signal level of the defective pixel. As will be described in detail later, the defective pixel handling process includes a correction process for the phase difference image signal or the image signal and an AF pixel row changing process.

  FIG. 8 shows the influence of defective pixels on phase difference detection, and the flowchart of FIG. 9 shows the flow of selection processing.

  Assume that an A image signal (dotted line) and a B image signal (solid line) having signal waveforms as shown in FIG. 8A are obtained in the AF pixel row. In FIG. 8A, the horizontal axis indicates the pixel number (pixel No.) in the AF pixel row, and the vertical axis indicates the values of the A image and B image signals (AD count number).

  The A image signal and the B image signal are signals having the same waveform. However, for example, if there is a defect in the PD for generating the A image signal in one pixel included in the AF pixel row, an A image signal having a waveform different from that of the B image signal is obtained. Such a pixel is called a defective pixel. If there is no defective pixel, the A image signal and the B image signal coincide with each other, so that the phase difference between the A image signal and the B image signal is 0, and as a result, the defocus amount is also 0. However, if there is a defective pixel, the phase difference between the A image signal and the B image signal changes with respect to 0 in accordance with the position and signal level of the defective pixel, and this changed phase difference is the error in the defocus amount. Become.

  In the manufacturing process of the image pickup apparatus according to the present embodiment, the image pickup element 102 having the pixel arrangement shown in FIG. If a defective pixel is found by the check, defective pixel information including the position of the defective pixel and the signal level is stored in the storage unit 112. The signal level at this time is a signal level in a dark state where no light is incident on the image sensor 102. The signal level in the dark state is originally 0, but a signal having a signal level offset from 0 is always output in the defective pixel. In the following description, a signal output from a defective pixel is referred to as a defective pixel signal.

  In this embodiment, defective pixel information for a pair of phase difference image signals obtained separately from each of PD 203 and PD 204 of each pixel, and defective pixel information for an image signal obtained by synthesizing signals from each of PD 203 and PD 204, Are stored in the storage unit 112 separately. Note that the defective pixel information of the PD 203 and the defective pixel information of the PD 204 may be separately stored in the storage unit 112 as defective pixel information for the phase difference image signal. Further, a signal level obtained by adding signals from the PD 203 and the PD 204 may be stored as the signal level of the defective pixel with respect to the image signal.

  In the following description, the signal level of the defective pixel is referred to as a defective signal level. In this embodiment, the defect signal level is expressed by a value obtained by dividing the defect signal level by the contrast of the phase difference image signal (difference between the maximum value and the minimum value of the phase difference image signal), that is, the ratio to the contrast. This is because the correlation calculation for obtaining the phase difference generally depends largely on the contrast of the phase difference image signal, so it is more convenient to convert the defect signal level into a ratio to the contrast in order to consider the influence of the defective pixel. It is. Here, the contrast of the phase difference image signal is assumed to be such that a defective pixel exists for the A image signal and no defective pixel exists for the B image signal. calculate.

Assuming that the value of the B image signal obtained from all 65 pixels having pixel numbers i = 0 to 64 shown in FIG. 8A is B (i), the contrast PB is the maximum value Max {B ( i)} and the minimum value Min {(Bi)},
PB = Max {B (i)}-Min {(Bi)}
Calculated by If no defective pixel exists for the A image signal and there is a defective pixel for the B image signal, the contrast PB may be calculated using the value A (i) of the A image signal.

When the defect signal level stored in advance as part of the defective pixel information in the storage unit 112 is n, the normalized defect signal level S_lvl is
S_lvl = n / PB
Is required.

  It is assumed that the defect signal level S_lvl = + 40 [%] of a defective pixel that exists for only one pixel with respect to the A image signal. FIG. 8B shows which defocus amount finally obtained when this defective pixel is present at the position of each pixel No. among the above 65 pixels with respect to the true defocus amount (= 0). It is shown that it shifts only (has an error).

  As can be seen from FIG. 8B, even when the defect signal level is constant (+ 40%), the error in the defocus amount varies depending on the position of the pixel No where the defective pixel exists. For example, in the example shown in FIG. 8B, the maximum error of the defocus amount when S_lvl = + 40 [%] is ± 50 [μm when defective pixels exist at the positions of pixel No = 30 and 37. ]. If the maximum defocus amount error is known, the AF error actually performed (hereinafter referred to as the actual AF error) falls within the AF accuracy range (hereinafter referred to as the required AF accuracy range) required of the imaging apparatus. The defect signal level is determined.

  In FIG. 9, the control unit 107 that has started the selection process determines whether or not there is a defective pixel in the AF pixel row of the image sensor 102 in step S <b> 7041 with respect to the phase difference image signal stored in the storage unit 112. Determination is performed using pixel information. If there is no defective pixel in the AF pixel row, the control unit 107 allows the use of the phase difference image signal and the image signal as it is, and ends this processing. On the other hand, if a defective pixel exists in the AF pixel row, the process proceeds to step S7042.

  In step S7042, the control unit 107 determines whether or not the defect signal level S_lvl of the defective pixel is higher than the phase difference threshold (predetermined value), that is, the actual AF error when the defective pixel is used deviates from the required AF accuracy range. It is determined whether or not. When the defect signal level is higher than the phase difference threshold, the defect signal level is a signal level that requires correction of a phase difference image signal including a defective pixel signal from the defective pixel (hereinafter referred to as a phase difference defect correction level). ), The process proceeds to step S7043. On the other hand, if the defect signal level S_lvl is equal to or lower than the threshold value and the defect signal level is not the phase difference defect correction level (the actual AF error falls within the required AF accuracy range), the process proceeds to step S7044.

  In step S7043, the control unit 107 determines (selects) whether or not to perform interpolation correction processing on the image signal using defective pixel information on the image signal stored in the storage unit 112.

  Here, the defective pixel information for the image signal includes a table indicating the threshold value for the image signal in accordance with the temperature, the sensitivity of the image sensor 102 and the exposure time, in addition to the information on the position of the defective pixel and the signal level. The image signal threshold is used to determine a defect signal level higher than this as a signal level (hereinafter referred to as an image defect correction level) that requires correction of an image signal including a defective pixel signal having the defect signal level. The control unit 107 corresponds to the operating temperature of the image sensor 102 obtained from the temperature detection unit 113, the sensitivity of the image sensor 102 when the sensitivity is designated by a user operation, and the shutter speed (exposure time) set by the AE process. The image defect correction level is read from the table. If the defect signal level of the defective pixel is the image defect correction level, the process proceeds to step S7045. If the defect signal level is not the image defect correction level, the process proceeds to step S7046.

  In step S7045, the control unit 107 performs an interpolation correction process on both the phase difference image signal and the image signal, or performs a process of changing the AF pixel row to a pixel row that does not include a defective pixel, while the image signal Do interpolation correction processing be performed for? When the AF pixel row changing process is performed, the control unit 107 causes the signal processing unit 104 to generate a new phase difference image signal using the imaging signal from the AF pixel row after the change.

  The interpolation correction process is performed by calculating a signal value after correcting the defective pixel using a signal value of a normal pixel existing around the defective pixel. Further, the AF pixel row changing process is performed by changing the pixel row to a pixel row in the vicinity of the defective pixel (for example, a pixel row adjacent to the defective pixel) that does not include the defective pixel. Thereafter, the control unit 107 ends this process.

  In step S7046, the control unit 107 performs an interpolation correction process on the phase difference image signal, and performs a process of outputting the image signal without performing the correction process on the image signal. Then, this process ends.

  In step S7044, as in step S7043, the control unit 107 determines whether to correct the image signal (the defect signal level of the defective pixel is the image defect correction level). If the defect signal level of the defective pixel is the image defect correction level, the process proceeds to step S7047. On the other hand, when the defect signal level is not the image defect correction level, the process of outputting the image signal is performed without performing the correction process on the image signal, and this process is terminated.

  In step S7047, the control unit 107 performs only the interpolation correction process on the image signal described in step S7045, and outputs the phase difference image signal to the phase difference detection unit 106 without performing the correction process on the phase difference image signal. A process for detecting the phase difference is performed. Then, this process ends.

  As described above, in this embodiment, a phase difference image is obtained by using threshold values (phase difference and image signal threshold values) of different defect signals for each of the phase difference image signal and the image signal including the defective pixel signal. It is determined (selected) whether or not to perform defective pixel correspondence processing separately on the signal and the image signal. Therefore, when the defect signal level (phase difference defect correction level and image defect correction level) to be subjected to defective pixel correspondence processing is different between the phase difference image signal and the image signal, the phase difference image signal and the image signal An appropriate defective pixel handling process can be performed for each of the above.

  Next, an image pickup apparatus that is Embodiment 2 of the present invention will be described. In this embodiment, when a defective pixel exists in the AF pixel row (phase difference detection pixel group), the defective pixel is effectively used within a range where the accuracy of focus detection (that is, AF) is allowed.

  The configuration of the image pickup apparatus of the present embodiment is the same as that of the image pickup apparatus shown in the first embodiment (FIG. 1). In this embodiment, the same components as those of the first embodiment are denoted by the same reference numerals as those of the first embodiment. Instead of explanation. Further, the basic flow of the focus control process in this embodiment is the same as that shown in the first embodiment (FIG. 7). However, the selection process of the defective pixel handling process performed in step S704 in FIG. Further, the defective pixel handling process in this embodiment is a correction process for the phase difference image signal or an AF pixel row changing process.

  In this embodiment, the control unit (focus control unit and processing unit) 107 calculates the defocus amount of the imaging lens by multiplying the phase difference obtained from the phase difference detection unit 106 by the defocus conversion coefficient. In the present embodiment, an imaging apparatus capable of effectively using defective pixels within a range in which focus detection accuracy can be allowed according to the defocus conversion coefficient will be described.

  10 and 11 show how to obtain the defocus conversion coefficient. The image sensor 102 receives light beams limited by lens holding frames 1040 and 1041 that hold lenses such as a focus lens and a variable power lens in the optical barrel 101 and components such as an optical diaphragm in the diaphragm mechanism unit 1013. To do.

  FIG. 10 shows a state in which the light beam is limited (the vignetting is generated) by the optical aperture located at the exit pupil plane 1001 with respect to the pixel near the center of the image sensor (hereinafter referred to as the center pixel). Yes. In FIG. 10, reference numeral 1003 denotes an image pickup element positioned on the planned image formation plane of the image pickup lens, and reference numeral 1004 denotes an image pickup element at a position shifted from the planned image formation plane (position corresponding to the defocus amount 1029). Reference numeral 1005 denotes an optical axis of the imaging lens, and reference numeral 1006 denotes an optical axis position on the imaging element 1003. Reference numerals 1007 and 1008 denote the outermost rays among the light beams limited by the optical diaphragm (hereinafter referred to as “restricted light beams”), and reference numerals 1009 and 1020 denote light beams that are not limited by the optical diaphragm (hereinafter referred to as “unrestricted light beams”). The outermost rays are shown. Further, among the limited light beams (1007, 1008), the phase difference detection light beams are denoted by 1021, 1022, and the centers of gravity of the phase difference detection light beams 1021, 1022 are denoted by 1025, 1026, respectively. Further, among the unrestricted light beams (1009, 1020), the phase detection light beams are indicated by 1023 and 1024, and the centers of gravity of the phase detection light beams 1023 and 1024 are indicated by 1027 and 1028, respectively.

  FIG. 11 shows a change in the gravity center position of the incident light beam due to vignetting on the exit pupil plane 1001 in the central pixel. In FIG. 11, reference numerals 1033 and 1034 respectively denote pupil regions through which the restricted light beam (1007, 1008) and the unrestricted light beam (1009, 1020) incident on the central pixel pass. Reference numeral 1035 denotes an incident angle characteristic of a light beam forming an A image with respect to the PD 203 shown in FIG. 2, and reference numeral 1036 denotes an incident angle characteristic of a light beam forming a B image to the PD 204 shown in FIG. In the PDs 203 and 204, the phase difference detection light beam, which is a part of the light beam that has passed through the circular pupil regions 1033 and 1034, has a sensitivity distribution indicated by contour lines inside the incident angle characteristics 1035 and 1036. Incident to give. Therefore, the center of gravity of the sensitivity distribution of the PDs 203 and 204 with respect to the phase difference detection light beam is obtained, thereby obtaining the distance between the center of gravity when the phase difference detection light beam is a restricted light beam and when it is an unrestricted light beam. be able to. By obtaining and storing information on the sensitivity distribution of the PDs 203 and 204 and the aperture of the imaging lens by measurement or calculation, a defocus conversion coefficient for calculating the defocus amount from the phase difference is obtained using the information. Can be sought.

  In FIG. 10, the defocus amount 1029 is DEF, and the distance 1030 from the image sensor 1003 to the exit pupil plane 1001 is L. In addition, the distance between the gravity centers 1026 and 1025 of the sensitivity distribution by the phase difference detection light beams incident on the PDs 203 and 204 in the limited light beams (1007 and 1008) is G1, and the A image and B formed by the phase difference detection light beams The image shift amount (phase difference) of the image is PRED1 (1031). Further, the distance between the gravity centers 1028 and 1027 of the sensitivity distribution due to the phase difference detection light beam incident on the PDs 203 and 204 of the unrestricted light beam (1009 and 1020) is G2, and the A image and the B image formed by the incident light beam are G2. The amount of image shift (phase difference) is PRED2 (1032). When the defocus conversion coefficients for converting the phase differences PRED1 and PRED2 into the defocus amounts are K1 and K2, respectively, the defocus amounts are obtained by the following equations.

DEF = K1 × PRED1
DEF = K2 × PRED2
The defocus conversion coefficients K1 and K2 are obtained by the following equations, respectively.

K1 = L / G1 (when the luminous flux is limited)
K2 = L / G2 (when the luminous flux is not restricted)
In the above formula, since G1 <G2, K1> K2. This generally means that the value of the defocus conversion coefficient K increases as the phase difference detection light beam is limited.

  When the pixel for detecting the phase difference is not in the vicinity of the optical axis position, vignetting of the phase difference detecting light beam is caused by the optical diaphragm located at a position other than the exit pupil plane 1001. Further, even when the F value is brighter than the optical diaphragm, vignetting of the light flux occurs due to the exit pupil corresponding to the lens holding frame other than the optical diaphragm in the imaging lens.

  FIG. 12 shows a state where a light beam limited by the lens holding frame is incident on a pixel (hereinafter referred to as a peripheral pixel) located at an image height away from the center (optical axis position) of the image sensor. . In FIG. 12, reference numeral 1103 denotes an image pickup element located on the planned image formation plane of the image pickup lens, and 1104 denotes an image pickup element located at a position shifted from the planned image formation plane (position corresponding to the defocus amount 1129). Reference numeral 1105 denotes an optical axis of the imaging lens, and 1106 denotes an optical axis position on the imaging element 1103. Reference numeral 1107 denotes a light beam at the outermost periphery of the restricted light beam limited by the lens holding frame 1140 located closest to the image sensor 1003. Reference numeral 1108 denotes a restricted light beam restricted by the lens holding frame 1141 located closest to the subject. The outermost rays are shown. In addition, the phase difference detection light beam 1121 of the limited light beam (1107) is indicated by 1121, and the center of gravity of the phase difference detection light beam 1121 is indicated by 1125. A phase difference detection light beam 1122 of the restricted light beam (1108) is indicated by 1122, and the center of gravity of the phase difference detection light beam 1122 is indicated by 1126.

  FIG. 13 shows a change in the gravity center position of the incident light beam due to vignetting in the exit pupil plane 1101 in the peripheral pixels. In FIG. 13, reference numeral 1133 denotes a pupil region through which the limited luminous flux (1107, 1108) incident on the peripheral pixels passes. Reference numeral 1135 denotes the incident angle characteristic of the light beam forming the A image with respect to the PD 203 shown in FIG. 2, and 1136 denotes the incident angle characteristic of the light beam forming the B image to the PD 204 shown in FIG. In PD 203 and PD 204, the phase difference detection light beam, which is a part of the light beam transmitted through the inside of the pupil region 1133, gives the PD 203 and 204 a sensitivity distribution indicated by contour lines inside the incident angle characteristics 1135 and 1136. Incident. Therefore, by obtaining the centroids of the sensitivity distributions of the PDs 203 and 204 with respect to the phase difference detection light beam, the distance between the centroids when the phase difference detection light beam is limited by the lens holding frame can be obtained. By obtaining and storing information on the sensitivity distribution of the PDs 203 and 204 and the aperture of the imaging lens by measurement or calculation, a defocus conversion coefficient for calculating the defocus amount from the phase difference is obtained using the information. Can be sought.

  In FIG. 12, the defocus amount 1129 is DEF, and the distance 1130 from the image sensor 1103 to the exit pupil plane 1101 is L. Further, among the limited light beams (1107, 1108), the distance between the gravity centers 1126, 1125 of the sensitivity distribution by the phase difference detection light beams incident on the PDs 203, 204 is G3, and the A image and B formed by the phase difference detection light beams The image shift amount (phase difference) of the image is PRED3 (1131). When the defocus conversion coefficient for converting the phase difference PRED3 into the defocus amount is K3, the defocus amount is obtained by the following equation.

DEF = K3 × PRED3
Further, the defocus conversion coefficient K3 is obtained by the following equation.

K3 = L / G3
In the present embodiment, a case is described in which the phase difference detection light beam is limited by the lens holding frame in accordance with the position (image height) of the pixel used for phase difference detection on the image sensor. However, in addition, the phase difference detection is also performed by a change in the exit pupil distance, which is the distance from the image plane of the imaging lens to the optical image (exit pupil) formed by the lenses included in the zoom mechanism unit 1012 and the focus mechanism unit 1011. The position where the luminous flux is limited changes. In addition, the position where the phase difference detection light beam is limited also changes due to the difference in aperture of the imaging lens and the individual difference in the sensitivity distribution of the pixels due to manufacturing variations of the imaging device 102.

  As described with reference to FIGS. 10 to 13, the defocus conversion coefficient for converting the phase difference into the defocus amount is obtained by changing the light beam limiting conditions such as the aperture value of the optical diaphragm and the position where the light beam is limited. Change. That is, the sensitivity of the defocus amount with respect to the phase difference PRED changes when the light beam is limited. The larger the aperture value of the imaging lens at the time of phase difference detection (focus detection), and the higher the image height from the optical axis position on the image sensor, the greater the defocus conversion coefficient value, and the defocus conversion coefficient value becomes larger. The sensitivity of the focus amount increases. Furthermore, the sensitivity distribution varies from individual to individual within the imaging plane due to a change in the angle of incident light rays to the pixels due to optical manufacturing variations in the imaging element 102. Therefore, the sensitivity of the defocus amount with respect to the phase difference PRED is also increased by changing the captured light flux for each individual.

  Next, the flow of the selection process performed in step S704 in FIG. 7 in the present embodiment will be described with reference to the flowchart in FIG.

  In step S1201, the control unit 107 that has started the selection process uses the defective pixel information for the phase difference image signal stored in the storage unit 112 to determine whether or not there is a defective pixel in the AF pixel row of the image sensor 102. Judgment. If there is no defective pixel in the AF pixel row, the control unit 107 allows the use of the phase difference image signal and the image signal as it is, and ends this processing. On the other hand, if a defective pixel exists in the AF pixel row, the process proceeds to step S1202.

  In step S1202, the state of the imaging lens that is the imaging condition, that is, the aperture value and the exit pupil distance are confirmed.

  Next, in step S1203, the control unit 107 checks the position (image height) of the AF pixel row on the image sensor 102 (imaging surface).

  In step S1204, the control unit 107 selects the defocus conversion coefficient K based on the imaging condition acquired in step S1202 and the image height of the AF pixel row acquired in step S1203.

  Here, the control unit 107 stores (holds) the defocus conversion coefficient corresponding to the aperture value, exit pupil distance, and image height of the AF pixel row as table data in its internal memory (or external memory). Yes. The coefficient table which is the table data is created as follows, for example. First, in the manufacturing / adjustment process of the imaging apparatus, the sensitivity distribution of pixels at each image height in the imaging element 102 is detected (measured) while changing the aperture value and the exit pupil distance for each individual. Next, a defocus conversion coefficient corresponding to the detected sensitivity distribution is selected from defocus conversion coefficients corresponding to a plurality of prepared sensitivity distributions, and the aperture value, exit pupil distance, and image height of the AF pixel row are selected. A defocus conversion coefficient corresponding to is obtained. The coefficient table is created by tabulating these defocus conversion coefficients.

  As described above, since the position of the center of gravity of the phase difference detecting light beam on the exit pupil plane is shifted due to the vignetting of the light beam, the control unit 107 confirms the imaging conditions obtained in steps S1202 and S1203 and the image height of the AF pixel row. Then, a defocus conversion coefficient K corresponding to the imaging condition and the image height of the AF pixel row is selected from the coefficient table stored in the memory.

  In step S1205, the control unit 107 compares the defocus conversion coefficient K selected in step S1204 with the conversion coefficient threshold value Kth, and determines whether the defocus conversion coefficient K is greater than the conversion coefficient threshold value Kth. Thus, it is confirmed whether or not the amount of phase difference variation (that is, the actual AF error) due to the influence of the defective pixel falls within the required AF accuracy range. A method for determining the conversion coefficient threshold value Kth will be described later. If the defocus conversion coefficient K is larger than the conversion coefficient threshold value Kth, the process advances to step S1206 because the actual AF error does not fall within the required AF accuracy range. On the other hand, when the defocus conversion coefficient K is equal to or smaller than the conversion coefficient threshold value Kth, it is determined that the actual AF error is within the required AF accuracy range, and this process is terminated without performing the defective pixel handling process.

  In step S1206, the control unit 107 performs an interpolation correction process on the phase difference image signal, or performs a process of changing the AF pixel row to a pixel row that does not include a defective pixel, and newly adds a phase difference image to the signal processing unit 104. Do you want to generate a signal? The interpolation correction process is performed by calculating a signal value after correcting the defective pixel using a signal value of a normal pixel existing around the defective pixel. The AF pixel row is changed by changing the pixel row to a pixel row in the vicinity of the defective pixel (for example, a pixel row adjacent to the defective pixel) that does not include the defective pixel. Thereafter, the control unit 107 ends this process.

  A method for determining the conversion coefficient threshold value Kth from the relationship between the defect signal level S_lvl and the defocus conversion coefficient K described in the first embodiment will be described with reference to FIG. The error in the defocus amount calculated from the phase difference is obtained by multiplying the magnitude of the influence on the phase difference by the defective pixel and the defocus conversion coefficient K. Therefore, the conversion coefficient threshold value Kth is determined according to the defect signal level S_lvl corresponding to the defocus amount error (that is, the actual AF error) falling within the required AF accuracy range.

  The vertical axis in FIG. 15 indicates the defect signal level S_lvl that is the signal level of the defective pixel included in the AF pixel row, and the horizontal axis indicates the defocus conversion coefficient K. The straight line connecting the white diamond points in the figure indicates the defocus conversion coefficient K for calculating the maximum error of the defocus amount that falls within the required AF accuracy range at each defect signal level S_lvl, that is, the conversion coefficient threshold value Kth. Yes. For example, when the defective pixel level S_lvl is 40%, the defocus conversion coefficient for calculating the maximum error of the defocus amount that falls within the required AF accuracy range is K7, and therefore the control unit 107 sets the conversion coefficient threshold value Kth as the conversion coefficient threshold value Kth. Set K7.

  The control unit 107 may store conversion coefficient threshold values Kth corresponding to all defect signal levels in a memory. Further, only a plurality of conversion coefficient threshold values Kth corresponding to a plurality of discrete defect signal levels (hereinafter referred to as specific defect signal levels) indicated by white diamond points in FIG. 15 may be stored in the memory. In this case, when setting the conversion coefficient threshold value Kth corresponding to the specific defect signal level, the conversion coefficient threshold value Kth corresponding to the specific defect signal level is read from the plurality of conversion coefficient threshold values Kth stored in the memory. Further, when setting the conversion coefficient threshold value Kth for a defect signal level other than the specific defect signal level (hereinafter referred to as a non-specific defect signal level), it corresponds to two specific defect signal levels close to the non-specific defect signal level. Linear interpolation calculation using two conversion coefficient threshold values Kth is performed. Thereby, the conversion coefficient threshold value Kth corresponding to the non-specific defect signal level is obtained.

  As described above, in this embodiment, different defocus conversion coefficients are set according to the optical manufacturing variation of the image sensor 102, the imaging conditions (aperture value, exit pupil distance), and the image height of the AF pixel row. Then, it is determined (selected) whether or not to perform the defective pixel handling process according to the result of comparing the defocus conversion coefficient and the conversion coefficient threshold value Kth. Specifically, the defective pixel correspondence processing is performed only when the defocus conversion coefficient is larger than the conversion coefficient threshold value Kth set according to the signal level of the defective pixel, that is, when the AF accuracy required for the imaging apparatus cannot be guaranteed. Do. Thus, in a situation where the defocus conversion coefficient is smaller than the conversion coefficient threshold Kth and the sensitivity of the defocus amount error to the phase difference error due to the influence of the defective pixel is low, the defective pixel is effectively used to detect the focus (that is, AF) can be performed. On the other hand, in a situation where the defocus conversion coefficient is larger than the conversion coefficient threshold value Kth and the sensitivity of the defocus amount error to the phase difference error due to the influence of the defective pixel is high, the influence of the defective pixel is suppressed or eliminated. Focus detection can be performed with high accuracy.

In each of the above-described embodiments, the case where the interpolation correction process or the AF pixel row change process is performed as the defective pixel handling process for the phase difference image signal has been described. However, as a defective pixel handling process other than these processes, a correction process may be performed in which a phase difference signal is generated only from normal pixels excluding defective pixels in an AF pixel row including defective pixels. For example, a phase difference image signal corrected by an addition process or an average process between normal pixels may be generated.
(Other examples)
The present invention supplies a program that realizes one or more functions of the above-described embodiments to a system or apparatus via a network or a storage medium, and one or more processors in a computer of the system or apparatus read and execute the program This process can be realized. It can also be realized by a circuit (for example, ASIC) that realizes one or more functions.

  Each embodiment described above is only a representative example, and various modifications and changes can be made to each embodiment in carrying out the present invention.

102 Image sensor 104 Signal processing unit 106 Phase difference detection unit 107 Control unit 112 Storage unit

Claims (13)

An image sensor that photoelectrically converts a subject image formed by the imaging optical system using a plurality of pixels;
A display or recording image signal is generated using output signals from the plurality of pixels, and an output signal from a phase difference detection pixel group among the plurality of pixels is used in accordance with a focus state of the imaging optical system. Signal generating means for generating a phase difference image signal having a phase difference;
Phase difference detection means for detecting the phase difference from the phase difference image signal;
Focus control means for performing focus control of the imaging optical system using the phase difference;
Storage means for storing information about defective pixels included in the image sensor;
Processing means capable of performing defective pixel correspondence processing on the phase difference image signal and the image signal when the defective pixel is included in the phase difference detection pixel group;
The processing means separately selects whether or not to perform the defective pixel correspondence processing on each of the phase difference image signal and the image signal using information on the defective pixel. apparatus.   The imaging apparatus according to claim 1, wherein the information on the defective pixel includes information on a position of the defective pixel and information on a signal level of the defective pixel. Whether the processing means performs the defective pixel handling process by determining whether a signal level of the defective pixel is higher than a predetermined value when the defective pixel is included in the phase difference detection pixel group. Select
The imaging apparatus according to claim 2, wherein the predetermined value is used separately in the determination for the phase difference image signal and the determination for the image signal.   The imaging apparatus according to claim 1, wherein the defective pixel handling process is one of a process of correcting the phase difference image signal or the image signal and a process of changing the phase difference detection pixel group. Image generation for generating an image signal for display or recording on a computer of an image pickup apparatus having an image pickup device that photoelectrically converts a subject image formed by an image pickup optical system using a plurality of pixels, using output signals from the plurality of pixels A computer program for performing processing and focus control processing for performing focus control of the imaging optical system,
The focus control process generates a phase difference image signal having a phase difference corresponding to a focus state of the imaging optical system using an output signal from a phase difference detection pixel group among the plurality of pixels, and the phase difference image A process of detecting the phase difference from a signal and performing the focus control using the phase difference;
The program is stored in the computer.
Obtaining information on defective pixels contained in the image sensor;
When the defective pixel is included in the phase difference detection pixel group, it is possible to perform defective pixel correspondence processing on the phase difference image signal and the image signal,
A control program for an imaging apparatus, wherein information regarding the defective pixel is used to separately select whether or not to perform the defective pixel correspondence processing on each of the phase difference image signal and the image signal. An image sensor that photoelectrically converts a subject image formed by the imaging optical system using a plurality of pixels;
Signal generating means for generating a phase difference image signal having a phase difference corresponding to a focus state of the imaging optical system using an output signal from a phase difference detection pixel group among the plurality of pixels;
Phase difference detection means for detecting the phase difference from the phase difference image signal;
A focus control unit that calculates a defocus amount of the imaging optical system using the phase difference and a defocus conversion coefficient, and performs focus control of the imaging optical system according to the defocus amount;
Storage means for storing information about defective pixels included in the image sensor;
Processing means capable of performing defective pixel correspondence processing on the phase difference image signal when the defective pixel is included in the phase difference detection pixel group;
The focus control unit sets the defocus conversion coefficient according to the state of the imaging optical system and the position of the phase difference detection pixel group,
The processing means includes
Setting a threshold for the defocus conversion coefficient using information about the defective pixel;
An imaging apparatus, wherein whether or not to perform the defective pixel handling process is selected according to a result of comparing the defocus conversion coefficient and the threshold value.   The processing means does not perform the defective pixel handling process when the defocus conversion coefficient is smaller than the threshold value, and performs the defective pixel handling process when the defocus conversion coefficient is larger than the threshold value. The imaging device according to claim 6.   The imaging apparatus according to claim 6, wherein the state of the imaging optical system includes an aperture value and an exit pupil distance of the imaging optical system.   7. The focus control unit sets the defocus conversion coefficient according to a state of the imaging optical system, a position of the phase difference detection pixel group, and a sensitivity distribution of the phase difference detection pixel group. The imaging device according to any one of 1 to 8.   10. The image pickup apparatus according to claim 6, wherein the information regarding the defective pixel includes information regarding a position of the defective pixel and information regarding a signal level of the defective pixel. 11.   The imaging apparatus according to claim 10, wherein the processing unit sets the threshold according to a signal level of the defective pixel.   The defect pixel handling process is one of a process for correcting the phase difference image signal or image signal and a process for changing the phase difference detection pixel group. The imaging device described in 1. Focus control processing for performing focus control of the imaging optical system using an output signal from the plurality of pixels in a computer of an imaging apparatus having an imaging element that photoelectrically converts a subject image formed by the imaging optical system by a plurality of pixels Is a computer program that
The focus control process generates a phase difference image signal having a phase difference corresponding to a focus state of the imaging optical system using an output signal from a phase difference detection pixel group among the plurality of pixels, and the phase difference image Processing for detecting the phase difference from a signal, calculating a defocus amount of the imaging optical system using the phase difference and a defocus conversion coefficient, and performing focus control of the imaging optical system according to the defocus amount And
The program is stored in the computer.
Obtaining information on defective pixels contained in the image sensor;
When the defective pixel is included in the phase difference detection pixel group, it is possible to perform a defective pixel corresponding process on the phase difference image signal,
The defocus conversion coefficient is set according to the state of the imaging optical system and the position of the phase difference detection pixel group,
Using information about the defective pixel to set a threshold for the defocus conversion coefficient;
A control program for an imaging apparatus, which makes a selection as to whether or not to perform the defective pixel handling process in accordance with a result of comparing the defocus conversion coefficient and the threshold value.