JP2022097687A - Imaging element and imaging apparatus - Google Patents

Abstract

PROBLEM TO BE SOLVED: To suppress fluctuations in the conversion gain of a charge voltage.

SOLUTION: An imaging element includes a microlens through which light is allowed to transmitted, a plurality of photoelectric conversion units that photoelectrically convert the light transmitted through the microlens, a first photoelectric conversion unit from among the plurality of photoelectric conversion units, a second photoelectric conversion unit from among the plurality of photoelectric conversion units, a first floating diffusion to which a first charge converted photoelectrically by the first photoelectric conversion unit is transferred, a second floating diffusion to which a second charge converted photoelectrically by the second photoelectric conversion unit is transferred, a first amplification unit connected to the first floating diffusion, a second amplification unit connected to the second floating diffusion, a first signal line connected to the first amplification unit, a second signal line connected to the second amplification unit, and a first connection switch that is controlled so as to be able to connect the first amplification unit and the first signal line, and connect the second amplification unit and the second signal line.

SELECTED DRAWING: Figure 1

COPYRIGHT: (C)2022,JPO&INPIT

Description

The present invention relates to an image pickup device and an image pickup apparatus.

An image pickup device that adds (mixes) the charges of two light receiving elements and reads out the potential corresponding to the added charges is known (Patent Document 1). However, the conventional image pickup apparatus has a problem that the conversion gain when converting the added charge into the potential fluctuates.

Japanese Patent Application Laid-Open No. 2016-139859

According to the first aspect of the present invention, the image pickup device is the first of the microlens that transmits light, a plurality of photoelectric conversion units that photoelectrically convert the light transmitted through the microlens, and the plurality of photoelectric conversion units. The photoelectric conversion unit, the second photoelectric conversion unit among the plurality of photoelectric conversion units, the first floating diffusion to which the first charge photoelectrically converted by the first photoelectric conversion unit is transferred, and the above. A second floating diffusion to which the second charge photoelectrically converted by the second photoelectric conversion unit is transferred, a first amplification unit connected to the first floating diffusion unit, and the second floating diffusion unit. The second amplification unit to be connected, the first signal line connected to the first amplification unit, the second signal line connected to the second amplification unit, and the first amplification unit. The first connection switch is controlled so as to be connectable between the first signal line and the second signal line, and between the second amplification unit and the second signal line.
Further, according to the second aspect of the present invention, the image pickup apparatus includes the image pickup element according to the first aspect, an image pickup optical system for forming an image of light from a subject on the image pickup element, and the image pickup element and the image pickup. The control unit includes a control unit that controls the optical system, and the control unit performs focus detection of the image pickup optical system based on a signal output from the image pickup element when the first connection switch is disconnected. It has a detection unit.
Further, according to the third aspect of the present invention, the image pickup device includes the image pickup device according to the first aspect.

It is a block diagram which shows the structure of the image pickup apparatus which concerns on 1st Embodiment. The circuit diagram which shows the composition of the pixel which concerns on 1st Embodiment. The figure for demonstrating the operation example of the image pickup element which concerns on 1st Embodiment. The figure for demonstrating another operation example of the image pickup device which concerns on 1st Embodiment. The circuit diagram which shows the structure of a part of the image pickup element which concerns on 1st Embodiment. The timing chart which shows the operation example of the image pickup device which concerns on 1st Embodiment. A timing chart showing another operation example of the image pickup device according to the first embodiment. The circuit diagram which shows the composition of the pixel which concerns on 2nd Embodiment. The circuit diagram which shows the composition of the pixel which concerns on 3rd Embodiment. The circuit diagram which shows the structure of a part of the image pickup element which concerns on 3rd Embodiment. The timing chart which shows the operation example of the image pickup device which concerns on 3rd Embodiment. A timing chart showing another operation example of the image pickup device according to the third embodiment. The circuit diagram which shows the structure of the pixel which concerns on modification 1.

(First Embodiment)
FIG. 1 is a block diagram showing a configuration of an image pickup apparatus according to the first embodiment. FIG. 1 shows a configuration example of an electronic camera 1 (hereinafter referred to as a camera 1) which is an example of an image pickup apparatus according to the first embodiment. The camera 1 includes an image pickup optical system (imaging optical system) 2, an image pickup element 3, a control unit 4, a memory 5, a display unit 6, and an operation unit 7. The image pickup optical system 2 has a plurality of lenses and an aperture including a focus adjustment lens (focus lens), and forms a subject image on the image pickup element 3. The image pickup optical system 2 may be detachable from the camera 1.

The image sensor 3 is, for example, a CMOS image sensor. The image pickup element 3 receives a light beam that has passed through the exit pupil of the image pickup optical system 2 and images a subject image. As will be described in detail later, the image sensor 3 has a plurality of pixels having a microlens and a plurality of photoelectric conversion units (for example, two photoelectric conversion units) in a two-dimensional shape (row direction and column direction intersecting the row direction). Is placed in. The photoelectric conversion unit is composed of, for example, a photodiode (PD). The image pickup device 3 photoelectrically converts the incident light to generate a signal, and outputs the generated signal to the control unit 4.

Although the details of the image pickup element 3 will be described later, the image pickup element 3 is a signal for generating image data, that is, an image pickup signal, and a pair of focus detection signals, that is, first and first focus detection signals for performing phase difference type focus detection for the focal point of the image pickup optical system 2. The focus detection signal of 2 is output to the control unit 4. The first and second focus detection signals photoelectrically convert the first and second images of the first and second luminous fluxes that have passed through the first and second regions of the exit pupil of the imaging optical system 2, respectively. It is a signal.

The memory 5 is, for example, a recording medium such as a memory card. Image data and the like are recorded in the memory 5. The control unit 4 performs writing of data to the memory 5 and reading of data from the memory 5. The display unit 6 displays an image based on image data, information on shooting such as a shutter speed and an aperture value, a menu screen, and the like. The operation unit 7 includes various setting switches such as a release button and a power switch, and outputs an operation signal corresponding to each operation to the control unit 4.

The control unit 4 is composed of a CPU, ROM, RAM, etc., and controls each unit of the camera 1 based on a control program. The control unit 4 has an image data generation unit 4a and a focus detection unit 4b. The image data generation unit 4a performs various image processing on the image pickup signal output from the image pickup element 3 to generate image data. The image processing includes known image processing such as gradation conversion processing, color interpolation processing, and contour enhancement processing.

The focus detection unit 4b performs focus detection processing necessary for automatic focus adjustment (AF) of the image pickup optical system 2 by a known phase difference detection method. Specifically, the focus detection unit 4b detects the amount of image deviation of the first and second images based on the pair of focus detection signals output from the image sensor 3, and degenerates based on the detected amount of image deviation. Calculate the focus amount. Focus adjustment is automatically performed by driving the focus adjustment lens according to the amount of defocus.

The control unit 4 has a process of individually reading signals from a plurality of photoelectric conversion units of each pixel of the image sensor 3 (first control mode) and a process of adding and reading signals from a plurality of photoelectric conversion units (first control mode). 2 control modes) and. In the present embodiment, the details will be described later, but in the case of the first control mode, the control unit 4 is generated by the signal due to the electric charge generated by the first photoelectric conversion unit and the second photoelectric conversion unit. The electric charge signals are read out individually, that is, independently as a pair of focus detection signals.

In the second control mode, the control unit 4 performs a process of adding signals from each of the first and second photoelectric conversion units and reads them out as an image pickup signal. Here, the "addition process" includes a process of averaging a plurality of signals, a process of weighting and adding a plurality of signals, and the like. The control unit 4 performs a first control mode when performing phase difference AF, reads a pair of focus detection signals from the image sensor 3, and performs a second control mode when generating image data. The image pickup signal is read out from the image pickup element 3.

FIG. 2 is a circuit diagram showing a pixel configuration of the image pickup device 3 according to the first embodiment. The pixel 10 includes a microlens ML, a first photoelectric conversion unit 11a, a second photoelectric conversion unit 11b, a first transfer unit 12a, a second transfer unit 12b, and a first reset unit 13a. , A second reset unit 13b, a first floating diffusion (FD) 14a, and a second floating diffusion (FD) 14b. The pixel 10 further includes a first amplification unit 15a, a second amplification unit 15b, a first selection unit 16a, a second selection unit 16b, an addition switch unit 17, and a coupling switch unit 18. Have.

The microlens ML collects the light incident through the image pickup optical system 2 of FIG. 1 on the first photoelectric conversion unit 11a and the second photoelectric conversion unit 11b. The microlens ML surrounds the first and second photoelectric conversion units 11a and 11b in order to show that the light flux passing through the microlens ML is incident on the first and second photoelectric conversion units 11a and 11b. It is indicated by an elliptical line. This elliptical shape does not represent the actual size or the actual shape of the microlens ML.

The first photoelectric conversion unit 11a and the second photoelectric conversion unit 11b are photodiodes PD (PDa, PDb), and have a function of converting incident light into electric charges and accumulating the photoelectrically converted electric charges. The first photoelectric conversion unit 11a and the second photoelectric conversion unit 11b are arranged corresponding to one microlens ML, and receive light flux that has passed through different regions of the exit pupil of the imaging optical system 2. That is, the first photoelectric conversion unit 11a and the second photoelectric conversion unit 11b are the first and second light fluxes of the first and second light fluxes that have passed through the first and second regions of the exit pupil of the imaging optical system 2, respectively. Each of the two images is photoelectrically converted.

The first transfer unit 12a is composed of the transistor M1a controlled by the signal TX1, and transfers the charge photoelectrically converted by the first photoelectric conversion unit 11a to the first FD 14a. That is, the first transfer unit 12a forms a charge transfer path between the first photoelectric conversion unit 11a and the first FD 14a. The transistor M1a is a first transfer transistor. The capacitance Ca of the first FD14a accumulates (retains) the charge transferred to the first FD14a and converts the charge into a voltage divided by the capacitance value of the capacitance Ca. The reference numeral Ca indicating the capacity schematically indicates the capacity added to the first FD14a. The capacitance Ca includes the capacitance (parasitic capacitance) of each transistor such as the gate capacitance of the first amplification unit 15a connected to the first FD 14a, the wiring capacitance, and the like. The gate capacitance is a parasitic capacitance between the gate and the back gate of the transistor.

The first amplification unit 15a amplifies and outputs a signal due to the electric charge stored in the capacitance Ca. The first amplification unit 15a is composed of a transistor M3a in which a drain (terminal), a gate (terminal) and a source (terminal) are connected to a power supply VDD, a first FD14a and a first selection unit 16a, respectively. The source of the first amplification unit 15a is connected to the first vertical signal line VLa via the first selection unit 16a. The first amplification unit 15a functions as a part of the source follower circuit using the first current source 25a shown in FIG. 3 as a load current source. The transistor M3a is a first amplification transistor.

The first reset unit 13a is composed of the transistor M2a controlled by the signal RS1, resets the charge of the capacitance Ca, and resets the voltage of the first FD 14a. The transistor M2a is a first reset transistor. The first selection unit 16a is composed of a transistor M4a controlled by the signal SEL1 and outputs a signal from the first amplification unit 15a to the first vertical signal line VLa. The transistor M4a is a first selection transistor. The first output unit according to the present embodiment is composed of a first amplification unit 15a and a first selection unit 16a, and generates and outputs a signal based on the electric charge generated by the first photoelectric conversion unit 11a. ..

The second transfer unit 12b is composed of the transistor M1b controlled by the signal TX2, and transfers the charge photoelectrically converted by the second photoelectric conversion unit 11b to the second FD 14b. That is, the second transfer unit 12b forms a charge transfer path between the second photoelectric conversion unit 11b and the second FD 14b. The transistor M1b is a second transfer transistor. The capacitance Cb of the second FD 14b accumulates the charge transferred to the second FD 14b and converts the charge into a voltage divided by the capacitance value of the capacitance Cb. The reference numeral Cb indicating the capacitance schematically indicates the capacitance added to the second FD14b. The capacitance Cb includes the capacitance of each transistor such as the gate capacitance of the second amplification unit 15b connected to the second FD 14b, the wiring capacitance, and the like.

The second amplification unit 15b amplifies and outputs a signal due to the electric charge stored in the capacitance Cb. The second amplification unit 15b is composed of a transistor M3b in which a drain, a gate, and a source are connected to a power supply VDD, a second FD14b, and a second selection unit 16b, respectively. The source of the second amplification unit 15b is connected to the second vertical signal line VLb via the second selection unit 16b. The second amplification unit 15b functions as a part of the source follower circuit using the second current source 25b shown in FIG. 3 as a load current source. The transistor M3b is a second amplification transistor.

The second reset unit 13b is composed of the transistor M2b controlled by the signal RS2, resets the charge of the capacitance Cb, and resets the voltage of the second FD 14b. The transistor M2b is a second reset transistor. The second selection unit 16b is composed of a transistor M4b controlled by the signal SEL2, and outputs a signal from the second amplification unit 15b to the second vertical signal line VLb. The transistor M4b is a second selection transistor. The second output unit according to the present embodiment is composed of a second amplification unit 15b and a second selection unit 16b, and generates and outputs a signal based on the charge generated by the second photoelectric conversion unit 11b. ..

The addition switch unit 17 is composed of a transistor M7 controlled by the signal ADD_FD, and connects (couples) the first FD14a and the second FD14b. The coupling switch unit 18 is composed of a transistor M8 controlled by the signal ADD_SF, and connects the first amplification unit 15a and the second amplification unit 15b. More specifically, the coupling switch unit 18 connects the source of the transistor M3a of the first amplification unit 15a and the source of the transistor M3b of the second amplification unit 15b. Further, it can be said that the coupling switch unit 18 connects between the first amplification unit 15a and the first selection unit 16a, and between the second amplification unit 15b and the second selection unit 16b.

In the first control mode, the control unit 4 controls the image pickup element 3 to turn off the transistor M7 of the addition switch unit 17 and turn off the transistor M8 of the coupling switch unit 18. The electric charge photoelectrically converted by the first photoelectric conversion unit 11a is transferred to the first FD 14a by the first transfer unit 12a. Then, the signal corresponding to the electric charge transferred to the first FD 14a (first pixel signal) is read out to the first vertical signal line VLa by the first amplification unit 15a and the first selection unit 16a. Further, the electric charge photoelectrically converted by the second photoelectric conversion unit 11b is transferred to the second FD 14b by the second transfer unit 12b. The signal corresponding to the electric charge transferred to the second FD 14b (second pixel signal) is read out to the second vertical signal line VLb by the second amplification unit 15b and the second selection unit 16b.

As described above, in the first control mode, the first pixel signal generated according to the electric charge from the first photoelectric conversion unit 11a is output to the first vertical signal line VLa, and the second photoelectric conversion unit is used. The second pixel signal generated according to the charge from 11b is output to the second vertical signal line VLb. The first pixel signal and the second pixel signal are output to the control unit 4 as a pair of focus detection signals after being subjected to signal processing by a column circuit or the like described later.

Next, the basic operation of the second control mode will be described. In the second control mode, the control unit 4 turns on the transistor M7 of the addition switch unit 17 and also turns on the transistor M8 of the coupling switch unit 18. Further, the control unit 4 turns on the transistor M4a of the first selection unit 16a and turns off the transistor M4b of the second selection unit 16b, for example. The charges photoelectrically converted by the first and second photoelectric conversion units 11a and 11b are transferred by the first and second transfer units 12a and 12b, respectively, and added by the addition switch unit 17, and the first and second charges are added. It is accumulated in FD14a and 14b of 2. The first and second amplification units 15a and 15b, the coupling switch unit 18 and the first selection unit 16a generate an addition pixel signal according to the added charge and read it out to the first vertical signal line VLa. Is done.

In the second control mode, when the transistor M4a of the first selection unit 16a is turned off and the transistor M4b of the second selection unit 16b is turned on, the additive pixel signal is the second vertical signal line. Read to VLb.

In the present embodiment, the second control mode includes a one-line reading method for reading a signal for each row of pixels 10 arranged two-dimensionally and a two-line simultaneous reading method for reading signals at the same time for two lines. Have. Hereinafter, the "one-line read method" of the second control mode will be described with reference to FIG. 3, and the "two-line simultaneous read method" of the second control mode will be described with reference to FIG.

FIG. 3 shows one of a plurality of pixels 10 arranged in a two-dimensional manner. The image pickup device 3 is provided with a first vertical signal line VLa and a second vertical signal line VLb for a row of a plurality of pixels 10 arranged in a row direction, that is, in a vertical direction. Further, the first current source 25a and the first column circuit unit 40a are provided for the first vertical signal line VLa, and the second current source 25b and the second current source 25b and the second for the second vertical signal line VLb. A column circuit unit 40b is provided. In the example shown in FIG. 3, for simplification of the explanation, only 1 pixel in the row direction × 3 pixels in the column direction is shown, but the image sensor 3 has, for example, several million pixels to several hundred million pixels. , Or more pixels.

The first current source 25a is connected to each pixel 10 via the first vertical signal line VLa, and the second current source 25b is connected to each pixel 10 via the second vertical signal line VLb. .. The first current source 25a and the second current source 25b generate a current for reading a signal from each pixel 10. The first current source 25a supplies the generated current to the first vertical signal line VLa and the first selection unit 16a and the first amplification unit 15a of each pixel 10. Similarly, the second current source 25b supplies the generated current to the second vertical signal line VLb and the second selection unit 16b and the second amplification unit 15b of each pixel 10.

The first column circuit unit 40a and the second column circuit unit 40b are configured to include an analog / digital conversion unit (AD conversion unit), respectively. The first column circuit unit 40a converts a signal input from each pixel 10 via the first vertical signal line VLa into a digital signal. The second column circuit unit 40b converts a signal input from each pixel 10 via the second vertical signal line VLb into a digital signal. The first column circuit unit 40a and the second column circuit unit 40b output the converted digital signal to the horizontal transfer unit described later.

In the one-line readout method of the second control mode, the image sensor 3 receives a signal (additional pixel signal) corresponding to the charge obtained by adding the charge of the first photoelectric conversion unit 11a and the charge of the second photoelectric conversion unit 11b. Is read out to, for example, the first vertical signal line VLa. The example shown in FIG. 3 shows an example of reading an additional pixel signal from the pixel 10 in the first row, that is, the pixel 10 in the bottom row. In the pixel 10 in the first row, the transistor M7 of the addition switch unit 17 is turned on. , The transistor M8 of the coupling switch unit 18 is also turned on. Further, the transistor M4a of the first selection unit 16a is on, and the transistor M4b of the second selection unit 16b is off. On the other hand, in the pixels 10 of the other rows such as the second row and the third row, the transistors M4a and M4b of the first and second selection portions 16a and 16b are turned off. In FIG. 3, ON indicates that the transistor is on (connected state, conduction state, short-circuit state), and OFF indicates that the transistor is off (disconnected state, non-conducting state, open state, cut-off state). Shows.

In the pixel 10 of the first row, the transistor M7 of the addition switch unit 17 is turned on, so that the first FD14a and the second FD14b are electrically connected to each other. Further, the first transfer unit 12a and the second transfer unit 12b are electrically connected to each other. As a result, the electric charge transferred from the first photoelectric conversion unit 11a and the electric charge transferred from the second photoelectric conversion unit 11b are added. It can also be said that the charges generated by each of the first photoelectric conversion unit 11a and the second photoelectric conversion unit 11b are mixed (synthesized). The capacitance Ca and the capacitance Cb are electrically connected, and the electric charge transferred from the first photoelectric conversion unit 11a and the second photoelectric conversion unit 11b is distributed to the capacitance Ca and the capacitance Cb, and the first. The voltage of the FD 14a and the voltage of the second FD 14b are averaged and input to the first and second amplification units 15a and 15b. That is, in each of the first amplification unit 15a and the second amplification unit 15b, the charge obtained by adding the accumulated charge of the capacitance Ca and the accumulated charge of the capacitance Cb is divided by the combined capacitance value of the capacitance Ca and the capacitance Cb. The applied voltage is input.

The transistor M4a of the first selection unit 16a is turned on, the transistor M4b of the second selection unit 16b is turned off, and the transistor M8 of the coupling switch unit 18 is turned on, so that the first and second amplification units 15a, Both 15b are operated in the saturation region by being supplied with a current from the first current source 25a. Since the transistors M3a and M3b of the first and second amplification units 15a and 15b operate in the saturation region, the gate capacitances of the first and second amplification units 15a and 15b both have substantially constant capacitance values.

As described above, since the gate capacitances of the first and second amplification units 15a and 15b are substantially constant values, the capacitance of the first FD14a and the capacitance of the second FD14b also remain at predetermined values. Therefore, the first amplification unit 15a and the second amplification unit 15b divide the charge obtained by adding the accumulated charge of the capacitance Ca and the accumulated charge of the capacitance Cb by the combined capacitance value of the capacitance Ca and the capacitance Cb to the voltage. Based on this, each amplified signal is output. The signal of the first amplification unit 15a and the signal of the second amplification unit 15b are sent to the first vertical signal line VLa as an additive pixel signal via the first selection unit 16a.

As described above, when the additional pixel signal is read from the pixel 10 in the first row on the first vertical signal line VLa, after that, in the image sensor 3, the second row, the third row and the pixel 10 are in line units. The pixels are sequentially selected, and the addition pixel signal is read from the pixel 10 to the first vertical signal line VLa. The additive pixel signal of the pixel 10 output to the first vertical signal line VLa is converted into a digital signal by the first column circuit unit 40a, and then output to the control unit 4 as an image pickup signal.

In the example shown in FIG. 3, the additive pixel signal of the pixel 10 in each row is read out to the first vertical signal line VLa. Therefore, the image sensor 3 can stop the generation of the current by the second current source 25b connected to the second vertical signal line VLb from which the additional pixel signal is not read, and consumes the power of the image sensor 3. It can be reduced. When the transistor M4a of the first selection unit 16a is turned off and the transistor M4b of the second selection unit 16b is turned on, the additive pixel signal can be read out from the pixel 10 to the second vertical signal line VLb.

In the present embodiment, the conversion gain when the first and second FDs 14a and 14b convert the electric charge into a voltage, that is, the reciprocal of the combined capacitance value of the capacitance Ca and the capacitance Cb is always substantially constant. .. Therefore, the additive pixel signal depends on the accumulated charges of the first and second FDs 14a and 14b, and becomes a signal having high linearity. Hereinafter, it will be described that the conversion gains of the first and second FDs 14a and 14b are always substantially constant in comparison with the comparative example.

In the present embodiment, as described above, the transistor M4a and the transistor M8 are turned on and the transistor M4b is turned off, so that the transistors M3a and M3b are both supplied with current from the first current source 25a to be in the saturation region. It becomes the operation in. Therefore, the gate capacitances of the transistors M3a and M3b of the first and second amplification units 15a and 15b are both substantially constant capacitance values and do not substantially fluctuate. Therefore, the capacitance Ca of the first FD14a and the capacitance Cb of the second FD14b also remain at predetermined values, that is, substantially constant values, without being affected by fluctuations in the gate capacitance of the transistors M3a and M3b. Therefore, the conversion gains of the first and second FDs 14a and 14b are always substantially constant. As the miniaturization of pixels progresses, it is considered that the ratio of the gate capacitance to the combined capacitance of the first and second FD14a and 14b increases, and in this case, the gate capacitance fluctuates and the first and second FD14a, It is possible to prevent the linearity of the charge-voltage conversion of 14b from deteriorating.

On the other hand, in the comparative example, the coupling switch unit 18 is deleted in the pixel 10 of FIG. When the transistor M4a of the first selection unit 16a is turned on and the transistor M4b of the second selection unit 16b is turned off, a current is supplied to the first amplification unit 15a, but a current is supplied to the second amplification unit 15b. Is not supplied, and the second amplification unit 15b operates in the weak inversion region. Due to the operation in this weak inversion region, the gate capacitance of the transistor M3b of the second amplification unit 15b changes according to the signal input to the gate. Due to the fluctuation of the gate capacitance of the second amplification unit 15b, the capacitances of the first and second FDs 14a and 14b are also changed, and the conversion gain of the charge voltage is changed.

FIG. 4 is a diagram for explaining a two-line simultaneous reading method of the second control mode. In the two-row simultaneous readout method of the second control mode, for the pixels of the two rows, the additive pixel signal is read from the pixels of one row to the first vertical signal line VLa, and at the same time, from the pixels of the other row. Reads the additive pixel signal to the second vertical signal line VLb. This will be described in detail below.

In FIG. 4, in the pixel 10 in the first row of the bottom row, the transistor M7 of the addition switch unit 17 is turned on, the transistor M8 of the coupling switch unit 18 is also turned on, the transistor M4a of the first selection unit 16a is also turned on, and the second The transistor M4b of the selection unit 16b is turned off. Further, in the pixel 10 of the second row adjacent to the pixel of the first row, the transistor M7 of the addition switch unit 17 is turned on, the transistor M8 of the coupling switch unit 18 is also turned on, and the transistor M4a of the first selection unit 16a is turned off. The transistor M4b of the second selection unit 16b is turned on.

Since the transistor M7 of the addition switch unit 17 is in the ON state in each of the pixels 10 in the first row and the second row, the electric charge transferred from the first photoelectric conversion unit 11a and the charge transferred from the second photoelectric conversion unit 11b are transferred. The added charge is added. Further, in each of the pixels 10 in the first row, the first current source 25a amplifies the current by the first amplification unit 15a and the second amplification unit 15a by turning on the first selection unit 16a and the coupling switch unit 18. It is supplied to each of the parts 15b. On the other hand, in each of the pixels 10 in the second row, by turning on the second selection section 16b and turning on the coupling switch section 18, the second current source 25b amplifies the current by the first amplification section 15a and the second amplification section. It is supplied to each of the parts 15b. In this way, in both the first and second rows, the transistors M3a and M3b of the first and second amplification units 15a and 15b of each pixel 10 operate in the saturation region, and the gate capacitances of the transistors M3a and M3b are both. It becomes a substantially constant value.

An additional pixel signal based on the charge added from the pixel 10 in the first line is read out from the first vertical signal line VLa, and at the same time, the pixel 10 in the second line is read from the second vertical signal line VLb. An additional pixel signal based on the charge added from is read out. When the simultaneous reading of the pixels of the first row and the second row is completed, the simultaneous reading from the pixels of the third row and the fourth row is performed, and further, from the pixels of the odd-numbered rows and the even-numbered rows adjacent to each other thereafter. Simultaneous reading is performed sequentially.

As described above, in the two-line simultaneous reading method shown in FIG. 4, it is possible to simultaneously read the additional pixel signal of the pixels for two lines. Therefore, a signal can be read out at high speed from each pixel 10 arranged in the image sensor 3. Further, even in the two-row simultaneous reading method, the transistors M3a and M3b of the first and second amplification units 15a and 15b are supplied with the current from the first current source 25a or the second current source 25b and are in the saturation region. It becomes the operation in. Therefore, the gate capacitances of the transistors M3a and M3b are both substantially constant values, and the additive pixel signal depends on the accumulated charges of the first and second FD14a and 14b, and becomes a signal with high linearity.

A more detailed circuit configuration and operation of the image pickup device 3 according to the first embodiment will be described with reference to FIGS. 5 to 7. FIG. 5 is a circuit diagram showing the pixels 10 of the image pickup device 3 according to the first embodiment in a two-dimensional manner and showing a more detailed circuit configuration. FIG. 6 is a timing chart showing an operation example of the image pickup device 3 in the case of the one-line readout method of the second control mode. FIG. 7 is a timing chart showing an operation example of the image pickup device 3 in the case of the two-row simultaneous readout method of the second control mode.

As shown in FIG. 5, the image pickup element 3 includes a plurality of pixels 10 arranged in a matrix, a first current source 25a (first current source 25a1 to first current source 25a3), and a second current source 25a3. It has a current source 25b (second current source 25b1 to second current source 25b3). Further, the image pickup device 3 includes a first current control unit 30a (first current control unit 30a1 to first current control unit 30a3) and a second current control unit 30b (second current control unit 30b1 to second). It has a current control unit 30b3) of 2. The image pickup element 3 further includes a first column circuit unit 40a (first column circuit unit 40a1 to first column circuit unit 40a3) and a second column circuit unit 40b (second column circuit unit 40b1 to first). It has a column circuit unit 40b3) of 2), a vertical transfer unit 50, and a horizontal transfer unit 60.

A first vertical signal line VLa (first vertical signal line VLa1 to a first vertical signal line VLa3) and a second vertical signal line VLb (second vertical signal line) corresponding to each row of the pixel 10. VLb1 to the second vertical signal line VLb3) are provided. A first current source 25a, a first current control unit 30a, and a first column circuit unit 40a are provided for the first vertical signal line VLa. Further, a second current source 25b, a second current control unit 30b, and a second column circuit unit 30b are provided for the second vertical signal line VLb. In the example shown in FIG. 5, for simplification of the explanation, only 3 pixels in the row direction × 3 pixels in the column direction are shown as the pixels 10. Of the plurality of pixels 10 shown in FIG. 5, the lower left pixel 10 is defined as the pixel 10 (0,0) in the first row and the first column, and in FIG. 5, the pixels 10 (0,0) to the pixel 10 (2,2). Up to is illustrated. The first current source 25a and the second current source 25b are each composed of, for example, a cascode connection of two transistors, and generate a current based on a bias voltage (voltage Bias 1, voltage Bias 2).

The vertical transfer unit 50 supplies the signal TX, the signal RS, the signal SEL1, the signal SEL2, the signal ADD_FD, the signal ADD_SF, and the power supply voltage VDD to each pixel 10 to control each pixel 10. The first current control unit 30a has switch units 31a and 32a, and an inverter unit 33a, and the second current control unit 30b has switch units 31b, 32b, and an inverter unit 33b. The vertical transfer unit 50 supplies the signal CS1_EN, the signal CS2_EN, and the voltage Vclip to the first current control unit 30a and the second current control unit 30b. In the example shown in FIG. 5, the first transfer unit 12a and the second transfer unit 12b of the pixel 10 are controlled by the same signal TX, and the first reset unit 13a and the second reset unit 13b are It is controlled by the same signal RS.

The horizontal transfer unit 60 sequentially transfers the digital signals converted by the first column circuit unit 40a and the second column circuit unit 40b to a signal processing unit (not shown). The signal processing unit performs signal processing such as correlation double sampling and processing for correcting the signal amount with respect to the signal input from the horizontal transfer unit 60, and outputs the signal to the control unit 4 of the camera 1.

In the timing chart shown in FIG. 6, the horizontal axis indicates the time, and indicates the control signal input to each part of the image pickup device 3 of FIG. 5 in the case of the one-line readout method of the second control mode. Further, in FIG. 6, the transistor to which the control signal is input is turned on when the control signal is at a high level (for example, power supply potential), and the control signal is input when the control signal is at a low level (for example, ground potential). The transistor turns off.

The vertical transfer unit 50 sets the signal ADD_FD and the signal ADD_SF to a high level and sets the second control mode. When the signal ADD_FD becomes high level, the first FD14a and the second FD14b of each pixel 10 are electrically connected to each other. Further, when the signal ADD_SF becomes high level, the first amplification unit 15a and the second amplification unit 15b of each pixel 10 are electrically connected.

The signal CS1_EN is set to high level and the signal CS2_EN is set to low level. When the signal CS1_EN becomes high level, the switch unit 31a of the first current control unit 30a is turned on, and the switch unit 32a is turned off when the low level is input by the inverter unit 33a. As a result, a current is supplied to the first vertical signal line VLa from the first current source 25a via the switch unit 31a.

When the signal CS2_EN becomes low level, the switch unit 31b of the second current control unit 30b is turned off, and the switch unit 32b is turned on. As a result, the supply of the current from the second current source 25b is stopped to the second vertical signal line VLb, and the voltage Vclip is supplied via the switch unit 32b. The second vertical signal line VLb is fixed to a predetermined voltage, and the floating state is avoided. Since the second amplification unit 15b is supplied with a current from the first current source 25a via the first selection unit 16a and the coupling switch unit 18, the second amplification unit 15b is in the weak inversion region. It is avoided to be an operation.

At the time t1 shown in FIG. 6, when the signal RS <0> becomes a high level, the first pixel and the first pixel 10 (0,2), which are the pixels in the first row, are the first and the pixel 10 (0,2), respectively. The transistors M2a and M2b of the second reset units 13a and 13b are turned on, and the potentials of the first and second FD14a and 14b become the reset potentials, respectively. In this case, as described above, since the first FD14a and the second FD14b of the pixel 10 are connected, the potentials of the first and second FDs 14a and 14b are averaged.

Further, at time t1, when the signal SEL1 <0> becomes high level, the signal based on the reset potential becomes the first vertical by the first and second amplification units 15a and 15b, and the first selection unit 16a. It is output to the signal line VLa. That is, the signal (noise signal) when the potentials of the first and second FDs 14a and 14b are reset to the reset potential is read out to the first vertical signal line VLa. The noise signals from each pixel 10 in the first row output to the first vertical signal line VLa are input to the first column circuit units 40a1 to 40a3 and converted into digital signals, respectively.

At time t2, when the signal TX <0> becomes high level, the transistors M1a and M1b of the first and second transfer units 12a and 12b are turned on, and the first and second photoelectric conversion units 11a and 11b are turned on. The charge photoelectrically converted in the above is transferred to the first and second FDs 14a and 14b. In this case, since the first FD14a and the second FD14b are connected, the charges transferred from the two photoelectric conversion units are distributed to the capacitance Ca and the capacitance Cb.

Further, at time t2, since the signal SEL1 <0> is at a high level, the additive pixel signal is the first vertical signal line VLa by the first and second amplification units 15a and 15b and the first selection unit 16a. Is output to. The additional pixel signals from each pixel 10 in the first row output to the first vertical signal line VLa are input to the first column circuit units 40a1 to 40a3 and converted into digital signals, respectively. The noise signal converted into a digital signal and the additional pixel signal are input to the signal processing unit via the horizontal transfer unit 60. The signal processing unit performs correlated double sampling that performs difference processing between the noise signal of the pixel 10 and the additive pixel signal.

At time t3 to time t5, the noise signal is read from the pixel on the second row and the additional pixel signal is read out in the same manner as in the case of the period from time t1 to time t3. At time t5 to time t7, the noise signal is read from the pixel on the third row and the additional pixel signal is read out in the same manner as in the case of the period from time t1 to time 3. As described above, in the one-line readout method shown in FIG. 6, the pixels 10 are sequentially selected in line units, the signals from the two photoelectric conversion units of the pixels 10 are added, and the added pixel signal is used as the first vertical signal line VLa. It can be read. Further, by stopping the supply of the current from the second current source 25b, the power consumption of the image pickup device 3 can be reduced.

In the timing chart shown in FIG. 7, the horizontal axis indicates the time, and indicates the control signal input to each part of the image pickup device 3 of FIG. 5 in the case of the two-line simultaneous readout method of the second control mode. The vertical transfer unit 50 sets the signal ADD_FD and the signal ADD_SF to high levels, as in the case of the one-line readout method shown in FIG. Further, the signal CS1_EN is set to a high level, and a current is supplied to the first vertical signal line VLa from the first current source 25a. Further, in the two-line simultaneous reading method of FIG. 7, the signal CS2_EN is set to a high level. When the signal CS2_EN becomes high level, the switch unit 31b of the second current control unit 30b is turned on. As a result, a current is supplied to the second vertical signal line VLb from the second current source 25b via the switch unit 31b.

At time t1, the signals RS <0> and RS <1> become high level, so that the pixels in the first row and the pixels in the second row (pixels 10 (0,0) to pixels 10 (1,2)). The transistors M2a and M2b of the first and second reset units 13a and 13b of the above are turned on. As a result, the potentials of the first and second FDs 14a and 14b become reset potentials, respectively. Then, since the first FD14a and the second FD14b are connected, the potentials of the first and second FD14a and 14b are averaged.

Further, at time t1, when the signal SEL1 <0> becomes high level, the averaged noise signal of the pixel 10 in the first row is output to the first vertical signal line VLa. The noise signals from each pixel 10 on the first row are input to the first column circuit units 40a1 to 40a3 and converted into digital signals. Further, at time t1, when the signal SEL2 <1> becomes high level, the averaged noise signal of the pixel 10 in the second row is output to the second vertical signal line VLb. The noise signals from each pixel 10 on the second row are input to the second column circuit units 40b1 to 40b3 and converted into digital signals.

At time t2, when the signal TX <0> becomes high level, the transistors M1a and M1b of the first and second transfer units 12a and 12b of the first and second pixels 10 are turned on, and the first and second pixels are turned on. The charges of the photoelectric conversion units 11a and 11b of the above are transferred to the first and second FDs 14a and 14b. Further, at time t2, when the signal TX <1> becomes high level, the charges of the first and second photoelectric conversion units 11a and 11b of the second row pixel 10 become the first and second FD14a and 14b. Transferred to. In this case, since the first FD14a and the second FD14b are connected to each of the pixels 10 in the first row and the second row, the charges transferred from the two photoelectric conversion units are the capacitance Ca and the capacitance Cb. Will be distributed to.

Further, at time t2, since the signal SEL1 <0> and the signal SEL2 <1> are at a high level, the additional pixel signal of the pixel 10 in the first line is output to the first vertical signal line VLa, and the second line is output. The additive pixel signal of the pixel 10 is output to the second vertical signal line VLb. The additional pixel signals from each pixel 10 in the first row output to the first vertical signal line VLa are input to the first column circuit units 40a1 to 40a3 and converted into digital signals, respectively. The additional pixel signals from each pixel 10 in the second row output to the second vertical signal line VLb are input to the second column circuit units 40b1 to 40b3 and converted into digital signals, respectively.

At time t3 to time t5, the signal is read from the pixel on the third row and the signal is read from the pixel on the fourth row at the same time, as in the case of the period from time t1 to time t3. At time t5 to time t7, the signal is read from the pixel on the fifth row and the signal is read from the pixel on the sixth row at the same time, as in the case of the period from time t1 to time t3. As described above, the two-line simultaneous reading method shown in FIG. 7 can simultaneously read the signals of the pixels for two lines. Therefore, a signal can be read out at high speed from each pixel 10 arranged in the image sensor 3.

Next, the proper use of the first control mode, the one-line reading method of the second control mode, and the two-line simultaneous reading method of the second control mode will be described. The control unit 4 controls the image pickup device 3 in the first control mode when the camera 1 performs the focus adjustment operation. Further, when the camera 1 displays the through image (live view image) of the subject on the display unit 6, the control unit 4 reads the image sensor 3 in the first line reading method or two lines simultaneous reading in the second control mode. Control by method. Therefore, when the camera 1 performs the focus adjustment operation while displaying the through image (live view image) of the subject on the display unit 6, the control unit 4 controls the image pickup element 3 in a time-division manner. It is controlled by the one-line read method or the two-line simultaneous read method of the mode and is controlled by the first control mode. When the release operation member of the operation unit 7 is operated, the control unit 4 controls the image pickup device 3 by the one-line reading method or the two-line simultaneous reading method of the second control mode.

Further, when the camera 1 performs high-frame-rate shooting, for example, high-speed continuous shooting or moving image shooting, the control unit 4 sets the image sensor 3 in the second control mode 2 for high-speed readout of the additive pixel signal. It is controlled by the row simultaneous read method. Further, even when the subject movement speed detection unit provided in the camera 1 detects that the subject is moving at a relatively high speed, the control unit 4 reads the additive pixel signal at high speed to reduce image blurring. In order to do so, the image pickup device 3 is controlled by the two-row simultaneous readout method of the second control mode. On the other hand, when the battery remaining amount detecting unit detects that the remaining battery level of the drive battery of the camera 1 is low, the control unit 4 controls the image sensor 3 for the second control in order to reduce the battery consumption. It is controlled by the one-line read method of the mode.

According to the above-described embodiment, the following effects can be obtained. (1) The image pickup element 3 stores the charges generated by the first photoelectric conversion unit 11a and the second photoelectric conversion unit 11b that photoelectrically convert the incident light to generate charges, and the first photoelectric conversion unit 11a. A first storage unit (first FD14a), a second storage unit (second FD14b) that stores the electric charge generated by the second photoelectric conversion unit 11b, and a first photoelectric conversion unit 11a. A first output unit (first amplification unit 15a and first selection unit 16a) that generates and outputs a signal based on the electric charge, and a signal based on the electric charge generated by the second photoelectric conversion unit 11b are generated. The second output unit (second amplification unit 15b and second selection unit 16b) to be output and the first connection unit (coupling switch) arranged between the first output unit and the second output unit. A pixel having a unit 18) and a second connection unit (additional switch unit 17) including a second switch that electrically connects and disconnects the first photoelectric conversion unit 11a and the second photoelectric conversion unit 11b. A first signal line (first vertical signal line VLa) that is connected to the first output unit and outputs a signal from the first output unit is provided. In the present embodiment, the fluctuation of the gate capacitance of the second amplification unit 15b is suppressed by connecting the first amplification unit 15a and the second amplification unit 15b via the coupling switch unit 18. Therefore, it is possible to suppress fluctuations in the conversion gain of the charge voltage. As a result, it is possible to obtain an additive pixel signal having high linearity.

(2) The image pickup device 3 further includes a control unit (vertical transfer unit 50). The control unit connects the first selection switch (first selection unit 16a) and the first connection unit (coupling switch unit 18), and disconnects the second selection switch (second selection unit 16b). As a result, the signals of the first output unit and the second output unit are output to the first signal line (first vertical signal line VLa) via the first selection switch (first selection unit 16a). In the present embodiment, by turning on the transistor M8 of the coupling switch unit 18, a current is supplied from the first current source 25a to the second amplification unit 15b. Therefore, the transistor M3b of the second amplification unit 15b can be operated in the saturation region to make the gate capacitance of the second amplification unit 15b substantially constant. As a result, fluctuations in the conversion gain of the charge voltage can be suppressed.

(Second embodiment)
The image pickup device according to the second embodiment will be described with reference to FIG. FIG. 8 is a circuit diagram showing the configuration of the pixel 10 of the image pickup device 3 according to the second embodiment. In the first embodiment, as shown in FIG. 2 and the like, the addition switch unit 17 is arranged in the pixel 10. In the second embodiment, as shown in FIG. 8, the pixel 10 does not have the addition switch unit 17. Other configurations are the same as those of the first embodiment.

In the first control mode, the transistor M8 of the coupling switch unit 18 is turned off, and the operation is the same as in the case of the first embodiment. That is, the charge photoelectrically converted by the first photoelectric conversion unit 11a is transferred to the first FD14a, and the charge photoelectrically converted by the second photoelectric conversion unit 11b is transferred to the second FD14b. Then, the first pixel signal generated based on the charge from the first photoelectric conversion unit 11a is output to the first vertical signal line VLa, and is generated based on the charge from the second photoelectric conversion unit 11b. The second pixel signal is output to the second vertical signal line VLb.

In the second control mode, the transistor M8 of the coupling switch unit 18 is turned on, and the first amplification unit 15a and the second amplification unit 15b are connected. As a result, the added-averaged added pixel signal of the signals of the first amplification unit 15a and the second amplification unit 15b is output to, for example, the first vertical signal line VL1. The additional pixel signal output to the first vertical signal line VL1 is a signal generated by the first amplification unit 15a based on the potential of the first FD 14a and a second signal based on the potential of the second FD 14b. The signal corresponds to the average of the signals generated by the amplification unit 15b.

As described above, in the present embodiment, by connecting the first amplification unit 15a and the second amplification unit 15b to each other via the coupling switch unit 18, the signals from the two photoelectric conversion units are added and vertical. Output to the signal line. The addition (mixing) of the signals of the first amplification unit 15a and the second amplification unit 15b is performed at the sources of the transistors M3a and M3b of the first amplification unit 15a and the second amplification unit 15b. Therefore, the addition switch unit 17 for adding charges from the two photoelectric conversion units and the wiring connected to the addition switch unit 17 are not required, and the number of elements and the number of wirings arranged in each pixel 10 can be reduced. Can be done. As a result, it becomes possible to miniaturize the pixels and reduce the chip area of the image pickup device. Further, it is possible to prevent the area of the photoelectric conversion unit from becoming small by arranging a large number of elements or the like in the pixel.

Further, in the present embodiment, since the conversion gain is the reciprocal of the capacitance value of one FD, the conversion gain can be increased as compared with the case where the conversion gain is the reciprocal of the combined capacitance value of the two FDs. .. As a result, the noise mixed in the additive pixel signal can be relatively reduced, and the S / N ratio can be improved.

(Third embodiment)
The image pickup device according to the third embodiment will be described with reference to FIG. 9. FIG. 9 is a conceptual diagram showing a configuration example of pixels of the image pickup device 3 according to the third embodiment. In the first embodiment, an example in which a plurality of photoelectric conversion units are arranged for each pixel 10 has been described. In the third embodiment, as shown in FIG. 9, the pixel 10 has a configuration having one photoelectric conversion unit. Other configurations are the same as those of the first embodiment.

The pixel 10 is coupled with a microlens ML, a photoelectric conversion unit 11, a transfer unit 12, a reset unit 13, a floating diffusion (FD) 14, an amplification unit 15, a selection unit 16, and an addition switch unit 17. It has a switch unit 18. The microlens ML collects the light incident through the image pickup optical system 2 on the photoelectric conversion unit 11. The photoelectric conversion unit 11 is arranged corresponding to one microlens ML. The addition switch unit 17 connects each FD14 of a plurality of pixels 10 arranged in the row direction, for example, and the coupling switch unit 18 connects each amplification unit 15 of the plurality of pixels 10 arranged in the row direction, for example. To connect.

In the present embodiment, for example, the control unit 4 performs the first control mode when shooting a still image, individually reads out the signal of each pixel 10 of the image pickup device 3, and the second control unit 4 when shooting a moving image. The control mode is performed, and the signals of the plurality of pixels 10 are added and read out. In the first control mode, the control unit 4 controls the image pickup element 3 to turn off the transistor M7 of the addition switch unit 17 of each pixel 10, and also turns off the transistor M8 of the coupling switch unit 18. In each pixel 10, the charge photoelectrically converted by the photoelectric conversion unit 11 is transferred to the FD 14 by the transfer unit 12. Then, the pixel signal corresponding to the charge transferred to the FD 14 is read out to the vertical signal line VL by the amplification unit 15 and the selection unit 16. As described above, in the first control mode, the pixel signal of each pixel is individually read out to the vertical signal line VL.

In the second control mode, the control unit 4 turns on the addition switch unit 17 and the coupling switch unit 18, and the charge converted by photoelectric conversion by the photoelectric conversion unit 11 of each pixel 10 is added. Then, the amplification unit 15, the selection unit 16, and the coupling switch unit 18 generate an addition pixel signal according to the added charge and read it out to the vertical signal line VL. Hereinafter, the one-line reading method of the second control mode will be described with reference to FIGS. 10 and 11, and the two-line simultaneous reading method of the second control mode will be described with reference to FIGS. 10 and 12.

FIG. 10 is a circuit diagram showing a configuration of a part of the image pickup device according to the third embodiment. FIG. 11 is a timing chart showing an operation example of the image pickup device 3 in the case of the one-line readout method of the second control mode. FIG. 12 is a timing chart showing an operation example of the image pickup device 3 in the case of the two-row simultaneous readout method of the second control mode. In the example shown in FIG. 10, for simplification of the explanation, only 4 pixels in the row direction × 3 pixels in the column direction are shown in the pixel 10. Of the plurality of pixels 10 shown in FIG. 10, the lower left pixel 10 is defined as the pixel 10 (0,0) in the first row and the first column, and in FIG. 10, the pixels 10 (0,0) to the pixel 10 (2,3). Up to is illustrated.

As shown in FIG. 10, the image pickup element 3 includes a plurality of pixels 10 arranged in a matrix, a current source 25 (current source 25a to current source 25d), and a current control unit 30 (current control unit 30a to current control). It has a section 30d), a column circuit section 40 (column circuit section 40a to column circuit section 40d), a vertical transfer section 50, and a horizontal transfer section 60. A vertical signal line VL (vertical signal line VLa to vertical signal line VLd) is provided corresponding to each row of the pixels 10. A current source 25, a current control unit 30, and a column circuit unit 40 are provided for the vertical signal line VL.

In the one-line readout method shown in FIG. 11, the vertical transfer unit 50 sets the signal ADD_FD2 and the signal ADD_SF2 to high levels. The signal ADD_FD1 and the signal ADD_SF1 are each set to a low level. When the signal ADD_FD2 becomes high level, the FD14 of the pixel 10 (0,0) and the FD14 of the pixel 10 (0,1) are electrically connected to each other, and the FD14 of the pixel 10 (0,2) and the pixel 10 are connected to each other. The FD14 of (0,3) is electrically connected to each other. Further, the FD14 of the pixel 10 (1,0) and the FD14 of the pixel 10 (1,1) are electrically connected to each other, and the FD14 of the pixel 10 (1,2) and the FD14 of the pixel 10 (1,3) are connected to each other. Are electrically connected to each other. Further, the FD14 of the pixel 10 (2,0) and the FD14 of the pixel 10 (2,1) are electrically connected to each other, and the FD14 of the pixel 10 (2,2) and the FD14 of the pixel 10 (2,3) are combined with each other. Are electrically connected to each other.

When the signal ADD_SF2 becomes high level, the amplification unit 15 of the pixel 10 (0,0) and the amplification unit 15 of the pixel 10 (0,1) are electrically connected to each other, and the amplification unit 15 of the pixel 10 (0,2) is connected to each other. The amplification unit 15 and the amplification unit 15 of the pixel 10 (0,3) are electrically connected to each other. Further, the amplification unit 15 of the pixel 10 (1,0) and the amplification unit 15 of the pixel 10 (1,1) are electrically connected to each other, and the amplification unit 15 of the pixel 10 (1,2) and the pixel 10 (1) are connected to each other. , 3) The amplification unit 15 is electrically connected to each other. Further, the amplification unit 15 of the pixel 10 (2,0) and the amplification unit 15 of the pixel 10 (2,1) are electrically connected to each other, and the amplification unit 15 of the pixel 10 (2,2) and the pixel 10 (2) are connected to each other. , 3) The amplification unit 15 is electrically connected to each other.

The signal CS1_EN is set to high level and the signal CS2_EN is set to low level. When the signal CS1_EN becomes high level, the switch units 31 of the current control units 30a and 30c are turned on. As a result, currents are supplied to the vertical signal lines VLa and VLc from the current sources 25a and 25c, respectively. Further, when the signal CS2_EN becomes low level, the switch units 31 of the current control units 30b and 30d are turned off, and the switch unit 32 is turned on. As a result, the voltage Vclip is supplied to each of the vertical signal lines VLb and VLd.

At the time t1 shown in FIG. 11, when the signal RS <0> becomes high level, the reset unit 13 of each of the pixels 10 (0,0) to 10 (0,3), which is the pixel in the first row, The transistor M2 is turned on, and the potential of the FD 14 becomes the reset potential. In this case, the potential of the FD 14 is averaged between the FD 14 electrically connected to each other of the pixel 10 (0,0) and the pixel 10 (0,1). Further, the potential of the FD 14 is averaged between the FD 14 electrically connected to each other of the pixel 10 (0, 2) and the pixel 10 (0, 3).

Further, at time t1, when the signal SEL1 <0> becomes high level, the averaged noise signal of the two pixels of the pixel 10 (0,0) and the pixel 10 (0,1) becomes the pixel 10 ( It is output to the vertical signal line VLa via the selection unit 16 of 0,0). Further, the averaged noise signal of the two pixels of the pixel 10 (0,2) and the pixel 10 (0,3) is output to the vertical signal line VLc via the selection unit 16 of the pixel 10 (0,2). Will be done. The noise signals from the pixels 10 of the first line output to the vertical signal lines VLa and VLc are input to the column circuit units 40a and 40c, respectively, and converted into digital signals.

At time t2, the signal TX <0> becomes a high level, so that the pixel 10 (0,0), the pixel 10 (0,1), the pixel 10 (0,2), and the pixel 10 (0,3) The transistor M1 of the transfer unit 12 is turned on, and the charge photoelectrically converted by the photoelectric conversion unit 11 is transferred to the FD 14. In this case, the charges transferred from the photoelectric conversion units 11 of the pixels 10 (0, 0) and the pixels 10 (0, 1) are the capacitance C of the FD 14 of the pixels 10 (0, 0) and the pixels 10 (0, 0). It is distributed to the capacity C of the FD14 of 1). Further, the charges transferred from the photoelectric conversion units 11 of the pixels 10 (0, 2) and the pixels 10 (0, 3) are the capacitance C of the FD 14 of the pixels 10 (0, 2) and the pixels 10 (0, 3). ) Is distributed to the capacity C of the FD14.

Further, since the signal SEL1 <0> is at a high level at time t2, the additional pixel signal obtained by averaging the signals of the two pixels of the pixel 10 (0,0) and the pixel 10 (0,1) is the pixel 10. It is output to the vertical signal line VLa via the selection unit 16 of (0,0). Further, the added pixel signal obtained by averaging the signals of the two pixels of the pixel 10 (0, 2) and the pixel 10 (0, 3) is the vertical signal line VLc via the selection unit 16 of the pixel 10 (0, 2). Is output to. The additional pixel signals from the pixels 10 of the first line output to the vertical signal lines VLa and VLc are input to the column circuit units 40a and 40c, respectively, and converted into digital signals.

At time t3 to time t5, the noise signal is read from the pixel on the second row and the additional pixel signal is read out in the same manner as in the case of the period from time t1 to time t3. At time t5 to time t7, the noise signal is read from the pixel on the third row and the additional pixel signal is read out in the same manner as in the case of the period from time t1 to time 3. As described above, in the one-line readout method, the pixels 10 can be sequentially selected in row units, the signals from the photoelectric conversion units of the two pixels 10 are added, and the added pixel signal can be read out to the first vertical signal line VLa. .. Further, by stopping the supply of the current from the second current source 25b, the power consumption of the image pickup device 3 can be reduced.

In the two-line simultaneous reading method shown in FIG. 12, the vertical transfer unit 50 sets the signal ADD_FD2 and the signal ADD_SF2 to high levels, as in the case of the one-line reading method of FIG. 11 described above. The signal ADD_FD1 and the signal ADD_SF1 are each made into a robel. Further, the signal CS1_EN is set to a high level, and the signal CS2_EN is also set to a high level. When the signal CS1_EN becomes high level, currents are supplied to the vertical signal lines VLa and VLc from the current sources 25a and 25c, respectively. Further, when the signal CS2_EN becomes high level, currents are supplied to the vertical signal lines VLb and VLd from the current sources 25b and 25d, respectively.

At the time t1 shown in FIG. 12, the signals RS <0> and RS <1> become high levels, so that the pixels in the first row and the pixels in the second row (pixels 10 (0, 0) to pixels 10 (1). 3)) The transistor M2 of each reset unit 13 is turned on. In this case, the potentials of the FD 14s are averaged between the FDs 14 electrically connected to each other.

Further, at time t1, when the signal SEL1 <0> becomes a high level, the averaged noise signal of the two pixels of the pixel 10 (0,0) and the pixel 10 (0,1) becomes the pixel 10 ( It is output to the vertical signal line VLa via the selection unit 16 of 0,0). Further, the averaged noise signal of the two pixels of the pixel 10 (0,2) and the pixel 10 (0,3) is output to the vertical signal line VLc via the selection unit 16 of the pixel 10 (0,2). Will be done. Further, at time t1, when the signal SEL2 <1> becomes high level, the averaged noise signal of the two pixels of the pixel 10 (1,0) and the pixel 10 (1,1) becomes the pixel 10 (1). It is output to the vertical signal line VLb via the selection unit 16 of 1 and 1). Further, the averaged noise signal of the two pixels of the pixel 10 (1,2) and the pixel 10 (1,3) is output to the vertical signal line VLd via the selection unit 16 of the pixel 10 (1,3). Will be done. The noise signals from the pixels 10 of the first line and the second line output to the vertical signal lines VLa to VLd are input to the column circuit units 40a to 40d and converted into digital signals, respectively.

At time t2, when the signal TX <0> becomes high level, the transistor M1 of the transfer unit 12 is turned on in the pixels 10 (0,0) to the pixel 10 (0,3), and the photoelectric conversion unit 11 turns on. The photoelectrically converted charge is transferred to the FD 14. Further, at time t2, when the signal TX <1> becomes high level, the transistor M1 of the transfer unit 12 is turned on in the pixels 10 (1,0) to the pixels 10 (1,3), and the photoelectric conversion unit is turned on. The charge photoelectrically converted in 11 is transferred to the FD 14.

Further, at time t2, since the signal SEL1 <0> is at a high level, the additional pixel signal of the two pixels of the pixel 10 (0,0) and the pixel 10 (0,1) is the pixel 10 (0,0). It is output to the vertical signal line VLa via the selection unit 16. Further, the additive pixel signal of the two pixels of the pixel 10 (0, 2) and the pixel 10 (0, 3) is output to the vertical signal line VLc via the selection unit 16 of the pixel 10 (0, 2). Further, at time t2, since the signal SEL2 <1> is at a high level, the additional pixel signal of the two pixels of the pixel 10 (1,0) and the pixel 10 (1,1) is the pixel 10 (1,1). It is output to the vertical signal line VLb via the selection unit 16. Further, the additive pixel signal of the two pixels of the pixel 10 (1,2) and the pixel 10 (1,3) is output to the vertical signal line VLd via the selection unit 16 of the pixel 10 (1,3). The additional pixel signals from the pixels 10 of the first line and the second line output to the vertical signal lines VLa to VLd are input to the column circuit units 40a to 40d and converted into digital signals, respectively.

At time t3 to time t5, the signal is read from the pixel on the third row and the signal is read from the pixel on the fourth row at the same time, as in the case of the period from time t1 to time t3. At time t5 to time t7, the signal is read from the pixel on the fifth row and the signal is read from the pixel on the sixth row at the same time, as in the case of the period from time t1 to time 3. As described above, in the two-line simultaneous reading method, the signals of the pixels for two lines can be read at the same time. Therefore, a signal can be read out at high speed from each pixel 10 arranged in the image sensor 3.

The following modifications are also within the scope of the present invention, and one or more of the modifications can be combined with the above-described embodiment.

(Modification 1)
In the third embodiment described above, an example in which the addition switch unit 17 is provided in the pixel 10 has been described. However, as shown in FIG. 13, the pixel configuration may be configured without the addition switch unit 17. In this case, in the first control mode, the transistor M8 of the coupling switch unit 18 is turned off, and the operation is the same as in the case of the third embodiment. Further, in the second control mode, the transistor M8 of the coupling switch unit 18 is turned on, and the amplification units 15 of each pixel 10 are electrically connected to each other. As a result, the added-averaged added pixel signal of the signal of the amplification unit 15 of each pixel 10 is output to the vertical signal line VL. As described above, in the first modification, by connecting the amplification units 15 of the plurality of pixels 10 to each other via the coupling switch unit 18, the signals from the plurality of photoelectric conversion units are added and output to the vertical signal line. can do. The coupling switch unit 18 does not have to be arranged for each pixel 10. The coupling switch unit 18 may be arranged for each of a plurality of pixels and shared by the plurality of pixels. Further, the addition switch unit 17 may be arranged for each of a plurality of pixels and shared by the plurality of pixels.

(Modification 2)
In the first embodiment described above, an example in which two photoelectric conversion units are arranged in one pixel has been described, but the pixel configuration is not limited to this. The pixel configuration may be configured to have three or more photoelectric conversion units per pixel. In this case, for example, in the first control mode, the signals from the plurality of photoelectric conversion units are individually read out, and in the second control mode, the signals from two or more photoelectric conversion units among the plurality of photoelectric conversion units are read. It may be added and read.

(Modification 3)
In the above-described embodiments and modifications, an example in which a photodiode is used as the photoelectric conversion unit has been described. However, a photoelectric conversion film may be used as the photoelectric conversion unit.

(Modification example 4)
The image pickup element 3 described in the above-described embodiment and modification is applied to a camera, a smartphone, a tablet, a camera built in a PC, an in-vehicle camera, a camera mounted on an unmanned aerial vehicle (drone, radio-controlled model, etc.), and the like. May be good.

Although various embodiments and modifications have been described above, the present invention is not limited to these contents. Other aspects considered within the scope of the technical idea of the present invention are also included within the scope of the present invention.

The disclosure content of the following priority basic application is incorporated here as a quotation.
Japanese Patent Application No. 16283, 2017 (filed on January 31, 2017)

3 Image sensor, 4 Control unit, 10 pixels, 11a 1st photoelectric conversion unit, 11b 2nd photoelectric conversion unit, 17 Addition switch unit, 18 Coupling switch unit, 50 Vertical transfer unit

Claims (23)

A microlens that allows light to pass through,
A plurality of photoelectric conversion units that photoelectrically convert the light transmitted through the microlens, and
The first photoelectric conversion unit among the plurality of photoelectric conversion units and
A second photoelectric conversion unit among the plurality of photoelectric conversion units,
The first floating diffusion to which the first charge converted by photoelectric in the first photoelectric conversion unit is transferred, and
A second floating diffusion to which the second charge photoelectrically converted by the second photoelectric conversion unit is transferred, and
A first amplification unit connected to the first floating diffusion,
A second amplification unit connected to the second floating diffusion,
The first signal line connected to the first amplification unit and
A second signal line connected to the second amplification unit,
A first connection switch that is controlled so as to be able to connect between the first amplification unit and the first signal line, and between the second amplification unit and the second signal line.
An image sensor comprising. In the image pickup device according to claim 1,
The signal based on the first charge is output from the first amplification unit to the first signal line, and the signal based on the second charge is output from the second amplification unit to the first signal line. When the first connection switch is connected, the image pickup device is connected. In the image pickup device according to claim 1,
A second connection switch for controlling the first floating diffusion and the second floating diffusion so as to be connectable is provided.
The first charge and the second charge are accumulated in the first floating diffusion and the second floating diffusion, and are accumulated in the charge accumulated in the first floating diffusion and the second floating diffusion. When a signal based on the electric charge is output from the first amplification unit and the second amplification unit to the first signal line, the first connection switch and the second connection switch are brought into a connected state. Image sensor. The image pickup device according to any one of claims 1 to 3.
The signal based on the first charge is output from the first amplification unit to the first signal line, and the signal based on the second charge is output from the second amplification unit to the second signal line. When the first connection switch is turned off, the image sensor is turned off. In the image pickup device according to claim 1,
A first current source connected to the first amplification unit via the first signal line, and a first current source.
A second current source, which is connected to the second amplification unit via the second signal line, is provided.
An image pickup device to which the first current source and the second amplification unit can be connected via the first connection switch. In the image pickup device according to claim 5,
An image pickup device that connects the first current source and the second amplification unit to the first connection switch when the generation of current is stopped in the second current source. In the image pickup device according to claim 5 or 6,
When the first current source supplies current to the first amplification section and the second current source supplies current to the second amplification section, the first connection switch is turned off. Image sensor. In the image pickup device according to any one of claims 5 to 7.
When the first connection switch is put into the connected state, the first current source supplies current to the first amplification unit and the second amplification unit, so that the second amplification unit is saturated. An image sensor that operates in the area. The image pickup device according to any one of claims 5 to 8.
An image pickup device in which the first connection switch is brought into a connected state when the first current source supplies a current to the first amplification unit and the second amplification unit. In the image pickup device according to any one of claims 5 to 9.
The signal based on the first charge is output from the first amplification unit to the first signal line, and the signal based on the second charge is output from the second amplification unit to the first signal line. When the first connection switch is connected, a current is supplied from the first current source to the second amplification unit via the first connection switch. In the image pickup device according to any one of claims 5 to 10.
The signal based on the first charge is output from the first amplification unit to the first signal line, and the signal based on the second charge is output from the second amplification unit to the second signal line. At that time, the first connection switch is turned off, a current is supplied from the first current source to the first amplification unit, and a current is supplied from the second current source to the second amplification unit. Is supplied with an image pickup element. In the image pickup device according to any one of claims 5 to 11.
An image pickup device comprising a second connection switch in which the first floating diffusion and the second floating diffusion are controlled so as to be connectable. In the image pickup device according to claim 12,
A signal based on the charge accumulated in the first floating diffusion and the second floating diffusion, and the first charge and the second charge are accumulated in the first floating diffusion and the second floating diffusion. Is output from the first amplification unit and the second amplification unit to the first signal line, the second connection switch and the first connection switch are put into a connected state, and the first connection switch is connected. An image pickup device in which a current is supplied from the first current source to the second amplification unit via a connection switch. In the image pickup device according to claim 12 or 13,
The signal based on the first charge is output from the first amplification unit to the first signal line, and the signal based on the second charge is output from the second amplification unit to the second signal line. When this is done, the first connection switch and the second connection switch are turned off, a current is supplied from the first current source to the first amplification unit, and the second current source supplies the current. An image pickup element in which a current is supplied to the second amplification unit. The image pickup device according to any one of claims 5 to 14.
A first selection unit connected to the first amplification unit and the first signal line,
A second selection unit connected to the second amplification unit and the second signal line is provided.
The first amplification unit is connected to the first signal line via the first selection unit.
The second amplification unit is an image pickup device connected to the second signal line via the second selection unit. In the image pickup device according to claim 15,
The first connection switch can connect the region between the first amplification unit and the first selection unit and the region between the second amplification unit and the second selection unit. Image sensor. In the image pickup device according to claim 15 or 16.
The first selection unit connects the first amplification unit and the first signal line, and the second selection unit disconnects the second amplification unit and the second signal line. At this time, the first connection switch is put into a connected state, and a current is supplied from the first current source to the second amplification unit via the first connection switch. The image pickup device according to any one of claims 15 to 17.
The first selection unit connects the first amplification unit and the first signal line, and the second selection unit connects the second amplification unit and the second signal line. At this time, the first connection switch is turned off, a current is supplied from the first current source to the first amplification unit, and a current is supplied from the second current source to the second amplification unit. Is supplied with an image sensor. The image pickup device according to any one of claims 1 to 18.
A first transfer unit connected to the first photoelectric conversion unit,
A second transfer unit connected to the second photoelectric conversion unit is provided.
The first photoelectric conversion unit is connected to the first floating diffusion via the first transfer unit, and the second photoelectric conversion unit is connected to the second floating diffusion via the second transfer unit. An image sensor connected to. In the image pickup device according to any one of claims 1 to 19.
The first reset unit connected to the first floating diffusion and
A second reset section connected to the second floating diffusion is provided.
The first floating diffusion is connected to the first amplification section via the first reset section.
The second floating diffusion is an image pickup device connected to the second amplification unit via the second reset unit. The image pickup device according to any one of claims 1 to 20 and the image sensor.
An image pickup optical system that forms an image of light from a subject on the image sensor,
A control unit for controlling the image pickup element and the image pickup optical system is provided.
The control unit is an image pickup device having a focus detection unit that detects the focus of the image pickup optical system based on a signal output from the image pickup element when the first connection switch is in the disconnected state. In the image pickup apparatus according to claim 21,
The imaging optical system has a focus adjusting lens and a driving unit that changes the position of the focus adjusting lens.
In the focus detection unit, the first connection switch is disconnected, the first signal based on the first charge is output from the first amplification unit to the first signal line, and the second signal line is output. When a second signal based on the electric charge of the above is output from the second amplification unit to the second signal line, the focus adjustment lens is driven based on the first signal and the second signal. Determine the amount,
The control unit is an image pickup device that drives the drive unit based on the drive amount. An image pickup apparatus comprising the image pickup device according to any one of claims 1 to 20.

Images