WO2022113474A1 - Élément d'imagerie à semi-conducteurs et appareil d'imagerie - Google Patents

Élément d'imagerie à semi-conducteurs et appareil d'imagerie Download PDF

Info

Publication number
WO2022113474A1
WO2022113474A1 PCT/JP2021/033244 JP2021033244W WO2022113474A1 WO 2022113474 A1 WO2022113474 A1 WO 2022113474A1 JP 2021033244 W JP2021033244 W JP 2021033244W WO 2022113474 A1 WO2022113474 A1 WO 2022113474A1
Authority
WO
WIPO (PCT)
Prior art keywords
auto
transistor
zero
pair
zero potential
Prior art date
Application number
PCT/JP2021/033244
Other languages
English (en)
Japanese (ja)
Inventor
啓志 熊田
Original Assignee
ソニーセミコンダクタソリューションズ株式会社
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by ソニーセミコンダクタソリューションズ株式会社 filed Critical ソニーセミコンダクタソリューションズ株式会社
Publication of WO2022113474A1 publication Critical patent/WO2022113474A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H03—ELECTRONIC CIRCUITRY
    • H03M—CODING; DECODING; CODE CONVERSION IN GENERAL
    • H03M1/00—Analogue/digital conversion; Digital/analogue conversion
    • H03M1/12—Analogue/digital converters
    • H03M1/50—Analogue/digital converters with intermediate conversion to time interval
    • H03M1/56—Input signal compared with linear ramp
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/75—Circuitry for providing, modifying or processing image signals from the pixel array

Definitions

  • This technology relates to a solid-state image sensor. More specifically, the present invention relates to a solid-state image sensor that performs analog-to-digital conversion using a comparator, and an image pickup device.
  • an ADC Analog to Digital Converter
  • a solid-state image sensor has been proposed in which a fixed externally applied voltage is applied to an input terminal on the lamp side of a comparator in a single-slope ADC (see, for example, Patent Document 1).
  • the voltage of the input terminal of the comparator is initialized to an appropriate value at the time of auto-zero operation by the externally applied voltage.
  • the lower limit of the operating range of the comparator may fluctuate due to process variation, and at that time, the auto-zero voltage determined by the externally applied voltage deviates from the operating range and the operation of the comparator is unstable. May become.
  • This technique was created in view of such a situation, and aims to stabilize the operation of the comparator in the solid-state image sensor in which the ADC including the comparator is arranged.
  • the present technology has been made to solve the above-mentioned problems, and the first aspect thereof is a pair of differential transistors that amplify the difference between an input voltage and a predetermined reference voltage, and the above-mentioned pair of differences.
  • An auto-zero transistor that opens and closes the path between one gate and drain of a dynamic transistor and an auto-zero potential whose fluctuation amount due to process variation is substantially the same as the fluctuation amount of the gate-source voltage of the differential transistor are generated.
  • It is a solid-state imaging device including an auto-zero potential generation circuit that supplies to the other gate of a pair of differential transistors. This has the effect of stabilizing the operation of the comparator.
  • the auto-zero transistor is a pMOS (p-channel Metal Oxide Semiconductor) transistor
  • the pair of differential transistors is an nMOS (n-channel MOS) transistor
  • the auto-zero potential generation is performed.
  • the circuit may include an external pMOS transistor in an on state, an external nMOS transistor in an on state, and an external current mirror transistor that supplies a current to the external pMOS transistor and the external nMOS transistor.
  • the auto-zero transistor and the pair of differential transistors are nMOS transistors, and the auto-zero potential generation circuit supplies a current to the on-state external nMOS transistor and the external nMOS transistor. It may include an external current mirror transistor. This has the effect of improving robustness.
  • a current mirror circuit and a pair of cascode transistors inserted between the pair of differential transistors and the current mirror circuit are further provided, and the auto-zero potential generation circuit is described above.
  • One of the pair of cascode transistors may be controlled to be turned on within a predetermined auto-zero period. This has the effect of reducing the input offset voltage of the comparator.
  • the comparator further comprising a pixel array portion in which a plurality of pixels are arranged in a two-dimensional lattice, and includes the pair of differential transistors and the auto-zero transistor is the pixel array. It may be arranged in each row of parts. This has the effect of performing analog-to-digital conversion on a column-by-column basis.
  • the auto-zero potential generation circuit may be arranged for each of the above columns. This has the effect of generating an auto-zero potential for each row.
  • the auto-zero potential generation circuit may be shared by the respective comparators in a plurality of rows. This has the effect of reducing the circuit scale.
  • the second aspect of the present technology is a pair of differential transistors that amplify the difference between the input voltage and a predetermined reference voltage and output it as a pixel signal, and one gate and drain of the pair of differential transistors.
  • An auto-zero transistor that opens and closes the path between the transistors and an auto-zero potential whose fluctuation amount due to process variation is substantially the same as the fluctuation amount between the gate and source of the differential transistor are generated at the other gate of the pair of differential transistors.
  • It is an image pickup apparatus including an auto-zero potential generation circuit for supplying and a signal processing circuit for processing image data in which the pixel signals are arranged. This has the effect of stabilizing the operation of the comparator in the image pickup device.
  • FIG. 1 It is a block diagram which shows an example of the schematic structure of a vehicle control system. It is explanatory drawing which shows an example of the installation position of the vehicle exterior information detection unit and the image pickup unit. It is a figure which shows an example of the schematic structure of an endoscopic surgery system. It is a block diagram which shows an example of the functional structure of the camera head and CCU shown in FIG.
  • FIG. 1 is a block diagram showing a configuration example of an image pickup apparatus 100 according to a first embodiment of the present technology.
  • the image pickup device 100 captures image data, and includes an optical system 110, a solid-state image pickup element 200, a signal processing circuit 120, a memory 130, and a monitor 140.
  • the optical system 110 collects incident light and guides it to the solid-state image sensor 200.
  • the optical system 110 includes one or a plurality of lenses.
  • the solid-state image sensor 200 generates image data by photoelectric conversion in synchronization with a vertical synchronization signal.
  • the vertical synchronization signal is a periodic signal indicating the imaging timing, and the frequency is, for example, 30 hertz (Hz).
  • the solid-state image sensor 200 supplies the generated image data to the signal processing circuit 120.
  • the signal processing circuit 120 performs various signal processing such as demosaic processing and white balance correction processing on the image data.
  • the signal processing circuit 120 supplies the processed image data to the memory 130 and the monitor 140. It should be noted that some or all of the processing performed by the signal processing circuit 120 can be performed in the solid-state image sensor 200.
  • the memory 130 stores image data.
  • the monitor 140 displays image data.
  • FIG. 2 is a block diagram showing a configuration example of the solid-state image sensor 200 according to the first embodiment of the present technology.
  • the solid-state image sensor 200 includes a vertical scanning circuit 211, a timing control circuit 212, a DAC (Digital to Analog Converter) 213, a pixel array unit 214, a column ADC 230, and a horizontal transfer scanning circuit 215.
  • DAC Digital to Analog Converter
  • Pixels 220 are arranged in a two-dimensional grid pattern in the pixel array unit 214.
  • the set of pixels 220 arranged in the horizontal direction is referred to as a “row”, and the set of pixels 220 arranged in the vertical direction is referred to as a “column”.
  • the pixel 220 photoelectrically converts the incident light to generate an analog pixel signal.
  • the vertical scanning circuit 211 selects and drives rows in order, and outputs a pixel signal to the column ADC 230.
  • the timing control circuit 212 controls the operation timings of the vertical scanning circuit 211, the DAC 213, the column ADC 230, and the horizontal transfer scanning circuit 215 in synchronization with the vertical synchronization signal.
  • the DAC 213 generates a predetermined reference signal and supplies it to the column ADC 230.
  • the reference signal for example, a saw wavy lamp signal is used.
  • the column ADC 230 is provided with an ADC for each column, and performs AD (Analog to Digital) conversion for each pixel signal of the column.
  • the column ADC 230 sequentially outputs the digital signals after AD conversion to the signal processing circuit 120 under the control of the horizontal transfer scanning circuit 215. For each row, AD conversion of the pixel signal of each column in the row is executed, and AD conversion is executed for all rows, so that one image data is generated.
  • the horizontal transfer scanning circuit 215 controls the column ADC 230 to output digital signals in order.
  • FIG. 3 is a circuit diagram showing a configuration example of the pixel 220 according to the first embodiment of the present technology.
  • the pixel 220 includes a photoelectric conversion element 221, a transfer transistor 222, a reset transistor 223, a floating diffusion layer 224, an amplification transistor 225, and a selection transistor 226.
  • the photoelectric conversion element 221 photoelectrically converts incident light to generate an electric charge.
  • the transfer transistor 222 transfers electric charges from the photoelectric conversion element 221 to the stray diffusion layer 224 according to the transfer signal TRG from the vertical scanning circuit 211.
  • the reset transistor 223 is initialized by extracting electric charges from the floating diffusion layer 224 according to the reset signal RST from the vertical scanning circuit 211.
  • the floating diffusion layer 224 accumulates electric charges and generates a voltage according to the amount of electric charges.
  • the amplification transistor 225 amplifies the voltage of the stray diffusion layer 224.
  • the selection transistor 226 outputs a signal of the amplified voltage as a pixel signal according to the selection signal SEL from the vertical scanning circuit 211.
  • a vertical signal line 229 is wired in the pixel array unit 214 for each row, and the pixel signal of each pixel 220 in the row is output to the column ADC 230 via the vertical signal line 229 in the row.
  • the circuit configuration of the pixel 220 is not limited to the configuration illustrated in the figure as long as it can generate a pixel signal.
  • FIG. 4 is a block diagram showing a configuration example of the column ADC 230 according to the first embodiment of the present technology.
  • this column ADC 230 an ADC 231 and a latch circuit 235 are arranged for each column.
  • the ADC 231 and the latch circuit 235 are arranged 2048 each.
  • ADC231 converts the analog pixel signal of the corresponding column into a digital signal.
  • Each of the ADCs 231 includes an auto-zero potential generation circuit 410, capacitances 232 and 233, a comparator 420, and a counter 234.
  • One end of the capacitance 232 is connected to the vertical signal line 229, and the other end is connected to the input terminal of the comparator 420.
  • One end of the capacitance 233 is connected to the DAC 213 and the other end is connected to the input terminal of the comparator 420.
  • the auto-zero potential generation circuit 410 generates a predetermined auto-zero potential and supplies it to the comparator 420.
  • a pixel signal from the pixel array unit 214 and a reference signal from the DAC 213 are input to the comparator 420 via the capacitances 232 and 233.
  • the voltage of the pixel signal is defined as the input voltage V VSL
  • the voltage of the reference signal is defined as the reference voltage V ram .
  • the comparator 420 compares the input voltage VVSL with the reference voltage Vramp , and outputs the comparison result to the counter 234.
  • the counter 234 counts the count value over the period until the comparison result is reversed.
  • the counter 234 outputs a digital signal indicating the count value to the latch circuit 235.
  • the latch circuit 235 holds the digital signal from the corresponding ADC 231.
  • the latch circuit 235 supplies a digital signal to the signal processing circuit 120 under the control of the horizontal transfer scanning circuit 215.
  • an ADC other than the single slope type can be arranged if the ADC includes the comparator 420.
  • SARADC Successessive Approximation Register Analog to Digital Converter
  • the ADC is arranged for each column, it is also possible to arrange the ADC for each pixel.
  • a circuit that generates a time code based on the counter value is arranged outside the pixel array unit, and an ADC composed of a comparator and a data storage unit is arranged for each pixel. Then, the time code when the comparison result is inverted is held in the data storage unit as a digital signal.
  • FIG. 5 is a circuit diagram showing a configuration example of an auto-zero potential generation circuit 410 and a comparator 420 in the ADC 231 according to the first embodiment of the present technology.
  • the auto-zero potential generation circuit 410 includes an external current mirror transistor 411, an external pMOS transistor 412, and an external nMOS transistor 413.
  • the external current mirror transistor 411 for example, a pMOS transistor is used.
  • the comparator 420 includes current mirror transistors 421 and 422, pMOS transistors 431 to 434, 428, 249, differential transistors 423 and 424, a tail current source 425, and an auto-zero transistor 426.
  • a pMOS transistor is used as the current mirror transistor 421, the current mirror transistor 422, and the auto zero transistor 426.
  • the differential transistors 423 and 424 nMOS transistors are used.
  • the current mirror transistors 421 and 422 are connected in parallel to the node of the power supply voltage VDD. Further, the gate of the current mirror transistor 421 is connected to the gate of the current mirror transistor 422 and the gate of the external current mirror transistor 411.
  • the external pMOS transistor 412 and the external nMOS transistor 413 are connected in series between the external current mirror transistor 411 and the node of the reference voltage (ground voltage, etc.) VSS.
  • the gate of the external pMOS transistor 412 is connected to the node of the reference voltage VSS, and the gate of the external nMOS transistor 413 is connected to its drain. By these connections, both the external pMOS transistor 412 and the external nMOS transistor 413 are turned on.
  • the pMOS transistor 431 opens and closes the path between the connection node of the current mirror transistor 421 and the differential transistor 423 and the gate of the differential transistor 423 according to the control signal x ⁇ 2 from the timing control circuit 212.
  • the pMOS transistor 432 opens and closes the path between the gate and drain of the current mirror transistor 421 according to the control signal x ⁇ 7 from the timing control circuit 212.
  • the pMOS transistor 433 opens and closes the path between the gate and drain of the current mirror transistor 422 according to the control signal x ⁇ 6 from the timing control circuit 212.
  • the potential of the connection node between the external current mirror transistor 411 and the external pMOS transistor 412 is defined as the auto-zero potential Vext .
  • the pMOS transistor 428 opens and closes the path between the node of the auto-zero potential Vext and the gate of the differential transistor 423 according to the control signal x ⁇ 4 from the timing control circuit 212.
  • the pMOS transistor 429 opens and closes the path between the node of the auto-zero potential Vext and the gate of the differential transistor 424 according to the control signal x ⁇ 3 from the timing control circuit 212.
  • the gate of the differential transistor 423 is also connected to the capacitance 232 on the vertical signal line 229 side.
  • the drain of the differential transistor 423 is connected to the drain of the current mirror transistor 421.
  • the gate of the differential transistor 424 is connected to the capacitance 233 on the DAC 213 side.
  • the drain of the differential transistor 424 is connected to the drain of the current mirror transistor 422.
  • the voltage of the connection node of the current mirror transistor 422 and the differential transistor 424 is output to the counter 234 as an output voltage Vout indicating the comparison result.
  • the tail current source 425 is commonly connected to the sources of the differential transistors 423 and 424.
  • As the tail current source 425 for example, an nMOS transistor is used.
  • the auto-zero transistor 426 opens and closes the path between the gate and drain of the differential transistor 424 according to the control signal x ⁇ 1.
  • the control signal x ⁇ 1 is supplied by, for example, the timing control circuit 212.
  • the current supplied by the tail current source 425 is defined as IT.
  • the external current mirror transistor 411 supplies the IT / 2 current to the external pMOS transistor 412 and the external nMOS transistor 413, respectively.
  • the gate-source voltage VN_TM of the external nMOS transistor 413 corresponding to this current is expressed by the following equation.
  • VN_TM VTHN_TM + ( IT / ⁇ TM ) 1/2 ... Equation 1
  • VTHN_TM is the threshold voltage of the external nMOS transistor 413
  • ⁇ TM is a coefficient determined by the size of the transistor, the oxide film capacity, and the like.
  • VP_AZM V THP_AZM + ( IT / ⁇ AZM ) 1/2 ... Equation 2
  • VTHP_AZM is the threshold voltage of the external pMOS transistor 412
  • ⁇ AZM is a coefficient determined by the size of the transistor, the oxide film capacity, and the like.
  • the auto-zero potential Vext is expressed by the following equation.
  • the input range (in other words, the operating range) of the comparator 420 is expressed by the following equation.
  • VOV0 indicates the voltage between the source of the differential transistor 423 and the reference voltage VSS (in other words, the source voltage).
  • VN_dim indicates the gate-source voltage of the differential transistor 423.
  • VOV01 represents the drain-source voltage of the differential transistor 423.
  • VP_cur indicates the voltage between the gate and the source of the current mirror transistor 421.
  • Equation 6 the difference between the voltage VN_TM and the voltage VN_dif corresponds to the difference in the threshold voltage of the external nMOS transistor 413 and the differential transistor 423 if the respective coefficients ⁇ are the same.
  • VN_TM > VP_AZM .
  • VTHN_dim is the threshold voltage of the differential transistor 423.
  • the external nMOS transistor 413 is an nMOS transistor having a threshold voltage higher than the differential transistor 423 by VOV0 or more.
  • Equation 6 the difference between the voltage VP_AZM and the voltage VN_dif is premised on the condition that VP_AZM ⁇ VN_TM is satisfied. Therefore, if the condition (1) is satisfied, there is a problem. It does not become.
  • the on-resistance RON of the auto-zero transistor 426 is expressed by the following equation.
  • R ON 1 / ⁇ AZ (V ext -V THP_AZ ) ⁇ ... Equation 8
  • VTHP_AZ is the threshold voltage of the auto-zero transistor 426
  • ⁇ AZ is a coefficient determined by the size of the transistor, the oxide film capacity, and the like.
  • the on-resistance RON is inversely proportional to the auto-zero potential Vext input to the differential transistor 423. Therefore, if the auto-zero potential Vext is set too low in order to widen the operating range, the on -resistance RON rises and the settling time of auto-zero is extended. Therefore, the auto-zero potential Vext needs to be determined in consideration of the on -resistance RON in addition to the operating range of the comparator 420.
  • Equation 3 Substituting Equation 3 into Equation 8 yields the following equation.
  • Equation 9 can be replaced with the following equation.
  • R ON 1 / ⁇ ( ⁇ AZ IT ) 1/2 ⁇ ⁇ ⁇ ⁇ Equation 11
  • Equation 11 From Equation 11, it can be said that the dependence of the on-resistance RON on the process variation is small. Further, the on-resistance RON when VP_AZM ⁇ VN_TM is smaller than the value of Equation 11 because it is premised that the condition of VP_AZM ⁇ VN_TM is satisfied.
  • FIG. 6 is a timing chart showing an example of the operation of the solid-state image sensor 200 according to the first embodiment of the present technology.
  • the timing control circuit 212 supplies low-level control signals x ⁇ 1 and x ⁇ 4.
  • the control signals x ⁇ 2 and x ⁇ 3 are set to a high level.
  • the timing control circuit 212 sets the control signal x ⁇ 6 to a high level and sets the control signal x ⁇ 7 to a low level, and immediately after the timing T1, sets the control signal x ⁇ 6 to a low level and sets the control signal x ⁇ 7 to a high level.
  • the pixel 220 supplies the reset level as the input voltage VVSL via the vertical signal line 229.
  • the reset level indicates the level when the pixel 220 is initialized, and is also called the P phase level.
  • the DAC 213 gradually increases the level of the reference signal.
  • the reset level (P phase level) is AD converted within this period.
  • the pixel 220 supplies the signal level as an input voltage VVSL via the vertical signal line 229.
  • the signal level indicates the level when the electric charge is transferred to the floating diffusion layer in the pixel 220, and is also called the D phase level.
  • the DAC 213 gradually increases the level of the reference signal. The signal level (D phase level) is AD converted within this period.
  • the level (low level) of the control signal x ⁇ 1 at the time of auto zero is set to a relatively high value.
  • the voltage dropped from the power supply voltage VDD by the drain-source voltage of the current mirror transistor connected to the diode is used as the low level of the control signal x ⁇ 1 at auto zero.
  • the column ADC230 or the circuit in the subsequent stage performs CDS (Correlated Double Sampling) processing for obtaining the difference between the P phase level and the D phase level as a net pixel signal.
  • CDS Correlated Double Sampling
  • FIG. 7 is a graph showing an example of the characteristics of the comparator according to the first embodiment of the present technique.
  • the vertical axis shows the voltage and the horizontal axis shows the resistance value.
  • the lower limit of the operating range of the comparator 420 may fluctuate depending on the variation in the process.
  • Arrows with "SS” in the figure indicate the range of variation.
  • the lower limit of the operating range changes (for example, rises) according to the fluctuation of the voltage VN_dim between the gate and the source of the differential transistor 423 due to the variation in the process.
  • the lower limit of the operating range fluctuates (rises), so that the auto-zero potential V ext may deviate from the operating range and the comparator 420 may become unstable. For example, an event in which the inversion of the comparison result of the comparator 420 is significantly delayed or an event in which the inversion is not performed occurs.
  • the fluctuation amount due to the process variation is the fluctuation amount of the voltage VN_dif between the gate and the source of the differential transistor 423. It supplies substantially the same auto-zero potential V ext .
  • the auto-zero potential Vext also fluctuates (rises).
  • the auto-zero potential V ext does not go out of the operating range. Therefore, the operation of the comparator 420 can be stabilized.
  • substantially the same means that the difference between the two values to be compared is less than a predetermined allowable value.
  • the on-resistance RON may fluctuate depending on the variation of the process. Therefore, in the auto-zero potential generation circuit 410, as illustrated in Equation 3, when VN_TM ⁇ VP_AZM , the amount of fluctuation due to process variation is substantially the same as the amount of fluctuation of the threshold voltage V THP_AZM of the auto-zero transistor 426. The potential Vext is supplied. Therefore, as illustrated in Equation 10, fluctuations in the on -resistance RON can be suppressed. As a result, it is possible to prevent a long settling time at the time of auto zero.
  • the auto-zero potential generation circuit 410 supplies an auto-zero potential in which the amount of fluctuation due to process variation is substantially the same as that of the auto-zero transistor 426, so that the comparator 420 operates. Can be stabilized.
  • Second Embodiment> In the first embodiment described above, the pMOS transistor is used as the auto-zero transistor 426, but in this configuration, an external pMOS transistor 412 is required in order to suppress fluctuations in the on -resistance RON.
  • the solid-state image sensor 200 of the second embodiment is different from the first embodiment in that the number of external pMOS transistors 412 is reduced by using the nMOS transistor as an auto-zero transistor.
  • FIG. 8 is a circuit diagram showing a configuration example of the auto-zero potential generation circuit 410 and the comparator 420 according to the second embodiment of the present technology.
  • the comparator 420 of the second embodiment differs from the first embodiment in that it includes an nMOS auto-zero transistor 427 instead of the pMOS auto-zero transistor 426.
  • a control signal ⁇ 1 that becomes a high level within the auto-zero period is input to the auto-zero transistor 427.
  • the auto-zero potential generation circuit 410 of the second embodiment is different from the first embodiment in that the external pMOS transistor 412 is not arranged.
  • Equation 8 can be replaced with the following equation by changing the auto-zero transistor to nMOS.
  • R ON 1 / ⁇ AZ (V ext -V THN_AZ ) ⁇ ... Equation 12
  • VTHN_AZ indicates the threshold voltage of the nMOS transistor.
  • the on-resistance RON also changes according to the fluctuation of the characteristics of the nMOS transistor as well as the operating range. Therefore, unlike the first embodiment, it is not necessary to consider the variation of the pMOS transistor, and the robustness is improved. In particular, it is effective for setting the auto-zero potential Vext to the limit of the lower limit of the operating range when the on-resistance of the pMOS transistor becomes high.
  • the robustness is improved as compared with the first embodiment in which the external pMOS transistor 412 is required. Can be done.
  • the differential transistors 423 and 424 are connected to the current mirror transistors 421 and 422.
  • the input offset voltage of the comparator 420 tends to increase when the auto-zero potential Vext is set to the very limit of the lower limit of the operating range. This is because as the auto-zero potential voltage decreases , the drain-source voltage of the differential transistor 424 on the lamp side decreases, and the difference from the drain-source voltage of the differential transistor 423 on the input side widens. be.
  • the solid-state image sensor 200 of the third embodiment is different from the second embodiment in that the input offset voltage is reduced by inserting a cascode transistor.
  • FIG. 9 is a circuit diagram showing a configuration example of the auto-zero potential generation circuit 410 and the comparator 420 according to the third embodiment of the present technology.
  • the auto-zero potential generation circuit 410 of the third embodiment is different from the second embodiment in that it further includes a control transistor 414 and an external nMOS transistor 415.
  • the comparator 420 of the third embodiment does not include the pMOS transistors 428 and 429, but further includes a pMOS transistor 434, an nMOS transistor 435, 438 and 439, and a cascode transistor 436 and 437. It is different from the embodiment of. Further, a column amplifier 440 is inserted between the comparator 420 and the counter 234 for each column.
  • control transistor 414 the external nMOS transistor 415, and the external nMOS transistor 413 are connected in series between the external current mirror transistor 411 and the reference voltage VSS.
  • a control signal ⁇ 5 from the timing control circuit 212 is input to the gate of the control transistor 414.
  • connection node of the external current mirror transistor 411 and the control transistor 414 and the gate of the external nMOS transistor 415 are connected to the gate of the cascode transistor 436. Let the voltage of this node be Vext2 .
  • the pMOS transistor 431 opens and closes the path between the connection node of the current mirror transistor 421 and the cascode transistor 436 and the gate of the differential transistor 423 according to the control signal x ⁇ 2 from the timing control circuit 212.
  • the pMOS transistor 434 opens and closes the path between the connection node of the current mirror transistor 422 and the cascode transistor 437 and the gate of the differential transistor 424 according to the control signal x ⁇ 3 from the timing control circuit 212.
  • the nMOS transistor 435 is inserted between the connection node of the current mirror transistor 421 and the cascode transistor 436 and the gate of the differential transistor 423.
  • a predetermined low level TIEL is input to the gate of the nMOS transistor 435.
  • a predetermined high level TIEH is input to the gate of the cascode transistor 437.
  • the nMOS transistor 438 opens and closes the path between the gate of the external nMOS transistor 413 and the gate of the differential transistor 423 according to the control signal ⁇ 4 from the timing control circuit 212.
  • the nMOS transistor 439 is inserted between the connection node of the external nMOS transistors 413 and 415 and the gate of the differential transistor 424.
  • a predetermined low level TIEL is input to the gate of the nMOS transistor 439.
  • the column amplifier 440 amplifies the output of the comparator 420 by a predetermined analog gain and supplies it to the counter 234.
  • the third embodiment can be applied to the first embodiment using the pMOS auto-zero transistor 426.
  • an external pMOS transistor may be added to the auto-zero potential generation circuit 410, and the control signal x ⁇ 1 may be input to the auto-zero transistor 426.
  • FIG. 10 is a timing chart showing an example of the operation of the solid-state image sensor 200 according to the third embodiment of the present technology.
  • the control signals x ⁇ 2 and x ⁇ 3 are set to a high level.
  • the timing control circuit 212 sets the control signals ⁇ 5 and x ⁇ 6 to the high level and the control signal x ⁇ 7 to the low level.
  • the timing control circuit 212 sets the control signals ⁇ 1 and ⁇ 4 to a high level.
  • the timing control circuit 212 sets the control signals ⁇ 1 and ⁇ 4 to a low level.
  • the timing control circuit 212 sets the control signals ⁇ 5 and x ⁇ 6 to the low level and the control signal x ⁇ 7 to the high level.
  • FIG. 11 is a diagram for explaining the effect in the third embodiment of the present technique.
  • a in the figure shows the comparator 420 of the second embodiment.
  • the cascode transistor is not inserted between the current mirror circuit (current mirror transistors 421 and 422) and the differential transistors 423 and 424.
  • the drain-source voltage of the differential transistor 424 on the lamp side decreases as the auto-zero potential Vext decreases, and the difference from the drain-source voltage of the differential transistor 423 on the input side increases. It will spread. As a result, the input offset voltage of the comparator 420 may increase.
  • the timing control circuit 212 turns on the control transistor 414 by the control signal ⁇ 5 and inserts the cascode transistors 436 and 437 within the auto-zero period. ing. Then, when the auto zero is completed, the timing control circuit 212 releases the cascode.
  • the drain potentials of the differential transistors 423 and 424 can be made uniform. As a result, it is possible to suppress an increase in the difference between the drain and source voltages of the differential transistors 423 and 424, respectively, and reduce the input offset voltage.
  • the input offset voltage in the comparator 420 can be reduced because the cascode is formed within the auto-zero period.
  • the auto-zero potential generation circuit 410 is arranged for each column, but in this configuration, the circuit scale of the column ADC 230 increases as the number of columns increases.
  • the solid-state image sensor 200 of the fourth embodiment is different from the first embodiment in that the circuit scale is reduced by sharing the auto-zero potential generation circuit 410 in a plurality of rows.
  • FIG. 12 is a block diagram showing a configuration example of the column ADC 230 according to the fourth embodiment of the present technology.
  • one auto-zero potential generation circuit 410 is arranged outside the ADC 231. Then, one auto-zero potential generation circuit 410 is shared by a plurality of columns (for example, all columns).
  • the circuit scale can be reduced as compared with the first embodiment in which the auto-zero potential generation circuit 410 is arranged for each row.
  • the auto-zero potential generation circuit 410 is shared by a plurality of columns, the circuit scale of the column ADC 230 can be reduced.
  • the technique according to the present disclosure can be applied to various products.
  • the technology according to the present disclosure is realized as a device mounted on a moving body of any kind such as an automobile, an electric vehicle, a hybrid electric vehicle, a motorcycle, a bicycle, a personal mobility, an airplane, a drone, a ship, and a robot. You may.
  • FIG. 13 is a block diagram showing a schematic configuration example of a vehicle control system, which is an example of a mobile control system to which the technique according to the present disclosure can be applied.
  • the vehicle control system 12000 includes a plurality of electronic control units connected via the communication network 12001.
  • the vehicle control system 12000 includes a drive system control unit 12010, a body system control unit 12020, an outside information detection unit 12030, an in-vehicle information detection unit 12040, and an integrated control unit 12050.
  • a microcomputer 12051, an audio image output unit 12052, and an in-vehicle network I / F (interface) 12053 are shown as a functional configuration of the integrated control unit 12050.
  • the drive system control unit 12010 controls the operation of the device related to the drive system of the vehicle according to various programs.
  • the drive system control unit 12010 has a driving force generator for generating a driving force of a vehicle such as an internal combustion engine or a driving motor, a driving force transmission mechanism for transmitting the driving force to the wheels, and a steering angle of the vehicle. It functions as a control device such as a steering mechanism for adjusting and a braking device for generating braking force of the vehicle.
  • the body system control unit 12020 controls the operation of various devices mounted on the vehicle body according to various programs.
  • the body system control unit 12020 functions as a keyless entry system, a smart key system, a power window device, or a control device for various lamps such as headlamps, back lamps, brake lamps, turn signals or fog lamps.
  • the body system control unit 12020 may be input with radio waves transmitted from a portable device that substitutes for the key or signals of various switches.
  • the body system control unit 12020 receives inputs of these radio waves or signals and controls a vehicle door lock device, a power window device, a lamp, and the like.
  • the vehicle outside information detection unit 12030 detects information outside the vehicle equipped with the vehicle control system 12000.
  • the image pickup unit 12031 is connected to the vehicle outside information detection unit 12030.
  • the vehicle outside information detection unit 12030 causes the image pickup unit 12031 to capture an image of the outside of the vehicle and receives the captured image.
  • the vehicle outside information detection unit 12030 may perform object detection processing or distance detection processing such as a person, a vehicle, an obstacle, a sign, or a character on the road surface based on the received image.
  • the image pickup unit 12031 is an optical sensor that receives light and outputs an electric signal according to the amount of the light received.
  • the image pickup unit 12031 can output an electric signal as an image or can output it as distance measurement information. Further, the light received by the image pickup unit 12031 may be visible light or invisible light such as infrared light.
  • the in-vehicle information detection unit 12040 detects the in-vehicle information.
  • a driver state detection unit 12041 that detects a driver's state is connected to the vehicle interior information detection unit 12040.
  • the driver state detection unit 12041 includes, for example, a camera that images the driver, and the in-vehicle information detection unit 12040 determines the degree of fatigue or concentration of the driver based on the detection information input from the driver state detection unit 12041. It may be calculated, or it may be determined whether or not the driver has fallen asleep.
  • the microcomputer 12051 calculates the control target value of the driving force generator, the steering mechanism, or the braking device based on the information inside and outside the vehicle acquired by the vehicle exterior information detection unit 12030 or the vehicle interior information detection unit 12040, and the drive system control unit.
  • a control command can be output to 12010.
  • the microcomputer 12051 realizes ADAS (Advanced Driver Assistance System) functions including vehicle collision avoidance or impact mitigation, follow-up driving based on inter-vehicle distance, vehicle speed maintenance driving, vehicle collision warning, vehicle lane deviation warning, and the like. It is possible to perform cooperative control for the purpose of.
  • ADAS Advanced Driver Assistance System
  • the microcomputer 12051 controls the driving force generating device, the steering mechanism, the braking device, and the like based on the information around the vehicle acquired by the vehicle exterior information detection unit 12030 or the vehicle interior information detection unit 12040. It is possible to perform coordinated control for the purpose of automatic driving that runs autonomously without depending on the operation.
  • the microcomputer 12051 can output a control command to the body system control unit 12020 based on the information outside the vehicle acquired by the vehicle outside information detection unit 12030.
  • the microcomputer 12051 controls the headlamps according to the position of the preceding vehicle or the oncoming vehicle detected by the outside information detection unit 12030, and performs cooperative control for the purpose of anti-glare such as switching the high beam to the low beam. It can be carried out.
  • the audio image output unit 12052 transmits an output signal of at least one of audio and an image to an output device capable of visually or audibly notifying information to the passenger or the outside of the vehicle.
  • an audio speaker 12061, a display unit 12062, and an instrument panel 12063 are exemplified as output devices.
  • the display unit 12062 may include, for example, at least one of an onboard display and a head-up display.
  • FIG. 14 is a diagram showing an example of the installation position of the imaging unit 12031.
  • the imaging unit 12031 As the imaging unit 12031, the imaging unit 12101, 12102, 12103, 12104, 12105 is provided.
  • the image pickup units 12101, 12102, 12103, 12104, 12105 are provided, for example, at positions such as the front nose, side mirrors, rear bumpers, back doors, and the upper part of the windshield in the vehicle interior of the vehicle 12100.
  • the image pickup unit 12101 provided on the front nose and the image pickup section 12105 provided on the upper part of the windshield in the vehicle interior mainly acquire an image in front of the vehicle 12100.
  • the image pickup units 12102 and 12103 provided in the side mirror mainly acquire images of the side of the vehicle 12100.
  • the image pickup unit 12104 provided in the rear bumper or the back door mainly acquires an image of the rear of the vehicle 12100.
  • the image pickup unit 12105 provided on the upper part of the front glass in the vehicle interior is mainly used for detecting a preceding vehicle, a pedestrian, an obstacle, a traffic light, a traffic sign, a lane, or the like.
  • FIG. 14 shows an example of the shooting range of the imaging units 12101 to 12104.
  • the imaging range 12111 indicates the imaging range of the imaging unit 12101 provided on the front nose
  • the imaging ranges 12112 and 12113 indicate the imaging range of the imaging units 12102 and 12103 provided on the side mirrors, respectively
  • the imaging range 12114 indicates the imaging range.
  • the imaging range of the imaging unit 12104 provided on the rear bumper or the back door is shown. For example, by superimposing the image data captured by the imaging units 12101 to 12104, a bird's-eye view image of the vehicle 12100 can be obtained.
  • At least one of the image pickup units 12101 to 12104 may have a function of acquiring distance information.
  • at least one of the image pickup units 12101 to 12104 may be a stereo camera including a plurality of image pickup elements, or may be an image pickup element having pixels for phase difference detection.
  • the microcomputer 12051 has a distance to each three-dimensional object in the image pickup range 12111 to 12114 based on the distance information obtained from the image pickup unit 12101 to 12104, and a temporal change of this distance (relative speed with respect to the vehicle 12100). By obtaining can. Further, the microcomputer 12051 can set an inter-vehicle distance to be secured in advance in front of the preceding vehicle, and can perform automatic brake control (including follow-up stop control), automatic acceleration control (including follow-up start control), and the like. In this way, it is possible to perform coordinated control for the purpose of automatic driving or the like that autonomously travels without relying on the driver's operation.
  • automatic brake control including follow-up stop control
  • automatic acceleration control including follow-up start control
  • the microcomputer 12051 converts three-dimensional object data related to a three-dimensional object into two-wheeled vehicles, ordinary vehicles, large vehicles, pedestrians, electric poles, and other three-dimensional objects based on the distance information obtained from the image pickup units 12101 to 12104. It can be classified and extracted and used for automatic avoidance of obstacles. For example, the microcomputer 12051 distinguishes obstacles around the vehicle 12100 into obstacles that are visible to the driver of the vehicle 12100 and obstacles that are difficult to see. Then, the microcomputer 12051 determines the collision risk indicating the risk of collision with each obstacle, and when the collision risk is equal to or higher than the set value and there is a possibility of collision, the microcomputer 12051 via the audio speaker 12061 or the display unit 12062. By outputting an alarm to the driver and performing forced deceleration and avoidance steering via the drive system control unit 12010, driving support for collision avoidance can be provided.
  • At least one of the image pickup units 12101 to 12104 may be an infrared camera that detects infrared rays.
  • the microcomputer 12051 can recognize a pedestrian by determining whether or not a pedestrian is present in the captured image of the imaging unit 12101 to 12104.
  • recognition of a pedestrian is, for example, a procedure for extracting feature points in an image captured by an image pickup unit 12101 to 12104 as an infrared camera, and pattern matching processing is performed on a series of feature points indicating the outline of an object to determine whether or not the pedestrian is a pedestrian. It is done by the procedure to determine.
  • the audio image output unit 12052 determines the square contour line for emphasizing the recognized pedestrian.
  • the display unit 12062 is controlled so as to superimpose and display. Further, the audio image output unit 12052 may control the display unit 12062 so as to display an icon or the like indicating a pedestrian at a desired position.
  • the above is an example of a vehicle control system to which the technique according to the present disclosure can be applied.
  • the technique according to the present disclosure can be applied to, for example, the image pickup unit 12031 among the configurations described above.
  • the image pickup apparatus 100 of FIG. 1 can be applied to the image pickup unit 12031.
  • FIG. 15 is a diagram showing an example of a schematic configuration of an endoscopic surgery system 5000 to which the technique according to the present disclosure can be applied.
  • FIG. 15 illustrates a surgeon (doctor) 5067 performing surgery on patient 5071 on patient bed 5069 using the endoscopic surgery system 5000.
  • the endoscopic surgery system 5000 includes an endoscope 5001, other surgical tools 5017, a support arm device 5027 for supporting the endoscope 5001, and various devices for endoscopic surgery. It is composed of a cart 5037 and a cart 5037.
  • trocca 5025a to 5025d In endoscopic surgery, instead of cutting the abdominal wall to open the abdomen, multiple tubular opening devices called trocca 5025a to 5025d are punctured into the abdominal wall. Then, from the trocca 5025a to 5025d, the lens barrel 5003 of the endoscope 5001 and other surgical tools 5017 are inserted into the body cavity of the patient 5071.
  • other surgical tools 5017 a pneumoperitoneum tube 5019, an energy treatment tool 5021 and forceps 5023 are inserted into the body cavity of patient 5071.
  • the energy treatment tool 5021 is a treatment tool for incising and peeling a tissue, sealing a blood vessel, or the like by using a high frequency current or ultrasonic vibration.
  • the surgical tool 5017 shown is only an example, and as the surgical tool 5017, various surgical tools generally used in endoscopic surgery such as a sword and a retractor may be used.
  • the image of the surgical site in the body cavity of the patient 5071 taken by the endoscope 5001 is displayed on the display device 5041.
  • the surgeon 5067 performs a procedure such as excising the affected area by using the energy treatment tool 5021 or the forceps 5023 while viewing the image of the surgical site displayed on the display device 5041 in real time.
  • the pneumoperitoneum tube 5019, the energy treatment tool 5021, and the forceps 5023 are supported by the operator 5067, an assistant, or the like during the operation.
  • the support arm device 5027 includes an arm portion 5031 extending from the base portion 5029.
  • the arm portion 5031 is composed of joint portions 5033a, 5033b, 5033c, and links 5035a, 5035b, and is driven by control from the arm control device 5045.
  • the endoscope 5001 is supported by the arm portion 5031, and its position and posture are controlled. Thereby, the stable position fixing of the endoscope 5001 can be realized.
  • the endoscope 5001 is composed of a lens barrel 5003 in which a region having a predetermined length from the tip is inserted into the body cavity of the patient 5071, and a camera head 5005 connected to the base end of the lens barrel 5003.
  • the endoscope 5001 configured as a so-called rigid mirror having a rigid barrel 5003 is illustrated, but the endoscope 5001 is configured as a so-called flexible mirror having a flexible barrel 5003. May be good.
  • An opening in which an objective lens is fitted is provided at the tip of the lens barrel 5003.
  • a light source device 5043 is connected to the endoscope 5001, and the light generated by the light source device 5043 is guided to the tip of the lens barrel by a light guide extending inside the lens barrel 5003, and is an objective. It is irradiated toward the observation target in the body cavity of the patient 5071 through the lens.
  • the endoscope 5001 may be a direct endoscope, a perspective mirror, or a side endoscope.
  • An optical system and an image pickup element are provided inside the camera head 5005, and the reflected light (observation light) from the observation target is focused on the image pickup element by the optical system.
  • the observation light is photoelectrically converted by the image pickup device, and an electric signal corresponding to the observation light, that is, an image signal corresponding to the observation image is generated.
  • the image signal is transmitted to the camera control unit (CCU: Camera Control Unit) 5039 as RAW data.
  • the camera head 5005 is equipped with a function of adjusting the magnification and the focal length by appropriately driving the optical system thereof.
  • the camera head 5005 may be provided with a plurality of image pickup elements.
  • a plurality of relay optical systems are provided inside the lens barrel 5003 in order to guide the observation light to each of the plurality of image pickup elements.
  • the CCU 5039 is composed of a CPU (Central Processing Unit), a GPU (Graphics Processing Unit), and the like, and comprehensively controls the operations of the endoscope 5001 and the display device 5041. Specifically, the CCU 5039 performs various image processing for displaying an image based on the image signal, such as a development process (demosaic process), on the image signal received from the camera head 5005. The CCU 5039 provides the image signal subjected to the image processing to the display device 5041. Further, the CCU 5039 transmits a control signal to the camera head 5005 and controls the driving thereof.
  • the control signal may include information about imaging conditions such as magnification and focal length.
  • the display device 5041 displays an image based on the image signal processed by the CCU 5039 under the control of the CCU 5039.
  • the endoscope 5001 is compatible with high-resolution shooting such as 4K (horizontal number of pixels 3840 x vertical pixel number 2160) or 8K (horizontal pixel number 7680 x vertical pixel number 4320), and / or 3D display.
  • a display device capable of displaying a high resolution and / or a device capable of displaying in 3D can be used corresponding to each of the display devices 5041.
  • a display device 5041 having a size of 55 inches or more is used for high-resolution shooting such as 4K or 8K, a further immersive feeling can be obtained.
  • a plurality of display devices 5041 having different resolutions and sizes may be provided depending on the application.
  • the light source device 5043 is composed of, for example, a light source such as an LED (light emission diode), and supplies irradiation light for photographing the surgical site to the endoscope 5001.
  • a light source such as an LED (light emission diode)
  • the arm control device 5045 is configured by a processor such as a CPU, and operates according to a predetermined program to control the drive of the arm portion 5031 of the support arm device 5027 according to a predetermined control method.
  • the input device 5047 is an input interface for the endoscopic surgery system 5000.
  • the user can input various information and input instructions to the endoscopic surgery system 5000 via the input device 5047.
  • the user inputs various information related to the surgery, such as physical information of the patient and information about the surgical procedure, via the input device 5047.
  • the user is instructed to drive the arm portion 5031 via the input device 5047, or is instructed to change the imaging conditions (type of irradiation light, magnification, focal length, etc.) by the endoscope 5001. , Instructions to drive the energy treatment tool 5021, etc. are input.
  • the type of the input device 5047 is not limited, and the input device 5047 may be various known input devices.
  • the input device 5047 for example, a mouse, a keyboard, a touch panel, a switch, a foot switch 5057 and / or a lever and the like can be applied.
  • the touch panel may be provided on the display surface of the display device 5041.
  • the input device 5047 is a device worn by the user, such as a glasses-type wearable device or an HMD (Head Mounted Display), and various inputs are made according to the user's gesture and line of sight detected by these devices. Is done. Further, the input device 5047 includes a camera capable of detecting the movement of the user, and various inputs are performed according to the gesture and the line of sight of the user detected from the image captured by the camera. Further, the input device 5047 includes a microphone capable of picking up the voice of the user, and various inputs are performed by voice via the microphone.
  • a glasses-type wearable device or an HMD Head Mounted Display
  • the input device 5047 is configured to be able to input various information in a non-contact manner, so that a user who belongs to a clean area (for example, an operator 5067) can operate a device belonging to the unclean area in a non-contact manner. Is possible. In addition, the user can operate the device without taking his / her hand off the surgical tool that he / she has, which improves the convenience of the user.
  • a clean area for example, an operator 5067
  • the treatment tool control device 5049 controls the drive of the energy treatment tool 5021 for cauterizing tissue, incising, sealing a blood vessel, or the like.
  • the pneumoperitoneum device 5051 gas in the body cavity of the patient 5071 via the pneumoperitoneum tube 5019 in order to inflate the body cavity of the patient 5071 for the purpose of securing the field of view by the endoscope 5001 and securing the work space of the operator. Is sent.
  • the recorder 5053 is a device capable of recording various information related to surgery.
  • the printer 5055 is a device capable of printing various information related to surgery in various formats such as text, images, and graphs.
  • the support arm device 5027 includes a base portion 5029 as a base and an arm portion 5031 extending from the base portion 5029.
  • the arm portion 5031 is composed of a plurality of joint portions 5033a, 5033b, 5033c and a plurality of links 5035a, 5035b connected by the joint portions 5033b, but in FIG. 15, for the sake of simplicity.
  • the configuration of the arm portion 5031 is simplified and shown. Actually, the shapes, numbers and arrangements of the joint portions 5033a to 5033c and the links 5035a and 5035b, the direction of the rotation axis of the joint portions 5033a to 5033c, and the like are appropriately set so that the arm portion 5031 has a desired degree of freedom. obtain.
  • the arm portion 5031 may be preferably configured to have more than 6 degrees of freedom.
  • the endoscope 5001 can be freely moved within the movable range of the arm portion 5031, so that the lens barrel 5003 of the endoscope 5001 can be inserted into the body cavity of the patient 5071 from a desired direction. It will be possible.
  • An actuator is provided in the joint portions 5033a to 5033c, and the joint portions 5033a to 5033c are configured to be rotatable around a predetermined rotation axis by driving the actuator.
  • the arm control device 5045 By controlling the drive of the actuator by the arm control device 5045, the rotation angles of the joint portions 5033a to 5033c are controlled, and the drive of the arm portion 5031 is controlled. Thereby, control of the position and posture of the endoscope 5001 can be realized.
  • the arm control device 5045 can control the drive of the arm unit 5031 by various known control methods such as force control or position control.
  • the drive of the arm unit 5031 is appropriately controlled by the arm control device 5045 according to the operation input.
  • the position and orientation of the endoscope 5001 may be controlled.
  • the endoscope 5001 at the tip of the arm portion 5031 can be moved from an arbitrary position to an arbitrary position, and then fixedly supported at the moved position.
  • the arm portion 5031 may be operated by a so-called master slave method. In this case, the arm portion 5031 can be remotely controlled by the user via an input device 5047 installed at a location away from the operating room.
  • the arm control device 5045 When force control is applied, the arm control device 5045 receives an external force from the user, and the actuators of the joint portions 5033a to 5033c are arranged so that the arm portion 5031 moves smoothly according to the external force. So-called power assist control for driving may be performed.
  • the arm portion 5031 when the user moves the arm portion 5031 while directly touching the arm portion 5031, the arm portion 5031 can be moved with a relatively light force. Therefore, the endoscope 5001 can be moved more intuitively and with a simpler operation, and the convenience of the user can be improved.
  • the endoscope 5001 was supported by a doctor called a scopist.
  • the support arm device 5027 by using the support arm device 5027, the position of the endoscope 5001 can be more reliably fixed without human intervention, so that an image of the surgical site can be stably obtained. , It becomes possible to perform surgery smoothly.
  • the arm control device 5045 does not necessarily have to be provided on the cart 5037. Further, the arm control device 5045 does not necessarily have to be one device. For example, the arm control device 5045 may be provided at each of the joint portions 5033a to 5033c of the arm portion 5031 of the support arm device 5027, and the plurality of arm control devices 5045 cooperate with each other to drive the arm portion 5031. Control may be realized.
  • the light source device 5043 supplies the endoscope 5001 with irradiation light for photographing the surgical site.
  • the light source device 5043 is composed of, for example, an LED, a laser light source, or a white light source composed of a combination thereof.
  • the white light source is configured by the combination of the RGB laser light sources, the output intensity and the output timing of each color (each wavelength) can be controlled with high accuracy, so that the white balance of the captured image in the light source device 5043 can be controlled. Can be adjusted.
  • the laser light from each of the RGB laser light sources is irradiated to the observation target in a time-division manner, and the drive of the image sensor of the camera head 5005 is controlled in synchronization with the irradiation timing to correspond to each of RGB. It is also possible to capture the image in a time-division manner. According to this method, a color image can be obtained without providing a color filter in the image pickup device.
  • the drive of the light source device 5043 may be controlled so as to change the intensity of the output light at predetermined time intervals.
  • the drive of the image sensor of the camera head 5005 in synchronization with the timing of the change of the light intensity to acquire an image in time division and synthesizing the image, so-called high dynamic without blackout and overexposure. Range images can be generated.
  • the light source device 5043 may be configured to be able to supply light in a predetermined wavelength band corresponding to special light observation.
  • special light observation for example, by utilizing the wavelength dependence of light absorption in body tissue, the surface layer of the mucous membrane is irradiated with light in a narrower band than the irradiation light (that is, white light) during normal observation.
  • narrow band imaging in which a predetermined tissue such as a blood vessel is photographed with high contrast, is performed.
  • fluorescence observation may be performed in which an image is obtained by fluorescence generated by irradiating with excitation light.
  • the body tissue is irradiated with excitation light to observe the fluorescence from the body tissue (autofluorescence observation), or a reagent such as indocyanine green (ICG) is locally injected into the body tissue and the body tissue is injected. It is possible to obtain a fluorescence image by irradiating the excitation light corresponding to the fluorescence wavelength of the reagent.
  • the light source device 5043 may be configured to be capable of supplying narrowband light and / or excitation light corresponding to such special light observation.
  • FIG. 16 is a block diagram showing an example of the functional configuration of the camera head 5005 and CCU5039 shown in FIG.
  • the camera head 5005 has a lens unit 5007, an image pickup unit 5009, a drive unit 5011, a communication unit 5013, and a camera head control unit 5015 as its functions.
  • the CCU 5039 has a communication unit 5059, an image processing unit 5061, and a control unit 5063 as its functions.
  • the camera head 5005 and the CCU 5039 are bidirectionally connected by a transmission cable 5065 so as to be communicable.
  • the lens unit 5007 is an optical system provided at a connection portion with the lens barrel 5003.
  • the observation light taken in from the tip of the lens barrel 5003 is guided to the camera head 5005 and incident on the lens unit 5007.
  • the lens unit 5007 is configured by combining a plurality of lenses including a zoom lens and a focus lens.
  • the optical characteristics of the lens unit 5007 are adjusted so as to collect the observation light on the light receiving surface of the image pickup element of the image pickup unit 5009.
  • the zoom lens and the focus lens are configured so that their positions on the optical axis can be moved in order to adjust the magnification and the focus of the captured image.
  • the image pickup unit 5009 is composed of an image pickup element and is arranged after the lens unit 5007.
  • the observation light that has passed through the lens unit 5007 is focused on the light receiving surface of the image pickup device, and an image signal corresponding to the observation image is generated by photoelectric conversion.
  • the image signal generated by the image pickup unit 5009 is provided to the communication unit 5013.
  • CMOS Complementary Metal Oxide Semiconductor
  • image pickup device for example, an image pickup device capable of capturing a high-resolution image of 4K or higher may be used.
  • the image pickup elements constituting the image pickup unit 5009 are configured to have a pair of image pickup elements for acquiring image signals for the right eye and the left eye corresponding to 3D display, respectively.
  • the 3D display enables the surgeon 5067 to more accurately grasp the depth of the living tissue in the surgical site.
  • the image pickup unit 5009 is composed of a multi-plate type, a plurality of lens units 5007 are also provided corresponding to each image pickup element.
  • the image pickup unit 5009 does not necessarily have to be provided on the camera head 5005.
  • the image pickup unit 5009 may be provided inside the lens barrel 5003 immediately after the objective lens.
  • the drive unit 5011 is composed of an actuator, and the zoom lens and the focus lens of the lens unit 5007 are moved by a predetermined distance along the optical axis under the control of the camera head control unit 5015. As a result, the magnification and focus of the image captured by the image pickup unit 5009 can be adjusted as appropriate.
  • the communication unit 5013 is composed of a communication device for transmitting and receiving various information to and from the CCU 5039.
  • the communication unit 5013 transmits the image signal obtained from the image pickup unit 5009 as RAW data to the CCU 5039 via the transmission cable 5065.
  • the image signal is transmitted by optical communication.
  • the surgeon 5067 performs the surgery while observing the condition of the affected area with the captured image, so for safer and more reliable surgery, the moving image of the surgical site is displayed in real time as much as possible. This is because it is required.
  • the communication unit 5013 is provided with a photoelectric conversion module that converts an electric signal into an optical signal.
  • the image signal is converted into an optical signal by the photoelectric conversion module, and then transmitted to the CCU 5039 via the transmission cable 5065.
  • the communication unit 5013 receives a control signal for controlling the drive of the camera head 5005 from the CCU 5039.
  • the control signal includes, for example, information to specify the frame rate of the captured image, information to specify the exposure value at the time of imaging, and / or information to specify the magnification and focus of the captured image. Contains information about the condition.
  • the communication unit 5013 provides the received control signal to the camera head control unit 5015.
  • the control signal from the CCU 5039 may also be transmitted by optical communication.
  • the communication unit 5013 is provided with a photoelectric conversion module that converts an optical signal into an electric signal, and the control signal is converted into an electric signal by the photoelectric conversion module and then provided to the camera head control unit 5015.
  • the image pickup conditions such as the frame rate, exposure value, magnification, and focus are automatically set by the control unit 5063 of the CCU 5039 based on the acquired image signal. That is, the so-called AE (Auto Exposure) function, AF (Auto Focus) function, and AWB (Auto White Balance) function are mounted on the endoscope 5001.
  • the camera head control unit 5015 controls the drive of the camera head 5005 based on the control signal from the CCU 5039 received via the communication unit 5013. For example, the camera head control unit 5015 controls the drive of the image pickup element of the image pickup unit 5009 based on the information to specify the frame rate of the image pickup image and / or the information to specify the exposure at the time of image pickup. Further, for example, the camera head control unit 5015 appropriately moves the zoom lens and the focus lens of the lens unit 5007 via the drive unit 5011 based on the information that the magnification and the focus of the captured image are specified.
  • the camera head control unit 5015 may further have a function of storing information for identifying the lens barrel 5003 and the camera head 5005.
  • the camera head 5005 can be made resistant to autoclave sterilization.
  • the communication unit 5059 is configured by a communication device for transmitting and receiving various information to and from the camera head 5005.
  • the communication unit 5059 receives an image signal transmitted from the camera head 5005 via the transmission cable 5065.
  • the image signal can be suitably transmitted by optical communication.
  • the communication unit 5059 is provided with a photoelectric conversion module that converts an optical signal into an electric signal.
  • the communication unit 5059 provides the image processing unit 5061 with an image signal converted into an electric signal.
  • the communication unit 5059 transmits a control signal for controlling the drive of the camera head 5005 to the camera head 5005.
  • the control signal may also be transmitted by optical communication.
  • the image processing unit 5061 performs various image processing on the image signal which is the RAW data transmitted from the camera head 5005.
  • the image processing includes, for example, development processing, high image quality processing (band enhancement processing, super-resolution processing, NR (Noise reduction) processing and / or camera shake correction processing, etc.), and / or enlargement processing (electronic zoom processing). Etc., various known signal processing is included.
  • the image processing unit 5061 performs detection processing on the image signal for performing AE, AF, and AWB.
  • the image processing unit 5061 is composed of a processor such as a CPU or GPU, and the processor operates according to a predetermined program, so that the above-mentioned image processing and detection processing can be performed.
  • the image processing unit 5061 is composed of a plurality of GPUs, the image processing unit 5061 appropriately divides the information related to the image signal and performs image processing in parallel by the plurality of GPUs.
  • the control unit 5063 performs various controls regarding the imaging of the surgical site by the endoscope 5001 and the display of the captured image. For example, the control unit 5063 generates a control signal for controlling the drive of the camera head 5005. At this time, when the imaging condition is input by the user, the control unit 5063 generates a control signal based on the input by the user. Alternatively, when the endoscope 5001 is equipped with an AE function, an AF function, and an AWB function, the control unit 5063 has an optimum exposure value, a focal length, and an optimum exposure value according to the result of detection processing by the image processing unit 5061. The white balance is calculated appropriately and a control signal is generated.
  • control unit 5063 causes the display device 5041 to display the image of the surgical unit based on the image signal processed by the image processing unit 5061.
  • the control unit 5063 recognizes various objects in the surgical unit image by using various image recognition techniques.
  • the control unit 5063 detects a surgical tool such as forceps, a specific biological part, bleeding, a mist when using the energy treatment tool 5021, etc. by detecting the shape, color, etc. of the edge of the object included in the surgical site image. Can be recognized.
  • the control unit 5063 uses the recognition result to superimpose and display various surgical support information on the image of the surgical site. By superimposing the surgery support information and presenting it to the surgeon 5067, it becomes possible to proceed with the surgery more safely and surely.
  • the transmission cable 5065 connecting the camera head 5005 and the CCU 5039 is an electric signal cable compatible with electric signal communication, an optical fiber compatible with optical communication, or a composite cable thereof.
  • the communication is performed by wire using the transmission cable 5065, but the communication between the camera head 5005 and the CCU 5039 may be performed wirelessly.
  • the communication between the two is performed wirelessly, it is not necessary to lay the transmission cable 5065 in the operating room, so that the situation where the movement of the medical staff in the operating room is hindered by the transmission cable 5065 can be solved.
  • an endoscopic surgery system 5000 to which the technique according to the present disclosure can be applied.
  • the endoscopic surgery system 5000 has been described here as an example, the system to which the technique according to the present disclosure can be applied is not limited to such an example.
  • the techniques according to the present disclosure may be applied to a flexible endoscopic system for examination or a microsurgery system.
  • the technique according to the present disclosure can be suitably applied to the imaging unit 5009 among the configurations described above.
  • the image pickup apparatus 100 of FIG. 1 can be applied to the image pickup unit 5009.
  • the technique according to the present disclosure to the image pickup unit 5009, the operation of the comparator in the solid-state image pickup device is stabilized, and the reliability of the system is improved.
  • the present technology can have the following configurations.
  • a pair of differential transistors that amplify the difference between the input voltage and a predetermined reference voltage, and An auto-zero transistor that opens and closes the path between one gate and drain of the pair of differential transistors, Equipped with an auto-zero potential generation circuit that generates an auto-zero potential whose fluctuation amount due to process variation is substantially the same as the fluctuation amount of the gate-source voltage of the differential transistor and supplies it to the other gate of the pair of differential transistors.
  • Solid-state imaging device Solid-state imaging device.
  • the auto-zero transistor is a pMOS (p-channel Metal Oxide Semiconductor) transistor.
  • the pair of differential transistors are nMOS (n-channel MOS) transistors.
  • the auto-zero potential generation circuit is With an external pMOS transistor in the ON state, An external nMOS transistor in the ON state and The solid-state image pickup device according to (1) above, which includes the external pMOS transistor and an external current mirror transistor that supplies a current to the external nMOS transistor. (3) The auto-zero transistor and the pair of differential transistors are nMOS transistors.
  • the auto-zero potential generation circuit is An external nMOS transistor in the ON state and The solid-state image pickup device according to (1) above, which includes an external current mirror transistor that supplies a current to the external nMOS transistor. (4) Current mirror circuit and Further, a pair of cascode transistors inserted between the pair of differential transistors and the current mirror circuit is provided.
  • the solid-state image pickup device according to any one of (1) to (3) above, wherein the auto-zero potential generation circuit controls one of the pair of cascode transistors to be turned on within a predetermined auto-zero period.
  • a pixel array unit in which a plurality of pixels are arranged in a two-dimensional lattice is further provided.
  • the solid-state image pickup device according to any one of (1) to (4), wherein the comparator including the pair of differential transistors and the auto-zero transistor is arranged for each row of the pixel array unit.
  • the solid-state image pickup device according to (5) above, wherein the auto-zero potential generation circuit is arranged in each row.
  • Image sensor 110 Optical system 120 Signal processing circuit 130 Memory 140 Monitor 200 Solid-state image sensor 211 Vertical scanning circuit 212 Timing control circuit 213 DAC 214 Pixel array part 215 Horizontal transfer scanning circuit 220 Pixel 221 Photoelectric conversion element 222 Transfer transistor 223 Reset transistor 224 Floating diffusion layer 225 Amplification transistor 226 Selective transistor 230 Column ADC 231 ADC 232, 233 Capacity 234 Counter 235 Latch circuit 410 Auto zero potential generation circuit 411 External current mirror transistor 412 External pMOS transistor 413, 415 External nMOS transistor 414 Control transistor 420 Comparer 421, 422 Current mirror transistor 423, 424 Differential transistor 425 Tail current Source 426, 427 Auto-zero transistor 431 to 434 pMOS transistor 435, 438, 439 nMOS transistor 436, 437 Cascode transistor 440 Column amplifier 5009, 12031 Imaging unit

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Theoretical Computer Science (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Analogue/Digital Conversion (AREA)

Abstract

L'invention concerne un élément d'imagerie à semi-conducteurs dans lequel est disposé un convertisseur analogique-numérique (CAN) comprenant un comparateur, le fonctionnement du comparateur étant stabilisé.　Une paire de transistors différentiels amplifient une différence entre une tension d'entrée et une tension de référence prédéterminée. Un transistor de mise à zéro automatique ouvre et ferme un chemin entre la grille et le drain d'un transistor de la paire de transistors différentiels. Un circuit de génération de potentiel de mise à zéro automatique génère un potentiel de mise à zéro automatique de telle sorte que la quantité de variation due aux variations de traitement soit sensiblement égale à la quantité de variation grille-source des transistors différentiels, et fournit le potentiel à la grille de l'autre transistor de la paire de transistors différentiels.
PCT/JP2021/033244 2020-11-24 2021-09-10 Élément d'imagerie à semi-conducteurs et appareil d'imagerie WO2022113474A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2020194247 2020-11-24
JP2020-194247 2020-11-24

Publications (1)

Publication Number Publication Date
WO2022113474A1 true WO2022113474A1 (fr) 2022-06-02

Family

ID=81755521

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2021/033244 WO2022113474A1 (fr) 2020-11-24 2021-09-10 Élément d'imagerie à semi-conducteurs et appareil d'imagerie

Country Status (1)

Country Link
WO (1) WO2022113474A1 (fr)

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014197773A (ja) * 2013-03-29 2014-10-16 ソニー株式会社 コンパレータ、固体撮像素子、電子機器、および、駆動方法
WO2017061191A1 (fr) * 2015-10-09 2017-04-13 ソニー株式会社 Élément d'imagerie à semi-conducteurs, procédé de pilotage d'un élément d'imagerie à semi-conducteurs et dispositif électronique

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014197773A (ja) * 2013-03-29 2014-10-16 ソニー株式会社 コンパレータ、固体撮像素子、電子機器、および、駆動方法
WO2017061191A1 (fr) * 2015-10-09 2017-04-13 ソニー株式会社 Élément d'imagerie à semi-conducteurs, procédé de pilotage d'un élément d'imagerie à semi-conducteurs et dispositif électronique

Similar Documents

Publication Publication Date Title
US10868056B2 (en) Solid-state imaging element and electronic apparatus
WO2017221715A1 (fr) Élément d'imagerie et dispositif électronique
WO2018198787A1 (fr) Dispositif de capture d'image à semi-conducteurs et appareil électronique
WO2020179696A1 (fr) Dispositif de réception de lumière et dispositif de télémétrie
US11653119B2 (en) Solid-state image sensor and imaging device
US11457169B2 (en) Solid-state imaging element and electronic equipment
WO2021117307A1 (fr) Élément d'imagerie à semi-conducteurs, dispositif d'imagerie et procédé de commande d'élément d'imagerie à semi-conducteurs
WO2020179302A1 (fr) Dispositif d'imagerie
WO2022113474A1 (fr) Élément d'imagerie à semi-conducteurs et appareil d'imagerie
WO2019017217A1 (fr) Dispositif de capture d'image à semi-conducteur, procédé de commande associé, et appareil électronique
TWI837273B (zh) 固態攝像元件及攝像裝置
WO2018051819A1 (fr) Élément d'imagerie, procédé de commande associé et dispositif électronique
WO2017150168A1 (fr) Élément d'imagerie et dispositif électronique
WO2022085476A1 (fr) Dispositif d'imagerie à semi-conducteur et procédé de traitement de signal
WO2023171146A1 (fr) Dispositif de détection de lumière
WO2024062813A1 (fr) Dispositif d'imagerie et équipement électronique
JP2020088729A (ja) 固体撮像装置、固体撮像装置の駆動方法、及び電子機器
JP2019022020A (ja) 固体撮像素子、固体撮像素子の駆動方法および電子機器

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 21897452

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 21897452

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: JP