WO2013125249A1 - 撮像ユニット、撮像装置および制御プログラム - Google Patents

撮像ユニット、撮像装置および制御プログラム Download PDF

Info

Publication number
WO2013125249A1
WO2013125249A1 PCT/JP2013/001055 JP2013001055W WO2013125249A1 WO 2013125249 A1 WO2013125249 A1 WO 2013125249A1 JP 2013001055 W JP2013001055 W JP 2013001055W WO 2013125249 A1 WO2013125249 A1 WO 2013125249A1
Authority
WO
WIPO (PCT)
Prior art keywords
potential
unit
amplification factor
signal
reset
Prior art date
Application number
PCT/JP2013/001055
Other languages
English (en)
French (fr)
Japanese (ja)
Inventor
航 船水
Original Assignee
株式会社ニコン
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 株式会社ニコン filed Critical 株式会社ニコン
Priority to CN201380021039.5A priority Critical patent/CN104247402B/zh
Priority to JP2014500606A priority patent/JP6028791B2/ja
Priority to EP13751745.4A priority patent/EP2819399B1/en
Publication of WO2013125249A1 publication Critical patent/WO2013125249A1/ja
Priority to US14/468,081 priority patent/US10469765B2/en
Priority to IN7739DEN2014 priority patent/IN2014DN07739A/en
Priority to US16/540,496 priority patent/US10708518B2/en

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/70—Circuitry for compensating brightness variation in the scene
    • H04N23/76—Circuitry for compensating brightness variation in the scene by influencing the image signals
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50—Control of the SSIS exposure
    • H04N25/57—Control of the dynamic range
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/616—Noise processing, e.g. detecting, correcting, reducing or removing noise involving a correlated sampling function, e.g. correlated double sampling [CDS] or triple sampling
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
    • H04N25/65—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to reset noise, e.g. KTC noise related to CMOS structures by techniques other than CDS
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/75—Circuitry for providing, modifying or processing image signals from the pixel array
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/78—Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters

Definitions

  • the present invention relates to an imaging unit, an imaging apparatus, and a control program.
  • CMOS type imaging unit that reads out a pixel signal generated by a pixel unit in response to incident light by an amplifier circuit provided for each vertical signal line.
  • Patent Document 1 Japanese Patent Application Laid-Open No. 2004-15701
  • the charge corresponding to the incident light is accumulated in the floating diffusion and then output to the vertical signal line, and the signal amplified by the amplifier circuit is read out. Since the floating diffusion is reset after the charge from the floating diffusion is read out, once the light is incident, the amplification factor of the amplifier circuit is limited to one type. If the amplification factor is lowered in accordance with the case where the incident light is strong and the charge accumulated in the floating diffusion is large, the signal read from the region where the incident light is weak becomes weak. On the contrary, if the amplification factor is increased in accordance with the region where the incident light is weak, the signal read from the region where the incident light is strong is saturated. For this reason, the dynamic range of the imaging unit is limited, and a wider dynamic range has been desired.
  • the pixel portion that outputs a pixel signal corresponding to the reset potential after reset and the signal potential after charge accumulation is different from the first amplification factor or the first amplification factor.
  • An imaging unit is provided that includes a control unit that amplifies a pixel signal at a second amplification factor.
  • the photoelectric conversion unit, the transfer gate for transferring the charge generated in the photoelectric conversion unit to the floating diffusion, the charge accumulated in the floating diffusion is eliminated, and the potential of the floating diffusion is excluded.
  • a control program for an imaging unit comprising: a pixel reset switch that resets the signal potential from the signal potential to the reset potential; and an amplifier unit that amplifies a pixel signal that is output based on the potential of the floating diffusion. Turning the reset switch on to set the floating diffusion potential to the reset potential, and turning off the reset switch and turning on the transfer gate for a certain period of time before turning off the floating diffusion.
  • FIG. 1 is a diagram illustrating the configuration of an imaging apparatus 900 according to an embodiment of the present invention.
  • the imaging apparatus 900 includes an imaging unit 910, an image processing unit 912, a work memory 918, a display unit 920, a camera memory 922, a bus 926, a camera system control unit 924, an AE sensor 916, and a reception unit 914.
  • the imaging unit 910, the image processing unit 912, the display unit 920, the work memory 918, the camera memory 922, and the camera system control unit 924 are connected to the bus 926 and transmit / receive signals to / from each other via the bus 926.
  • the imaging unit 910 includes an image sensor such as a CMOS sensor in which a plurality of photoelectric conversion elements are two-dimensionally arranged.
  • the imaging unit 910 includes a control unit 700.
  • the imaging unit 910 is controlled by the camera system control unit 924 and outputs an amplified signal obtained by amplifying the pixel signal obtained from the subject image.
  • the camera system control unit 924 and the control unit 700 may function together as a control unit of the imaging unit 910.
  • the image processing unit 912 performs various image processing using the work memory 918 as a work space, and generates image data.
  • the generated image data can be converted into a display signal by the image processing unit 912 and displayed on the display unit 920. Further, the image data can be recorded in the camera memory 922.
  • the AE sensor 916 is a photometric sensor in which a plurality of photometric areas are set for the subject space, and detects the brightness of the subject image at each photometric point. A series of shooting sequences is started when the receiving unit 914 receives a user operation and outputs an operation signal to the camera system control unit 924. In addition, the reception unit 914 receives selection of the ISO sensitivity by the user and transmits it to the camera system control unit 924. The camera system control unit 924 transmits an amplification factor corresponding to the ISO sensitivity received by the reception unit 914 to the control unit 700.
  • the camera system control unit 924 analyzes the detection signal of the AE sensor 916 and transmits the amplification factor of the pixel signal corresponding to the optimal ISO sensitivity to the control unit 700.
  • FIG. 2 is a diagram illustrating the configuration of the imaging unit 910 according to the embodiment of the present invention.
  • the imaging unit 910 includes a pixel unit 110, a load current source 201, a column amplification amplifier unit 300, a potential holding unit 400, a readout circuit 500, a vertical scanning unit 600, a control unit 700, an AFE 710, and an ADC 720.
  • the imaging unit 910 includes a plurality of unit pixels 100 in the pixel unit 110.
  • the plurality of unit pixels 100 are arranged in a matrix.
  • Each unit pixel 100 is connected to a vertical signal line 200 and a control line 202.
  • the control line 202 may be composed of a plurality of signal lines to increase signal transmission efficiency.
  • Unit pixels 100 arranged in the same row are connected to a common control line 202.
  • the control line 202 is connected to the vertical scanning unit 600.
  • Unit pixels 100 arranged in the same column are connected to a common vertical signal line 200.
  • the vertical scanning unit 600 controls the reading of the pixel signal from the unit pixel 100 to the vertical signal line 200 via the control line 202.
  • the vertical signal line 200 is connected to the readout circuit 500 via the column amplification amplifier unit 300 and the potential holding unit 400.
  • the load current source 201 supplies current to the vertical signal line 200.
  • the column amplification amplifier unit 300 amplifies the pixel signal read from the unit pixel 100 and sends the amplified signal, which is the amplified pixel signal, to the potential holding unit 400.
  • the potential holding unit 400 holds the amplified signal and sends the amplified signal to the reading circuit 500 at a timing controlled by the control unit 700.
  • the read circuit 500 sends the amplified signal to the AFE 710.
  • the AFE 710 aligns the level of the amplified signal and sends it to the ADC 720.
  • the ADC 720 converts the signal received from the AFE 710 into a digital signal and outputs it.
  • the AFE 710 and the ADC 720 may be provided on the same substrate as other components of the imaging unit 910. However, the present invention is not limited thereto, and the AFE 710 and the ADC 720 are provided on different substrates, and the other of the imaging unit 910 is provided by wiring or bumps. These components may be electrically connected to the substrate.
  • the vertical scanning unit 600, the column amplification amplifier unit 300, the potential holding unit 400, and the readout circuit 500 are electrically connected to the control unit 700 and controlled by the control unit 700.
  • FIG. 3 is a diagram illustrating a part of the configuration of the imaging unit 910 in an enlarged manner.
  • the unit pixel 100 includes a photoelectric conversion unit 101, a transfer gate 102, a floating diffusion 103, a pixel reset switch 104, a pixel amplifier 105, and a selection switch 106.
  • the photoelectric conversion unit 101 converts received light into electric charges and accumulates them.
  • the photoelectric conversion unit 101 is a photodiode as an example.
  • the control unit 700 causes the transfer gate 102 to transfer the charge generated in the photoelectric conversion unit 101 to the floating diffusion 103.
  • the control unit 700 causes the floating diffusion 103 to accumulate the charge transferred via the transfer gate 102.
  • the control unit 700 causes the pixel reset switch 104 connected to the floating diffusion 103 to eliminate the charge accumulated in the floating diffusion 103 and reset the potential of the floating diffusion 103 from the signal potential to the reset potential.
  • the pixel amplifier 105 is connected to the floating diffusion 103 and amplifies and outputs the potential of the floating diffusion 103.
  • the selection switch 106 is connected to the pixel amplifier 105 and the vertical signal line 200.
  • the load current source 201 is connected to the vertical signal line 200.
  • the column amplification amplifier unit 300 includes an input capacitor 301, a column amplification amplifier reset switch 302, a first feedback capacitor selection switch 304, a first feedback capacitor 303, a second feedback capacitor selection switch 306, a second feedback capacitor 305, An amplifier 308 is provided.
  • the input capacitor 301 is connected to the vertical signal line 200.
  • Input capacitor 301 is connected to one of the input terminals of amplifier 308.
  • VREF is connected to the other input terminal of the amplifier 308 to become a reference potential.
  • the feedback loop of the amplifier 308 includes a column amplification amplifier reset switch 302, a first feedback capacitor selection switch 304 and a first feedback capacitor 303, a second feedback capacitor selection switch 306, and a second feedback capacitor 305. Prepare in parallel.
  • the first feedback capacitor selection switch 304 and the first feedback capacitor 303 are connected in series.
  • the second feedback capacitor selection switch 306 and the second feedback capacitor 305 are connected in series.
  • the potential holding unit 400 includes a reset potential input switch 402, a reset potential holding capacitor 404, a signal potential input switch 403, a signal potential holding capacitor 405, a reset potential output switch 406, and a signal potential output switch 407.
  • the reset potential input switch 402 and the signal potential input switch 403 are connected in parallel to the output of the column amplification amplifier unit 300.
  • the reset potential holding capacitor 404 is connected to the reset potential input switch 402.
  • the reset potential output switch 406 is connected to the reset potential holding capacitor 404.
  • the reset potential output switch 406 is connected to the reading circuit 500.
  • the signal potential holding capacitor 405 is connected to the signal potential input switch 403.
  • the signal potential output switch 407 is connected to the signal potential holding capacitor 405.
  • the signal potential output switch 407 is connected to the reading circuit 500.
  • FIG. 4 is a timing chart showing the operation timing of the imaging unit 910 in one horizontal period.
  • the operation of the imaging unit 910 shown in FIG. In the first period (t1), the pixel reset switch 104 and the transfer gate 102 are turned on for a predetermined time. That is, the potentials are turned on at ⁇ 1 and ⁇ 2. As a result, the potentials of the photoelectric conversion unit 101 and the floating diffusion 103 are reset. At this time, the potentials of all the photoelectric conversion units 101 and the floating diffusion 103 of the imaging unit 910 may be simultaneously reset.
  • the photoelectric conversion unit 101 converts received light into electric charges and accumulates them. Charge accumulation in the photoelectric conversion unit 101 is determined by an exposure time set in the imaging unit 910 by the camera system control unit 924.
  • the selection switch 106 is turned on.
  • the pixel reset switch 104 is turned on for a predetermined time. That is, ⁇ 1 is set to the on-state potential, and ⁇ 2 is set to the on-state potential for a predetermined time. Thereby, the floating diffusion 103 becomes a reset potential after reset.
  • the column amplification amplifier reset switch 302 and the second feedback capacitor selection switch 306 are turned on for a predetermined time in the third period (t3). That is, ⁇ 4 and ⁇ 6 are turned on. In addition, ⁇ 5 is set to an on-state potential, and the first feedback capacitor selection switch 304 is turned on. As a result, the input terminal of the amplifier 308 is reset.
  • the column feedback amplifier reset switch 302 and the second feedback capacitor selection switch 306 are turned off.
  • the column feedback amplifier reset switch 302 is turned off after the second feedback capacitor selection switch 306 is turned off.
  • ⁇ 5 remains at the on-state potential, and the first feedback capacitor selection switch 304 remains on.
  • the amplification factor of the column amplification amplifier unit 300 is set to the first amplification factor determined by the ratio of the capacitance of the input capacitor 301 and the capacitance of the first feedback capacitor 303.
  • ⁇ 3 is turned on for a predetermined time, and the transfer gate 102 is turned on for a predetermined time.
  • electrons generated in the photoelectric conversion unit 101 in the second period (t2) are transferred to the floating diffusion 103, and the potential of the floating diffusion 103 changes from the reset potential to the signal potential after charge accumulation.
  • the fluctuation of the potential of the floating diffusion 103 is transmitted to the vertical signal line 200 via the pixel amplifier 105 and the selection switch 106.
  • the pixel signal corresponding to the reset potential and the signal potential is output from the unit pixel 100 to the vertical signal line 200.
  • a pixel signal corresponding to a change from the reset potential to the signal potential is input from the vertical signal line 200 to the column amplification amplifier unit 300.
  • the pixel signal input to the column amplification amplifier unit 300 is amplified with a first amplification factor determined by the ratio of the capacitance of the input capacitor 301 and the capacitance of the first feedback capacitor 303.
  • the first amplified signal amplified at the first amplification factor is output from the column amplification amplifier unit 300 to the potential holding unit 400.
  • the potential of the first amplified signal output from the column amplification amplifier unit 300 is represented by Vout when Vout represented by the following equation is smaller than the power supply voltage of the column amplification amplifier unit 300.
  • Vout is equal to or higher than the power supply voltage of the column amplification amplifier unit 300
  • the potential of the first amplified signal output from the column amplification amplifier unit 300 is equal to the power supply voltage of the column amplification amplifier unit 300.
  • Vout VREF + (reset potential of floating diffusion 103 ⁇ signal potential of floating diffusion 103) ⁇ gain of pixel amplifier 105 ⁇ ( ⁇ capacitance of input capacitor 301 / capacitance of first feedback capacitor 303).
  • the capacitance of the input capacitor 301 is 1 pF
  • the capacitance of the first feedback capacitor 303 is 0.1 pF
  • the reset potential of the floating diffusion 103 is 4 V
  • the gain of the pixel amplifier 105 is 0.8 times
  • VREF is 2.0 V
  • the power supply voltage of the column amplifier section 300 is 5V.
  • the signal potential input switch 403 is turned on for a predetermined time.
  • the signal potential holding capacitor 405 holds the first amplified signal output from the column amplification amplifier unit 300 according to the incident light.
  • ⁇ 9 is set to the on-state potential, and the reset potential output switch 406 and the signal potential output switch 407 are turned on for a predetermined time. Accordingly, the signal corresponding to the reset potential held in the reset potential holding capacitor 404 in the fourth period (t4) and the signal potential held in the signal potential holding capacitor 405 in the fifth period (t5).
  • the first amplified signal is sent to the readout circuit 500.
  • the seventh period (t7) ⁇ 4, ⁇ 5, and ⁇ 6 are turned on, and the column amplification amplifier reset switch 302, the first feedback capacitor selection switch 304, and the second feedback capacitor selection switch 306 are Turned on.
  • the input terminal of the amplifier 308 is reset.
  • the column diffusion amplifier unit 300 is reset with the floating diffusion 103 based on the state of the signal potential.
  • the first feedback capacitor selection switch 304 remains on from the third period (t3).
  • the column amplification amplifier reset switch 302 is turned off. That is, ⁇ 5 is set to the off-state potential, and then ⁇ 4 is set to the off-state potential. ⁇ 6 remains at the on-state potential, and the second feedback capacitor selection switch 306 remains on. Accordingly, the amplification factor of the column amplification amplifier unit 300 is set to the second amplification factor determined by the ratio of the capacitance of the input capacitor 301 and the capacitance of the second feedback capacitor 305.
  • the second amplification factor of the column amplification amplifier unit 300 set in the seventh period (t7) is , Different from the first amplification factor of the column amplification amplifier section 300 set in the fifth period (t5).
  • ⁇ 7 is turned on for a predetermined time, and the reset potential input switch 402 is turned on for a predetermined time. As a result, a signal corresponding to the signal potential is held in the reset potential holding capacitor 404.
  • ⁇ 2 is set to an on-state potential for a predetermined time, and the pixel reset switch 104 is turned on for a predetermined period.
  • the potential of the floating diffusion 103 is reset.
  • the potential of the floating diffusion 103 changes from the signal potential to the reset potential.
  • the fluctuation of the potential of the floating diffusion 103 is transmitted to the vertical signal line 200 via the pixel amplifier 105 and the selection switch 106.
  • a pixel signal corresponding to a change from the signal potential of the floating diffusion 103 to the reset potential is input to the column amplification amplifier unit 300.
  • the pixel signal input to the column amplification amplifier unit 300 is amplified with a second amplification factor determined by the ratio between the capacitance of the input capacitor 301 and the capacitance of the second feedback capacitor 305, and the second amplification signal is output from the column amplification amplifier unit 300. Is output.
  • the potential of the second amplified signal output from the column amplification amplifier unit 300 is represented by Vout when Vout represented by the following equation is smaller than the power supply voltage of the column amplification amplifier unit 300.
  • Vout is equal to or higher than the power supply voltage of the column amplification amplifier unit 300
  • the potential of the second amplified signal output from the column amplification amplifier unit 300 is equal to the power supply voltage of the column amplification amplifier unit 300.
  • Vout VREF + (potential of floating diffusion 103 after transfer gate 102 is turned on for a predetermined time ⁇ reset potential of floating diffusion 103) ⁇ 0.8 ⁇ ( ⁇ capacitance of input capacitor 301 / capacitance of second feedback capacitor 305) .
  • the capacitance of the input capacitor 301 is 1 pF
  • the capacitance of the second feedback capacitor 305 is 1 pF
  • the reset potential of the floating diffusion 103 is 4 V
  • the gain of the pixel amplifier 105 is 0.8 times
  • VREF is 2.0 V
  • column amplification The power supply voltage of the amplifier unit 300 is set to 5V.
  • ⁇ 8 is turned on for a predetermined time, and the signal potential input switch 403 is turned on for a predetermined time.
  • the second amplified signal corresponding to the reset potential is held in the signal potential holding capacitor 405.
  • ⁇ 9 is set to the ON state potential, and the reset potential output switch 406 and the signal potential output switch 407 are turned ON for a predetermined time. Accordingly, the signal corresponding to the signal potential held in the reset potential holding capacitor 404 in the seventh period (t7) and the reset potential held in the signal potential holding capacitor 405 in the eighth period (t8).
  • the second amplified signal is sent to the readout circuit 500.
  • the control unit 700 reads the pixel signal from the pixel unit 110 by repeating the third period (t3) to the ninth period (t9).
  • the first amplification signal and the second amplification signal are read out to the reading circuit 500 by the charge generated by the light incident on the photoelectric conversion unit 101 in the second period (t2). That is, the first amplified signal is read out to the reading circuit 500 from the third period (t3) to the sixth period (t6). Then, the second amplified signal is read out to the readout circuit 500 from the seventh period (t7) to the ninth period (t9).
  • the first amplified signal and the second amplified signal are read together with signals corresponding to the reset potential and the signal potential, respectively. Therefore, variations in the column amplification amplifier unit 300 can be canceled. For example, the difference between the first amplified signal and the second amplified signal, the reset potential, and the signal potential is used.
  • the first amplification factor and the second amplification factor are different. That is, the imaging unit 910 is exposed once, so that a signal corresponding to the first amplified signal and a signal corresponding to the second amplified signal are sent from the imaging unit 910 to the image processing unit 912.
  • the image processing unit 912 combines the signal corresponding to the first amplified signal and the signal corresponding to the second amplified signal, which have different amplification factors, and generates an image with an expanded dynamic range.
  • the first amplification factor is larger than the second amplification factor.
  • the second amplified signal is not saturated because the amplification factor is smaller than that of the first amplified signal.
  • the influence of noise can be reduced. That is, noise can be generated by injecting carriers from a transistor when resetting the potential.
  • the reset operation in the seventh period (t7) can prevent the low-intensity signal from being affected by noise.
  • FIG. 5 is a diagram for explaining image processing of the imaging apparatus 900.
  • the image 982 obtained from the first amplified signal that is amplified by the first amplification factor that is higher than the second amplification factor when the imaging unit 910 is exposed overexposure occurs in a bright portion of the subject.
  • the image 980 obtained from the second amplified signal amplified with the second amplification factor smaller than the first amplification factor the dark part of the subject is underexposed.
  • the person portion of the image 980 is underexposed and part of the person portion is blacked out.
  • the image processing unit 912 can synthesize an optimal portion from the image 982 and the image 980 to obtain an image 984 that is free from overexposure and blackout and has no underexposed portion.
  • the image processing unit 912 may generate an image using only the first amplified signal when the first amplified signal is not saturated.
  • the image processing unit 912 may not use the second amplified signal, or the control unit 700 generates the second amplified signal in the column amplification amplifier unit 300. You don't have to.
  • the image 984 may be synthesized by using the second amplified signal. Further, the first amplified signal may be used in a region where the intensity of the second amplified signal is weaker than a predetermined level. Thereby, an image with an expanded dynamic range is obtained.
  • the image processing unit 912 includes a signal corresponding to the first amplified signal amplified by the first amplification factor and a signal corresponding to the second amplified signal amplified by the second amplification factor.
  • One image at a time may be generated. That is, the image processing unit 912 may generate image data corresponding to the two images 982 and 980 and store the image data in the camera memory 922. Thereby, two images with different amplification factors can be obtained by one exposure.
  • FIG. 6 is a diagram illustrating another example of the configuration of the imaging unit 910.
  • the imaging unit 910 illustrated in FIG. 6 is different from the imaging unit 910 illustrated in FIG.
  • the imaging unit 910 includes a pixel unit 110, a load current source 201, a column amplification amplifier unit 300, a determination unit 220, a potential holding unit 400, a readout circuit 500, a vertical scanning unit 600, a control unit 700, an AFE 710, and an ADC 720.
  • the determination unit 220 is controlled by the control unit 700 to compare the amplified signal output from the column amplification amplifier unit 300 with a signal of a predetermined level.
  • the determination unit 220 includes a comparator, for example.
  • the determination unit 220 associates the comparison result with the amplified signal output from the column amplification amplifier unit 300.
  • the determination unit 220 determines whether the amplified signal output by the column amplification amplifier unit 300 is in a saturated state. For example, when the first amplification factor is greater than the second amplification factor, the determination unit 220 determines whether the first amplification signal amplified by the first amplification factor is in a saturated state, and determines the determination result as the first amplification factor. It is associated with at least one of the first amplified signal and the second amplified signal. As an example, the first amplified signal and the second amplified signal are in a saturated state in addition to the address of the unit pixel 100 corresponding to each amplified signal and the signal corresponding to the intensity of incident light. It has a status flag indicating whether or not there is. The status flag indicating whether or not the first amplified signal is saturated is, for example, a 1-bit signal.
  • the control unit 700 may not read out the second amplified signal when the state flag indicates that the first amplified signal amplified by the first amplification factor larger than the second amplification factor is not saturated. This speeds up reading.
  • FIG. 7 is a flowchart for explaining image processing by the imaging apparatus 900.
  • the flowchart of FIG. 7 is an example of a flow corresponding to the imaging unit 910 illustrated in FIG.
  • the flow starts from a stage where the imaging unit 910 is reset prior to exposure.
  • the control unit 700 turns off the transfer gate 102 and turns on the pixel reset switch 104.
  • the potential of the floating diffusion 103 is reset to a reset potential.
  • the imaging unit 910 is exposed to generate electric charges according to the light incident on the photoelectric conversion unit 101.
  • step S952 the control unit 700 turns off the pixel reset switch 104 and turns on the transfer gate 102. As a result, the potential of the floating diffusion 103 is set to the signal potential after charge accumulation. Then, the control unit 700 causes the vertical signal line 200 to output a first pixel signal that is a pixel signal corresponding to a change from the reset potential to the signal potential.
  • step S954 the control unit 700 causes the column amplification amplifier unit 300 to amplify the first pixel signal with a first amplification factor determined by the ratio of the capacitance of the input capacitor 301 and the first feedback capacitor 303. Then, the control unit 700 causes the column amplification amplifier unit 300 to output a first amplification signal that is a first pixel signal amplified by the first amplification factor.
  • step S956 the control unit 700 causes the determination unit 220 to determine whether the first amplified signal is in a saturated state. If the state flag indicates that the first amplified signal is saturated, the determination unit 220 proceeds to step S956. If the state flag indicates that the first amplified signal is not saturated, the determination unit 220 proceeds to step S962. As described above, the determination unit 220 may associate the determination result with at least one of the first amplified signal and the second amplified signal.
  • step S958 the control unit 700 turns off the transfer gate 102 and turns on the pixel reset switch 104 again. Thereby, the control unit 700 sets the potential of the floating diffusion 103 to the reset potential, and outputs a second pixel signal that is a pixel signal corresponding to the change from the signal potential to the reset potential.
  • step S960 the control unit 700 causes the column amplification amplifier unit 300 to amplify the second pixel signal with the second amplification factor determined by the ratio of the capacitances of the input capacitor 301 and the second feedback capacitor 305.
  • the control unit 700 causes the column amplification amplifier unit 300 to output the second amplified signal.
  • the second amplified signal is output from the imaging unit 910, replacing the first amplified signal output in step S954.
  • the image processing unit 912 generates an image from one or both of the first amplified signal and the second amplified signal output from the imaging unit 910 via the bus 926.
  • the image processing unit 912 uses only the first image signal for generating the image data corresponding to the region where the first amplified signal that is not saturated is output.
  • the image processing unit 912 uses only the second amplified signal, for example, for generating image data of an area corresponding to the unit pixel 100 to which the second amplified signal is output.
  • the boundary between the two regions is different due to the difference in amplification factor.
  • the image processing unit 912 may process the image data in the vicinity of the boundary so that an unnatural image is not generated in the vicinity region. For example, the image processing unit 912 brightly corrects image data in a region using the second amplified signal within a predetermined range from the boundary. The image processing unit 912 may use the determination result associated with the above processing by the determination unit 220.
  • the camera system control unit 924 and the control unit 700 end a series of processes.
  • the series of processes described above can cause the camera system control unit 924 and the control unit 700 to execute a program stored in the camera memory 922.
  • both the first amplified signal output in step S ⁇ b> 960 and the second amplified signal output in step S ⁇ b> 960 may be output from the imaging unit 910. In that case, the image processing unit 912 may generate one image using both the first amplified signal and the second amplified signal.
  • one photoelectric conversion unit 101 has been described as having a structure (referred to as a 4Tr pixel) having one floating diffusion 103, one pixel reset switch 104, one pixel amplifier 105, and one selection switch 106.
  • the imaging unit 910 having a structure in which the floating diffusion 103, the pixel reset switch 104, the pixel amplifier 105, and the selection switch 106 are shared by the plurality of photoelectric conversion units 101 can be operated in the same manner as described above.
  • the potential holding unit 400 may include another set of potential holding units. As a result, the time required to read out the signal can be shortened.
  • the present invention is not limited to this example, and the same applies to, for example, the imaging unit 910 including the ADC 720 in the subsequent stage of the column amplification amplifier unit 300.
  • the ADC 720 connected to the column amplification amplifier unit 300 converts the signal received from the column amplification amplifier unit 300 into a digital signal and outputs the digital signal to the potential holding unit 400.
  • the potential holding unit 400 sends a digital signal to the reading circuit 500 at a timing controlled by the control unit 700.
  • the imaging unit 910 includes a DFE (digital front end), and the readout circuit 500 sends a signal to the DFE.
  • the DFE aligns the level of the received signal and outputs it to the bus 926.
  • the present invention is not limited to this, and the first amplification factor and the second amplification factor can be set to a plurality of amplification factors. You may select and set from the rate. For example, the gain determined by the ratio of the input capacitor 301 and the first feedback capacitor 303, the gain determined by the ratio of the input capacitor 301 and the second feedback capacitor 305, and the input capacitor 301 are connected in parallel. The first gain and the second gain may be selected based on the gain determined by the ratio between the first feedback capacitor 303 and the second feedback capacitor 305.
  • three or more sets of feedback capacitor selection switches and feedback capacitors may be provided in parallel in the feedback loop of the column amplification amplifier unit 300.
  • Three or more sets of feedback capacitor selection switches and feedback capacitors may be used alone or in combination, and each may correspond to a different amplification factor.
  • the different amplification factors may correspond to different ISO sensitivities.
  • the control unit 700 may set the amplification factor corresponding to the user-specified ISO sensitivity received by the reception unit 914 as one of the first amplification factor and the second amplification factor. Further, the control unit 700 may set the other one of the first amplification factor and the second amplification factor as an amplification factor corresponding to the ISO sensitivity calculated by the camera system control unit 924 from the detection result of the AE sensor 916. Good. At this time, the gain corresponding to the ISO sensitivity may be calculated by the camera system control unit 924 and transmitted to the control unit 700.
  • the control unit 700 selects one or a plurality of feedback capacitors included in the column amplification amplifier unit 300 corresponding to the amplification factor sent from the camera system control unit 924, and selects the first amplification factor or A second amplification factor may be set.
  • the receiving unit 914 may receive two ISO sensitivity selections by the user, and transmit the amplification factors corresponding to the two ISO sensitivities received by the receiving unit 914 to the control unit 700, respectively. Also in this case, the control unit 700 may set the first gain and the second gain.
  • the imaging apparatus 900 may be used as a detection unit that detects the brightness by feeding back the output of the imaging unit 910.
  • the image processing by the imaging unit imaging apparatus 900 is not limited to the example of FIG. 7, and the imaging unit 910 shown in FIG. 2 or 6 outputs signals based on both the first amplified signal and the second amplified signal,
  • the image processing unit 912 may generate one or two images.
  • the image processing unit 912 determines that the determination unit includes at least the first amplified signal and the second amplified signal.
  • One image may be generated using the determination result associated with one of the images.
  • the imaging unit 910 includes a CMOS sensor
  • the present invention is not limited to this, and the present invention can also be applied to an imaging unit 910 including a CCD sensor.
  • the imaging unit 910 including a CCD sensor for example, a configuration in which signal charges transferred by a CCD shift register are converted into a voltage using a floating diffusion amplifier can be used.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Solid State Image Pick-Up Elements (AREA)
PCT/JP2013/001055 2012-02-24 2013-02-25 撮像ユニット、撮像装置および制御プログラム WO2013125249A1 (ja)

Priority Applications (6)

Application Number Priority Date Filing Date Title
CN201380021039.5A CN104247402B (zh) 2012-02-24 2013-02-25 摄像单元、摄像装置以及控制程序
JP2014500606A JP6028791B2 (ja) 2012-02-24 2013-02-25 撮像ユニット、撮像装置および制御プログラム
EP13751745.4A EP2819399B1 (en) 2012-02-24 2013-02-25 Imaging unit, imaging device, and control program
US14/468,081 US10469765B2 (en) 2012-02-24 2014-08-25 Imaging unit, imaging apparatus and computer-readable medium having stored thereon a control program for selectively using first and second amplified signals
IN7739DEN2014 IN2014DN07739A (zh) 2012-02-24 2014-09-16
US16/540,496 US10708518B2 (en) 2012-02-24 2019-08-14 Imaging unit, imaging apparatus, and computer-readable medium having stored thereon a control program for selectively using first and second amplified signals

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2012038756 2012-02-24
JP2012-038756 2012-02-24

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/468,081 Continuation US10469765B2 (en) 2012-02-24 2014-08-25 Imaging unit, imaging apparatus and computer-readable medium having stored thereon a control program for selectively using first and second amplified signals

Publications (1)

Publication Number Publication Date
WO2013125249A1 true WO2013125249A1 (ja) 2013-08-29

Family

ID=49005443

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2013/001055 WO2013125249A1 (ja) 2012-02-24 2013-02-25 撮像ユニット、撮像装置および制御プログラム

Country Status (6)

Country Link
US (2) US10469765B2 (zh)
EP (1) EP2819399B1 (zh)
JP (1) JP6028791B2 (zh)
CN (2) CN104247402B (zh)
IN (1) IN2014DN07739A (zh)
WO (1) WO2013125249A1 (zh)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP2819399B1 (en) * 2012-02-24 2020-09-02 Nikon Corporation Imaging unit, imaging device, and control program
JP6613554B2 (ja) * 2014-09-30 2019-12-04 株式会社ニコン 画像処理装置およびプログラム
JP6520035B2 (ja) * 2014-09-30 2019-05-29 株式会社ニコン 電子機器

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000165754A (ja) * 1998-11-27 2000-06-16 Canon Inc 固体撮像装置および固体撮像装置の信号読出し方法
JP2007189537A (ja) * 2006-01-13 2007-07-26 Canon Inc 撮像素子及び撮像装置
JP2008263546A (ja) * 2007-04-13 2008-10-30 Konica Minolta Holdings Inc 固体撮像装置、固体撮像装置の駆動方法、及びこれを用いた撮像システム
JP2009044231A (ja) * 2007-08-06 2009-02-26 Canon Inc 撮像装置、およびその制御方法
JP2011120094A (ja) * 2009-12-04 2011-06-16 Canon Inc 撮像装置及びその駆動方法

Family Cites Families (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP4022862B2 (ja) * 2002-06-11 2007-12-19 ソニー株式会社 固体撮像装置及びその制御方法
JP2005192139A (ja) * 2003-12-26 2005-07-14 Konica Minolta Photo Imaging Inc 撮像装置及び撮影システム
US7321111B2 (en) * 2004-04-12 2008-01-22 Canesta, Inc. Method and system to enhance differential dynamic range and signal/noise in CMOS range finding systems using differential sensors
JP4873385B2 (ja) * 2006-07-19 2012-02-08 オリンパス株式会社 固体撮像装置
JP5130675B2 (ja) * 2006-08-11 2013-01-30 株式会社ニコン デジタルカメラ、および画像処理プログラム
JP4775230B2 (ja) * 2006-11-06 2011-09-21 株式会社ニコン 画像処理装置、撮像装置、及び画像処理プログラム
US8115841B2 (en) * 2007-03-13 2012-02-14 Micron Technology, Inc. Method, apparatus and system providing an image sensor having pixels with multiple exposures, diodes and gain readouts
JP5187550B2 (ja) 2007-08-21 2013-04-24 ソニー株式会社 撮像装置
JP2010002876A (ja) 2008-05-19 2010-01-07 Sony Ericsson Mobilecommunications Japan Inc 表示装置、表示制御方法および表示制御プログラム
JP5129035B2 (ja) * 2008-06-17 2013-01-23 オリンパス株式会社 固体撮像装置
CN101521755A (zh) * 2008-12-15 2009-09-02 昆山锐芯微电子有限公司 Cmos图像传感器读出电路及读出方法
US8717474B2 (en) * 2009-12-04 2014-05-06 Canon Kabushiki Kaisha Imaging apparatus and method for driving the same
JP5422362B2 (ja) * 2009-12-15 2014-02-19 株式会社東芝 固体撮像装置
US20110186714A1 (en) * 2010-01-29 2011-08-04 Chip Goal Electronics Corporation, R.O.C. Adaptive De-Flicker Device and Method For Adaptive De-Flicker
JP5552858B2 (ja) * 2010-03-26 2014-07-16 ソニー株式会社 固体撮像装置、固体撮像装置の駆動方法、及び、電子機器
JP2011259305A (ja) * 2010-06-10 2011-12-22 Toshiba Corp 固体撮像装置
EP2819399B1 (en) * 2012-02-24 2020-09-02 Nikon Corporation Imaging unit, imaging device, and control program
JP6463002B2 (ja) * 2014-05-08 2019-01-30 キヤノン株式会社 撮像装置の駆動方法、撮像システムの駆動方法

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2000165754A (ja) * 1998-11-27 2000-06-16 Canon Inc 固体撮像装置および固体撮像装置の信号読出し方法
JP2007189537A (ja) * 2006-01-13 2007-07-26 Canon Inc 撮像素子及び撮像装置
JP2008263546A (ja) * 2007-04-13 2008-10-30 Konica Minolta Holdings Inc 固体撮像装置、固体撮像装置の駆動方法、及びこれを用いた撮像システム
JP2009044231A (ja) * 2007-08-06 2009-02-26 Canon Inc 撮像装置、およびその制御方法
JP2011120094A (ja) * 2009-12-04 2011-06-16 Canon Inc 撮像装置及びその駆動方法

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP2819399A4 *

Also Published As

Publication number Publication date
EP2819399B1 (en) 2020-09-02
JPWO2013125249A1 (ja) 2015-07-30
CN104247402B (zh) 2018-09-07
CN108833811A (zh) 2018-11-16
CN104247402A (zh) 2014-12-24
IN2014DN07739A (zh) 2015-05-15
US20190373181A1 (en) 2019-12-05
EP2819399A1 (en) 2014-12-31
US10708518B2 (en) 2020-07-07
CN108833811B (zh) 2020-12-01
JP6028791B2 (ja) 2016-11-16
US10469765B2 (en) 2019-11-05
EP2819399A4 (en) 2015-11-04
US20150049228A1 (en) 2015-02-19

Similar Documents

Publication Publication Date Title
US10771718B2 (en) Imaging device and imaging system
US10070103B2 (en) Solid-state imaging device, driving method, and electronic device
US9357137B2 (en) Imaging apparatus, signal processing method, and program
JP4609428B2 (ja) 固体撮像装置、固体撮像装置の駆動方法および撮像装置
JP5074297B2 (ja) 固体撮像装置およびその駆動方法、並びに電子情報機器
WO2009096168A1 (ja) 固体撮像装置およびその駆動方法
US8792033B2 (en) Image pickup apparatus capable of changing operation condition of image sensing device and control method therefor
EP2360912B1 (en) Solid-state image pickup apparatus and driving method therefor
US11336844B2 (en) Imaging device, imaging system, and movable object
JP5867537B2 (ja) 撮像素子および撮像装置
US8294798B2 (en) Solid-state imaging apparatus
US20110292264A1 (en) Solid-state imaging device and imaging apparatus including the same
JP2008124527A (ja) 固体撮像装置及び撮像装置
CN110249623B (zh) 摄像元件及电子相机
US8149308B2 (en) Solid-state image pickup device
WO2017141847A1 (ja) 固体撮像装置および撮像装置
US10708518B2 (en) Imaging unit, imaging apparatus, and computer-readable medium having stored thereon a control program for selectively using first and second amplified signals
CN114600447A (zh) 摄像元件、光检测元件和电子设备
CN110235435B (zh) 摄像元件及摄像装置
US20070097226A1 (en) Image data processing semiconductor integrated circuit
JP2006074436A (ja) 読出アドレス制御方法、物理情報取得装置、および半導体装置
JP2022184314A (ja) 撮像素子、及び、撮像装置
JP4386296B2 (ja) 半導体固体撮像装置

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13751745

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 2014500606

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

WWE Wipo information: entry into national phase

Ref document number: 2013751745

Country of ref document: EP