US20020024605A1 - Method for capturing a dark frame - Google Patents
Method for capturing a dark frame Download PDFInfo
- Publication number
- US20020024605A1 US20020024605A1 US09/872,064 US87206401A US2002024605A1 US 20020024605 A1 US20020024605 A1 US 20020024605A1 US 87206401 A US87206401 A US 87206401A US 2002024605 A1 US2002024605 A1 US 2002024605A1
- Authority
- US
- United States
- Prior art keywords
- charge
- pixel
- overflow
- time period
- reset
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/53—Control of the integration time
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/587—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/59—Control of the dynamic range by controlling the amount of charge storable in the pixel, e.g. modification of the charge conversion ratio of the floating node capacitance
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/62—Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels
- H04N25/621—Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels for the control of blooming
- H04N25/623—Detection or reduction of noise due to excess charges produced by the exposure, e.g. smear, blooming, ghost image, crosstalk or leakage between pixels for the control of blooming by evacuation via the output or reset lines
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/60—Noise processing, e.g. detecting, correcting, reducing or removing noise
- H04N25/63—Noise processing, e.g. detecting, correcting, reducing or removing noise applied to dark current
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/70—SSIS architectures; Circuits associated therewith
- H04N25/76—Addressed sensors, e.g. MOS or CMOS sensors
- H04N25/77—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
- H04N25/771—Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising storage means other than floating diffusion
Definitions
- the present invention relates to electronic cameras employing solid state pixel sensor arrays. More particularly, the present invention relates to circuits and techniques for exposure control of such cameras and to exposure control of such cameras by means of overflow detection in arrays of active pixels.
- Prior art exposure control techniques known to the inventors that use the actual image sensors during the actual exposure interval are of two types. Some prior art techniques integrate the total photocurrent by a common back-side electrode (anode) of a group of photodiodes—i.e., they integrate the substrate current to get an average light reading on the whole array. Other prior art techniques use nondestructive readout to sample selected pixels during the exposure interval, looking for an indication that some pixels are reaching a full-scale exposure.
- the first technique is tricky and difficult to implement, since the photocurrents are small and the substrate is large and noisy. In addition, it responds strictly to the average light level across the image plane rather than to those pixels that are reaching a full-scale charge accumulation.
- the second technique requires a sequential polling, so is limited to either a very slow operation or to sensing only a very small subset of the pixels. The second technique is therefore not good for detecting the exact time when a small percentage of pixels are reaching a full-scale exposure.
- One such prior art technique uses an imager first to estimate a light level and thereby to calculate an optimum exposure duration for a second cycle of the imager. This technique is obviously not as fast, and particularly is unsuited to controlling the exposure time rapidly during a dynamic lighting event, provided for example from a strobe flash.
- Another such prior art technique employs a separate overall light sensor to measure an average light level and to react to a sufficient quantity of light by closing a shutter or quenching a strobe flash.
- Mechanical shutters and non-frame-storage electronic sensors cannot be shuttered rapidly enough to use this technique during a flash, which is why the detector is sometimes used to turn off the light source instead of closing a shutter.
- These techniques require an awkward coordination between the camera, the light sensor, and the light source, and do not necessarily track automatically the sensitivity (or film speed) and lens aperture of the camera.
- Another type of prior art technique relates to use of an adjustable overflow drain for dynamic range enhancement. These techniques have not been integrated with the use of the overflow current for terminating the exposure time. Variations on this technique employ either a moving overflow barrier or a dual exposure interval to increase dynamic range.
- Yet another object of the present invention is to provide an exposure control technique for an electronic still camera employing a solid state imaging array which may be employed in conjunction with dark-frame-subtraction noise reduction techniques.
- Yet another object of the present invention is to provide an exposure control technique for an electronic still camera employing a solid state imaging array which provides enhanced dynamic range through overflow detection in the active pixels.
- a method according to the present invention for controlling the exposure of an active pixel array for applications such as an electronic still camera includes the steps of: integrating photocurrent in each pixel during an integration time period; collecting overflow charge from all pixels in the array during the integration time period; developing an overflow signal as a function of the overflow charge; and terminating the integration time period when the overflow charge exceeds a threshold level selected to represent a desired reference exposure level.
- the step of collecting overflow charge from all pixels in the array comprises setting a charge potential barrier at the cathode of a photodiode in each pixel, the potential barrier being lower than the potential at which charge would overflow into the substrate, and the step of developing an overflow signal comprises generating a signal from charge overflowing the potential barrier.
- Apparatus according to the present invention for controlling the exposure of an active pixel array includes means for integrating photocurrent in each pixel during a integration time period; means for collecting overflow charge from all pixels in the array during the integration time period; means for developing an overflow signal as a function of the overflow charge; and means for terminating the integration time period when the overflow signal exceeds a preset threshold level.
- the means for collecting overflow charge from all pixels in the array comprises means for setting a charge potential barrier at the cathode of a photodiode in each pixel, the potential barrier being lower than the potential at which charge would overflow into the substrate, and for collecting charge overflowing the potential barrier.
- this function is performed by using the reset transistor in each pixel as a settable charge overflow barrier which is set to a level below (more positive than) the potential at the substrate.
- the means for developing an overflow signal comprises means for developing a voltage proportional to the excess charge accumulation at the cathode of the photodiode in all pixels. As presently preferred, this function is performed by developing a voltage proportional to the total charge allowed to flow into the Vref supply from all pixels in the array.
- Another aspect of the present invention provides for producing a dark frame for the purpose of canceling out fixed pattern noise.
- Dark frame subtraction is employed to significantly reduce fixed pattern noise due to variations between pixels.
- Dark frame capture can easily be implemented electronically with a frame store imager simply by having a very short exposure time, preferably as controlled by the same timing and logic circuits that control automatic exposure. This eliminates the need for a mechanical shutter to perform the dark frame generation, which will save cost and complexity of the camera.
- a method is provided for obtaining calibration information for the individual pixels. Normally each pixel in an imager is reset to a reference level before an integration cycle begins.
- photocurrent in the photodiode causes the voltage on its cathode and a storage capacitor to droop, corresponding to the signal.
- the reset switch and the transfer switch connecting the photodiode to the capacitor are clocked in rapid succession so that there is no time for photocurrent to accumulate, generating a reference frame that can be subtracted from the image frame at a later time when both frames have been stored on the host system.
- the dark frame captures information about readout offset voltages of the individual pixels and an absolute zero-intensity reference per pixel.
- the dark frame may be captured before or after an actual exposure frame. Gray frames for calibration may similarly be captured by varying the Vref potential during reset.
- FIG. 1 is a simplified schematic diagram of a single prior-art pixel sensor.
- FIGS. 2 a through 2 e are energy diagrams which illustrate the prior-art problem of “blooming” due to charge overflow in the pixel sensor of FIG. 1, and of one prior-art method for dealing with blooming.
- FIG. 3 is a schematic diagram of a circuit according to the present invention for providing exposure control in active pixel sensor arrays by means of overflow detection in an active-pixel array according to the present invention.
- FIG. 4 is a schematic diagram of another circuit according to the present invention for providing exposure control in active pixel sensor arrays by means of overflow detection in an active-pixel array according to the present invention.
- FIG. 5 is a block diagram of another circuit according to the present invention for providing exposure control in active pixel sensor arrays by means of overflow detection in an active-pixel array according to the present invention and additionally for extending the dynamic range of an active pixel imager.
- FIGS. 6 a , 6 b , and 6 c are timing diagrams showing the operation of the circuit of FIG. 5 in its different modes.
- FIG. 7 is a simplified schematic diagram of a single pixel sensor according to the present invention.
- FIGS. 8 a through 8 f are energy diagrams illustrating the adaption of an anti-blooming overflow barrier for use as an autoexposure detector according to the present invention.
- FIG. 9 is a timing diagram showing the transfer, reset, and integrate output waveforms of the circuit of FIG. 5.
- FIGS. 10 a through 10 d are energy diagrams illustrating the dark frame and gray frame calibration feature of the present invention.
- Frame-storage imaging arrays according to the present invention have the ability to begin and end an exposure interval very quickly under completely electronic control via timing logic signals.
- One aspect of the present invention exploits that capability by providing methods and circuits for detecting when the exposure is sufficient, and for automatically terminating the exposure interval very precisely. The present invention thereby responds to the actual light being received during the exposure interval, as detected by the actual detectors. This is believed to be an improvement over measuring the light with a separate detector or at a separate time.
- the presently preferred embodiment of the invention takes advantage of the fact that the active pixel includes a reset transistor and further employs that transistor as an anti-blooming or overflow gutter, and senses the overflow amount as an indication of when some pixels have reached a full-scale exposure.
- the present invention adds the use of essentially zero exposure time to do a dark-level calibration, and other innovations.
- the fact that the frame-storage sensor array can do precisely controlled exposure times means that it can also do a vanishingly small exposure time with otherwise normal timing, as a way to obtain an image representative of the dark-state offsets of the amplifiers and readout circuits.
- This dark frame is one part of an automatic calibration scheme of the present invention.
- a second part of the automatic calibration scheme is one or more “gray” frames: a voltage level is established in each pixel sensor through the same transistor used for reset, overflow, and exposure detection, so that the offsets of the amplifier and readout circuitry can be read out as an image, at one or more levels, to be used in correcting images made earlier or later with the same camera.
- the use of the overflow signal in the present invention means that the exposure control is paying particular attention to the highlights of an image, or those parts that are limiting with respect to a charge-integration type of image sensor.
- the overflow/reset transistor acts as an expansive nonlinearity, so that when the responses are added, the total response preferentially weights the peaks, as opposed to the average, of the light levels in the imaging area. This use of a nonlinearity in an averaging exposure control system is believed to be in itself novel.
- FIGS. 1 and 2 a through 2 e a simplified schematic diagram of a single pixel sensor and energy diagrams describing its behavior, respectively, are provided to illustrate the prior-art problem of “blooming” due to charge overflow in pixel sensors and of one prior-art method for dealing with blooming.
- the prior-art pixel sensor 10 of FIG. 1 includes a photodiode 12 , having its anode formed in a semiconductor substrate (shown as ground symbol 14 ), and its cathode connected to the source of a reset transistor 16 .
- the drain of the reset transistor 16 is connected to a reference voltage supply Vref (shown at reference numeral 18 ), and its gate is connected to a reset control line 20 .
- Vref shown at reference numeral 18
- FIGS. 2 a through 2 e are energy diagrams which illustrate the potential energy of electrons at different points in the circuit of FIG. 1.
- the substrate potential is shown at the left at reference numeral 22
- the potential of the photodiode cathode is shown to its right at reference numeral 24
- the potential barrier set by the reset transistor is shown to the right of the photodiode cathode at reference numeral 26
- the potential of the Vref supply furthest to the right at reference numeral 28 .
- the reference numerals 22 , 24 , 26 , and 28 will be followed by suffixes a through e to correspond to the figures to which reference is made.
- FIG. 2 a illustrates the potential energy conditions which exist during the reset period when the reset transistor 16 is turned on to reset the pixel sensor to Vref.
- the potential barrier presented by the reset transistor at reference numeral 26 a is low and the energy level at the cathode of the photodiode 12 at region 24 a is set equal to Vref by the flow of current through reset transistor 16 .
- the potential at the cathode of photodiode 12 at region 24 a has been set equal to the level Vref which exists at reference numeral 28 a.
- FIG. 2 b illustrates the potential energy conditions which exist during the early portion of the integration period when the reset transistor 16 is turned off and charge is accumulating at the cathode of photodiode 12 in region 24 b .
- the accumulation of charge raises the voltage at the cathode of photodiode 12 in region 24 b because the potential barrier of the reset transistor 16 at reference numeral 26 b prevents the charge from flowing through reset transistor 16 to the Vref supply 18 at potential 28 b .
- Photon-generated electrons that are forming in the substrate 22 b are shown flowing “downhill” into the region 24 b.
- FIG. 2 c illustrates the potential energy conditions which exist during the later portion of the integration period when the reset transistor 16 is turned off and charge has accumulated at the cathode of photodiode 12 in region 24 c to the point where it has raised the potential of the photodiode cathode to a level which allows the accumulated charge to overflow into the substrate at reference numeral 22 c since the potential is higher than the substrate potential.
- the potential barrier of the reset transistor 16 at reference numeral 26 c prevents the charge from flowing through reset transistor 16 to the Vref supply 18 .
- FIGS. 2 d and 2 e illustrate a prior-art solution to the “blooming” problem caused by charge overflow into the substrate.
- the energy diagram of FIG. 2 d illustrates the potential energy conditions which exist during the early portion of the integration period when the reset transistor 16 is turned off and charge is accumulating at the cathode of photodiode 12 in region 24 d .
- the accumulation of charge raises the voltage at the cathode of photodiode 12 in region 24 d because the potential barrier of the reset transistor 16 at reference numeral 26 d prevents the charge from flowing through reset transistor 16 to the Vref supply 18 at potential 28 d.
- FIG. 2 e The energy diagram of FIG. 2 e illustrates the potential energy conditions which exist later during the integration period.
- the reset transistor 16 is still turned off and charge has accumulated at the cathode of photodiode 12 .
- the accumulation of charge continues to raise the voltage at the cathode of photodiode 12 in region 24 e .
- the potential barrier of the reset transistor 16 at reference numeral 26 e is set to a potential level lower than that of the substrate at reference numeral 22 e , the excess charge overflows into the Vref supply through reset transistor 16 rather than into the substrate 14 as was the case with the arrangement depicted in FIG. 2 c .
- the potential barrier of reset transistor 16 is set by appropriately biasing the gate of reset transistor 16 so that, as the voltage at the source of reset transistor 16 drops with accumulated charge, reset transistor 16 begins to allow current to flow before the potential 24 e at the cathode of photodiode 12 reaches the substrate potential 22 e.
- FIG. 3 a circuit 40 which provides one solution to the problem of determining the correct exposure interval for active pixel arrays for use in application such as electronic still cameras is described.
- Four illustrative pixels of an imaging array indicated generally at reference numerals 42 , 44 , 46 , and 48 are depicted in FIG. 3.
- the four illustrative pixels 42 , 44 , 46 , and 48 are depicted in adjacent rows and columns.
- a first row containing pixels 42 and 44 is associated with row-select line 50 and a second row containing pixels 46 and 48 is associated with row-select line 52 .
- a first column containing pixels 42 and 46 is associated with column-output line 54 and a second column containing pixels 44 and 48 is associated with column-output line 56 .
- FIG. 3 Persons of ordinary skill in the art will recognize that, while four illustrative storage pixels are shown in FIG. 3, a real imager array according to the present invention would consist of thousands or millions of pixels. Such skilled persons would also recognize that the concept disclosed with respect to FIG. 3 would work as well for active pixels without the storage elements 60 a through 60 d and transfer switches 64 a through 64 d shown in the pixels of FIG. 3.
- each of pixels 42 , 44 , 46 , and 48 is identical and the circuit elements of each pixel will be designated by identical reference numerals each having a suffix identifying the pixel with which it is associated.
- the circuit elements of pixels 42 , 44 , 46 , and 48 will be designated by suffix letters a, b, c, and d, respectively, in FIG. 3.
- each of pixels 42 , 44 , 46 , and 48 comprises a photodiode 58 , a storage capacitor 60 , a reset switch 62 , a transfer switch 64 , an output amplifier 66 , and a select switch 68 .
- each of switches 62 , 64 , and 68 comprises an N-Channel MOS transistor, although persons of ordinary skill in the art will be readily able to fabricate other embodiments in light of the teachings herein.
- each of pixels 42 , 44 , 46 , and 48 is fully described in co-pending application entitled “INTRA-PIXEL FRAME STORAGE ELEMENT, ARRAY, AND ELECTRONIC SHUTTER METHOD SUITABLE FOR ELECTRONIC STILL CAMERA APPLICATIONS”, Ser. No. ______, filed Nov. 13 , 1997 , and assigned to the same assignee as the present invention. Briefly, each pixel is first reset by turning on both its reset switch 62 and its transfer switch 64 . Then the reset switches 62 are turned off so that integration of photocurrent from photodiode 58 can begin.
- the present invention relies on overflow detection. At long exposure times, and assuming that the reset switch 62 is fully off, the voltages at the cathodes in the photodiodes of pixels receiving high light levels become so low that the cathodes no longer attract photo-generated electrons from the anode. These electrons tend to drift into the substrate. According to the present invention, the reset transistor 62 of each pixel in the array is employed to perform overflow detection by using it as an overflow barrier.
- each reset transistor in the array is set to a potential lower than that of the substrate so that excess charge above a level set by the gate voltage of the reset transistor 62 is passed through each reset transistor to a node from which total charge passed from all pixels can be sensed and an overflow signal developed therefrom.
- the overflow detection circuit comprises an operational amplifier 72 , having its non-inverting input connected to a reference voltage Vref (indicated at reference numeral 74 ) and its inverting input connected to reset line 76 , to which the drains of all reset transistors 62 in the array are connected.
- a feedback circuit from the output of amplifier 72 to its inverting input comprises a capacitor 78 , shunted by P-Channel MOS transistor 80 .
- the gate of P-Channel MOS transistor 80 is connected to an integrate signal line 82 .
- a comparator 84 has one input coupled to the output of amplifier 82 and the other input coupled to a voltage potential Vtrigger.
- the off-state gate voltage driving the reset switch 62 in all pixels is selected such that charge integration as a result of photo-electron generation will cause the voltage at the cathode of the photodiode 28 (common to the source of reset switch 62 ) to fall below the Vgs threshold of reset transistor 62 and begin to turn on reset switch 62 prior to overflow of electrons into the substrate.
- reset switch 62 starts to conduct, it will divert excess photo-generated electrons to line 76 , and thereby draw current from line 76 . This current is sensed, and when it reaches a threshold level which indicates overflow from a significant number of pixels it is used to terminate the exposure interval.
- the integrate signal on line 82 at the gate of P-Channel MOS transistor 80 is low so that the drains of all the reset switches 62 a - 62 d in the pixels 42 , 44 , 46 , and 48 at line 46 are held at Vref.
- the reset signal line (not shown) coupled to the gates of reset switches 32 a - 32 d in the pixels is also on, holding the cathodes of photodiodes 58 a - 58 d at Vref.
- the xfr clock at the gates of transfer switches 64 a - 64 d is also on at this time so that the upper plates of capacitors 30 a - 30 d are also reset to Vref.
- the reset signal goes low, isolating the cathodes of the photodiodes 58 a - 58 d from line 76 , and the integrate clock line 82 goes high.
- the inverting input of the amplifier 72 at line 76 is held to Vref by the capacitive feedback around amplifier 72 .
- the negative photocurrent (electrons) collected by photodiodes 58 a - 58 d begins to integrate on both photodiodes 58 a - 58 d and their respective storage capacitors 60 a - 60 d , causing the voltage on capacitors 60 a - 60 d to integrate down from the reset level Vref.
- the low level of the reset clock is set to approximately 1 volt.
- the voltages on the source of one or more of reset switches 62 a - 62 d will eventually decrease to approximately 1 N-Channel threshold below the voltage on their gates, at which point one or more of them will begin to turn on and further photocurrent generated in their pixels will flow through reset switches 32 a - 32 d into line 76 .
- line 76 is being held at Vref by amplifier 72 , the output of amplifier 72 must move up to compensate for the injected charge Q-overflow into line 76 .
- a difference voltage will appear at the output of amplifier 72 equal to Q-overflow divided by capacitor 78 .
- the excess photocurrent continues to flow through reset switch 32 a , the voltage on the output of amplifier 72 will increase until it reaches the level of Vtrigger and the comparator 84 will flip, indicating that the integration interval should be terminated.
- This scheme implemented by the circuit 40 of FIG. 3 assumes that the select switches 68 a - 68 d will be off during the integration interval so that no current can flow through amplifier transistors 66 a - 66 d .
- the drains of amplifier transistors 66 a - 66 d are covered by a light shield so that no photocurrent flows through them.
- capacitor 78 is integrating the overflow current from all the pixels in the array in the configuration shown.
- the amount of overexposure desired can be adjusted by the difference between Vtrigger and Vref, and also the size of capacitor 78 .
- storage capacitor 60 a and the capacitance of photodiode 58 combined add up to about 100 fF.
- the technique described with reference to FIG. 3 would provide exposure control for a digital still camera that is fairly simple to implement. It is well suited for integration with the storage pixel concept due to the inherent simplicity of electronic exposure control provided by the storage pixel concept.
- FIG. 4 a schematic diagram of another overflow control circuit 60 employing an alternative technique for detecting overflow in CMOS active pixels according to the present invention is presented.
- the technique embodied in the circuit of FIG. 4 is simpler than the feedback technique of FIG. 3.
- the circuit of FIG. 4 does not utilize operational amplifier 72 but instead employs P-Channel MOS transistor 92 , having its source connected to Vref, its drain connected to line 76 of FIG. 3, and its gate connected to the integrate signal line 98 .
- Capacitor 94 shown connected between line 76 and ground, may be realized as the distributed capacitance of line 76 .
- Line 76 is also connected to one input of comparator 96 .
- the other input to comparator 96 is connected to the voltage potential Vtrigger.
- the integrate signal line 98 at the gate of P-Channel MOS transistor 92 is low so that the pixels can be reset to Vref as in the embodiment of FIG. 1.
- P-Channel MOS transistor 92 is also turned on after the integration cycle to assure continued draining of photocurrent during readout. However, during exposure, P-Channel MOS transistor 92 is off, so that capacitor 94 alone maintains line 76 at Vref. As integration proceeds, some pixels will start to overflow, thus pulling down line 76 enough to trigger comparator 96 to indicate that the integration interval is complete.
- the overflow-sensing techniques of the present invention may be extended to imagers employing a bipolar non-storage technology, where a well is biased to act as an emitter for overflow collection during exposure, as opposed to its usual bias as a collector during readout.
- a bipolar non-storage technology where a well is biased to act as an emitter for overflow collection during exposure, as opposed to its usual bias as a collector during readout.
- the trigger can not be used to terminate the exposure precisely, but, from the within disclosure, persons of ordinary skill in the art will appreciate that it can be used to quench a strobe flash or to close a mechanical shutter, and to begin readout.
- overflow-sensing techniques of the present invention may be advantageously employed in prior-art imagers which measure the light either at a different time, e.g. just before the actual exposure, or with a different sensor device that needs to be calibrated relative to the sensor that is picking up the actual image, with the advantage that it senses the brightest areas rather than the average over the array.
- Another aspect of the present invention is the use of the reset/overflow/exposure transistors in a slightly differently timed mode to allow the capture of more highlight detail than would be possible when using it simply as an overflow transistor with or without automatic exposure termination.
- the automatic exposure detection of the present invention may detect that there is a significant amount of overflow after say 10 msec. At that time, perhaps about 1% of the pixels have integrated photocurrent to the limiting overflow level as determined by the gate voltage on the reset switches 62 . At that time, instead of simply terminating the exposure by closing the transfer switches 64 , this aspect of the present invention first reduces the gate voltage on the reset transistor switch 62 , moving the limiting overflow level in the direction that allows more photocurrent to be integrated, and then waiting a brief time, say on the order of 1 msec, or 10% of the already elapsed time, or perhaps less (substantially less than the original exposure time, in general), and then terminating the exposure.
- FIG. 5 a block diagram is presented of another circuit 100 according to the present invention for providing exposure control in active pixel sensor arrays by means of overflow detection in an active-pixel array according to the present invention and additionally for extending the dynamic range of an active pixel imager.
- the exposure time register 102 holds a number indicating how many clock cycles long the exposure, or the maximum exposure, should be.
- the exposure time is determined by down counter 104 .
- Enable Auto-Exposure input 106 is low, then the exposure time will be determined simply by the down counter 104 preloaded with the exposure time number stored in exposure time register 102 .
- the duration of the exposure is set by the exposure time number multiplied by the clock cycle time on clock line 118 .
- the enable auto-exposure input 106 is high, then the exposure time set into down counter 104 from exposure time register 102 is used as a maximum. If a trigger signal is never detected at the output of comparator 120 , due to insufficient total light in the maximum exposure interval, then the behavior of circuit 100 is as described above for the manual exposure case.
- a trigger signal is detected representing a threshold overflow signal condition, via AND gate 122 , D flip-flops 124 and 126 , and OR gate 128 , the down counter 104 is reloaded from the up counter 130 through multiplexer 110 , because now the XFR line 112 , driving the address input of multiplexer 110 , is in the other state.
- D-flip-flop 124 and AND gate 122 serve to synchronize the trigger to the clock. The effect of this action depends on the state of the Mode input 132 .
- Mode input 132 If the Mode input 132 is low, then the up counter 130 is held at zero through inverter 134 and OR gate 136 , and loading the down counter with zero makes the XFR line 112 go low immediately, terminating the exposure.
- the up counter is loaded from divide-by-N unit 138 , and the exposure will be extended for this many more clock cycles.
- the output of divide-by-N unit 138 increments by one every N input clock pulses and thus represents approximately 1/N of the already elapsed exposure period.
- the overflow barrier will be raised by lowering Reset line 112 to a lower voltage (V3 instead of the usual V2).
- the Reset line is controlled by P-Channel MOS transistor 140 and N-Channel MOS transistors 142 , 144 , 146 , and 148 .
- P-Channel MOS transistor 140 drives Reset line 112 to a high level voltage VI.
- N-Channel MOS transistors 142 and 144 are turned on, via the outputs of D flip-flops 116 and 126 , respectively, driving Reset line 112 to a medium-low level (V2).
- N-Channel MOS transistors 146 and 148 drive Reset line 112 to a lower level (V 3 ). After that, Reset line 112 floats at that level for the remainder of the extended integration period. Alternately, Reset input 112 could be continually driven to V3 if desired. Circuit modifications to provide such a feature could trivially be made by persons of ordinary skill in the art.
- FIGS. 6 a , 6 b , and 6 c timing diagrams show the operation of the circuit of FIG. 5 in all three cases discussed above. All logic signals transition after the rising clock edge that leads to them.
- FIG. 6 a illustrates the simple countdown case, independent of the state of the Mode line 132 .
- the trigger never occurs, either because it is disabled in order to obtain a fixed exposure time, or because the light level is so low that the maximum exposure time is reached.
- FIG. 6 b illustrates the simple auto-exposure case.
- the Mode input 132 is zero and the integration period is terminated by the trigger event.
- FIG. 6 c illustrates the highlight-extension auto-exposure case where the Mode input 132 is high and the trigger event causes the voltage at Reset line 112 to change, raising the overflow barrier, and causes the integration period to continue for about an additional 1/N of the already-elapsed exposure time.
- the total count for the Exposure Time would be many bits; with a 10 MHz clock and an absolute maximum time of 1 second, 24 bits would be required.
- the smallest possible count to make a dark frame with all the XFR, Integrate, and Reset edges in the right sequence would be 2 clock cycles.
- FIG. 7 is a simplified schematic diagram of a partial pixel 160 connected to an n-type switch 168 serving the same role as transistor 92 in FIG. 4.
- the pixel sensor 160 of FIG. 7 includes a photodiode 162 , having its anode formed in a semiconductor substrate (shown as ground symbol 164 ), and its cathode connected to the source of a reset transistor 166 .
- FIGS. 8 a through 8 f are energy diagrams which illustrate the potential at different points in the circuit of FIG. 7.
- the substrate potential is shown at the left at reference numeral 172
- the potential of the photodiode cathode is shown to its right at reference numeral 174
- the potential barrier set by the reset-A transistor is shown to the right of the photodiode cathode at reference numeral 176
- the potential barrier set by transistor 168 is shown to the right of the overflow node at reference numeral 180 and the potential of the Vref supply furthest to the right at reference numeral 182 .
- the reference numerals 172 , 174 , 176 , 178 , 180 , and 182 will be followed by suffixes a through f to correspond to the figures to which reference is made.
- the stippling and individual dots in each of the FIGS. 8 a through 8 f illustrates increments of charge.
- the height of the stippling in each region indicates the potential to which such charge has elevated each region.
- FIG. 8 a illustrates the potential energy conditions which exist during the reset period when transistors 166 and 168 are turned on to reset the pixel sensor 160 to Vref.
- the potential barriers presented by transistors 166 and 168 at reference numerals 176 a and 180 a are low and the energy level at the cathode of the photodiode 12 at region 174 a is set equal to Vref by the flow of current through transistors 166 and 168 .
- the potential at the cathode of photodiode 162 at region 174 a has been set equal to the level Vref which exists at reference numeral 182 a.
- FIG. 8 b illustrates the potential energy conditions which exist during the early portion of the integration period when transistors 166 and 168 are turned off and charge is accumulating at the cathode of photodiode 162 in region 174 b .
- the accumulation of charge starts to raise the voltage at the cathode of photodiode 162 in region 174 b because the potential barrier presented by the transistor 166 at reference numeral 176 b , prevents the charge from flowing through reset transistor 166 .
- the potential energy barriers presented by reset transistors 166 and 168 are both lower than the potential of the substrate.
- FIG. 8 c illustrates the potential energy conditions which exist during a later portion of the integration period.
- Transistors 166 and 168 are still off and charge has accumulated at the cathode of photodiode 162 in region 174 c to raise the potential of the photodiode cathode.
- the potential barrier of the reset transistor 166 at reference numeral 176 c still prevents the charge from flowing through reset transistor 166 .
- FIG. 8 d illustrates the potential energy conditions which exist during a later portion of the integration period when charge accumulating at the cathode of photodiode 162 in region 174 d is overflowing the potential barrier of reset transistor 166 at reference numeral 176 e and has begun to raise the potential at the overflow node between transistors 166 and 168 as shown at reference numeral 178 d .
- the overflow node is common to a group of pixels in the array which may include all pixels in the array.
- FIG. 8 e illustrates the potential energy conditions which exist at the point where charge accumulating at the overflow node at region 174 e has caused the overflow detect to trigger.
- the energy conditions in FIG. 8 e should be compared with those of FIG. 8 f , in which the potential barrier of reset transistor 166 has been raised slightly to allow further exposure for a selected time period, such as by employing the circuit of FIG. 5.
- the barrier height at 180 is not critical to this description, as it only operates as an on/off switch.
- dark frame subtraction can reduce fixed pattern noise due to variations between pixels significantly.
- Dark frame capture can easily be implemented electronically with a frame store imager simply by having a very short exposure time. This eliminates the need for a mechanical shutter to perform the dark frame generation, which will save cost and complexity of the camera.
- FIG. 9 is a timing diagram showing how this principle can be implemented using the circuit of FIG. 5. If a dark frame is desired, the preset count is set to be as small as possible. In the circuit of FIG. 5, the count is set equal to 2 in order to assure that the timing edges of the signals are correct.
- the transfer switch 64 a stays on so that the photocharge is integrated on both capacitor 60 a and photodiode 58 a , to increase the charge capacity and thereby the signal-to-noise ratio of the pixel. For dark-frame capture, this integration interval is kept extremely short so that effectively zero photogenerated charge is accumulated.
- the transfer switch 64 a turns off to isolate the image information on capacitor 60 a from further charge integration.
- the reset switch 62 a turns back on, keeping the photodiode at a positive potential during readout to absorb as many of the photo generated electrons as possible to keep them from being collected on the upper plate of capacitor 60 a and affecting the stored voltage level.
- dark frame subtraction can reduce fixed pattern noise due to pixel variation significantly. Furthermore it is easily integrated into the storage pixel operation as described above, without the requirement of a mechanical shutter for the camera.
- One of the main sources of fixed pattern noise in a CMOS imaging array comprises variations in the transistor parameters in the pixel circuit. These variations include VIN, W/L, body factor, etc.
- Example sources of error are source follower gain and offset variation, or transient noise injection variation. Much of this noise does not vary rapidly with time and therefore a periodic calibration can significantly reduce the effect of the noise.
- This type of calibration can be used to reduce noise levels down to the sources of noise that vary over time, such as 1/f noise and thermal noise. However, time varying noise occurs at the 10 bit level or below, and so is less significant for commercial imagers.
- FIGS. 10 a through 10 d are energy diagrams illustrating the dark frame calibration feature of the present invention.
- FIGS. 10 a through 10 d refer to the energy levels associated with the simplified pixel of FIG. 7.
- the substrate potential is shown at the left at reference numeral 192
- the potential of the photodiode cathode is shown to its right at reference numeral 194
- the potential barrier set by the reset-A transistor 166 is shown to the right of the photodiode cathode at reference numeral 196
- the potential barrier set by the reset-B transistor 168 is shown to the right of the overflow node at reference numeral 200 and the potential of the Vref supply furthest to the right at reference numeral 202 .
- the reference numerals 192 , 194 , 196 , 198 , 200 , and 202 will be used to the right of the overflow node
- FIG. 10 a shows the energy levels present in the pixel of FIG. 7 when resetting the pixel to dark level.
- the potential barriers of transistors 166 and 168 at reference numerals 196 a and 200 a are low, allowing the energy levels of the photodiode cathode at reference numeral 194 a , the overflow node at reference numeral 198 a to equalize at the potential Vref at reference numeral 202 a.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Solid State Image Pick-Up Elements (AREA)
Abstract
A method for controlling the exposure of an active pixel array electronic still camera includes the steps of: integrating photocurrent in each pixel during an integration time period; collecting overflow charge from all pixels in the array during the integration time period; developing an overflow signal as a function of the overflow charge; and terminating the integration time period when the overflow signal exceeds a preset threshold level selected to represent a desired reference exposure level. Apparatus for performing the method of the present invention includes circuitry for integrating photocurrent in each pixel during a integration time period; circuitry for diverting and detecting overflow charge from all pixels in the array during the integration time period; circuitry for developing an overflow signal as a function of the overflow charge; and circuitry for terminating said integration time period when the overflow signal exceeds a preset threshold level selected to represent a desired reference exposure level.
Description
- 1. Field of the Invention
- The present invention relates to electronic cameras employing solid state pixel sensor arrays. More particularly, the present invention relates to circuits and techniques for exposure control of such cameras and to exposure control of such cameras by means of overflow detection in arrays of active pixels.
- 2. The Prior Art
- Prior art exposure control techniques known to the inventors that use the actual image sensors during the actual exposure interval are of two types. Some prior art techniques integrate the total photocurrent by a common back-side electrode (anode) of a group of photodiodes—i.e., they integrate the substrate current to get an average light reading on the whole array. Other prior art techniques use nondestructive readout to sample selected pixels during the exposure interval, looking for an indication that some pixels are reaching a full-scale exposure.
- The first technique is tricky and difficult to implement, since the photocurrents are small and the substrate is large and noisy. In addition, it responds strictly to the average light level across the image plane rather than to those pixels that are reaching a full-scale charge accumulation. The second technique requires a sequential polling, so is limited to either a very slow operation or to sensing only a very small subset of the pixels. The second technique is therefore not good for detecting the exact time when a small percentage of pixels are reaching a full-scale exposure.
- Other prior art techniques for exposure control typically measure the light either at a different time, e.g. just before the actual exposure, or with a different sensor device that needs to be calibrated relative to the sensor that is picking up the actual image. Such techniques typically sample the image plane at selected fixed points rather than adapting to the lighting conditions of the entire image.
- One such prior art technique uses an imager first to estimate a light level and thereby to calculate an optimum exposure duration for a second cycle of the imager. This technique is obviously not as fast, and particularly is unsuited to controlling the exposure time rapidly during a dynamic lighting event, provided for example from a strobe flash.
- Another such prior art technique employs a separate overall light sensor to measure an average light level and to react to a sufficient quantity of light by closing a shutter or quenching a strobe flash. Mechanical shutters and non-frame-storage electronic sensors cannot be shuttered rapidly enough to use this technique during a flash, which is why the detector is sometimes used to turn off the light source instead of closing a shutter. These techniques require an awkward coordination between the camera, the light sensor, and the light source, and do not necessarily track automatically the sensitivity (or film speed) and lens aperture of the camera.
- Another type of prior art technique relates to use of an adjustable overflow drain for dynamic range enhancement. These techniques have not been integrated with the use of the overflow current for terminating the exposure time. Variations on this technique employ either a moving overflow barrier or a dual exposure interval to increase dynamic range.
- It is therefore an object of the present invention to provide an exposure control technique for an electronic still camera employing a solid state imaging array which overcomes the shortcomings of the prior art.
- It is another object of the present invention to provide an exposure control technique for an electronic still camera employing a solid state imaging array which exploits the overflow current produced by overexposed pixels in active pixel arrays.
- Yet another object of the present invention is to provide an exposure control technique for an electronic still camera employing a solid state imaging array which may be employed in conjunction with dark-frame-subtraction noise reduction techniques.
- Yet another object of the present invention is to provide an exposure control technique for an electronic still camera employing a solid state imaging array which provides enhanced dynamic range through overflow detection in the active pixels.
- A method according to the present invention for controlling the exposure of an active pixel array for applications such as an electronic still camera includes the steps of: integrating photocurrent in each pixel during an integration time period; collecting overflow charge from all pixels in the array during the integration time period; developing an overflow signal as a function of the overflow charge; and terminating the integration time period when the overflow charge exceeds a threshold level selected to represent a desired reference exposure level.
- According to a presently preferred embodiment of the invention, the step of collecting overflow charge from all pixels in the array comprises setting a charge potential barrier at the cathode of a photodiode in each pixel, the potential barrier being lower than the potential at which charge would overflow into the substrate, and the step of developing an overflow signal comprises generating a signal from charge overflowing the potential barrier.
- Apparatus according to the present invention for controlling the exposure of an active pixel array includes means for integrating photocurrent in each pixel during a integration time period; means for collecting overflow charge from all pixels in the array during the integration time period; means for developing an overflow signal as a function of the overflow charge; and means for terminating the integration time period when the overflow signal exceeds a preset threshold level.
- According to a presently preferred embodiment of the invention, the means for collecting overflow charge from all pixels in the array comprises means for setting a charge potential barrier at the cathode of a photodiode in each pixel, the potential barrier being lower than the potential at which charge would overflow into the substrate, and for collecting charge overflowing the potential barrier. As presently preferred, this function is performed by using the reset transistor in each pixel as a settable charge overflow barrier which is set to a level below (more positive than) the potential at the substrate. In addition, the means for developing an overflow signal comprises means for developing a voltage proportional to the excess charge accumulation at the cathode of the photodiode in all pixels. As presently preferred, this function is performed by developing a voltage proportional to the total charge allowed to flow into the Vref supply from all pixels in the array.
- Another aspect of the present invention provides for producing a dark frame for the purpose of canceling out fixed pattern noise. Dark frame subtraction is employed to significantly reduce fixed pattern noise due to variations between pixels. Dark frame capture can easily be implemented electronically with a frame store imager simply by having a very short exposure time, preferably as controlled by the same timing and logic circuits that control automatic exposure. This eliminates the need for a mechanical shutter to perform the dark frame generation, which will save cost and complexity of the camera. A method is provided for obtaining calibration information for the individual pixels. Normally each pixel in an imager is reset to a reference level before an integration cycle begins. After the pixel is reset, photocurrent in the photodiode causes the voltage on its cathode and a storage capacitor to droop, corresponding to the signal. To generate a reference dark frame, the reset switch and the transfer switch connecting the photodiode to the capacitor are clocked in rapid succession so that there is no time for photocurrent to accumulate, generating a reference frame that can be subtracted from the image frame at a later time when both frames have been stored on the host system. The dark frame captures information about readout offset voltages of the individual pixels and an absolute zero-intensity reference per pixel. The dark frame may be captured before or after an actual exposure frame. Gray frames for calibration may similarly be captured by varying the Vref potential during reset.
- FIG. 1 is a simplified schematic diagram of a single prior-art pixel sensor.
- FIGS. 2a through 2 e are energy diagrams which illustrate the prior-art problem of “blooming” due to charge overflow in the pixel sensor of FIG. 1, and of one prior-art method for dealing with blooming.
- FIG. 3 is a schematic diagram of a circuit according to the present invention for providing exposure control in active pixel sensor arrays by means of overflow detection in an active-pixel array according to the present invention.
- FIG. 4 is a schematic diagram of another circuit according to the present invention for providing exposure control in active pixel sensor arrays by means of overflow detection in an active-pixel array according to the present invention.
- FIG. 5 is a block diagram of another circuit according to the present invention for providing exposure control in active pixel sensor arrays by means of overflow detection in an active-pixel array according to the present invention and additionally for extending the dynamic range of an active pixel imager.
- FIGS. 6a, 6 b, and 6 c are timing diagrams showing the operation of the circuit of FIG. 5 in its different modes.
- FIG. 7 is a simplified schematic diagram of a single pixel sensor according to the present invention.
- FIGS. 8a through 8 f are energy diagrams illustrating the adaption of an anti-blooming overflow barrier for use as an autoexposure detector according to the present invention.
- FIG. 9 is a timing diagram showing the transfer, reset, and integrate output waveforms of the circuit of FIG. 5.
- FIGS. 10a through 10 d are energy diagrams illustrating the dark frame and gray frame calibration feature of the present invention.
- Those of ordinary skill in the art will realize that the following description of the present invention is illustrative only and not in any way limiting. Other embodiments of the invention will readily suggest themselves to such skilled persons.
- Frame-storage imaging arrays according to the present invention have the ability to begin and end an exposure interval very quickly under completely electronic control via timing logic signals. One aspect of the present invention exploits that capability by providing methods and circuits for detecting when the exposure is sufficient, and for automatically terminating the exposure interval very precisely. The present invention thereby responds to the actual light being received during the exposure interval, as detected by the actual detectors. This is believed to be an improvement over measuring the light with a separate detector or at a separate time.
- The presently preferred embodiment of the invention takes advantage of the fact that the active pixel includes a reset transistor and further employs that transistor as an anti-blooming or overflow gutter, and senses the overflow amount as an indication of when some pixels have reached a full-scale exposure.
- In addition, the present invention adds the use of essentially zero exposure time to do a dark-level calibration, and other innovations. The fact that the frame-storage sensor array can do precisely controlled exposure times means that it can also do a vanishingly small exposure time with otherwise normal timing, as a way to obtain an image representative of the dark-state offsets of the amplifiers and readout circuits. This dark frame is one part of an automatic calibration scheme of the present invention. A second part of the automatic calibration scheme is one or more “gray” frames: a voltage level is established in each pixel sensor through the same transistor used for reset, overflow, and exposure detection, so that the offsets of the amplifier and readout circuitry can be read out as an image, at one or more levels, to be used in correcting images made earlier or later with the same camera.
- Because of the fast shutter capability, it is possible to perform these calibration image measurements even without darkening the image on the sensor array. These calibration images are not the same as prior art techniques that integrate a dark current over a time interval—those techniques can also be used, to further remove leakage or dark current artifacts, but they require actually darkening the image on the sensor array.
- The use of the overflow signal in the present invention means that the exposure control is paying particular attention to the highlights of an image, or those parts that are limiting with respect to a charge-integration type of image sensor. Essentially, the overflow/reset transistor acts as an expansive nonlinearity, so that when the responses are added, the total response preferentially weights the peaks, as opposed to the average, of the light levels in the imaging area. This use of a nonlinearity in an averaging exposure control system is believed to be in itself novel.
- An important surprising advantage comes from the combination of the rapid automatic exposure sensing with the frame-storage nature of the image sensor array. Since the exposure time at each sensor pixel can be terminated immediately and globally across the imager array by a transition on the XFR line, independent of any readout time interval, the shutter can be operated rapidly enough to cut off the exposure accurately even during a rapid dynamic lighting event such as a strobe flash. Furthermore, the mechanism for so doing is the same mechanism, with no control differences, as used without a flash; so the camera can give a correct exposure without being set to different modes for different lighting conditions.
- Referring first to FIGS. 1 and 2a through 2 e, a simplified schematic diagram of a single pixel sensor and energy diagrams describing its behavior, respectively, are provided to illustrate the prior-art problem of “blooming” due to charge overflow in pixel sensors and of one prior-art method for dealing with blooming. The prior-
art pixel sensor 10 of FIG. 1 includes aphotodiode 12, having its anode formed in a semiconductor substrate (shown as ground symbol 14), and its cathode connected to the source of areset transistor 16. The drain of thereset transistor 16 is connected to a reference voltage supply Vref (shown at reference numeral 18), and its gate is connected to areset control line 20. - FIGS. 2a through 2 e are energy diagrams which illustrate the potential energy of electrons at different points in the circuit of FIG. 1. In each of FIGS. 2a through 2 e, the substrate potential is shown at the left at reference numeral 22, the potential of the photodiode cathode is shown to its right at reference numeral 24, the potential barrier set by the reset transistor is shown to the right of the photodiode cathode at reference numeral 26, and the potential of the Vref supply furthest to the right at
reference numeral 28. The reference numerals 22, 24, 26, and 28 will be followed by suffixes a through e to correspond to the figures to which reference is made. The stippling and individual dots in each of the figures illustrate increments of charge. The height of the stippling in each region indicates the potential to which such charge has elevated each region. Those of ordinary skill in the art will recognize that charge units are electrons and thus that higher barriers or levels of charge represent lower voltages. - FIG. 2a illustrates the potential energy conditions which exist during the reset period when the
reset transistor 16 is turned on to reset the pixel sensor to Vref. At the point in time illustrated by FIG. 2a, the potential barrier presented by the reset transistor at reference numeral 26 a is low and the energy level at the cathode of thephotodiode 12 at region 24 a is set equal to Vref by the flow of current throughreset transistor 16. Thus the potential at the cathode ofphotodiode 12 at region 24 a has been set equal to the level Vref which exists at reference numeral 28 a. - FIG. 2b illustrates the potential energy conditions which exist during the early portion of the integration period when the
reset transistor 16 is turned off and charge is accumulating at the cathode ofphotodiode 12 inregion 24 b. The accumulation of charge raises the voltage at the cathode ofphotodiode 12 inregion 24 b because the potential barrier of thereset transistor 16 at reference numeral 26 b prevents the charge from flowing throughreset transistor 16 to theVref supply 18 at potential 28 b. Photon-generated electrons that are forming in the substrate 22 b are shown flowing “downhill” into theregion 24 b. - FIG. 2c illustrates the potential energy conditions which exist during the later portion of the integration period when the
reset transistor 16 is turned off and charge has accumulated at the cathode ofphotodiode 12 in region 24 c to the point where it has raised the potential of the photodiode cathode to a level which allows the accumulated charge to overflow into the substrate atreference numeral 22 c since the potential is higher than the substrate potential. The potential barrier of thereset transistor 16 at reference numeral 26 c prevents the charge from flowing throughreset transistor 16 to theVref supply 18. - FIGS. 2d and 2 e, to which attention is now drawn, illustrate a prior-art solution to the “blooming” problem caused by charge overflow into the substrate. The energy diagram of FIG. 2d illustrates the potential energy conditions which exist during the early portion of the integration period when the
reset transistor 16 is turned off and charge is accumulating at the cathode ofphotodiode 12 in region 24 d. Just as in the example of FIG. 2b, the accumulation of charge raises the voltage at the cathode ofphotodiode 12 in region 24 d because the potential barrier of thereset transistor 16 at reference numeral 26 d prevents the charge from flowing throughreset transistor 16 to theVref supply 18 at potential 28 d. - The energy diagram of FIG. 2e illustrates the potential energy conditions which exist later during the integration period. The
reset transistor 16 is still turned off and charge has accumulated at the cathode ofphotodiode 12. Just as in the example of FIG. 2c, the accumulation of charge continues to raise the voltage at the cathode ofphotodiode 12 in region 24 e. However, because the potential barrier of thereset transistor 16 at reference numeral 26 e is set to a potential level lower than that of the substrate at reference numeral 22 e, the excess charge overflows into the Vref supply throughreset transistor 16 rather than into thesubstrate 14 as was the case with the arrangement depicted in FIG. 2c. The potential barrier ofreset transistor 16 is set by appropriately biasing the gate ofreset transistor 16 so that, as the voltage at the source ofreset transistor 16 drops with accumulated charge, resettransistor 16 begins to allow current to flow before the potential 24 e at the cathode ofphotodiode 12 reaches the substrate potential 22 e. - Referring now to FIG. 3, a
circuit 40 which provides one solution to the problem of determining the correct exposure interval for active pixel arrays for use in application such as electronic still cameras is described. Four illustrative pixels of an imaging array indicated generally atreference numerals illustrative pixels row containing pixels select line 50 and a secondrow containing pixels 46 and 48 is associated with row-select line 52. A firstcolumn containing pixels 42 and 46 is associated with column-output line 54 and a secondcolumn containing pixels output line 56. - Persons of ordinary skill in the art will recognize that, while four illustrative storage pixels are shown in FIG. 3, a real imager array according to the present invention would consist of thousands or millions of pixels. Such skilled persons would also recognize that the concept disclosed with respect to FIG. 3 would work as well for active pixels without the storage elements60 a through 60 d and transfer switches 64 a through 64 d shown in the pixels of FIG. 3.
- Each of
pixels pixels - According to the presently preferred embodiment of the invention, each of
pixels photodiode 58, astorage capacitor 60, a reset switch 62, a transfer switch 64, an output amplifier 66, and a select switch 68. According to the presently-preferred embodiment of the invention, each of switches 62, 64, and 68 comprises an N-Channel MOS transistor, although persons of ordinary skill in the art will be readily able to fabricate other embodiments in light of the teachings herein. - Operation of each of
pixels photodiode 58 can begin. - When transfer switch64 is turned on, the capacitance of the
storage capacitor 60 adds to the capacitance of thephotodiode 58 during integration, thereby increasing the charge capacity and therefore dynamic range of the storage-pixel sensor. This also reduces variation in the pixel output due to capacitance fluctuations since the gate oxide capacitance from whichstorage capacitor 60 is formed is better controlled than the junction capacitance of thephotodiode 58. - The present invention relies on overflow detection. At long exposure times, and assuming that the reset switch62 is fully off, the voltages at the cathodes in the photodiodes of pixels receiving high light levels become so low that the cathodes no longer attract photo-generated electrons from the anode. These electrons tend to drift into the substrate. According to the present invention, the reset transistor 62 of each pixel in the array is employed to perform overflow detection by using it as an overflow barrier. The barrier of each reset transistor in the array is set to a potential lower than that of the substrate so that excess charge above a level set by the gate voltage of the reset transistor 62 is passed through each reset transistor to a node from which total charge passed from all pixels can be sensed and an overflow signal developed therefrom.
- The overflow detection circuit comprises an operational amplifier72, having its non-inverting input connected to a reference voltage Vref (indicated at reference numeral 74) and its inverting input connected to reset
line 76, to which the drains of all reset transistors 62 in the array are connected. A feedback circuit from the output of amplifier 72 to its inverting input comprises acapacitor 78, shunted by P-Channel MOS transistor 80. The gate of P-Channel MOS transistor 80 is connected to an integratesignal line 82. Acomparator 84 has one input coupled to the output ofamplifier 82 and the other input coupled to a voltage potential Vtrigger. - As will become apparent from the disclosure herein, the off-state gate voltage driving the reset switch62 in all pixels is selected such that charge integration as a result of photo-electron generation will cause the voltage at the cathode of the photodiode 28 (common to the source of reset switch 62) to fall below the Vgs threshold of reset transistor 62 and begin to turn on reset switch 62 prior to overflow of electrons into the substrate. When reset switch 62 starts to conduct, it will divert excess photo-generated electrons to
line 76, and thereby draw current fromline 76. This current is sensed, and when it reaches a threshold level which indicates overflow from a significant number of pixels it is used to terminate the exposure interval. - Before the integration interval begins, the integrate signal on
line 82 at the gate of P-Channel MOS transistor 80 is low so that the drains of all the reset switches 62 a-62 d in thepixels photodiodes 58 a-58 d at Vref. The xfr clock at the gates of transfer switches 64 a-64 d is also on at this time so that the upper plates of capacitors 30 a-30 d are also reset to Vref. - Referring now to
pixels photodiodes 58 a-58 d fromline 76, and the integrateclock line 82 goes high. At this point, the inverting input of the amplifier 72 atline 76 is held to Vref by the capacitive feedback around amplifier 72. Also, the negative photocurrent (electrons) collected byphotodiodes 58 a-58 d begins to integrate on bothphotodiodes 58 a-58 d and theirrespective storage capacitors 60 a-60 d, causing the voltage oncapacitors 60 a-60 d to integrate down from the reset level Vref. - The low level of the reset clock is set to approximately 1 volt. As integration of photocurrent continues, the voltages on the source of one or more of reset switches62 a-62 d will eventually decrease to approximately 1 N-Channel threshold below the voltage on their gates, at which point one or more of them will begin to turn on and further photocurrent generated in their pixels will flow through reset switches 32 a-32 d into
line 76. Sinceline 76 is being held at Vref by amplifier 72, the output of amplifier 72 must move up to compensate for the injected charge Q-overflow intoline 76. A difference voltage will appear at the output of amplifier 72 equal to Q-overflow divided bycapacitor 78. As the excess photocurrent continues to flow through reset switch 32 a, the voltage on the output of amplifier 72 will increase until it reaches the level of Vtrigger and thecomparator 84 will flip, indicating that the integration interval should be terminated. - This scheme implemented by the
circuit 40 of FIG. 3 assumes that the select switches 68 a-68 d will be off during the integration interval so that no current can flow through amplifier transistors 66 a-66 d. The drains of amplifier transistors 66 a-66 d are covered by a light shield so that no photocurrent flows through them. - Those of ordinary skill in the art will observe that
capacitor 78 is integrating the overflow current from all the pixels in the array in the configuration shown. The amount of overexposure desired can be adjusted by the difference between Vtrigger and Vref, and also the size ofcapacitor 78. To provide a numerical example for this circuit, it is assumed that there is a highlight in the image of 1000 pixels (out of an image of about a million pixels) that it is desired to use as a reference exposure to terminate the integration. In any pixel, storage capacitor 60 a and the capacitance ofphotodiode 58 combined add up to about 100 fF. An amount of excess photocharge corresponding to 10% of the charge capacity of a pixel would be about 100 mV×100fF=10 fC. For 1000 pixels, this adds up to 10 pC. If Vref−Vtrigger=1V,capacitor 78 would have to be 10 pF, which could easily be integrated into the substrate containing the array. - In summary, the technique described with reference to FIG. 3 would provide exposure control for a digital still camera that is fairly simple to implement. It is well suited for integration with the storage pixel concept due to the inherent simplicity of electronic exposure control provided by the storage pixel concept.
- Referring now to FIG. 4, a schematic diagram of another
overflow control circuit 60 employing an alternative technique for detecting overflow in CMOS active pixels according to the present invention is presented. The technique embodied in the circuit of FIG. 4 is simpler than the feedback technique of FIG. 3. - The circuit of FIG. 4 does not utilize operational amplifier72 but instead employs P-
Channel MOS transistor 92, having its source connected to Vref, its drain connected to line 76 of FIG. 3, and its gate connected to the integratesignal line 98.Capacitor 94, shown connected betweenline 76 and ground, may be realized as the distributed capacitance ofline 76.Line 76 is also connected to one input ofcomparator 96. The other input tocomparator 96 is connected to the voltage potential Vtrigger. - Before the integration cycle begins, the integrate
signal line 98 at the gate of P-Channel MOS transistor 92 is low so that the pixels can be reset to Vref as in the embodiment of FIG. 1. P-Channel MOS transistor 92 is also turned on after the integration cycle to assure continued draining of photocurrent during readout. However, during exposure, P-Channel MOS transistor 92 is off, so thatcapacitor 94 alone maintainsline 76 at Vref. As integration proceeds, some pixels will start to overflow, thus pulling downline 76 enough to triggercomparator 96 to indicate that the integration interval is complete. - The overflow-sensing techniques of the present invention may be extended to imagers employing a bipolar non-storage technology, where a well is biased to act as an emitter for overflow collection during exposure, as opposed to its usual bias as a collector during readout. In this case, there is not a fast electronic shutter, so the trigger can not be used to terminate the exposure precisely, but, from the within disclosure, persons of ordinary skill in the art will appreciate that it can be used to quench a strobe flash or to close a mechanical shutter, and to begin readout.
- In addition, persons of ordinary skill in the art will appreciate that the overflow-sensing techniques of the present invention may be advantageously employed in prior-art imagers which measure the light either at a different time, e.g. just before the actual exposure, or with a different sensor device that needs to be calibrated relative to the sensor that is picking up the actual image, with the advantage that it senses the brightest areas rather than the average over the array.
- Several of the prior art techniques allow the light measurement to be made over either a full image area (average mode) or a restricted area (spot mode). The present invention is easiest to embody in a full image mode, but with wiring changes in the array could be adapted to operate in a spot mode.
- Another aspect of the present invention is the use of the reset/overflow/exposure transistors in a slightly differently timed mode to allow the capture of more highlight detail than would be possible when using it simply as an overflow transistor with or without automatic exposure termination. By combining the automatic detection of overflow with a subsequent brief extension of the exposure period during which the overflow limiting function is disabled or modified, it is possible to allow the highlight pixels that have become limited at the overflow level to differentiate themselves.
- For example, while capturing an image, the automatic exposure detection of the present invention may detect that there is a significant amount of overflow after say 10 msec. At that time, perhaps about 1% of the pixels have integrated photocurrent to the limiting overflow level as determined by the gate voltage on the reset switches62. At that time, instead of simply terminating the exposure by closing the transfer switches 64, this aspect of the present invention first reduces the gate voltage on the reset transistor switch 62, moving the limiting overflow level in the direction that allows more photocurrent to be integrated, and then waiting a brief time, say on the order of 1 msec, or 10% of the already elapsed time, or perhaps less (substantially less than the original exposure time, in general), and then terminating the exposure.
- This brief extension of time then allows the very bright pixels to be differentiated, with a reduced gain in terms of Volts per Watt. Pixels that are ten (or so) times brighter than what it took to cause limiting in the original time period will still be limited, but the extension of dynamic range on the high end is still considerable.
- Referring now to FIG. 5, a block diagram is presented of another
circuit 100 according to the present invention for providing exposure control in active pixel sensor arrays by means of overflow detection in an active-pixel array according to the present invention and additionally for extending the dynamic range of an active pixel imager. - The
exposure time register 102 holds a number indicating how many clock cycles long the exposure, or the maximum exposure, should be. The exposure time is determined bydown counter 104. - If Enable Auto-Exposure input106 is low, then the exposure time will be determined simply by the
down counter 104 preloaded with the exposure time number stored inexposure time register 102. A start pulse onstart line 108 loads the exposure time number into down counter 102 via multiplexer 1110, making the “=0” output of downcounter 102 go low for the predetermined duration, directly driving the XFR line and being delayed by one cycle for Integrateline 112 andReset line 114 through flip-flop 116. The duration of the exposure is set by the exposure time number multiplied by the clock cycle time on clock line 118. - If the enable auto-exposure input106 is high, then the exposure time set into down counter 104 from
exposure time register 102 is used as a maximum. If a trigger signal is never detected at the output ofcomparator 120, due to insufficient total light in the maximum exposure interval, then the behavior ofcircuit 100 is as described above for the manual exposure case. - If a trigger signal is detected representing a threshold overflow signal condition, via AND
gate 122, D flip-flops down counter 104 is reloaded from the up counter 130 throughmultiplexer 110, because now theXFR line 112, driving the address input ofmultiplexer 110, is in the other state. D-flip-flop 124 and ANDgate 122 serve to synchronize the trigger to the clock. The effect of this action depends on the state of theMode input 132. - If the
Mode input 132 is low, then the upcounter 130 is held at zero throughinverter 134 and OR gate 136, and loading the down counter with zero makes theXFR line 112 go low immediately, terminating the exposure. - If the Mode input136 is high, then the up counter is loaded from divide-by-N unit 138, and the exposure will be extended for this many more clock cycles. The output of divide-by-N unit 138 increments by one every N input clock pulses and thus represents approximately 1/N of the already elapsed exposure period. During this extended exposure period, the overflow barrier will be raised by lowering
Reset line 112 to a lower voltage (V3 instead of the usual V2). - The Reset line is controlled by P-
Channel MOS transistor 140 and N-Channel MOS transistors line 116 is low, P-Channel MOS transistor 140 drives Resetline 112 to a high level voltage VI. Throughout the normal integration period when trigger at the output ofcomparator 120 is false, N-Channel MOS transistors 142 and 144 are turned on, via the outputs of D flip-flops Reset line 112 to a medium-low level (V2). During only the second clock cycle after Trigger becomes true andMode input 132 is high, N-Channel MOS transistors drive Reset line 112 to a lower level (V3). After that,Reset line 112 floats at that level for the remainder of the extended integration period. Alternately,Reset input 112 could be continually driven to V3 if desired. Circuit modifications to provide such a feature could trivially be made by persons of ordinary skill in the art. - Referring now to FIGS. 6a, 6 b, and 6 c, timing diagrams show the operation of the circuit of FIG. 5 in all three cases discussed above. All logic signals transition after the rising clock edge that leads to them.
- FIG. 6a illustrates the simple countdown case, independent of the state of the
Mode line 132. In this case, the trigger never occurs, either because it is disabled in order to obtain a fixed exposure time, or because the light level is so low that the maximum exposure time is reached. - FIG. 6b illustrates the simple auto-exposure case. In this case, the
Mode input 132 is zero and the integration period is terminated by the trigger event. - FIG. 6c illustrates the highlight-extension auto-exposure case where the
Mode input 132 is high and the trigger event causes the voltage atReset line 112 to change, raising the overflow barrier, and causes the integration period to continue for about an additional 1/N of the already-elapsed exposure time. FIG. 6c is drawn using N=3. A typical value of N would be 5 to 20. FIGS. 6a and 6 c are drawn using N=3 to save space. The total count for the Exposure Time would be many bits; with a 10 MHz clock and an absolute maximum time of 1 second, 24 bits would be required. The smallest possible count to make a dark frame with all the XFR, Integrate, and Reset edges in the right sequence would be 2 clock cycles. - Those of ordinary skill in the art will observe that, if Mode is high, and Trigger becomes high near the end of the maximum exposure count, then the total exposure with the extension might exceed the maximum count by a ratio of up to 1+1/N; this is a feature, not a bug, since it would be harder to make sense of the data if the exposure were terminated some time in the middle of the extension.
- Referring now to FIGS. 7 and 8a through 8 f, the operation of the circuit of FIG. 5 may be easily seen. FIG. 7 is a simplified schematic diagram of a
partial pixel 160 connected to an n-type switch 168 serving the same role astransistor 92 in FIG. 4. Thepixel sensor 160 of FIG. 7 includes aphotodiode 162, having its anode formed in a semiconductor substrate (shown as ground symbol 164), and its cathode connected to the source of a reset transistor 166. The drain of the reset transistor 166 is connected to the source of atransistor 168, whose drain is connected to a reference voltage supply Vref (shown at reference numeral 170), and whose gate is connected to areset control line 172. The gates of the reset transistor 166 andtransistor 168 are connected to reset-A and reset-B control lines, 174, and 176, respectively. In the configuration illustrated in FIG. 7, where reset transistor 166 andtransistor 168 are both N-Channel devices, the signals reset-A and reset-B could be the same signal. Persons of ordinary skill in the art will realize that it is preferable fortransistor 168 to be a P-Channel device in actual embodiments fabricated according to the principles of the present invention, as intransistor 92 of FIG. 4, since a P-Channel device will have a greater drive capability. An N-Channel transistor is shown in FIG. 7 simply so that an energy diagram in terms of electrons can be used to illustrate the behavior. - FIGS. 8a through 8 f are energy diagrams which illustrate the potential at different points in the circuit of FIG. 7. In each of FIGS. 8a through 8 f, the substrate potential is shown at the left at
reference numeral 172, the potential of the photodiode cathode is shown to its right atreference numeral 174, the potential barrier set by the reset-A transistor is shown to the right of the photodiode cathode atreference numeral 176, the potential at the overflow node to the right of the potential barrier set by the reset-A transistor at reference numeral 178, the potential barrier set bytransistor 168 is shown to the right of the overflow node at reference numeral 180 and the potential of the Vref supply furthest to the right at reference numeral 182. Thereference numerals - FIG. 8a illustrates the potential energy conditions which exist during the reset period when
transistors 166 and 168 are turned on to reset thepixel sensor 160 to Vref. At the point in time illustrated by FIG. 8a, the potential barriers presented bytransistors 166 and 168 at reference numerals 176 a and 180 a are low and the energy level at the cathode of thephotodiode 12 at region 174 a is set equal to Vref by the flow of current throughtransistors 166 and 168. Thus the potential at the cathode ofphotodiode 162 at region 174 a has been set equal to the level Vref which exists at reference numeral 182 a. - FIG. 8b illustrates the potential energy conditions which exist during the early portion of the integration period when
transistors 166 and 168 are turned off and charge is accumulating at the cathode ofphotodiode 162 inregion 174 b. The accumulation of charge starts to raise the voltage at the cathode ofphotodiode 162 inregion 174 b because the potential barrier presented by the transistor 166 at reference numeral 176 b, prevents the charge from flowing through reset transistor 166. Note that the potential energy barriers presented byreset transistors 166 and 168 are both lower than the potential of the substrate. - FIG. 8c illustrates the potential energy conditions which exist during a later portion of the integration period.
Transistors 166 and 168 are still off and charge has accumulated at the cathode ofphotodiode 162 in region 174 c to raise the potential of the photodiode cathode. The potential barrier of the reset transistor 166 atreference numeral 176 c still prevents the charge from flowing through reset transistor 166. - FIG. 8d to which attention is now drawn, illustrates the potential energy conditions which exist during a later portion of the integration period when charge accumulating at the cathode of
photodiode 162 in region 174 d is overflowing the potential barrier of reset transistor 166 at reference numeral 176 e and has begun to raise the potential at the overflow node betweentransistors 166 and 168 as shown at reference numeral 178 d. Those of ordinary skill in the art will recognize that the overflow node is common to a group of pixels in the array which may include all pixels in the array. - FIG. 8e illustrates the potential energy conditions which exist at the point where charge accumulating at the overflow node at
region 174 e has caused the overflow detect to trigger. The energy conditions in FIG. 8e should be compared with those of FIG. 8f, in which the potential barrier of reset transistor 166 has been raised slightly to allow further exposure for a selected time period, such as by employing the circuit of FIG. 5. The barrier height at 180 is not critical to this description, as it only operates as an on/off switch. - According to another aspect of the present invention, dark frame subtraction can reduce fixed pattern noise due to variations between pixels significantly. Dark frame capture can easily be implemented electronically with a frame store imager simply by having a very short exposure time. This eliminates the need for a mechanical shutter to perform the dark frame generation, which will save cost and complexity of the camera.
- FIG. 9 is a timing diagram showing how this principle can be implemented using the circuit of FIG. 5. If a dark frame is desired, the preset count is set to be as small as possible. In the circuit of FIG. 5, the count is set equal to 2 in order to assure that the timing edges of the signals are correct.
- The transfer output waveform, the integrate signal and reset waveform of the circuit of FIG. 5 are shown in FIG. 9. Inspection of the
storage pixel 12 of FIG. 3 together with the timing diagram of FIG. 9 explains the phase relationships required for of the reset and transfer signals. During the time period (t1 to t2), both reset switch 62 a and transfer switch 64 a are on which causes photodiode 58 a and capacitor 60 a to be reset at the beginning of the integration cycle. Then the reset pulse goes low (time=t2) so that integration of photocurrent can begin. During integration (t2 to t3), the transfer switch 64 a stays on so that the photocharge is integrated on both capacitor 60 a and photodiode 58 a, to increase the charge capacity and thereby the signal-to-noise ratio of the pixel. For dark-frame capture, this integration interval is kept extremely short so that effectively zero photogenerated charge is accumulated. When the integration interval is complete, the transfer switch 64 a turns off to isolate the image information on capacitor 60 a from further charge integration. Soon thereafter (time=t4), the reset switch 62 a turns back on, keeping the photodiode at a positive potential during readout to absorb as many of the photo generated electrons as possible to keep them from being collected on the upper plate of capacitor 60 a and affecting the stored voltage level. - In summary, dark frame subtraction can reduce fixed pattern noise due to pixel variation significantly. Furthermore it is easily integrated into the storage pixel operation as described above, without the requirement of a mechanical shutter for the camera.
- One of the main sources of fixed pattern noise in a CMOS imaging array comprises variations in the transistor parameters in the pixel circuit. These variations include VIN, W/L, body factor, etc. Example sources of error are source follower gain and offset variation, or transient noise injection variation. Much of this noise does not vary rapidly with time and therefore a periodic calibration can significantly reduce the effect of the noise.
- Referring again to FIG. 3, an understanding is provided of a method according to the present invention for calibration of the individual pixels. Normally the pixel is reset to the Vref level before an integration cycle begins. After the pixel is reset, photocurrent generated in
photodiode 58 causes the voltage on the cathode of thephotodiode 58 or the upper plate ofcapacitor 60 to decrease, corresponding to the signal. However, if the reset switch 62 and the transfer switch 64 are clocked in rapid succession so that there is no time for photocurrent to accumulate, a reference frame can be generated that can be subtracted from the image frame at a later time when both frames have been stored on the host system. - If the level of Vref is varied, and the reference frame regenerated, the entire transfer function over the whole dynamic range from the cathode of
photodiode 58 to the analog output can be reconstructed separately for every pixel in the array. This operation will generate a lot of data and therefore cannot be done frequently, however an overnight or “between rolls” calibration might make sense. - This type of calibration can be used to reduce noise levels down to the sources of noise that vary over time, such as 1/f noise and thermal noise. However, time varying noise occurs at the 10 bit level or below, and so is less significant for commercial imagers.
- FIGS. 10a through 10 d are energy diagrams illustrating the dark frame calibration feature of the present invention. FIGS. 10a through 10 d refer to the energy levels associated with the simplified pixel of FIG. 7. In FIGS. 10a through 10 f, the substrate potential is shown at the left at reference numeral 192, the potential of the photodiode cathode is shown to its right at reference numeral 194, the potential barrier set by the reset-A transistor 166 is shown to the right of the photodiode cathode at reference numeral 196, the potential at the overflow node to the right of the potential barrier set by the reset-A transistor at reference numeral 198, the potential barrier set by the reset-
B transistor 168 is shown to the right of the overflow node at reference numeral 200 and the potential of the Vref supply furthest to the right atreference numeral 202. Thereference numerals 192, 194, 196, 198, 200, and 202 will be followed by suffixes a through d to correspond to the figures to which reference is made. - FIG. 10a shows the energy levels present in the pixel of FIG. 7 when resetting the pixel to dark level. The potential barriers of
transistors 166 and 168 at reference numerals 196 a and 200 a are low, allowing the energy levels of the photodiode cathode at reference numeral 194 a, the overflow node at reference numeral 198 a to equalize at the potential Vref at reference numeral 202 a. - Next, as shown in FIG. 10b, the potential barriers of
transistors 166 and 168 are raised, as shown at reference numerals 196 b and 200 b. No photo integration has taken place and the dark-frame charge level is read out of the pixels at this point. In the case of a storage pixel, the XFR switch is turned off prior to readout. - As shown, in FIG. 10c, the potential barriers of
reset transistors 166 and 168 at reference numerals 196 c and 200 c are lowered again to reset to the gray level, allowing the energy levels of the photodiode cathode at reference numeral 194 c, the overflow node at reference numeral 198 c to again equalize at the potential Vref at reference numeral 202 c. - Finally, as shown in FIG. 10d, the potential barriers of
transistors 166 and 168 at reference numerals 196 d and 200 d are again raised. No photointegration has yet taken place, and a uniform gray-level image based on the lowered Vref voltage is now read out. - While embodiments and applications of this invention have been shown and described, it would be apparent to those skilled in the art that many more modifications than mentioned above are possible without departing from the inventive concepts herein. In particular, such skilled persons will recognize that the n-type and p-type regions could be reversed along with the cathodes and anodes of the photodiodes, and the polarities of all voltages, resulting in an operative embodiment. The invention, therefore, is not to be restricted except in the spirit of the appended claims.
Claims (13)
1. A method for controlling the exposure of an active pixel array disposed on a semiconductor substrate, comprising the steps of:
integrating photocurrent in each pixel during an integration time period;
collecting overflow charge from all pixels in the array during said integration time period;
developing an overflow signal as a function of said overflow charge; and
terminating said integration time period when said overflow signal exceeds a preset threshold level selected to represent a desired reference exposure level.
2. The method of claim 1 wherein the step of collecting overflow charge from all pixels in said array comprises setting a charge potential barrier at a charge collection electrode of a photodiode in each pixel, said potential barrier being lower than the potential at which charge would overflow into the substrate and collecting charge overflowing said potential barrier.
3. The method of claim 2 wherein the step of developing an overflow signal comprises developing a voltage proportional to said charge having overflowed said potential barrier.
4. A method for controlling the exposure of an active pixel array disposed on a semiconductor substrate, comprising the steps of:
resetting each pixel during a reset time period;
integrating photocurrent in each pixel during an integration time period;
collecting overflow charge from all pixels in the array during said integration time period;
developing an overflow signal as a function of said overflow charge; and
terminating said integration time period when said overflow signal exceeds a preset threshold level.
5. The method of claim 4 wherein the step of collecting overflow charge from all pixels in said array comprises setting a charge potential barrier at a charge collection electrode of a photodiode in each pixel, said potential barrier being lower than the potential at which charge would overflow into the substrate and collecting charge overflowing said potential barrier.
6. The method of claim 5 wherein the step of developing an overflow signal comprises developing a voltage proportional to said charge having overflowed said potential barrier.
7. Apparatus for controlling the exposure of an active pixel array, comprising:
means for integrating photocurrent in each pixel during a integration time period;
means for collecting overflow charge from all pixels in the array during said integration time period;
means for developing an overflow signal as a function of said overflow charge; and
means for terminating said integration time period when said overflow signal exceeds a preset threshold level.
8. The apparatus of claim 7 wherein the means for collecting overflow charge from all pixels in said array comprises means for setting a charge potential barrier at a charge collection electrode of a photodiode in each pixel, said potential barrier being lower than the potential at which charge would overflow into the substrate, and for collecting charge overflowing said potential barrier.
9. The apparatus of claim 8 wherein the means for developing an overflow signal comprises means for developing a voltage proportional to said charge having overflowed said potential barrier.
10. In an active pixel imager array including pixels each comprising a photodiode having a first terminal connected to a fixed potential, a second terminal connectable to a reference voltage source through a reset transistor having a gate, a source connected to the second terminal and a drain connected to the reference voltage source, a storage capacitor connectable to the second terminal through a transfer switch, an amplifier having an input coupled to the capacitor and an output coupled to an output line through a select switch, a method for controlling the exposure of the active pixel array, comprising the steps of:
turning on the reset transistor and the transfer switch of each pixel to reset each pixel during a reset time period, said reset transistor turned on by applying a first voltage to its gate;
turning off the reset transistor while leaving the transfer switch on in each pixel to integrate photocurrent in each pixel during an integration time period, said reset transistor in each pixel turned off by applying a second voltage to its gate, said second voltage selected to bias said reset transistor in each pixel off until voltage at the second terminal of the photodiode in individual pixels decreases by a set amount enough to pass charge through the pixel's reset transistor during said integration time period;
deriving an overflow signal proportional to the total charge drawn from said reference voltage source during said integration period; and
terminating said second time period when said overflow signal exceeds a preset threshold level selected to represent a desired reference exposure level.
11. In an active frame storage pixel array disposed on a semiconductor substrate, the active pixel array controlled by an electronic shutter, a method for capturing a dark frame comprising the steps of:
resetting each pixel to a preselected voltage during a reset time period;
initiating an integration time period; and
immediately terminating said integration time period such that substantially zero photogenerated charge is accumulated.
12. The method of claim 11 wherein the step of resetting each pixel to a preselected voltage during a reset time period comprises the step of resetting each pixel to a dark level.
13. The method of claim 11 wherein the step of resetting each pixel to a preselected voltage during a reset time period comprises the step of resetting each pixel to a level other than a dark level.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/872,064 US20020024605A1 (en) | 1998-02-26 | 2001-05-31 | Method for capturing a dark frame |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/031,333 US6452633B1 (en) | 1998-02-26 | 1998-02-26 | Exposure control in electronic cameras by detecting overflow from active pixels |
US09/872,064 US20020024605A1 (en) | 1998-02-26 | 2001-05-31 | Method for capturing a dark frame |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/031,333 Division US6452633B1 (en) | 1998-02-26 | 1998-02-26 | Exposure control in electronic cameras by detecting overflow from active pixels |
Publications (1)
Publication Number | Publication Date |
---|---|
US20020024605A1 true US20020024605A1 (en) | 2002-02-28 |
Family
ID=21858857
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/031,333 Expired - Lifetime US6452633B1 (en) | 1998-02-26 | 1998-02-26 | Exposure control in electronic cameras by detecting overflow from active pixels |
US09/872,064 Abandoned US20020024605A1 (en) | 1998-02-26 | 2001-05-31 | Method for capturing a dark frame |
US09/872,070 Expired - Lifetime US6833871B1 (en) | 1998-02-26 | 2001-07-16 | Exposure control in electronic cameras by detecting overflow from active pixels |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/031,333 Expired - Lifetime US6452633B1 (en) | 1998-02-26 | 1998-02-26 | Exposure control in electronic cameras by detecting overflow from active pixels |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/872,070 Expired - Lifetime US6833871B1 (en) | 1998-02-26 | 2001-07-16 | Exposure control in electronic cameras by detecting overflow from active pixels |
Country Status (3)
Country | Link |
---|---|
US (3) | US6452633B1 (en) |
TW (1) | TW401690B (en) |
WO (1) | WO1999044358A2 (en) |
Cited By (19)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060028568A1 (en) * | 2004-08-06 | 2006-02-09 | Nobuhiro Takeda | Image capturing apparatus |
US20060192865A1 (en) * | 2005-02-04 | 2006-08-31 | Kazuhiro Suzuki | Noise processing apparatus and image pickup apparatus |
US7102672B1 (en) * | 2002-02-08 | 2006-09-05 | Electro Optical Sciences Inc | Integrated CMOS imaging array dark current monitor |
US7136100B1 (en) * | 1999-09-08 | 2006-11-14 | Casio Computer Co., Ltd. | Electronic still camera capable of removing noise component in image data and signal processing method thereof |
US20070064146A1 (en) * | 2005-09-21 | 2007-03-22 | Sorin Davidovici | System and Method for Image Sensor Element or Array with Photometric and Realtime Reporting Capabilities |
US20080031537A1 (en) * | 2006-08-07 | 2008-02-07 | Dina Gutkowicz-Krusin | Reducing noise in digital images |
US20080100736A1 (en) * | 2006-11-01 | 2008-05-01 | Canon Kabushiki Kaisha | Image sensing apparatus and control method therefor |
US20080252742A1 (en) * | 2007-04-12 | 2008-10-16 | Sony Corporation | Solid-state imaging device, method of driving the same, signal processing method for the same, and imaging apparatus |
US20090109313A1 (en) * | 2007-10-30 | 2009-04-30 | Xinqiao Liu | Self-Triggering CMOS Image Sensor |
US20100194956A1 (en) * | 2009-02-05 | 2010-08-05 | The Hong Kong University Of Science And Technology | Apparatus and method for improving dynamic range and linearity of CMOS image sensor |
US20110141487A1 (en) * | 2009-12-10 | 2011-06-16 | Stmicroelectronics (Research & Development) Limited | Or relating to optical navigation devices |
US20140267654A1 (en) * | 2013-03-15 | 2014-09-18 | Olive Medical Corporation | Comprehensive fixed pattern noise cancellation |
US20150103009A1 (en) * | 2013-10-14 | 2015-04-16 | Pixart Imaging Inc. | Image sensing apparatus and optical navigating apparatus with the image sensing apparatus |
US9966410B1 (en) * | 2017-04-04 | 2018-05-08 | Pixart Imaging (Penang) Sdn. Bhd. | Image sensor circuit and image sensing method |
US11221414B2 (en) * | 2019-06-20 | 2022-01-11 | Cilag Gmbh International | Laser mapping imaging with fixed pattern noise cancellation |
US11233960B2 (en) | 2019-06-20 | 2022-01-25 | Cilag Gmbh International | Fluorescence imaging with fixed pattern noise cancellation |
US11237270B2 (en) * | 2019-06-20 | 2022-02-01 | Cilag Gmbh International | Hyperspectral, fluorescence, and laser mapping imaging with fixed pattern noise cancellation |
US11265491B2 (en) | 2019-06-20 | 2022-03-01 | Cilag Gmbh International | Fluorescence imaging with fixed pattern noise cancellation |
US11854175B2 (en) | 2019-06-20 | 2023-12-26 | Cilag Gmbh International | Fluorescence imaging with fixed pattern noise cancellation |
Families Citing this family (61)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE69841968D1 (en) * | 1997-08-15 | 2010-12-09 | Sony Corp | Solid state imaging device and control method therefor |
US6452633B1 (en) * | 1998-02-26 | 2002-09-17 | Foveon, Inc. | Exposure control in electronic cameras by detecting overflow from active pixels |
JPH11274466A (en) * | 1998-03-20 | 1999-10-08 | Nikon Corp | Solid state imaging device and camera with the device |
TW425563B (en) * | 1998-06-03 | 2001-03-11 | Nippon Electric Co | Solid state image pickup device and driving method therefore |
JP3871439B2 (en) * | 1998-06-05 | 2007-01-24 | 松下電器産業株式会社 | Solid-state imaging device and driving method thereof |
US7015964B1 (en) * | 1998-11-02 | 2006-03-21 | Canon Kabushiki Kaisha | Solid-state image pickup device and method of resetting the same |
US6693670B1 (en) * | 1999-07-29 | 2004-02-17 | Vision - Sciences, Inc. | Multi-photodetector unit cell |
US6765619B1 (en) * | 2000-04-04 | 2004-07-20 | Pixim, Inc. | Method and apparatus for optimizing exposure time in image acquisitions |
JP2001337166A (en) * | 2000-05-26 | 2001-12-07 | Minolta Co Ltd | Method and device for three-dimensional input |
US7336309B2 (en) * | 2000-07-05 | 2008-02-26 | Vision-Sciences Inc. | Dynamic range compression method |
JP3875461B2 (en) * | 2000-07-06 | 2007-01-31 | 株式会社東芝 | Solid-state imaging system |
KR20030029124A (en) * | 2000-08-04 | 2003-04-11 | 포베온, 인크. | All-eletronic high-resolution digital still camera |
US20020030151A1 (en) * | 2000-09-11 | 2002-03-14 | Blaszczynski George M. | Method and apparatus for instantaneous exposure control in digital imaging devices |
TWI225556B (en) * | 2000-09-13 | 2004-12-21 | Au Optronics Corp | Manufacturing method of reflective liquid crystal display |
WO2002043366A2 (en) * | 2000-11-27 | 2002-05-30 | Vision Sciences Inc. | Programmable resolution cmos image sensor |
US20020179820A1 (en) | 2000-11-27 | 2002-12-05 | Moshe Stark | Noise floor reduction in image sensors |
CN100440926C (en) * | 2001-02-27 | 2008-12-03 | 张汉臣 | Photographic scene toleration technology and image conversion method |
US20050187433A1 (en) * | 2001-07-26 | 2005-08-25 | Given Imaging Ltd. | In-vivo imaging device providing constant bit rate transmission |
US9113846B2 (en) * | 2001-07-26 | 2015-08-25 | Given Imaging Ltd. | In-vivo imaging device providing data compression |
US7298406B2 (en) * | 2002-01-16 | 2007-11-20 | Micron Technology, Inc. | Ground referenced pixel reset |
JP3854887B2 (en) * | 2002-04-05 | 2006-12-06 | キヤノン株式会社 | Photoelectric conversion device |
JP4035356B2 (en) * | 2002-04-10 | 2008-01-23 | キヤノン株式会社 | Imaging apparatus and control method thereof |
US7164444B1 (en) * | 2002-05-17 | 2007-01-16 | Foveon, Inc. | Vertical color filter detector group with highlight detector |
US6844585B1 (en) | 2002-06-17 | 2005-01-18 | National Semiconductor Corporation | Circuit and method of forming the circuit having subsurface conductors |
US7071981B1 (en) * | 2002-07-01 | 2006-07-04 | Magnachip Semiconductor, Ltd. | Image sensing system and method |
US6646318B1 (en) | 2002-08-15 | 2003-11-11 | National Semiconductor Corporation | Bandgap tuned vertical color imager cell |
US6888573B2 (en) * | 2002-10-31 | 2005-05-03 | Motorola, Inc. | Digital pixel sensor with anti-blooming control |
US6903394B2 (en) * | 2002-11-27 | 2005-06-07 | Micron Technology, Inc. | CMOS imager with improved color response |
US7486313B2 (en) * | 2003-01-17 | 2009-02-03 | Biomorphic Vlsi, Inc. | System and method for automatic exposure control and white balancing for CMOS sensors |
IL155175A (en) * | 2003-03-31 | 2012-01-31 | Given Imaging Ltd | Diagnostic device using data compression |
JP3878575B2 (en) * | 2003-04-28 | 2007-02-07 | 松下電器産業株式会社 | Solid-state imaging device and driving method thereof |
US7105373B1 (en) | 2003-08-14 | 2006-09-12 | National Semiconductor Corporation | Vertical photodiode with heavily-doped regions of alternating conductivity types |
US6958194B1 (en) | 2003-10-21 | 2005-10-25 | Foveon, Inc. | Imager with improved sensitivity |
US7022968B1 (en) | 2003-10-21 | 2006-04-04 | National Semiconductor Corporation | Optical sensor that measures the light output by the combustion chamber of an internal combustion engine |
DE60333757D1 (en) * | 2003-11-04 | 2010-09-23 | St Microelectronics Res & Dev | Improvements in or relating to image sensors |
US6852562B1 (en) | 2003-12-05 | 2005-02-08 | Eastman Kodak Company | Low-cost method of forming a color imager |
DE112005000309B4 (en) * | 2004-03-10 | 2017-03-16 | Waters Technologies Corp. (N.D.Ges.D. Staates Delaware) | A method for improving the signal-to-noise ratio of measurements made using a self-scanning linear photodiode array |
US6972457B1 (en) | 2004-04-09 | 2005-12-06 | Eastman Kodak Company | Imaging cell that has a long integration period and method of operating the imaging cell |
US6972995B1 (en) | 2004-04-09 | 2005-12-06 | Eastman Kodak Company | Imaging cell with a non-volatile memory that provides a long integration period and method of operating the imaging cell |
US8009207B2 (en) | 2004-05-24 | 2011-08-30 | Nikon Corporation | Noise reduction device for reducing noise in image using blackout image, electronic camera, program, and method |
US7102117B2 (en) * | 2004-06-08 | 2006-09-05 | Eastman Kodak Company | Active pixel sensor cell with integrating varactor and method for using such cell |
US7343047B2 (en) * | 2004-09-22 | 2008-03-11 | Hewlett-Packard Development Company, L.P. | Systems and methods for arriving at an auto focus Figure of Merit |
FR2878373A1 (en) * | 2004-11-25 | 2006-05-26 | Suisse Electronique Microtech | CMOS type photosensitive cell for use as pixel structure, has integrator circuit for maintaining constant voltage at terminals of photodiode associated to bias current source and for forming exposure signal generating unit |
US8182422B2 (en) | 2005-12-13 | 2012-05-22 | Avantis Medical Systems, Inc. | Endoscope having detachable imaging device and method of using |
US8872906B2 (en) | 2005-01-05 | 2014-10-28 | Avantis Medical Systems, Inc. | Endoscope assembly with a polarizing filter |
US8797392B2 (en) | 2005-01-05 | 2014-08-05 | Avantis Medical Sytems, Inc. | Endoscope assembly with a polarizing filter |
US8289381B2 (en) | 2005-01-05 | 2012-10-16 | Avantis Medical Systems, Inc. | Endoscope with an imaging catheter assembly and method of configuring an endoscope |
WO2007087421A2 (en) | 2006-01-23 | 2007-08-02 | Avantis Medical Systems, Inc. | Endoscope |
JP4662880B2 (en) * | 2006-04-03 | 2011-03-30 | 三星電子株式会社 | Imaging apparatus and imaging method |
US8287446B2 (en) | 2006-04-18 | 2012-10-16 | Avantis Medical Systems, Inc. | Vibratory device, endoscope having such a device, method for configuring an endoscope, and method of reducing looping of an endoscope |
EP2023794A2 (en) | 2006-05-19 | 2009-02-18 | Avantis Medical Systems, Inc. | System and method for producing and improving images |
JP5125010B2 (en) * | 2006-07-20 | 2013-01-23 | ソニー株式会社 | Solid-state imaging device and control system |
JP4252098B2 (en) * | 2006-09-20 | 2009-04-08 | 三洋電機株式会社 | Photodetector |
US7675093B2 (en) | 2006-11-28 | 2010-03-09 | Micron Technology, Inc. | Antiblooming imaging apparatus, system, and methods |
US8064666B2 (en) | 2007-04-10 | 2011-11-22 | Avantis Medical Systems, Inc. | Method and device for examining or imaging an interior surface of a cavity |
US8159574B2 (en) * | 2008-12-08 | 2012-04-17 | BAE Systems Imaging Solutions, Inc. | Imaging array with built-in exposure control |
US8130294B2 (en) * | 2008-12-08 | 2012-03-06 | BAE Systems Imaging Solutions, Inc. | Imaging array with non-linear light response |
EP2392131B1 (en) * | 2009-01-28 | 2017-07-19 | Gentex Corporation | Improved imaging device |
JP5257176B2 (en) * | 2009-03-18 | 2013-08-07 | ソニー株式会社 | Solid-state imaging device, driving method of solid-state imaging device, and electronic apparatus |
US7851764B2 (en) * | 2009-03-20 | 2010-12-14 | Direct Electron, Lp | Method of high-energy particle imaging by computing a difference between sampled pixel voltages |
US20150097951A1 (en) * | 2013-07-17 | 2015-04-09 | Geoffrey Louis Barrows | Apparatus for Vision in Low Light Environments |
Family Cites Families (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3866067A (en) | 1973-05-21 | 1975-02-11 | Fairchild Camera Instr Co | Charge coupled device with exposure and antiblooming control |
US3934161A (en) | 1974-04-29 | 1976-01-20 | Texas Instruments Incorporated | Electronic shutter for a charge-coupled imager |
JPS54108628A (en) | 1978-02-13 | 1979-08-25 | Minolta Camera Co Ltd | Information transmission device of lenses |
JPS5850030B2 (en) | 1979-03-08 | 1983-11-08 | 日本放送協会 | Photoelectric conversion device and solid-state imaging plate using it |
US4499529A (en) | 1981-05-21 | 1985-02-12 | Figueroa Luisito A | Light reflector |
JPS5883824A (en) | 1981-11-13 | 1983-05-19 | Nippon Kogaku Kk <Nikon> | Electric connector device for interchangeable lens camera |
JPS5942527A (en) | 1982-09-01 | 1984-03-09 | Minolta Camera Co Ltd | Optical instrument with attaching and detaching mechanism |
JPS59152424A (en) | 1983-02-18 | 1984-08-31 | Canon Inc | Electric signal sending and receiving device of sending and receiving electric signal between camera and accessories |
JPS6020687A (en) | 1983-07-15 | 1985-02-01 | Nippon Kogaku Kk <Nikon> | Electronic still camera |
JPS6053912A (en) | 1983-09-02 | 1985-03-28 | Minolta Camera Co Ltd | Mount device for attaching and detaching lens of camera and interchangeable lens |
JPS6058780A (en) | 1983-09-09 | 1985-04-04 | Olympus Optical Co Ltd | Solid-state image pickup device provided with photometric function |
JPS6023841A (en) | 1984-04-23 | 1985-02-06 | Canon Inc | Interchangeable lens barrel |
JPS6235328A (en) | 1985-08-09 | 1987-02-16 | Minolta Camera Co Ltd | Exposure controller for camera |
US4742238A (en) | 1985-10-02 | 1988-05-03 | Canon Kabushiki Kaisha | Non-linear photoelectric converting apparatus with means for changing drainage performance |
JPS62143571A (en) | 1985-12-17 | 1987-06-26 | Sharp Corp | Electronic still camera |
US4839735A (en) | 1986-12-22 | 1989-06-13 | Hamamatsu Photonics K.K. | Solid state image sensor having variable charge accumulation time period |
JPH07114474B2 (en) | 1987-01-05 | 1995-12-06 | 株式会社東芝 | Electronic still camera |
US4901129A (en) | 1987-04-10 | 1990-02-13 | Texas Instruments Incorporated | Bulk charge modulated transistor threshold image sensor elements and method of making |
JPH01103378A (en) | 1987-10-16 | 1989-04-20 | Sanyo Electric Co Ltd | Exposure control circuit for solid-state image pickup element |
JP2577598B2 (en) | 1988-03-10 | 1997-02-05 | 富士写真フイルム株式会社 | Peak detector for image sensor |
JPH0399589A (en) | 1989-09-13 | 1991-04-24 | Toshiba Corp | Solid-state camera |
DE69108803T2 (en) | 1990-01-08 | 1995-08-24 | Nikon Corp | Arrangement for processing still images. |
US5276521A (en) | 1990-07-30 | 1994-01-04 | Olympus Optical Co., Ltd. | Solid state imaging device having a constant pixel integrating period and blooming resistance |
JP2641802B2 (en) | 1990-12-27 | 1997-08-20 | 富士通株式会社 | Imaging device |
JP2993144B2 (en) | 1991-02-22 | 1999-12-20 | 株式会社デンソー | Image sensor |
US5276520A (en) * | 1991-06-07 | 1994-01-04 | Eastman Kodak Company | Enhancing exposure latitude of image sensors |
JPH05158107A (en) * | 1991-12-10 | 1993-06-25 | Fuji Film Micro Device Kk | Automatic photometry device for image pickup device |
JPH05316431A (en) | 1992-05-06 | 1993-11-26 | Sony Corp | Solid-state image pickup device |
JPH063580A (en) * | 1992-06-19 | 1994-01-14 | Nikon Corp | Focus detecting device |
US5335015A (en) | 1992-10-30 | 1994-08-02 | Texas Instruments Incorporated | Method for improved dynamic range of BCMD image sensors |
US5631704A (en) | 1994-10-14 | 1997-05-20 | Lucent Technologies, Inc. | Active pixel sensor and imaging system having differential mode |
US5625210A (en) | 1995-04-13 | 1997-04-29 | Eastman Kodak Company | Active pixel sensor integrated with a pinned photodiode |
US5739562A (en) | 1995-08-01 | 1998-04-14 | Lucent Technologies Inc. | Combined photogate and photodiode active pixel image sensor |
JPH0965217A (en) * | 1995-08-22 | 1997-03-07 | Nec Corp | Solid-state image pickup device and its drive method |
GB2308267B (en) | 1995-08-25 | 2000-06-28 | Psc Inc | Optical reader with imaging array having reduced pattern density |
DE69525535T2 (en) | 1995-11-21 | 2002-11-28 | St Microelectronics Srl | Adaptive optical sensor |
DE69729648T2 (en) | 1996-01-22 | 2005-06-09 | California Institute Of Technology, Pasadena | ACTIVE PIXEL SENSOR MATRIX WITH MULTI-LOAD OUTPUT |
US5614948A (en) | 1996-04-26 | 1997-03-25 | Intel Corporation | Camera having an adaptive gain control |
US6369853B1 (en) | 1997-11-13 | 2002-04-09 | Foveon, Inc. | Intra-pixel frame storage element, array, and electronic shutter method suitable for electronic still camera applications |
US6046444A (en) * | 1997-12-08 | 2000-04-04 | Intel Corporation | High sensitivity active pixel with electronic shutter |
US6452633B1 (en) * | 1998-02-26 | 2002-09-17 | Foveon, Inc. | Exposure control in electronic cameras by detecting overflow from active pixels |
-
1998
- 1998-02-26 US US09/031,333 patent/US6452633B1/en not_active Expired - Lifetime
-
1999
- 1999-02-19 WO PCT/US1999/003766 patent/WO1999044358A2/en active Application Filing
- 1999-02-25 TW TW088102812A patent/TW401690B/en not_active IP Right Cessation
-
2001
- 2001-05-31 US US09/872,064 patent/US20020024605A1/en not_active Abandoned
- 2001-07-16 US US09/872,070 patent/US6833871B1/en not_active Expired - Lifetime
Cited By (37)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7136100B1 (en) * | 1999-09-08 | 2006-11-14 | Casio Computer Co., Ltd. | Electronic still camera capable of removing noise component in image data and signal processing method thereof |
US7102672B1 (en) * | 2002-02-08 | 2006-09-05 | Electro Optical Sciences Inc | Integrated CMOS imaging array dark current monitor |
US7733401B2 (en) * | 2004-08-06 | 2010-06-08 | Canon Kabushiki Kaisha | Image capturing apparatus |
US8233071B2 (en) * | 2004-08-06 | 2012-07-31 | Canon Kabushiki Kaisha | Image capturing apparatus comprising image sensor and plurality of pixels with simultaneous transfer of pixel electric charge from a first to an oppositely arranged second storage device |
US20060028568A1 (en) * | 2004-08-06 | 2006-02-09 | Nobuhiro Takeda | Image capturing apparatus |
US20100208096A1 (en) * | 2004-08-06 | 2010-08-19 | Nobuhiro Takeda | Image capturing apparatus |
US20060192865A1 (en) * | 2005-02-04 | 2006-08-31 | Kazuhiro Suzuki | Noise processing apparatus and image pickup apparatus |
US20070064146A1 (en) * | 2005-09-21 | 2007-03-22 | Sorin Davidovici | System and Method for Image Sensor Element or Array with Photometric and Realtime Reporting Capabilities |
US7800669B2 (en) * | 2005-09-21 | 2010-09-21 | R.J.S. Technology, Inc. | System and method for image sensor element or array with photometric and realtime reporting capabilities |
US8160386B2 (en) | 2006-08-07 | 2012-04-17 | Mela Sciences, Inc. | Reducing noise in digital images |
US7813586B2 (en) | 2006-08-07 | 2010-10-12 | Mela Sciences, Inc. | Reducing noise in digital images |
US8630508B2 (en) | 2006-08-07 | 2014-01-14 | Mela Sciences, Inc. | Reducing noise in digital images |
US20080031537A1 (en) * | 2006-08-07 | 2008-02-07 | Dina Gutkowicz-Krusin | Reducing noise in digital images |
US20110019888A1 (en) * | 2006-08-07 | 2011-01-27 | MELA SCIENCES, Inc., a Delaware corporation | Reducing noise in digital images |
US7940320B2 (en) * | 2006-11-01 | 2011-05-10 | Canon Kabushiki Kaisha | Image sensing apparatus and control method therefor having a field based varying horizontal cycle |
US20080100736A1 (en) * | 2006-11-01 | 2008-05-01 | Canon Kabushiki Kaisha | Image sensing apparatus and control method therefor |
US9185313B2 (en) * | 2007-04-12 | 2015-11-10 | Sony Corporation | Solid-state imaging device, method of driving the same, signal processing method for the same, and imaging apparatus |
US20080252742A1 (en) * | 2007-04-12 | 2008-10-16 | Sony Corporation | Solid-state imaging device, method of driving the same, signal processing method for the same, and imaging apparatus |
US7812879B2 (en) * | 2007-10-30 | 2010-10-12 | Fairchild Imaging | Self-triggering CMOS image sensor |
US20090109313A1 (en) * | 2007-10-30 | 2009-04-30 | Xinqiao Liu | Self-Triggering CMOS Image Sensor |
US8625012B2 (en) * | 2009-02-05 | 2014-01-07 | The Hong Kong University Of Science And Technology | Apparatus and method for improving dynamic range and linearity of CMOS image sensor |
US20100194956A1 (en) * | 2009-02-05 | 2010-08-05 | The Hong Kong University Of Science And Technology | Apparatus and method for improving dynamic range and linearity of CMOS image sensor |
US20110141487A1 (en) * | 2009-12-10 | 2011-06-16 | Stmicroelectronics (Research & Development) Limited | Or relating to optical navigation devices |
US9354747B2 (en) * | 2009-12-10 | 2016-05-31 | Stmicroelectronics (Research & Development) Limited | Optical navigation device with a backlight and associated methods |
US20140267654A1 (en) * | 2013-03-15 | 2014-09-18 | Olive Medical Corporation | Comprehensive fixed pattern noise cancellation |
US10341593B2 (en) * | 2013-03-15 | 2019-07-02 | DePuy Synthes Products, Inc. | Comprehensive fixed pattern noise cancellation |
US10972690B2 (en) * | 2013-03-15 | 2021-04-06 | DePuy Synthes Products, Inc. | Comprehensive fixed pattern noise cancellation |
US11425322B2 (en) * | 2013-03-15 | 2022-08-23 | DePuy Synthes Products, Inc. | Comprehensive fixed pattern noise cancellation |
US9244541B2 (en) * | 2013-10-14 | 2016-01-26 | Pixart Imaging Inc. | Image sensing apparatus and optical navigating apparatus with the image sensing apparatus |
US20150103009A1 (en) * | 2013-10-14 | 2015-04-16 | Pixart Imaging Inc. | Image sensing apparatus and optical navigating apparatus with the image sensing apparatus |
US9966410B1 (en) * | 2017-04-04 | 2018-05-08 | Pixart Imaging (Penang) Sdn. Bhd. | Image sensor circuit and image sensing method |
US11221414B2 (en) * | 2019-06-20 | 2022-01-11 | Cilag Gmbh International | Laser mapping imaging with fixed pattern noise cancellation |
US11233960B2 (en) | 2019-06-20 | 2022-01-25 | Cilag Gmbh International | Fluorescence imaging with fixed pattern noise cancellation |
US11237270B2 (en) * | 2019-06-20 | 2022-02-01 | Cilag Gmbh International | Hyperspectral, fluorescence, and laser mapping imaging with fixed pattern noise cancellation |
US11265491B2 (en) | 2019-06-20 | 2022-03-01 | Cilag Gmbh International | Fluorescence imaging with fixed pattern noise cancellation |
US11821989B2 (en) | 2019-06-20 | 2023-11-21 | Cllag GmbH International | Hyperspectral, fluorescence, and laser mapping imaging with fixed pattern noise cancellation |
US11854175B2 (en) | 2019-06-20 | 2023-12-26 | Cilag Gmbh International | Fluorescence imaging with fixed pattern noise cancellation |
Also Published As
Publication number | Publication date |
---|---|
TW401690B (en) | 2000-08-11 |
US6833871B1 (en) | 2004-12-21 |
WO1999044358A2 (en) | 1999-09-02 |
US6452633B1 (en) | 2002-09-17 |
WO1999044358A3 (en) | 2000-02-03 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6452633B1 (en) | Exposure control in electronic cameras by detecting overflow from active pixels | |
US6760070B1 (en) | High-sensitivity storage pixel sensor array having auto-exposure detection | |
US7038820B1 (en) | Automatic exposure control for an image sensor | |
US8089035B2 (en) | CMOS image sensor with high sensitivity wide dynamic range pixel for high resolution applications | |
KR100718404B1 (en) | Image sensor incorporating saturation time measurement to increase dynamic range | |
CN100515050C (en) | Solid-state image pickup device, method of driving same and imaging apparatus | |
US7489354B2 (en) | CMOS active pixel with hard and soft reset | |
JP2020532165A (en) | Detecting high intensity light in a photo sensor | |
JP4902658B2 (en) | Image sensor | |
KR20010043893A (en) | Extended dynamic range image sensor system | |
US20100309352A1 (en) | Solid-state imaging device | |
JP4916517B2 (en) | A / D converter using transfer gate clock with slope | |
CN111355901A (en) | Photoelectric sensor, pixel circuit, image sensor and photoelectric sensing method | |
US6831691B1 (en) | Solid-state image pickup device | |
JP4300635B2 (en) | Solid-state imaging device | |
JP3664035B2 (en) | Solid-state imaging device | |
US7295237B2 (en) | Image capturing apparatus capable of extracting a moving object | |
JP4300654B2 (en) | Solid-state imaging device | |
JP4931231B2 (en) | Imaging apparatus and control method thereof | |
JP4292628B2 (en) | Solid-state imaging device | |
US7298406B2 (en) | Ground referenced pixel reset | |
US7190399B2 (en) | Image pickup apparatus | |
JP4345175B2 (en) | Solid-state imaging device | |
CN212486631U (en) | Photoelectric sensor, pixel circuit, image sensor, and electronic device | |
US8159574B2 (en) | Imaging array with built-in exposure control |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |