USRE42739E1 - Imager output signal processing - Google Patents

Imager output signal processing Download PDF

Info

Publication number
USRE42739E1
USRE42739E1 US12/717,188 US71718801A USRE42739E US RE42739 E1 USRE42739 E1 US RE42739E1 US 71718801 A US71718801 A US 71718801A US RE42739 E USRE42739 E US RE42739E
Authority
US
United States
Prior art keywords
pixel
sigma
saturation
column
digital
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Lifetime, expires
Application number
US12/717,188
Inventor
Justin Fortier
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
HARUSAKI TECHNOLOGIES LLC
Harusaki Tech LLC
Original Assignee
Harusaki Tech LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Harusaki Tech LLC filed Critical Harusaki Tech LLC
Priority to US12/717,188 priority Critical patent/USRE42739E1/en
Assigned to HARUSAKI TECHNOLOGIES, LLC reassignment HARUSAKI TECHNOLOGIES, LLC ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: PSION TEKLOGIX SYSTEMS INC.
Assigned to HARUSAKI TECHNOLOGIES, LLC reassignment HARUSAKI TECHNOLOGIES, LLC CORRECTIVE ASSIGNMENT TO CORRECT THE ADDRESS OF THE ASSIGNEE, PREVIOUSLY RECORDED ON REEL 025654 FRAME 0826. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT. Assignors: PSION TEKLOGIX SYSTEMS INC.
Application granted granted Critical
Publication of USRE42739E1 publication Critical patent/USRE42739E1/en
Adjusted expiration legal-status Critical
Expired - Lifetime legal-status Critical Current

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/78Readout circuits for addressed sensors, e.g. output amplifiers or A/D converters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/71Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/75Circuitry for providing, modifying or processing image signals from the pixel array
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50Control of the SSIS exposure
    • H04N25/53Control of the integration time
    • H04N25/533Control of the integration time by using differing integration times for different sensor regions

Definitions

  • the invention relates generally to CMOS imagers, and more particularly to the processing of column level signals in an imager.
  • CMOS imagers are well known in the art and are implemented in many different applications.
  • One of the primary areas that CMOS imagers can be found is in portable applications such as digital cameras that use battery power. It is therefore very desirable to have a CMOS imager that is powered with a low supply voltage, for example one volt (1V).
  • the quantization values of an imager become very small.
  • the pixel consists of a precharge transistor, a source follower amplifying transistor and an access transistor.
  • V t When the pixel is precharged to the supply voltage, one threshold voltage, V t , is lost through the precharge transistor.
  • V t Once the pixel is exposed to light and the output is being read out to the column, another V t is lost through the source follower amplifying transistor.
  • a typical V t for MOS transistors is 0.07 V, leaving a maximum voltage output to the column of 0.86V (1V-2*0.07V), further limiting the quantization levels.
  • FIG. 1 illustrates column voltage output from a typical 3-transistor CMOS pixel versus integration time.
  • the maximum voltage that can be red out to the column is V supply -2*V t .
  • the integration time t int if the light on the pixel is sufficiently intense, the photodiode saturates and the voltage on the column is goes to zero.
  • Quantizing the output from the pixels into digital data for the Digital Signal Processor may be carried out in a number of known ways.
  • Correlated Double Sampling CDS quantizes the output of the column signal twice, once at the beginning of the integration period and once at the end. From these two samples the DSP calculates the slope of the pixel output to determine the brightness of the pixel.
  • This method is highly susceptible to noise and as a result of the high noise to quantization level ratio can be very inaccurate in a low voltage CMOS imager.
  • by using only two points to calculate the slope of the pixel output there is no accounting for a saturated pixel. Any pixels that saturate at different times in the integration period are all calculated as having the same slope, and thus all those pixels are considered to have the same value.
  • Successive approximation is another method of converting the analog output from the pixel into a digital signal.
  • the output at the end of the integration period is successively compared to different threshold levels, each representing one bit of resolution of the final output.
  • the thresholds are created through capacitors that must be sized in precise ratios (C, 1 ⁇ 2C, 1 ⁇ 4C, etc.) which is both difficult to implement and also occupies a large amount of space. Also, the capacitors on every column across the array must be matched with one another for consistent results, which is not always attainable due to process impurities.
  • the problem of noise is a large factor in successive approximation, as both the small quantization levels to noise ratio as well as capacitance noise, which is larger in small capacitors, will accumulate to yield inaccurate results.
  • Successive approximation also does not directly account for the problem of threshold voltage loss through the pixel transistors.
  • successive approximation takes a single sample at the end of the integration period and therefore, has no way of differentiating between pixels that saturate at different times throughout the integration period.
  • the invention is directed to a method and apparatus for processing pixel output signals from column lines in an imager having an array of pixels in rows and columns.
  • the output signals on each column line are converted to digital signals using a sigma-delta type analog-to-digital converter and the digital signals are fed to a digital signal processor.
  • the sigma-delta type converter is monitored to stop sampling of a pixel with the detection of pixel saturation.
  • detecting pixel saturation is carried out by counting a predetermined number of consecutive zeros.
  • the sigma-delta type converter output is sent to the digital signal processor with the detection of the saturation of a pixel.
  • sets of a predetermined number of sigma-delta type converter output samples are condensed by a decimator into binary numbers of predetermined bit length.
  • the number of sigma-delta type converter output samples in a set wherein the pixel has saturated is determined using a further counter and this number is fed to the decimator. Alternately, the determined number may be fed to the digital signal processor.
  • next pixel in a column is controlled to be read with the saturation of the previous pixel
  • next row of pixels may be controlled to be read with the saturation of the pixels in the previous row
  • the outputs of the decimators may be multiplexed to provide one or more inputs to the digital signal processor.
  • a single multiplexer may be used providing one input line to the digital signal processor, or a number of multiplexers may be used providing a number of input lines to the digital signal processor.
  • FIG. 1 illustrates the column voltage output from a pixel versus integration time
  • FIG. 2 illustrates the general imaging array architecture
  • FIG. 3 is a block diagram of the imaging array output for one column
  • FIG. 4 is a block diagram of a second embodiment of the imaging array output for one column
  • FIG. 5 is a block diagram of a third embodiment of the imaging array output for one column
  • FIG. 6 is a block diagram of the imaging array output for one column with feedback to the pixels
  • FIG. 7 is an imaging array with counter feedback to row enable circuitry
  • FIG. 8 illustrates imaging array with a decimator multiplexer for the outputs
  • FIG. 9 illustrates imaging array with multiple decimator multiplexers for the outputs.
  • FIG. 2 schematically illustrates an imager 200 in accordance with the present invention.
  • the imager includes an imaging array 201 of pixels 202 arranged in rows 203 and columns 204 .
  • the rows 203 are controlled by row enabling circuitry 205 , and the outputs of columns 204 are directed to column output circuitry 207 through lines 206 .
  • the method and apparatus for processing imaging array output signals in accordance with the present invention comprises a column level (one for every column) sigma-delta type analog-to-digital converter 208 in the column output circuitry 207 .
  • Sigma-delta converters are well known in the converter art as efficient oversampling analog-to-digital quantizers.
  • This type of converter generally consists of a quantizer that both outputs the digital result as well as feeds the result back to the input.
  • the feedback is subtracted from the input and the difference is integrated and then enters the quantizer.
  • the output of the converter consists of ones and zeros with the average output tracking the average input due to the feedback.
  • the pixel 202 is charged to substantially the supply voltage V supply , and with the input to sigma-delta converter 208 being at a high level, the output will be mainly ones with the occasional zero.
  • the pixel 202 will then start to be pulled towards ground at a rate dependent on the intensity of the light, causing the sigma-delta converter 208 to start outputting less ones and more zeros.
  • a low signal level will be applied to the sigma-delta converter 208 which outputs almost all zeros with only occasional ones.
  • the column level sigma-delta analog-to-digital converter 208 is able to solve the various problems associated with having a low voltage CMOS imager 200 .
  • the sigma-delta converter 208 overcomes the problems of noise through oversampling the output of the pixels 202 . More samples yields more accurate results through line-of-best-fit approximations on the output of the converter 208 .
  • the line-of-best-fit approximation also allows the sigma-delta converter 208 to indirectly account for the threshold voltage V t drops across the transistors in the pixel.
  • the sigma-delta converter 208 is capable of accounting for saturating pixels 202 .
  • the integration time t int of the imager 200 corresponds to a set number of outputs from the sigma-delta converter 208 depending on the sampling frequency. If a pixel 202 does not saturate, then the sigma-delta converter 208 will output the set number of samples and the digital signal processor (DSP) will calculate the correct output.
  • DSP digital signal processor
  • the output of the sigma-delta converter 208 is monitored and will stop sampling when pixel 202 saturation has been detected. The DSP will then calculate the line-of-best-fit knowing that it has received less values and correspondingly calculates the result.
  • the invention may be implemented using column level sigma-delta converters 308 having inputs connected to the analog column output lines 304 for pixels 302 with each column level sigma-delta converter 308 having a simple counter 309 associated with it, as shown in FIG. 3 .
  • the counter 309 receives the output of the sigma-delta converter 308 and increments every time it receives a zero output and resets every time it receives a logic one output.
  • the counter 308 is set to count to a predetermined number which is representative of the number of consecutive zero outputs from the sigma-delta converter 308 that determines when saturation has occurred.
  • the sigma-delta converter 308 stops sampling and the output is sent to the DSP minus the string of consecutive zeros.
  • the DSP will then convert this data to a value representative of the brightness of the pixel 302 recognizing the fact that it has less than the usual number of samples. For example, suppose a typical number of samples for the integration period is 1000, while a typical setting for the counter is 10. If a pixel 302 in a column 304 is being read out and after 765 samples the counter has reached 10, (in other words, the last 10 outputs were zeros) then the pixel 302 is considered to have saturated. The sigma-delta converter 308 stops sampling and the first 755 samples are processed by the DSP. The last 10 samples are all zeros and are therefore dropped from the converter output.
  • FIG. 4 which includes the elements described with respect to FIG. 3 with the addition of a decimator 410 at the column level with each sigma-delta converter 408 .
  • the decimator 410 will take a number of the samples output by the sigma-delta converter 408 and condense them to a binary number of a predetermined bit length. For example, the decimator 410 might take every 50 samples from the sigma-delta converter 408 and turn them into a 10-bit binary number.
  • the benefit of this system is that it eliminates the problem of bussing all of the samples to the DSP during the integration period. Instead only a certain number of decimated binary numbers will need to be output to the DSP.
  • Another major benefit of having the decimator 410 is that the first level of processing the data is already done at the column level, in parallel, before it even reaches the DSP, resulting in faster processing.
  • FIG. 5 which in addition to the elements described with respect to FIG. 4 , includes a decimator counter 511 , that is coupled between the first counter 509 and the decimator 510 .
  • the decimator counter 511 simply counts to the number of samples that the decimator 510 inputs before it provides a multi-bit binary number output. Each time the counter 511 reaches that value, the decimator 510 outputs a multi-bit binary number and then the counter 511 resets to zero.
  • the sigma-delta converter 508 stops sampling and the decimator counter 511 outputs its value to either the decimator 510 or the DSP.
  • the decimator 510 will calculate the last output taking into account that it does not have the usual number of samples. Therefore the saturation of the pixel 502 is reflected in the output of the decimator 510 and the DSP does not have to compensate for it.
  • the decimator counter 511 outputs to the DSP, then the DSP will receive the last output from the decimator 510 knowing that it has not accounted for the saturation of the pixel 502 and the DSP will correspondingly calculate the output.
  • the added benefit of this embodiment is a more accurate determination of the pixel's 502 saturation point leading to more accurate resolution in bright pixels.
  • FIG. 6 illustrates an embodiment that includes a system for permitting columns to be read out faster.
  • the imager includes a sigma-delta analog-to-digital converter 608 connected to analog column output line 604 for converting the output signals from pixels 602 .
  • Counter 609 is coupled to the converter 608 to detect saturated pixels 602 . Normally, when a pixel 602 saturates the sigma-delta converter 608 stops sampling and waits until the next pixel 602 is selected to be read out. In a system as shown in FIG. 6 , once pixel 602 saturation is detected by the counter 609 , the sigma-delta converter 608 stops reading the current pixel 602 n and the next pixel 602 n+1 is automatically selected to be read out immediately. Having the counter 609 feed back to pixels 602 directly through line 611 can allow it to automatically select the next pixel 602 to be read out. This will result in bright columns being read out in a much faster manner.
  • FIG. 7 is a schematic of an imager 700 similar to the imager 200 illustrated in FIG. 2 , wherein the reading out of rows of saturated pixels 702 may be accelerated.
  • each column converter 708 includes a counter 709 connected to the output of each converter 708 .
  • the counter 709 output is fed back to its respective converter 708 , as well as to a comparison circuit 714 through line 713 .
  • Comparison circuit 714 compares the outputs of all the counters 709 in the columns 704 . In the case where all the pixels 702 in a row 703 being read out at one time saturate, the comparison yields a positive result.
  • imagers 800 , 900 respectively are schematically illustrated wherein the imaging array 801 , 901 column output lines 806 , 906 are coupled to sigma-delta converters 808 , 908 .
  • the outputs of the converters 808 , 908 are coupled to counters 809 , 909 and to decimators 810 , 910 .
  • the decimators 810 , 910 outputs are coupled to one or more multiplexers 816 , 916 .
  • the multiplexer 816 is implemented along the column side of the imaging array 801 and consists of as many inputs as there are column lines 806 , with one output 817 which is connected to the DSP.
  • the decimator output multiplexer 816 would then consist of 1280 10-bit inputs and one 10-bit output.
  • the reason behind having this multiplexer 816 is that the DSP could be separated spatially from the imaging array 801 and the outputs 806 from the columns need to be bussed across the chip.
  • the apparatus would only need to bus one output 817 , instead of 1280 outputs 806 .
  • a clock is used to sequentially scroll through all of the columns to transfer one decimator output to the DSP at a time.
  • this embodiment is also beneficial in the sense that it is a fast and efficient way to read out the data.
  • multiple decimator output multiplexers 916 could be coupled to groups of decimators 910 with one output connection 917 from each of them bussed to the DSP.
  • Each multiplexer 916 is of a smaller size than in the previous embodiment and is connected to a smaller section of the column lines 906 .
  • 64 decimator output multiplexers could be implemented, each with 20 10-bit inputs and one 10-bit output.
  • the reasons behind using more than one multiplexer is to be able to have all the decimator 910 outputs transferred efficiently and easily to the DSP.
  • the previous embodiment needs a very fast and accurate clock to be implemented, whereas this embodiment is not as demanding and precise, yet still reduces the number of electric lines 906 needed between the imaging array 901 and the DSP by a large factor.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

The method and apparatus for processing pixel output signals from column lines in an imager having an array of pixels in rows and columns uses a sigma-delta type analog-to-digital converter to convert the output signals on each column line to digital signals and feeding them to a digital signal processor. The converter is monitored to stop sampling of a pixel with the detection of pixel saturation, which is carried out by counting a predetermined number of consecutive zeros in the converted signal. In addition, the next pixel in a column may be controlled to be read with the saturation of the previous pixel, and the next row of pixels may be controlled to be read with the saturation of the pixels in the previous row. Further, sets of a predetermined number of converter output samples are condensed by a decimator into binary numbers of predetermined bit length. The outputs of the decimators may be fed directly to the digital signal processor or they may be multiplexed to provide one or more inputs to the digital signal processor.

Description

This application is a 371 application of PCT application PCT/CA01/01773 filed Dec. 13, 2001, which claims the benefit of U.S. provisional application 60/256,336 filed Dec. 19, 2000. This application was published in English on Jun. 27, 2002 as International Publication Number WO 02/51128 A2.
FIELD OF THE INVENTION
The invention relates generally to CMOS imagers, and more particularly to the processing of column level signals in an imager.
BACKGROUND OF THE INVENTION
Currently, CMOS imagers are well known in the art and are implemented in many different applications. One of the primary areas that CMOS imagers can be found is in portable applications such as digital cameras that use battery power. It is therefore very desirable to have a CMOS imager that is powered with a low supply voltage, for example one volt (1V).
Having a voltage this low, however, leads to a number of problems. For one, the quantization values of an imager become very small. For example, a typical CMOS imager might use 8 bits of resolution and have a supply voltage of 3.3 volts. This leads to a quantization level of 3.3V/256=12.9 mV. If an imager is implemented with a one volt supply and 8 bits of resolution then the quantization level is 1V/256=3.9 mV. The proportion of noise relative to this low quantization value becomes very large and has a greater impact on the output.
Another problem involves the pixel structure that is used in most CMOS imagers, namely using 3 n-type MOS transistors with a photodiode. The pixel consists of a precharge transistor, a source follower amplifying transistor and an access transistor. When the pixel is precharged to the supply voltage, one threshold voltage, Vt, is lost through the precharge transistor. Once the pixel is exposed to light and the output is being read out to the column, another Vt is lost through the source follower amplifying transistor. A typical Vt for MOS transistors is 0.07 V, leaving a maximum voltage output to the column of 0.86V (1V-2*0.07V), further limiting the quantization levels. FIG. 1 illustrates column voltage output from a typical 3-transistor CMOS pixel versus integration time. The maximum voltage that can be red out to the column is Vsupply-2*Vt. During the integration time tint, if the light on the pixel is sufficiently intense, the photodiode saturates and the voltage on the column is goes to zero.
Quantizing the output from the pixels into digital data for the Digital Signal Processor (DSP) may be carried out in a number of known ways. Correlated Double Sampling (CDS) quantizes the output of the column signal twice, once at the beginning of the integration period and once at the end. From these two samples the DSP calculates the slope of the pixel output to determine the brightness of the pixel. This method is highly susceptible to noise and as a result of the high noise to quantization level ratio can be very inaccurate in a low voltage CMOS imager. Also, by using only two points to calculate the slope of the pixel output there is no accounting for a saturated pixel. Any pixels that saturate at different times in the integration period are all calculated as having the same slope, and thus all those pixels are considered to have the same value.
Successive approximation is another method of converting the analog output from the pixel into a digital signal. In this system the output at the end of the integration period is successively compared to different threshold levels, each representing one bit of resolution of the final output. The thresholds are created through capacitors that must be sized in precise ratios (C, ½C, ¼C, etc.) which is both difficult to implement and also occupies a large amount of space. Also, the capacitors on every column across the array must be matched with one another for consistent results, which is not always attainable due to process impurities. The problem of noise is a large factor in successive approximation, as both the small quantization levels to noise ratio as well as capacitance noise, which is larger in small capacitors, will accumulate to yield inaccurate results. Successive approximation also does not directly account for the problem of threshold voltage loss through the pixel transistors. Finally, successive approximation takes a single sample at the end of the integration period and therefore, has no way of differentiating between pixels that saturate at different times throughout the integration period.
Therefore, there is a need for an efficient method and apparatus that is suited to low voltage imagers for processing the pixel output signals at the column level.
SUMMARY OF THE INVENTION
The invention is directed to a method and apparatus for processing pixel output signals from column lines in an imager having an array of pixels in rows and columns. The output signals on each column line are converted to digital signals using a sigma-delta type analog-to-digital converter and the digital signals are fed to a digital signal processor.
In accordance with another aspect of the invention, the sigma-delta type converter is monitored to stop sampling of a pixel with the detection of pixel saturation. With the sigma-delta type converter providing an output of mainly logical ones for a high input signal level and an output of mainly zeros for a low input signal level, detecting pixel saturation is carried out by counting a predetermined number of consecutive zeros.
In accordance with a further aspect of the invention, the sigma-delta type converter output is sent to the digital signal processor with the detection of the saturation of a pixel.
In accordance with another aspect of the invention, sets of a predetermined number of sigma-delta type converter output samples are condensed by a decimator into binary numbers of predetermined bit length. In addition, the number of sigma-delta type converter output samples in a set wherein the pixel has saturated is determined using a further counter and this number is fed to the decimator. Alternately, the determined number may be fed to the digital signal processor.
In accordance with yet another aspect of this invention, the next pixel in a column is controlled to be read with the saturation of the previous pixel, and the next row of pixels may be controlled to be read with the saturation of the pixels in the previous row.
In accordance with a further aspect of this invention, the outputs of the decimators may be multiplexed to provide one or more inputs to the digital signal processor. A single multiplexer may be used providing one input line to the digital signal processor, or a number of multiplexers may be used providing a number of input lines to the digital signal processor.
Other aspects and advantages of the invention, as well as the structure and operation of various embodiments of the invention, will become apparent to those ordinarily skilled in the art upon review of the following description of the invention in conjunction with the accompanying drawings.
BRIEF DESCRIPTION OF THE DRAWINGS
The invention will be described with reference to the accompanying drawings, wherein:
FIG. 1 illustrates the column voltage output from a pixel versus integration time;
FIG. 2 illustrates the general imaging array architecture;
FIG. 3 is a block diagram of the imaging array output for one column;
FIG. 4 is a block diagram of a second embodiment of the imaging array output for one column;
FIG. 5 is a block diagram of a third embodiment of the imaging array output for one column;
FIG. 6 is a block diagram of the imaging array output for one column with feedback to the pixels;
FIG. 7 is an imaging array with counter feedback to row enable circuitry;
FIG. 8 illustrates imaging array with a decimator multiplexer for the outputs; and
FIG. 9 illustrates imaging array with multiple decimator multiplexers for the outputs.
DETAILED DESCRIPTION OF THE INVENTION
FIG. 2 schematically illustrates an imager 200 in accordance with the present invention. The imager includes an imaging array 201 of pixels 202 arranged in rows 203 and columns 204. The rows 203 are controlled by row enabling circuitry 205, and the outputs of columns 204 are directed to column output circuitry 207 through lines 206. As illustrated schematically in FIG. 2, the method and apparatus for processing imaging array output signals in accordance with the present invention comprises a column level (one for every column) sigma-delta type analog-to-digital converter 208 in the column output circuitry 207. Sigma-delta converters are well known in the converter art as efficient oversampling analog-to-digital quantizers. This type of converter generally consists of a quantizer that both outputs the digital result as well as feeds the result back to the input. The feedback is subtracted from the input and the difference is integrated and then enters the quantizer. The output of the converter consists of ones and zeros with the average output tracking the average input due to the feedback. In an imaging application the pixel 202 is charged to substantially the supply voltage Vsupply, and with the input to sigma-delta converter 208 being at a high level, the output will be mainly ones with the occasional zero. The pixel 202 will then start to be pulled towards ground at a rate dependent on the intensity of the light, causing the sigma-delta converter 208 to start outputting less ones and more zeros. When the pixel 202 is nearing saturation, a low signal level will be applied to the sigma-delta converter 208 which outputs almost all zeros with only occasional ones.
The column level sigma-delta analog-to-digital converter 208 is able to solve the various problems associated with having a low voltage CMOS imager 200. The sigma-delta converter 208 overcomes the problems of noise through oversampling the output of the pixels 202. More samples yields more accurate results through line-of-best-fit approximations on the output of the converter 208. The line-of-best-fit approximation also allows the sigma-delta converter 208 to indirectly account for the threshold voltage Vt drops across the transistors in the pixel.
In accordance with the present invention the sigma-delta converter 208 is capable of accounting for saturating pixels 202. The integration time tint of the imager 200 corresponds to a set number of outputs from the sigma-delta converter 208 depending on the sampling frequency. If a pixel 202 does not saturate, then the sigma-delta converter 208 will output the set number of samples and the digital signal processor (DSP) will calculate the correct output. In order to account for a pixel 202 that saturates, the output of the sigma-delta converter 208 is monitored and will stop sampling when pixel 202 saturation has been detected. The DSP will then calculate the line-of-best-fit knowing that it has received less values and correspondingly calculates the result.
The invention may be implemented using column level sigma-delta converters 308 having inputs connected to the analog column output lines 304 for pixels 302 with each column level sigma-delta converter 308 having a simple counter 309 associated with it, as shown in FIG. 3. The counter 309 receives the output of the sigma-delta converter 308 and increments every time it receives a zero output and resets every time it receives a logic one output. The counter 308 is set to count to a predetermined number which is representative of the number of consecutive zero outputs from the sigma-delta converter 308 that determines when saturation has occurred. Once this number of consecutive zeros has been realized the sigma-delta converter 308 stops sampling and the output is sent to the DSP minus the string of consecutive zeros. The DSP will then convert this data to a value representative of the brightness of the pixel 302 recognizing the fact that it has less than the usual number of samples. For example, suppose a typical number of samples for the integration period is 1000, while a typical setting for the counter is 10. If a pixel 302 in a column 304 is being read out and after 765 samples the counter has reached 10, (in other words, the last 10 outputs were zeros) then the pixel 302 is considered to have saturated. The sigma-delta converter 308 stops sampling and the first 755 samples are processed by the DSP. The last 10 samples are all zeros and are therefore dropped from the converter output.
There are a number of benefits that are created as a result of implementing this type of column level sigma-delta converter 308. The first and most important of which is that it compensates for the various problems associated with having a low supply voltage Vsupply. The method used to compensate for pixels 302 saturating also leads to additional benefits. With dark pixels 302, the sigma-delta converter 308 will simply read out the pixel 302 with the predetermined number of samples during the integration period resulting in excellent resolution. On the other hand, if the pixel 302 is exposed to bright light, the pixel 302 saturates and the sampling period is less, allowing the DSP to process and output the data faster. Also by accommodating for pixels 302 to saturate, this invention acts as an integrated auto-exposure feature.
Implementing a sigma-delta analog-to-digital converter 208 at the column level in this manner also leads to a number of further embodiments. The first embodiment is illustrated in FIG. 4 which includes the elements described with respect to FIG. 3 with the addition of a decimator 410 at the column level with each sigma-delta converter 408. The decimator 410 will take a number of the samples output by the sigma-delta converter 408 and condense them to a binary number of a predetermined bit length. For example, the decimator 410 might take every 50 samples from the sigma-delta converter 408 and turn them into a 10-bit binary number. The benefit of this system is that it eliminates the problem of bussing all of the samples to the DSP during the integration period. Instead only a certain number of decimated binary numbers will need to be output to the DSP. Another major benefit of having the decimator 410 is that the first level of processing the data is already done at the column level, in parallel, before it even reaches the DSP, resulting in faster processing.
In a further embodiment as illustrated in FIG. 5 which in addition to the elements described with respect to FIG. 4, includes a decimator counter 511, that is coupled between the first counter 509 and the decimator 510. The decimator counter 511 simply counts to the number of samples that the decimator 510 inputs before it provides a multi-bit binary number output. Each time the counter 511 reaches that value, the decimator 510 outputs a multi-bit binary number and then the counter 511 resets to zero. When the first counter 509 detects the predetermined number of consecutive zeros, the sigma-delta converter 508 stops sampling and the decimator counter 511 outputs its value to either the decimator 510 or the DSP. If the decimator counter 511 outputs its result directly to the decimator 510, the decimator 510 will calculate the last output taking into account that it does not have the usual number of samples. Therefore the saturation of the pixel 502 is reflected in the output of the decimator 510 and the DSP does not have to compensate for it. On the other hand, if the decimator counter 511 outputs to the DSP, then the DSP will receive the last output from the decimator 510 knowing that it has not accounted for the saturation of the pixel 502 and the DSP will correspondingly calculate the output. The added benefit of this embodiment is a more accurate determination of the pixel's 502 saturation point leading to more accurate resolution in bright pixels.
FIG. 6 illustrates an embodiment that includes a system for permitting columns to be read out faster. The imager includes a sigma-delta analog-to-digital converter 608 connected to analog column output line 604 for converting the output signals from pixels 602. Counter 609 is coupled to the converter 608 to detect saturated pixels 602. Normally, when a pixel 602 saturates the sigma-delta converter 608 stops sampling and waits until the next pixel 602 is selected to be read out. In a system as shown in FIG. 6, once pixel 602 saturation is detected by the counter 609, the sigma-delta converter 608 stops reading the current pixel 602 n and the next pixel 602 n+1 is automatically selected to be read out immediately. Having the counter 609 feed back to pixels 602 directly through line 611 can allow it to automatically select the next pixel 602 to be read out. This will result in bright columns being read out in a much faster manner.
FIG. 7 is a schematic of an imager 700 similar to the imager 200 illustrated in FIG. 2, wherein the reading out of rows of saturated pixels 702 may be accelerated. In this particular embodiment, each column converter 708 includes a counter 709 connected to the output of each converter 708. The counter 709 output is fed back to its respective converter 708, as well as to a comparison circuit 714 through line 713. Comparison circuit 714 compares the outputs of all the counters 709 in the columns 704. In the case where all the pixels 702 in a row 703 being read out at one time saturate, the comparison yields a positive result. This result is fed back through line 715 to the row enable circuitry 705 of the imager 700 and automatically selects the next row 703 of pixels 702 to be immediately read out. All of the sigma-delta converters 708 on the column level therefore begin reading out the next row 703 of pixels 702 sooner than in a normal situation where they must wait for the full integration period to pass. When the image is reasonably bright, the entire image can be read out at a faster rate in a uniform fashion. Also, using this method does not affect any of the features related to row selection such as windowing.
In FIGS. 8 and 9, imagers 800, 900 respectively are schematically illustrated wherein the imaging array 801, 901 column output lines 806, 906 are coupled to sigma- delta converters 808, 908. The outputs of the converters 808, 908 are coupled to counters 809, 909 and to decimators 810, 910. In these particular embodiments, the decimators 810, 910 outputs are coupled to one or more multiplexers 816, 916. As illustrated in FIG. 8, the multiplexer 816 is implemented along the column side of the imaging array 801 and consists of as many inputs as there are column lines 806, with one output 817 which is connected to the DSP. For example, suppose there are 1280 columns and the outputs from the decimators 810 are 10-bit binary numbers. The decimator output multiplexer 816 would then consist of 1280 10-bit inputs and one 10-bit output. The reason behind having this multiplexer 816 is that the DSP could be separated spatially from the imaging array 801 and the outputs 806 from the columns need to be bussed across the chip. By having the multiplexer 816 adjacent to the column directly connected to the outputs of the decimators 810 the apparatus would only need to bus one output 817, instead of 1280 outputs 806. A clock is used to sequentially scroll through all of the columns to transfer one decimator output to the DSP at a time. Other than reducing the number of electric lines needed to connect the array to the DSP, this embodiment is also beneficial in the sense that it is a fast and efficient way to read out the data.
Similarly, as shown in FIG. 9, multiple decimator output multiplexers 916 could be coupled to groups of decimators 910 with one output connection 917 from each of them bussed to the DSP. Each multiplexer 916 is of a smaller size than in the previous embodiment and is connected to a smaller section of the column lines 906. For example, using the array of 1280 columns mentioned previously, 64 decimator output multiplexers could be implemented, each with 20 10-bit inputs and one 10-bit output. The reasons behind using more than one multiplexer is to be able to have all the decimator 910 outputs transferred efficiently and easily to the DSP. The previous embodiment needs a very fast and accurate clock to be implemented, whereas this embodiment is not as demanding and precise, yet still reduces the number of electric lines 906 needed between the imaging array 901 and the DSP by a large factor.
While the invention has been described according to what is presently considered to be the most practical and preferred embodiments, it must be understood that the invention is not limited to the disclosed embodiments. Those ordinarily skilled in the art will understand that various modifications and equivalent structures and functions may be made without departing from the spirit and scope of the invention as defined in the claims. Therefore, the invention as defined in the claims must be accorded the broadest possible interpretation so as to encompass all such modifications and equivalent structures and functions.

Claims (44)

1. In an imager having an array of pixels in rows and columns with column lines for pixel output signals, a method of processing the pixel output signals comprising:
converting the pixel output signals on each column line to digital signals using a sigma-delta type analog-to-digital converter, the sigma-delta type converter outputting mainly logical ones for a high input signal level and outputting mainly zeros for a low input signal level;
feeding the digital signals to a digital signal processor; and
monitoring the sigma-delta type converter to stop sampling of a pixel when pixel saturation is detected,
wherein the monitoring step comprises, for each column:
at a first counter, counting consecutive zeros in the digital signals to a predetermined number, and
detecting the pixel saturation in response to counting to the predetermined number at the first counter.
2. A method of processing the pixel output signals as claimed in claim 1 further comprising:
sending the sigma-delta type converter output to the digital signal processor when the pixel saturation is detected.
3. A method of processing the pixel output signals as claimed in claim 1 further comprising:
reading the next pixel in a column when the previous pixel is saturated.
4. A method of processing the pixel output signals as claimed in claim 1 further comprising:
reading the next row of pixels when the pixels in the previous row are all saturated.
5. A method of processing the pixel output signals as claimed in claim 1 further comprising, for each column:
condensing sets of a predetermined number of sigma-delta type converter output samples in a decimator to binary numbers of predetermined bit length.
6. A method of processing the pixel output signals as claimed in claim 5 further comprising, for each column:
determining the number of sigma-delta type converter output samples and outputting the determined number when the value of the first counter reaches the predetermined number; and
feeding the determined number from the first counter to the decimator.
7. A method of processing the pixel output signals as claimed in claim 5 further comprising:
determining the number of sigma-delta type converter output samples and outputting the determined number when the value of the first counter reaches the predetermined number; and
feeding the determined number from the first counter to the digital signal processor.
8. A method of processing the pixel output signals as claimed in claim 5 further comprising:
multiplexing the outputs of the decimators to provide one or more inputs to the digital signal processor.
9. In an imager having an array of pixels in rows and columns with column lines for pixel output signals, apparatus for processing the pixel output signals comprising:
a sigma-delta type analog-to-digital converter for converting the pixel output signals on each column line to digital signals, the sigma-delta type converter outputting mainly logical ones for a high input signal level and outputting mainly zeros for a low input signal level;
means for feeding the digital signals to a digital signal processor;
means for detecting pixel saturation; and
means for stopping sampling of a pixel when the pixel saturation is detected,
wherein the detecting means comprises:
a first counter provided for each column for counting consecutive zeros in the digital signals to a predetermined number to determine when the pixel saturation has occurred.
10. Apparatus for processing the pixel output signals as claimed in claim 9 further comprising:
means for sending the sigma-delta type converter output to the digital signal processor when the pixel saturation is detected.
11. Apparatus for processing the pixel output signals as claimed in claim 9 further comprising:
a decimator provided for each column for condensing sets of a predetermined number of sigma-delta type converter output samples to binary numbers of predetermined bit length.
12. Apparatus for processing the pixel output signals as claimed in claim 11 further comprising:
means provided for each column for determining the number of sigma-delta type converter output samples and outputting the determined number when the value of the first counter reaches the predetermined number; and
means for feeding the determined number from the number determining means to the corresponding decimator.
13. Apparatus for processing the pixel output signals as claimed in claim 12 wherein the number determining means is a second counter, and wherein when the second counter outputs the determined number to the corresponding decimator, the corresponding decimator outputs the binary numbers and the second counter resets to zero.
14. Apparatus for processing the pixel output signals as claimed in claim 11 further comprising:
means provided for each column for determining the number of sigma-delta type converter output samples and outputting the determined number when the value of the first counter reaches the predetermined number; and
means for feeding the determined number from the number determining means to the digital signal processor.
15. Apparatus for processing the pixel output signals as claimed in claim 14, wherein the number determining means is a second counter, and wherein when the second counter outputs the determined number to the digital signal processor, the second counter resets to zero.
16. Apparatus for processing the pixel output signals as claimed in claim 11 further comprising:
means for multiplexing the outputs of the decimators to provide one or more inputs to the digital signal processor.
17. Apparatus for processing the pixel output signals as claimed in claim 16 wherein the multiplexing means comprises a multiplexer for providing one input line to the digital signal processor.
18. Apparatus for processing the pixel output signals as claimed in claim 16 wherein the multiplexing means comprises a number of multiplexers for providing a number of input lines to the digital signal processor.
19. Apparatus for processing the pixel output signals as claimed in claim 9 further comprising:
means for reading the next pixel in a column when the previous pixel is saturated.
20. Apparatus for processing the pixel output signals as claimed in claim 9 further comprising:
means for reading the next row of pixels when the value of the first counter reaches the predetermined number.
21. In an imager having an array of pixels in rows and columns with column lines for pixel output signals, a method comprising:
processing the pixel output signals on each column line using a sigma-delta type analog-to-digital converter, the sigma-delta type converter outputting digital signals comprising mainly logical ones for a high input signal level and comprising mainly zeros for a low input signal level; and
monitoring the sigma-delta type converter to stop sampling of a pixel in response to detecting pixel saturation;
wherein the monitoring step comprises, for each column:
at a first counter, counting consecutive zeros in the digital signals to a predetermined number; and
detecting pixel saturation in response to counting to the predetermined number at the first counter.
22. The method of claim 21 further comprising reading a next pixel in a column in response to detecting that a previous pixel is saturated.
23. The method of claims 21 further comprising reading a next row of pixels in response to detecting pixels of a previous row are saturated.
24. The method of claim 21 further comprising, for each column,
condensing sets of a predetermined number of sigma-delta type converter output samples in a decimator to binary numbers of predetermined bit length;
determining the number of sigma-delta type converter output samples and outputting the determined number when the value of the first counter reaches the predetermined number; and
feeding the determined number from the first counter to the decimator.
25. In an imager having an array of pixels in rows and columns with column lines for pixel output signals, an apparatus comprising:
a sigma-delta type analog-to-digital converter configured to convert the pixel output signals on each column line to digital signals, wherein the sigma-delta type converter outputs mainly logical ones for a high input signal level and outputs mainly zeros for a low input signal level;
means for detecting pixel saturation; and
means for stopping sampling of a pixel in response to detecting pixel saturation;
wherein the detecting means comprises a first counter provided for each column for counting consecutive zeros in the digital signals to a predetermined number to detect pixel saturation.
26. The apparatus of claim 25 further comprising a decimator provided for each column, wherein the decimator is configured to condense sets of a predetermined number of sigma-delta type converter output samples to binary numbers of predetermined bit length.
27. The apparatus of claim 26 further comprising:
means provided for each column for determining the number of sigma-delta type converter output samples and outputting the determined number when the value of the first counter reaches the predetermined number; and
means for feeding the determined number from the number determining means to the corresponding decimator.
28. The apparatus of claim 27 wherein the number determining means comprises a second counter, and wherein when the second counter outputs the determined number to the corresponding decimator, the corresponding decimator outputs the binary numbers and the second counter resets to zero.
29. An apparatus comprising:
a sigma-delta type analog-to-digital converter configured to convert pixel output signals to digital signals comprising mainly logical ones for a high input signal level and mainly zeros for a low input signal level, and to stop sampling a pixel in response to detected pixel saturation; and
a saturation counter configured to count consecutive zeros in the digital signals and to detect pixel saturation in response to obtaining a predetermined count associated with pixel saturation.
30. The apparatus of claim 29 further comprising:
a digital signal processor configured to determine pixel values based upon output signals; and
output circuitry configured to receive the digital signals and to provide output signals to the digital signal processor.
31. The apparatus of claim 29 further comprising:
a digital signal processor configured to determine pixel values based upon binary numbers of a predetermined bit length; and
output circuitry configured to receive the digital signals and to provide output signals comprising binary numbers of the predetermined bit length to the digital signal processor, the output circuitry comprising one or more decimators configured to condense sets of a predetermined number of sigma-delta type converter output samples of the digital signals to binary numbers of the predetermined bit length.
32. The apparatus of claim 31 wherein the output circuitry further comprises one or more decimator counters configured to feed the one or more decimators with the predetermined number of sigma-delta type converter output samples in response to the saturation counter reaching the predetermined count.
33. The apparatus of claim 32, wherein the output circuitry further comprises one or more multiplexers configured to receive the binary numbers of the predetermined length from the one or more decimators and to provide to the digital signal processor with the binary numbers of the predetermined length.
34. The apparatus of claim 29 further comprising
a digital signal processor configured to determine pixel values based upon a predetermined number of sigma-delta type output samples of the digital signals; and
output circuitry configured to provide the predetermined number of sigma-delta type output samples to the digital signal processor, the output circuitry comprising one or more decimator counters configured to feed the digital signal processor with the predetermined number of sigma-delta type output samples in response to the saturation counter reaching the predetermined count.
35. The apparatus of claim 34, wherein the output circuitry further comprises one or more multiplexers configured to receive the predetermined number of sigma-delta type output samples and to provide the predetermined number of sigma-delta type output samples to the digital signal processor.
36. The apparatus of claim 29, wherein in response to detecting pixel saturation, the saturation counter provides a feedback that results in the sigma-delta type analog-to-digital converter reading a next pixel in a column of pixels.
37. The apparatus of claim 29, further comprising
a plurality of sigma-delta type analog-to-digital converters, each sigma-delta type analog-to-digital converter configured to convert pixel output signals for a column of pixels to digital signals comprising mainly logical ones for a high input signal level and mainly zeros for a low input signal level, and to stop sampling a pixel in response to detected pixel saturation;
a plurality of saturation counters, each saturation counter configured to count consecutive zeros in the digital signals and to detect pixel saturation in response to reaching the predetermined count associated with pixel saturation;
row enable circuitry to select a next row of pixels for reading by the plurality of sigma-delta type analog-to-digital converters in response to a result that indicates that each of the plurality of saturation counters detected pixel saturation; and
a comparator to receive outputs from each of the plurality of saturation counters and to provide the row enable circuitry with the result in response to determining based upon the received outputs that each of the plurality of saturation counters detected pixel saturation.
38. An apparatus comprising:
an array of pixels in rows and columns;
a plurality of column lines to carry pixel output signals;
one or more sigma-delta type analog-to-digital converters, each of the one more sigma-delta analog-to-digital converters configured to convert pixel output signals to digital signals comprising mainly logical ones for a high input signal level and mainly zeros for a low input signal level, and to stop converting pixel output signals of a pixel in response to detected saturation of the pixel;
column output circuitry configured to receive the digital signals and to feed output signals to a digital signal processor; and
a plurality of saturation counters configured to detect pixel saturation, each saturation counter configured to count consecutive zeros in the digital signals of a corresponding column line, and to detect saturation in response to reaching a predetermined count.
39. The apparatus of claim 38 further comprising a digital signal processor configured to determine pixel values based upon the output signals of the column output circuitry.
40. The apparatus of claim 39 further comprising a digital signal processor configured to determine pixel values based upon binary numbers of a predetermined bit length, wherein the column output circuitry is configured to provide output signals comprising binary numbers of the predetermined bit length to the digital signal processor, the column output circuitry comprising a plurality of decimators configured to condense sets of a predetermined number of sigma-delta type converter output samples of the digital signals to binary numbers of the predetermined bit length.
41. The apparatus of claim 40 wherein the column output circuitry further comprises a plurality decimation counters configured to feed a corresponding decimator of the plurality of decimators with the predetermined number of sigma-delta type converter output samples in response to corresponding saturation counters reaching the predetermined number.
42. The apparatus of claim 41, wherein the column output circuitry further comprises a multiplexer configured to receive outputs from the plurality of decimators and to provide the outputs of the plurality of decimators to the digital signal processor.
43. The apparatus of claim 39, wherein in response to detecting pixel saturation, a saturation counter of the plurality of saturation counters provides a feedback that results in a corresponding sigma-delta type analog-to-digital converter reading a next pixel in a column of pixels.
44. The apparatus of claim 39, further comprising
row enable circuitry configured to select a next row of pixels for reading by the plurality of sigma-delta type analog-to-digital converters in response to a result that indicates that each of the plurality of saturation counters detected pixel saturation; and
a comparator configured to receive outputs from each of the plurality of saturation counters and to provide the row enable circuitry with the result in response to determining based upon the received outputs that each of the plurality of saturation counters detected pixel saturation.
US12/717,188 2000-12-19 2001-12-13 Imager output signal processing Expired - Lifetime USRE42739E1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US12/717,188 USRE42739E1 (en) 2000-12-19 2001-12-13 Imager output signal processing

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US25633600P 2000-12-19 2000-12-19
US12/717,188 USRE42739E1 (en) 2000-12-19 2001-12-13 Imager output signal processing
PCT/CA2001/001773 WO2002051128A2 (en) 2000-12-19 2001-12-13 A converter in a cmos image sensor

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US10/451,026 Reissue US7339621B2 (en) 2001-12-13 2001-12-13 Imager output signal processing

Publications (1)

Publication Number Publication Date
USRE42739E1 true USRE42739E1 (en) 2011-09-27

Family

ID=22971865

Family Applications (1)

Application Number Title Priority Date Filing Date
US12/717,188 Expired - Lifetime USRE42739E1 (en) 2000-12-19 2001-12-13 Imager output signal processing

Country Status (3)

Country Link
US (1) USRE42739E1 (en)
AU (1) AU2002216854A1 (en)
WO (1) WO2002051128A2 (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110291865A1 (en) * 2010-06-01 2011-12-01 Han Henry Sun Method, system, and apparatus for interpolating an output of an analog-to-digital converter
US20130070132A1 (en) * 2011-09-20 2013-03-21 Mesa Imaging Ag Time of Flight Sensor with Subframe Compression and Method
US9175957B2 (en) * 2012-09-24 2015-11-03 Alces Technology, Inc. Grayscale patterns from binary spatial light modulators
US20210368115A1 (en) * 2020-05-14 2021-11-25 Board Of Trustees Of Michigan State University Sigma delta quantization for images

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7483067B2 (en) * 2005-04-15 2009-01-27 Micron Technology, Inc. Column-parallel sigma-delta analog-to-digital conversion for imagers

Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5134487A (en) * 1989-11-06 1992-07-28 Canon Kabushiki Kaisha Using common circuitry for different signals
US5248971A (en) * 1992-05-19 1993-09-28 Mandl William J Method and apparatus for multiplexed oversampled analog to digital modulation
US5264940A (en) * 1990-10-08 1993-11-23 Olympus Optical Co., Ltd. Image sensing apparatus having exposure level and dynamic range control circuit
US5461425A (en) * 1994-02-15 1995-10-24 Stanford University CMOS image sensor with pixel level A/D conversion
US5886659A (en) * 1996-08-21 1999-03-23 California Institute Of Technology On-focal-plane analog-to-digital conversion for current-mode imaging devices
EP0912043A2 (en) 1997-10-27 1999-04-28 Texas Instruments Incorporated Improvements in or relating to image sensing devices
US5955899A (en) * 1997-01-27 1999-09-21 Intel Corporation Compact comparator
US6104844A (en) * 1997-04-11 2000-08-15 Siemens Aktiengesellschaft Image sensor having a multiplicity of pixel sensor regions
US6353324B1 (en) * 1998-11-06 2002-03-05 Bridge Semiconductor Corporation Electronic circuit
US6473122B1 (en) * 1999-12-06 2002-10-29 Hemanth G. Kanekal Method and apparatus to capture high resolution images using low resolution sensors and optical spatial image sampling
US6606120B1 (en) * 1998-04-24 2003-08-12 Foveon, Inc. Multiple storage node full color active pixel sensors
US6665013B1 (en) * 1994-01-28 2003-12-16 California Institute Of Technology Active pixel sensor having intra-pixel charge transfer with analog-to-digital converter
US6678039B2 (en) * 2001-05-23 2004-01-13 Canesta, Inc. Method and system to enhance dynamic range conversion useable with CMOS three-dimensional imaging
US6765619B1 (en) * 2000-04-04 2004-07-20 Pixim, Inc. Method and apparatus for optimizing exposure time in image acquisitions
US6831684B1 (en) * 2000-05-09 2004-12-14 Pixim, Inc. Circuit and method for pixel rearrangement in a digital pixel sensor readout
US7339621B2 (en) * 2001-12-13 2008-03-04 Psion Teklogix Systems, Inc. Imager output signal processing

Patent Citations (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5134487A (en) * 1989-11-06 1992-07-28 Canon Kabushiki Kaisha Using common circuitry for different signals
US5264940A (en) * 1990-10-08 1993-11-23 Olympus Optical Co., Ltd. Image sensing apparatus having exposure level and dynamic range control circuit
US5248971A (en) * 1992-05-19 1993-09-28 Mandl William J Method and apparatus for multiplexed oversampled analog to digital modulation
US6665013B1 (en) * 1994-01-28 2003-12-16 California Institute Of Technology Active pixel sensor having intra-pixel charge transfer with analog-to-digital converter
US5461425A (en) * 1994-02-15 1995-10-24 Stanford University CMOS image sensor with pixel level A/D conversion
US5886659A (en) * 1996-08-21 1999-03-23 California Institute Of Technology On-focal-plane analog-to-digital conversion for current-mode imaging devices
US5955899A (en) * 1997-01-27 1999-09-21 Intel Corporation Compact comparator
US6104844A (en) * 1997-04-11 2000-08-15 Siemens Aktiengesellschaft Image sensor having a multiplicity of pixel sensor regions
EP0912043A2 (en) 1997-10-27 1999-04-28 Texas Instruments Incorporated Improvements in or relating to image sensing devices
US6606120B1 (en) * 1998-04-24 2003-08-12 Foveon, Inc. Multiple storage node full color active pixel sensors
US6353324B1 (en) * 1998-11-06 2002-03-05 Bridge Semiconductor Corporation Electronic circuit
US6473122B1 (en) * 1999-12-06 2002-10-29 Hemanth G. Kanekal Method and apparatus to capture high resolution images using low resolution sensors and optical spatial image sampling
US6765619B1 (en) * 2000-04-04 2004-07-20 Pixim, Inc. Method and apparatus for optimizing exposure time in image acquisitions
US6831684B1 (en) * 2000-05-09 2004-12-14 Pixim, Inc. Circuit and method for pixel rearrangement in a digital pixel sensor readout
US6678039B2 (en) * 2001-05-23 2004-01-13 Canesta, Inc. Method and system to enhance dynamic range conversion useable with CMOS three-dimensional imaging
US7339621B2 (en) * 2001-12-13 2008-03-04 Psion Teklogix Systems, Inc. Imager output signal processing

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110291865A1 (en) * 2010-06-01 2011-12-01 Han Henry Sun Method, system, and apparatus for interpolating an output of an analog-to-digital converter
US8477056B2 (en) * 2010-06-01 2013-07-02 Infinera Corporation Method, system, and apparatus for interpolating an output of an analog-to-digital converter
US20130070132A1 (en) * 2011-09-20 2013-03-21 Mesa Imaging Ag Time of Flight Sensor with Subframe Compression and Method
US9140795B2 (en) * 2011-09-20 2015-09-22 Mesa Imaging Ag Time of flight sensor with subframe compression and method
US9175957B2 (en) * 2012-09-24 2015-11-03 Alces Technology, Inc. Grayscale patterns from binary spatial light modulators
US9316826B2 (en) 2012-09-24 2016-04-19 Alces Technology, Inc. Grayscale patterns from binary spatial light modulators
US20210368115A1 (en) * 2020-05-14 2021-11-25 Board Of Trustees Of Michigan State University Sigma delta quantization for images
US11818479B2 (en) * 2020-05-14 2023-11-14 Board Of Trustees Of Michigan State University Sigma Delta quantization for images

Also Published As

Publication number Publication date
AU2002216854A1 (en) 2002-07-01
WO2002051128A3 (en) 2002-09-12
WO2002051128A2 (en) 2002-06-27

Similar Documents

Publication Publication Date Title
US7339621B2 (en) Imager output signal processing
TWI377838B (en) Solid-state imaging device, method of driving the same, and camera
US20100264296A1 (en) Mixed analog and digital pixel for high dynamic range readout
US8803064B2 (en) Signal processing device, including charge injection circuit, and photodetection device
US8587688B2 (en) Solid-state image pickup device and signal processing method therefor
EP1233613B1 (en) Active pixel image sensor with high dynamic range
EP2060005B1 (en) Single slope analog-to-digital converter
US6831689B2 (en) Optical imager using a method for adaptive real-time expanding of the dynamic range
US8035541B2 (en) Digital-analog converter circuit, solid-state imaging device, and imaging apparatus
US9191026B2 (en) Image sensor and imaging method with single shot compressed sensing
US20080218614A1 (en) Dynamic range enhancement scheme for imagers
KR102538220B1 (en) Image sensing system and operating method of the same
EP2014084B1 (en) Cmos image sensor pixel using a photodiode
US7978115B2 (en) System and method for analog-to-digital conversion
WO2007097918A1 (en) A/d converter using ramped transfer gate clocks
USRE42739E1 (en) Imager output signal processing
Kwon et al. A novel double slope analog-to-digital converter for a high-quality 640/spl times/480 CMOS imaging system
Snoeij et al. Power and area efficient column-parallel ADC architectures for CMOS image sensors
KR101031591B1 (en) High speed and large scale photon counting x-ray dynamic image sensor, x-ray dynamic imaging apparatus and method thereof
EP2037675B1 (en) Sensor apparatus
US20050110886A1 (en) Solid state image pickup device
US11134208B1 (en) Increasing dynamic range of digital pixels by utilizing polling during integration
CN115426461A (en) Pixel unit, pixel array and image sensor
RU2199191C2 (en) Television camera
KR20130095016A (en) Fast readout ic architecture for x-ray image sensor

Legal Events

Date Code Title Description
AS Assignment

Owner name: HARUSAKI TECHNOLOGIES, LLC, DELAWARE

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:PSION TEKLOGIX SYSTEMS INC.;REEL/FRAME:025654/0826

Effective date: 20070917

AS Assignment

Owner name: HARUSAKI TECHNOLOGIES, LLC, DELAWARE

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ADDRESS OF THE ASSIGNEE, PREVIOUSLY RECORDED ON REEL 025654 FRAME 0826. ASSIGNOR(S) HEREBY CONFIRMS THE ASSIGNMENT;ASSIGNOR:PSION TEKLOGIX SYSTEMS INC.;REEL/FRAME:026074/0126

Effective date: 20070917

CC Certificate of correction
FPAY Fee payment

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12