EP1641249A1 - Improvements in or relating to image sensors - Google Patents
Improvements in or relating to image sensors Download PDFInfo
- Publication number
- EP1641249A1 EP1641249A1 EP04255878A EP04255878A EP1641249A1 EP 1641249 A1 EP1641249 A1 EP 1641249A1 EP 04255878 A EP04255878 A EP 04255878A EP 04255878 A EP04255878 A EP 04255878A EP 1641249 A1 EP1641249 A1 EP 1641249A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- pixels
- pixel array
- integration
- row
- sets
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
- 238000000034 method Methods 0.000 claims abstract description 31
- 230000010354 integration Effects 0.000 claims description 32
- 230000005855 radiation Effects 0.000 claims description 8
- 238000005096 rolling process Methods 0.000 abstract description 9
- 230000008569 process Effects 0.000 abstract description 7
- 230000004044 response Effects 0.000 description 3
- 238000003491 array Methods 0.000 description 2
- 230000003287 optical effect Effects 0.000 description 2
- 238000004364 calculation method Methods 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 230000001419 dependent effect Effects 0.000 description 1
- 238000007687 exposure technique Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 238000005070 sampling Methods 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 238000010561 standard procedure Methods 0.000 description 1
- 230000007704 transition Effects 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/587—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields
- H04N25/589—Control of the dynamic range involving two or more exposures acquired sequentially, e.g. using the combination of odd and even image fields with different integration times, e.g. short and long exposures
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/60—Control of cameras or camera modules
- H04N23/667—Camera operation mode switching, e.g. between still and video, sport and normal or high- and low-resolution modes
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/42—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by switching between different modes of operation using different resolutions or aspect ratios, e.g. switching between interlaced and non-interlaced mode
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/40—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled
- H04N25/44—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array
- H04N25/441—Extracting pixel data from image sensors by controlling scanning circuits, e.g. by modifying the number of pixels sampled or to be sampled by partially reading an SSIS array by reading contiguous pixels from selected rows or columns of the array, e.g. interlaced scanning
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/53—Control of the integration time
- H04N25/531—Control of the integration time by controlling rolling shutters in CMOS SSIS
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/50—Control of the SSIS exposure
- H04N25/57—Control of the dynamic range
- H04N25/58—Control of the dynamic range involving two or more exposures
- H04N25/581—Control of the dynamic range involving two or more exposures acquired simultaneously
- H04N25/583—Control of the dynamic range involving two or more exposures acquired simultaneously with different integration times
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N3/00—Scanning details of television systems; Combination thereof with generation of supply voltages
- H04N3/10—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical
- H04N3/14—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical by means of electrically scanned solid-state devices
- H04N3/15—Scanning details of television systems; Combination thereof with generation of supply voltages by means not exclusively optical-mechanical by means of electrically scanned solid-state devices for picture signal generation
- H04N3/155—Control of the image-sensor operation, e.g. image processing within the image-sensor
Definitions
- the present invention relates to improvements in or relating to image sensors, in particular to new rolling blade exposure techniques to extend dynamic range in CMOS image sensors.
- a solid state image sensor such as a CMOS image sensor, comprises an array of pixels. Light is incident on these pixels for an integration time, and the resulting charge is converted to a voltage before being read out.
- the readout process includes converting the analogue voltage to a digital value and then processing the collected digital values in order to construct an image.
- pixel arrays comprise a large number of pixels, it is common to read out selected subsets of pixels, for example, a row, at a time.
- FIG. 1 shows a typical "rolling blade" exposure system implemented in a CMOS image sensor.
- a pixel array 10 comprises a number of rows of pixels.
- a first row of pixels is put into integration at time t(n-h) and is read out at time t(n) where h is a number of lines of exposure.
- Integration wavefront 12 and read wavefront 14 advance at a constant line rate, dependent on the desired frame rate and number of rows in the image.
- the integration wavefront 12 is the operation of releasing all pixels from reset, starting integration of incident light.
- the exposure time h is generally adjusted as a function of the amount of light in the scene in order to maintain the mean pixel value in the centre of the output range.
- Such an exposure scheme provides a linear representation of the light level in the scene, provided that the output of the pixel and readout circuitry is also linear.
- Typical CMOS pixels such as passive, active or pinned photodiode pixels all provide a linear conversion of input photons to output voltage.
- the number of gathered photons is directly related to the length of exposure time.
- a linear readout chain and analogue to digital converter is usually employed to convert the pixel output voltage to digital image codes.
- the intra-scene dynamic range of such an imaging system is defined as the ratio of the largest light level to the smallest light level that can be represented in a single image.
- an image will contain very bright objects within a darker scene, a typical example being a scene outside a window viewed from within a darker room.
- An exposure algorithm is employed which adjusts the image mean to be some compromise between the darker and lighter areas.
- neither of these extremes can be fully represented within the code range of a linear image (typically 10-bits, or 60dB). This results in clipping of the brightest areas of an image to the maximum code level (typically 1023 in a 10-bit image). Detail in these clipped areas is lost.
- a pixel with a nonlinear response can be utilised to extend the intra-scene dynamic range.
- Such pixels have a compressive response from light photons to output volts, often using the logarithmic response of a MOS transistor in weak inversion.
- FPN fixed pattern noise
- Another technique used to obtain extended dynamic range is to combine images obtained with different exposures, as disclosed for example in US 6,115,065 assigned to California Institute of Technology. Clipped areas in the longer exposure image are replaced by detail from the shorter exposure image.
- a method of sensing an image using an image sensor which comprises a pixel array comprising the steps of:
- the method further comprises the step of exposing at least one further set of pixels to radiation for a further integration time different from said first, second and any other further integration times; obtaining a further data set from each further set of pixels; combining said first, second and further data sets to form a single output data set, and repeating the above steps for different first, second and further sets until a plurality of output data sets has been collected, representing data obtained from every region of the pixel array.
- the steps of exposing each set of pixels to radiation are carried out at least partially simultaneously.
- the pixel array comprises one group of pixels dedicated for use as each of the sets of pixels.
- the groups are interleaved.
- each set of pixels comprises a row of the pixel array.
- each set of pixels comprises a subset of a row of the pixel array.
- the subset comprises every other pixel in the row.
- each set of pixels comprises two rows of the array.
- the greater of the first and second integration times is an integer multiple of the lesser of the first and second integration times.
- the lesser of the first and second integration times is a fraction of the time taken to read out one row of pixels.
- the step of combining the data sets to form a single output data set comprises stitching the data sets together to ameliorate the dynamic range of the output data set when compared to any one of the other data sets.
- the output data set and each other data set are all the same size.
- an image sensor comprising a pixel array and control circuitry adapted to carry out the method of the first aspect.
- CMOS image sensor according to the second aspect is provided.
- a digital camera comprising an image sensor comprising a pixel array and control circuitry adapted to carry out the method of any of the first aspect is provided, and in further aspects, a mobile telephone or a webcam comprising the digital camera can be provided.
- the scheme shown in Fig. 2 is a means of obtaining extended dynamic range from an image at the expense of lower spatial resolution.
- a first integration wavefront 16 and a second integration wavefront 18 operate in a rolling blade fashion. Odd lines of the image have a first exposure h1, i.e. there are h1 rows between the first integration wavefront 16 and its corresponding read wavefront 20 and even lines have a second exposure h2, i.e. there are h2 rows between the second integration wavefront 18 and its corresponding read wavefront 22.
- One exposure here, h1 is shorter than the other.
- This illustrated embodiment can also make use of the concept of fine exposure, whereby the short exposure h1 can be adjusted as a fraction of a line time rather than in integer multiples.
- the integration wavefront occurs within the previous line being read out.
- the integration point can be adjusted by single clock periods. A large ratio is then possible between minimum fine exposure and maximum exposure. This can be one clock period to the number of clocks in a full image (easily as much as 1:1,000,000). This imposes an upper limit for the factor k which can be used to extend the image dynamic range.
- the short and long exposure images are read out consecutively from odd and even rows.
- the short exposure must be kept in a line memory for a line time before being stitched together with the next long exposure line to produce a single output line.
- the present invention just takes one picture, in which each line is stitched to maximise dynamic range. This means that no extra frame memory is required, and also eliminates the distortion that would come from taking two separate pictures at different times.
- the scheme could be implemented when a camera is in a viewfinder mode where image accuracy is not as important, or for an application where a high resolution is not critical, such as a live video display on a small screen in a high resolution imager.
- only a selection of pixels from each row are selected, either by subsampling or decimation. For example, every second pixel could be selected from each row. This is done in order to maintain the aspect ratio, but results in a resolution which is 1/4 of that obtained with the standard technique of Fig. 1. However, as discussed above, there are some situations where such a low resolution is acceptable.
- the invention is applied to a Bayer colour image.
- the long and short exposures are applied to line pairs rather than single lines in order to preserve colour sampling properties.
- the embodiment illustrated in Fig. 2 comprises two integration and read wavefronts. However, further integration and read wavefronts could be provided. This would further reduce resolution as compared to having two integration and read wavefronts, but the increased dynamic range would be desireable in some situations and pixel arrays.
- Fig. 3 This method does not compromise resolution but reduces the maximum frame rate by half. Firstly, a row of green/blue pixels is read out at long exposure (Fig. 3(1)). Next, the same green/blue row is put back into integration at a fine exposure level while the row of red/green pixels is being read (Fig. 3(2)).
- the fine exposed row of green/blue pixels is read out while the row of red/green pixels is put back into integration (Fig. 3(3)), and finally the fine exposed row of red/green pixels is read out (Fig. 3(4)). This process is repeated for the next colour line pair, until the whole array has been processed.
- the long exposure data is stored in a line memory before stitching with the short exposure data. This scheme works where the short exposure is constrained to be less than a line time.
- Fig. 4 illustrates a stitching process, which is applicable to any of the above embodiments.
- the image sensor of the present invention can be incorporated into a number of different products, including but not limited to a digital camera, an optical mouse, mobile telephone or webcam incorporating the digital camera, or other more specialised imagers used in diverse fields.
- a digital camera an optical mouse
- mobile telephone or webcam incorporating the digital camera
- other more specialised imagers used in diverse fields.
- the man skilled in the art will appreciate that the practical matter of implementing the invention in any of these or other devices is straightforward, and thus will not be described herein in more detail.
Landscapes
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Transforming Light Signals Into Electric Signals (AREA)
- Studio Devices (AREA)
Abstract
Description
- The present invention relates to improvements in or relating to image sensors, in particular to new rolling blade exposure techniques to extend dynamic range in CMOS image sensors.
- A solid state image sensor, such as a CMOS image sensor, comprises an array of pixels. Light is incident on these pixels for an integration time, and the resulting charge is converted to a voltage before being read out. The readout process includes converting the analogue voltage to a digital value and then processing the collected digital values in order to construct an image. As pixel arrays comprise a large number of pixels, it is common to read out selected subsets of pixels, for example, a row, at a time.
- Fig. 1 shows a typical "rolling blade" exposure system implemented in a CMOS image sensor. A
pixel array 10 comprises a number of rows of pixels. A first row of pixels is put into integration at time t(n-h) and is read out at time t(n) where h is a number of lines of exposure. -
Integration wavefront 12 and readwavefront 14 advance at a constant line rate, dependent on the desired frame rate and number of rows in the image. Aread wavefront 14 is the operation of reading all exposed pixels on a given row i at time t(n). A certain time dt is required to read the pixel row out before the next row i+1 can be read at time (t+dt). When i reaches the maximum number of lines in the image it is reset to i=O and recommences.
Theintegration wavefront 12 is the operation of releasing all pixels from reset, starting integration of incident light. - When the row number n increments to reach the maximum number of rows in the array, it moves back to the beginning n=0 and recommences. The wavefronts roll round the pixel array at a certain exposure spacing, hence the term "rolling blade". The exposure time h is generally adjusted as a function of the amount of light in the scene in order to maintain the mean pixel value in the centre of the output range.
- Such an exposure scheme provides a linear representation of the light level in the scene, provided that the output of the pixel and readout circuitry is also linear. Typical CMOS pixels such as passive, active or pinned photodiode pixels all provide a linear conversion of input photons to output voltage.
- The number of gathered photons is directly related to the length of exposure time. A linear readout chain and analogue to digital converter is usually employed to convert the pixel output voltage to digital image codes.
- The intra-scene dynamic range of such an imaging system is defined as the ratio of the largest light level to the smallest light level that can be represented in a single image. Often, an image will contain very bright objects within a darker scene, a typical example being a scene outside a window viewed from within a darker room. An exposure algorithm is employed which adjusts the image mean to be some compromise between the darker and lighter areas. However, neither of these extremes can be fully represented within the code range of a linear image (typically 10-bits, or 60dB). This results in clipping of the brightest areas of an image to the maximum code level (typically 1023 in a 10-bit image). Detail in these clipped areas is lost.
- A pixel with a nonlinear response can be utilised to extend the intra-scene dynamic range. Such pixels have a compressive response from light photons to output volts, often using the logarithmic response of a MOS transistor in weak inversion. However, they suffer from high fixed pattern noise (FPN) and other operational noise levels and increased system complexity for calibration purposes.
- Another technique used to obtain extended dynamic range is to combine images obtained with different exposures, as disclosed for example in US 6,115,065 assigned to California Institute of Technology. Clipped areas in the longer exposure image are replaced by detail from the shorter exposure image.
- However, such techniques require a frame memory which is an expensive overhead in a hardware implementation, and the images are also separated in time by a frame time, which introduces motion distortion.
- It would be desirable to find a way of increasing the intra-scene dynamic range of an image sensor that would reduce or eliminate one or more of these disadvantages.
- According to a first aspect of the present invention, there is provided a method of sensing an image using an image sensor which comprises a pixel array, the method comprising the steps of:
- exposing a first set of pixels to radiation for a first integration time;
- exposing a second set of pixels to radiation for a second integration time different from said first integration time;
- obtaining a first data set from the first set of pixels;
- obtaining a second data set from the second set of pixels;
- combining said first and second data sets to form a single output data set; and
- repeating the above steps for different first and second sets until a plurality of output data sets are obtained, representing data from every region of the pixel array.
- Preferably, the method further comprises the step of exposing at least one further set of pixels to radiation for a further integration time different from said first, second and any other further integration times;
obtaining a further data set from each further set of pixels;
combining said first, second and further data sets to form a single output data set, and
repeating the above steps for different first, second and further sets until a plurality of output data sets has been collected, representing data obtained from every region of the pixel array. - Preferably, the steps of exposing each set of pixels to radiation are carried out at least partially simultaneously.
- Preferably, the pixel array comprises one group of pixels dedicated for use as each of the sets of pixels.
- Preferably, the groups are interleaved.
- Preferably, each set of pixels comprises a row of the pixel array.
- Preferably, each set of pixels comprises a subset of a row of the pixel array.
- Preferably, the subset comprises every other pixel in the row.
- Preferably, each set of pixels comprises two rows of the array.
- Preferably, the greater of the first and second integration times is an integer multiple of the lesser of the first and second integration times.
- Preferably, the lesser of the first and second integration times is a fraction of the time taken to read out one row of pixels.
- Preferably, the step of combining the data sets to form a single output data set comprises stitching the data sets together to ameliorate the dynamic range of the output data set when compared to any one of the other data sets.
- Preferably, the output data set and each other data set are all the same size.
- According to a second aspect of the invention, there is provided an image sensor comprising a pixel array and control circuitry adapted to carry out the method of the first aspect.
- From a third aspect, a CMOS image sensor according to the second aspect is provided. From a fourth aspect, a digital camera comprising an image sensor comprising a pixel array and control circuitry adapted to carry out the method of any of the first aspect is provided, and in further aspects, a mobile telephone or a webcam comprising the digital camera can be provided.
- The present invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
- Fig. 1 shows a prior art rolling blade exposure system;
- Fig. 2 shows a rolling blade exposure system according to a first embodiment of the invention;
- Fig. 3 shows a stitching process for combining data obtained from short and long exposure times according to the system shown in Fig. 2; and
- Fig. 4 shows a rolling blade exposure system according to a second embodiment of the invention.
- The scheme shown in Fig. 2 is a means of obtaining extended dynamic range from an image at the expense of lower spatial resolution. A
first integration wavefront 16 and asecond integration wavefront 18 operate in a rolling blade fashion. Odd lines of the image have a first exposure h1, i.e. there are h1 rows between thefirst integration wavefront 16 and itscorresponding read wavefront 20 and even lines have a second exposure h2, i.e. there are h2 rows between thesecond integration wavefront 18 and itscorresponding read wavefront 22. One exposure (here, h1) is shorter than the other. The ratio between the long and short exposure can be fixed, i.e. h2=khl. - This illustrated embodiment can also make use of the concept of fine exposure, whereby the short exposure h1 can be adjusted as a fraction of a line time rather than in integer multiples. Thus the integration wavefront occurs within the previous line being read out. The integration point can be adjusted by single clock periods. A large ratio is then possible between minimum fine exposure and maximum exposure. This can be one clock period to the number of clocks in a full image (easily as much as 1:1,000,000). This imposes an upper limit for the factor k which can be used to extend the image dynamic range.
- The short and long exposure images are read out consecutively from odd and even rows. The short exposure must be kept in a line memory for a line time before being stitched together with the next long exposure line to produce a single output line.
- Instead of taking two pictures, each of which has a different exposure time, and then stitching those pictures together, the present invention just takes one picture, in which each line is stitched to maximise dynamic range. This means that no extra frame memory is required, and also eliminates the distortion that would come from taking two separate pictures at different times.
- When compared to a standard optical rolling blade, there is a loss of 1/2 vertical resolution involved in this process. However, this may be acceptable in some situations. For example, the scheme could be implemented when a camera is in a viewfinder mode where image accuracy is not as important, or for an application where a high resolution is not critical, such as a live video display on a small screen in a high resolution imager.
- In another embodiment of the invention, only a selection of pixels from each row are selected, either by subsampling or decimation. For example, every second pixel could be selected from each row. This is done in order to maintain the aspect ratio, but results in a resolution which is 1/4 of that obtained with the standard technique of Fig. 1. However, as discussed above, there are some situations where such a low resolution is acceptable.
- In a further embodiment, the invention is applied to a Bayer colour image. The long and short exposures are applied to line pairs rather than single lines in order to preserve colour sampling properties.
- The embodiment illustrated in Fig. 2 comprises two integration and read wavefronts. However, further integration and read wavefronts could be provided. This would further reduce resolution as compared to having two integration and read wavefronts, but the increased dynamic range would be desireable in some situations and pixel arrays.
- Yet a further embodiment of the invention is shown in Fig. 3. This method does not compromise resolution but reduces the maximum frame rate by half. Firstly, a row of green/blue pixels is read out at long exposure (Fig. 3(1)). Next, the same green/blue row is put back into integration at a fine exposure level while the row of red/green pixels is being read (Fig. 3(2)).
- The fine exposed row of green/blue pixels is read out while the row of red/green pixels is put back into integration (Fig. 3(3)), and finally the fine exposed row of red/green pixels is read out (Fig. 3(4)). This process is repeated for the next colour line pair, until the whole array has been processed. The long exposure data is stored in a line memory before stitching with the short exposure data. This scheme works where the short exposure is constrained to be less than a line time.
- Fig. 4 illustrates a stitching process, which is applicable to any of the above embodiments. The stitching process may be a simple algorithm of the following type: if (long exposure pixel (i) > threshold T) then output(i)= (short exposure pixel(i)-T/k+T). Other more sophisticated calculations may be employed to smooth the transition from short to long exposure areas of the scene. Note that if neither short or long exposure line is saturated then the information from the short exposure may be used in order not to decrease resolution.
- Improvements and modifications may be made to the above without departing from the scope of the present invention.
- It will also be appreciated that the image sensor of the present invention can be incorporated into a number of different products, including but not limited to a digital camera, an optical mouse, mobile telephone or webcam incorporating the digital camera, or other more specialised imagers used in diverse fields. The man skilled in the art will appreciate that the practical matter of implementing the invention in any of these or other devices is straightforward, and thus will not be described herein in more detail.
Claims (18)
- A method of sensing an image using an image sensor which comprises a pixel array, the method comprising the steps of:exposing a first set of pixels to radiation for a first integration time;exposing a second set of pixels to radiation for a second integration time different from said first integration time;obtaining a first data set from the first set of pixels;obtaining a second data set from the second set of pixels;combining said first and second data sets to form a single output data set; andrepeating the above steps for different first and second sets until a plurality of output data sets are obtained, representing data from every region of the pixel array.
- The method of claim 1, further comprising the step of exposing at least one further set of pixels to radiation for a further integration time different from said first, second and any other further integration times;
obtaining a further data set from each further set of pixels;
combining said first, second and further data sets to form a single output data set, and
repeating the above steps for different first, second and further sets until a plurality of output data sets has been collected, representing data obtained from every region of the pixel array. - The method of claim 1 or claim 2, wherein the steps of exposing each set of pixels to radiation are carried out at least partially simultaneously.
- The method of any preceding claim wherein the pixel array comprises one group of pixels dedicated for use as each of the sets of pixels.
- The method of claim 4, wherein the groups are interleaved.
- The method of any preceding claim, wherein each set of pixels comprises a row of the pixel array.
- The method of any preceding claim, wherein each set of pixels comprises a subset of a row of the pixel array.
- The method of claim 6 or claim 7, wherein the subset comprises every other pixel in the row.
- The method of any of claims 1-5, wherein each set of pixels comprises two rows of the array.
- The method of any preceding claim, wherein the greater of the first and second integration times is an integer multiple of the lesser of the first and second integration times.
- The method of any preceding claim, wherein the lesser of the first and second integration times is a fraction of the time taken to read out one row of pixels.
- The method of any preceding claim, wherein the step of combining the data sets to form a single output data set comprises stitching the data sets together to ameliorate the dynamic range of the output data set when compared to any one of the other data sets.
- The method of any preceding claim, wherein the output data set and each other data set are all the same size.
- An image sensor comprising a pixel array and control circuitry adapted to carry out the method of any of claims 1-13.
- A CMOS image sensor according to claim 14.
- A digital camera comprising an image sensor comprising a pixel array and control circuitry adapted to carry out the method of any of claims 1-13.
- A mobile telephone comprising the digital camera of claim 16.
- A webcam comprising the digital camera of claim 16.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP04255878A EP1641249A1 (en) | 2004-09-27 | 2004-09-27 | Improvements in or relating to image sensors |
US11/235,465 US20060066750A1 (en) | 2004-09-27 | 2005-09-26 | Image sensors |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
EP04255878A EP1641249A1 (en) | 2004-09-27 | 2004-09-27 | Improvements in or relating to image sensors |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1641249A1 true EP1641249A1 (en) | 2006-03-29 |
Family
ID=34930696
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP04255878A Withdrawn EP1641249A1 (en) | 2004-09-27 | 2004-09-27 | Improvements in or relating to image sensors |
Country Status (2)
Country | Link |
---|---|
US (1) | US20060066750A1 (en) |
EP (1) | EP1641249A1 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008138543A1 (en) * | 2007-05-10 | 2008-11-20 | Isis Innovation Limited | Image capture device and method |
EP2306707A2 (en) * | 2009-08-31 | 2011-04-06 | Samsung Electronics Co., Ltd. | Method and apparatus for increasing dynamic range of image by using electronic shutter |
CN101083724B (en) * | 2006-05-31 | 2014-04-30 | 因佩瑞恩Ip控股(开曼)有限公司 | CMOS imager system with interleaved readout for providing an image with increased dynamic range |
CN105934944A (en) * | 2013-11-26 | 2016-09-07 | 株式会社尼康 | Electronic device, imaging device, and imaging element |
Families Citing this family (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR100809345B1 (en) * | 2006-06-16 | 2008-03-05 | 삼성전자주식회사 | Apparatus and method for generating image |
KR100843087B1 (en) | 2006-09-06 | 2008-07-02 | 삼성전자주식회사 | A image generation apparatus and method for the same |
JP4957238B2 (en) * | 2006-12-27 | 2012-06-20 | ソニー株式会社 | Solid-state imaging device |
US20080165257A1 (en) * | 2007-01-05 | 2008-07-10 | Micron Technology, Inc. | Configurable pixel array system and method |
JP4905187B2 (en) * | 2007-03-09 | 2012-03-28 | ソニー株式会社 | Image processing apparatus, imaging apparatus, image processing method, and computer program |
US7812869B2 (en) * | 2007-05-11 | 2010-10-12 | Aptina Imaging Corporation | Configurable pixel array system and method |
US20090059039A1 (en) * | 2007-08-31 | 2009-03-05 | Micron Technology, Inc. | Method and apparatus for combining multi-exposure image data |
JP5054583B2 (en) * | 2008-03-17 | 2012-10-24 | 株式会社リコー | Imaging device |
KR101133733B1 (en) | 2009-12-10 | 2012-04-09 | 삼성전자주식회사 | Multi-Step Exposure Method By Electronic Shutter And Apparatus Using The Same |
US8576292B2 (en) * | 2010-04-30 | 2013-11-05 | Exelis, Inc. | High dynamic range approach for a CMOS imager using a rolling shutter and a gated photocathode |
US8994843B2 (en) | 2010-09-01 | 2015-03-31 | Qualcomm Incorporated | High dynamic range image sensor |
JP6041500B2 (en) * | 2012-03-01 | 2016-12-07 | キヤノン株式会社 | Imaging device, imaging system, driving method of imaging device, and driving method of imaging system |
WO2014018949A2 (en) | 2012-07-26 | 2014-01-30 | Olive Medical Corporation | Wide dynamic range using monochromatic sensor |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20010005225A1 (en) * | 1997-07-24 | 2001-06-28 | Vincent S. Clark | Focal plane exposure control system for cmos area image sensors |
US6441851B1 (en) * | 1996-10-02 | 2002-08-27 | Sony Corporation | Solid state image pickup device, signal processing method and camera therefor |
US20040041927A1 (en) * | 2002-08-29 | 2004-03-04 | Kwang-Bo Cho | High intrascene dynamic range NTSC and PAL imager |
Family Cites Families (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3962431B2 (en) * | 1995-11-07 | 2007-08-22 | カリフォルニア インスティチュート オブ テクノロジー | Image sensor with linear output of high dynamic range |
-
2004
- 2004-09-27 EP EP04255878A patent/EP1641249A1/en not_active Withdrawn
-
2005
- 2005-09-26 US US11/235,465 patent/US20060066750A1/en not_active Abandoned
Patent Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6441851B1 (en) * | 1996-10-02 | 2002-08-27 | Sony Corporation | Solid state image pickup device, signal processing method and camera therefor |
US20010005225A1 (en) * | 1997-07-24 | 2001-06-28 | Vincent S. Clark | Focal plane exposure control system for cmos area image sensors |
US20040041927A1 (en) * | 2002-08-29 | 2004-03-04 | Kwang-Bo Cho | High intrascene dynamic range NTSC and PAL imager |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101083724B (en) * | 2006-05-31 | 2014-04-30 | 因佩瑞恩Ip控股(开曼)有限公司 | CMOS imager system with interleaved readout for providing an image with increased dynamic range |
WO2008138543A1 (en) * | 2007-05-10 | 2008-11-20 | Isis Innovation Limited | Image capture device and method |
JP2010527189A (en) * | 2007-05-10 | 2010-08-05 | アイシス イノベイシヨン リミテツド | Image capture device and method |
US8508608B2 (en) | 2007-05-10 | 2013-08-13 | Isis Innovation Ltd. | Image capture device and method of capturing images |
US8570388B2 (en) | 2007-05-10 | 2013-10-29 | Isis Innovation Ltd. | Image capture device and method |
EP2306707A2 (en) * | 2009-08-31 | 2011-04-06 | Samsung Electronics Co., Ltd. | Method and apparatus for increasing dynamic range of image by using electronic shutter |
CN105934944A (en) * | 2013-11-26 | 2016-09-07 | 株式会社尼康 | Electronic device, imaging device, and imaging element |
EP3076662A4 (en) * | 2013-11-26 | 2017-08-09 | Nikon Corporation | Electronic device, imaging device, and imaging element |
US9961271B2 (en) | 2013-11-26 | 2018-05-01 | Nikon Corporation | Electronic device, imaging device, and imaging element |
CN105934944B (en) * | 2013-11-26 | 2020-08-14 | 株式会社尼康 | Image pickup element and image pickup apparatus |
US10757341B2 (en) | 2013-11-26 | 2020-08-25 | Nikon Corporation | Electronic device, imaging device, and imaging element |
US11785345B2 (en) | 2013-11-26 | 2023-10-10 | Nikon Corporation | Electronic device, imaging device, and imaging element for obtaining exposure of each area of image |
Also Published As
Publication number | Publication date |
---|---|
US20060066750A1 (en) | 2006-03-30 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20060066750A1 (en) | Image sensors | |
US10200664B2 (en) | Image processing apparatus, image device, image processing method, and program for reducing noise or false colors in an image | |
US10491839B2 (en) | Methods and apparatus for true high dynamic range (THDR) time-delay-and-integrate (TDI) imaging | |
USRE47523E1 (en) | Device and method for extending dynamic range in an image sensor | |
Schanz et al. | A high-dynamic-range CMOS image sensor for automotive applications | |
USRE41664E1 (en) | Solid-state imaging device, driving method therefor, and imaging apparatus | |
JP4193768B2 (en) | Data processing method, physical quantity distribution detection semiconductor device and electronic apparatus | |
US8736717B2 (en) | Image pickup apparatus and control method therefor | |
US20090109306A1 (en) | High dynamic range sensor with reduced line memory for color interpolation | |
JP6082274B2 (en) | Imaging apparatus and control method thereof | |
CN102625059A (en) | Dynamic range extension for CMOS image sensors for mobile applications | |
US20150201138A1 (en) | Solid-state imaging device and camera system | |
EP1835733A1 (en) | Solid-state image pickup device | |
JP2008187565A (en) | Solid-state imaging apparatus and imaging apparatus | |
US20140218577A1 (en) | Solid-state imaging device and camera module | |
CN110336953B (en) | Image sensor with four-pixel structure and reading control method | |
US7199827B2 (en) | Amplified solid-state image pickup device and image pickup system using the same | |
US10924693B2 (en) | Image sensor and image capturing apparatus | |
EP2485476A1 (en) | Imaging device | |
US7796185B2 (en) | Driving method for solid-state imaging device and solid-state imaging device | |
US7616354B2 (en) | Image capture apparatus configured to divisionally read out accumulated charges with a plurality of fields using interlaced scanning | |
Sasaki et al. | A wide dynamic range CMOS image sensor with multiple short-time exposures | |
JP2005217955A (en) | Imaging device, its control method, program, and storage medium | |
US10623642B2 (en) | Image capturing apparatus and control method thereof with change, in exposure period for generating frame, of conversion efficiency | |
JP2007124053A (en) | Imaging element and imaging apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LI LU MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL HR LT LV MK |
|
17P | Request for examination filed |
Effective date: 20060927 |
|
AKX | Designation fees paid |
Designated state(s): DE FR GB IT |
|
17Q | First examination report despatched |
Effective date: 20070119 |
|
RAP1 | Party data changed (applicant data changed or rights of an application transferred) |
Owner name: STMICROELECTRONICS (RESEARCH & DEVELOPMENT) LIMITE |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20120403 |