WO2018201219A1 - Cmos image sensors with pixel-wise programmable exposure encoding and methods for use of same - Google Patents

Cmos image sensors with pixel-wise programmable exposure encoding and methods for use of same Download PDF

Info

Publication number
WO2018201219A1
WO2018201219A1 PCT/CA2017/050926 CA2017050926W WO2018201219A1 WO 2018201219 A1 WO2018201219 A1 WO 2018201219A1 CA 2017050926 W CA2017050926 W CA 2017050926W WO 2018201219 A1 WO2018201219 A1 WO 2018201219A1
Authority
WO
WIPO (PCT)
Prior art keywords
exposure
charge
pixel
code
photodetector
Prior art date
Application number
PCT/CA2017/050926
Other languages
French (fr)
Inventor
Yi Luo
Shahriar Mirabbasi
Original Assignee
The University Of British Columbia
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The University Of British Columbia filed Critical The University Of British Columbia
Publication of WO2018201219A1 publication Critical patent/WO2018201219A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/50Control of the SSIS exposure
    • H04N25/53Control of the integration time
    • H04N25/533Control of the integration time by using differing integration times for different sensor regions
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L27/00Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
    • H01L27/14Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
    • H01L27/144Devices controlled by radiation
    • H01L27/146Imager structures
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/77Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
    • H04N25/771Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising storage means other than floating diffusion
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01LSEMICONDUCTOR DEVICES NOT COVERED BY CLASS H10
    • H01L27/00Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate
    • H01L27/14Devices consisting of a plurality of semiconductor or other solid-state components formed in or on a common substrate including semiconductor components sensitive to infrared radiation, light, electromagnetic radiation of shorter wavelength or corpuscular radiation and specially adapted either for the conversion of the energy of such radiation into electrical energy or for the control of electrical energy by such radiation
    • H01L27/144Devices controlled by radiation
    • H01L27/146Imager structures
    • H01L27/14601Structural or functional details thereof
    • H01L27/14609Pixel-elements with integrated switching, control, storage or amplification elements
    • H01L27/14612Pixel-elements with integrated switching, control, storage or amplification elements involving a transistor

Abstract

A pixel for an image sensor comprises: a photodetector for emitting charge in response to light incident thereon; and a plurality of charge-storage devices and a corresponding plurality of valve switches, each charge-storage device selectively connectable to receive charge from the photodetector by control of a switching state of its corresponding valve switch. The switching state of each valve switch is responsive to a corresponding exposure code signal φcode received at a control input of the valve switch.

Description

CMOS IMAGE SENSORS WITH PIXEL-WISE PROGRAMMABLE EXPOSURE ENCODING AND METHODS FOR USE OF SAME
Cross-Reference to Related Applications
[0001] This application claims priority from application No. 62/500376, filed 2 May 2017 and entitled METHODS, APPARATUS AND SYSTEMS FOR OPERATING AN IMAGE SENSOR. For purposes of the United States, this application claims the benefit under 35 U.S.C. §1 19 of application No. 62/500376, filed 2 May 2017, and entitled METHODS, APPARATUS AND SYSTEMS FOR OPERATING AN IMAGE SENSOR. All previously filed applications referred to in this paragraph are hereby incorporated herein by reference for all purposes.
Field
[0002] This disclosure relates to CMOS image sensors. Particular embodiments of the invention provide CMOS image sensors which encode or modulate input (scene) light during the process of image capture.
Background
[0003] Computational imaging is an emerging field of technology where input light to an image sensor (e.g. light from a scene that is being directed to the image sensor) is encoded or modulated during the process of image capture and then, after capture, computationally decoded or demodulated to generate one or more images of interest. Computational imaging can be used, without limitation, to capture scene details and/or other scene characteristics or scene features that are not perceptible to the human eye. By way of non-limiting example, computational imaging can be used for applications such as: high-speed motion de-blurring (see R. Raskar, A. Agrawal, and J. Tumblin, "Coded exposure photography: Motion deblurring using fluttered shutter," Proc. ACM SIGGRAPH, pp. 795-804, 2006); compressive sensing (see "Flutter shutter video camera for compressive sensing of videos," Proc. IEEE International Conference on Computational Photography (ICCP), pp. 1 -9, 2012); and focal-stack photography (see X. Lin, J. Suo, G. Wetzstein, Q. Dai, and R. Raskar, "Coded focal stack photography," Proc. IEEE International Conference on Computational
Photography (ICCP), pp.1 -9, 2013).
[0004] Figure 1 schematically shows the notional idea behind a computational imaging system 10 which involves the use of a computational-image-capture emulator 18. Light 8A from scene 8 is directed though suitable input optics 12 (typically comprising one or more lenses 12A and/or other optical components) to
computational-image-capture emulator 18. Computational-image-capture emulator 18 is typically implemented using controllable discrete optical components (not shown), such as a liquid crystal display (LCD) mask, liquid crystal on silicon (LCoS), digital micro-mirror device (DMD), other forms of spatial light modulators (SLMs) and/or the like. In some cases, computational-image capture emulators 18 also comprise a number of additional discrete optical components (e.g. lenses, beam splitters, mirrors and/or the like). In some implementations, computational-image-capture emulator 18 may be located to receive light 8A from scene 8 directly and may pass light to input optics 12 (i.e. the order of input optics 12 and computational-image-capture emulator 18 shown in Figure 1 may be switched). The output of computational-image-capture emulator 18 is computationally encoded light 18A which is directed to CMOS image sensor (CIS) 14. CIS 14 captures images in the conventional (continuous exposure or non-intermittent exposure) manner. The images captured by CIS 14 are subsequently stored in memory 18. Since the light impinging on CIS 14 is computationally encoded by emulator 18, the images stored in memory 18 represent computationally encoded image data. A computational-image decoder (typically implemented in the form of a suitably configured central processing unit (CPU)/graphics processing unit (GPU) or some other form of digital processor) 20 (typically embodied by a suitably
programmed computer that is separate from the image-capture device and from CIS 14) processes (decodes) the encoded images to produce decoded image data which may be restored in memory 18, output to display 22 or output to some other suitable device (not shown).
[0005] Two types of image-capture encoding include: temporal image-capture encoding and spatial-temporal image-capture encoding (also referred to as spatial image-capture encoding, for brevity). Figures 2A-2C schematically depict
conventional (continuous or non-intermittent) image capture, temporal image-capture encoding and spatial-temporal image-capture encoding. Figure 2A schematically depicts a single exposure cycle 24 for a CIS pixel array 26 of CIS 14 with
conventional continuous or non-intermittent exposure. Continuous exposure image capture is the technique typically used by current imaging devices and does not involve encoding the input image. Exposure cycle 24 starts by resetting the pixels (schematically depicted as squares in Figure 2A) during time period 28A. Then, during time period 28B, CIS 14 is continuously exposed to input light. Time period 28B may be referred to as the exposure period or integration period 28B for CIS 14 and is the period during which the photodiode (not shown) associated with each pixel converts photons into electronic charge. At the conclusion of the exposure period 28B, exposure cycle 24 enters a readout period 28C, during which the output signal of each pixel is "read" (typically line by line of pixel array 26) to determine a pixel value corresponding to the charge accumulated during its exposure period. After readout period 28C, the pixels may enter reset period 28A again, where the pixels are reset for capturing new image data.
[0006] Figure 2B schematically depicts a single exposure cycle 34 for a CIS pixel array 26 of CIS 14 during temporally encoded image capture. Reset period 38A and readout period 38C may be substantially similar to reset period 28A and readout period 28C of the continuous exposure image-capture example shown in Figure 2A. However, during exposure period 38B, a sequence of temporal exposure codes is applied to pixel array 26 such that at a number of sub-periods during exposure period 38B, pixel array 26 is not exposed to input light. Sub-periods of an exposure period (e.g. exposure period 38B) may also be referred to as "chops" of the exposure period. Pixel array 26 is shown schematically in Figure 2B as being black for the sub-periods of exposure period 38B during which exposure is off and white for the sub-periods of exposure period 38B during which exposure is on and charge is accumulated.
Because charge is accumulated (the corresponding photodiodes are exposed to light) during some sub-periods of exposure period 38B and exposure is off during some sub-periods of exposure period 38B, the Figure 2B exposure scheme may be referred to as intermittent exposure. As can be seen from Figure 2B, the entire pixel array 26 is either white (exposure on) or black (exposure off). A bit can be assigned to the exposure-on and exposure-off states of pixel array 26 (e.g. a bit value of 0 for the exposure-on state and a bit value of 1 for the exposure-off state). It will be
appreciated, with such a bit assignment, a temporal encoding or temporal modulation scheme can be imparted on the captured image by encoding each sub-period of exposure period 38B with a corresponding bit value. Accordingly, the Figure 2B process is known as temporal image-capture encoding.
[0007] Figure 2C schematically depicts a single exposure cycle 44 for a CIS pixel array 26 of CIS 14 during spatial-temporal encoded image capture. Reset period 48A and readout period 48C may be substantially similar to reset period 28A and readout period 28C of the continuous exposure example shown in Figure 2A. However, during exposure period 48B of the Figure 2C example, a spatial-temporal code is applied to pixel array 26, such that for each sub-period (chop) during exposure period 48B, a number of exposure codes are applied pixel-wise to the pixels 26A in pixel array 26, whereby each pixel 26A of pixel array 26 is either permitted to be exposed (shown as being white (exposure on) in the schematic Figure 2C illustration) or is prevented from being exposed (shown as being black (exposure off) in the schematic Figure 2C illustration). The spatial-temporal encoding scheme of Figure 2C is similar to the temporal encoding scheme of Figure 2B in the sense that exposure period 48B is temporally divided into sub-periods (chops), but differs from the temporal encoding scheme of Figure 2B in the sense that rather than having a single code bit for each sub-period, the spatial-temporal scheme of Figure 2C permits different code-bits to be assigned to each pixel 26A in pixel array 26 on a pixel-wise (i.e. spatial) basis for each sub-period. It will be appreciated that with the Figure 2C scheme, the image data captured by pixel array 26 of CIS 14 is both spatially (pixel-wise) and temporally encoded. Accordingly, the Figure 2C process is known as spatial-temporal exposure image-capture.
[0008] For computational image-capture emulator 18 of the Figure 1 system 10, temporal image-capture encoding (modulation) may be implemented for example by a controllable LCD mask which may be used like a rapidly switchable shutter to switch between the accumulating and non-accumulating states. Figure 2D shows such an example of a temporal image-capture modulation emulator 18 that may be used with the Figure 1 system 10. Image-capture emulator 18 shown in Figure 2D comprises a transmissive LCD 51 that is located in the light path between input optics 12 and CIS 14. LCD works as a rapidly-switching electrical shutter under the influence of a control signal 56 from an emulator controller (not shown) to either pass light or block light entirely from CIS 14 to thereby expose CIS 14 to temporally encoded light.
[0009] Figure 2E shows a LCoS-based implementation of a computational image- capture emulator 18 that may be used with the Figure 1 system 10 to emulate pixel- wise spatial-temporal image-capture modulation. Image-capture emulator 18 shown in Figure 2E comprises a number of discrete lenses 50A, 50B, 50C, a polarizing beam splitter 52 and a controllable LCoS unit 54. Input light 8A from scene 8 is provided to lens 50A, then lens 50B and then impinges on beam splitter 52. Beam splitter 52 splits the input light, some of which is transmitted to controllable LCoS unit 54 in the form of S-polarized light. LCoS unit 54 may be suitably programmed by signal(s) 56 from an emulator controller (not shown) to cause pixels to selectively reflect P-polarized light and to thereby implement a pixel-wise spatial-temporal encoding scheme. P-polarized light reflected from LCoS unit 54, which may be spatially and temporally encoded, passes through lense 50C and is reflected at beam splitter 52 toward input optics 12, which in turn focus the spatially and temporally encoded light onto CIS 14. CIS 14 is thereby exposed by the spatially and temporally encoded light.
[0010] Referring to Figures 2D and 2E and back to Figure 1 , it will be appreciated that the image-capture encoding implemented by system 10 is not implemented at the sensor level (i.e. by CIS 14), but rather is implemented by emulator 18 and its controllable discrete optical components. The image-capture encoding implemented by emulator 18 in system 10 actually occurs optically upstream (in the optical path of input light) from the pixels of CIS 14. Thus, while the Figure 1 system 10 may be referred to as computational "image-capture" encoding, the Figure 1 system 10 does not implement true electronic "exposure" encoding in the sense that the encoding by the Figure 1 system 10 does not occur electronically at the sensor level. There is a general desire to implement electronic exposure encoding at the sensor level.
[0011] Further, the controllable discrete optical components used for implementing the system 10 emulator 18 have a large size (when compared to CIS 14, for example), consume large amounts of power, require synchronization between emulator 18 and CIS 14. Also, the limitations of the controllable discrete optical components limit the operational characteristics of such emulators 18 and their corresponding imaging systems 10. For example, in the case of emulator 18 shown in Figure 2E, the physical limitations of LCoS unit 54 limit the resolution of any system 10 using this emulator 18. For emulators 18 that use beam splitters, like beam splitter 52 of the Figure 2E emulator 18, the beam splitter results in a loss of input light and corresponding loss of light efficiency. There is a general desire to implement image- capture encoding and/or exposure encoding that at least ameliorates some of these drawbacks with prior art emulator-based systems. [0012] Still further, there is a general desire to implement image-capture encoding and/or exposure encoding, to the extent possible, on the same CIS chip as the individual CMOS pixel sensors are located.
[0013] Figure 3A is a circuit diagram of a conventional prior art 4-transistor (4T) CMOS active-pixel sensor (APS) circuit 60 which may be used for a pixel 12A of pixel array 1 2 in CIS 14 of the Figure 1 system 10. Figure 3B is a corresponding timing diagram for circuit 60 and a plot of the voltage (V) at node 62 (corresponding to the voltage across photodiode 64). For circuit 60, the voltage (V) at node 62 is reset to Vrst during TReset, when the Reset and Trans signals go high. The time TReset during which the Reset and Trans signals are high corresponds to reset period 28A in Figure 2A. When the Reset and Trans signals transition to low, the exposure period (see period 28B in Figure 2A) begins. The exposure period lasts for a time TExposure, during which photodiode 64 is exposed to photons and corresponding charge begins to accumulate at node 62. This charge accumulation is shown (in the case of the illustrated embodiment) as the voltage signal V decreasing over the exposure period (see Figure 3B). At the conclusion of the exposure period, the Trans and Select signals transition to high and the accumulated voltage is transferred from node 62 to a floating diffusion (FD) and read out by a source follower to output node 66, and this voltage (Vout) is read from output node 66. The readout period TRead shown in Figure 3B corresponds to the readout period 28C shown in Figure 2A. Another cycle may begin at the conclusion of the readout period.
[0014] A characteristic of APS circuit 60 is that the charge generated by photodiode 64 is "locked" at node 62, while the Trans signal is low and the corresponding transistor 68 is non-conducting (i.e. for the entire exposure period T Exposure)- This characteristic of APS circuit 60 makes it challenging to implement intermittent exposure encoding using existing APS circuitry 60. Other types of existing CIS technology exhibit similar characteristics - i.e. that the exposure of the light sensing element (e.g. photodiode, photogate or photo-transistor) is continuous during the exposure period and is not programmable or otherwise controllable.
Brief Description of the Drawings
[0015] The accompanying drawings illustrate non-limiting example embodiments of the invention.
[0016] Figure 1 is a schematic illustration of a computational imaging system which involves the use of a computational-image-capture emulator.
[0017] Figure 2A is a schematic illustration of a single exposure cycle for a CIS pixel array during conventional continuous or non-intermittent exposure. Figure 2B is a schematic illustration of a single exposure cycle for a CIS pixel array during temporal image-capture encoding. Figure 2C is a schematic illustration of a single exposure cycle for a CIS pixel array during spatial-temporal image-capture encoding. Figure 2D shows a LCD mask-based implementation of a computational image-capture emulator that may be used with the Figure 1 system. Figure 2E shows a LCoS-based implementation of a computational image-capture emulator that may be used with the Figure 1 system.
[0018] Figure 3A is a circuit diagram of a conventional CMOS APS circuit. Figure 3B is a corresponding timing diagram for the Figure 3A circuit.
[0019] Figure 4A is a schematic illustration of a computational imaging system which involves exposure encoding according to a particular embodiment. Figure 4B is a block diagram illustration of an exposure encoder for a particular pixel that can be used as part of the CIS-based exposure encoder of the Figure 4A system according to a particular embodiment. Figure 4C is a block diagram illustration of an exposure encoder for a particular pixel that can be used as part of the CIS-based exposure encoder of the Figure 4A system according to a particular embodiment. Figures 4A, 4B and 4C may be referred to collectively herein as Figure 4.
[0020] Figure 5A is a diagram of a circuit for implementing the Figure 4B exposure encoder for a particular pixel in an APS implementation according to a particular embodiment. Figure 5B is a diagram of a circuit for implementing the Figure 4C exposure encoder for a particular pixel in an APS implementation according to a particular embodiment. Figure 5C is a timing diagram which describes the operation of the Figure 5A or Figure 5B exposure encoder circuit for temporal exposure encoding in one frame cycle according to a particular embodiment. Figure 5D is a timing diagram which describes the operation of the Figure 5A or Figure 5B exposure encoder circuit for spatial-temporal exposure encoding in one frame cycle according to a particular embodiment. Figures 5A, 5B, 5C and 5D may be referred to collectively herein as Figure 5.
[0021] Figure 6A is a diagram of a circuit for implementing the Figure 4B exposure encoder for a particular pixel in a Capacitive Trans-Impedance Amplifier (CTIA) implementation according to a particular embodiment. Figure 6B is a diagram of a circuit for implementing the Figure 4C exposure encoder for a particular pixel in a CTIA implementation according to a particular embodiment. Figure 6C is a timing diagram which describes the operation of the Figure 6A or Figure 6B exposure encoder circuit for temporal exposure encoding in one frame cycle according to a particular embodiment. Figure 6D is a timing diagram which describes the operation of the Figure 6A or Figure 6B exposure encoder circuit for spatial-temporal exposure encoding in one frame cycle according to a particular embodiment. Figures 6A, 6B, 6C and 6D may be referred to collectively herein as Figure 6.
[0022] Figure 7A is a circuit diagram of a dynamic random access memory (DRAM) unit which may be used as the code-memory unit for any of the pixels of Figure 4, 5 and/or 6 according to a particular embodiment. Figure 7B is a circuit diagram of a static random access memory (SRAM) unit which may be used the code-memory unit for any of the pixels of Figures 4, 5 and/or 6 according to a particular embodiment. Figures 7A and 7B may be referred to collectively herein as Figure 7.
[0023] Figure 8 is a schematic depiction of a CIS system architecture according to a particular embodiment, which shows a CIS pixel array, each pixel of which may be implemented according to any of the pixel (exposure encoder) embodiments described herein (e.g. Figures 4, 5 and 6).
[0024] Figure 9A is a flow chart schematically illustrating a method for operating the Figure 8 CIS system according to a particular embodiment. Figure 9B is a flow chart schematically illustrating a method for performing the temporal exposure encoding procedure of the Figure 9A method according to a particular embodiment. Figure 9C is a flow chart schematically illustrating a method for performing the spatial-temporal exposure encoding procedure of the Figure 9A method according to a particular embodiment. Figures 9A, 9B and 9C may be referred to collectively herein as Figure 9.
Detailed Description
[0025] Throughout the following description, specific details are set forth in order to provide a more thorough understanding of the invention. However, the invention may be practiced without these particulars. In other instances, well known elements have not been shown or described in detail to avoid unnecessarily obscuring the invention. Accordingly, the specification and drawings are to be regarded in an illustrative, rather than a restrictive sense.
[0026] Figure 4A is a schematic illustration of a computational imaging system 1 10 which involves exposure encoding using a CIS-based exposure encoder 1 14 according to a particular embodiment. Aside from CIS-based exposure encoder 1 14 (which takes the place of emulator 18 and CIS 14), the other components of system 100 may be similar to corresponding components of computational imaging system 10 described above and are referred to herein using similar reference numbers.
Aspects of the invention provide a CIS-based (or sensor-based) pixel-wise exposure encoder 1 14 which may be used in a computational imaging system 1 10 of the type shown in Figure 4A.
[0027] Figure 4B is a block diagram illustration of an exposure encoder 1 15 for a particular pixel 1 15A that can be used as part of the CIS-based exposure encoder 1 14 of the Figure 4A system 1 10 according to a particular embodiment. Exposure encoder 1 15 of the Figure 4B embodiment comprises a plurality (a pair in the case of the illustrated embodiment) of charge-storage devices 1 16A, 1 16B which are switchably connectable to photodetector 1 18 by a pair of controllable (e.g.
electronically controllable) switches MvaiA and MvaiB (also referred to herein as valve switches). The general scheme implemented by exposure encoder 1 15 is that, for each sub-period (chop) of an exposure period (see exposure periods 38B, 48B of Figures 2B, 2C), charge resulting from the exposure of photodetector (e.g.
photodiode, phototransistor, photogate or some other type of photo-sensitive element) 1 18 to input light is selectively delivered (by suitably controlling switches MvaiA, MvaB) to either one of charge-storage devices 1 16A, 1 16B in accordance with an exposure encoding scheme, but, in the case of the illustrated Figure 4B
embodiment, charge is only read out (by readout circuit 120A) from one of the charge-storage devices (charge-storage device 1 16A in the case of the Figure 4B illustration). Charge directed to the other one of the charge-storage devices (charge- storage device 1 16B in the case of the Figure 4B illustration) may be discarded when pixel 1 15A is reset. Thus, any exposure sub-period (chop) when charge from photodetector 1 18 is directed to charge-storage device 1 16A (by switch MvaiA), is equivalent to pixel 1 15A being exposed (exposure on) for that sub-period.
Conversely, any sub-period when charge from photodetector 1 18 is directed to charge-storage device 1 16B (by switch MvaiB), is equivalent to pixel 1 15A being not exposed (exposure off) for that sub-period. In some embodiments, a suitable readout circuit (not shown in Figure 4B) could be used to read out charge from charge storage device 1 16B. At the conclusion of the entire exposure period (comprising a plurality of exposure sub-periods), the accumulated (and encoded) charge stored in charge- storage device 1 16A may be read out by readout circuit 120A.
[0028] Exposure encoder 1 15 may optionally incorporate a plurality (a pair in the case of the illustrated embodiment) of code-memory units 122A, 122B, each of which is associated with a corresponding one of charge-storage units 1 16A, 1 16B. Code- memory units 122A, 122B may be used for implementing temporal exposure encoding and/or spatial-temporal exposure encoding. In the illustrated Figure 4B embodiment, where there are two code signals/bits (denoted (pCOde(+) and cpCode(-)), these two exposure code signals (pCOde(+) and (pCOde(-) can be respectively provided to code-memory units 122A, 122B, which may in turn be used, for each exposure sub- period, to control valve switches MvaiA and MvaiB to thereby select whether charge from photodetector 1 18 is directed to charge-storage unit 1 16A or charge-storage unit 1 16B. In the illustrated embodiment, the exposure codes ((pCode(+),<Pcode(-)) provided to code-memory units 122A, 122B are complementary to one another and this complementary nature of the codes may be denoted herein using the symbols "(+)" and "(-)". Where the exposure codes ((pCode(+),<Pcode(-)) are complementary to one another, it will be appreciated that the on/off state of valve switches MvaiA and MvaiB are opposite to one another - i.e. if switch MvaiA is conducting charge from
photodetector 1 16 to charge storage unit 1 16A, then switch MvaiB is in a nonconducting state and if switch MvaiB is conducting charge from photodetector 1 16 to charge storage unit 1 16B, then switch MvaiA is in a non-conducting state. In some embodiments, where the exposure codes ((pCOde(+) and (pCOde(-)) are complementary to one another, it may be possible to implement exposure encoder 1 15 using a single code-memory unit and a suitable circuit to invert the content of the single code- memory unit. It will be appreciated that for temporal exposure encoding (see Figure 2B), where pixel 1 15A is controlled by two complementary code signals ((pCOde(+), <Pcode(-)), code-memory units 122A, 122B are not required, since the intermittent exposure of the entire pixel array (not shown in Figure 4B) is gated simultaneously and suitable control signals may be sent directly to valve switches MvaiA, MvaiB- In some embodiments, a readout circuit 120B similar to readout circuit 120A (not shown in Figure 4B) may be provided as a part of exposure encoder 1 15 and may be connected to charge-storage device 1 16B for reading charge stored in charge- storage device 1 16B in manner similar to how readout circuit 120A reads out charge from charge-storage device 1 16A.
[0029] The components of the Figure 4B pixel 1 15A (including, for example, photodetector 1 18, charge-storage devices 1 16, valve switches Mvai, code-memory units 122 and/or readout circuits 120) may be fabricated on the same microelectronic chip (or wafer) or on a pair of stacked microelectronic chips (not shown). In some embodiments, photodetector 1 18 may be fabricated on a first microelectronic chip and the other components of the Figure 4B pixel 1 1 15A (including, for example, charge-storage devices 1 16, valve switches Mvai, code-memory units 122 and/or readout circuits 120) may be fabricated on a second stacked microelectronic chip that is stacked with the first microelectronic chip.
[0030] In the illustrated embodiment of Figure 4B, exposure encoder 1 15 of pixel 1 15A comprises a pair of charge-storage devices 1 16A, 1 16B, a corresponding pair of controllable valve switches MvaiA, MvaB and a corresponding pair of code-memory units 122A, 122B controlled by a corresponding pair of exposure code signals
((<Pcode(+),<Pcode(-))). In some embodiments, exposure encoders may comprise a plurality of more than two charge-storage units and a corresponding plurality of more than two switch valves and code-memory units controlled by a corresponding plurality of more than two exposure code signals. A block diagram example of an exposure encoder 215 for a particular pixel 215A of such an embodiment is shown in Figure 4C. The Figure 4C exposure encoder 215 for particular pixel 215A can be used as part of the CIS-based exposure encoder 1 14 of the Figure 4A system 1 10 according to a particular embodiment. The Figure 4C exposure encoder 215 is similar in many respects to, and is a generalization in many respects of, the exposure encoder of Figure 4B and similar reference numerals are used to describe features and components of the Figure 4C exposure encoder 215 that are similar to or correspond with the features and components of the Figure 4B exposure encoder 1 15.
[0031 ] The Figure 4C exposure encoder 215 for pixel 215A comprises a plurality of N (where N may be greater than 2) charge-storage devices 1 16A, 1 16B ... 1 16N (collectively, charge-storage devices 1 16), N corresponding switches MvaiA, MvaiB, ■■■ MvaiN (collectively, switches Mvai or valve switches Mvai) and N corresponding code- memory units 122A, 122B, ... 122N (collectively, code-memory units 122) used to control switches Mvai. In the illustrated embodiment, the Figure 4C exposure encoder 215 also comprises N corresponding readout circuits 120A, 120B, ... 120N
(collectively readout circuits 120), although exposure encoder 215 may be
implemented with as few as one readout circuit 120. The Figure 4C exposure encoder 215 is programmed (modulated) by a plurality of N exposure codes ((pCOdei , <Pcode2, ■■■ (PcodeN), each of which may be stored in a corresponding one of code-memory units 122 and each of which may be used to control a corresponding one of switches Mvai to thereby gate a corresponding charge storage device 1 16 (as explained in more detail below). In the Figure 4C exposure encoder 215, the plurality of exposure codes (<Pcodei , <Pcode2, ■■■ <PcodeN) may be independent of one another, such that, during any exposure sub-period, switches Mvai may be conducting in in any combination or subcombination so that charge may be selectively accumulated in any combination or sub-combination of charge-storage devices 1 16. It may be desirable, in some embodiments, to select the exposure codes (cpCodei , <Pcode2, ■■■ <PcodeN) to ensure that charge is accumulated in at least one charge storage unit 1 16 (i.e. at least on switch Mvai is conducting) during each exposure sub-period (chop). In the case where N=2, the Figure 4C exposure encoder 215 may be substantially similar to the Figure 4B exposure encoder 1 15.
[0032] The components of the Figure 4B pixel 215A (including, for example, photodetector 1 18, charge-storage devices 1 16, valve switches Mvai, code-memory units 122 and/or readout circuits 120) may be fabricated on the same microelectronic chip (or wafer) or on a pair of stacked microelectronic chips (not shown). In some embodiments, photodetector 1 18 may be fabricated on a first microelectronic chip and the other components of the Figure 4B pixel 1 1 15A (including, for example, charge-storage devices 1 16, valve switches Mvai, code-memory units 122 and/or readout circuits 120) may be fabricated on a second stacked microelectronic chip that is stacked with the first microelectronic chip.
[0033] Figure 5A is a circuit diagram of a circuit 121 for implementing the Figure 4B exposure encoder 1 15 for a particular pixel 1 15A in an APS implementation according to a particular embodiment. Circuit 121 may be used for a particular pixel 1 15A of the Figure 4A CIS exposure encoder 1 14. Circuit 121 may be suitably modified to provide any of the modifications discussed herein in connection with the Figure 4B exposure encoder 1 15. In circuit 121 of the Figure 5A embodiment, charge-storage devices 1 16A, 1 16B (collectively, charge-storage devices 1 16) are respectively implemented by charge-storage capacitors Ci , C2 (collectively, charge-storage capacitors C).
Charge-storage capacitors C act as charge-storage devices 1 16 to store charge transferred from photodetector 1 18 through valve transistors Mvan , Mvai2 (collectively, valve transistors or valve switches or, for brevity, switches Mvai), where valve transistors Mvan , Mva|2 act as switches to selectively switch charge accumulation between charge-storage capacitors Ci , C2 during each exposure sub-period. In Figure 5A and the description below, exposure code signals (pCOde(+), pcode(-) may be generalized and referred to as exposure code signals (pCOdei , <Pcode2-
[0034] In circuit 121 of the Figure 5A embodiment, code-memory units 122A, 122B (collectively, code-memory units 122) may be respectively implemented by any suitable memory units. In some embodiments, code-memory units 122 may each be implemented by a corresponding DRAM unit 126. Figure 7A depicts a DRAM unit 126 which may be used to implement a corresponding one of code-memory units 122 in the Figure 5A exposure encoder 1 15. In the Figure 7A embodiment, DRAM unit 126 comprises a transistor-based switch (Mdram) controlled by a corresponding signal (cpctri) and a corresponding capacitor (Cdram)- DRAM unit 126 may be connected between a corresponding exposure code signal (pCOde (e.g. one of exposure code signals (pCOdei , <Pcode2 shown in Figure 5A) and a corresponding valve transistor Mvai (e.g. one of valve transistors Mvan , Mvai2 shown in Figure 5A). When the control signal <pcM turns on switch Mdram, the exposure code signal (pCOde will appear at node 127 and will be stored by capacitor Cdram- This signal at node 127 is also on the gate of valve transistor Mvai and, consequently, turns valve transistor Mvai on or off.
[0035] In some embodiments, code-memory units 122 may each be implemented by a corresponding SRAM unit 131 . Figure 7B depicts a SRAM unit 131 which may be used to implement a corresponding one of code-memory units 122 in the Figure 5A exposure encoder 1 15. In the Figure 7B embodiment, SRAM unit 131 comprises a pair of control switches (Mcrn and Iv ) controlled by a corresponding signal (cpctri). SRAM unit 131 may be connected between a corresponding exposure code signal (Pcode (e.g. one of exposure code signals (pCOdei , <Pcode2 shown in Figure 5A) and a corresponding valve transistor Mvai (e.g. one of valve transistors Mvan , Mvai2 shown in Figure 5A). When the control signal (pctri is low, control transistors Mcrn and Mctri2 are non-conducting and the node 133A output of SRAM unit 131 cannot be changed. However, when the control signal (pctri is high, control transistors Mcrn and Mctri2 turn on and the node 133A output of SRAM unit 131 tracks the exposure code signal (pCOde- Once writing to SRAM unit 131 is finished, control signal (pctri is pulled low again, so that output node 133A is no longer accessible. The signal at node 133A of SRAM unit 131 is also on the gate of valve transistor Mvai and, consequently, may be used to turn valve transistor Mvai on or off. At the potential cost of more circuit components, SRAM unit 131 may have the advantage (relative to DRAM unit 126) that SRAM unit 131 does not exhibit leakage and consequently, does not have to be regularly refreshed.
[0036] Code-memory units 122 are not limited to the DRAM or SRAM embodiments shown in Figures 7A and 7B. In some embodiments, other forms of memory units could be additionally or alternatively be used to implement code-memory units 122.
[0037] Referring back to Figure 5A, when pixel 1 15A is being exposed to light, and photodetector 1 18 is implemented by a photodiode, electron-hole pairs are generated in the pn-junction region of photodiode 1 18 once the incident photon energy is greater than the photodetector's bandgap. If photodiode 1 18 is reverse-biased with a voltage V, the photocurrent IPD in diodel 18 can be modelled by the following equation:
Figure imgf000016_0001
where RPD is the photodiode sensitivity, K is Boltzmann's constant, L indicates the illumination at the photodiode surface, A is the cross-section area of the photodiode, TA is the absolute temperature, Dn,p Ln,p, np0 and pno respectively denote the diffusion coefficient, diffusion length, minority carrier concentration in the p-type region, and the minority carrier concentration in n-type region.
[0038] Exposure code signals (pCOdei , <Pcode2, as gated by gating signal (pctri, switch on/off valve transistors Mvan , Mvai2. When the exposure code (pCOdei is high and (pctri causes code-memory unit 122A to transfer its corresponding exposure code (pCOdei to the gate of valve transistor Mvan , valve transistor Mvan switches on to let charges from photodetector 1 18 accumulate at charge-storage device 1 16A (charge-storage capacitor Ci ). Where exposure codes signals cpCodei , <Pcode2 are complementary to one another, cpCOdei being high corresponds to (pCOde2 being low. Accordingly, at the same time as valve transistor Mvan switches on to let charges from photodetector 1 18 accumulate at charge-storage device 1 16A (charge-storage capacitor Ci ), cpctri also causes code-memory unit 122B to transfer its complementary (low) exposure code <Pcode2 to the gate of valve transistor Mvai2, so that valve transistor Mvai2 switches off and charge is prevented from flowing from photodetector 1 18 to charge-storage device 1 16B (charge-storage capacitor C2). Conversely, when the exposure code cpcodei is low and (pctri causes code-memory unit 122A to transfer its corresponding exposure code cpCOdei to the gate of valve transistor Mvan , valve transistor Mvan switches off to prevent charge from flowing from photodetector 1 18 to charge-storage device 1 16A (charge-storage capacitor Ci ). Where exposure codes signals (pCOdei , <Pcode2 are complementary, this will correspond to (pCOde2 being high, turning on valve transistor Mvai2, so that charge flows from photodetector 1 18 to charge-storage device 1 16B (charge-storage capacitor C2).
[0039] At the conclusion of the exposure period (e.g. exposure period 38B of Figure 2B or exposure period 48B of Figure 2C), the signal (ptran is used to turn on transfer transistors Mtran and to thereby transfer charges out from charge storage units 1 16 (charge-storage capacitors C) for readout by corresponding readout circuits 120A, 120B. In the illustrated embodiment of Figure 5A, each readout circuit 120A, 120B comprises a source follower formed by transistor Msf when switch Msei is on. In the specific case of the Figure 4B embodiment (where there is only one readout circuit 120A), charges from charge-storage capacitor C2 (which may not be of interest) may be neglected and discarded when reset transistors Mrst switch on.
[0040] Code-memory units 122A, 122B may act to buffer their respective exposure code signals (pCOdei , <P∞de2- When (pctri is pulled low, valve transistors Mvan , Mvai2 operate according to the voltage levels that are stored in the respective code-memory units 122A, 122B (e.g. in the respective capacitors Cdram of DRAM units 126 (Figure 7 A)), regardless of the status of exposure code signals (pCOdei , <Pcode2- Due to the potential for leakage current l|eak in DRAM memory cells, it may be desirable in some embodiments to have a DRAM refresh period that is less than Trefresh!max, where refresh,max is given by: where CORAM refers to Cdram of DRAM circuit 126 shown in Figure 7A, Cgate is the gate capacitance of valve transistors Mvan , Mvai2 (Figure 5A), Vth is the transistor threshold voltage, VH is the essential voltage level to maintain logic high, and Cdrain is the drain capacitance of the reset transistor Mrst.
[0041 ] Figure 5B is a circuit diagram of a circuit 124 for implementing the Figure 4C exposure encoder 215 for a particular pixel 215A in an APS implementation according to a particular embodiment. Circuit 124 may be used for a particular pixel 215A of the Figure 4A CIS exposure encoder 1 14. Circuit 124 may be suitably modified to provide any of the modifications discussed herein in connection with the Figure 4C exposure encoder 215. As discussed above in connection with Figures 4C and 4B, the Figure 5B circuit 124 differs from the Figure 5A circuit 121 because the Figure 5B circuit 124 is generalized to incorporate any suitable number N of exposure codes. In circuit 124 of the Figure 5B embodiment, charge-storage devices 1 16A, 1 16B, ... 1 16N
(collectively, charge-storage devices 1 16) are respectively implemented by charge- storage capacitors d , C2, ... CN (collectively charge storages capacitors C). Charge- storage capacitors C act as charge-storage devices 1 16 to store charge transferred from photodetector 1 18 through valve transistors Mvan , Mvai2, ... MvaiN (collectively valve transistors, valve switches or, for brevity, switches Mvai), where valve transistors Mva , MVai2,■■■ MvaiN act as switches to selectively switch charge accumulation between charge-storage capacitors Ci , C2, ... CN during each exposure sub-period.
[0042] In circuit 124 of the Figure 5B embodiment, code-memory units 122A, 122B, ... 122N may be respectively implemented by any suitable memory units. In some embodiments, code-memory units 122 may each be implemented by a corresponding DRAM unit 126 of the type shown in Figure 7A and described above in connection with circuit 121 of the Figure 5A embodiment. In some embodiments, code-memory units 122 may each be implemented by a corresponding SRAM unit 131 of the type shown in Figure 7B and described above in connection with circuit 121 of the Figure 5A embodiment. Code-memory units 122 are not limited to the DRAM or SRAM embodiments shown in Figures 7A and 7B. In some embodiments, other forms of memory units could be additionally or alternatively be used to implement code- memory units 122.
[0043] Photodetector 1 18 of the Figure 5B embodiment may operate in a manner substantially similar to photodetector 1 18 of the Figure 5A embodiment described above. Exposure code signals (pCOdei , <Pcode2, ■■■ (PcodeN, as gated by gating signal cpctri, switch on/off valve transistors Mvan , Mvai2,■■■ MvaiN- When the exposure code (pCOdei is high and (pctri causes code-memory unit 122A to transfer its corresponding exposure code cpcodei to the gate of valve transistor Mvan , valve transistor Mva switches on to let charges from photodetector 1 18 accumulate at charge-storage device 1 16A (charge- storage capacitor Ci ). Conversely, if the exposure code (pCOdei is low and cpctri causes code-memory unit 122A to transfer its corresponding exposure code cpCOdei to the gate of valve transistor Mvan , valve transistor Mvan switches off and charge does not flow from photodetector 1 18 to charge-storage device 1 16A (charge-storage capacitor d).
[0044] Similarly, if (pctri causes a code-memory unit 122B, ... 122N to transfer its corresponding exposure code (pCOde2, ■■■ (p∞deN to the gate of its corresponding valve transistor Mvai2, ... MvaiN and any of the corresponding exposure codes (pCOde2, ■■■ (PcodeN is high, the corresponding valve transistor Mvai2, ... MvaiN switches on to let charges from photodetector 1 18 accumulate at the corresponding charge-storage device 1 16B, ... 1 16N (the corresponding charge-storage capacitor C2, ... CN). Conversely, if (Pew causes code-memory unit 122B, ... 122N to transfer its corresponding exposure code (pcode2, ■■■ (PcodeN to the gate of its corresponding valve transistor Mvai2, ... MvaiN and any of the corresponding exposure code (pCOde2, ■■■ <PcodeN is low, then the corresponding valve transistor Mvai2, ... MvaiN switches off and charge does not flow from photodetector 1 18 to the corresponding charge-storage device 1 16B, ... 1 16N (the corresponding charge-storage capacitor C2, ... CN).
[0045] As discussed above, the plurality of exposure codes ((pCOdei , (Pcode2, ■■■ (PcodeN) may be independent of one another, such that, during any exposure sub-period, charge may be selectively accumulated in any combination of sub-combination of charge-storage devices 1 16 (charge-storage capacitors C). It may be desirable, in some embodiments, to select the exposure codes ((pCOdei , (pCOde2, ■■■ (PcodeN) to ensure that charge is accumulated in at least one charge storage unit 1 16 (charge-storage capacitor C) during each exposure sub-period (chop). This may be done, for example, by using a dummy exposure code which is complementary to another exposure code. This dummy exposure code may not be of interest and may not be read out by any readout circuit 120.
[0046] At the conclusion of the exposure period (e.g. exposure period 38B of Figure 2B or exposure period 48B of Figure 2C), the signal (ptran is used to turn on transfer transistors Mtran and to thereby transfer charges out from charge storage units 1 16 (charge-storage capacitors C) for readout by corresponding readout circuits 120A, 120B, ... 120N (collectively, readout circuits 120), each of which may be the same as readout circuits 120A, 120B described above in connection with circuit 121 of Figure 5A. Charges accumulated in any charge-storage capacitor C that are not of interest may be neglected and discarded when reset transistors Mrst switch on.
[0047] Code-memory units 122A, 122B, ... 122N may act to buffer their
corresponding exposure code signals (pCOdei , <P∞de2, ■■■ <PcodeN in a manner that is similar to code-memory units 122A, 122B of circuit 121 described above.
[0048] Figure 5C is a timing diagram which describes the operation of the Figure 5B exposure encoder circuit 124 for temporal exposure encoding over one frame cycle Tframe according to a particular embodiment. It will be appreciated that the Figure 5C timing diagram is also applicable to exposure encoder circuit 121 of Figure 5A, by selecting N=2. Figure 5C also shows a plot of the voltage (V) at node 128A of charge- storage device 1 16A (charge-storage capacitor d) over the frame cycle Tframe. The temporal exposure encoding starts with a reset period Trst, during which the signals cprst and (ptran are both high to reset the voltage level in charge-storage units 1 16 (charge-storage capacitors C) to Vrst. For the case of temporal exposure encoding shown in Figure 5C, during the exposure period TeXp0, cpctri stays high to pass exposure codes cpCodei , <Pcode2, ■■■ (PcodeN directly to valve transistors Mvai.
[0049] Considering now, the plot of the voltage (V) at node 128A of charge-storage capacitor Ci , during TeXp0, for exposure sub-periods when cpCOdei is high, valve- transistor Mvan is on, resulting in charge transfer from photodetector 1 18 to charge- storage capacitor Ci (charge-storage device 1 16A) and a corresponding decrease in the voltage (V) at node 128A during the exposure sub-period. Conversely, during Texpo, for exposure sub-periods when (pcode1 is low, valve transistor Mvan is off, there is no transfer of charge to node 128A and, consequently, the voltage (V) at node 128A remains constant during the exposure sub-period. Exposure codes (pCOdei , <Pcode2, ■■■ (PcodeN may be synchronized at a rate of (1/Tchop), which may in turn set an allowable bit length of the exposure code sequence to be (Texpo/Tchop). When Texpo ends, exposure codes (pCOdei , <Pcode2, ■■■ (PcodeN stop updating and (ptran and cpsei pull high, so that the node 128A voltage (V) is transferred, via transfer transistor Mtran, to readout circuit 120A, where this voltage is amplified by source follower Msf and read out as the accumulated output voltage Vouti■ The signal cpsei may pull high on a row-by-row basis in some embodiments, as described in more detail below.
[0050] Figure 5D is a timing diagram which describes the operation of the Figure 5A or Figure 5B exposure encoder circuit 124 for spatial-temporal exposure encoding in one frame cycle Tframe according to a particular embodiment. It will be appreciated that the Figure 5D timing diagram is also application to exposure encoder circuit 121 of Figure 5A, by selecting N=2. Figure 5D also shows a plot of the voltage (V) at node 128A of charge-storage device 1 16A (charge-storage capacitor Ci ) over the frame cycle Tframe- In the Figure 5D embodiment, it is assumed that the array of pixels in CIS 1 14 includes M rows of pixels (row^ row2, ... rowM). For spatial-temporal exposure encoding, within TeXp0, every row of pixels (row^ row2, ... rowM) is assigned a specific encoding period TCOde within each exposure sub-period (Tch0p) for its unique exposure code update. During each encoding period TCOde, the control signal cpctri,rowi , pctri,row2, ■■■ <Pctri,rowM for one corresponding row of pixels pulls high to allow the unique exposure codes cpcodei , pcode2, ■■■ <PcodeN for each pixel in that row to update/refresh the exposure codes cpcodei , <Pcode2, ■■■ <PcodeN stored in the corresponding code-memory units 122 of each pixel in the corresponding row. For example, in the illustrated embodiment of Figure 5D, in the first Tcode, the signal cpctri,rowi pulls high, thereby updating the unique exposure codes (pCOdei , <Pcode2, ■■■ pcodeN for each pixel in row^ . It should be realized that the exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN are unique for each pixel. However, because the exposure codes of the pixel array are updated on a row by row basis, each column of pixels may share the same exposure code bus (as will be explained in more detail below). Even where each column of pixels shares the same exposure code bus, a unique pixel may be addressed using control signals cpctri,rowi , pctri,row2, ■■■ <Pctri,rowM for each row in the array. Figure 5D only depicts the exposure codes for a single column ((pCOdei , coiumm , <Pcode2, coiumm , ■■■ <PcodeN, coiumni ), but it will be appreciated that each column bus will have a corresponding set of exposure codes
{cpcodei , ■■■ <PcodeN}coii where i=1 , ... P and P is the number of columns in the array.
[0051 ] In this manner, within each exposure sub-period (i.e. within each Tch0p), all pixels accomplish their exposure code update during a time period equal to the number of rows (M) times TCOde. This exposure code update for each pixel is equivalent to applying a spatial exposure mask to the pixel array. Until the next exposure sub-period (Tch0p) starts, the pixel array exposure for each pixel is programmed by the applied exposure mask (i.e. each pixel 215A in the pixel array is programmed by its corresponding exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN (stored in its corresponding code-memory units 122)).
[0052] In some embodiments, during Texpo, when other rows of pixels are being processed, each individual pixel may operate according to its own stored exposure codes (i.e. exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN stored in its corresponding code- memory units 122) regardless of any changes in the signals (pCOdei , coiumm , <Pcode2, coiumm , ■■■ pcodeN, coiumm■ The time period during which each pixel may operate according its own unique exposure codes (as stored in its code-memory units 122) may be referred to as Tmemory. In the Figure 5D embodiment, it can be observed that each row has a Tmemory of a slightly different duration (i.e. Tmem0ry,rowi , Tmemory,row2, ■■■ memory,rowM) and that the maximum time-length difference (i.e. between Tmem0ry,rowi and memory,rowM) is (M-1 )TCOde- This is a suitable implementation, for many applications, such as global shuttering applications and/or where the smallest Tmemory (Tmem0ry,rowM) is significantly greater than the number of rows (M) times TCOde (i.e.
memory,rowM»M(Tcode))- In some embodiments (not shown in Figure 5D), Tmemory may be made equal for each row by permitting Tmemory for rows 2, 3, ...M to extend into the next exposure sub-period/chop (e.g. until the exposure codes for the corresponding row are updated at the time TCOde for the corresponding row in the next exposure sub- period (Tch0p)). In such embodiments, the start and end times of Tmemory are offset for each row by a duration TCOde for each pair of adjacent rows between row! and rowM. This is a suitable implementation for many appflications, such as rolling shutter schemes, where the exposure is row-by-row based, for example.
[0053] The maximum number of spatial exposure masks that can be applied during one TeXpo and in one frame cycle Tframe is thus TeXpo/Tch0p. Other than for the independent programming of each pixel, during each exposure sub-period, the exposure, readout and reset of pixel 1 15A shown in Figure 5D works in a manner similar to that described above for Figure 5C. In some embodiments, such as global shuttering embodiments for example, where the Tmemory times for the second and subsequent rows are permitted to extend into subsequent exposure sub-periods (chops), it may be desirable to have the codes applied in the last exposure sub-period Tchop of each exposure period TeXp0 be dummy codes (or padded codes), so that all rows have equal Tmemory times for all exposure masks of interest. For example, all exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN (except, possibly, for one exposure code per pixel which is not of interest) for all pixels may be set to have exposure off (dummy codes) during the last exposure sub-period Tch0p of each exposure period TeXp0. In some such embodiments, the one exposure code per pixel which is not of interest, may be a dummy exposure code which is set to exposure on and which is used to sink charge from photodetector 1 18, when all of the exposure codes for the exposure codes of interest are set to exposure off, thereby preventing charge from being "locked" in photodetector 1 18. In rolling shutter embodiments, these dummy codes in the last sub-period may not be required, since pixels may be exposed and/or read on a row-by-row basis.
[0054] Figure 6A is a circuit diagram of a circuit 131 for implementing the Figure 4B exposure encoder 1 15 for a particular pixel 1 15A in a CTIA implementation according to a particular embodiment. Circuit 131 may be used for a particular pixel 215A of the Figure 4A CIS exposure encoder 1 14. Circuit 134 may be suitably modified to provide any of the modifications discussed herein in connection with the Figure 4C exposure encoder 215. In circuit 131 of the Figure 6A embodiment, charge-storage devices 1 16A, 1 16B, (collectively, charge-storage devices 1 16) are implemented by charge- storage capacitors d , C2 (collectively, charge-storage capacitors C), Charge-storage capacitors C act as charge-storage devices 1 16 to store charge transferred from photodiode 1 18 through valve transistors Mvan , Mvai2 (collectively valve transistors, valve switches or, for brevity, switches Mvai), where valve transistors Mvan , Mvai2 act as switches to selectively switch charge accumulation between charge-storage capacitors Ci , C2 during each exposure sub-period. In Figure 6A and the description below, exposure code signals (pCOde(+), <Pcode(-) may be generalized and referred to as exposure code signals (pCOdei , <Pcode2-
[0055] In circuit 131 of the Figure 6A embodiment, code-memory units 122A, 122B (collectively, code-memory units 122) may be respectively implemented by any suitable memory units. In some embodiments, code-memory units 122 may each be implemented by a corresponding DRAM unit 126 of the type shown in Figure 7A and described above in connection with circuit 121 of the Figure 5A embodiment. In some embodiments, code-memory units 122 may each be implemented by a corresponding SRAM unit 131 of the type shown in Figure 7B and described above in connection with circuit 121 of the Figure 5A embodiment. Code-memory units 122 are not limited to the DRAM or SRAM embodiments shown in Figures 7A and 7B. In some embodiments, other forms of memory units could be additionally or alternatively be used to implement code-memory units 122.
[0056] Circuit 131 of the Figure 6A embodiment, also comprises CTIA units 135A, 135B, (collectively, CTIA units 135), each of which comprises a corresponding TIA amplifier 136A, 136B (collectively, TIA amplifiers 136) for amplifying the charge across its corresponding charge-storage capacitor d , C2. In the illustrated embodiment, photodetector 1 18 is connected to each charge storage capacitor Ci , C2 via corresponding valve transistors Mvan , Mvai2- Charge storage capacitors Ci , C2 may be used for charge integration and may be reset using reset switches Mrst under the control of reset signal (prst.
[0057] The pixel exposure period TeXp0 may be divided into exposure sub-periods (chops) with temporal duration Tch0p. In each exposure sub-period (Tch0p), charges generated by photodetector 1 18 are selectively transferred to charge storage capacitors d , C2 depending on whether their corresponding valve transistors Mvan , MVai2 are on. Exposure code signals (pCOdei , <Pcode2, as gated by gating signal cpctri, switch on/off valve transistors Mvan , Mvai2. When exposure code (pCOdei is high and <pcM causes code-memory unit 122A to transfer its corresponding exposure code (pCOdei to the gate of valve transistor Mvan , valve transistor Mvan switches on to let charges from photodetector 1 18 accumulate at charge-storage device 1 16A (i.e. charge-storage capacitor Ci ). Where exposure codes signals cpCodei , <Pcode2 are complementary to one another, (pCOdei being high corresponds to (pCOde2 being low. Accordingly, at the same time as valve transistor Mvan switches on to let charges from photodetector 1 18 accumulate at charge-storage device 1 16A (charge-storage capacitor Ci ), cpctri also causes code-memory unit 122B to transfer its complementary (low) exposure code <Pcode2 to the gate of valve transistor Mvai2, so that valve transistor Mvai2 switches off and charge is prevented from flowing from photodetector 1 18 to charge-storage device 1 16B (charge-storage capacitor C2). Conversely, when the exposure code cpcodei is low and (pctri causes code-memory unit 122A to transfer its corresponding exposure code (pCOdei to the gate of valve transistor Mvan , valve transistor Mvan switches off to prevent charge from flowing from photodetector 1 18 to charge-storage device 1 16A (charge-storage capacitor Ci ). Where exposure codes signals (pCOdei , <Pcode2 are complementary, this will correspond to (pCOde2 being high, turning on valve transistor Mvai2, so that charge flows from photodetector 1 18 to charge-storage device 1 16B (charge-storage capacitor C2).
[0058] Each trans-impedance amplifier (TIA) 136A, 136B, biased by Vbp and Vbn, controls the transfer speed at its input node 140A, 140B to ensure that charge accumulated in photodetector 1 18 is fully transferred to TIA amplifiers 136A, 136B. Consequently, charge generated by photodetector 1 18 accumulates solely in charge- storage devices 1 16A, 1 16B (i.e. on charge-storage capacitors d , C2) during the exposure period TeXp0. For amplifiers 136A, 136B to settle (i.e. to ensure that charge is fully transferred to CTIA 135A, 135B) within Tch0p, their gain-bandwidth product may preferably be greater than:
GBW =—^—■ Cint+C?d (3) where Cint represents the charge-storage capacitor (Ci , C2) and Cpd is the self- capacitance of photodetector 1 18. To read out the pixel, pixel select switches Msei may be closed when signal cpsei is pulled up. Output signals, Vout1 , Vout2 reflect the voltage levels across charge storage capacitors Ci , C2 and can be calculated, for the N=2 case, according to:
½mt(l,2) = qnt-cpd + Voff (4)
nt T >
AgLlnt
where Vth, Ag, and ν0« denote the NMOS threshold voltage, the amplifier gain, and the offset voltage, respectively. With a constant load capacitance C|0Ud, the pixel read noise can be estimated as:
Figure imgf000025_0001
where a, rout and gm are the amplifier fitting coefficient (ranging from 2/3 to 2), the amplifier output resistance, and the amplifier transconductance, respectively.
[0059] For the N=2 case, the switching operation of valve transistors Mvan and Mvai2 is controlled by exposure code signals (pCOdei and (pCOde2 (which may, but need not necessarily, be complementary to one another). As summarized in Table I for the case of complementary exposure code signals, different (pCOdei and (pCOde2
combinations turn valve transistors Mvan and Mvai2 on/off accordingly and control the charge transfer direction (to Ci or to C2) during the temporal exposure encoding.
Table I
Figure imgf000026_0001
For spatial-temporal exposure encoding in the N=2 situation illustrated in Table 1 , as each pixel stores its unique exposure codes, two code-memory units 122A, 122B may be used to store (pCOdei and (p signals. In the illustrated Figure 6A embodiment, when the control signal (pctri is low, valve transistors Mvan and M maintain their on/off status according to the signals buffered in code-memory units 122A, 122B, irrespective of the status of (pCOdei and (p
[0060] Where code-memory units 122 are implemented by DRAM units 126A, 126B (see DRAM 126 of Figure 7A), due to potential leakage current l|eak, charges stored in DRAM units 126A, 126B may leak and cause potentially problematic logic shift. It is therefore desirable in some circumstances to refresh DRAM units 126A, 126B to maintain their stored logic level. In some embodiments, DRAM units 126A, 126B may be refreshed with a period less than Trefresh!max defined as in equation (1 ) above, where Cgate, and Cdrain represent gate capacitance of valve transistors Mvan , M and drain capacitance of the transistor Mdram (Figure 7A). During spatial-temporal exposure encoding, Tch0p may be selected to be smaller than Trefresh!max to ensure effective (e.g. leak-free) storage of exposure codes.
[0061] Figure 6B is a circuit diagram of a circuit 134 for implementing the Figure 4C exposure encoder 215 for a particular pixel 215A in a CTIA implementation according to a particular embodiment. Circuit 134 may be used for a particular pixel 215A of the Figure 4A CIS exposure encoder 1 14. Circuit 134 may be suitably modified to provide any of the modifications discussed herein in connection with the Figure 4C exposure encoder 215. As discussed above in connection with Figures 4C and 4B, the Figure 6B circuit 134 differs from the Figure 6A circuit 131 because the Figure 6B circuit 134 is generalized to incorporate any suitable number N of exposure codes. In circuit 134 of the Figure 6B embodiment, charge-storage devices 1 16A, 1 16B, ... 1 16N
(collectively, charge-storage devices 1 16) are implemented by charge-storage capacitors d , C2, ... CN (collectively, charge-storage capacitors C). Charge-storage capacitors C act as charge-storage devices 1 16 to store charge transferred from photodiode 1 18 through valve transistors Mvan , Mvai2,■■■ MvaiN (collectively valve transistors, valve switches or, for brevity, switches Mvai), where valve transistors Mvan , Mvai2, ... MvaiN act as switches to selectively switch charge accumulation between charge-storage capacitors Ci , C2, ... CN during each exposure sub-period.
[0062] In circuit 134 of the Figure 6B embodiment, code-memory units 122A, 122B, ... 122N may be respectively implemented by any suitable memory units. In some embodiments, code-memory units 122 may each be implemented by a corresponding DRAM unit 126 of the type shown in Figure 7A and described above in connection with circuit 121 of the Figure 5A embodiment. In some embodiments, code-memory units 122 may each be implemented by a corresponding SRAM unit 131 of the type shown in Figure 7B and described above in connection with circuit 121 of the Figure 5A embodiment. Code-memory units 122 are not limited to the DRAM or SRAM embodiments shown in Figures 7A and 7B. In some embodiments, other forms of memory units could be additionally or alternatively be used to implement code- memory units 122.
[0063] Circuit 134 of the Figure 6B embodiment, also comprises CTIA units 135A, 135B, ... 135N (collectively, CTIA units 135), each of which comprises a
corresponding TIA amplifier 136A, 136B, ... 136N (collectively, amplifiers 136) for amplifying the charge across its corresponding charge-storage capacitor d , C2, ... CN. In the illustrated embodiment, photodetector 1 18 is connected to each charge storage capacitor Ci , C2, ... CN via corresponding valve transistors Mvan , Mvai2, ... MvaiN- Charge storage capacitors Ci , C2, ... CN may be used for charge integration and may be reset using reset switches Mrst under the control of reset signal cprst. [0064] The pixel exposure period Texpo may be divided into exposure sub-periods (chops) with temporal duration Tch0p. In each exposure sub-period (Tch0p), charges generated by photodetector 1 18 are transferred to charge storage capacitors Ci , C2, ... CN depending on whether their corresponding valve transistors Mvah , Mva|2, ... MvaiN are on. Exposure code signals (pCOdei , <Pcode2, ■■■ <PcodeN, as gated by gating signal (pctri, switch valve transistors Mvan , Mvai2, ... MvaiN on/off. When exposure code (pCOdei is high and (pew causes code-memory unit 122A to transfer its corresponding exposure code <Pcodei to the gate of valve transistor Mvan , valve transistor Mvan switches on to let charges from photodetector 1 18 accumulate at charge-storage device 1 16A ( charge- storage capacitor CO- Conversely, if the exposure code (pCOdei is low and (pctri causes code-memory unit 122A to transfer its corresponding exposure code (pCOdei to the gate of valve transistor Mvan , valve transistor Mvan switches off and charge does not flow from photodetector 1 18 to charge-storage device 1 16A ( charge-storage capacitor C .
[0065] Similarly, if φ0, causes a code-memory unit 122B, ... 122N to transfer its corresponding exposure code (pCOde2, ■■■ <PcodeN to the gate of its corresponding valve transistor Mvai2, ... MvaiN and any of the corresponding exposure codes (pCOde2, ■■■ cPcodeN is high, the corresponding valve transistor Mva|2, ... Mva|N switches on to let charges from photodetector 1 18 accumulate at the corresponding charge-storage device 1 16B, ... 1 16N ( the corresponding charge-storage capacitor C2, ... CN). However, if (Pew causes code-memory unit 122B, ... 122N to transfer its corresponding exposure code (pcode2, ■■■ (PcodeN to the gate of its corresponding valve transistor Mvai2, ... MvaiN and any of the corresponding exposure code (pCOde2, ■■■ cPcodeN is low, then the corresponding valve transistor Mvai2, ... MvaiN switches off and charge does not flow from photodetector 1 18 to the corresponding charge-storage device 1 16B, ... 1 16N (. the corresponding charge-storage capacitor C2, ... CN).
[0066] As discussed above, the plurality of exposure codes ((pCOdei , <Pcode2, ■■■ <PcodeN) may be independent of one another, such that, during any exposure sub-period, charge may be selectively accumulated in any combination of sub-combination of charge-storage devices 1 16 (charge-storage capacitors C). It may be desirable, in some embodiments, to select the exposure codes ((pCOdei , <Pcode2, ■■■ <PcodeN) to ensure that charge is accumulated in at least one charge storage unit 1 16 (charge-storage capacitor C) during each exposure sub-period (chop). This may be done, for example, by using a dummy exposure code which is complementary to another exposure code. This dummy exposure code may not be of interest and may not be read out by any readout circuit 120.
[0067] Figure 6C is a timing diagram which describes the operation of the Figure 6B exposure encoder circuit 134 for temporal exposure encoding over one frame cycle frame according to a particular embodiment. It will be appreciated that the Figure 6C timing diagram is also applicable to exposure encoder circuit 131 of Figure 6A, by selecting N=2. Figure 6C also shows a plot of the voltage (V) at node 138A (the output of TIA 136A - see Figure 6B) over the frame cycle Tframe. In temporal exposure encoding, all pixels are guided by the same exposure codes (pCOdei , <Pcode2, ■■■ <p∞deN- Starting with pixel reset (Trst), the voltage level in photodetector 1 18, charge-storage units 1 16 (charge-storage capacitors C) and nodes 138A, 138B, ... 138N are reset to Vrst. During the exposure period (TeXp0), cpctri stays high, in the case of temporal exposure encoding, to pass exposure codes (pCOdei , <Pcode2, ■■■ pcodeN directly to valve transistors Mvan , Mvai2, ... MvaiN, thereby turning valve transistors Mvan , Mvai2, ... MvaiN on/off.
[0068] Considering now, the plot of the node 138A voltage (V), during Texpo, for exposure sub-periods when cpCOdei is high, valve transistor Mvan is on, resulting in charge transfer from photodetector 1 18 to charge-storage capacitor Ci (charge- storage device 1 16A), a corresponding decrease in the voltage at node 140A and a corresponding increase in the voltage (V) at node 138A due to the inverting amplification effect of TIA 136A. Conversely, during TeXp0, for exposure sub-periods when cpcodei is low, valve transistor Mvan is off, and so there is no transfer of charge to node 138A and the voltage (V) at node 138A remains constant during the exposure sub-period. Exposure codes (pCOdei , <P∞de2, ■■■ <PcodeN may be synchronized at a rate of (1 Tchop), which may in turn set the length of each exposure code to be (TeXpo/Tch0p). As charges are distributed into CTIA units 135A, 135B, ... 135N, the voltage levels at nodes 138A, 138B, ... 138N increase. Once Texpo ends, exposure codes (pCOdei , <P∞de2, ... cpcodeN stop updating. The pixel selection signal (cpsel) is then pulled up to read out the final output Vouti , Vout2,■■■ V0UtN- Within the readout period (Tread), the voltages at nodes 138A, 138B, ... 138N remain unchanged until cprst is pulled up again to start the next frame.
[0069] Figure 6D is a timing diagram which describes the operation of the Figure 6B exposure encoder circuit 134 for spatial-temporal exposure encoding in one frame cycle Tframe according to a particular embodiment. . It will be appreciated that the Figure 6D timing diagram is also application to exposure encoder circuit 131 of Figure 6A, by selecting N=2. Figure 6D also shows a plot of the voltage (V) at node 138A (Figure 6B) of charge-storage device 1 16A (charge storage capacitor Ci ) over the frame cycle Tframe- In the Figure 6D embodiment, it is assumed that the array of pixels in CIS 1 14 includes M rows of pixels (row! , row2, ... rowM). For spatial-temporal exposure encoding, within TeXp0, each row of pixels (row^ row2, ... rowM) is assigned a specific encoding period TCOde within each exposure sub-period (TCh0p) for its unique exposure code update. During each encoding period Tcode, the control signal cpctri,rowi , <Pctri,row2, ■■■ pctri.rowM for one corresponding row of pixels pulls high to allow the unique exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN for each pixel in that row to update/refresh the exposure codes (pCOdei , <Pcode2, ■■■ pcodeN stored in the corresponding code-memory units 122 of each pixel in the corresponding row. For example, in the illustrated embodiment of Figure 6D, in the first TCOde, the signal (pctri,rowi pulls high, thereby updating the unique exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN for each pixel in rowi . It should be realized that the exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN are unique for each pixel. However, because the exposure codes of the pixel array are updated on a row by row basis, each column of pixels may share the same exposure code bus (as will be explained in more detail below). Even where each column of pixels shares the same exposure code bus, a unique pixel may be addressed using control signals <Pctri,rowi , <Pctri,row2, ■■■ <Pctri,rowM for each row in the array. Figure 6D only depicts the exposure codes for a single column ((pCOdei , coiumm , <Pcode2, coiumm , ■■■ <PcodeN, coiumm ), but it will be appreciated that each column bus will have a corresponding set of exposure codes {cpcodei , ■■■ <PcodeN}coii where i=1 , ...P and P is the number of columns in the array.
[0070] In this manner, within each exposure sub-period (i.e. within each Tch0p), all pixels accomplish their exposure codes update during a time period equal to the number of rows (M) times TCOde- This exposure code update for each pixel is equivalent to applying a spatial exposure mask to the pixel array. Until the next exposure sub-period (Tch0p) starts, the pixel array exposure for each pixel is exposed based on the applied exposure mask (i.e. each pixel 215A in the pixel array is programmed by its corresponding exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN (stored in its corresponding code-memory units 122). [0071] In some embodiments, during Texpo, when other rows of pixels are being processed, each individual pixel may operate according to its own stored exposure codes (i.e. exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN stored in its corresponding code- memory units 122) regardless of any changes in the signals (pCOdei , coiumm , <Pcode2, coiumm , ■■■ pcodeN, coiumm■ The time period during which each pixel may operate according its own unique exposure codes (as stored in its code-memory unit 122) may be referred to as Tmemory. In the Figure 6D embodiment, it can be observed that each row has a Tmemory of a slightly different duration (i.e. Tmem0ry,rowi , Tmemory,row2, ■■■ memory,rowM) and that the maximum time-length difference (i.e. between Tmem0ry,rowi and memory,rowM) is (M-1 )Tcode. This is a suitable implementation, for many applications, such as global shuttering applications and/or where the smallest Tmemory (Tmem0ry,rowM) is significantly greater than the number of rows (M) times Tcode (i.e.
memory,rowM»M(TCode))- In some embodiments (not shown in Figure 6D), Tmemory may be made equal for each row by permitting Tmemory for rows 2, 3, ...M to extend into the next exposure sub-period/chop (e.g. until the exposure codes for the corresponding row are updated at the time TCOde for the corresponding row in the next exposure sub- period (Tch0p)). In such embodiments, the start and end times of Tmemory are offset for each row by a duration TCOde for each pair of adjacent rows between row! and rowM. This is asuitable implementation for many applications, such as rolling shutter schemes, where exposure is row-by-row based, for example.
[0072] The maximum number of spatial exposure masks that can be applied during one TeXpo and in one frame cycle Tframe is thus TeXpo/Tch0p. Other than for the independent programming of each pixel, during each exposure sub-period, the exposure, readout and reset of pixel 215A shown in Figure 6D works in a manner similar to that described above for Figure 6C. In some embodiments, such as global shuttering embodiments for example, where the Tmemory times for the second and subsequent rows are permitted to extend into subsequent exposure sub-periods (chops), it may be desirable to have the codes applied in the last exposure sub-period Tchop of each exposure period TeXp0 be dummy codes (or padded codes), so that all rows have equal Tmemory times for all exposure masks of interest. For example, all exposure codes (pCOdei , <Pcode2, ■■■ pcodeN (except, possibly, for one exposure code per pixel which is not of interest) for all pixels may be set to have exposure off (dummy codes) during the last exposure sub-period Tch0p of each exposure period TeXp0. In some such embodiments, the one exposure code per pixel which is not of interest, may be a dummy exposure code which is set to exposure on and which is used to sink charge from photodetector 1 18, when all of the exposure codes for the exposure codes of interest are set to exposure off, thereby preventing charge from being "locked" in photodetector 1 18. In rolling shutter embodiments, these dummy codes in the last sub-period may not be required, since pixels may be exposed and/or read on a row-by-row basis.
[0073] Figure 8 is a schematic depiction of a CIS system architecture 300 according to a particular embodiment, which shows a CIS pixel array 314. Each pixel 324 of CIS system 300 may be implemented according to any of the pixel (exposure encoder) embodiments described herein (e.g. Figures 4, 5 and 6). Pixels 324 may be individually referred to by their row and column number - e.g. any particular pixel 324 may be referred to as pixel 324jj where 1≤i≤M is the pixel row number and 1≤j≤P is the pixel column number. CIS system 300 of the illustrated embodiment comprises a number of notional controllers, comprising exposure code controller 310, image signal processing controller 312, code memory controller 316 and row scanner 318 and code memory controller 316. In practice, one or more of controllers 310, 312, 316, 318 may be implemented by the same physical or logical digital (data) processor which may be operating under the control of suitable software.
[0074] Exposure code controller 310 is connected to pixel array 314 via a series of column busses 31 OA. Exposure code controller 310 may operate under the control of suitable exposure control software (e.g. application software) 308 to deliver the various exposure codes cpCodei , pCode2, ■■■ <PcodeN to each pixel 324. Specifically, each column bus 31 OA connected to exposure code controller 310 carries a series of exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN during each TCOde, where the exposure codes <Pcodei , <Pcode2, ■■■ <PcodeN for each column bus 31 OA are specific to a particular pixel 314. In Figure 5D and 6D, the notation that is used for the exposure codes on each column bus is exposure codes (pCOdei ,coii, <Pcode2,coii, ■■■ <PcodeN,coii where 1 <i≤P is the index of column bus 31 OA. The particular pixel that is selected to be programmed in each TCOde is selected by a control signal cpctri.rowj output on row-select lines 316A by code memory controller 316, where 1≤j≤M is the index of row-select lines 316A. As discussed above, the rows of pixels 324 in array 314 are programmed with exposure codes on a row by row basis during successive TCOdes during each sub-period Tch0p.
[0075] Once all of the pixels 324 of array 314 are coded with their corresponding unique exposure codes (pCOdei , <Pcode2, ■■■ <PcodeN, in each sub-period (chop), exposure takes place for that sub-period (possibly extending into a subsequent chop as discussed above). At the conclusion of all of the sub-periods corresponding to an exposure period Texpo, the individual pixels are read out. This occurs in a manner similar to that of programming the pixels with column busses 312A that are connected to each pixel 324 in a corresponding column and row scanner 318, which outputs row-select signals (psei,rowj onto row-select lines 318A, where 1≤j≤M is the index of row-select lines 318A. For each successive row 1≤j≤M, the N output voltages Vouti , 0ut2, ■■■ VoutN of each pixel 324 in the row are output onto a corresponding column bus 312A and provided to image signal processor 312 and thereafter to image memory 320 (which may be accessible to a CPU, GPU or display (not shown in Figure 8)).
[0076] Figure 9A is a flow chart schematically illustrating a method 400 for operating the Figure 8 CIS system 300 according to a particular embodiment. Method 400 begins in block 402 which involves initiating the pixel of the CIS sensor 1 14. This CIS sensor initiation may comprise a standard CIS initiation as is known in the art. Method 400 then enters a frame loop which is performed once every Tframe (see Figures 5 and 6). The first procedure of the frame loop in the illustrated embodiment is the block 404 reset procedure, where cprst (for each pixel) is pulled high (see Figures 5 and 6) and the voltages at photodetector 1 18, charge-storage units 1 16 (charge-storage capacitors C) and the corresponding nodes of the exposure encoder circuit are reset to Vrst. Method 400 then proceeds to block 406 which involves an inquiry into whether the current frame is to be a non-intermittent (continuous) exposure frame. If the block 406 inquiry is positive, then method 400 proceeds to block 408 where a continuous exposure operation is performed. The block 408 continuous exposure, an example of which is shown in Figure 2A, is well known in the art.
[0077] However, if the block 406 is inquiry is negative, then method 400 proceeds to block 410, where an inquiry is made as to whether the intermittent exposure is to be a temporal exposure encoding (block 412) or a spatial-temporal exposure encoding (block 414). Each of temporal encoding block 412 and spatial-temporal encoding block 414 is explained in more detail in Figures 9B and 9C. At the conclusion of the exposure in 408, 412 or 414, the block 416 inquiry is positive and method 400 proceeds to block 418, where a read operation is performed at the end of the frame. The block 418 read operation may involve using the cpsei signal for each row the pixel array to read the output voltages that have accumulated in the charge-storage devices during the frame. These output voltages may be read onto the read column busses 412A (Figure 8) on a row-by-row basis, as discussed above. At the conclusion of the block 418 read operation, method 400 proceeds to block 420, where method 400 either loops back to block 404 to image another frame or ends at block 422.
[0078] Figure 9B is a flow chart schematically illustrating a method 450 for performing the block 412 temporal exposure encoding procedure of the Figure 9A method 400 according to a particular embodiment. Method 450 starts in block 452 and then proceeds to perform a pair of procedures 454, 456 for each sub-period (chop) during the exposure period Texpo. The first exposure sub-period involves performing blocks 454A and 456A. In block 454A, exposure code controller 310 (Figure 8) updates the exposure codes (cpCodei , pCode2, ■■■ <PcodeN) for the first chop for each column a1 , b1 , d ... (for all P columns in the array). For temporal exposure encoding, the exposure codes (cpcodei , <Pcode2, ■■■ <PcodeN) for each pixel (i.e. in each column and each row) are the same in each chop. Consequently, the (pctri signal may be used to program all rows (and all columns) in the pixel array at the same time in block 454A - i.e. it is not necessary to use (pctri on a row-by-row basis for temporal encoding. At the conclusion of block 454A, the exposure codes (cpCodei , <Pcode2, ■■■ <PcodeN) are programmed into the code-memory units 122 of each pixel. Method 450 then proceeds to block 456A, which involves exposure under the the exposure codes (cpCodei , <Pcode2, ■■■ <PcodeN) programmed in block 454A for the current exposure sub-period (chop). For the second and subsequent exposure sub-periods (chops) in the method 450 frame, the procedures of blocks 454B, ... 454n and blocks 456B, ... 456n are the substantially the same as blocks 454A and 456A for the first exposure sub-period (chop). In the illustrated embodiment, there are n chops (exposure sub-periods) in the frame. At the conclusion of the n exposure sub-periods, method 450 ends in block 458.
[0079] Figure 9C is a flow chart schematically illustrating a method 480 for performing the block 414 spatial-temporal exposure encoding procedure of the Figure 9A method 400 according to a particular embodiment. Method 480 starts in block 482 and then proceeds to perform a number of procedures 484, 486, 488, 490 for each sub-period (chop) during the exposure period TeXp0. The first exposure sub-period involves performing blocks 484A, 486A, 488A, 490A. In block 484A, pixel memory controller 316 (Figure 8) selects a row y of pixels and sets the signal (pctri,rowj to be high for the selected row y of pixels. In block 486A, exposure code controller 310 (Figure 8) updates the exposure codes (cpCodei , <Pcode2, ■■■ <PcodeN) for the first chop for each column a1 , b1 , c1 ... (for all P columns in the array) in the currently select row j. For spatial-temporal encoding, the exposure codes (cpCodei , <Pcode2, ■■■ <PcodeN) are unique for each individual column in each block 486A. This results in unique exposure codes (<Pcodei , <Pcode2, ■■■ <PcodeN) for each pixel in the CIS array. After block 486A, method 480 proceeds to block 488A, where an inquiry is performed as to whether the currently selected row j is the last row to have its exposure codes (cpCodei , <Pcode2, ■■■ <PcodeN) updated. If the block 488A inquiry is negative, then method 480 loops back to block 486A to select another row for programming. If the block 488A inquiry is positive, then the mask Μ corresponding to the first exposure sub-period (chop) is complete and method 480 proceeds to block 490A which involves exposure for the first expopsure sub-period (chop) under the exposure codes of the first mask Μ . For the second and subsequent exposure sub-periods (chops) in the method 480 frame, the procedures of blocks 484B, ... 484n, blocks 486B,... 486n, blocks 488B, ... 488n and blocks 490B, ... 490n are the substantially the same as blocks 484A, 486A, 488A, 490A for the first exposure sub-period (chop). In the illustrated embodiment, there are n chops (exposure sub-periods) in the frame. At the conclusion of the n exposure sub-periods, method 480 ends in block 492.
Interpretation of Terms
[0080] Unless the context clearly requires otherwise, throughout the description and the claims:
• "comprise", "comprising", and the like are to be construed in an inclusive
sense, as opposed to an exclusive or exhaustive sense; that is to say, in the sense of "including, but not limited to";
• "connected", "coupled", or any variant thereof, means any connection or
coupling, either direct or indirect, between two or more elements; the coupling or connection between the elements can be physical, logical, or a combination thereof;
• "herein", "above", "below", and words of similar import, when used to describe this specification, shall refer to this specification as a whole, and not to any particular portions of this specification; • "or", in reference to a list of two or more items, covers all of the following interpretations of the word: any of the items in the list, all of the items in the list, and any combination of the items in the list;
• the singular forms "a", "an", and "the" also include the meaning of any
appropriate plural forms;
• components are described or recited herein as being selectively connectable to one another. Such selective connections may refer to selectively conducting connections where in one state, electric conductivity is possible between the components, and in another state, electric conductivity is possible between the components. Such selective connections may be made, for example, by semiconductor switches (e.g. transistor-based switches or other
semiconductor-based switches), where the components may maintain physical connection (via the semiconductor switch), but may or may not be conuctively connected depending on the state of the switch.
[0081] Embodiments of the invention may be implemented using specifically designed hardware, configurable hardware, programmable data processors configured by the provision of software (which may optionally comprise "firmware") capable of executing on the data processors, special purpose computers or data processors that are specifically programmed, configured, or constructed to perform one or more steps in a method as explained in detail herein and/or combinations of two or more of these. Examples of specifically designed hardware are: logic circuits, application-specific integrated circuits ("ASICs"), large scale integrated circuits ("LSIs"), very large scale integrated circuits ("VLSIs"), and the like. Examples of configurable hardware are: one or more programmable logic devices such as programmable array logic ("PALs"), programmable logic arrays ("PLAs"), and field programmable gate arrays ("FPGAs")). Examples of programmable data processors are: microprocessors, digital signal processors ("DSPs"), embedded processors, graphics processors, math coprocessors, general purpose computers, server computers, cloud computers, mainframe computers, computer workstations, and the like. For example, one or more data processors in a control circuit for a device may implement methods as described herein by executing software instructions in a program memory accessible to the processors.
[0082] Processing may be centralized or distributed. Where processing is distributed, information including software and/or data may be kept centrally or distributed. Such information may be exchanged between different functional units by way of a communications network, such as a Local Area Network (LAN), Wide Area Network (WAN), or the Internet, wired or wireless data links, electromagnetic signals, or other data communication channel.
[0083] For example, while processes or blocks are presented in a given order, alternative examples may perform routines having steps, or employ systems having blocks, in a different order, and some processes or blocks may be deleted, moved, added, subdivided, combined, and/or modified to provide alternative or
subcombinations. Each of these processes or blocks may be implemented in a variety of different ways. Also, while processes or blocks are at times shown as being performed in series, these processes or blocks may instead be performed in parallel, or may be performed at different times.
[0084] In addition, while elements are at times shown as being performed
sequentially, they may instead be performed simultaneously or in different sequences. It is therefore intended that the following claims are interpreted to include all such variations as are within their intended scope.
[0085] Software and other modules may reside on servers, workstations, personal computers, tablet computers, image data encoders, image data decoders, PDAs, color-grading tools, video projectors, audio-visual receivers, displays (such as televisions), digital cinema projectors, media players, and other devices suitable for the purposes described herein. Those skilled in the relevant art will appreciate that aspects of the system can be practised with other communications, data processing, or computer system configurations, including: Internet appliances, hand-held devices (including personal digital assistants (PDAs)), wearable computers, all manner of cellular or mobile phones, multi-processor systems, microprocessor-based or programmable consumer electronics (e.g., video projectors, audio-visual receivers, displays, such as televisions, and the like), set-top boxes, color-grading tools, network PCs, mini-computers, mainframe computers, and the like.
[0086] The invention may also be provided in the form of a program product. The program product may comprise any non-transitory medium which carries a set of computer-readable instructions which, when executed by a data processor, cause the data processor to execute a method of the invention. Program products according to the invention may be in any of a wide variety of forms. The program product may comprise, for example, non-transitory media such as magnetic data storage media including floppy diskettes, hard disk drives, optical data storage media including CD ROMs, DVDs, electronic data storage media including ROMs, flash RAM, EPROMs, hardwired or preprogrammed chips (e.g., EEPROM semiconductor chips), nanotechnology memory, or the like. The computer-readable signals on the program product may optionally be compressed or encrypted.
[0087] In some embodiments, the invention may be implemented in software. For greater clarity, "software" includes any instructions executed on a processor, and may include (but is not limited to) firmware, resident software, microcode, and the like. Both processing hardware and software may be centralized or distributed (or a combination thereof), in whole or in part, as known to those skilled in the art. For example, software and other modules may be accessible via local memory, via a network, via a browser or other application in a distributed computing context, or via other means suitable for the purposes described above.
[0088] Where a component (e.g. a software module, processor, assembly, device, circuit, etc.) is referred to above, unless otherwise indicated, reference to that component (including a reference to a "means") should be interpreted as including as equivalents of that component any component which performs the function of the described component (i.e., that is functionally equivalent), including components which are not structurally equivalent to the disclosed structure which performs the function in the illustrated exemplary embodiments of the invention.
[0089] Specific examples of systems, methods and apparatus have been described herein for purposes of illustration. These are only examples. The technology provided herein can be applied to systems other than the example systems described above. Many alterations, modifications, additions, omissions, and permutations are possible within the practice of this invention. This invention includes variations on described embodiments that would be apparent to the skilled addressee, including variations obtained by: replacing features, elements and/or acts with equivalent features, elements and/or acts; mixing and matching of features, elements and/or acts from different embodiments; combining features, elements and/or acts from embodiments as described herein with features, elements and/or acts of other technology; and/or omitting combining features, elements and/or acts from described embodiments. For example:
• The embodiments described elsewhere herein comprise a photodiode as the light sensitive (photodetector) element. This is not necessary. The photodiode may additionally or alternatively comprise any suitable photo-sensing element, such as a phototransistor, photogate and/or the like.
• In some embodiments, the Figure 7 A DRAM unit 126 may comprise an
inverter (not shown), which may be connected to node 127 and may invert the exposure code signal (pCOde present at node 127 to output the complement of exposure code signal (pCOde- After writing to DRAM unit 126 by temporarily activating the control signal (pctri, this will result in a pair of complementary exposure codes (pCOde(+), <Pcode(-) being present on node 127 and at the output of the inverter. For the particular case of two complementary exposure codes <Pcode(+), <Pcode(-), node 127 of DRAM unit 126 may be connected to the gate of a first valve transistor (e.g. to the gate of Mvan in circuit 121 of Figure 5A or circuit 131 of Figure 6A) and the output of the inverter may be connected to the gate of a second valve transistor (e.g. to the gate of Mvai2 in circuit 121 of Figure 5A or circuit 131 of Figure 6A), which may allow the Figure 5A circuit 121 or the Figure 6A circuit to be configured with a single DRAM cell which may store both complementary exposure codes (pCOde(+), <Pcode(-)-
• In some embodiments, the Figure 7B SRAM unit 131 may comprise an
inverter 137, which may invert exposure code signal (pCOde and may result in the complement of exposure code signal (pCOde being present at node 139. In some embodiments, node 139 of SRAM unit 131 may be connected directly to the complement of exposure code signal cpCOde- After writing to SRAM unit 131 by temporarily activating the control signal (pctri, this will result in a pair of complementary exposure codes (pCOde(+), <Pcode(-) being present on nodes 133A, 133B of the Figure 7B SRAM unit 131 . For the particular case of two complementary exposure codes (pCOde(+), <Pcode(-), node 133A of SRAM unit 131 may be connected to the gate of a first valve transistor (e.g. to the gate of Mvan in circuit 121 of Figure 5A or circuit 131 of Figure 6A) and node 133B of SRAM unit 131 may be connected to the gate of a second valve transistor (e.g. to the gate of Mvai2 in circuit 121 of Figure 5A or circuit 131 of Figure 6A), which may allow the Figure 5A circuit 121 or the Figure 6A circuit to be configured with a single SRAM cell which may store both complementary exposure codes <Pcode(+), <Pcode(-)-
• In the embodiments described above, a valve switch Mvai is provided for each charge storage unit 1 16 to selectively connect each charge-storage unit 1 16 to the photodetector 1 18 or disconnect each charge-storage unit 1 16 from photodetector 1 18. In some embodiments, where N=2, a pixel may be provided with a single switch (controllable by a single exposure code φ∞< (+)) may be provided which may connect photodetector 1 18 alternatively to either one of charge storage units 1 16A, 1 16B. In other respects, such a pixel may be similar to the embodiments described elsewhere herein where N=2.
[0090] It is therefore intended that the following appended claims and claims hereafter introduced are interpreted to include all such modifications, permutations, additions, omissions, and sub-combinations as may reasonably be inferred. The scope of the claims should not be limited by the preferred embodiments set forth in the examples, but should be given the broadest interpretation consistent with the description as a whole.

Claims

WHAT IS CLAIMED IS:
1. A pixel for an image sensor comprising:
a photodetector for emitting charge in response to light incident thereon; a plurality of charge-storage devices and a corresponding plurality of valve switches, each charge-storage device selectively connectable to receive charge from the photodetector by control of a switching state of its
corresponding valve switch;
wherein the switching state of each valve switch is responsive to a corresponding exposure code signal (pCOde received at a control input of the valve switch.
2. A pixel according to claim 1 or any other claim herein wherein the exposure code signal (pCOde received at the control input of each valve switch comprises a binary signal having binary values capable of changing in each of a plurality of exposure sub-periods of a single exposure period TeXp0 during which the pixel is exposed to incident light.
3. A pixel according to any one of claims 1 to 2 or any other claim herein
comprising a plurality of code-memory units, each code-memory unit connected to receive a corresponding input exposure code signal and selectively connectable to provide a corresponding exposure code signal (pCOde to the control input of a corresponding one of the plurality of valve switches to thereby control the switching state of the corresponding one of the valve switches.
4. A pixel according to claim 3 or any other claim herein wherein the input
exposure code signal received at each code-memory unit comprises a binary signal having binary values capable of changing in each of a plurality of exposure sub-periods of a single exposure period TeXp0 during which the pixel is exposed to incident light.
5. A pixel according to any one of claims 3 to 4 or any other claim herein wherein each code-memory unit comprises a memory for maintaining the
corresponding exposure code signal at the control input of the corresponding one of the valve switches.
6. A pixel according to claim 5 or any other claim herein wherein, for each code- memory unit, the memory comprises a memory capacitor.
7. A pixel according to any one of claims 3 to 6 or any other claim herein wherein each code-memory unit comprises a dynamic random access (DRAM) cell.
8. A pixel according to any one of claims 3 to 5 or any other claim herein wherein each code-memory unit comprises a static random access (SRAM) cell.
9. A pixel according to any one of claims 3 to 8 or any other claim herein wherein each code-memory unit is selectively connectable to provide the
corresponding exposure code signal to the control input of the corresponding one of the plurality of valve switches in response to a control signal (pctri.
10. A pixel according to any one of claims 3 to 9 or any other claim herein wherein the photodetector is fabricated on a first microelectronic chip and the plurality of code-memory units are fabricated on the same first microelectronic chip or on one or more second stacked microelectronic chips stacked with the first microelectronic chip..
1 1 . A pixel according to any one of claims 1 to 10 or any other claim herein
comprising one or more readout circuits, each readout circuit associated with a corresponding one of the plurality of charge-storage devices and selectively connectable to the corresponding one of the charge-storage devices to output a corresponding output signal, the corresponding output signals dependent on an amount of charge stored in the corresponding one of the charge-storage devices.
12. A pixel according to claim 1 1 or any other claim herein wherein each readout circuit comprises a source follower transistor.
13. A pixel according to claim 1 1 or any other claim herein wherein each readout circuit comprises a trans-impedance amplifier (TIA).
14. A pixel according to any one of claims 1 1 to 13 or any other claim herein wherein each readout circuit is selectively connectable to the corresponding one of the charge storage units to output the corresponding output signal in response to a pixel select signal cpse|.
15. A pixel according to any one of claims 1 1 to 13 or any other claim herein wherein each readout circuit is selectively connectable to the corresponding one of the charge storage units to output the corresponding output signal in response to a combination of an output transfer signal (ptran and a pixel select signal cpse|.
16. A pixel according to any one of claims 1 1 to 15 or any other claim herein wherein each readout circuit is selectively connectable to the corresponding one of the charge-storage units once per exposure period TeXp0 during which the pixel is exposed to light at the conclusion of the exposure period TeXp0 and prior to any next exposure period.
17. A pixel according to any one of claims 1 1 to 16 or any other claim herein wherein the photodetector is fabricated on a first microelectronic chip and the one or more readout circuits are fabricated on the same first microelectronic chip or on one or more second stacked microelectronic chips stacked with the first microelectronic chip..
18. A pixel according to any one of claims 1 to 17 or any other claim herein
wherein each charge-storage device comprises a charge-storage capacitor.
19. A pixel according to any one of claims 1 to 18 or any other claim herein
wherein the photodetector is fabricated on a first microelectronic chip and the plurality of charge-storage devices are fabricated on the same first microelectronic chip or on one or more second stacked microelectronic chips stacked with the first microelectronic chip..
20. A pixel according to any one of claims 1 to 19 or any other claim herein
wherein each valve switch comprises a CMOS transistor, the gate of the CMOS transistor providing the control input of the valve switch and the source of the CMOS transistor connected to one of the photodetector and the corresponding charge-storage device and the drain of the CMOS transistor connected to the other one of the photodetector and the corresponding charge-storage device.
21 . A pixel according to any one of claims 1 to 20 or any other claim herein
wherein the photodetector is fabricated on a first microelectronic chip and the plurality of valve switches are fabricated on the same first microelectronic chip or on one or more second stacked microelectronic chips stacked with the first microelectronic chip.
22. A pixel according to any one of claims 1 to 21 or any other claim herein
comprising a plurality of reset switches, each reset switch selectively connectable to a corresponding one of the charge-storage devices to reset a voltage level at the corresponding one of the charge-storage devices.
23. A pixel according to claim 22 or any other claim herein wherein each reset switch is selectively connectable to the corresponding one of the charge- storage devices in response to a pixel reset signal cprst.
24. A pixel according to any one of claims 22 to 23 or any other claim herein wherein each reset switch is selectively connectable to the corresponding one of the charge-storage devices once per exposure period TeXp0 during which the pixel is exposed to light immediately prior to the exposure period TeXp0.
25. A pixel according to any one of claims 1 to 24 or any other claim herein
wherein one of the exposure code signals is complementary to at least one other one of the exposure code signals such that the switching states of valve switches that receive the one of the exposure code signals and the other one of the exposure code signals are opposite to one another.
A pixel according to any one of claims 1 to 25 or any other claim herein wherein the plurality of charge-storage devices comprises two charge-storage devices and the corresponding plurality of valve switches comprise two corresponding valve switches.
A pixel according to claim 26 or any other claim herein comprising a code memory unit connected to receive a corresponding input exposure code signal and selectively connectable to provide a corresponding exposure code signal <Pcode(+) to the control input of a first one of the two valve switches to thereby control the switching state of the first one of the two valve switches.
A pixel according to claim 27 or any other claim herein comprising a digital inverter connected to receive corresponding exposure code signal (pCOde(+) from the code-memory unit and to output a complementary exposure code signal <Pcode(-) to the control input of a second one of the two valve switches to thereby control the switching state of the second one of the two valve switches, the switching state of the second one of the two valve switches being opposite to the switching state of the first one of the two valve switches.
A pixel according to claim 27 or any other claim herein wherein the code memory unit comprises a static random access (SRAM) cell which receives the input exposure code signal and stores the exposure code signal (pCOde(+) and a complementary exposure code signal (pCOde(-) and which is selectively connectable to provide the complementary exposure code signal (pCOde(-) to the control input of a second one of the two valve switches to thereby control the switching state of the second one of the two valve switches, the switching state of the second one of the two valve switches being opposite to the switching state of the first one of the two valve switches.
A pixel for an image sensor comprising:
a photodetector for emitting charge in response to light incident thereon; first and second charge-storage devices and a valve switch, each of the first and second charge-storage devices selectively connectable to receive charge from the photodetector by control of a switching state of the valve switch between the photodetector and either one of the first and second charge-storage devices;
wherein the switching state of the valve switch is responsive to a corresponding exposure code signal (pCOde received at a control input of the valve switch.
31 . A pixel according to claim 30 or any other claim herein comprising any
features, combinations of features and/or sub-combinations of features of claims 1 to 29.
32 An image-capture device for capturing exposure encoded images on a pixel array, the image-capture device comprising:
a pixel array, each pixel of the array comprising:
a photodetector for emitting charge in response to light incident thereon;
a plurality of charge-storage devices and a corresponding plurality of valve switches, each charge-storage device selectively connectable to receive charge from the photodetector by control of a switching state of its corresponding valve switch;
wherein the switching state of each valve switch is responsive to a corresponding exposure code signal (pCOde received at a control input of the valve switch;
a digital processor connected to provide control signals, the control signals comprising the exposure code signals, to the pixel array and configured to provide the control signals in a manner which causes the pixel array to capture an exposure encoded image wherein, for an exposure period TeXp0 associated with the exposure encoded image during which the pixel array is exposed to light and for each pixel, the selective connection of the photodetector to each charge-storage device is temporally intermittent.
33. An image-capture device according to claim 32 or any other claim herein
wherein each exposure code signal provided by the processor to the pixel array and received at the control input of a corresponding valve switch is a binary signal having binary values capable of changing in each of a plurality of exposure sub-periods during the exposure period TeXp0.
34. An image-capture device according to claim 33 or any other claim herein
wherein the processor is configured to provide updated exposure code signals to each pixel in the array once for each exposure sub-period during the exposure period Texpo.
35. An image-capture device according to claim 34 or any other claim herein
wherein the processor is connected to provide the exposure code signals to the pixels over a plurality of column busses and, in each exposure sub-period during the exposure period TeXp0, is configured to provide the updated exposure code signals to the pixels on a row-by-row basis, the provision of updated exposure code signals to each row of pixels gated by a corresponding row control signal q
36. An image-capture device according to any one of claims 33 to 35 or any other claim herein wherein, after the updated exposure codes are provided to each pixel in the array, each pixel in the array operates according to the updated exposure codes for a remainder of the exposure period Texpo.
37. An image-capture device according to any one of claims 33 to 36 or any other claim herein wherein the exposure period Texpo may be offset for different pixels (e.g. for different individual pixels or different rows of pixels) in the array.
38. An image-capture device according to any one of claims 32 to 37 or any other claim herein wherein each pixel comprises one or more readout circuits, each readout circuit associated with a corresponding one of the plurality of charge- storage devices and selectively connectable to the corresponding one of the charge-storage devices to output a corresponding output signal, the corresponding output signals dependent on an amount of charge stored in the corresponding one of the charge-storage devices.
39. An image-capture device according to claim 38 or any other claim herein wherein the processor is configured to provide pixel select signals cpsei to the array to thereby selectively connect each readout circuit to the corresponding one of the charge storage units to output the corresponding output signal once per exposure period TeXp0 at the conclusion of the exposure period TeXp0 and prior to any next exposure period.
40. An image-capture device according to claim 38 or any other claim herein wherein the processor is configured to provide pixel select signals cpsei and output transfer signals φΐΓ3η to the array to thereby selectively connect each readout circuit to the corresponding one of the charge storage units to output the corresponding output signal once per exposure period TeXp0 at the conclusion of the exposure period TeXp0 and prior to any next exposure period.
41 . An image-capture device according to any one of claims 32 to 40 or any other claim herein wherein each pixel comprises a plurality of reset switches, each reset switch selectively connectable to a corresponding one of the charge- storage devices to reset a voltage level at the corresponding one of the charge-storage devices.
42. An image-capture device according to claim 41 or any other claim herein wherein the processor is configured to provide pixel reset signals cprst to the array to thereby reset each charge-storage device once per exposure period TeXpo immediately prior to the exposure period TeXp0.
43. An image-capture device according to any one of claims 32 to 42 or any other claim herein comprising any of the features, combinations of features or subcombinations of features of any of claims 1 to 31 .
44. A method for facilitating intermittent exposure of a pixel in an image sensor, the method comprising:
providing a pixel comprising: a photodetector for emitting charge in response to light incident thereon, a plurality of charge-storage devices and a corresponding plurality of valve switches, each charge-storage device selectively connectable to receive charge from the photodetector by control of a switching state of its corresponding valve switch;
for each of a plurality of exposure sub-periods in an exposure period TeXp0 during which the pixel is exposed to light, providing an exposure code signal cpcode at a control input of each valve switch, to thereby control the switching state of the valve switch.
45. A method according to claim 44 or any other claim herein wherein, for each of a plurality of exposure sub-periods in an exposure period Texpo during which the pixel is exposed to light, providing an exposure code signal <pcode at a control input of each valve switch, comprises providing a binary exposure code signal (pCOde-
46. A method according to any one of claims 44 to 45 or any other claim herein comprising providing each exposure code signal to a corresponding code- memory unit which is selectively connectable to provide the exposure code signal (pCOde to the control input of a corresponding one of the plurality of valve switches to thereby control the switching state of the corresponding one of the valve switches.
47. A method according to claim 46 or any other claim herein wherein each code- memory unit comprises a memory for maintaining the corresponding exposure code signal at the control input of the corresponding one of the valve switches.
48. A method according to any one of claims 46 to 47 or any other claim herein comprising providing a control signal (pctri which causes the selective connection of each code-memory unit to provide the corresponding exposure code signal to the control input of the corresponding one of the plurality of valve switches.
49. A method according to any one of claims 46 to 48 or any other claim herein wherein the photodetector is fabricated on a first microelectronic chip and the plurality of code-memory units are fabricated on the same first microelectronic chip or on one or more second stacked microelectronic chips stacked with the first microelectronic chip.
50. A method according to any one of claims 44 to 49 or any other claim herein comprising selectively connecting one or more of the plurality of charge- storage devices to one or more corresponding readout circuits to output one or more corresponding output signals, each corresponding output signal dependent on an amount of charge stored in a corresponding one of the charge-storage devices.
51 . A method according to claim 50 or any other claim herein comprising providing a pixel select signal cpsei which causes the selective connection of the one or more charge-storage devices to the one or more corresponding readout circuits.
52. A method according to claim 50 or any other claim herein comprising providing a combination of an output transfer signal (ptran and a pixel select signal cpsei which causes the selective connection of the one or more charge-storage devices to the one or more corresponding readout circuits.
53. A method according to any one of claims 50 to 52 or any other claim herein comprising selectively connecting the one or more readout circuits to the one or more the charge-storage units once per exposure period TeXp0 at the conclusion of the exposure period TeXp0 and prior to any next exposure period.
54. A method according to any one of claims 50 to 53 or any other claim herein wherein the photodetector is fabricated on a first microelectronic chip and the one or more readout circuits are fabricated on the same first microelectronic chip or on one or more second stacked microelectronic chips stacked with the first microelectronic chip.
55. A method according to any one of claims 44 to 54 or any other claim herein wherein each charge-storage device comprises a charge-storage capacitor.
56. A method according to any one of claims 44 to 55 or any other claim herein wherein the photodetector is fabricated on a first microelectronic chip and the plurality of charge-storage devices are fabricated on the same first microelectronic chip or on one or more second stacked microelectronic chips stacked with the first microelectronic chip.
57. A method according to any one of claims 44 to 56 or any other claim herein wherein each valve switch comprises a CMOS transistor, the gate of the CMOS transistor providing the control input of the valve switch and the source of the CMOS transistor connected to one of the photodetector and the corresponding charge-storage device and the drain of the CMOS transistor connected to the other one of the photodetector and the corresponding charge-storage device.
58. A method according to any one of claims 44 to 57 or any other claim herein wherein the photodetector is fabricated on a first microelectronic chip and the plurality of valve switches are fabricated on the same first microelectronic chip or on one or more second stacked microelectronic chips stacked with the first microelectronic chip.
59. A method according to any one of claims 44 to 58 or any other claim herein comprising selectively connecting each of a plurality of reset switches to a corresponding one of the charge-storage devices to reset a voltage level at the corresponding one of the charge-storage devices.
60. A method according to claim 59 or any other claim herein comprising providing a pixel reset signals cprst which cause the selective connection of each reset switch to the corresponding one of the charge-storage devices.
61 . A method according to any one of claims 59 to 60 or any other claim herein comprising selectively connecting each reset switch to the corresponding one of the charge-storage devices once per exposure period TeXp0 immediately prior to the exposure period TeXp0.
62. A method according to any one of claims 44 to 61 or any other claim herein wherein one of the exposure code signals is complementary to at least one other one of the exposure code signals such that the switching states of valve switches that receive the one of the exposure code signals and the other one of the exposure code signals are opposite to one another.
A method according to any one of claims 44 to 62 or any other claim herein wherein the plurality of charge-storage devices comprises two charge-storage devices and the corresponding plurality of valve switches comprise two corresponding valve switches.
A method according to claim 63 or any other claim herein comprising providing a code memory unit connected to receive a corresponding input exposure code signal and selectively connectable to provide a corresponding exposure code signal (pCOde(+) to the control input of a first one of the two valve switches to thereby control the switching state of the first one of the two valve switches.
A method according to claim 64 or any other claim herein comprising connecting a digital inverter to receive corresponding exposure code signal <Pcode(+) from the code-memory unit and to output a complementary exposure code signal cpCode(-) to the control input of a second one of the two valve switches to thereby control the switching state of the second one of the two valve switches, the switching state of the second one of the two valve switches being opposite to the switching state of the first one of the two valve switches.
A method according to claim 64 or any other claim herein wherein the code memory unit comprises a static random access (SRAM) cell which receives the input exposure code signal and stores the exposure code signal (pCOde(+) and a complementary exposure code signal (pCOde(-) and which is selectively connectable to provide the complementary exposure code signal (pCOde(-) to the control input of a second one of the two valve switches to thereby control the switching state of the second one of the two valve switches, the switching state of the second one of the two valve switches being opposite to the switching state of the first one of the two valve switches.
67. A method according to any one of claims 44 to 66 or any other claim herein comprising any of the features, combinations of features or sub-combinations of features of any of claims 1 to 43.
68. A method for facilitating intermittent exposure of a pixel in an image sensor the method comprising
providing a pixel comprising: a photodetector for emitting charge in response to light incident thereon; first and second charge-storage devices and a valve switch, each of the first and second charge-storage devices selectively connectable to receive charge from the photodetector by control of a switching state of the valve switch between the photodetector and either one of the first and second charge-storage devices;
for each of a plurality of exposure sub-periods in an exposure period TeXp0 during which the pixel is exposed to light, providing an exposure code signal cpcode at a control input of the valve switch, to thereby control the switching state of the valve switch.
69. A method according to claim 68 or any other claim herein comprising any of the features, combinations of features or sub-combinations of features of any of claims 1 to 67.
70. A method for operating an image-capture device to capture exposure encoded images on a pixel array, the method comprising:
providing a pixel array, each pixel of the array comprising: a photodetector for emitting charge in response to light incident thereon; a plurality of charge- storage devices and a corresponding plurality of valve switches, each charge- storage device selectively connectable to receive charge from the
photodetector by control of a switching state of its corresponding valve switch; for each valve switch of each pixel and for each of a plurality of exposure sub-periods in an exposure period TeXp0 during which the pixel is exposed to light, providing an exposure code signal (pCOde at a control input of the valve switch to thereby control the switching state of the valve switch;
providing control signals, the control signals comprising the exposure code signals, to the pixel array in a manner which causes the pixel array to capture an exposure encoded image wherein, for the exposure period TeXp0, the selective connection of the photodetector to each charge-storage device is temporally intermittent.
A method according to claim 70 or any other claim herein comprising any of the features, combinations of features or sub-combinations of features of any of claims 1 to 69.
Apparatus having any new and inventive feature, combination of features, or sub-combination of features as described herein.
Methods having any new and inventive steps, acts, combination of steps and/or acts or sub-combination of steps and/or acts as described herein.
PCT/CA2017/050926 2017-05-02 2017-08-02 Cmos image sensors with pixel-wise programmable exposure encoding and methods for use of same WO2018201219A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201762500376P 2017-05-02 2017-05-02
US62/500,376 2017-05-02

Publications (1)

Publication Number Publication Date
WO2018201219A1 true WO2018201219A1 (en) 2018-11-08

Family

ID=64015908

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CA2017/050926 WO2018201219A1 (en) 2017-05-02 2017-08-02 Cmos image sensors with pixel-wise programmable exposure encoding and methods for use of same

Country Status (1)

Country Link
WO (1) WO2018201219A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4207792A1 (en) * 2021-12-31 2023-07-05 Samsung Electronics Co., Ltd. A flexible computational image sensor with compressive sensing capability

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1997008647A1 (en) * 1995-08-25 1997-03-06 Psc, Inc. Optical reader with condensed cmos circuitry
US20010002045A1 (en) * 1994-01-28 2001-05-31 California Institute Of Technology CMOS active pixel sensor type imaging system on a chip
US20020117690A1 (en) * 1999-07-14 2002-08-29 Rhodes Howard E. CMOS imager with storage capacitor
US7199405B2 (en) * 2000-02-25 2007-04-03 Micron Technology, Inc. Pixel cell with high storage capacitance for a CMOS imager

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20010002045A1 (en) * 1994-01-28 2001-05-31 California Institute Of Technology CMOS active pixel sensor type imaging system on a chip
WO1997008647A1 (en) * 1995-08-25 1997-03-06 Psc, Inc. Optical reader with condensed cmos circuitry
US20020117690A1 (en) * 1999-07-14 2002-08-29 Rhodes Howard E. CMOS imager with storage capacitor
US7199405B2 (en) * 2000-02-25 2007-04-03 Micron Technology, Inc. Pixel cell with high storage capacitance for a CMOS imager

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP4207792A1 (en) * 2021-12-31 2023-07-05 Samsung Electronics Co., Ltd. A flexible computational image sensor with compressive sensing capability

Similar Documents

Publication Publication Date Title
US20170339327A1 (en) Image sensor combining high dynamic range techniques
US10244191B2 (en) Imaging systems with flicker mitigation and high dynamic range
CN100574384C (en) Camera head and image capture method
CN102970493B (en) Many level resetting voltage of multiple conversion gain image sensor
US9247170B2 (en) Triple conversion gain image sensor pixels
US7427736B2 (en) Method and apparatus for providing a rolling double reset timing for global storage in image sensors
US9030583B2 (en) Imaging system with foveated imaging capabilites
US20140063300A1 (en) High dynamic range imaging systems having clear filter pixel arrays
US9099367B2 (en) Image sensor and image processing device including the same
JP2008067107A (en) Photoelectric conversion device and imaging device
JP2017055322A (en) Imaging apparatus, imaging system, and control method for imaging apparatus
CN103595930A (en) Solid-state imaging device, driving method, and electronic device
US11284032B2 (en) Imaging device, semiconductor device and camera
US9055241B2 (en) Solid-state image pickup device, image pickup device, and signal reading method including an averaging circuit for averaging accumulated signals
US8896736B2 (en) Solid-state imaging device, imaging apparatus and signal reading method having photoelectric conversion elements that are targets from which signals are read in the same group
US9350920B2 (en) Image generating apparatus and method
US9225919B2 (en) Image sensor systems and methods for multiple exposure imaging
CN104660925A (en) High Dynamic Range Image Sensor Read Out Architecture
US9843746B2 (en) Image sensor combining high dynamic range techniques
US9854186B2 (en) Methods and apparatus for an images sensor with row-level gain control
TW201733343A (en) Global shutter correction
US9338372B2 (en) Column-based high dynamic range imaging systems
JP7146022B2 (en) Semiconductor device, imager, and method performed by the imager
JP5053892B2 (en) Solid-state image sensor
WO2018201219A1 (en) Cmos image sensors with pixel-wise programmable exposure encoding and methods for use of same

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 17908193

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 17908193

Country of ref document: EP

Kind code of ref document: A1