WO2021128535A1 - Système de lecture de pixels de capteur de vision bionique à double modalité - Google Patents

Système de lecture de pixels de capteur de vision bionique à double modalité Download PDF

Info

Publication number
WO2021128535A1
WO2021128535A1 PCT/CN2020/073537 CN2020073537W WO2021128535A1 WO 2021128535 A1 WO2021128535 A1 WO 2021128535A1 CN 2020073537 W CN2020073537 W CN 2020073537W WO 2021128535 A1 WO2021128535 A1 WO 2021128535A1
Authority
WO
WIPO (PCT)
Prior art keywords
type
control circuit
dual
vision sensor
target
Prior art date
Application number
PCT/CN2020/073537
Other languages
English (en)
Chinese (zh)
Inventor
施路平
杨哲宇
赵蓉
裴京
徐海峥
Original Assignee
清华大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 清华大学 filed Critical 清华大学
Publication of WO2021128535A1 publication Critical patent/WO2021128535A1/fr

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith
    • H04N25/71—Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/75—Circuitry for providing, modifying or processing image signals from the pixel array

Definitions

  • the present invention relates to the field of integrated circuit technology, and more specifically, to a dual-mode bionic vision sensor pixel readout system.
  • bionic vision sensors are playing an increasingly important role in many application fields such as industrial manufacturing, intelligent transportation, and intelligent robots.
  • the bionic vision sensor mainly simulates the modalities of the retina of the human eye.
  • the retina of the human eye mainly includes two visual perception cells, namely cone cells and rod cells, corresponding to two different modalities respectively.
  • the mode of cone cells is mainly sensitive to absolute light intensity information and color information, and has high image restoration accuracy, but the restoration speed is slow; contrary to the mode of cone cells, rod cells mainly respond to light.
  • the strong gradient information is perceived, and it has a faster perceiving speed and a larger perceptual dynamic range, but it cannot perceive absolute light intensity information and color information.
  • bionic vision sensors in the prior art can only simulate one of the modalities of the retina of the human eye, forming a single perception mode, and thus can only perceive a certain type of information.
  • traditional cameras similar to cones, mainly perceive color information.
  • Dynamic Vision Sensor (DVS) similar to rod cells, mainly perceives light intensity gradient information.
  • DVS Dynamic Vision Sensor
  • the application scenarios of single-modal vision sensors are limited. For example, for a bionic vision sensor similar to cone cells, since it captures absolute light intensity information instead of light intensity gradient information, although it is widely used in home entertainment electronic equipment, it often faces speed in the field of industrial control. Insufficient dynamic range is too small and other issues, so it is difficult to apply.
  • the bionic vision sensor similar to the rod cell although the sensing speed is very fast, it is only sensitive to moving targets, which makes it difficult to capture images, or the captured images are of poor quality, which is difficult to meet the needs of entertainment electronic devices. Moreover, because the bionic vision sensor only contains a single perception mode, the bionic vision sensor will fail when this perception mode fails, which has great limitations for unmanned, unmanned aerial vehicles and other robots that have high requirements for stability. In addition, the current main indicators for evaluating the performance of the bionic vision sensor include image quality, dynamic range and shooting speed.
  • these three indicators are often mutually exclusive: for example, when the shooting speed increases, the dynamic range of the bionic vision sensor will decrease; when the image quality increases, the shooting speed will generally be It is difficult to take both into consideration at the same time.
  • a bionic vision sensor with dual perception modes that is, a dual-mode bionic vision sensor that can sense absolute light intensity information, color information, and light intensity gradient information at the same time, and furthermore, it is necessary to provide a matching pixel Read the system.
  • embodiments of the present invention provide a dual-mode bionic vision sensor pixel readout system.
  • the embodiment of the present invention provides a dual-mode bionic vision sensor pixel readout system, including: a digital-to-analog converter data input bus and a first data output bus;
  • the data input bus of the digital-to-analog converter is connected to the digital-to-analog converter corresponding to the control circuit of the first type, and the first data output bus is connected to the output terminal of the control circuit of the first type;
  • the control circuit of the first type It is the control circuit corresponding to the target first type photosensitive device in the pixel array of the dual-mode bionic vision sensor;
  • the target first-type photosensitive device is used to obtain a target light signal and convert the target light signal into a first-type current signal;
  • the first-type control circuit is used to compare the first-type current signal with The difference between the sum of the second-type current signals converted by a first preset number of non-target first-type photosensitive devices around the target first-type photosensitive device, and outputting information representing the light intensity gradient information in the target optical signal Specify a digital signal.
  • the dual-mode bionic vision sensor pixel readout system further includes: an addressing decoder;
  • the address decoder is used to read the output result of the second type of control circuit, the second type of control circuit is the control circuit corresponding to the second type of photosensitive device in the pixel array;
  • the second type photosensitive device is used to obtain the target light signal, extract the light signal of a specified frequency band from the target light signal, and convert the light signal of the specified frequency band into a third type current signal;
  • the second type of control circuit is configured to output an analog voltage signal representing the light intensity information in the target light signal based on the third type of current signal.
  • the dual-mode bionic vision sensor pixel readout system further includes: an analog-to-digital converter;
  • the analog-to-digital converter is connected to the addressing decoder, and the analog-to-digital converter is used to convert the output result of the second-type control circuit read by the addressing decoder into a digital voltage signal.
  • the dual-mode bionic vision sensor pixel readout system further includes: a second data output bus;
  • the second data output bus is connected to the analog-to-digital converter.
  • the dual-mode bionic vision sensor pixel readout system further includes: a correlated double sampling circuit CDS;
  • the CDS is connected between the second type control circuit and the address decoder.
  • every second predetermined number of control circuits of the first type share one digital-to-analog converter.
  • the dual-mode bionic vision sensor pixel readout system further includes: a first storage unit;
  • the first storage unit is configured to store the output results of the first-type control circuit for every second preset number.
  • the dual-mode bionic vision sensor pixel readout system further includes: a second storage unit;
  • the second storage unit is used to store all output results of the first-type control circuit stored in the first storage unit.
  • the dual-mode bionic vision sensor pixel readout system further includes: a clock and a phase-locked loop;
  • the clock is connected to the phase-locked loop, and the phase-locked loop is connected to the digital-to-analog converter corresponding to the first type of control circuit, the first storage unit, and the second storage unit.
  • the addressing decoder specifically includes: an X-direction addressing decoder and a Y-direction addressing decoder;
  • the X-direction addressing decoder is used to read the output result of the second-type control circuit corresponding to the second-type photosensitive device in each column of the pixel array;
  • the Y-direction addressing decoder is used to read the output results of the second-type control circuit corresponding to the second-type photosensitive device in each row of the pixel array.
  • a dual-mode bionic vision sensor pixel read-out system can realize data input and output to the first type of control circuit by using a digital-to-analog converter data input bus and a first data output bus to transmit data.
  • the high-speed transmission of data further increases the image generation speed of the dual-mode bionic vision sensor.
  • FIG. 1 is a schematic diagram of an arrangement of a pixel array of a dual-mode bionic vision sensor according to an embodiment of the present invention
  • FIG. 2 is a schematic diagram of the arrangement of a pixel array of a dual-mode bionic vision sensor according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a first-type current mode active pixel sensor circuit for controlling a target first-type photosensitive device according to an embodiment of the present invention
  • FIG. 4 is a schematic diagram of the variation of the designated digital signal input to the DAC 15 in the first type of current mode active pixel sensor circuit provided by an embodiment of the present invention
  • FIG. 5 is a schematic diagram of a specific structure of a first type of current mode active pixel sensor circuit provided by an embodiment of the present invention
  • FIG. 6 is a schematic structural diagram of a dual-mode bionic vision sensor pixel readout system provided by an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a specific structure of a voltage mode active pixel sensor circuit provided by an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of an address decoder provided by an embodiment of the present invention.
  • FIG. 9 is a schematic diagram of a specific structure of a second type of current mode active pixel sensor circuit provided by an embodiment of the present invention.
  • FIG. 10 is a schematic diagram of the connection of an addressing decoder provided by an embodiment of the present invention.
  • FIG. 11 is a schematic structural diagram of a CDS provided by an embodiment of the present invention.
  • FIG. 12 is a circuit timing diagram of a CDS provided by an embodiment of the present invention.
  • Figure 13 is a schematic structural diagram of a CDS provided by an embodiment of the present invention.
  • FIG. 14 is a schematic structural diagram of a pixel readout system of a dual-mode bionic vision sensor provided by an embodiment of the present invention.
  • connection should be interpreted broadly. For example, they may be fixed connections or Removable connection or integral connection; it can be mechanical connection or electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal communication between two components.
  • connection should be interpreted broadly. For example, they may be fixed connections or Removable connection or integral connection; it can be mechanical connection or electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal communication between two components.
  • the embodiment of the present invention provides a dual-mode bionic vision sensor pixel readout system, including: a digital-to-analog converter data input bus and a first data output bus;
  • the data input bus of the digital-to-analog converter is connected to a digital-to-analog converter (DAC) corresponding to the control circuit of the first type, and the first data output bus is connected to the output terminal of the control circuit of the first type;
  • DAC digital-to-analog converter
  • One type of control circuit is the control circuit corresponding to the target first type photosensitive device in the pixel array of the dual-mode bionic vision sensor;
  • the target first-type photosensitive device is used to obtain a target light signal and convert the target light signal into a first-type current signal;
  • the first-type control circuit is used to compare the first-type current signal with The difference between the sum of the second-type current signals converted by a first preset number of non-target first-type photosensitive devices around the target first-type photosensitive device, and outputting information representing the light intensity gradient information in the target optical signal Specify a digital signal.
  • the pixel array of the dual-mode bionic vision sensor is formed by arranging a plurality of first-type photosensitive devices and a plurality of second-type photosensitive devices. Specifically, it may be composed of first-type photosensitive devices and second-type photosensitive devices. The photosensitive devices are arranged alternately. Each photosensitive device of the first type and each photosensitive device of the second type respectively serve as a pixel. Among them, the number of photosensitive devices of the first type and the number of photosensitive devices of the second type can be set according to the size of the pixel array, and can be the same or different, which is not specifically limited in the embodiment of the present invention.
  • Both the first type of photosensitive device and the second type of photosensitive device are used to obtain the target light signal.
  • the first type of photosensitive device includes the target type 1 photosensitive device and the non-target type 1 photosensitive device.
  • the target type 1 photosensitive device is also used to convert the target light signal into the first type current signal
  • the non-target type 1 photosensitive device is also Used to convert the target light signal into the second type current signal.
  • the first type of photosensitive device may specifically be a photodiode with the same response curve.
  • the second type of photosensitive device is also used to extract the optical signal of the specified frequency band from the target optical signal, and convert the optical signal of the specified frequency band into the third type of current signal.
  • the second type of photosensitive device has photodiodes that may have different response curves.
  • the response frequency band of the second type of photosensitive device is specifically a designated frequency band, and the designated frequency band may be a red light frequency band, a blue light frequency band or a green light frequency band.
  • the second type of photosensitive device can also be composed of photodiodes and color filters (CF) with the same response curve.
  • the color filters can specifically be red, blue, or green filters, respectively It is used to extract the optical signal in the red, blue or green frequency band from the target optical signal.
  • the color filter may be a light filter or a lens. When the color filter is a lens, a Byron lens may be used, or other types of lenses may be used.
  • the second type of photosensitive device is composed of photodiodes and color filters with the same response curve as an example for description.
  • the pixel array of the dual-mode bionic vision sensor can be arranged as shown in Figure 1.
  • Figure 1 only shows a 7 ⁇ 7 pixel array, consisting of 25 first-type photosensitive devices 11 and 24 second-type photosensitive devices The 12-phase arrangement is formed.
  • the “+” marks in Figure 1 are the target first-type photosensitive devices, the “-” marks are non-target first-type photosensitive devices, and the R, G, and B marks are all second-type photosensitive devices. And respectively represent the second type of photosensitive device that extracts light signals in the red frequency band, the second type of photosensitive device that extracts light signals in the green frequency band, and the second type of photosensitive device that extracts light signals in the blue frequency band.
  • the dual-mode bionic vision sensor may also be as shown in FIG. 2 or other arrangements, which are not specifically limited in the embodiment of the present invention.
  • Each target first-type photosensitive device corresponds to a control circuit
  • the control circuit corresponding to the target first-type photosensitive device is a first-type control circuit, specifically a first-type current-mode active pixel sensor circuit, which is used based on the first-type The difference between the current signal and the sum of the second-type current signal converted by the first preset number of non-target first-type photosensitive devices around the target first-type photosensitive device, and output the designation that characterizes the light intensity gradient information in the target optical signal Digital signal.
  • the first type of control circuit is used to simulate the action of excitatory rod cells.
  • the control circuit of the first type includes a target first-type photosensitive device, a first current amplifier, a comparator, an adder, a digital-to-analog converter, and a tri-state gate circuit; the target first-type photosensitive device is connected to the first current amplifier, so The first current amplifier is connected to an input terminal of the comparator; the input terminals of the adder are respectively connected to the first type control switch, and the output terminal of the adder is connected to the other input of the comparator.
  • the output terminal of the comparator is connected to the digital-to-analog converter, and the digital-to-analog converter converts the input specified digital signal into a specified analog signal, and outputs the specified analog signal to the first The current amplifier or the adder until the output terminal of the comparator outputs an event pulse signal, that is, the comparator is in an edge trigger state, the first type current mode active pixel sensor circuit outputs the designated digital signal, and the The designated digital signal is used to characterize the light intensity gradient information in the target light signal.
  • the three-state gate circuit is respectively connected to the output terminal of the comparator and the input terminal of the digital-to-analog converter; the three-state gate circuit is used to output the event pulse signal at the output terminal of the comparator , That is, when the comparator is in the edge trigger state, the specified digital signal is output.
  • the first-type current mode active pixel sensor circuit in FIG. 3 includes a target first-type photosensitive device 11, a first current amplifier 12, a comparator 13, an adder 14, and a digital to analog converter (DAC) 15.
  • DAC digital to analog converter
  • the target first-type photosensitive device 11 is connected to the first current amplifier 12, and the first current amplifier 12 is used to amplify the first-type current signal I 0 converted by the target first-type photosensitive device 11, and the amplification factor is the first preset Set the number, that is, the magnification factor is equal to the number of non-target first-type photosensitive devices around the target first-type photosensitive device 11, so as to ensure that the amplified first-type current signal is equal to the first type around the target first-type photosensitive device 11. It is assumed that the sum of the second-type current signals converted by the number of non-target second-type photosensitive devices is on the same order of magnitude.
  • the first type of photosensitive device provided in the embodiment of the present invention does not extract the optical signal of the specified frequency band from the target light signal, that is, the response curves are all the same or there is no filter in the first type of photosensitive device, therefore The response frequency band of the first type of photosensitive device is related to itself.
  • the first current amplifier 12 is connected to an input terminal of the comparator 13 and inputs the amplified first-type current signal into the comparator 13.
  • the four non-target first-type photosensitive devices around the target first-type photosensitive device 11 are all connected to the input ends of the adder 14 respectively. Because each non-target first-type photosensitive device is connected in series with a first-type control switch. In the embodiment of the present invention, only the first-type control switches M 1 , M 2 , M 3 , and M 4 connected in series with each non-target first-type photosensitive device are shown.
  • the output terminal of the adder 14 is connected to the other input terminal of the comparator 13.
  • the current signals I 1 , I 2 , I 3 , and I 4 obtained by the conversion of the four non-target type 1 photosensitive devices are input to the adder 14 respectively, and the adder 14 calculates I 1 , I 2 , I 3 , and I 4 And input the sum result to the comparator 13.
  • the comparator 13 compares the amplified first-type current signal and the sum result of the adder 14. If the comparison result between the current moment and the current moment is consistent, no output is made.
  • the DAC15 converts the input designated digital signal into a designated analog signal, and outputs the designated analog signal to the first current amplifier 12 or the adder 14, and then outputs it to the first current amplifier 12 or the adder 14.
  • the designated analog signal of a current amplifier 12 is denoted as I DA2
  • the designated analog signal output to the adder 14 is denoted as I DA1 .
  • the comparator 13 is used for comparison.
  • the output terminal of the comparator 13 outputs the event pulse signal, that is, the comparator 13 is in the edge-triggered state.
  • the first type of current The pattern active pixel sensor circuit outputs a designated digital signal, and the designated digital signal is used to characterize the light intensity gradient information in the target light signal.
  • the designated digital signal output by the first-type current mode active pixel sensor circuit is a digital signal represented by 0 and 1.
  • the tri-state gate circuit 41 is respectively connected to the output terminal of the comparator 13 and the input terminal of the DAC 15; the tri-state gate circuit 41 is used to output an event pulse signal at the output terminal of the comparator 13, that is, when the comparator 13 is in the edge trigger state, The specified digital signal is output.
  • the designated digital signal input to the DAC15 can be a designated digital signal that is manually inputted periodically.
  • the change form of the designated digital signal is shown in Fig. 4, and the designated digital signal increases stepwise with time.
  • the designated digital signal value is ⁇ I
  • the comparator 13 outputs an event pulse signal, that is, the comparator 13 is in an edge-triggered state, and the ⁇ I at this time is used as the output of the first-type current mode active pixel sensor circuit.
  • N is the number of steps passed before, and step is the time length of each step.
  • FIG. 5 it is a schematic diagram of the specific structure of the first type of current mode active pixel sensor circuit provided in the embodiment of the present invention.
  • the circuit structure 51 simulates a rod cell circuit
  • the circuit structure 52 simulates a ganglion cell and a bipolar cell.
  • Vcc is the power supply of the control circuit.
  • the target first-type photosensitive device 53 is connected to Vcc.
  • the current mirror 54 in FIG. 5 is the first current amplifier.
  • Fig. 5 does not show the four non-target first-type photosensitive devices around the target first-type photosensitive device 53, only the first-type control switches M 1 , which are connected in series with each non-target first-type photosensitive device. M 2 , M 3 , M 4 .
  • the lines where I 1 , I 2 , I 3 , and I 4 are located are merged into one line to realize the function of an adder.
  • the combined line is connected to the input terminal of CP56.
  • the CP56 compares the amplified first-type current signal and the sum of I 1 , I 2 , I 3 , and I 4 .
  • the DAC55 converts the input designated digital signal into a designated analog signal, and outputs the designated analog signal to the target type 1 photosensitive device 53 or a non-target A type of photosensitive device.
  • the CP56 is used for comparison.
  • the output terminal of the CP56 outputs the event pulse signal, that is, the CP56 is in the edge-triggered state.
  • the three-state gate circuit 57 outputs the specified digital signal .
  • a capacitor 58 is also connected between CP56 and ground.
  • the capacitor 58 can be an actual capacitor or a virtual parasitic capacitor in the first-type current mode active pixel sensor circuit. This is in the embodiment of the present invention. There is no specific limitation.
  • the dual-mode bionic vision sensor pixel readout system includes: a digital-to-analog converter data input bus and a first data output bus; the digital-to-analog converter data input bus is connected to the DAC corresponding to the first type of control circuit , The first data output bus is connected with the output terminal of the first type of control circuit.
  • the pixel array used is composed of multiple M rows and N columns of sub-pixel arrays. Each sub-pixel array has a total of M ⁇ N pixels, which are Pixel(0,0), Pixel(1,0),... , Pixel(N,0),..., Pixel(N,M). Each pixel corresponds to one photosensitive device, and the arrangement of the photosensitive devices can be as shown in Fig. 1 or Fig. 2.
  • Each control circuit of the first type can correspond to a DAC, or as shown in Figure 6, a plurality of control circuits of the first type share one DAC, and the number of the control circuits of the first type sharing the DAC is specifically the second preset number. That is, the number of first-type control circuits corresponding to all target first-type photosensitive devices included in each sub-pixel array.
  • the data input bus and the first data output bus of the digital-to-analog converter are used to transmit data, and the input data and output data to the first-type control circuit can be realized.
  • the high-speed transmission which in turn improves the image generation speed of the dual-mode bionic vision sensor.
  • the dual-mode bionic vision sensor pixel readout system provided in the embodiment of the present invention further includes: an addressing decoder;
  • the address decoder is used to read the output result of the second type of control circuit, the second type of control circuit is the control circuit corresponding to the second type of photosensitive device in the pixel array;
  • the second type photosensitive device is used to obtain the target light signal, extract the light signal of a specified frequency band from the target light signal, and convert the light signal of the specified frequency band into a third type current signal;
  • the second type of control circuit is configured to output an analog voltage signal representing the light intensity information in the target light signal based on the third type of current signal.
  • the control circuit corresponding to the second type of photosensitive device in the pixel array of the dual-mode bionic vision sensor is a second type of control circuit
  • the second type of control circuit is specifically a voltage mode active pixel sensor circuit , For outputting an analog voltage signal representing the light intensity information in the target light signal based on the third type of current signal.
  • FIG. 7 in FIG. 7, there are a total of 4 second-type photosensitive devices, namely 71, 72, 73, and 74.
  • the second-type photosensitive device 71 and the second-type control switch 75 are connected in series to form the first device branch.
  • the second type of photosensitive device 72 and the second type of control switch 76 are connected in series to form a second device branch
  • the second type of photosensitive device 73 and the second type of control switch 78 are connected in series to form a third device branch
  • the second type of photosensitive device 74 is connected in series with
  • the second type of control switches 77 are connected in series to form a fourth device branch.
  • the first device branch, the second device branch, the third device branch, and the fourth device branch are connected in parallel to the MOS transistors 79 and 710, and the MOS transistor 710 is connected to the MOS transistor 711.
  • the MOS tube 79 is used for biasing, the MOS tube 710 is used for switching, and the MOS tube 711 is used for current integration of the third type current signal converted by the second type photosensitive device on a certain device branch to obtain the analog
  • the voltage signal represents the light intensity information in the target light signal.
  • the main function of the addressing decoder is to convert N channels of input data to 2N conversion.
  • the N inputs of the addressing decoder can be the output results of N second-type control circuits, denoted as I 0 , I 1 , ..., I N-1 , the addressing decoder’s 2 N output is denoted as The addressing decoder is controlled by the clock Clk and powered by En.
  • the address decoder is introduced to read the output results of the second-type control circuit, which can avoid that each second-type control circuit is connected to an output line to output the results, which can save resources and improve data.
  • the transmission speed is introduced to read the output results of the second-type control circuit, which can avoid that each second-type control circuit is connected to an output line to output the results, which can save resources and improve data.
  • the control circuit of the dual-mode bionic vision sensor further includes: a third control circuit for controlling each non-target first-type photosensitive device.
  • the third control circuit is specifically a second type of current mode active pixel sensor circuit.
  • the third control circuit includes a non-target first-type photosensitive device and a second preset number of current mirrors; each current mirror is connected in series with a second-type photosensitive device around the non-target first-type photosensitive device.
  • each second-type current mode active pixel sensor circuit in the embodiment of the present invention controls a non-target first-type photosensitive device.
  • the second-type current mode active pixel sensor circuit includes a non-target first-type photosensitive device 81 and four first-type current mirrors 82, 83, 84, 85.
  • Each first-type current mirror is connected in series with a target first-type photosensitive device around the non-target first-type photosensitive device 81, that is, the current signal I 1 obtained by the conversion of the non-target first-type photosensitive device 81 is copied into four I 1 , which are respectively used for the first-type current mode active pixel sensor circuit of each target first-type photosensitive device around the non-target first-type photosensitive device 81 to obtain the light intensity gradient information in the target light signal to achieve the non-target
  • the multiplexing of the first type of photosensitive device improves the pixel fill factor of the reconfigurable dual-mode bionic vision sensor.
  • the addressing decoder specifically includes: an X-direction addressing decoder and Y-direction addressing decoder;
  • the X-direction addressing decoder is used to read the output result of the second-type control circuit corresponding to the second-type photosensitive device in each column of the pixel array;
  • the Y-direction addressing decoder is used to read the output results of the second-type control circuit corresponding to the second-type photosensitive device in each row of the pixel array.
  • the size of each sub-pixel array is 40*40.
  • the dual-mode bionic vision sensor pixel readout system provided in the embodiment of the present invention further includes: an analog-to-digital converter (ADC), ADC and addressing decoding
  • ADC analog-to-digital converter
  • ADC is specifically connected with the X-direction addressing decoder, and the ADC is used to convert the output result of the second type of control circuit read by the addressing decoder into a digital voltage signal.
  • the output result of the second type of control circuit in FIG. 7 is the result obtained by the current integration of the MOS tube 711, which is an analog voltage signal, which needs to be connected to the ADC to achieve analog-to-digital conversion. Get the digital voltage signal.
  • the dual-mode bionic vision sensor pixel readout system provided in the embodiment of the present invention further includes: a second data output bus;
  • the second data output bus is connected to the analog-to-digital converter.
  • the dual-mode bionic vision sensor pixel readout system provided in the embodiment of the present invention further includes: a correlated double sampling circuit (Correlated Double Sampling, CDS), and the CDS is connected to
  • CDS Correlated Double Sampling
  • the second type of control circuit and the addressing decoder can be specifically connected between the second type of control circuit and the X-direction addressing decoder, and the CDS and the X-direction addressing decoder are connected through a bus.
  • CDS basic circuit shown in Figure 11 the left side in FIG. 11 only shows a control device of the second type branch circuit, the second type and the second type sensing device PD M TG control switch in series, and M TG
  • the MOS tube M RS and M SF are connected, and the MOS tube M SF is connected with the MOS tube M SEL .
  • the MOS tube M RS is used for biasing
  • the MOS tube M SF is used for switching
  • the MOS tube M SEL is used for current integration of the third type current signal obtained by PD conversion to obtain an analog voltage signal to represent the target light signal In the light intensity information, and output analog voltage signal.
  • M RS and M SF are also connected to a capacitor FD.
  • the capacitor FD may be an actual capacitor or a parasitic capacitor of the CDS, which is not specifically limited in the embodiment of the present invention.
  • FIG 11 is a right side the CDS, by two S / H circuit, and a differential amplifier, specifically to work: the reset level and the signal level is sampled and held in the capacitor C R, respectively, and the capacitance C S, C R are connected to the MOS transistor M R and M Y, C S is connected to the MOS transistor M S and M Y; each of the reset level and the signal level remains at the C R and C S is obtained by differentiating the output signal.
  • the circuit timing diagram of CDS is shown in Figure 12. In Figure 12 with They respectively represent the levels of the MOS transistors M SEL , M RS , the second type control switch M TG , and the MOS transistors M R , M S , and M Y.
  • the MOS tube M SEL is always on from t 1 to t 7 , so M SEL is always on.
  • ADC reads the reset level and switching noise, and then at t 2 Set high (at this time, the capacitor FD is reset) after the Stored in the capacitor CR ; at this time, the sample-and-hold reset signal is in the capacitor CR , and at t 3 Set high, and then read the signal level; at t 4 by Set high, opening charge a second type of control switch M TG accumulated in the FD is transferred to the capacitor; at the time t 5 Set high, the accumulated charge in the capacitor FD is sampled and held in C S ; finally, at t 6 Set high to realize the integration of the accumulation signal and the reset signal.
  • the schematic structural diagram of the CDS in the embodiment of the present invention may also be as shown in FIG. 13.
  • the specific values of the capacitors C 1 and C 2 can be set according to requirements, which are not specifically limited in the embodiment of the present invention.
  • the dual-mode bionic vision sensor pixel readout system provided in the embodiment of the present invention further includes: a first storage unit;
  • the first storage unit is configured to store the output results of the first-type control circuit for every second preset number.
  • the first storage unit that stores the output results of the first-type control circuit corresponding to all the target first-type photosensitive devices in the sub-pixel array.
  • the second preset number refers to the number of first-type control circuits corresponding to all target first-type photosensitive devices in each sub-pixel array.
  • the first storage unit may specifically be a register, a latch, an SRAM, a DRAM, a memristor, etc.
  • the dual-mode bionic vision sensor pixel readout system provided in the embodiment of the present invention further includes: a second storage unit;
  • the second storage unit is used for summarizing the output results of the first-type control circuit stored in all the first storage units.
  • the second storage unit which stores the control circuit of the first type in the first storage unit in all the sub-pixel arrays in the pixel array.
  • the output results are summarized.
  • the second storage unit may specifically be a register, a latch, an SRAM, a DRAM, a memristor, etc.
  • the dual-mode bionic vision sensor pixel readout system provided in the embodiment of the present invention further includes: a clock and a phase-locked loop;
  • the clock is connected to the phase-locked loop, and the phase-locked loop is connected to the digital-to-analog converter corresponding to the first type of control circuit, the first storage unit, and the second storage unit.
  • the sub-pixel array includes M rows and N columns of pixels, and the pixel arrangement can be as shown in FIG. 1 or FIG. 2.
  • the first-type control circuit corresponding to all the target first-type photosensitive devices in each sub-pixel array corresponds to the same DAC.
  • the input end of the DAC is connected to the data input bus of the digital-to-analog converter, and the input is DA_par, which is output by the DAC to each sub-pixel array.
  • the output of one type of control circuit is DA_val.
  • the X-direction addressing decoder and the Y-direction addressing decoder are used to respectively address the first-type control circuits corresponding to all target first-type photosensitive devices in each sub-pixel array in the X-direction and the Y-direction. Before addressing in the X direction, CDS is also used to reduce the output noise of the second type of control circuit.
  • the first storage unit stores the output results of the first-type control circuit corresponding to all the target first-type photosensitive devices in the sub-pixel array.
  • the first storage unit is connected to the second storage unit.
  • the second storage unit is connected to the user interface 1 through a first data bus, and the user interface 1 is used to display an image formed by a designated digital signal obtained by a dual-mode bionic vision sensor.
  • the X-direction addressing decoder is connected to the ADC, and the input of the ADC is AD_par.
  • the ADC is connected to the user interface 2 through a second data bus, and the user interface 2 is used to display the image formed by the digital voltage signal obtained by the dual-mode bionic vision sensor.
  • Fig. 14 also includes a logic control center, which is used to implement logic control; it also includes a user configuration interface, which is used to implement user configuration; and a third storage unit, which is used to implement storage of user configuration information.
  • the third storage unit may specifically be a register, a latch, an SRAM, a DRAM, a memristor, etc.
  • Fig. 14 also includes a clock CLK and a phase-locked loop (Phase Locked Loop, PLL).
  • the clock CLK is used to send a clock signal clk0 to the PLL to realize clock control of the PLL.
  • the clock CLK also sends the clock signal clk1 to the DAC through the PLL, the clock signal clk2 to the first storage unit, the clock signal clk3 to the second storage unit, the clock signal clk4 to the ADC, the clock signal clk5 to the user interface 1, and the logic
  • the control center sends the clock signal clk6 to realize the clock control of the DAC, the first storage unit, the second storage unit, the ADC, the user interface 1, and the logic control center.
  • the input of the DAC and the input of the ADC can be controlled through the logic control center.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

Des modes de réalisation de la présente invention concernent un système de lecture de pixels d'un capteur de vision bionique à double modalité. Des données sont transmises à l'aide d'un bus d'entrée de données de convertisseur numérique-analogique et d'un premier bus de sortie de données, de sorte que la transmission à grande vitesse des données d'entrée et des données de sortie d'un premier type de circuit de commande peut être mise en œuvre, puis que la vitesse de génération d'image du capteur de vision bionique à double modalité est augmentée.
PCT/CN2020/073537 2019-12-24 2020-01-21 Système de lecture de pixels de capteur de vision bionique à double modalité WO2021128535A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911348655.7A CN111083405B (zh) 2019-12-24 2019-12-24 双模态仿生视觉传感器像素读出系统
CN201911348655.7 2019-12-24

Publications (1)

Publication Number Publication Date
WO2021128535A1 true WO2021128535A1 (fr) 2021-07-01

Family

ID=70317295

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/073537 WO2021128535A1 (fr) 2019-12-24 2020-01-21 Système de lecture de pixels de capteur de vision bionique à double modalité

Country Status (2)

Country Link
CN (1) CN111083405B (fr)
WO (1) WO2021128535A1 (fr)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111770245B (zh) * 2020-07-29 2021-05-25 中国科学院长春光学精密机械与物理研究所 一种类视网膜图像传感器的像素结构
CN112600996B (zh) * 2020-12-03 2022-12-09 清华大学 紫外仿生视觉传感器
CN112543271B (zh) * 2020-12-03 2022-09-02 清华大学 双模态紫外仿生视觉传感器

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1835551A (zh) * 2005-03-18 2006-09-20 北京思比科微电子技术有限公司 Cmos图像传感器
CN101023680A (zh) * 2004-07-21 2007-08-22 微米技术有限公司 杆状细胞和视锥细胞响应传感器
EP2180599A1 (fr) * 2008-10-24 2010-04-28 Advanced Silicon SA Lecture d'imagerie par rayons X et système
CN103533263A (zh) * 2012-07-03 2014-01-22 三星电子株式会社 图像传感器芯片、操作方法和包括图像传感器芯片的系统
CN108282623A (zh) * 2018-01-26 2018-07-13 北京灵汐科技有限公司 成像元件、成像设备和图像信息处理方法
CN110536083A (zh) * 2019-08-30 2019-12-03 上海芯仑光电科技有限公司 一种图像传感器及图像采集系统

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108200362B (zh) * 2017-12-19 2019-10-18 清华大学 基于空间对比度的仿生视网膜摄像电路及子电路
KR102578417B1 (ko) * 2018-03-14 2023-09-14 소니 어드밴스드 비주얼 센싱 아게 직접 메모리 제어를 갖는 이벤트-기반 비전 센서
KR102178561B1 (ko) * 2018-12-04 2020-11-13 서울대학교산학협력단 시각 적응을 모사한 다이나믹 비전 센서
CN113192993B (zh) * 2019-03-26 2023-04-11 福州鑫图光电有限公司 一种图像传感器的成像方法
CN109842404A (zh) * 2019-04-01 2019-06-04 重庆鲁班机器人技术研究院有限公司 动态有源像素视觉传感器

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101023680A (zh) * 2004-07-21 2007-08-22 微米技术有限公司 杆状细胞和视锥细胞响应传感器
CN1835551A (zh) * 2005-03-18 2006-09-20 北京思比科微电子技术有限公司 Cmos图像传感器
EP2180599A1 (fr) * 2008-10-24 2010-04-28 Advanced Silicon SA Lecture d'imagerie par rayons X et système
CN103533263A (zh) * 2012-07-03 2014-01-22 三星电子株式会社 图像传感器芯片、操作方法和包括图像传感器芯片的系统
CN108282623A (zh) * 2018-01-26 2018-07-13 北京灵汐科技有限公司 成像元件、成像设备和图像信息处理方法
CN110536083A (zh) * 2019-08-30 2019-12-03 上海芯仑光电科技有限公司 一种图像传感器及图像采集系统

Also Published As

Publication number Publication date
CN111083405A (zh) 2020-04-28
CN111083405B (zh) 2021-06-04

Similar Documents

Publication Publication Date Title
WO2021128533A1 (fr) Capteur de vision bionique bimodal
WO2021128531A1 (fr) Capteur de vision bionique bimodal doté d'un cône rétinien et d'une tige rétinienne
WO2021128535A1 (fr) Système de lecture de pixels de capteur de vision bionique à double modalité
US10615190B2 (en) Dual conversion gain high dynamic range readout for comparator of double ramp analog to digital converter
CN106060430A (zh) 图像拾取装置、图像拾取系统和驱动图像拾取装置的方法
KR102324713B1 (ko) 이미지 센서의 램프 신호 생성기 및 이미지 센서
JP7248710B2 (ja) 複数のスーパーピクセルを有するイメージセンサ
CN105979173B (zh) 对双转换增益高动态范围传感器的补偿
WO2021128536A1 (fr) Réseau de pixels et capteur de vision bionique
TWI375465B (en) Correlation double sampling circuit for image sensor
WO2021128532A1 (fr) Capteur de vision bionique à cônes et bâtonnets rétiniens de multiplexage
US9554074B2 (en) Ramp generator for low noise image sensor
KR20120022034A (ko) 픽셀 데이터의 고속 출력을 위한 이미지 센서
US9900538B2 (en) Phase delay counting analog-to-digital converter circuitry
WO2021128534A1 (fr) Capteur de vision bionique à tige
KR20200113817A (ko) 이미지 센서
US20210266475A1 (en) Image sensor and electronic camera
US20170324913A1 (en) Image sensor combining high dynamic range techniques
CN103491324A (zh) 高速全局快门图像传感器像素及其像素信号的采样方法
CN105222900B (zh) 红外焦平面阵列读出电路
US11025851B2 (en) Fast image sensor with pixel binning
JP2015002415A (ja) 光電変換装置、光電変換システム、光電変換装置の駆動方法
US8902343B1 (en) Charge pump for pixel floating diffusion gain control
CN112040157B (zh) 具有减少的信号采样反冲的图像传感器
JPH06189319A (ja) 電子カラー画像システムとアナログ信号プロセッサ

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20904488

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20904488

Country of ref document: EP

Kind code of ref document: A1