WO2021128534A1 - Rod bionic vision sensor - Google Patents

Rod bionic vision sensor Download PDF

Info

Publication number
WO2021128534A1
WO2021128534A1 PCT/CN2020/073527 CN2020073527W WO2021128534A1 WO 2021128534 A1 WO2021128534 A1 WO 2021128534A1 CN 2020073527 W CN2020073527 W CN 2020073527W WO 2021128534 A1 WO2021128534 A1 WO 2021128534A1
Authority
WO
WIPO (PCT)
Prior art keywords
target
type
signal
photosensitive device
vision sensor
Prior art date
Application number
PCT/CN2020/073527
Other languages
French (fr)
Chinese (zh)
Inventor
施路平
杨哲宇
赵蓉
裴京
徐海峥
Original Assignee
清华大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 清华大学 filed Critical 清华大学
Publication of WO2021128534A1 publication Critical patent/WO2021128534A1/en

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/77Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components
    • H04N25/772Pixel circuitry, e.g. memories, A/D converters, pixel amplifiers, shared circuits or shared components comprising A/D, V/T, V/F, I/T or I/F converters
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/71Charge-coupled device [CCD] sensors; Charge-transfer registers specially adapted for CCD sensors
    • H04N25/75Circuitry for providing, modifying or processing image signals from the pixel array
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70SSIS architectures; Circuits associated therewith
    • H04N25/76Addressed sensors, e.g. MOS or CMOS sensors
    • H04N25/767Horizontal readout lines, multiplexers or registers

Definitions

  • the present invention relates to the field of integrated circuit technology, and more specifically, to a rod bionic vision sensor.
  • the current CMOS image sensor has some shortcomings that are difficult to overcome: the dynamic range of the CMOS sensor to acquire images is relatively small. Moreover, due to the low sub-sampling resolution of CMOS image sensors, saturation and distortion are likely to occur in scenes with strong, weak or high contrast. At the same time, because the CMOS image sensor acquires all the data in the light reflected by the external target object, it will cause image data redundancy and a large amount of data. Brings a lot of pressure to the subsequent image processing and storage. For row (column) scanning CMOS image sensors, the imaging speed is mainly limited by the conversion speed of the analog-to-digital converter (ADC). As the requirements for the scale of the photosensitive array continue to increase, The shooting speed of CMOS image sensors will become increasingly difficult to increase.
  • ADC analog-to-digital converter
  • an embodiment of the present invention provides a rod bionic vision sensor.
  • the embodiment of the present invention provides a rod bionic vision sensor, including: a first sub-circuit, the first sub-circuit includes a target first-type photosensitive device, a first current amplifier, a comparator, an adder, and a digital-to-analog converter ;
  • the target first-type photosensitive device is used to obtain a target light signal, and convert the target light signal into a first-type current signal;
  • the target first-type photosensitive device is connected to the first current amplifier, and the first current amplifier is connected to an input terminal of the comparator; the input terminals of the adder are respectively connected to the target first-type photosensitive device A first preset number of non-target type 1 photosensitive devices around the device are connected, and the output terminal of the adder is connected to the other input terminal of the comparator;
  • the output terminal of the comparator is connected to the digital-to-analog converter, and the digital-to-analog converter converts the input specified digital signal into a specified analog signal, and outputs the specified analog signal to the first current amplifier or The adder until the output terminal of the comparator outputs an event pulse signal, the first sub-circuit outputs the designated digital signal, and the designated digital signal is used to characterize the light intensity gradient information in the target optical signal ;
  • each of the non-target first-type photosensitive devices is connected in series with a first-type control switch.
  • the first sub-circuit further includes: a three-state gate circuit
  • the tri-state gate circuit is respectively connected with the output terminal of the comparator and the input terminal of the digital-to-analog converter;
  • the three-state gate circuit is used to output the designated digital signal when the event pulse signal is output at the output terminal of the comparator.
  • the first sub-circuit further includes: an addressing unit;
  • the addressing unit is respectively connected with the output terminal of the comparator and the input terminal of the digital-to-analog converter;
  • the addressing unit is used to output the designated digital signal when the event pulse signal is output at the output terminal of the comparator.
  • control circuit further includes: a second sub-circuit
  • the second sub-circuit includes one non-target first-type photosensitive device and the second preset number of first-type current mirrors;
  • Each first-type current mirror is respectively connected in series with a target first-type photosensitive device around the non-target first-type photosensitive device.
  • the first-type control switches are turned on at the same time, and when the intensity of the target light signal is less than a second preset value, all the The first type of control switch is turned off at the same time.
  • the designated digital signal output by the first sub-circuit is a differential mode signal
  • the designated digital signal output by the first sub-circuit is a common mode signal
  • the first current amplifier is specifically a second type current mirror.
  • the first sub-circuit further includes: a second current amplifier
  • the second current amplifier is connected between the target first-type photosensitive device and the first current amplifier.
  • the first sub-circuit further includes: a storage unit;
  • the storage unit is used to store the designated digital signal.
  • the rod bionic vision sensor provided by the embodiment of the present invention realizes the perception of light intensity gradient information in the target light signal by simulating the function of rod cells, thereby increasing the dynamic range of the bionic vision sensor image and increasing the shooting speed .
  • a first-type control switch is introduced for each non-target first-type photosensitive device, which can control the obtained light intensity gradient information, realize the adjustment of the dynamic range of the bionic vision sensor image, and then realize the adjustment of the shooting speed .
  • FIG. 1 is a schematic structural diagram of the arrangement of a pixel array in a bionic vision sensor according to an embodiment of the present invention
  • FIG. 2 is a schematic structural diagram of the arrangement of pixel arrays in a bionic vision sensor according to an embodiment of the present invention
  • FIG. 3 is a schematic structural diagram of a first sub-circuit in a rod bionic vision sensor provided by an embodiment of the present invention
  • FIG. 4 is a schematic diagram of the connection relationship between the target first-type photosensitive device and each non-target first-type photosensitive device in the first sub-circuit of the rod bionic vision sensor according to an embodiment of the present invention
  • FIG. 5 is a schematic diagram of a change form of a designated digital signal input to a digital-to-analog converter in a rod bionic vision sensor according to an embodiment of the present invention
  • FIG. 6 is a schematic diagram of a specific structure of a rod bionic vision sensor provided by an embodiment of the present invention.
  • FIG. 7 is a schematic diagram of a specific structure of a rod bionic vision sensor provided by an embodiment of the present invention.
  • FIG. 8 is a schematic structural diagram of a second sub-circuit in a rod bionic vision sensor provided by an embodiment of the present invention.
  • connection should be interpreted broadly. For example, they may be fixed connections or Removable connection or integral connection; it can be mechanical connection or electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal communication between two components.
  • connection should be interpreted broadly. For example, they may be fixed connections or Removable connection or integral connection; it can be mechanical connection or electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal communication between two components.
  • the embodiment of the present invention provides a rod bionic vision sensor, including: a first sub-circuit, the first sub-circuit includes a target first-type photosensitive device, a first current amplifier, a comparator, an adder, and a digital-to-analog converter ;
  • the target first-type photosensitive device is used to obtain a target light signal, and convert the target light signal into a first-type current signal;
  • the target first-type photosensitive device is connected to the first current amplifier, and the first current amplifier is connected to an input terminal of the comparator; the input terminals of the adder are respectively connected to the target first-type photosensitive device A first preset number of non-target type 1 photosensitive devices around the device are connected, and the output terminal of the adder is connected to the other input terminal of the comparator;
  • the output terminal of the comparator is connected to the digital-to-analog converter, and the digital-to-analog converter converts the input specified digital signal into a specified analog signal, and outputs the specified analog signal to the first current amplifier or The adder until the output terminal of the comparator outputs an event pulse signal, the first sub-circuit outputs the designated digital signal, and the designated digital signal is used to characterize the light intensity gradient information in the target optical signal ;
  • each of the non-target first-type photosensitive devices is connected in series with a first-type control switch.
  • the pixel array of the bionic vision sensor includes a first type of photosensitive device and a second type of photosensitive device.
  • the first type of photosensitive device is used to obtain the target light signal and convert the target light signal into the first type of current signal
  • the second type of photosensitive device is used to obtain the target light signal, and extract the specified frequency band from the target light signal.
  • Optical signal and convert the optical signal of the specified frequency band into the second type current signal.
  • the target light signal refers to the light signal reflected on the surface of the target object.
  • the target light signal can be directly irradiated on the first type of photosensitive device or the second type of photosensitive device, or it can be irradiated on the first type of photosensitive device or the second type of photosensitive device through a collimating lens.
  • the type of photosensitive device can also be irradiated on the first type of photosensitive device or the second type of photosensitive device through the cover.
  • the waveband of the target light signal may be a visible light waveband, that is, the target light signal may be a visible light signal.
  • the target object refers to an object that needs to be observed by the human eye, which may be a real object, an image, or other forms, and the specific form of the target object is not limited in the present invention.
  • the first type of photosensitive device may specifically be a photo-diode (PD), or may be other devices that can convert an optical signal into a current signal, which is not specifically limited in the embodiment of the present invention. It should be noted that the first type of photosensitive device does not include a filter.
  • the second type of photosensitive device is used to sense the color components in the target light signal.
  • the second type of photosensitive device may specifically include a PD and a color filter (CF) arranged on the PD, which is finally obtained by a bionic vision sensor
  • the image is a color image.
  • CF is used to obtain the target optical signal, extract the optical signal of the specified frequency band from the target optical signal, and the PD converts the optical signal of the specified frequency band into the second type current signal.
  • the color filter may specifically be a filter or a lens, which is used to transmit light signals of a specified wavelength.
  • a Byron lens can be used specifically, and other types of lenses can also be used.
  • the color filter can be divided into a red color filter, a blue color filter and a green color filter according to the wavelength of the transmitted light signal, and the transmitted light signals are respectively a red light signal, a blue light signal and a green light signal.
  • the second type of photosensitive device can also be directly composed of photodiodes. By selecting photodiodes with different response curves, the target light signal can be obtained, and the light signal of the specified wavelength band can be extracted from the target light signal, and the light The signal is converted into the role of the second type of current signal.
  • the rod bionic vision sensor provided in the embodiment of the present invention is mainly used to simulate the function of the rod cell in the human eye, so the rod bionic vision sensor can also be called a rod cell circuit.
  • Rod cells can be equivalent to the first type of photosensitive device in the bionic vision sensor. Since rod cells can be divided into excitatory rod cells and inhibitory rod cells, correspondingly, the first type of photosensitive device can include the target Type 1 photosensitive devices and non-target type 1 photosensitive devices, excitatory rod cells can be equivalent to target type 1 photosensitive devices, and inhibitory rod cells can be equivalent to non-target type 1 photosensitive devices.
  • FIG. 1 a schematic diagram of the arrangement of the pixel array structure can be shown in FIG. 1, which includes a first type of photosensitive device 11 and a second type of photosensitive device 12, and the first type of photosensitive device 11
  • the target type 1 photosensitive device is marked with "+”
  • the non-target type 1 photosensitive device is marked with "-”.
  • the second type photosensitive device 12 containing a red color filter is marked as "R”
  • the second type photosensitive device 12 containing a blue color filter is marked as "B”
  • the second type photosensitive device containing a green color filter is marked as "R”.
  • Device 12 is labeled "G”.
  • Each target type 1 photosensitive device is surrounded by 4 non-target type 1 photosensitive devices and 4 type 2 photosensitive devices, and each non-target type 1 photosensitive device is surrounded by 4 target type 1 photosensitive devices and 4 The second type of photosensitive device.
  • the structure diagram of the arrangement of the pixel array can also be shown in Figure 2, which includes the first type of photosensitive device 21 and the second type of photosensitive device 22, the target first type of photosensitive device in the first type of photosensitive device 21 is marked as "+ ", non-target type 1 photosensitive devices are marked as "-”.
  • the second type photosensitive device 22 containing a red color filter is marked as "R”
  • the second type photosensitive device 22 containing a blue color filter is marked as "B”
  • the second type photosensitive device containing a green color filter is marked as "R”.
  • Device 22 is labeled "G”.
  • Each target type 1 photosensitive device has 6 non-target type 1 photosensitive devices and 2 type 2 photosensitive devices, and each non-target type 1 photosensitive device is surrounded by 2 target type 1 photosensitive devices and 4 The second type photosensitive device, or each non-target first type photosensitive device is surrounded by 4 target first type photosensitive devices and 2 second type photosensitive devices.
  • the arrangement of the pixel array may also be in other forms, which is not specifically limited in the embodiment of the present invention. Hereinafter, only the arrangement of the pixel array shown in FIG. 1 is taken as an example for description.
  • the rod bionic vision sensor specifically includes a first sub-circuit for controlling the target first-type photosensitive device.
  • the first sub-circuit may specifically be a first-type current mode active pixel sensor circuit. As shown in FIG. 3, the first sub-circuit includes a target first-type photosensitive device 31, a first current amplifier 32, a comparator 33, an adder 34, and a digital to analog converter (Digital to Analog Converter, DAC) 35.
  • DAC Digital to Analog Converter
  • the target first The type photosensitive device 31 is connected to the first current amplifier 32, and the first current amplifier 32 is used to amplify the first type current signal I 0 obtained by the conversion of the target first type photosensitive device 31, and the amplification factor is a first preset number, That is, the magnification is equal to the number of non-target first-type photosensitive devices around the target first-type photosensitive device 31 to ensure that the amplified first-type current signal is equal to the first preset number around the target first-type photosensitive device 31
  • the sum of the current signals converted by non-target second-type photosensitive devices is on the same order of magnitude.
  • the pixel array shown in FIG. 1 corresponds to the first preset number of 4, and the pixel array shown in FIG. 2 corresponds to the first preset number of 6. In the embodiment of the present invention, the first preset number is equal to 4 as an example for description.
  • the response band of the photosensitive device is related to itself.
  • the image signal output by the rod bionic vision sensor controlled by the bionic vision sensor is a grayscale signal.
  • the first current amplifier 32 is connected to an input terminal of the comparator 33 and inputs the amplified first-type current signal into the comparator 33.
  • the four non-target first-type photosensitive devices around the target first-type photosensitive device 31 are all connected to the input ends of the adder 34 respectively. Because each non-target first-type photosensitive device is connected in series with a first-type control switch. In the embodiment of the present invention, only the first-type control switches M 1 , M 2 , M 3 , and M 4 connected in series with each non-target first-type photosensitive device are shown.
  • the first type of control switches may specifically be MOS transistors, and all the first type of control switches can be turned on at the same time, or they can be turned off at the same time, and can also be partially turned on and partially turned off, which can be specifically set as required. China does not make specific restrictions on this.
  • the target first-type photosensitive device provided in the embodiment of the present invention and each surrounding non-target first-type photosensitive device are connected through a MOS tube to achieve connection control.
  • the MOS tube When the MOS tube is turned on, the target type 1 photosensitive device is connected to the non-target type 1 photosensitive device through the conductive MOS tube.
  • the MOS tube When the MOS tube is disconnected, the target type 1 photosensitive device is connected to the non-target type 1 photosensitive device. The device is disconnected.
  • the on and off of the first type of control switch can be set as required, so the first type of control switch is a configurable first type of control switch. Since the first type of control switch realizes whether the non-target type 1 photosensitive device around the target type 1 photosensitive device is effective, it can be understood that the first type of control switch can be used as a parameter configurable 1bit convolution check to check the first type of photosensitive device.
  • the current signal converted by the device is subjected to convolution operation, the completion speed is very high, and the 1-bit convolution operation in the pixel can be completed to realize high-speed feature extraction.
  • the output terminal of the adder 34 is connected to the other input terminal of the comparator 33.
  • the current signals I 1 , I 2 , I 3 , and I 4 obtained by the conversion of the four non-target first-type photosensitive devices are respectively input to the adder 34, and the adder 34 calculates I 1 , I 2 , I 3 , and I 4 And input the sum result to the comparator 33.
  • the comparator 33 compares the amplified first-type current signal and the sum result of the adder 34. If the comparison result between the current moment and the current moment is consistent, no output is made.
  • the DAC35 converts the input designated digital signal into a designated analog signal, and outputs the designated analog signal to the first current amplifier 32 or the adder 34, and then outputs it to the first current amplifier 32 or the adder 34.
  • the designated analog signal of a current amplifier 32 is denoted as I DA2
  • the designated analog signal output to the adder 34 is denoted as I DA1 .
  • the output is then compared by the comparator 33. When the comparison result at the current moment and the latter moment are opposite, the output terminal of the comparator 33 outputs the event pulse signal, that is, the comparator 33 is in the edge-triggered state.
  • the first sub-circuit The specified digital signal is output, and the specified digital signal is used to characterize the light intensity gradient information in the target optical signal.
  • the designated digital signal output by the first sub-circuit is a digital signal represented by 0 and 1.
  • the designated digital signal input to the DAC35 can be a designated digital signal that is manually inputted periodically.
  • the change form of the designated digital signal is shown in Figure 5.
  • the designated digital signal increases stepwise with time.
  • N*step the value of the designated digital signal is ⁇ I
  • the comparator 33 outputs an event pulse signal, that is, the comparator 33 is in the edge-triggered state, and the ⁇ I at this time is used as the output of the first sub-circuit.
  • N is the number of steps passed before, and step is the time length of each step.
  • the adder in the embodiment of the present invention can be an actual device or a functional module that realizes the addition function.
  • it can be achieved by combining the lines where the current signals I 1 , I 2 , I 3 , and I 4 are located. Realize as a line.
  • the first current amplifier may also be an actual device or a functional module that realizes the current amplifying function, which is not specifically limited in the embodiment of the present invention.
  • the target first-type photosensitive device and the non-target first-type photosensitive device in the rod bionic vision sensor provided in the embodiment of the present invention are multiplexed.
  • any two adjacent target first-type photosensitive devices share two non-target first-type photosensitive devices, and each non-target second-type photosensitive device is surrounded by four surrounding
  • the goal is to share the first type of photosensitive devices to realize the multiplexing of the first type of photosensitive devices.
  • the embodiment of the present invention provides a rod bionic vision sensor, which realizes the perception of light intensity gradient information in the target light signal by simulating the role of rod cells, thereby increasing the dynamic range of the bionic vision sensor image and improving shooting speed.
  • a first-type control switch is introduced for each non-target first-type photosensitive device, which can control the obtained light intensity gradient information, realize the adjustment of the dynamic range of the bionic vision sensor image, and then realize the adjustment of the shooting speed .
  • the first sub-circuit further includes: a three-state gate circuit
  • the tri-state gate circuit is respectively connected with the output terminal of the comparator and the input terminal of the digital-to-analog converter;
  • the three-state gate circuit is used to output the designated digital signal when the event pulse signal is output at the output terminal of the comparator.
  • the rod bionic vision sensor provided in the embodiment of the present invention further includes in the first sub-circuit: a three-state gate circuit, as shown in FIG. 6, which is a component of the rod bionic vision sensor provided in the embodiment of the present invention.
  • a three-state gate circuit as shown in FIG. 6, which is a component of the rod bionic vision sensor provided in the embodiment of the present invention.
  • the circuit structure 61 simulates a rod cell circuit
  • the circuit structure 62 simulates a ganglion cell and a bipolar cell.
  • Vcc is the power supply of the control circuit.
  • the target first-type photosensitive device 63 is connected to Vcc.
  • the first-type current signal I 0 converted by the target first-type photosensitive device 63 is amplified 4 times by the current mirror 64 and then compared with a comparator (Comparer, CP).
  • a comparator Comparer, CP
  • 66 is connected to the input terminal, and the current signals converted by the four non-target first-type photosensitive devices around the target first-type photosensitive device 63 are respectively I 1 , I 2 , I 3 , and I 4 .
  • Fig. 6 does not show the four non-target first-type photosensitive devices around the target first-type photosensitive device 63, only the first-type control switches M 1 and M 1, which are connected in series with each non-target first-type photosensitive device are drawn.
  • M 2 , M 3 , M 4 The lines where I 1 , I 2 , I 3 , and I 4 are located are merged into one line to realize the function of an adder.
  • the combined line is connected to the input terminal of CP66.
  • the CP66 compares the amplified first-type current signal and the sum of I 1 , I 2 , I 3 , and I 4 . If the comparison result between the current moment and the current moment is consistent, no output is made.
  • the DAC65 converts the input designated digital signal into a designated analog signal, and outputs the designated analog signal to the target type 1 photosensitive device 63 or a non-target A type of photosensitive device. After the output, the CP66 is used for comparison. When the comparison result of the current time and the next time is opposite, the output terminal of the CP66 outputs the event pulse signal, that is, the CP66 is in the edge-triggered state. At this time, the three-state gate circuit 67 outputs the specified digital signal .
  • a capacitor 68 is also connected between CP66 and ground.
  • the capacitor 68 may be an actual capacitor or a virtual parasitic capacitor in the first sub-circuit, which is not specifically limited in the embodiment of the present invention.
  • the first sub-circuit further includes a storage unit.
  • the storage unit is connected to the output terminal of the tri-state gate circuit and is used to store the designated digital signal output by the first sub-circuit.
  • the storage unit may specifically be a register, a latch, SRAM, DRAM, memristor, etc. Taking a register as an example, the number of bits of the register can be selected according to the accuracy of the DAC35, and a 4-bit register can be selected in the embodiment of the present invention.
  • the first sub-circuit further includes an addressing unit 69.
  • the addressing unit 69 is respectively connected with the output terminal of CP68 and the input terminal of DAC65;
  • the addressing unit 69 is used for outputting an event pulse signal at the output terminal of the CP68, that is, when the CP68 is in an edge trigger state, outputting a designated digital signal.
  • the tri-state gate circuit 67 in FIG. 6 can be replaced with an addressing unit to obtain the structure shown in FIG. 7.
  • the first sub-circuit further includes a storage unit.
  • the storage unit is connected to the output terminal of the addressing unit 69 and is used to store the designated digital signal output by the first sub-circuit.
  • the storage unit may specifically be a register, a latch, SRAM, DRAM, memristor, etc. Taking a register as an example, the number of bits of the register can be selected according to the accuracy of the DAC35, and a 4-bit register can be selected in the embodiment of the present invention.
  • control circuit further includes: a second sub-circuit
  • the second sub-circuit includes one non-target first-type photosensitive device and the second preset number of first-type current mirrors;
  • Each first-type current mirror is respectively connected in series with a second-type photosensitive device around the non-target first-type photosensitive device, and the second-type photosensitive device is used to obtain the target light signal from the target light signal Extracting the optical signal of the specified frequency band in the, and converting the optical signal of the specified frequency band into the second type current signal.
  • the rod bionic vision sensor provided in the embodiment of the present invention further includes a second sub-circuit for controlling the non-target type 1 photosensitive device.
  • the second sub-circuit may specifically be a second-type current mode active pixel sensor circuit.
  • the second sub-circuit includes a non-target first-type photosensitive device 71 and four first-type current mirrors 72, 73, 74, 75.
  • Each first-type current mirror is connected in series with a target first-type photosensitive device around the non-target first-type photosensitive device 71, that is, the current signal I 1 obtained by the conversion of the non-target first-type photosensitive device 71 is copied into four I 1 , Respectively used to include the first sub-circuit of each target first-type photosensitive device around the non-target first-type photosensitive device 71 to obtain the light intensity gradient information in the target light signal, so as to realize the non-target first-type photosensitive device Reuse.
  • the rod bionic vision sensor provided in the embodiment of the present invention, when the illuminance of the target light signal is greater than the first preset value, all the first-type control switches are turned on at the same time, when When the intensity of the target optical signal is less than the second preset value, all the control switches of the first type are turned off at the same time.
  • all the control switches of the first type are independent of each other, and one is turned on and off does not affect the other.
  • the number of turns on and the number of turns off can be selected according to needs, and all of them can be turned on or off.
  • all the control switches of the first type in order to obtain a better effect, when the illuminance of the target light signal is greater than the first preset value, all the control switches of the first type can be turned on at the same time, and when the intensity of the target light signal is less than the second preset value When the value is set, all the first type control switches are turned off at the same time.
  • the first preset value and the second preset value may be determined according to the type, parameter, and ambient light intensity of the photosensitive device.
  • the first preset value may be 10klux
  • the second preset value may be 50lux. That is, when the illuminance of the target light signal is greater than the first preset value, it is indicated as strong light.
  • all the first type control switches are turned on at the same time. All non-target type 1 photosensitive devices are valid, and the designated digital signal output by the first sub-circuit is a differential mode signal, which enables the bionic vision sensor to obtain the edge information of the image.
  • the intensity of the target light signal is less than the second preset value, it is indicated as weak illumination.
  • the first type current signal I 1 converted by the target first type photosensitive device is very small.
  • the rod bionic vision sensor provided in the embodiment of the present invention better simulates the Gap Junction connection of the human eye, thereby realizing the improvement of the image dynamic range of the bionic vision sensor.
  • the illuminance of the target light signal is greater than the first preset value and less than the second preset value, it indicates that the illumination is moderate.
  • all the control switches of the first type may be partially turned on and partially turned off.
  • the designated digital signal output by the first sub-circuit is a differential mode signal.
  • the designated digital signal output by the first sub-circuit is a common mode signal. signal.
  • the first current amplifier is specifically a second type current mirror.
  • the current mirror 64 is a second type of current mirror.
  • the second type here is mainly used to distinguish from the first type of current mirror, and does not play a limiting role.
  • the first sub-circuit further includes: a second current amplifier
  • the second current amplifier is connected between the target first-type photosensitive device and the first current amplifier.
  • a second current amplifier may be connected between the first current amplifier and the target first-type photosensitive device to serve as the target
  • the first-type current signal converted by the first-type photosensitive device is preliminarily amplified.
  • the second current amplifier may be an actual device or a functional module that realizes the current amplification function, which is not specifically limited in the embodiment of the present invention.
  • a second current amplifier is also provided between the non-target first-type photosensitive device around the target first-type photosensitive device and the adder, so that the current of the branch where each non-target first-type photosensitive device is located before the adder is The signal is in the same order of magnitude as the current signal of the branch where the target type 1 photosensitive device is located.

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Transforming Light Signals Into Electric Signals (AREA)

Abstract

A rod bionic vision sensor, comprising: a first subcircuit, the first subcircuit comprising a target first-type photosensitive component (31), a first current amplifier (32), a comparator (33), an adder (34), and a digital-to-analog converter (35); a first preset number of non-target first-type photosensitive components being provided around the target first-type photosensitive component, each non-target first-type photosensitive component being connected in series to one first-type control switch (M1, M2, M3, and M4). By mimicking the effects of rod cells, implemented is the effect of sensing light intensity gradient information in a target light signal, thus increasing the dynamic range of a bionic vision sensor image, and increasing photographing speed. With one first-type control switch being introduced for each non-target first-type photosensitive component, the light intensity gradient information obtained can be controlled to implement an adjustment of the dynamic range of the bionic vision sensor image, thus implementing an adjustment of the photographing speed.

Description

视杆仿生视觉传感器Rod Bionic Vision Sensor 技术领域Technical field
本发明涉及集成电路技术领域,更具体地,涉及视杆仿生视觉传感器。The present invention relates to the field of integrated circuit technology, and more specifically, to a rod bionic vision sensor.
背景技术Background technique
目前,随着对图像传感器与图像处理识别算法研究地不断深入,以CMOS技术为主导的图像传感器在工业制造、智能交通、智能机器人等多个应用领域扮演着越来越重要的作用。At present, with the continuous in-depth research on image sensors and image processing and recognition algorithms, image sensors dominated by CMOS technology are playing an increasingly important role in many application fields such as industrial manufacturing, intelligent transportation, and intelligent robots.
但目前CMOS图像传感器有一些很难克服的缺陷:CMOS传感器获取图像的动态范围较小。而且由于CMOS图像传感器的二次采样分辨率较低,在光线很强、很弱或高对比度的场景下很容易产生饱和与失真。同时,由于CMOS图像传感器是获取外界目标物体反射光线中的所有数据,会导致图像数据冗余,并且数据量很大。给后级图像处理与存储带来了很大压力。对行(列)扫描的CMOS图像传感器,其摄像速度主要被后级模拟数字转换器(Analog-to-Digital Conversion,ADC)的转换速度所限制,随着对感光阵列的规模要求的不断增加,CMOS图像传感器拍摄速度会越来越难提高。However, the current CMOS image sensor has some shortcomings that are difficult to overcome: the dynamic range of the CMOS sensor to acquire images is relatively small. Moreover, due to the low sub-sampling resolution of CMOS image sensors, saturation and distortion are likely to occur in scenes with strong, weak or high contrast. At the same time, because the CMOS image sensor acquires all the data in the light reflected by the external target object, it will cause image data redundancy and a large amount of data. Brings a lot of pressure to the subsequent image processing and storage. For row (column) scanning CMOS image sensors, the imaging speed is mainly limited by the conversion speed of the analog-to-digital converter (ADC). As the requirements for the scale of the photosensitive array continue to increase, The shooting speed of CMOS image sensors will become increasingly difficult to increase.
基于CMOS图像传感器在摄像过程中产生的上述问题,现急需提供一种视杆仿生视觉传感器,以解决利用CMOS图像传感器进行摄像产生的问题。Based on the above-mentioned problems caused by the CMOS image sensor during the shooting process, there is an urgent need to provide a rod bionic vision sensor to solve the problems caused by the use of the CMOS image sensor for shooting.
发明内容Summary of the invention
为克服上述问题或者至少部分地解决上述问题,本发明实施例提 供了一种视杆仿生视觉传感器。In order to overcome the above-mentioned problems or at least partially solve the above-mentioned problems, an embodiment of the present invention provides a rod bionic vision sensor.
本发明实施例提供了一种视杆仿生视觉传感器,包括:第一子电路,所述第一子电路包括目标第一类感光器件、第一电流放大器、比较器、加法器和数模转换器;The embodiment of the present invention provides a rod bionic vision sensor, including: a first sub-circuit, the first sub-circuit includes a target first-type photosensitive device, a first current amplifier, a comparator, an adder, and a digital-to-analog converter ;
所述目标第一类感光器件用于获取目标光信号,并将所述目标光信号转换为第一类电流信号;The target first-type photosensitive device is used to obtain a target light signal, and convert the target light signal into a first-type current signal;
所述目标第一类感光器件与所述第一电流放大器相连,所述第一电流放大器与所述比较器的一个输入端相连;所述加法器的输入端分别与所述目标第一类感光器件周围第一预设数量个非目标第一类感光器件连接,所述加法器的输出端与所述比较器的另一个输入端相连;The target first-type photosensitive device is connected to the first current amplifier, and the first current amplifier is connected to an input terminal of the comparator; the input terminals of the adder are respectively connected to the target first-type photosensitive device A first preset number of non-target type 1 photosensitive devices around the device are connected, and the output terminal of the adder is connected to the other input terminal of the comparator;
所述比较器的输出端与所述数模转换器相连,所述数模转换器将输入的指定数字信号转换为指定模拟信号,并将所述指定模拟信号输出至所述第一电流放大器或者所述加法器,直至所述比较器的输出端输出事件脉冲信号,所述第一子电路输出所述指定数字信号,所述指定数字信号用于表征所述目标光信号中的光强梯度信息;The output terminal of the comparator is connected to the digital-to-analog converter, and the digital-to-analog converter converts the input specified digital signal into a specified analog signal, and outputs the specified analog signal to the first current amplifier or The adder until the output terminal of the comparator outputs an event pulse signal, the first sub-circuit outputs the designated digital signal, and the designated digital signal is used to characterize the light intensity gradient information in the target optical signal ;
其中,每个所述非目标第一类感光器件均与一个第一类控制开关串联。Wherein, each of the non-target first-type photosensitive devices is connected in series with a first-type control switch.
优选地,所述第一子电路还包括:三态门电路;Preferably, the first sub-circuit further includes: a three-state gate circuit;
所述三态门电路分别与所述比较器的输出端以及所述数模转换器的输入端连接;The tri-state gate circuit is respectively connected with the output terminal of the comparator and the input terminal of the digital-to-analog converter;
所述三态门电路用于在所述比较器的输出端输出所述事件脉冲信号时,输出所述指定数字信号。The three-state gate circuit is used to output the designated digital signal when the event pulse signal is output at the output terminal of the comparator.
优选地,所述第一子电路还包括:寻址单元;Preferably, the first sub-circuit further includes: an addressing unit;
所述寻址单元分别与所述比较器的输出端以及所述数模转换器的输入端连接;The addressing unit is respectively connected with the output terminal of the comparator and the input terminal of the digital-to-analog converter;
所述寻址单元用于在所述比较器的输出端输出所述事件脉冲信号时,输出所述指定数字信号。The addressing unit is used to output the designated digital signal when the event pulse signal is output at the output terminal of the comparator.
优选地,所述控制电路还包括:第二子电路;Preferably, the control circuit further includes: a second sub-circuit;
所述第二子电路包括一个所述非目标第一类感光器件和所述第二预设数量个第一类电流镜;The second sub-circuit includes one non-target first-type photosensitive device and the second preset number of first-type current mirrors;
每个第一类电流镜分别与所述非目标第一类感光器件周围的一个目标第一类感光器件串联。Each first-type current mirror is respectively connected in series with a target first-type photosensitive device around the non-target first-type photosensitive device.
优选地,当所述目标光信号的光照度大于第一预设值时,所有所述第一类控制开关同时导通,当所述目标光信号的强度小于第二预设值时,所有所述第一类控制开关同时断开。Preferably, when the illuminance of the target light signal is greater than a first preset value, all the first-type control switches are turned on at the same time, and when the intensity of the target light signal is less than a second preset value, all the The first type of control switch is turned off at the same time.
优选地,当至少一个所述第一类控制开关导通时,所述第一子电路输出的所述指定数字信号为差模信号,当所有所述第一类控制开关断开时,所述第一子电路输出的所述指定数字信号为共模信号。Preferably, when at least one of the first-type control switches is turned on, the designated digital signal output by the first sub-circuit is a differential mode signal, and when all the first-type control switches are turned off, the The designated digital signal output by the first sub-circuit is a common mode signal.
优选地,所述第一电流放大器具体为第二类电流镜。Preferably, the first current amplifier is specifically a second type current mirror.
优选地,所述第一子电路还包括:第二电流放大器;Preferably, the first sub-circuit further includes: a second current amplifier;
所述第二电流放大器连接在所述目标第一类感光器件与所述第一电流放大器之间。The second current amplifier is connected between the target first-type photosensitive device and the first current amplifier.
优选地,所述第一子电路还包括:存储单元;Preferably, the first sub-circuit further includes: a storage unit;
所述存储单元用于存储所述指定数字信号。The storage unit is used to store the designated digital signal.
本发明实施例提供的一种视杆仿生视觉传感器,通过模拟视杆细胞的作用,实现对目标光信号中的光强梯度信息的感知作用,进而提高仿生视觉传感器图像的动态范围,提高拍摄速度。而且,为每个非目标第一类感光器件引入一个第一类控制开关,可以对得到的光强梯度信息进行控制,实现对仿生视觉传感器图像的动态范围的调整,进而实现对拍摄速度的调整。The rod bionic vision sensor provided by the embodiment of the present invention realizes the perception of light intensity gradient information in the target light signal by simulating the function of rod cells, thereby increasing the dynamic range of the bionic vision sensor image and increasing the shooting speed . Moreover, a first-type control switch is introduced for each non-target first-type photosensitive device, which can control the obtained light intensity gradient information, realize the adjustment of the dynamic range of the bionic vision sensor image, and then realize the adjustment of the shooting speed .
附图说明Description of the drawings
为了更清楚地说明本发明实施例或现有技术中的技术方案,下面将对实施例或现有技术描述中所需要使用的附图作一简单地介绍,显 而易见地,下面描述中的附图是本发明的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the embodiments of the present invention or the technical solutions in the prior art more clearly, the following will briefly introduce the drawings that need to be used in the description of the embodiments or the prior art. Obviously, the drawings in the following description These are some embodiments of the present invention. For those of ordinary skill in the art, other drawings can be obtained based on these drawings without creative work.
图1为本发明实施例提供的一种仿生视觉传感器中像素阵列的排布方式结构示意图;FIG. 1 is a schematic structural diagram of the arrangement of a pixel array in a bionic vision sensor according to an embodiment of the present invention;
图2为本发明实施例提供的一种仿生视觉传感器中像素阵列的排布方式结构示意图;2 is a schematic structural diagram of the arrangement of pixel arrays in a bionic vision sensor according to an embodiment of the present invention;
图3为本发明实施例提供的一种视杆仿生视觉传感器中第一子电路的结构示意图;3 is a schematic structural diagram of a first sub-circuit in a rod bionic vision sensor provided by an embodiment of the present invention;
图4为本发明实施例提供的一种视杆仿生视觉传感器中第一子电路中目标第一类感光器件与周围的每个非目标第一类感光器件之间的连接关系示意图;4 is a schematic diagram of the connection relationship between the target first-type photosensitive device and each non-target first-type photosensitive device in the first sub-circuit of the rod bionic vision sensor according to an embodiment of the present invention;
图5为本发明实施例提供的一种视杆仿生视觉传感器中输入至数模转换器的指定数字信号的变化形式示意图;5 is a schematic diagram of a change form of a designated digital signal input to a digital-to-analog converter in a rod bionic vision sensor according to an embodiment of the present invention;
图6为本发明实施例提供的一种视杆仿生视觉传感器的具体结构示意图;6 is a schematic diagram of a specific structure of a rod bionic vision sensor provided by an embodiment of the present invention;
图7为本发明实施例提供的一种视杆仿生视觉传感器的具体结构示意图;7 is a schematic diagram of a specific structure of a rod bionic vision sensor provided by an embodiment of the present invention;
图8为本发明实施例提供的一种视杆仿生视觉传感器中第二子电路的结构示意图。FIG. 8 is a schematic structural diagram of a second sub-circuit in a rod bionic vision sensor provided by an embodiment of the present invention.
具体实施方式Detailed ways
为使本发明实施例的目的、技术方案和优点更加清楚,下面将结合本发明实施例中的附图,对本发明实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本发明一部分实施例,而不是全部的实施例。基于本发明中的实施例,本领域普通技术人员在没有作出创造性劳动前提下所获得的所有其他实施例,都属于本发明保护 的范围。In order to make the objectives, technical solutions, and advantages of the embodiments of the present invention clearer, the following will clearly and completely describe the technical solutions in the embodiments of the present invention with reference to the accompanying drawings in the embodiments of the present invention. Obviously, the described embodiments These are a part of the embodiments of the present invention, but not all of the embodiments. Based on the embodiments of the present invention, all other embodiments obtained by those of ordinary skill in the art without creative work shall fall within the protection scope of the present invention.
在本发明实施例的描述中,需要说明的是,术语“中心”、“上”、“下”、“左”、“右”、“竖直”、“水平”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本发明实施例和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本发明实施例的限制。此外,术语“第一”、“第二”、“第三”仅用于描述目的,而不能理解为指示或暗示相对重要性。In the description of the embodiments of the present invention, it should be noted that the terms "center", "upper", "lower", "left", "right", "vertical", "horizontal", "inner", "outer" The orientation or positional relationship indicated by "" is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the embodiments of the present invention and simplifying the description, and does not indicate or imply that the pointed device or element must have a specific orientation, It is constructed and operated in a specific orientation, and therefore cannot be understood as a limitation to the embodiment of the present invention. In addition, the terms "first", "second", and "third" are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance.
在本发明实施例的描述中,需要说明的是,除非另有明确的规定和限定,术语“安装”、“相连”、“连接”应做广义理解,例如,可以是固定连接,也可以是可拆卸连接,或一体地连接;可以是机械连接,也可以是电连接;可以是直接相连,也可以通过中间媒介间接相连,可以是两个元件内部的连通。对于本领域的普通技术人员而言,可以具体情况理解上述术语在本发明实施例中的具体含义。In the description of the embodiments of the present invention, it should be noted that, unless otherwise clearly defined and limited, the terms "installation", "connection", and "connection" should be interpreted broadly. For example, they may be fixed connections or Removable connection or integral connection; it can be mechanical connection or electrical connection; it can be directly connected or indirectly connected through an intermediate medium, and it can be the internal communication between two components. For those of ordinary skill in the art, the specific meanings of the above terms in the embodiments of the present invention can be understood in specific situations.
本发明实施例提供了一种视杆仿生视觉传感器,包括:第一子电路,所述第一子电路包括目标第一类感光器件、第一电流放大器、比较器、加法器和数模转换器;The embodiment of the present invention provides a rod bionic vision sensor, including: a first sub-circuit, the first sub-circuit includes a target first-type photosensitive device, a first current amplifier, a comparator, an adder, and a digital-to-analog converter ;
所述目标第一类感光器件用于获取目标光信号,并将所述目标光信号转换为第一类电流信号;The target first-type photosensitive device is used to obtain a target light signal, and convert the target light signal into a first-type current signal;
所述目标第一类感光器件与所述第一电流放大器相连,所述第一电流放大器与所述比较器的一个输入端相连;所述加法器的输入端分别与所述目标第一类感光器件周围第一预设数量个非目标第一类感光器件连接,所述加法器的输出端与所述比较器的另一个输入端相连;The target first-type photosensitive device is connected to the first current amplifier, and the first current amplifier is connected to an input terminal of the comparator; the input terminals of the adder are respectively connected to the target first-type photosensitive device A first preset number of non-target type 1 photosensitive devices around the device are connected, and the output terminal of the adder is connected to the other input terminal of the comparator;
所述比较器的输出端与所述数模转换器相连,所述数模转换器将输入的指定数字信号转换为指定模拟信号,并将所述指定模拟信号输出至所述第一电流放大器或者所述加法器,直至所述比较器的输出端输出事件脉冲信号,所述第一子电路输出所述指定数字信号,所述指 定数字信号用于表征所述目标光信号中的光强梯度信息;The output terminal of the comparator is connected to the digital-to-analog converter, and the digital-to-analog converter converts the input specified digital signal into a specified analog signal, and outputs the specified analog signal to the first current amplifier or The adder until the output terminal of the comparator outputs an event pulse signal, the first sub-circuit outputs the designated digital signal, and the designated digital signal is used to characterize the light intensity gradient information in the target optical signal ;
其中,每个所述非目标第一类感光器件均与一个第一类控制开关串联。Wherein, each of the non-target first-type photosensitive devices is connected in series with a first-type control switch.
具体地,本发明实施例中,仿生视觉传感器的像素阵列包括第一类感光器件和第二类感光器件。其中,第一类感光器件用于获取目标光信号,并将所述目标光信号转换为第一类电流信号,第二类感光器件用于获取目标光信号,从目标光信号中提取指定频段的光信号,并将指定频段的光信号转换为第二类电流信号。Specifically, in the embodiment of the present invention, the pixel array of the bionic vision sensor includes a first type of photosensitive device and a second type of photosensitive device. Among them, the first type of photosensitive device is used to obtain the target light signal and convert the target light signal into the first type of current signal, and the second type of photosensitive device is used to obtain the target light signal, and extract the specified frequency band from the target light signal. Optical signal, and convert the optical signal of the specified frequency band into the second type current signal.
目标光信号是指目标物体表面反射的光信号,目标光信号可以直接照射在第一类感光器件或第二类感光器件上,也可以是通过准直透镜照射在第一类感光器件或第二类感光器件上,还可以是透过覆盖物照射在第一类感光器件或第二类感光器件上。目标光信号的波段可以是可见光波段,即目标光信号可以为可见光信号。目标物体是指需要人眼观察的物体,可以是实物,也可以是图像,或者其他形式,本发明中不对目标物体的具体形态进行限定。The target light signal refers to the light signal reflected on the surface of the target object. The target light signal can be directly irradiated on the first type of photosensitive device or the second type of photosensitive device, or it can be irradiated on the first type of photosensitive device or the second type of photosensitive device through a collimating lens. The type of photosensitive device can also be irradiated on the first type of photosensitive device or the second type of photosensitive device through the cover. The waveband of the target light signal may be a visible light waveband, that is, the target light signal may be a visible light signal. The target object refers to an object that needs to be observed by the human eye, which may be a real object, an image, or other forms, and the specific form of the target object is not limited in the present invention.
第一类感光器件具体可以是光电二极管(Photo-Diode,PD),也可以是其他可以将光信号转换为电流信号的器件,本发明实施例中对此不作具体限定。需要说明的是,第一类感光器件中不包含有滤光器。第二类感光器件用于对目标光信号中的彩色分量进行感应,第二类感光器件具体可以包括PD和设置在PD上的滤色器(Colour Filter,CF),最终由仿生视觉传感器得到的图像是彩色图像。其中,CF用于获取目标光信号,从目标光信号中提取指定频段的光信号,PD将指定频段的光信号转换为第二类电流信号。滤色器具体可以是滤光片或者透镜,用于透过指定波长的光信号。当滤色器为透镜时,具体可选用拜伦透镜,也可以选用其他类型的透镜。滤色器按透过光信号的波长大小可分为红色滤色器、蓝色滤色器以及绿色滤色器,其透过的光信号分别为红光信号、蓝光信号和绿光信号。The first type of photosensitive device may specifically be a photo-diode (PD), or may be other devices that can convert an optical signal into a current signal, which is not specifically limited in the embodiment of the present invention. It should be noted that the first type of photosensitive device does not include a filter. The second type of photosensitive device is used to sense the color components in the target light signal. The second type of photosensitive device may specifically include a PD and a color filter (CF) arranged on the PD, which is finally obtained by a bionic vision sensor The image is a color image. Among them, CF is used to obtain the target optical signal, extract the optical signal of the specified frequency band from the target optical signal, and the PD converts the optical signal of the specified frequency band into the second type current signal. The color filter may specifically be a filter or a lens, which is used to transmit light signals of a specified wavelength. When the color filter is a lens, a Byron lens can be used specifically, and other types of lenses can also be used. The color filter can be divided into a red color filter, a blue color filter and a green color filter according to the wavelength of the transmitted light signal, and the transmitted light signals are respectively a red light signal, a blue light signal and a green light signal.
需要说明的是,第二类感光器件还可以直接由光电二极管组成,通过选取不同响应曲线的光电二极管实现获取目标光信号,从目标光信号中提取指定波段的光信号,并将指定波段的光信号转换为第二类电流信号的作用。It should be noted that the second type of photosensitive device can also be directly composed of photodiodes. By selecting photodiodes with different response curves, the target light signal can be obtained, and the light signal of the specified wavelength band can be extracted from the target light signal, and the light The signal is converted into the role of the second type of current signal.
本发明实施例中提供的视杆仿生视觉传感器主要用于模拟人眼中视杆细胞的功能,因此视杆仿生视觉传感器又可称为视杆细胞电路。视杆细胞可等效为仿生视觉传感器中的第一类感光器件,由于视杆细胞又可分为兴奋性视杆细胞和抑制性视杆细胞,相应地,第一类感光器件可包括目标第一类感光器件和非目标第一类感光器件,兴奋性视杆细胞可等效为目标第一类感光器件,抑制性视杆细胞可等效为非目标第一类感光器件。The rod bionic vision sensor provided in the embodiment of the present invention is mainly used to simulate the function of the rod cell in the human eye, so the rod bionic vision sensor can also be called a rod cell circuit. Rod cells can be equivalent to the first type of photosensitive device in the bionic vision sensor. Since rod cells can be divided into excitatory rod cells and inhibitory rod cells, correspondingly, the first type of photosensitive device can include the target Type 1 photosensitive devices and non-target type 1 photosensitive devices, excitatory rod cells can be equivalent to target type 1 photosensitive devices, and inhibitory rod cells can be equivalent to non-target type 1 photosensitive devices.
本发明实施例中提供的仿生视觉传感器,像素阵列的排布方式结构示意图可以如图1所示,其中包括第一类感光器件11和第二类感光器件12,第一类感光器件11中的目标第一类感光器件标记为“+”,非目标第一类感光器件标记为“-”。包含有红色滤色器的第二类感光器件12标记为“R”,包含有蓝色滤色器的第二类感光器件12标记为“B”,包含有绿色滤色器的第二类感光器件12标记为“G”。每个目标第一类感光器件周围具有4个非目标第一类感光器件以及4个第二类感光器件,每个非目标第一类感光器件周围具有4个目标第一类感光器件及4个第二类感光器件。In the bionic vision sensor provided in the embodiment of the present invention, a schematic diagram of the arrangement of the pixel array structure can be shown in FIG. 1, which includes a first type of photosensitive device 11 and a second type of photosensitive device 12, and the first type of photosensitive device 11 The target type 1 photosensitive device is marked with "+", and the non-target type 1 photosensitive device is marked with "-". The second type photosensitive device 12 containing a red color filter is marked as "R", the second type photosensitive device 12 containing a blue color filter is marked as "B", and the second type photosensitive device containing a green color filter is marked as "R". Device 12 is labeled "G". Each target type 1 photosensitive device is surrounded by 4 non-target type 1 photosensitive devices and 4 type 2 photosensitive devices, and each non-target type 1 photosensitive device is surrounded by 4 target type 1 photosensitive devices and 4 The second type of photosensitive device.
像素阵列的排布方式结构示意图也可以如图2所示,其中包括第一类感光器件21和第二类感光器件22,第一类感光器件21中的目标第一类感光器件标记为“+”,非目标第一类感光器件标记为“-”。包含有红色滤色器的第二类感光器件22标记为“R”,包含有蓝色滤色器的第二类感光器件22标记为“B”,包含有绿色滤色器的第二类感光器件22标记为“G”。每个目标第一类感光器件周围具有6个非目标第一类感光器件以及2个第二类感光器件,每个非目标第一类感光器件周 围具有2个目标第一类感光器件以及4个第二类感光器件,或者每个非目标第一类感光器件周围具有4个目标第一类感光器件以及2个第二类感光器件。像素阵列的排布方式也可以是其他形式,本发明实施例中对此不作具体限定。以下仅以图1示出的像素阵列的排布方式为例进行说明。The structure diagram of the arrangement of the pixel array can also be shown in Figure 2, which includes the first type of photosensitive device 21 and the second type of photosensitive device 22, the target first type of photosensitive device in the first type of photosensitive device 21 is marked as "+ ", non-target type 1 photosensitive devices are marked as "-". The second type photosensitive device 22 containing a red color filter is marked as "R", the second type photosensitive device 22 containing a blue color filter is marked as "B", and the second type photosensitive device containing a green color filter is marked as "R". Device 22 is labeled "G". Each target type 1 photosensitive device has 6 non-target type 1 photosensitive devices and 2 type 2 photosensitive devices, and each non-target type 1 photosensitive device is surrounded by 2 target type 1 photosensitive devices and 4 The second type photosensitive device, or each non-target first type photosensitive device is surrounded by 4 target first type photosensitive devices and 2 second type photosensitive devices. The arrangement of the pixel array may also be in other forms, which is not specifically limited in the embodiment of the present invention. Hereinafter, only the arrangement of the pixel array shown in FIG. 1 is taken as an example for description.
由于第一类感光器件可以包括目标第一类感光器件,因此视杆仿生视觉传感器具体包括用于控制目标第一类感光器件的第一子电路。其中,第一子电路具体可以是第一类电流模式有源像素传感器电路。如图3所示,第一子电路包括目标第一类感光器件31、第一电流放大器32、比较器33、加法器34和数模转换器(Digital to Analog Converter,DAC)35,目标第一类感光器件31与第一电流放大器32相连,第一电流放大器32用于对目标第一类感光器件31转换得到的第一类电流信号I 0进行放大,放大的倍数为第一预设数量,即放大的倍数与目标第一类感光器件31周围的非目标第一类感光器件的数量相等,以保证放大后的第一类电流信号与目标第一类感光器件31周围第一预设数量个非目标第二类感光器件转换得到的电流信号之和在同一量级上。图1中示出的像素阵列,对应的第一预设数量为4,图2示出的像素阵列,对应的第一预设数量为6。本发明实施例中以第一预设数量等于4为例进行说明。 Since the first-type photosensitive device may include the target first-type photosensitive device, the rod bionic vision sensor specifically includes a first sub-circuit for controlling the target first-type photosensitive device. Among them, the first sub-circuit may specifically be a first-type current mode active pixel sensor circuit. As shown in FIG. 3, the first sub-circuit includes a target first-type photosensitive device 31, a first current amplifier 32, a comparator 33, an adder 34, and a digital to analog converter (Digital to Analog Converter, DAC) 35. The target first The type photosensitive device 31 is connected to the first current amplifier 32, and the first current amplifier 32 is used to amplify the first type current signal I 0 obtained by the conversion of the target first type photosensitive device 31, and the amplification factor is a first preset number, That is, the magnification is equal to the number of non-target first-type photosensitive devices around the target first-type photosensitive device 31 to ensure that the amplified first-type current signal is equal to the first preset number around the target first-type photosensitive device 31 The sum of the current signals converted by non-target second-type photosensitive devices is on the same order of magnitude. The pixel array shown in FIG. 1 corresponds to the first preset number of 4, and the pixel array shown in FIG. 2 corresponds to the first preset number of 6. In the embodiment of the present invention, the first preset number is equal to 4 as an example for description.
需要说明的是,本发明实施例中提供的第一类感光器件中不存在滤光器(Colorfilter,CF),因此感光器件的响应波段与自身相关。一般而言,此时视杆仿生视觉传感器控制仿生视觉传感器输出的图像信号为灰度信号。It should be noted that there is no color filter (CF) in the first type of photosensitive device provided in the embodiment of the present invention, so the response band of the photosensitive device is related to itself. Generally speaking, at this time, the image signal output by the rod bionic vision sensor controlled by the bionic vision sensor is a grayscale signal.
第一电流放大器32与比较器33的一个输入端相连,将放大后的第一类电流信号输入至比较器33中。目标第一类感光器件31周围的4个非目标第一类感光器件均分别与加法器34的输入端相连。由于每个非目标第一类感光器件均与一个第一类控制开关串联。本发明实施例 中仅示出了与每个非目标第一类感光器件串联的第一类控制开关M 1、M 2、M 3、M 4。其中,第一类控制开关具体可以是MOS管,所有第一类控制开关可以同时导通,也可以同时断开,还可以部分导通部分断开,具体可以根据需要进行设置,本发明实施例中对此不作具体限定。 The first current amplifier 32 is connected to an input terminal of the comparator 33 and inputs the amplified first-type current signal into the comparator 33. The four non-target first-type photosensitive devices around the target first-type photosensitive device 31 are all connected to the input ends of the adder 34 respectively. Because each non-target first-type photosensitive device is connected in series with a first-type control switch. In the embodiment of the present invention, only the first-type control switches M 1 , M 2 , M 3 , and M 4 connected in series with each non-target first-type photosensitive device are shown. Among them, the first type of control switches may specifically be MOS transistors, and all the first type of control switches can be turned on at the same time, or they can be turned off at the same time, and can also be partially turned on and partially turned off, which can be specifically set as required. China does not make specific restrictions on this.
如图4所示,本发明实施例中提供的目标第一类感光器件与周围的每个非目标第一类感光器件之间均通过一个MOS管实现连接控制。当MOS管导通时,目标第一类感光器件通过导通的MOS管与非目标第一类感光器件实现连接,当MOS管断开时,目标第一类感光器件与非目标第一类感光器件断开连接。As shown in FIG. 4, the target first-type photosensitive device provided in the embodiment of the present invention and each surrounding non-target first-type photosensitive device are connected through a MOS tube to achieve connection control. When the MOS tube is turned on, the target type 1 photosensitive device is connected to the non-target type 1 photosensitive device through the conductive MOS tube. When the MOS tube is disconnected, the target type 1 photosensitive device is connected to the non-target type 1 photosensitive device. The device is disconnected.
第一类控制开关的导通与关闭可以根据需要进行设置,因此第一类控制开关为可配置的第一类控制开关。由于第一类控制开关实现的是控制目标第一类感光器件周围的非目标第一类感光器件是否有效,可以理解为第一类控制开关可以作为参数可配的1bit卷积核对第一类感光器件转换得到的电流信号进行卷积运算,完成速度很高,可以完成像素内的1bit卷积运算,实现高速的特征提取。The on and off of the first type of control switch can be set as required, so the first type of control switch is a configurable first type of control switch. Since the first type of control switch realizes whether the non-target type 1 photosensitive device around the target type 1 photosensitive device is effective, it can be understood that the first type of control switch can be used as a parameter configurable 1bit convolution check to check the first type of photosensitive device. The current signal converted by the device is subjected to convolution operation, the completion speed is very high, and the 1-bit convolution operation in the pixel can be completed to realize high-speed feature extraction.
加法器34的输出端与比较器33的另一个输入端相连。4个非目标第一类感光器件转换得到的电流信号I 1、I 2、I 3、I 4分别输入至加法器34,由加法器34对I 1、I 2、I 3、I 4进行求和,并将求和结果输入至比较器33。由比较器33对放大后的第一类电流信号以及加法器34的求和结果进行比较。当前一时刻与当前时刻的比较结果一致,则不做输出,由DAC35将输入的指定数字信号转换为指定模拟信号,并将指定模拟信号输出至第一电流放大器32或者加法器34,输出至第一电流放大器32的指定模拟信号记为I DA2,输出至加法器34的指定模拟信号记为I DA1。输出后再通过比较器33进行比较,当前一时刻与后一时刻的比较结果相反时,由比较器33的输出端输出事件脉冲信号,即比较器33处于边沿触发状态,此时第一子电路输出指定数字信号,指定数字信号用于表征目标光信号中的光强梯度信息。其中,第一子电路输出的 指定数字信号是一种用0和1表示的数字信号。 The output terminal of the adder 34 is connected to the other input terminal of the comparator 33. The current signals I 1 , I 2 , I 3 , and I 4 obtained by the conversion of the four non-target first-type photosensitive devices are respectively input to the adder 34, and the adder 34 calculates I 1 , I 2 , I 3 , and I 4 And input the sum result to the comparator 33. The comparator 33 compares the amplified first-type current signal and the sum result of the adder 34. If the comparison result between the current moment and the current moment is consistent, no output is made. The DAC35 converts the input designated digital signal into a designated analog signal, and outputs the designated analog signal to the first current amplifier 32 or the adder 34, and then outputs it to the first current amplifier 32 or the adder 34. The designated analog signal of a current amplifier 32 is denoted as I DA2 , and the designated analog signal output to the adder 34 is denoted as I DA1 . The output is then compared by the comparator 33. When the comparison result at the current moment and the latter moment are opposite, the output terminal of the comparator 33 outputs the event pulse signal, that is, the comparator 33 is in the edge-triggered state. At this time, the first sub-circuit The specified digital signal is output, and the specified digital signal is used to characterize the light intensity gradient information in the target optical signal. Among them, the designated digital signal output by the first sub-circuit is a digital signal represented by 0 and 1.
其中,输入至DAC35的指定数字信号可以是人为输入的周期性增加的指定数字信号,指定数字信号的变化形式具体如图5所示,指定数字信号具体随时间呈阶梯型递增,当某一时刻N*step时,指定数字信号取值为ΔI,比较器33输出事件脉冲信号,即比较器33处于边沿触发状态,则将此时的ΔI作为第一子电路的输出。其中,N为此前经过的台阶数,step为每一台阶经过的时长。Among them, the designated digital signal input to the DAC35 can be a designated digital signal that is manually inputted periodically. The change form of the designated digital signal is shown in Figure 5. The designated digital signal increases stepwise with time. In the case of N*step, the value of the designated digital signal is ΔI, and the comparator 33 outputs an event pulse signal, that is, the comparator 33 is in the edge-triggered state, and the ΔI at this time is used as the output of the first sub-circuit. Among them, N is the number of steps passed before, and step is the time length of each step.
需要说明的是,本发明实施例中的加法器可以是实际的器件,也可以是实现加法功能的功能模块,例如可以通过将电流信号I 1、I 2、I 3、I 4所在的线路合并成一条线路实现。而且,第一电流放大器也可以是实际的器件,也可以是实现电流放大功能的功能模块,本发明实施例中对此不作具体限定。 It should be noted that the adder in the embodiment of the present invention can be an actual device or a functional module that realizes the addition function. For example, it can be achieved by combining the lines where the current signals I 1 , I 2 , I 3 , and I 4 are located. Realize as a line. Moreover, the first current amplifier may also be an actual device or a functional module that realizes the current amplifying function, which is not specifically limited in the embodiment of the present invention.
根据像素阵列的排布方式,本发明实施例中提供的视杆仿生视觉传感器中的目标第一类感光器件和非目标第一类感光器件之间实现复用。例如,图1所示的像素阵列,任意相邻两个目标第一类感光器件之间共用两个非目标第一类感光器件,同时每个非目标第二类感光器件均被周围的四个目标第一类感光器件共用,实现第一类感光器件的复用。According to the arrangement of the pixel array, the target first-type photosensitive device and the non-target first-type photosensitive device in the rod bionic vision sensor provided in the embodiment of the present invention are multiplexed. For example, in the pixel array shown in Figure 1, any two adjacent target first-type photosensitive devices share two non-target first-type photosensitive devices, and each non-target second-type photosensitive device is surrounded by four surrounding The goal is to share the first type of photosensitive devices to realize the multiplexing of the first type of photosensitive devices.
本发明实施例中提供了一种视杆仿生视觉传感器,通过模拟视杆细胞的作用,实现对目标光信号中的光强梯度信息的感知作用,进而提高仿生视觉传感器图像的动态范围,提高拍摄速度。而且,为每个非目标第一类感光器件引入一个第一类控制开关,可以对得到的光强梯度信息进行控制,实现对仿生视觉传感器图像的动态范围的调整,进而实现对拍摄速度的调整。The embodiment of the present invention provides a rod bionic vision sensor, which realizes the perception of light intensity gradient information in the target light signal by simulating the role of rod cells, thereby increasing the dynamic range of the bionic vision sensor image and improving shooting speed. Moreover, a first-type control switch is introduced for each non-target first-type photosensitive device, which can control the obtained light intensity gradient information, realize the adjustment of the dynamic range of the bionic vision sensor image, and then realize the adjustment of the shooting speed .
在上述实施例的基础上,本发明实施例中提供的视杆仿生视觉传感器,所述第一子电路还包括:三态门电路;On the basis of the foregoing embodiment, in the rod bionic vision sensor provided in the embodiment of the present invention, the first sub-circuit further includes: a three-state gate circuit;
所述三态门电路分别与所述比较器的输出端以及所述数模转换器 的输入端连接;The tri-state gate circuit is respectively connected with the output terminal of the comparator and the input terminal of the digital-to-analog converter;
所述三态门电路用于在所述比较器的输出端输出所述事件脉冲信号时,输出所述指定数字信号。The three-state gate circuit is used to output the designated digital signal when the event pulse signal is output at the output terminal of the comparator.
具体地,本发明实施例中提供的视杆仿生视觉传感器,在第一子电路中还包括:三态门电路,如图6所示,为本发明实施例中提供的视杆仿生视觉传感器的具体结构示意图。图6中,电路结构61模拟视杆细胞电路,电路结构62模拟节细胞与双极细胞。Vcc为控制电路的电源,目标第一类感光器件63与Vcc连接,目标第一类感光器件63转换得到的第一类电流信号I 0经电流镜64放大4倍后与比较器(Comparer,CP)66的输入端连接,目标第一类感光器件63周围的4个非目标第一类感光器件转换得到的电流信号分别为I 1、I 2、I 3、I 4。图6中并未画出目标第一类感光器件63周围的4个非目标第一类感光器件,仅仅画出了与每个非目标第一类感光器件串联的第一类控制开关M 1、M 2、M 3、M 4。I 1、I 2、I 3、I 4所在的线路合并成一条线路,实现加法器的作用。合并的一条线路与CP66的输入端连接。由CP66对放大后的第一类电流信号以及I 1、I 2、I 3、I 4之和进行比较。当前一时刻与当前时刻的比较结果一致,则不做输出,由DAC65将输入的指定数字信号转换为指定模拟信号,并将指定模拟信号输出至目标第一类感光器件63或者某一个非目标第一类感光器件。输出后再通过CP66进行比较,当前一时刻与后一时刻的比较结果相反时,由CP66的输出端输出事件脉冲信号,即CP66处于边沿触发状态,此时由三态门电路67输出指定数字信号。 Specifically, the rod bionic vision sensor provided in the embodiment of the present invention further includes in the first sub-circuit: a three-state gate circuit, as shown in FIG. 6, which is a component of the rod bionic vision sensor provided in the embodiment of the present invention. Specific structure diagram. In FIG. 6, the circuit structure 61 simulates a rod cell circuit, and the circuit structure 62 simulates a ganglion cell and a bipolar cell. Vcc is the power supply of the control circuit. The target first-type photosensitive device 63 is connected to Vcc. The first-type current signal I 0 converted by the target first-type photosensitive device 63 is amplified 4 times by the current mirror 64 and then compared with a comparator (Comparer, CP). ) 66 is connected to the input terminal, and the current signals converted by the four non-target first-type photosensitive devices around the target first-type photosensitive device 63 are respectively I 1 , I 2 , I 3 , and I 4 . Fig. 6 does not show the four non-target first-type photosensitive devices around the target first-type photosensitive device 63, only the first-type control switches M 1 and M 1, which are connected in series with each non-target first-type photosensitive device are drawn. M 2 , M 3 , M 4 . The lines where I 1 , I 2 , I 3 , and I 4 are located are merged into one line to realize the function of an adder. The combined line is connected to the input terminal of CP66. The CP66 compares the amplified first-type current signal and the sum of I 1 , I 2 , I 3 , and I 4 . If the comparison result between the current moment and the current moment is consistent, no output is made. The DAC65 converts the input designated digital signal into a designated analog signal, and outputs the designated analog signal to the target type 1 photosensitive device 63 or a non-target A type of photosensitive device. After the output, the CP66 is used for comparison. When the comparison result of the current time and the next time is opposite, the output terminal of the CP66 outputs the event pulse signal, that is, the CP66 is in the edge-triggered state. At this time, the three-state gate circuit 67 outputs the specified digital signal .
在图6中,CP66与地之间还连接有电容68,电容68可以是实际电容,也可以是第一子电路中虚拟出来的寄生电容,本发明实施例中对此不作具体限定。In FIG. 6, a capacitor 68 is also connected between CP66 and ground. The capacitor 68 may be an actual capacitor or a virtual parasitic capacitor in the first sub-circuit, which is not specifically limited in the embodiment of the present invention.
在上述实施例的基础上,本发明实施例中提供的视杆仿生视觉传感器,第一子电路还包括:存储单元。存储单元与三态门电路的输出 端连接,用于存储第一子电路输出的指定数字信号。存储单元具体可以是寄存器、锁存器、SRAM、DRAM、忆阻器等。以寄存器为例,寄存器的位数可以根据DAC35的精度进行选择,本发明实施例中在此可选择4位寄存器。On the basis of the foregoing embodiment, in the rod bionic vision sensor provided in the embodiment of the present invention, the first sub-circuit further includes a storage unit. The storage unit is connected to the output terminal of the tri-state gate circuit and is used to store the designated digital signal output by the first sub-circuit. The storage unit may specifically be a register, a latch, SRAM, DRAM, memristor, etc. Taking a register as an example, the number of bits of the register can be selected according to the accuracy of the DAC35, and a 4-bit register can be selected in the embodiment of the present invention.
如图7所示,在上述实施例的基础上,本发明实施例中提供的视杆仿生视觉传感器,第一子电路还包括:寻址单元69。As shown in FIG. 7, on the basis of the foregoing embodiment, in the rod bionic vision sensor provided in the embodiment of the present invention, the first sub-circuit further includes an addressing unit 69.
寻址单元69分别与CP68的输出端以及DAC65的输入端连接;The addressing unit 69 is respectively connected with the output terminal of CP68 and the input terminal of DAC65;
寻址单元69用于在CP68的输出端输出事件脉冲信号时,即CP68处于边沿触发状态时,输出指定数字信号。也就是说,图6中的三态门电路67可以替换为寻址单元得到图7所示的结构。The addressing unit 69 is used for outputting an event pulse signal at the output terminal of the CP68, that is, when the CP68 is in an edge trigger state, outputting a designated digital signal. In other words, the tri-state gate circuit 67 in FIG. 6 can be replaced with an addressing unit to obtain the structure shown in FIG. 7.
在上述实施例的基础上,本发明实施例中提供的视杆仿生视觉传感器,第一子电路还包括:存储单元。存储单元与寻址单元69的输出端连接,用于存储第一子电路输出的指定数字信号。存储单元具体可以是寄存器、锁存器、SRAM、DRAM、忆阻器等。以寄存器为例,寄存器的位数可以根据DAC35的精度进行选择,本发明实施例中在此可选择4位寄存器。On the basis of the foregoing embodiment, in the rod bionic vision sensor provided in the embodiment of the present invention, the first sub-circuit further includes a storage unit. The storage unit is connected to the output terminal of the addressing unit 69 and is used to store the designated digital signal output by the first sub-circuit. The storage unit may specifically be a register, a latch, SRAM, DRAM, memristor, etc. Taking a register as an example, the number of bits of the register can be selected according to the accuracy of the DAC35, and a 4-bit register can be selected in the embodiment of the present invention.
在上述实施例的基础上,本发明实施例中提供的视杆仿生视觉传感器,所述控制电路还包括:第二子电路;On the basis of the foregoing embodiment, in the rod bionic vision sensor provided in the embodiment of the present invention, the control circuit further includes: a second sub-circuit;
所述第二子电路包括一个所述非目标第一类感光器件和所述第二预设数量个第一类电流镜;The second sub-circuit includes one non-target first-type photosensitive device and the second preset number of first-type current mirrors;
每个第一类电流镜分别与所述非目标第一类感光器件周围的一个第二类感光器件串联,所述第二类感光器件用于获取所述目标光信号,从所述目标光信号中提取指定频段的光信号,并将所述指定频段的光信号转换为第二类电流信号。Each first-type current mirror is respectively connected in series with a second-type photosensitive device around the non-target first-type photosensitive device, and the second-type photosensitive device is used to obtain the target light signal from the target light signal Extracting the optical signal of the specified frequency band in the, and converting the optical signal of the specified frequency band into the second type current signal.
具体地,如图8所示,本发明实施例中提供的视杆仿生视觉传感器中还包括用于控制非目标第一类感光器件的第二子电路。其中,第二子电路具体可以是第二类电流模式有源像素传感器电路。第二子电 路包括一个非目标第一类感光器件71和4个第一类电流镜72、73、74、75。每个第一类电流镜分别与非目标第一类感光器件71周围的一个目标第一类感光器件串联,即将非目标第一类感光器件71转换得到的电流信号I 1复制成4个I 1,分别用于包括非目标第一类感光器件71周围的每个目标第一类感光器件的第一子电路获取到目标光信号中的光强梯度信息,以实现非目标第一类感光器件的复用。 Specifically, as shown in FIG. 8, the rod bionic vision sensor provided in the embodiment of the present invention further includes a second sub-circuit for controlling the non-target type 1 photosensitive device. Wherein, the second sub-circuit may specifically be a second-type current mode active pixel sensor circuit. The second sub-circuit includes a non-target first-type photosensitive device 71 and four first-type current mirrors 72, 73, 74, 75. Each first-type current mirror is connected in series with a target first-type photosensitive device around the non-target first-type photosensitive device 71, that is, the current signal I 1 obtained by the conversion of the non-target first-type photosensitive device 71 is copied into four I 1 , Respectively used to include the first sub-circuit of each target first-type photosensitive device around the non-target first-type photosensitive device 71 to obtain the light intensity gradient information in the target light signal, so as to realize the non-target first-type photosensitive device Reuse.
在上述实施例的基础上,本发明实施例中提供的视杆仿生视觉传感器,当所述目标光信号的光照度大于第一预设值时,所有所述第一类控制开关同时导通,当所述目标光信号的强度小于第二预设值时,所有所述第一类控制开关同时断开。On the basis of the above-mentioned embodiment, the rod bionic vision sensor provided in the embodiment of the present invention, when the illuminance of the target light signal is greater than the first preset value, all the first-type control switches are turned on at the same time, when When the intensity of the target optical signal is less than the second preset value, all the control switches of the first type are turned off at the same time.
具体地,所有的第一类控制开关均相互独立,一个导通与断开并不会影响另一个,可以根据需要选择导通的数量和断开的数量,也可以全部导通或全部断开。本发明实施例中,为获得更好的效果,可以在目标光信号的光照度大于第一预设值时,使所有第一类控制开关同时导通,当目标光信号的强度小于第二预设值时,使所有第一类控制开关同时断开。其中第一预设值、第二预设值可以根据感光器件的类型、参数以及环境光照度进行确定。例如,第一预设值可以为10klux,第二预设值可以为50lux。即,当目标光信号的光照度大于第一预设值时,说明为强光照,此时为防止视杆仿生视觉传感器内DAC与比较器饱和,将所有第一类控制开关同时导通,此时所有非目标第一类感光器件有效,第一子电路输出的指定数字信号为差模信号,可以使仿生视觉传感器得到图像的边缘信息。当目标光信号的强度小于第二预设值时,说明为弱光照,此时经目标第一类感光器件转换得到的第一类电流信号I 1很小。因此将所有第一类控制开关同时断开,此时所有非目标第一类感光器件无效,第一子电路输出的指定数字信号为共模信号,可以使仿生视觉传感器得到图像的原始信息。本发明实施例中提供的视杆仿生视觉传感器更好的仿真人眼的Gap Junction连接,从而实 现对于仿生视觉传感器的图像动态范围的提高。 Specifically, all the control switches of the first type are independent of each other, and one is turned on and off does not affect the other. The number of turns on and the number of turns off can be selected according to needs, and all of them can be turned on or off. . In the embodiment of the present invention, in order to obtain a better effect, when the illuminance of the target light signal is greater than the first preset value, all the control switches of the first type can be turned on at the same time, and when the intensity of the target light signal is less than the second preset value When the value is set, all the first type control switches are turned off at the same time. The first preset value and the second preset value may be determined according to the type, parameter, and ambient light intensity of the photosensitive device. For example, the first preset value may be 10klux, and the second preset value may be 50lux. That is, when the illuminance of the target light signal is greater than the first preset value, it is indicated as strong light. At this time, in order to prevent saturation of the DAC and comparator in the rod bionic vision sensor, all the first type control switches are turned on at the same time. All non-target type 1 photosensitive devices are valid, and the designated digital signal output by the first sub-circuit is a differential mode signal, which enables the bionic vision sensor to obtain the edge information of the image. When the intensity of the target light signal is less than the second preset value, it is indicated as weak illumination. At this time, the first type current signal I 1 converted by the target first type photosensitive device is very small. Therefore, all the first-type control switches are turned off at the same time. At this time, all non-target first-type photosensitive devices are invalid, and the designated digital signal output by the first sub-circuit is a common mode signal, which enables the bionic vision sensor to obtain the original information of the image. The rod bionic vision sensor provided in the embodiment of the present invention better simulates the Gap Junction connection of the human eye, thereby realizing the improvement of the image dynamic range of the bionic vision sensor.
需要说明的是,当目标光信号的光照度大于第一预设值且小于第二预设值时,说明光照适中,此时所有第一类控制开关中可以部分导通部分断开。当至少一个第一类控制开关导通时,第一子电路输出的指定数字信号均为差模信号,当所有第一类控制开关断开时,第一子电路输出的指定数字信号为共模信号。It should be noted that when the illuminance of the target light signal is greater than the first preset value and less than the second preset value, it indicates that the illumination is moderate. At this time, all the control switches of the first type may be partially turned on and partially turned off. When at least one type 1 control switch is turned on, the designated digital signal output by the first sub-circuit is a differential mode signal. When all the first type control switches are turned off, the designated digital signal output by the first sub-circuit is a common mode signal. signal.
在上述实施例的基础上,本发明实施例中提供的视杆仿生视觉传感器,所述第一电流放大器具体为第二类电流镜。On the basis of the foregoing embodiment, in the rod bionic vision sensor provided in the embodiment of the present invention, the first current amplifier is specifically a second type current mirror.
具体地,如图6和图7所示,电流镜64为第二类电流镜。这里的第二类主要用于与第一类电流镜区分,并不起限定作用。Specifically, as shown in FIGS. 6 and 7, the current mirror 64 is a second type of current mirror. The second type here is mainly used to distinguish from the first type of current mirror, and does not play a limiting role.
在上述实施例的基础上,本发明实施例中提供的视杆仿生视觉传感器,所述第一子电路还包括:第二电流放大器;On the basis of the foregoing embodiment, in the rod bionic vision sensor provided in the embodiment of the present invention, the first sub-circuit further includes: a second current amplifier;
所述第二电流放大器连接在所述目标第一类感光器件与所述第一电流放大器之间。The second current amplifier is connected between the target first-type photosensitive device and the first current amplifier.
具体地,本发明实施例中,由于第一类感光器件转换得到的电流信号较小,因此可以在第一电流放大器与目标第一类感光器件之间连接有第二电流放大器,用于为目标第一类感光器件转换得到的第一类电流信号进行初步放大。第二电流放大器可以是实际的器件,也可以是实现电流放大功能的功能模块,本发明实施例中对此不作具体限定。相应地,目标第一类感光器件周围的非目标第一类感光器件与加法器之间也设置有第二电流放大器,使加法器之前每个非目标第一类感光器件所处支路的电流信号与目标第一类感光器件所处支路的电流信号处于同一量级。Specifically, in the embodiment of the present invention, since the current signal converted by the first-type photosensitive device is relatively small, a second current amplifier may be connected between the first current amplifier and the target first-type photosensitive device to serve as the target The first-type current signal converted by the first-type photosensitive device is preliminarily amplified. The second current amplifier may be an actual device or a functional module that realizes the current amplification function, which is not specifically limited in the embodiment of the present invention. Correspondingly, a second current amplifier is also provided between the non-target first-type photosensitive device around the target first-type photosensitive device and the adder, so that the current of the branch where each non-target first-type photosensitive device is located before the adder is The signal is in the same order of magnitude as the current signal of the branch where the target type 1 photosensitive device is located.
最后应说明的是:以上实施例仅用以说明本发明的技术方案,而非对其限制;尽管参照前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等同替换;而这些修 改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围。Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present invention, not to limit them; although the present invention has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that: The technical solutions recorded in the foregoing embodiments are modified, or some of the technical features thereof are equivalently replaced; these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present invention.

Claims (9)

  1. 一种视杆仿生视觉传感器,其特征在于,包括:第一子电路,所述第一子电路包括目标第一类感光器件、第一电流放大器、比较器、加法器和数模转换器;A rod bionic vision sensor, characterized by comprising: a first sub-circuit, the first sub-circuit including a target first-type photosensitive device, a first current amplifier, a comparator, an adder, and a digital-to-analog converter;
    所述目标第一类感光器件用于获取目标光信号,并将所述目标光信号转换为第一类电流信号;The target first-type photosensitive device is used to obtain a target light signal, and convert the target light signal into a first-type current signal;
    所述目标第一类感光器件与所述第一电流放大器相连,所述第一电流放大器与所述比较器的一个输入端相连;所述加法器的输入端分别与所述目标第一类感光器件周围第一预设数量个非目标第一类感光器件连接,所述加法器的输出端与所述比较器的另一个输入端相连;The target first-type photosensitive device is connected to the first current amplifier, and the first current amplifier is connected to an input terminal of the comparator; the input terminals of the adder are respectively connected to the target first-type photosensitive device A first preset number of non-target type 1 photosensitive devices around the device are connected, and the output terminal of the adder is connected to the other input terminal of the comparator;
    所述比较器的输出端与所述数模转换器相连,所述数模转换器将输入的指定数字信号转换为指定模拟信号,并将所述指定模拟信号输出至所述第一电流放大器或者所述加法器,直至所述比较器的输出端输出事件脉冲信号,所述第一子电路输出所述指定数字信号,所述指定数字信号用于表征所述目标光信号中的光强梯度信息;The output terminal of the comparator is connected to the digital-to-analog converter, and the digital-to-analog converter converts the input specified digital signal into a specified analog signal, and outputs the specified analog signal to the first current amplifier or The adder until the output terminal of the comparator outputs an event pulse signal, the first sub-circuit outputs the designated digital signal, and the designated digital signal is used to characterize the light intensity gradient information in the target optical signal ;
    其中,每个所述非目标第一类感光器件均与一个第一类控制开关串联。Wherein, each of the non-target first-type photosensitive devices is connected in series with a first-type control switch.
  2. 根据权利要求1所述的视杆仿生视觉传感器,其特征在于,所述第一子电路还包括:三态门电路;The rod bionic vision sensor according to claim 1, wherein the first sub-circuit further comprises: a three-state gate circuit;
    所述三态门电路分别与所述比较器的输出端以及所述数模转换器的输入端连接;The tri-state gate circuit is respectively connected with the output terminal of the comparator and the input terminal of the digital-to-analog converter;
    所述三态门电路用于在所述比较器的输出端输出所述事件脉冲信号时,输出所述指定数字信号。The three-state gate circuit is used to output the designated digital signal when the event pulse signal is output at the output terminal of the comparator.
  3. 根据权利要求1所述的视杆仿生视觉传感器,其特征在于,所述第一子电路还包括:寻址单元;The rod bionic vision sensor according to claim 1, wherein the first sub-circuit further comprises: an addressing unit;
    所述寻址单元分别与所述比较器的输出端以及所述数模转换器的输入端连接;The addressing unit is respectively connected with the output terminal of the comparator and the input terminal of the digital-to-analog converter;
    所述寻址单元用于在所述比较器的输出端输出所述事件脉冲信号时,输出所述指定数字信号。The addressing unit is used to output the designated digital signal when the event pulse signal is output at the output terminal of the comparator.
  4. 根据权利要求1所述的视杆仿生视觉传感器,其特征在于,所述控制电路还包括:第二子电路;The rod bionic vision sensor according to claim 1, wherein the control circuit further comprises: a second sub-circuit;
    所述第二子电路包括一个所述非目标第一类感光器件和所述第二预设数量个第一类电流镜;The second sub-circuit includes one non-target first-type photosensitive device and the second preset number of first-type current mirrors;
    每个第一类电流镜分别与所述非目标第一类感光器件周围的一个目标第一类感光器件串联。Each first-type current mirror is respectively connected in series with a target first-type photosensitive device around the non-target first-type photosensitive device.
  5. 根据权利要求1-4中任一项所述的视杆仿生视觉传感器,其特征在于,当所述目标光信号的光照度大于第一预设值时,所有所述第一类控制开关同时导通,当所述目标光信号的强度小于第二预设值时,所有所述第一类控制开关同时断开。The rod bionic vision sensor according to any one of claims 1-4, wherein when the illuminance of the target light signal is greater than a first preset value, all the first-type control switches are turned on at the same time When the intensity of the target optical signal is less than the second preset value, all the first type control switches are turned off at the same time.
  6. 根据权利要求1-4中任一项所述的视杆仿生视觉传感器,其特征在于,当至少一个所述第一类控制开关导通时,所述第一子电路输出的所述指定数字信号为差模信号,当所有所述第一类控制开关断开时,所述第一子电路输出的所述指定数字信号为共模信号。The rod bionic vision sensor according to any one of claims 1-4, wherein when at least one of the first-type control switches is turned on, the designated digital signal output by the first sub-circuit It is a differential mode signal. When all the first-type control switches are turned off, the designated digital signal output by the first sub-circuit is a common mode signal.
  7. 根据权利要求1-4中任一项所述的视杆仿生视觉传感器,其特征在于,所述第一电流放大器具体为第二类电流镜。The rod bionic vision sensor according to any one of claims 1 to 4, wherein the first current amplifier is specifically a second type current mirror.
  8. 根据权利要求1-4中任一项所述的视杆仿生视觉传感器,其特征在于,所述第一子电路还包括:第二电流放大器;The rod bionic vision sensor according to any one of claims 1-4, wherein the first sub-circuit further comprises: a second current amplifier;
    所述第二电流放大器连接在所述目标第一类感光器件与所述第一电流放大器之间。The second current amplifier is connected between the target first-type photosensitive device and the first current amplifier.
  9. 根据权利要求1-4中任一项所述的视杆仿生视觉传感器,其特征在于,所述第一子电路还包括:存储单元;The rod bionic vision sensor according to any one of claims 1-4, wherein the first sub-circuit further comprises: a storage unit;
    所述存储单元用于存储所述指定数字信号。The storage unit is used to store the designated digital signal.
PCT/CN2020/073527 2019-12-24 2020-01-21 Rod bionic vision sensor WO2021128534A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201911348673.5 2019-12-24
CN201911348673.5A CN111031267B (en) 2019-12-24 2019-12-24 Optic rod bionic vision sensor

Publications (1)

Publication Number Publication Date
WO2021128534A1 true WO2021128534A1 (en) 2021-07-01

Family

ID=70212884

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/073527 WO2021128534A1 (en) 2019-12-24 2020-01-21 Rod bionic vision sensor

Country Status (2)

Country Link
CN (1) CN111031267B (en)
WO (1) WO2021128534A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112532898B (en) * 2020-12-03 2022-09-27 北京灵汐科技有限公司 Bimodal infrared bionic vision sensor
CN112584016B (en) * 2020-12-03 2022-07-19 北京灵汐科技有限公司 Infrared bionic vision sensor
CN112600996B (en) * 2020-12-03 2022-12-09 清华大学 Ultraviolet bionic vision sensor

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103595931A (en) * 2013-11-05 2014-02-19 天津大学 CMOS asynchronous time domain image sensor capable of achieving real-time time stamp
JP2014187423A (en) * 2013-03-21 2014-10-02 Canon Inc Imaging element, method of driving the same, and imaging device
CN105163048A (en) * 2015-09-11 2015-12-16 天津大学 Dynamic vision sensor based on amplifier multiplexing
CN108200362A (en) * 2017-12-19 2018-06-22 清华大学 Bionical retina imaging circuit and sub-circuit based on space contrast degree
CN110507283A (en) * 2019-09-17 2019-11-29 福州鑫图光电有限公司 Retina camera and its implementation

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8625012B2 (en) * 2009-02-05 2014-01-07 The Hong Kong University Of Science And Technology Apparatus and method for improving dynamic range and linearity of CMOS image sensor
CN110324548B (en) * 2019-06-27 2021-11-09 Oppo广东移动通信有限公司 Pixel unit circuit, signal processing method and storage medium

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2014187423A (en) * 2013-03-21 2014-10-02 Canon Inc Imaging element, method of driving the same, and imaging device
CN103595931A (en) * 2013-11-05 2014-02-19 天津大学 CMOS asynchronous time domain image sensor capable of achieving real-time time stamp
CN105163048A (en) * 2015-09-11 2015-12-16 天津大学 Dynamic vision sensor based on amplifier multiplexing
CN108200362A (en) * 2017-12-19 2018-06-22 清华大学 Bionical retina imaging circuit and sub-circuit based on space contrast degree
CN110507283A (en) * 2019-09-17 2019-11-29 福州鑫图光电有限公司 Retina camera and its implementation

Also Published As

Publication number Publication date
CN111031267A (en) 2020-04-17
CN111031267B (en) 2020-12-11

Similar Documents

Publication Publication Date Title
WO2021128533A1 (en) Bimodal bionic vision sensor
WO2021128531A1 (en) Bimodal bionic vision sensor with retinal cone and retinal rod
WO2021128534A1 (en) Rod bionic vision sensor
US9967472B2 (en) Image sensor combining high dynamic range techniques
CN103327342B (en) There is the imaging system of opaque filter pixel
CN106060430A (en) Image pickup apparatus, image pickup system, and method of driving an image pickup apparatus
CN112532898B (en) Bimodal infrared bionic vision sensor
TWI615028B (en) Image sensor, imaging terminal having same and imaging method using same
WO2021128532A1 (en) Multiplexing retinal cone-rod bionic vision sensor
TWI615029B (en) Image sensor, terminal having same and imaging method using same
WO2021128536A1 (en) Pixel array and bionic vision sensor
WO2021128535A1 (en) Pixel readout system of dual-modality bionic vision sensor
US9843746B2 (en) Image sensor combining high dynamic range techniques
WO2017101864A1 (en) Image sensor, control method, and electronic device
WO2017101558A1 (en) Image sensor, terminal comprising same, and imaging method
WO2017101562A1 (en) Image sensor, terminal having same, and imaging method
CN112543271B (en) Bimodal ultraviolet bionic vision sensor
US10574922B2 (en) Imaging systems with boosted control signals
US20210058576A1 (en) Imaging systems with improved circuitry to provide boosted control signals
WO2022116991A1 (en) Bionic vision sensor
CN216649833U (en) Pixel reading circuit and image sensor
CN116249024A (en) Pixel readout circuit and image sensor
CN112600996A (en) Ultraviolet bionic vision sensor

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20907038

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 20907038

Country of ref document: EP

Kind code of ref document: A1