CN211296854U - Pixel array and bionic vision sensor - Google Patents

Pixel array and bionic vision sensor Download PDF

Info

Publication number
CN211296854U
CN211296854U CN201922360390.4U CN201922360390U CN211296854U CN 211296854 U CN211296854 U CN 211296854U CN 201922360390 U CN201922360390 U CN 201922360390U CN 211296854 U CN211296854 U CN 211296854U
Authority
CN
China
Prior art keywords
pixel array
type
frequency band
optical signals
row
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201922360390.4U
Other languages
Chinese (zh)
Inventor
施路平
杨哲宇
赵蓉
裴京
徐海峥
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tsinghua University
Original Assignee
Tsinghua University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tsinghua University filed Critical Tsinghua University
Priority to CN201922360390.4U priority Critical patent/CN211296854U/en
Priority to PCT/CN2020/073543 priority patent/WO2021128536A1/en
Application granted granted Critical
Publication of CN211296854U publication Critical patent/CN211296854U/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
    • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
    • H04N25/70—SSIS architectures; Circuits associated therewith

Abstract

The embodiment of the utility model provides a pixel array and bionic vision sensor, pixel array includes: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for extracting optical signals of a specified frequency band and converting the optical signals of the specified frequency band into second-class current signals; in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting optical signals of the same designated frequency band. The embodiment of the utility model provides an in the pixel array that provides can be arranged in bionical vision sensor to make bionical vision sensor have perception colour information and absolute light intensity information's function and perception light intensity gradient information's function simultaneously, compensatied prior art not can with the bionical vision sensor assorted pixel array's of two perception modes defect.

Description

Pixel array and bionic vision sensor
Technical Field
The utility model relates to an integrated circuit technical field, more specifically relates to pixel array and bionical vision sensor.
Background
At present, with the continuous and deep research on image sensors and image processing and recognition algorithms, the bionic vision sensor plays an increasingly important role in a plurality of application fields such as industrial manufacturing, intelligent transportation, intelligent robots and the like.
The bionic vision sensor mainly simulates the mode of human retina, and the human retina mainly comprises two visual perception cells, namely cone cells and rod cells, which respectively correspond to two different modes. The mode of the cone cells is mainly sensitive to absolute light intensity information and color information, and the cone cells have high image restoration precision but low restoration speed; in contrast to the mode of the cone cells, the rod cells mainly sense light intensity gradient information, have a fast sensing speed and a large dynamic range of sensing, but cannot sense absolute light intensity information and color information.
However, all the bionic visual sensors in the prior art can only simulate one mode of the retina of the human eye to form a single perception mode, and thus can only perceive a certain kind of information. Like conventional cameras, color information is mainly perceived, similar to cone cells. Such as Dynamic Vision Sensor (DVS), which is similar to rod cells, primarily senses intensity gradient information. And the single-modality visual sensor application scenarios are limited. For example, for a bionic visual sensor similar to a cone cell, since absolute light intensity information rather than light intensity gradient information is obtained by shooting, although the bionic visual sensor is widely applied to household entertainment electronic equipment, in the field of industrial control, the bionic visual sensor is often faced with the problems of insufficient speed, too small dynamic range and the like, and is difficult to apply. For the bionic visual sensor similar to the rod cell, although the sensing speed is high, the bionic visual sensor is only sensitive to a moving object, so that an image is difficult to shoot, or the quality of the shot image is poor, and the requirement of entertainment electronic equipment is difficult to meet. Moreover, the bionic vision sensor only comprises a single perception mode, and the bionic vision sensor fails when the perception mode fails, so that the bionic vision sensor has great limitation on unmanned driving, unmanned aerial vehicles and other robots with high requirements on stability. In addition, the main indexes for evaluating the performance of the bionic vision sensor at present comprise image quality, dynamic range and shooting speed. From the above, under the framework of the traditional bionic visual sensor, the three indexes are often mutually exclusive: if the shooting speed is increased, the dynamic range of the bionic vision sensor is reduced; the shooting speed generally decreases as the image quality improves, and it is difficult to achieve both.
Therefore, there is a need to provide a bionic visual sensor with dual sensing modes, which can sense the absolute light intensity information, the color information and the light intensity gradient information at the same time, and further provide a pixel array matched with the sensor. However, the prior art pixel array usually adopts a BAYER pattern, and as shown in fig. 1, the plane of the pixels in the column direction is illustrated as: RGRGRG … (0, 2, 4 … columns, respectively) and GBGBGB … (1, 3, 5 … columns, respectively) are spread and tiled, and a light-shielding layer is used between every two pixels to shield light, so that only one color image can be acquired at a time, and the sensor is not suitable for a bionic visual sensor having a dual-sensing mode.
SUMMERY OF THE UTILITY MODEL
To overcome the above problems or at least partially solve the above problems, embodiments of the present invention provide a pixel array and a bionic vision sensor.
In a first aspect, an embodiment of the present invention provides a pixel array, including: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting the same optical signal of the specified frequency band.
Preferably, every two adjacent rows in the pixel array are a repeating unit, and a second type photosensitive device for extracting the optical signal in the red light frequency band, a second type photosensitive device for sensing the optical signal in the blue light frequency band, and a second type photosensitive device for sensing the optical signal in the green light frequency band are simultaneously arranged in each repeating unit.
Preferably, two second-type photosensitive devices for extracting light signals in the red light band are arranged around each first-type photosensitive device except for the first row, the first column, the last row and the last column in the pixel array.
Preferably, two second-type photosensitive devices for extracting optical signals of the blue light band are arranged around each first-type photosensitive device except for the first row, the first column, the last row and the last column in the pixel array.
Preferably, two second-type photosensitive devices for extracting optical signals of the green light band are arranged around each first-type photosensitive device except for the first row, the first column, the last row and the last column in the pixel array.
Preferably, each of the first type and the second type of photosensitive devices includes a photodiode therein.
In a second aspect, an embodiment of the present invention provides a pixel array, including: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in every two adjacent rows of the pixel array, one row only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the other row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands.
Preferably, each adjacent six rows in the pixel array are a repeating unit.
Preferably, each of the first type and the second type of photosensitive devices includes a photodiode therein.
In a third aspect, an embodiment of the present invention provides a bionic vision sensor, including: a pixel array as described in the first or second aspect.
The embodiment of the utility model provides a pair of pixel array and bionic vision sensor, pixel array includes: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array; in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting optical signals of the same designated frequency band. The embodiment of the utility model provides an in the pixel array that provides can be arranged in bionical vision sensor to make bionical vision sensor have perception colour information and absolute light intensity information's function and perception light intensity gradient information's function simultaneously, compensatied not can with the bionical vision sensor assorted pixel array's of two perception modes defect among the prior art.
Drawings
In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings needed to be used in the description of the embodiments or the prior art will be briefly described below, and it is obvious that the drawings in the following description are some embodiments of the present invention, and for those skilled in the art, other drawings can be obtained according to these drawings without creative efforts.
Fig. 1 is a schematic structural diagram of a pixel array in the prior art;
fig. 2 is a schematic structural diagram of a pixel array according to an embodiment of the present invention;
fig. 3 is a schematic structural diagram of a pixel array according to an embodiment of the present invention;
fig. 4 is a schematic structural diagram of a pixel array according to an embodiment of the present invention;
fig. 5 is a schematic structural diagram of a pixel array according to an embodiment of the present invention;
fig. 6 is a schematic structural diagram of a voltage mode active pixel sensor circuit in a bionic vision sensor according to an embodiment of the present invention;
fig. 7 is a schematic structural diagram of a current mode active pixel sensor circuit in a bionic vision sensor according to an embodiment of the present invention;
fig. 8 is a schematic circuit structure diagram for associating a current mode active pixel sensor circuit with other current mode active pixel sensor circuits in a bionic vision sensor provided in an embodiment of the present invention;
fig. 9 is a schematic diagram of a variation form of a specific digital signal input to a digital-to-analog converter in a current mode active pixel sensor circuit in a bionic vision sensor according to an embodiment of the present invention.
Detailed Description
In order to make the objects, technical solutions and advantages of the embodiments of the present invention clearer, the embodiments of the present invention will be clearly and completely described below with reference to the accompanying drawings in the embodiments of the present invention, and it is obvious that the described embodiments are some, but not all, embodiments of the present invention. Based on the embodiments in the present invention, all other embodiments obtained by a person skilled in the art without creative efforts belong to the protection scope of the present invention.
An embodiment of the utility model provides a pixel array, include: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting the same optical signal of the specified frequency band.
Specifically, the embodiment of the utility model provides an in for the bionical vision sensor that the matching has two perception modes, provide one kind and can be applied to the pixel array of above-mentioned bionical vision sensor. The pixel array is formed by arranging a plurality of first photosensitive devices and a plurality of second photosensitive devices, and specifically, the pixel array may be formed by alternately arranging the first photosensitive devices and the second photosensitive devices. Each first type of photosensitive device and each second type of photosensitive device are respectively used as a pixel. Wherein, the quantity of first type photosensitive device and second type photosensitive device can be set for according to pixel array's size, can be the same also can be different, the embodiment of the utility model provides an in this not specifically limit. The first photosensitive device and the second photosensitive device are used for acquiring a target optical signal, the first photosensitive device is also used for converting the target optical signal into a first current signal, and the second photosensitive device is also used for extracting an optical signal of a specified frequency band from the target optical signal and converting the optical signal of the specified frequency band into a second current signal. The first type of photosensitive device may be photodiodes with the same response curve, the second type of photosensitive device may be photodiodes with different response curves, the response frequency band of the second type of photosensitive device may be a specific frequency band, and the specific frequency band may be a red frequency band, a blue frequency band, or a green frequency band. The second type of photosensitive device may also be composed of a photodiode and a Color Filter (CF) with the same response curve, where the color Filter may specifically be a red color Filter, a blue color Filter, or a green color Filter, and is used to extract optical signals in a red light band, a blue light band, or a green light band from the target optical signal, respectively. It should be noted that the color filter may specifically be a filter or a lens, and when the color filter is a lens, a bayer lens may be specifically selected, and other types of lenses may also be selected.
In the following embodiments, only the second type of photosensitive device is exemplified by a photodiode and a color filter having the same response curve.
As shown in fig. 2, only a 7 × 7 pixel array is shown in fig. 2, and is formed by arranging 25 first-type photo- sensing devices 11 and 24 second-type photo-sensing devices 12 alternately. Reference numeral R, G, B in fig. 2 denotes a second type of photosensitive device, and denotes a second type of photosensitive device that extracts an optical signal in a red frequency band, a second type of photosensitive device that extracts an optical signal in a green frequency band, and a second type of photosensitive device that extracts an optical signal in a blue frequency band, respectively. For example, a second type of photosensitive device with a red color filter, a second type of photosensitive device with a green color filter, and a second type of photosensitive device with a blue color filter, respectively.
In each row of the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, each first type photosensitive device and each second type photosensitive device are arranged alternately, and each second type photosensitive device is used for extracting optical signals of the same appointed frequency band. That is, as shown in fig. 2, each of the second type of photo-sensing devices in the first row includes a green color filter, denoted G, each of the second type of photo-sensing devices in the second row includes a red color filter, denoted R, each of the second type of photo-sensing devices in the third row includes a blue color filter, denoted B, each of the second type of photo-sensing devices in the fourth row includes a red color filter, denoted R, each of the second type of photo-sensing devices in the fifth row includes a green color filter, denoted G, each of the second type of photo-sensing devices in the sixth row includes a red color filter, denoted R, and each of the second type of photo-sensing devices in the seventh row includes a blue color filter, denoted B. The first type of photosensitive devices in the first to seventh rows are not labeled.
When the pixel array is applied to the bionic vision sensor, the function of sensing light intensity gradient information can be realized by combining all first-class photosensitive devices of the pixel array with corresponding control circuits, each first-class photosensitive device directly converts a target light signal into a first-class current signal, wherein the light signal of a specified frequency band is not required to be extracted, each first-class photosensitive device can be compared with electric signals obtained by four surrounding first-class photosensitive devices, and finally an image generated by the first-class photosensitive devices is a gray image representing edge information; the function of sensing color information and absolute light intensity information is realized by combining all the second-class photosensitive devices of the pixel array with corresponding control circuits, and because each second-class photosensitive device is used for acquiring a target light signal, extracting a light signal of a specified frequency band from the target light signal and converting the light signal of the specified frequency band into a second-class current signal, an image generated by the second-class photosensitive devices is a color image.
The embodiment of the utility model provides an in provide a pixel array, include: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array; in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting optical signals of the same designated frequency band. The embodiment of the utility model provides an in the pixel array that provides can be arranged in bionical vision sensor to make bionical vision sensor have perception colour information and absolute light intensity information's function and perception light intensity gradient information's function simultaneously, compensatied not can with the bionical vision sensor assorted pixel array's of two perception modes defect among the prior art.
On the basis of the embodiment, the utility model provides a pixel array, every adjacent four rows is a repeating unit in the pixel array, and exists simultaneously in every repeating unit and draw the light signal's of ruddiness frequency channel second type photosensitive element, the extraction the light signal's of blue light frequency channel second type photosensitive element and the extraction the light signal's of green light frequency channel second type photosensitive element.
Specifically, as shown in fig. 2, in the embodiment of the present invention, in the pixel array formed by arranging all the first type of photosensitive devices and all the second type of photosensitive devices, the first line to the fourth line are a repeating unit, and there are the second type of photosensitive devices for extracting the optical signals of the red light frequency band, the second type of photosensitive devices for extracting the optical signals of the blue light frequency band, and the second type of photosensitive devices for extracting the optical signals of the green light frequency band in the repeating unit. For example, a second type of photosensitive device including a red color filter, a blue color filter, and a green color filter is simultaneously present in each repeating unit. The fifth row is the same as the first row, the sixth row is the same as the second row, and the seventh row is the same as the third row. If the pixel array shown in fig. 2 has an eighth row, the eighth row is the same as the fourth row, and the fifth to eighth rows constitute one repeating unit.
The pixel array obtained by the arrangement can enable the first type of photosensitive devices and the second type of photosensitive devices to be arranged relatively uniformly, so that color information, absolute light intensity information and light intensity gradient information sensed by the matched bionic vision sensor are more comprehensive and accurate, and the obtained image effect is better.
On the basis of the above-mentioned embodiment, the utility model provides a pixel array, except first line, first row, last line and last column every in the pixel array all have two around the first type photosensitive device and extract the second type photosensitive device of the light signal of ruddiness frequency channel.
Specifically, as shown in fig. 2, in the embodiment of the present invention, in the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, the first type photosensitive devices in the second row and the second column are taken as an example for explanation, and the four second type photosensitive devices around the first type photosensitive devices are respectively marked as G, R, R, B, that is, there are two second type photosensitive devices for extracting the light signals in the red light frequency band. For example, there may be two photosensitive devices of the second type that include red color filters. As another example, the first photosensitive device in the third row and the third column, four second photosensitive devices around the first photosensitive device are respectively labeled R, B, B, R, and there are also two second photosensitive devices for extracting light signals in the red light band. In the pixel array obtained by the arrangement, the pixel color-to-intensity ratio is as follows: 50% red, 25% blue, 25% green.
At this time, the second type of photosensitive devices existing in the first to fourth rows in one repeating unit include a green color filter, a red color filter, a blue color filter, and a red color filter, respectively.
On the basis of the above-mentioned embodiment, the utility model provides a pixel array, except first line, first row, last line and last column every in the pixel array all have two around the first type photosensitive device and extract the second type photosensitive device of the light signal of blue light frequency channel.
Specifically, as shown in fig. 3, in the embodiment of the present invention, in the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, the first type photosensitive devices in the second row and the second column are taken as an example for explanation, and the four second type photosensitive devices around the first type photosensitive devices are respectively marked as G, B, B, R, that is, there are two second type photosensitive devices for extracting the optical signals in the blue light frequency band. For example, there may be two photosensitive devices of the second type that include blue filters. As another example, the first photosensitive device in the third row and the third column, four second photosensitive devices around the first photosensitive device are respectively labeled B, R, R, B, and there are also two second photosensitive devices for extracting light signals in the blue light band. In the pixel array obtained by the arrangement, the pixel color-to-intensity ratio is as follows: 25% red, 50% blue, 25% green.
At this time, the second type of photosensitive devices existing in the first to fourth rows in one repeating unit include a green color filter, a blue color filter, a red color filter, and a blue color filter, respectively.
On the basis of the above-mentioned embodiment, the utility model provides a pixel array, except first line, first row, last line and last column every in the pixel array all have two around the first type photosensitive device and extract the second type photosensitive device of the light signal of green glow frequency channel.
Specifically, as shown in fig. 4, in the embodiment of the present invention, in the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, the first type photosensitive devices in the second row and the second column are taken as an example for explanation, and the four second type photosensitive devices around the first type photosensitive devices are respectively marked as R, G, G, B, that is, there are two second type photosensitive devices for extracting the optical signal in the green light band. For example, there may be two photosensitive devices of the second type that include green filters. As another example, the first photosensitive device in the third row and the third column, four second photosensitive devices around the first photosensitive device are respectively labeled G, B, B, G, and there are also two second photosensitive devices for extracting light signals in the green light band. In the pixel array obtained by the arrangement, the pixel color-to-intensity ratio is as follows: 25% red, 25% blue, 50% green.
At this time, the second type of photosensitive devices existing in the first to fourth rows in one repeating unit include red, green, blue, and green color filters, respectively.
Since the arrangement of all the first type photosensitive devices and all the second type photosensitive devices in the pixel array are different, mainly different prior (prior) to a reverse mosaic transformation (Demosaicing) algorithm, and since human eyes are most sensitive to green, in practical applications, the array arrangement shown in fig. 4 is usually selected as a preferred scheme.
On the basis of the above-mentioned embodiment, the embodiment of the utility model provides a pixel array, every first type photosensitive device with all include photodiode in the second type photosensitive device.
On the basis of the above embodiments, the embodiment of the present invention provides a pixel array, including: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in every two adjacent rows of the pixel array, one row only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the other row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands.
Specifically, the embodiment of the utility model provides an in for the bionical vision sensor that the matching has two perception modes, provide one kind and can be applied to the pixel array of above-mentioned bionical vision sensor. The pixel array is formed by arranging a plurality of first photosensitive devices and a plurality of second photosensitive devices, and specifically, the pixel array may be formed by alternately arranging the first photosensitive devices and the second photosensitive devices. Wherein, the quantity of first type photosensitive device and second type photosensitive device can be set for according to pixel array's size, can be the same also can be different, the embodiment of the utility model provides an in this not specifically limit.
As shown in fig. 5, only a 7 × 7 pixel array is shown in fig. 5, consisting of 33 first type photo-sensitive devices 22 and 16 second type photo-sensitive devices 21. In fig. 5, the photosensitive devices not marked are all the first type photosensitive devices, the photosensitive devices marked R, G, B are all the second type photosensitive devices, and respectively represent the second type photosensitive devices for extracting the optical signals in the red frequency band, the second type photosensitive devices for extracting the optical signals in the green frequency band, and the second type photosensitive devices for extracting the optical signals in the blue frequency band. For example, a second type of photosensitive device with a red color filter, a second type of photosensitive device with a green color filter, and a second type of photosensitive device with a blue color filter, respectively.
In a pixel array formed by all the first type photosensitive devices and all the second type photosensitive devices, in every two adjacent rows, taking a first row and a second row as an example, the second row only comprises the first type photosensitive devices, each first type photosensitive device and each second type photosensitive device in the first row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands. Similarly, every two adjacent columns take a first column and a second column as an example, the second column only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the first column are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands.
In fig. 5, the second photosensitive devices in the first row and the first column, the first row and the third column, and the first row and the fifth column are three adjacent second photosensitive devices, where the second photosensitive devices in the first row and the first column extract optical signals in a red frequency band, which is denoted as R, the second photosensitive devices in the first row and the third column extract optical signals in a green frequency band, which is denoted as G, and the second photosensitive devices in the first row and the fifth column extract optical signals in a blue frequency band, which is denoted as B.
When the pixel array is applied to the bionic vision sensor, the function of sensing light intensity gradient information can be realized by combining all first-class photosensitive devices of the pixel array with corresponding control circuits, each first-class photosensitive device directly converts a target light signal into a first-class current signal, wherein the light signal of a specified frequency band is not required to be extracted, each first-class photosensitive device can be compared with electric signals obtained by four surrounding first-class photosensitive devices, and finally an image generated by the first-class photosensitive devices is a gray image representing edge information; the function of sensing color information and absolute light intensity information is realized by combining all the second-class photosensitive devices of the pixel array with corresponding control circuits, and because each second-class photosensitive device is used for acquiring a target light signal, extracting a light signal of a specified frequency band from the target light signal and converting the light signal of the specified frequency band into a second-class current signal, an image generated by the second-class photosensitive devices is a color image.
The embodiment of the utility model provides an in provide a pixel array, include: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array; in every two adjacent rows of the pixel array, one row only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the other row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands. The embodiment of the utility model provides an in the pixel array that provides can be arranged in bionical vision sensor to make bionical vision sensor have perception colour information and absolute light intensity information's function and perception light intensity gradient information's function simultaneously, compensatied not can with the bionical vision sensor assorted pixel array's of two perception modes defect among the prior art.
On the basis of the above embodiments, the present invention provides a pixel array, in which every adjacent six rows are a repeating unit.
Specifically, as shown in fig. 5, in the embodiment of the present invention, in the pixel array formed by arranging all the first type photosensitive devices and all the second type photosensitive devices, the first row to the sixth row are a repeating unit, and three adjacent second type photosensitive devices in each row in the repeating unit extract optical signals of different specified frequency bands. For example, color filters different from each other exist in every adjacent three second-type photosensitive devices of each row in the repeating unit. The seventh row is the same as the first row. If the pixel array shown in fig. 2 has eighth to twelfth rows, the eighth row is the same as the second row, the ninth row is the same as the third row, the tenth row is the same as the fourth row, the eleventh row is the same as the fifth row, the twelfth row is the same as the sixth row, and the seventh to twelfth rows constitute one repeating unit.
The pixel array obtained by the arrangement can enable the light intensity gradient information sensed by the matched bionic vision sensor to be more comprehensive and accurate, and more accurate edge information can be obtained.
On the basis of the above-mentioned embodiment, the embodiment of the utility model provides a pixel array, every first type photosensitive device with all include photodiode in the second type photosensitive device.
On the basis of the above embodiment, the embodiment of the utility model provides a bionic vision sensor is provided, include: an array of pixels as described in the previous embodiments.
Specifically, the embodiment of the utility model provides an in the bionic vision sensor that provides, every first type photosensitive device and every second type photosensitive device in the pixel array equally divide and do not correspond a control circuit. The control circuit corresponding to the first type of light sensing device may be a current mode active pixel sensor circuit and the control circuit corresponding to the second type of light sensing device may be a voltage mode active pixel sensor circuit. The voltage mode active pixel sensor circuit is shown in fig. 6, which corresponds to the cone cells of the retina of a human eye. Vcc1 in fig. 6 is the power supply for the voltage mode active pixel sensor circuit, Vcc1 may be 3.3V. The second type of photosensitive device 12 is respectively connected with MOS tubes 13 and 14, and the MOS tube 14 is connected with the MOS tube 15. The MOS transistor 13 is used for performing a bias function, the MOS transistor 14 is used for performing a switching function, and the MOS transistor 15 is used for performing current integration on the electrical signal converted by the second type photosensitive device 12 to obtain a voltage signal, and represent light intensity information and color information in the optical signal.
The current mode active pixel sensor circuit is shown in fig. 7, which corresponds to a rod cell of the retina of a human eye. In fig. 7, Vcc2 is the power supply for the current mode active pixel sensor circuit, and Vcc2 may be 3.3V. The first photosensitive device 11 is connected with the MOS tube 23, the MOS tube 23 is connected with the MOS tube 24 and forms a current mirror, and the current signal I converted by the first photosensitive device 11 can be obtained by changing the channel width of the MOS tube 24cThe current signal magnitude of the end of the MOS transistor 24 corresponding to the mirror image of the first type photosensitive device 11 has a P-fold relationship, that is, the current of the end of the MOS transistor 24 corresponding to the mirror image of the first type photosensitive device 11 is P × Ic。
The association between a certain current mode active pixel sensor circuit and other current mode active pixel sensor circuits is by a circuit as shown in fig. 8. In fig. 8, Vcc3 is a power supply for the circuit, and Vcc3 may be 3.3V. A Digital to Analog Converter (DAC) 31 is connected to the comparator 32, and the electrical signal converted by the first type of photo-sensing device is IcThe electrical signals converted by 4 other first-type photosensitive devices around the first-type photosensitive device are I1、I2、I3、I4After 4 times of reduction, the ratio is I1/4、I2/4、I3/4、I4/4. The comparator 32 is connected to the addressing unit 33 and the addressing unit 33 is connected to the DAC31 and the memory unit 34, respectively. It should be noted that the input of DAC31 may be a periodic digital signal input by human, and is used by addressing unit 33 to address storage unit 34 to store the output result of the current mode active pixel sensor circuit when the output of comparator 32 outputs the event pulse signal, i.e. comparator 32 is in an edge triggered state. The embodiment of the utility model provides an in realize the control to the output action of current mode active pixel sensor circuit through comparator 32, when the output event pulse signal of comparator 32, comparator 32 is in border trigger state promptly, and the appointed digit of current mode active pixel sensor circuit output this momentAnd the specified digital signal at this time is used for representing the light intensity gradient information in the target light signal. The storage unit 34 may specifically be a register, a latch, an SRAM, a DRAM, a memristor, or the like. Taking a register as an example, the bit number of the register is related to the precision of the DAC31, and a 4-bit register may be selected in the embodiment of the present invention.
Specifically, the change form of the designated digital signal input to the DAC31 is as shown in fig. 9, the designated digital signal is specifically increased in a step-like manner with time, and when a certain time N × step occurs, the designated digital signal takes a value of Δ I, the comparator 32 outputs an event pulse signal, that is, the comparator 32 is in an edge triggered state, and then Δ I at this time is used as the output of the current mode active pixel sensor circuit. Wherein, N is the number of steps passed before, and step is the time length of each step.
The embodiment of the utility model provides an in, can regard as a pixel group with every nine pixels in the pixel array, and the central pixel in this pixel group is first type sensitization device, compares central pixel in every pixel group and the signal of telecommunication that four first type sensitization devices obtained on every side through control circuit, and the image that finally produces via first type sensitization device is for the grey level image that shows marginal information, realizes the function of perception light intensity gradient information. And the function of sensing color information and absolute light intensity information is realized by combining all the second type photosensitive devices of the pixel array with corresponding control circuits.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit it; although the present invention has been described in detail with reference to the foregoing embodiments, it should be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit and scope of the present invention in its corresponding aspects.

Claims (10)

1. An array of pixels, comprising: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in each row of the pixel array, each first photosensitive device and each second photosensitive device are arranged alternately, and each second photosensitive device is used for extracting the same optical signal of the specified frequency band.
2. The pixel array of claim 1, wherein every adjacent four rows of the pixel array are a repeating unit, and a second photosensitive device for extracting the light signal in the red light band, a second photosensitive device for extracting the light signal in the blue light band, and a second photosensitive device for extracting the light signal in the green light band are simultaneously present in each repeating unit.
3. The pixel array of claim 2, wherein each of the first type of photo-sensing devices in the pixel array except for the first row, the first column, the last row and the last column has two second type photo-sensing devices for extracting the light signals in the red light band.
4. The pixel array of claim 2, wherein each of the first type of photo-sensing devices in the pixel array except for the first row, the first column, the last row and the last column has two second type photo-sensing devices around it for extracting the light signal in the blue light band.
5. The pixel array of claim 2, wherein each of the first type of photo-sensing devices in the pixel array except for the first row, the first column, the last row and the last column has two second type photo-sensing devices around it for extracting the light signal in the green band.
6. The pixel array of any of claims 1-5, wherein each of the first type of photo-sensing device and the second type of photo-sensing device comprises a photodiode.
7. An array of pixels, comprising: the first photosensitive devices are used for acquiring target optical signals and converting the target optical signals into first-class current signals, and the second photosensitive devices are used for acquiring the target optical signals, extracting optical signals of a specified frequency band from the target optical signals and converting the optical signals of the specified frequency band into second-class current signals; the designated frequency band is a red light frequency band, a blue light frequency band or a green light frequency band; all the first type photosensitive devices and all the second type photosensitive devices are arranged to form a pixel array;
in every two adjacent rows of the pixel array, one row only comprises the first type photosensitive devices, every first type photosensitive device and every second type photosensitive device in the other row are arranged alternately, and every three adjacent second type photosensitive devices extract optical signals of different specified frequency bands.
8. The pixel array of claim 7, wherein each adjacent six rows of the pixel array are a repeating unit.
9. The pixel array of claim 7 or 8, wherein each of the first type of photo-sensing device and the second type of photo-sensing device comprises a photodiode.
10. A biomimetic vision sensor, comprising: the pixel array of any one of claims 1-9.
CN201922360390.4U 2019-12-24 2019-12-24 Pixel array and bionic vision sensor Active CN211296854U (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CN201922360390.4U CN211296854U (en) 2019-12-24 2019-12-24 Pixel array and bionic vision sensor
PCT/CN2020/073543 WO2021128536A1 (en) 2019-12-24 2020-01-21 Pixel array and bionic vision sensor

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201922360390.4U CN211296854U (en) 2019-12-24 2019-12-24 Pixel array and bionic vision sensor

Publications (1)

Publication Number Publication Date
CN211296854U true CN211296854U (en) 2020-08-18

Family

ID=72022687

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201922360390.4U Active CN211296854U (en) 2019-12-24 2019-12-24 Pixel array and bionic vision sensor

Country Status (2)

Country Link
CN (1) CN211296854U (en)
WO (1) WO2021128536A1 (en)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112543271A (en) * 2020-12-03 2021-03-23 清华大学 Bimodal ultraviolet bionic vision sensor
CN112584016A (en) * 2020-12-03 2021-03-30 北京灵汐科技有限公司 Infrared bionic vision sensor
CN112702588A (en) * 2020-12-21 2021-04-23 北京灵汐科技有限公司 Dual-mode image signal processor and dual-mode image signal processing system
CN113038046A (en) * 2021-03-23 2021-06-25 北京灵汐科技有限公司 Pixel sensing array and vision sensor
WO2022199413A1 (en) * 2021-03-23 2022-09-29 北京灵汐科技有限公司 Pixel sensing array and visual sensor

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102623475B (en) * 2012-04-17 2014-12-31 中国科学院上海高等研究院 Stacked CMOS (Complementary Metal Oxide Semiconductor) image sensor
US20150062347A1 (en) * 2013-08-27 2015-03-05 Semiconductor Components Industries, Llc Image processing methods for visible and infrared imaging
KR102409389B1 (en) * 2015-10-06 2022-06-15 삼성전자주식회사 Image sensor including color separation element
CN105611136B (en) * 2016-02-26 2019-04-23 联想(北京)有限公司 A kind of imaging sensor and electronic equipment
KR102549621B1 (en) * 2016-09-02 2023-06-28 삼성전자주식회사 Semiconductor device
US10444415B2 (en) * 2017-02-14 2019-10-15 Cista System Corp. Multispectral sensing system and method

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112543271A (en) * 2020-12-03 2021-03-23 清华大学 Bimodal ultraviolet bionic vision sensor
CN112584016A (en) * 2020-12-03 2021-03-30 北京灵汐科技有限公司 Infrared bionic vision sensor
CN112584016B (en) * 2020-12-03 2022-07-19 北京灵汐科技有限公司 Infrared bionic vision sensor
CN112702588A (en) * 2020-12-21 2021-04-23 北京灵汐科技有限公司 Dual-mode image signal processor and dual-mode image signal processing system
CN113038046A (en) * 2021-03-23 2021-06-25 北京灵汐科技有限公司 Pixel sensing array and vision sensor
WO2022199413A1 (en) * 2021-03-23 2022-09-29 北京灵汐科技有限公司 Pixel sensing array and visual sensor

Also Published As

Publication number Publication date
WO2021128536A1 (en) 2021-07-01

Similar Documents

Publication Publication Date Title
CN211296854U (en) Pixel array and bionic vision sensor
CN111083402B (en) Bimodal bionic vision sensor
CN111083404B (en) Viewing cone and rod bimodal bionic vision sensor
CN102970493B (en) Many level resetting voltage of multiple conversion gain image sensor
CN102625060B (en) Dynamic range expansion for the cmos image sensor of movable application
CN111106807B (en) Viewing cone and rod multiplexing bionic vision sensor
WO2011106461A1 (en) Increasing the resolution of color sub-pixel arrays
CN112532898B (en) Bimodal infrared bionic vision sensor
CN102801984B (en) The method of color image sensor and acquisition color digital image
CN111031267B (en) Optic rod bionic vision sensor
CN109496426A (en) Sensor, driving method and electronic device
US9368530B2 (en) Image sensor and color filter array including multiple selectable meshed filter sets
CN111083405B (en) Bimodal bionic vision sensor pixel reading system
CN106791507A (en) High dynamic cmos pixel unit and its signal acquisition method
US11317063B2 (en) Calibration module of image sensor, image sensor and method of calibrating crosstalk in image sensor
CN207251823U (en) Imaging device and imaging system
US11463643B2 (en) Image sensing device and image sensing method
CN112543271B (en) Bimodal ultraviolet bionic vision sensor
CN104967763B (en) A kind of image acquisition device, image-pickup method and electronic equipment
WO2022116991A1 (en) Bionic vision sensor
CN103002292A (en) Colorful image sensor and colorful color-filtering cell array
US11696041B2 (en) Image sensor, control method, camera component and mobile terminal with raised event adaptability and phase detection auto focus
CN108040216A (en) A kind of high dynamic cmos pixel unit and its Signal sampling and processing method
EP3846463A1 (en) Image generation device and image generation method
CN113301280A (en) Pixel circuit of photosensitive block, image processing method and device and electronic equipment

Legal Events

Date Code Title Description
GR01 Patent grant
GR01 Patent grant