CN210578954U - Image sensor with multichannel narrowband color filter array - Google Patents
Image sensor with multichannel narrowband color filter array Download PDFInfo
- Publication number
- CN210578954U CN210578954U CN201921700892.0U CN201921700892U CN210578954U CN 210578954 U CN210578954 U CN 210578954U CN 201921700892 U CN201921700892 U CN 201921700892U CN 210578954 U CN210578954 U CN 210578954U
- Authority
- CN
- China
- Prior art keywords
- color filter
- filter array
- image sensor
- narrow
- band
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 230000003595 spectral effect Effects 0.000 claims abstract description 29
- 238000000701 chemical imaging Methods 0.000 abstract description 15
- 238000005516 engineering process Methods 0.000 description 11
- 238000001228 spectrum Methods 0.000 description 9
- 238000010586 diagram Methods 0.000 description 7
- 238000003384 imaging method Methods 0.000 description 7
- 230000010354 integration Effects 0.000 description 5
- 238000001514 detection method Methods 0.000 description 4
- 239000000126 substance Substances 0.000 description 3
- 238000000034 method Methods 0.000 description 2
- 230000003252 repetitive effect Effects 0.000 description 2
- 230000015572 biosynthetic process Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000004298 light response Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000005693 optoelectronics Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
- H04N25/13—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements
- H04N25/135—Arrangement of colour filter arrays [CFA]; Filter mosaics characterised by the spectral characteristics of the filter elements based on four or more different wavelength filter elements
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- Spectrometry And Color Measurement (AREA)
Abstract
The utility model provides an image sensor with multichannel narrowband color filter array. The image sensor comprises a two-dimensional photosensitive pixel array and a multi-channel narrow-band color filter array, wherein the color filter array is positioned above a photosensitive surface of the photosensitive pixel array, and each photosensitive pixel corresponds to a narrow-band color filter with a bandwidth; the photosensitive pixel array and the color filter array are both formed by repeated arrangement of minimum repeating units, and the minimum repeating units are respectively formed by n × n photosensitive pixels or narrow-band color filters, wherein n is a positive integer greater than 2. The utility model discloses an image sensor has multichannel narrowband color filter array, can carry out high spectral imaging, can obtain spectral resolution and spatial resolution simultaneously, can obtain spectral information and spatial information fast, high performance ground, and the integrated level is high, and is with low costs.
Description
Technical Field
The utility model relates to an image sensor's high spectrum imaging technique especially combines together imaging technique and spectrum technique, obtains the spatial information and the spectral information of target simultaneously. More importantly, the scheme of the multi-channel narrow-band color filter array realizes that the image sensor directly acquires the spectral information, is easy to realize, has high integration level, and is an image sensor with the multi-channel narrow-band color filter array for hyperspectral imaging.
Background
The hyperspectral imaging technology is an image data technology based on a plurality of narrow bands developed in the last two decades, the most prominent application of the hyperspectral imaging technology is the field of remote sensing detection, and the hyperspectral imaging technology has a wider application prospect in more and more civil fields. The system integrates advanced technologies in the fields of optics, optoelectronics, electronics, information processing, computer science and the like, and is a new emerging technology which organically combines the traditional two-dimensional imaging technology and the spectrum technology.
The definition of the hyperspectral imaging technology is that on the basis of multispectral imaging, an imaging spectrometer is utilized to continuously image a target object in dozens or hundreds of spectral bands in a spectral coverage range from ultraviolet to near infrared (200-2500 nm). The spectral information of the object to be measured is obtained while the spatial characteristic imaging of the object is obtained.
The hyperspectral imaging technology has the characteristics of ultra multiband (hundreds of wave bands), high spectral resolution (a plurality of nm), narrow wave band (less than or equal to 10-2 lambda), wide spectral range (200-2500nm), integrated spectrum and the like. The method has the advantages of rich acquired image information, high recognition degree and more data description models. Because the reflection spectrum of an object has a fingerprint effect, different substance information is distinguished according to the principles of different spectra of different substances and certain same spectrum of the same substance.
However, the existing hyperspectral imaging technology needs a common image sensor and also needs the cooperation of various spectrometers or light splitting devices, and the whole imaging system has a large volume, low integration level, low working speed, complex devices and high manufacturing cost, and is difficult to meet the daily use requirements of people.
Disclosure of Invention
How can be fast, high performance carry out high spectral imaging and the technical problem that the system integration level is high, with low costs needs to be solved, consequently the utility model provides an image sensor who has multichannel narrowband color filter array and be used for high spectral imaging.
The utility model adopts the technical scheme as follows:
an image sensor with a multi-channel narrow-band color filter array comprises a two-dimensional photosensitive pixel array and the multi-channel narrow-band color filter array, wherein the color filter array is positioned above a photosensitive surface of the photosensitive pixel array, and each photosensitive pixel corresponds to a narrow-band color filter with a bandwidth; the photosensitive pixel array and the color filter array are both formed by repeated arrangement of minimum repeating units, and the minimum repeating units are respectively formed by n-by-n photosensitive pixels or narrow-band color filters, wherein n is a positive integer greater than 2.
Further, the photosensitive pixels are panchromatic pixels.
Further, the minimum repeating unit of the color filter array is composed of narrow-band color filters having different response wavelength bands.
Furthermore, the response bandwidth of the narrow-band color filter is less than 40nm, and the response wavelength band of the color filter array is 200 nm-2500 nm.
Further, the color filter is a band pass filter or a cut filter.
Further, when the minimum repeating units are arranged in even rows and columns, the hyperspectral data of each photosensitive pixel is the sum of the spectral responses of all pixels in the respective corresponding wave bands in the minimum repeating unit with the pixel as the upper left corner, the lower left corner, the upper right corner or the lower right corner; when the minimum repeating units are arranged in odd rows and columns, the hyperspectral data of each photosensitive pixel is the sum of the spectral responses of all pixels in the minimum repeating unit with the pixel as the center point in the respective corresponding wave bands.
The utility model has the advantages that: the wave band sensed by each photosensitive pixel is controlled through the color filter array, and then the spectral response of each wave band of a target point corresponding to a single photosensitive pixel is obtained by utilizing an interpolation or weighting algorithm of each pixel data in the minimum repeating unit of the color filter array, so that a final hyperspectral image is obtained. The concrete characteristics and advantages are as follows:
(1) the integration level is high: the utility model discloses an image sensor need not additionally provide beam splitting equipment or spectrum appearance when being used for high spectrum formation of image, has avoided bloated of imaging system. Spectral information of each narrow-band wave band in a response range can be detected by each photosensitive pixel only through the multi-channel color filter array, and meanwhile, spatial information is obtained, so that fast and high-performance hyperspectral imaging is realized. The combination of the multi-channel color filter array and the photosensitive pixel array simplifies the system structure with extremely high integration, reduces the cost, and opens up the application possibility.
(2) The flexibility is good: the utility model discloses an image sensor's multichannel color filter array, its minimum repetitive unit's scale is adjustable, can change minimum repetitive unit's scale according to specific in service behavior and detection demand. When the requirement on the spectral detection precision is not high, a small repeating unit and a band-pass filter with a larger bandwidth can be used; large repeat units, and smaller bandwidth bandpass filters can be used when spectral detection accuracy is more demanding. The image sensor can be suitable for various environments by adjusting the size of the minimum repeating unit of the color filter array and the model of the color filter.
(3) The spectral resolution is high: due to the fact that the size of the color filter array is adjustable, the response wave band can be divided more accurately by using the minimum repeating unit with a larger size, and higher spectral resolution is achieved.
Drawings
FIG. 1 is a general structure diagram of a multi-channel narrow-band color filter array in an image sensor according to the present invention;
fig. 2 is a schematic diagram of the structure of a 3 x 3 multi-channel narrow-band color filter array;
fig. 3 is a schematic diagram of the structure of a 4 x 4 multi-channel narrow-band color filter array;
fig. 4 is a schematic diagram of an embodiment of an image sensor using a 3 x 3 multi-channel narrow band color filter array.
Detailed Description
In order to make the disclosure of the present invention clearer, the following will further describe the embodiments of the present invention with reference to the accompanying drawings.
Fig. 1 shows a general structure diagram of a multi-channel narrowband color filter array in an image sensor of the embodiment, and the structure includes:
color filters arranged in a repeating pattern having square minimal repeating units formed from combinations of n x n (n being a positive integer greater than 2) narrow-band color filters of different response bands, the color filter array minimal repeating units having at least three rows and three columns. The response bandwidth of the narrow-band color filter is less than 40nm, the color filter is generally a band-pass color filter or a cut-off color filter, and the response wave band of the color filter array covers 200 nm-2500 nm.
Fig. 2 and 3 are schematic structural diagrams of the minimum repeating unit of the multi-channel narrowband color filter array of 3 rows and 3 columns and 4 rows and 4 columns, respectively. The minimum repeating unit is composed of 9 and 16 color filters, and the specific response bandwidth of the color filters can be determined by the specific application direction.
Fig. 4 is a schematic diagram of the simplest version of the embodiment, showing the structure of an image sensor using a 3 x 3 multi-channel narrow-band color filter array, comprising:
a two-dimensional array of photosensitive pixels and a multi-channel narrow-band color filter array. The photosensitive pixels are panchromatic pixels, a corresponding narrow-band color filter is arranged above each photosensitive pixel, the photosensitive pixels and the corresponding narrow-band color filters are arranged in a repeating pattern of 3 x 3 minimum repeating units, and 9 narrow-band color filters with different response bands in the minimum repeating units are arranged in a mode shown in fig. 2.
Considering that the most basic hyperspectral imaging application should meet the requirement of visible light wave band, in this embodiment, the color filter array of the minimal repeating unit covers the wave band of 400nm to 760nm, the response bandwidth of the color filter in each minimal repeating unit is 40nm, and the wave bands of the respective responses are not overlapped, so that 9 photosensitive pixels in the minimal repeating unit can respectively receive the spectral information of one wave band.
When the target is imaged, each photosensitive pixel obtains the spectral information of the object in the wave band corresponding to the color filter above the photosensitive pixel. The hyperspectral information on each pixel point is synthesized by the spectral information of 9 different wave bands in the minimum repeating unit taking the pixel point as the center. That is, the response values of the spectral bands corresponding to the 8 color filters at the specific pixel position are guessed or interpolated through the 8 photosensitive pixel values around the specific photosensitive pixel position, so as to obtain the hyperspectral information of the visible light band at the specific pixel position.
In a 3-by-3 photosensitive pixel array with a certain photosensitive pixel as the center point, a color filter CF11、CF12、CF13、CF21、CF22、CF23、CF31、CF32And CF33The photoresponse values of the corresponding photosensitive pixels are respectively D11、D12、D13、D21、D22、D23、D31、D32And D33. Let the photosensitive pixel at the center point be the color filter CF in the 3 x 3 array11Corresponding pixel, the color filter CF of the pixel11The spectral information of the transmitted band is D11And the other 8 spectral information in different wavelength bands can be represented by the light response values D of the peripheral 8 pixels12、D13、D21、D22、D23、D31、D32And D33Instead of or in accordance with weighting.
Therefore, the spectral information of each spectral band within 400nm to 760nm of the target point corresponding to the central pixel is obtained. By analogy, spectral information of each spectral band of the target within 400-760 nm corresponding to all photosensitive pixels except the head-tail row and the head-tail column of the photosensitive pixel array of the image sensor can be obtained, and the image sensor realizes fast and high-performance hyperspectral imaging.
Of course, the embodiment is not limited to the above-mentioned implementation manner of the 3 × 3 color filter array in the visible light band, and it is also possible to implement hyperspectral imaging of the target within 200nm to 2500nm by adjusting the size of the color filter array and the bandwidth of the color filter.
The above description is only the simplest embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention should be covered by the present invention.
Claims (6)
1. An image sensor with a multi-channel narrow-band color filter array is characterized by comprising a two-dimensional photosensitive pixel array and the multi-channel narrow-band color filter array, wherein the color filter array is positioned above a photosensitive surface of the photosensitive pixel array, and each photosensitive pixel corresponds to a narrow-band color filter with one bandwidth; the photosensitive pixel array and the color filter array are both formed by repeated arrangement of minimum repeating units, and the minimum repeating units are respectively formed by n-by-n photosensitive pixels or narrow-band color filters, wherein n is a positive integer greater than 2.
2. The image sensor of claim 1, wherein the light sensitive pixels are panchromatic pixels.
3. The image sensor of claim 1 in which the minimal repeating unit of the color filter array is made up of narrow-band color filters with different response wavelength bands.
4. The image sensor of claim 1 with the multi-channel narrow-band color filter array, wherein the narrow-band color filters have a response bandwidth <40nm and the color filter array has a response wavelength band of 200nm to 2500 nm.
5. The image sensor of claim 1, wherein the color filter is a bandpass filter or a cutoff filter.
6. The image sensor of claim 1, wherein when the minimal repeating units are arranged in an even number of rows and columns, the hyperspectral data for each photosensitive pixel is a combination of the spectral responses of all pixels in their respective corresponding bands within the minimal repeating unit with the pixel being the top left, bottom left, top right, or bottom right corner; when the minimum repeating units are arranged in odd rows and columns, the hyperspectral data of each photosensitive pixel is the sum of the spectral responses of all pixels in the minimum repeating unit with the pixel as the center point in the respective corresponding wave bands.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201921700892.0U CN210578954U (en) | 2019-10-12 | 2019-10-12 | Image sensor with multichannel narrowband color filter array |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201921700892.0U CN210578954U (en) | 2019-10-12 | 2019-10-12 | Image sensor with multichannel narrowband color filter array |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN210578954U true CN210578954U (en) | 2020-05-19 |
Family
ID=70662151
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201921700892.0U Active CN210578954U (en) | 2019-10-12 | 2019-10-12 | Image sensor with multichannel narrowband color filter array |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN210578954U (en) |
-
2019
- 2019-10-12 CN CN201921700892.0U patent/CN210578954U/en active Active
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Geelen et al. | A compact snapshot multispectral imager with a monolithically integrated per-pixel filter mosaic | |
| CN110719447A (en) | Image sensor with multichannel narrowband color filter array | |
| Arad et al. | Sparse recovery of hyperspectral signal from natural RGB images | |
| US9030580B2 (en) | Color filter modules for plenoptic XYZ imaging systems | |
| JP2021506168A (en) | Light field image processing method for depth acquisition | |
| CN109642989A (en) | Optical module and the Optical devices for using the optical module | |
| CN107991245B (en) | Crop spectrum information acquisition device and crop vegetation index acquisition method | |
| CN113686437B (en) | Time domain spectral imaging chip based on super-structure surface | |
| US20240047494A1 (en) | Micro spectrum chip based on units of random shapes | |
| CN104121990A (en) | Random grating based compressed sensing broadband hyperspectral imaging system | |
| US9426383B1 (en) | Digital camera for capturing spectral and spatial information | |
| US20180245978A1 (en) | Spectrum-inspection device | |
| CN117490843A (en) | Super-surface-based computational visible-near infrared spectrum imaging chip | |
| CN107328475B (en) | Broadband filtering spectrum imager and self-adaptive direct spectrum classification method | |
| Caras et al. | Implications of sensor design for coral reef detection: Upscaling ground hyperspectral imagery in spatial and spectral scales | |
| Sousa et al. | Joint characterization of multiscale information in high dimensional data | |
| AU2021323773B2 (en) | Miniature spectrum chip based on units of different shapes, and method for generating micro-nano structure array in miniature spectrum chip | |
| CN210578954U (en) | Image sensor with multichannel narrowband color filter array | |
| US20220344381A1 (en) | Micro spectrum chip based on units of different shapes | |
| US8797431B2 (en) | Method of controlling the resolution of a hyperspectral image | |
| EP3232473B1 (en) | Masked pixel arrays | |
| CN207717226U (en) | Hyperspectral imaging devices based on periodically interference membrane system FP chambers scanning | |
| CN112504454A (en) | Super-resolution spectral imaging filter structure based on pixel-level spectral modulation | |
| CN106672893A (en) | Tunable filter and tunable filter array | |
| CN118129908B (en) | Polarization imaging spectrometer based on polarization grating spectral and polarization spectrum reconstruction method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| GR01 | Patent grant | ||
| GR01 | Patent grant | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20220704 Address after: 211135 room 801, building 9, No. 100, Tianjiao Road, Qilin high tech Industrial Development Zone, Jiangning District, Nanjing, Jiangsu Province Patentee after: Nanjing Weipaishi Semiconductor Technology Co.,Ltd. Patentee after: Nanjing University Address before: 211135 room 801, building 9, No. 100, Tianjiao Road, Qilin high tech Industrial Development Zone, Jiangning District, Nanjing, Jiangsu Province Patentee before: Nanjing Weipaishi Semiconductor Technology Co.,Ltd. |
|
| TR01 | Transfer of patent right | ||
| TR01 | Transfer of patent right |
Effective date of registration: 20240418 Address after: 210046 Xianlin Avenue 163, Qixia District, Nanjing City, Jiangsu Province Patentee after: NANJING University Country or region after: China Address before: 211135 room 801, building 9, No. 100, Tianjiao Road, Qilin high tech Industrial Development Zone, Jiangning District, Nanjing, Jiangsu Province Patentee before: Nanjing Weipaishi Semiconductor Technology Co.,Ltd. Country or region before: China Patentee before: NANJING University |
|
| TR01 | Transfer of patent right |