CN110719447A - Image sensor with multichannel narrowband color filter array - Google Patents
Image sensor with multichannel narrowband color filter array Download PDFInfo
- Publication number
- CN110719447A CN110719447A CN201910965943.0A CN201910965943A CN110719447A CN 110719447 A CN110719447 A CN 110719447A CN 201910965943 A CN201910965943 A CN 201910965943A CN 110719447 A CN110719447 A CN 110719447A
- Authority
- CN
- China
- Prior art keywords
- color filter
- filter array
- image sensor
- narrow
- band
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 230000003595 spectral effect Effects 0.000 claims abstract description 30
- 238000003384 imaging method Methods 0.000 abstract description 7
- 230000010354 integration Effects 0.000 abstract description 6
- 238000001228 spectrum Methods 0.000 abstract description 6
- 238000000701 chemical imaging Methods 0.000 description 16
- 238000005516 engineering process Methods 0.000 description 14
- 238000010586 diagram Methods 0.000 description 7
- 238000001514 detection method Methods 0.000 description 4
- 239000000126 substance Substances 0.000 description 3
- 238000000034 method Methods 0.000 description 2
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 230000010365 information processing Effects 0.000 description 1
- 230000004298 light response Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 230000005693 optoelectronics Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
- H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N25/00—Circuitry of solid-state image sensors [SSIS]; Control thereof
- H04N25/10—Circuitry of solid-state image sensors [SSIS]; Control thereof for transforming different wavelengths into image signals
- H04N25/11—Arrangement of colour filter arrays [CFA]; Filter mosaics
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Engineering & Computer Science (AREA)
- Multimedia (AREA)
- Signal Processing (AREA)
- General Physics & Mathematics (AREA)
- Spectrometry And Color Measurement (AREA)
Abstract
The invention provides an image sensor with a multi-channel narrow-band color filter array. The image sensor comprises a two-dimensional photosensitive pixel array and a multi-channel narrow-band color filter array, wherein the color filter array is positioned above a photosensitive surface of the photosensitive pixel array, and each photosensitive pixel corresponds to a narrow-band color filter with a bandwidth; the photosensitive pixel array and the color filter array are both formed by repeated arrangement of minimum repeating units, and the minimum repeating units are respectively formed by n × n photosensitive pixels or narrow-band color filters, wherein n is a positive integer greater than 2. The image sensor provided by the invention is provided with the multi-channel narrow-band color filter array, can perform high-spectrum imaging, can simultaneously obtain spectral resolution and spatial resolution, can quickly obtain spectral information and spatial information with high performance, and has high integration level and low cost.
Description
Technical Field
The invention relates to a hyperspectral imaging technology of an image sensor, in particular to a method for simultaneously obtaining spatial information and spectral information of a target by combining the imaging technology and the spectral technology. More importantly, the scheme of the multi-channel narrow-band color filter array realizes that the image sensor directly acquires the spectral information, is easy to realize, has high integration level, and is an image sensor with the multi-channel narrow-band color filter array for hyperspectral imaging.
Background
The hyperspectral imaging technology is an image data technology based on a plurality of narrow bands developed in the last two decades, the most prominent application of the hyperspectral imaging technology is the field of remote sensing detection, and the hyperspectral imaging technology has a wider application prospect in more and more civil fields. The system integrates advanced technologies in the fields of optics, optoelectronics, electronics, information processing, computer science and the like, and is a new emerging technology which organically combines the traditional two-dimensional imaging technology and the spectrum technology.
The definition of the hyperspectral imaging technology is that on the basis of multispectral imaging, an imaging spectrometer is utilized to continuously image a target object in dozens or hundreds of spectral bands in a spectral coverage range from ultraviolet to near infrared (200 + 2500 nm). The spectral information of the object to be measured is obtained while the spatial characteristic imaging of the object is obtained.
The hyperspectral imaging technology has the characteristics of ultra-multiband (hundreds of wave bands), high spectral resolution (a plurality of nm), narrow wave band (less than or equal to 10-2 lambda), wide spectral range (200 and 2500nm), integrated spectrum and the like. The method has the advantages of rich acquired image information, high recognition degree and more data description models. Because the reflection spectrum of an object has a fingerprint effect, different substance information is distinguished according to the principles of different spectra of different substances and certain same spectrum of the same substance.
However, the existing hyperspectral imaging technology needs a common image sensor and also needs the cooperation of various spectrometers or light splitting devices, and the whole imaging system has a large volume, low integration level, low working speed, complex devices and high manufacturing cost, and is difficult to meet the daily use requirements of people.
Disclosure of Invention
How to carry out hyperspectral imaging quickly and with high performance, high system integration level and low cost is a technical problem to be solved, so the invention provides an image sensor with a multi-channel narrowband color filter array for hyperspectral imaging.
The technical scheme adopted by the invention is as follows:
an image sensor with a multi-channel narrow-band color filter array comprises a two-dimensional photosensitive pixel array and the multi-channel narrow-band color filter array, wherein the color filter array is positioned above a photosensitive surface of the photosensitive pixel array, and each photosensitive pixel corresponds to a narrow-band color filter with a bandwidth; the photosensitive pixel array and the color filter array are both formed by repeated arrangement of minimum repeating units, and the minimum repeating units are respectively formed by n-by-n photosensitive pixels or narrow-band color filters, wherein n is a positive integer greater than 2.
Further, the photosensitive pixels are panchromatic pixels.
Further, the minimum repeating unit of the color filter array is composed of narrow-band color filters having different response wavelength bands.
Furthermore, the response bandwidth of the narrow-band color filter is less than 40nm, and the response wavelength band of the color filter array is 200 nm-2500 nm.
Further, the color filter is a band pass filter or a cut filter.
Further, when the minimum repeating units are arranged in even rows and columns, the hyperspectral data of each photosensitive pixel is the sum of the spectral responses of all pixels in the respective corresponding wave bands in the minimum repeating unit with the pixel as the upper left corner, the lower left corner, the upper right corner or the lower right corner; when the minimum repeating units are arranged in odd rows and columns, the hyperspectral data of each photosensitive pixel is the sum of the spectral responses of all pixels in the minimum repeating unit with the pixel as the center point in the respective corresponding wave bands.
The invention has the beneficial effects that: the wave band sensed by each photosensitive pixel is controlled through the color filter array, and then the spectral response of each wave band of a target point corresponding to a single photosensitive pixel is obtained by utilizing an interpolation or weighting algorithm of each pixel data in the minimum repeating unit of the color filter array, so that a final hyperspectral image is obtained. The concrete characteristics and advantages are as follows:
(1) the integration level is high: when the image sensor is used for hyperspectral imaging, no additional light splitting equipment or spectrometer is needed, and the bloated imaging system is avoided. Spectral information of each narrow-band wave band in a response range can be detected by each photosensitive pixel only through the multi-channel color filter array, and meanwhile, spatial information is obtained, so that fast and high-performance hyperspectral imaging is realized. The combination of the multi-channel color filter array and the photosensitive pixel array simplifies the system structure with extremely high integration, reduces the cost, and opens up the application possibility.
(2) The flexibility is good: the multi-channel color filter array of the image sensor has the advantages that the scale of the minimum repeating unit is adjustable, and the scale of the minimum repeating unit can be changed according to specific use conditions and detection requirements. When the requirement on the spectral detection precision is not high, a small repeating unit and a band-pass filter with a larger bandwidth can be used; large repeat units, and smaller bandwidth bandpass filters can be used when spectral detection accuracy is more demanding. The image sensor can be suitable for various environments by adjusting the size of the minimum repeating unit of the color filter array and the model of the color filter.
(3) The spectral resolution is high: due to the fact that the size of the color filter array is adjustable, the response wave band can be divided more accurately by using the minimum repeating unit with a larger size, and higher spectral resolution is achieved.
Drawings
FIG. 1 is a general block diagram of a multi-channel narrowband color filter array in an image sensor of the present invention;
fig. 2 is a schematic diagram of the structure of a 3 x 3 multi-channel narrow-band color filter array;
fig. 3 is a schematic diagram of the structure of a 4 x 4 multi-channel narrow-band color filter array;
fig. 4 is a schematic diagram of an embodiment of an image sensor using a 3 x 3 multi-channel narrow band color filter array.
Detailed Description
In order to make the disclosure of the present invention clearer, the following will further describe the embodiments of the present invention with reference to the accompanying drawings.
Fig. 1 shows a general structure diagram of a multi-channel narrowband color filter array in an image sensor of the embodiment, and the structure includes:
color filters arranged in a repeating pattern having square minimal repeating units formed from combinations of n x n (n being a positive integer greater than 2) narrow-band color filters of different response bands, the color filter array minimal repeating units having at least three rows and three columns. The response bandwidth of the narrow-band color filter is less than 40nm, the color filter is generally a band-pass color filter or a cut-off color filter, and the response wave band of the color filter array covers 200 nm-2500 nm.
Fig. 2 and 3 are schematic structural diagrams of the minimum repeating unit of the multi-channel narrowband color filter array of 3 rows and 3 columns and 4 rows and 4 columns, respectively. The minimum repeating unit is composed of 9 and 16 color filters, and the specific response bandwidth of the color filters can be determined by the specific application direction.
Fig. 4 is a schematic diagram of the simplest version of the embodiment, showing the structure of an image sensor using a 3 x 3 multi-channel narrow-band color filter array, comprising:
a two-dimensional array of photosensitive pixels and a multi-channel narrow-band color filter array. The photosensitive pixels are panchromatic pixels, a corresponding narrow-band color filter is arranged above each photosensitive pixel, the photosensitive pixels and the corresponding narrow-band color filters are arranged in a repeating pattern of 3 x 3 minimum repeating units, and 9 narrow-band color filters with different response bands in the minimum repeating units are arranged in a mode shown in fig. 2.
Considering that the most basic hyperspectral imaging application should meet the requirement of visible light wave band, in this embodiment, the color filter array of the minimal repeating unit covers the wave band of 400nm to 760nm, the response bandwidth of the color filter in each minimal repeating unit is 40nm, and the wave bands of the respective responses are not overlapped, so that 9 photosensitive pixels in the minimal repeating unit can respectively receive the spectral information of one wave band.
When the target is imaged, each photosensitive pixel obtains the spectral information of the object in the wave band corresponding to the color filter above the photosensitive pixel. The hyperspectral information on each pixel point is synthesized by the spectral information of 9 different wave bands in the minimum repeating unit taking the pixel point as the center. That is, the response values of the spectral bands corresponding to the 8 color filters at the specific pixel position are guessed or interpolated through the 8 photosensitive pixel values around the specific photosensitive pixel position, so as to obtain the hyperspectral information of the visible light band at the specific pixel position.
In a 3-by-3 photosensitive pixel array with a certain photosensitive pixel as the center point, a color filter CF11、CF12、CF13、CF21、CF22、CF23、CF31、CF32And CF33The photoresponse values of the corresponding photosensitive pixels are respectively D11、D12、D13、D21、D22、D23、D31、D32And D33. Let the photosensitive pixel at the center point be the color filter CF in the 3 x 3 array11Corresponding pixel, the color filter CF of the pixel11The spectral information of the transmitted band is D11And the other 8 spectral information in different wavelength bands can be represented by the light response values D of the peripheral 8 pixels12、D13、D21、D22、D23、D31、D32And D33Instead of or in accordance with weighting.
Therefore, the spectral information of each spectral band within 400nm to 760nm of the target point corresponding to the central pixel is obtained. By analogy, spectral information of each spectral band of the target within 400-760 nm corresponding to all photosensitive pixels except the head-tail row and the head-tail column of the photosensitive pixel array of the image sensor can be obtained, and the image sensor realizes fast and high-performance hyperspectral imaging.
Of course, the embodiment is not limited to the above-mentioned implementation manner of the 3 × 3 color filter array in the visible light band, and it is also possible to implement hyperspectral imaging of the target within 200nm to 2500nm by adjusting the size of the color filter array and the bandwidth of the color filter.
The above description is only the simplest embodiment of the present invention, but the scope of the present invention is not limited thereto, and any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope of the present invention should be covered within the scope of the present invention.
Claims (6)
1. An image sensor with a multi-channel narrow-band color filter array is characterized by comprising a two-dimensional photosensitive pixel array and the multi-channel narrow-band color filter array, wherein the color filter array is positioned above a photosensitive surface of the photosensitive pixel array, and each photosensitive pixel corresponds to a narrow-band color filter with one bandwidth; the photosensitive pixel array and the color filter array are both formed by repeated arrangement of minimum repeating units, and the minimum repeating units are respectively formed by n-by-n photosensitive pixels or narrow-band color filters, wherein n is a positive integer greater than 2.
2. The image sensor of claim 1, wherein the light sensitive pixels are panchromatic pixels.
3. The image sensor of claim 1 in which the minimal repeating unit of the color filter array is made up of narrow-band color filters with different response wavelength bands.
4. The image sensor of claim 1 with the multi-channel narrow-band color filter array, wherein the narrow-band color filters have a response bandwidth <40nm and the color filter array has a response wavelength band of 200nm to 2500 nm.
5. The image sensor of claim 1, wherein the color filter is a bandpass filter or a cutoff filter.
6. The image sensor of claim 1, wherein when the minimal repeating units are arranged in an even number of rows and columns, the hyperspectral data for each photosensitive pixel is a combination of the spectral responses of all pixels in their respective corresponding bands within the minimal repeating unit with the pixel being the top left, bottom left, top right, or bottom right corner; when the minimum repeating units are arranged in odd rows and columns, the hyperspectral data of each photosensitive pixel is the sum of the spectral responses of all pixels in the minimum repeating unit with the pixel as the center point in the respective corresponding wave bands.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910965943.0A CN110719447A (en) | 2019-10-12 | 2019-10-12 | Image sensor with multichannel narrowband color filter array |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201910965943.0A CN110719447A (en) | 2019-10-12 | 2019-10-12 | Image sensor with multichannel narrowband color filter array |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN110719447A true CN110719447A (en) | 2020-01-21 |
Family
ID=69211448
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201910965943.0A Pending CN110719447A (en) | 2019-10-12 | 2019-10-12 | Image sensor with multichannel narrowband color filter array |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN110719447A (en) |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111565305A (en) * | 2020-05-12 | 2020-08-21 | Oppo（重庆）智能科技有限公司 | Image sensor, signal processing method and storage medium |
| CN111750997A (en) * | 2020-06-29 | 2020-10-09 | 中国科学院西安光学精密机械研究所 | Optical imaging detection device based on polarization time-sharing spectrum synchronization |
| CN112504454A (en) * | 2020-11-25 | 2021-03-16 | 天津津航技术物理研究所 | Super-resolution spectral imaging filter structure based on pixel-level spectral modulation |
-
2019
- 2019-10-12 CN CN201910965943.0A patent/CN110719447A/en active Pending
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111565305A (en) * | 2020-05-12 | 2020-08-21 | Oppo（重庆）智能科技有限公司 | Image sensor, signal processing method and storage medium |
| CN111750997A (en) * | 2020-06-29 | 2020-10-09 | 中国科学院西安光学精密机械研究所 | Optical imaging detection device based on polarization time-sharing spectrum synchronization |
| CN112504454A (en) * | 2020-11-25 | 2021-03-16 | 天津津航技术物理研究所 | Super-resolution spectral imaging filter structure based on pixel-level spectral modulation |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US11092725B2 (en) | Single-sensor hyperspectral imaging device | |
| Geelen et al. | A compact snapshot multispectral imager with a monolithically integrated per-pixel filter mosaic | |
| CN110719447A (en) | Image sensor with multichannel narrowband color filter array | |
| Arad et al. | Sparse recovery of hyperspectral signal from natural RGB images | |
| US9030580B2 (en) | Color filter modules for plenoptic XYZ imaging systems | |
| US7835002B2 (en) | System for multi- and hyperspectral imaging | |
| EP2464952B1 (en) | Multi-spectral imaging | |
| JP2021506168A (en) | Light field image processing method for depth acquisition | |
| CN109642989A (en) | Optical module and the Optical devices for using the optical module | |
| US20070182962A1 (en) | Spatial image modulation to improve performance of computed tomography imaging spectrometer | |
| US20240047494A1 (en) | Micro spectrum chip based on units of random shapes | |
| KR20150004858A (en) | Sensor for spectral-polarization imaging | |
| CN107991245B (en) | Crop spectrum information acquisition device and crop vegetation index acquisition method | |
| CN210578954U (en) | Image sensor with multichannel narrowband color filter array | |
| US20220344381A1 (en) | Micro spectrum chip based on units of different shapes | |
| WO2017086788A1 (en) | Hyperspectral 2d imaging device | |
| CN107941339A (en) | Hyperspectral imaging devices and method based on periodicity interference membrane system FP chamber scannings | |
| CN103679758B (en) | The method for controlling the resolution ratio of high spectrum image | |
| CN109827658B (en) | Staring type spectrum chip structure for green vegetation detection and preparation method thereof | |
| CN209639829U (en) | A kind of push-scanning type polarization light spectrum image-forming micro-system | |
| CN207717226U (en) | Hyperspectral imaging devices based on periodically interference membrane system FP chambers scanning | |
| EP4199092A1 (en) | Miniature spectrum chip based on units of different shapes, and method for generating micro-nano structure array in miniature spectrum chip | |
| EP3232473B1 (en) | Masked pixel arrays | |
| CN106672893A (en) | Tunable filter and tunable filter array | |
| US10868987B2 (en) | Light-sensor module, method for operating a light-sensor module and method for producing a light-sensor module |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20220629 Address after: 211135 room 801, building 9, No. 100, Tianjiao Road, Qilin high tech Industrial Development Zone, Jiangning District, Nanjing, Jiangsu Province Applicant after: Nanjing Weipaishi Semiconductor Technology Co.,Ltd. Applicant after: Nanjing University Address before: 211135 room 801, building 9, No. 100, Tianjiao Road, Qilin high tech Industrial Development Zone, Jiangning District, Nanjing, Jiangsu Province Applicant before: Nanjing Weipaishi Semiconductor Technology Co.,Ltd. |
|
| TA01 | Transfer of patent application right |
Effective date of registration: 20240412 Address after: 210046 Xianlin Avenue 163, Qixia District, Nanjing City, Jiangsu Province Applicant after: NANJING University Country or region after: China Address before: 211135 room 801, building 9, No. 100, Tianjiao Road, Qilin high tech Industrial Development Zone, Jiangning District, Nanjing, Jiangsu Province Applicant before: Nanjing Weipaishi Semiconductor Technology Co.,Ltd. Country or region before: China Applicant before: NANJING University |