WO2022112688A1 - Imageur multispectral à domaine spectral élargi - Google Patents
Imageur multispectral à domaine spectral élargi Download PDFInfo
- Publication number
- WO2022112688A1 WO2022112688A1 PCT/FR2021/052036 FR2021052036W WO2022112688A1 WO 2022112688 A1 WO2022112688 A1 WO 2022112688A1 FR 2021052036 W FR2021052036 W FR 2021052036W WO 2022112688 A1 WO2022112688 A1 WO 2022112688A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- spectral
- electromagnetic radiation
- multispectral imager
- spectral band
- filters
- Prior art date
Links
- 230000003595 spectral effect Effects 0.000 title claims abstract description 96
- 238000001914 filtration Methods 0.000 claims abstract description 38
- 230000005670 electromagnetic radiation Effects 0.000 claims abstract description 26
- 230000005855 radiation Effects 0.000 claims description 41
- 239000011159 matrix material Substances 0.000 claims description 27
- 239000011368 organic material Substances 0.000 claims description 2
- 230000005540 biological transmission Effects 0.000 description 14
- 239000000758 substrate Substances 0.000 description 14
- 230000000903 blocking effect Effects 0.000 description 7
- 238000001228 spectrum Methods 0.000 description 6
- 101000583150 Homo sapiens Membrane-associated phosphatidylinositol transfer protein 3 Proteins 0.000 description 5
- 102100030351 Membrane-associated phosphatidylinositol transfer protein 3 Human genes 0.000 description 5
- DZSYJVXGONVNKA-UHFFFAOYSA-L NIR-1 dye Chemical compound [K+].[K+].C1=CC2=C(S([O-])(=O)=O)C=C(S([O-])(=O)=O)C=C2C(C2(C)C)=C1[N+](CC)=C2C=CC=CC=CC=C1C(C)(C)C2=CC(C(O)=O)=CC=C2N1CCCCS([O-])(=O)=O DZSYJVXGONVNKA-UHFFFAOYSA-L 0.000 description 5
- 238000000701 chemical imaging Methods 0.000 description 5
- 238000000034 method Methods 0.000 description 5
- 101000583145 Homo sapiens Membrane-associated phosphatidylinositol transfer protein 1 Proteins 0.000 description 4
- 102100030353 Membrane-associated phosphatidylinositol transfer protein 1 Human genes 0.000 description 4
- AUQMGYLQQPSCNH-UHFFFAOYSA-L NIR-2 dye Chemical compound [K+].[K+].C1=CC2=C(S([O-])(=O)=O)C=C(S([O-])(=O)=O)C=C2C(C2(C)C)=C1[N+](CC)=C2C=CC=CC=C1C(C)(C)C2=CC(C(O)=O)=CC=C2N1CCCCS([O-])(=O)=O AUQMGYLQQPSCNH-UHFFFAOYSA-L 0.000 description 4
- 230000003287 optical effect Effects 0.000 description 3
- 230000035945 sensitivity Effects 0.000 description 3
- 230000015572 biosynthetic process Effects 0.000 description 2
- 238000001514 detection method Methods 0.000 description 2
- 239000006185 dispersion Substances 0.000 description 2
- 239000000463 material Substances 0.000 description 2
- 244000007853 Sarothamnus scoparius Species 0.000 description 1
- 238000010521 absorption reaction Methods 0.000 description 1
- 239000012141 concentrate Substances 0.000 description 1
- 239000003344 environmental pollutant Substances 0.000 description 1
- 239000003292 glue Substances 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000000203 mixture Substances 0.000 description 1
- 231100000719 pollutant Toxicity 0.000 description 1
- 239000011347 resin Substances 0.000 description 1
- 229920005989 resin Polymers 0.000 description 1
- 229910052710 silicon Inorganic materials 0.000 description 1
- 239000010703 silicon Substances 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/12—Generating the spectrum; Monochromators
- G01J3/26—Generating the spectrum; Monochromators using multiple reflection, e.g. Fabry-Perot interferometer, variable interference filters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
- G01J3/0227—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows using notch filters
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0262—Constructional arrangements for removing stray light
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/12—Generating the spectrum; Monochromators
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2803—Investigating the spectrum using photoelectric array detector
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/12—Generating the spectrum; Monochromators
- G01J2003/1226—Interference filters
- G01J2003/1239—Interference filters and separate detectors
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2803—Investigating the spectrum using photoelectric array detector
- G01J2003/2806—Array and filter array
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2803—Investigating the spectrum using photoelectric array detector
- G01J2003/2806—Array and filter array
- G01J2003/2809—Array and correcting filter
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
- G01J2003/2826—Multispectral imaging, e.g. filter imaging
Definitions
- TITLE Expanded spectral domain multispectral imager.
- the invention relates to a multispectral imager capable of instantaneously obtaining two-dimensional images whose spectrum is resolved at each point.
- Multispectral or hyperspectral imagers make it possible to obtain such images, which consist of two-dimensional images from which the spectrum is extracted at each point.
- hyperspectral imaging when the extracted spectra are highly resolved, that is to say formed of numerous (typically more than 100) relatively narrow spectral bands (typically 5 to 15 nm), and of multispectral imaging when the ssoonntt spectra formed of fewer spectral bands (typically between 4 and 20) relatively broad (typically 15 to 40 nm).
- a first method for obtaining multispectral images is to use a scanner comprising a one-dimensional sensor scanning a scene to be analyzed, called a “push broom scanner”.
- a second method is to use a two-dimensional matrix of elementary photosensitive sensors, matrix called “FPA” for Focal Plane Array in English terminology, in order to practice instantaneous multispectral imaging, or “snapchot imaging”, method for capturing images in a single integration period of the array of sensors,
- FPA Focal Plane Array
- snapchot imaging method for capturing images in a single integration period of the array of sensors
- the present invention falls within the scope of obtaining multispectral images according to this second method, a framework in which patent document US 2019/0145823 discloses a multispectral imager based on an image sensor comprising a two-dimensional matrix formed of a matrix of photosensitive pixels, and a set of elementary filters each associated with one of the photosensitive pixels.
- the photosensitive pixels are each dedicated to a given spectral band, that is to say provided to receive and measure radiation of wavelength included in this band, all the photosensitive pixels dedicated to the same spectral band forming a sub-image of which each point belongs to one of a plurality of macropixels each formed of a group of pixels and associated filters.
- each elementary filter is superimposed on that of the photosensitive pixels with which it is associated, defining its spectral band by filtering the incident electromagnetic radiation,
- the elementary filters each consist of a Fabry-Pérot type interference filter.
- Devices such as those of US patent 2019/0145823 are designed to analyze only spectral domains of relatively small extents, around 300 nm wide, in order to avoid pollution of one spectral band by another.
- the spectral domain ranging from 400 to 1000 nm (visible and near infrared domain)
- two distinct multispectral imagers for example dedicated respectively to the spectral domains 400-700 nm and 700- 1000nm.
- Patent application LIS 2017/0163901 Al relates to a multispectral imaging system based on optics making it possible to form a plurality of imagettes each forming a duplicate of an image of a scene to be analyzed, each imagette being detected by a separate portion of a color image capture element, as well as a combination of narrow bandwidth filters and color filters integrated into the image capture element.
- Patent documents US 2015/0138560 Al and DE 112013 002 560 T5 relate to a spectroscopic detector comprising two facing mirrors forming a laser cavity.
- the aim of the present invention is to increase the extent of the spectral domain that can be analyzed by a single multispectral imager.
- the invention relates more particularly to a multispectral imager designed to analyze a spectral domain of interest comprising a first spectral band and a second spectral band distinct from the first spectral band, comprising an image sensor formed of a matrix of macropixels ( 110) each comprising a first photosensitive pixel and a second photosensitive pixel dedicated respectively to the first spectral band and to the second spectral band distinct from the first spectral band, and a filtering structure which comprises a first interference filter and a second interference filter which are superimposed respectively on the first photosensitive pixel and on the second photosensitive pixel and which are arranged to transmit respectively a first electromagnetic radiation belonging to the first spectral band and a second.
- the multispectral imager being characterized in that a wavelength half that of the second electromagnetic radiation is located in the spectral domain of interest, and in that the multispectral imager comprises additionally a filter layer which is superimposed on the second photosensitive pixel and which is configured to block the passage of a third electromagnetic radiation of wavelength half that of the second electromagnetic radiation.
- An essential advantage of a multispectral imager according to the invention is its ability to analyze a widened spectral domain without undergoing pollution due to the resonances of order 2 of the interference filters.
- Such a multispectral imager does not require any particular image sensor and can therefore be based on standard commercial image sensors, facilitating the development and considerably reducing the cost of this imager.
- a multispectral imager having such a structure, with an operation based on the use of macropixels and a filtering layer structured on the scale of a pixel, has other advantageous characteristics.
- such a structure implies an intimate proximity between the image sensor, the interference filtering structure and the filtering layer, thus ensuring a virtual absence of problems related to the respective angles of view of each of the pixels of a scene to capture.
- the filter layer may form a high-pass filter configured to block the first electromagnetic radiation and transmit the second electromagnetic radiation;
- the filter layer can be structured so as not to be superimposed on the first photosensitive pixel
- the filter layer can consist of a layer of red organic material
- the filtering layer can be formed from a mosaic of elementary filters, can also be superimposed on the first photosensitive pixel and be configured to transmit the first electromagnetic radiation to the first photosensitive pixel;
- the filtering layer may comprise a matrix of organic filters each configured to transmit a spectral band in the visible spectral range; the organic filters can be configured to transmit bands of blue, green and red radiation respectively; and
- the matrix of organic filters can be a Bayer matrix.
- FIG. 1A illustrates a sectional view of a multispectral imager according to a first embodiment of the invention
- FIG. 1B illustrates a plan view of an array of macropixels of the spectral imager of FIG. 1A;
- Figure 1C illustrates a macropixel of Figure 1B
- FIG. 1D illustrates a first variant of the general principle of the invention
- FIG. 3 illustrates the characteristics of a multispectral imager according to a second embodiment of the invention
- FIGS. 2 illustrates structural variants of a spectral imager according to the invention.
- FIGS. 2 illustrate spectral responses of optical filters, with transmission percentages on the ordinate and wavelengths on the abscissa, expressed in nanometers.
- FIG. 1A illustrates a sectional view of the structure of a 16-channel multispectral imager according to the invention, with an image sensor 100 comprising a sensor substrate 105, an array of photosensitive pixels 115 formed on and/or in this substrate, respectively dedicated to one of sixteen spectral bands of interest, centered respectively on wavelengths ⁇ 1 to ⁇ 16 , and.a filter structure 150 comprising a substrate, filter 155 as well as a matrix interference filters 160 formed on this substrate and a filter layer 170 formed on the interference filters 160.
- a plurality of macropixels 110 forming a matrix of macropixels illustrated by FIG. 1B are each formed of a group of pixels, each dedicated to one of the spectral bands of interest, and associated filters.
- FIG. 1C illustrates in a plan view of one of these macropixels 110, each formed of a 4 ⁇ 4 matrix of photosensitive pixels 115, the photosensitive pixels being designated by the central wavelengths ⁇ 1 to ⁇ 16 of the 16 spectral bands to which they are respectively dedicated, 430, 468, 506, 544, 582, 620, 658, 696, 734, 772, 810, 848, 886, 924, 962 and 1000 nm.
- the filtering layer 170 could take a continuous form or be composed of discrete elements such as a mosaic of elementary filters, and may or may not have a composition and properties homogeneous over its entire extent; it is here homogeneously formed from a red organic resin structured to be superimposed on the photosensitive pixels dedicated to the spectral bands centered on the high wavelengths ⁇ 1 to ⁇ 16 and to be absent at the level of the pixels dedicated to the centered spectral bands on the low wavelengths ⁇ 1 to ⁇ 5 , as illustrated by FIG. 2 in B) which represents the filtering layer 170 on the scale of a macropixel 110.
- the filter layer 170 here forms a high-pass organic filter, with a cut-off wavelength located at approximately 590 nm, as illustrated by FIG. 2 at C), but any type of filter could be used, such as for example filters operating by absorption, reflection, interferential or plasmonic, provided that they have an adequate spectral response (high pass here) and that they can be structured on the scale of the photosensitive pixels.
- block and transmit 3 ⁇ 4> are not to be understood in the sense of total blocking and total transmission, but must be understood according to usage in the field of optical filters, such as example by blocking at least 80% and transmitting at least 30% of electromagnetic radiation, which corresponds to the examples considered in this description.
- a filter layer superimposed on a photosensitive pixel is configured to transmit radiation to this photosensitive pixel
- this filter layer is transparent to this radiation (transmission of at least 30% of this radiation ) and. allows it to cross it to irradiate this photosensitive pixel. This does not prevent a first element forming a first part of the filter layer from transmitting a first radiation of given wavelength and a second element forming a second part of the filter layer from blocking a second radiation of this given wavelength.
- the imager can further comprise an array of microlenses 120 reproducing the arrangement of the photosensitive pixels so that each pixel corresponds to one and only one of the lenses, and configured to concentrate the incident radiation on the photosensitive surfaces of the photosensitive pixels, increasing thus the sensitivity of the imager.
- this imager requires an intimate proximity between the image sensor, the interference filtering structure and the filtering layer, so that the incident radiation trajectories pass respectively through a photosensitive pixel and an interference filter which is superimposed on it, even with a substantial angle of incidence (greater than 30° for example) while limiting the phenomena of crosstalk (or "crosstalk" in English, pollution of the radiation intended to be received by a given pixel by a radiation intended to be received by a neighboring pixel),
- Such proximity can be obtained by bringing the elements (160, 170) formed on the sensor substrate 105 into direct contact with the elements (115, 120) formed on the filter substrate 155, or optionally via layers thin protection, then by fixing the substrates (105,155) to each other by means of a strip of glue 157 located on the periphery of these substrates (105, 155).
- the elements 160, 170, 115 and 120 are interposed between the two substrates 105 and 155 so as not to be separated by the thickness of one or two of these substrates and to maintain the necessary proximity.
- the imager illustrated in FIG. 1A is associated with an optical focusing system (not .illustrated) comprising one or several lenses located at a distance from the photosensitive pixels 115 and from the interference filters 160 and from their substrate 155.
- an optical focusing system (not .illustrated) comprising one or several lenses located at a distance from the photosensitive pixels 115 and from the interference filters 160 and from their substrate 155.
- the interference filters can be, for example, filters of the Fabry-Pérot type, formed by a resonant cavity between two mirrors,
- Such a filter transmits electromagnetic radiation if it enters into resonance in the cavity, that is to say on the condition that its wavelength belongs to a spectral band centered on a given wavelength defined by the formula [1] following: in which k is an integer greater than or equal to 1 which defines the order of resonance considered, is the index of refraction of the cavity for the wavelength ⁇ k , and e is the physical thickness of the cavity,
- the width of the spectral band transmitted by such a filter is characterized by the height at mid-height of a resonance peak, which can range from a few nanometers to several tens of nanometers, and depends on the structure and the materials used poul ⁇ ie filter.
- the orders of resonance of orders 2 limit in practice the spectral range that a given multispectral imager will be able to analyze
- an interference filter designed to transmit as a useful signal a first radiation thanks to a resonance of order 1 will also transmit a second radiation of wavelength approximately half (at the index dispersion of refraction close) to that of the first radiation due to the resonance of order 2, which pollutes the measurement of the useful signal to the point of making it unusable.
- the extent of the analyzable spectral range to exclude the latter by the use of a global high-pass filter covering all the photosensitive pixels or by the characteristics of the material used for the detection of the radiation, such as silicon in the case of a CMOS detection technology.
- Figure 2 shows in A) a graph indicating the spectral responses of the 16 interference filters associated with the 16 photosensitive pixels in a spectral range extending from 400 to 1100 nm, with the transmission peaks due to resonances of orders 1 and 2, with widths at mid-height between 20 and 50 nm.
- the filtering layer 170 solves the problem of pollution of the useful signals of the high spectral bands (in wavelength) by blocking the radiation of shorter wavelengths, not globally on all the photosensitive pixels. , but specifically at the level of the photosensitive pixels dedicated to these high spectral bands, while allowing radiation from the low spectral bands (in wavelength) to pass at the level of the photosensitive pixels dedicated to these low spectral bands.
- the filtering layer 170 is, in this embodiment, structured at the level of the photosensitive pixels taken individually so as to be superimposed only on the pixels dedicated to the high spectral bands, being absent at the level of the pixels dedicated to the low spectral bands.
- the filtering layer 170 has a matrix structure, each element of which reproduces in geometry and in dimensions the structure of the macropixels 110, structure formed in this example of a matrix of 4 ⁇ 4 photosensitive pixels 115.
- the filtering layer 170 is here formed of elements superimposed respectively on the photosensitive pixels 115 dedicated respectively to the wavelengths ⁇ 6 to ⁇ 16 , each element corresponding to a photosensitive pixel and vice versa.
- these elements form a continuous filtering layer 170 on the scale of a macropixel 110, superimposed on a first portion only of a macropixel 110 so as not to intercept incident radiation passing through a second portion. of the same macropixel, as shown in B) of Figure 2.
- a multispectral imager according to the invention can analyze an enlarged spectral range ranging for example from 400 to 1000 n®, of greater range than those of conventional multispectral imagers, without suffering from the pollution phenomenon described above.
- FIG. 2 illustrates in D) the spectral response of the combination according to the invention between the interference filters 160 and the filtering layer 170 consisting of the high-pass filter illustrated in B), designed to block the radiation corresponding to the resonances of order 2 11 interference filters ⁇ 1 to ⁇ 16 , of wavelengths shorter than the cut-off wavelength of the filtering layer.
- the filtering layer makes it possible to eliminate or very greatly reduce the transmission of radiation due to resonance peaks of order 2, so as to obtain a spectral image with 16 bands covering a wide spectral range and suffering little or no damage. of pollution caused by these resonance peaks of order 2, according to the principle illustrated by FIG. 1D.
- the solid arrows indicate the transmission peaks of the 11 photosensitive pixels dedicated to the wavelengths ⁇ 6 to ⁇ 16 , pixels on which the filtering layer 170 is superimposed.
- FIG. 1D summarizes the general principle of the invention: a first interference filter IF1 superimposed on a first photosensitive pixel PP1 transmits radiation I ⁇ I of a wavelength belonging to a first spectral band of interest centered on the length d wave ⁇ I , a second interference filter IF2 superimposed on a second photosensitive pixel PP2 transmits radiation I ⁇ II of a second wavelength belonging to a second spectral band of interest centered on the wavelength ⁇ II as well as a polluting radiation I ⁇ II — P third wavelength approximately half of ⁇ II due to an order 2 resonance of the second interference filter IF2, and a filtering layer FL which is configured to transmit I ⁇ I to PP1 and I ⁇ II to PP2, and block the polluting radiation I ⁇ II — P at PP2.
- the filter layer FL also blocks radiation with a wavelength half that of ⁇ II at the level of PP2.
- the third wavelength of the radiation, pollutant I ⁇ II — P could be very close to or equal to ⁇ 1 , and could in particular be found in a spectral band of interest, centered on ⁇ 1 corresponding to the resonance peak of order 1 of IF1, and therefore be transmitted by the first interference filter IF1.
- the two spectral bands of interest are distinct, that is to say centered on different wavelengths, and preferably do not overlap.
- a first variant of this principle consists in structuring the filtering layer FL so as to superimpose it only on the second photosensitive pixel PP2.
- the expression “approximately” means that a deviation of 10% is authorized between the values of the quantities considered, and is in particular used to take account of the index dispersion in the positioning of the resonance peaks,
- ⁇ I and ⁇ II correspond for example respectively to ⁇ I and ⁇ 12 , PP1 and PP2 to the photosensitive pixels 115 dedicated to the spectral bands centered on these wavelengths, IF1 and IF2 to the interference filters 160 superimposed respectively on PP1 and PP2, I ⁇ I and I ⁇ II on the radiation transmitted by IF1 and IF2 by resonance of order 1 and I ⁇ II — P on the radiation transmitted by IF2 by resonance of order 2, and the layer filter layer FL to filter layer 170.
- a multispectral imager applying the general principle of the invention to this first embodiment, combining a matrix of interference filters and a high-pass filter structured at the scale of the photosensitive pixels, makes it possible to analyze a domain spectrum sufficiently wide to include a first spectral band and a second spectral band of wavelengths approximately twice as short as those of the first spectral band without suffering from pollution due to the second orders of resonance.
- the application of the invention is not limited to filters of the Fabry-Pérot type taken here as an example, but extends to any type of filter producing several orders of interference.
- This first embodiment is based on the use of a filter layer 170 forming a high-pass filter locally structured so as to be superimposed only on the photosensitive pixels dedicated to the high spectral bands to block the radiation transmitted by the resonances of order 2 and more of the associated interference filters, but the invention is not limited to this configuration and could use other types of filters such as band-pass filters, superimposed or not on all the photosensitive pixels defining a macropixel, as illustrated by the following embodiment.
- the second embodiment of the invention consists of a 5-channel spectral imager having a structure identical to that of the first embodiment except for the interference filters and the filtering layer, and comprising photosensitive pixels dedicated to 5 bands spectral centers on wavelengths ⁇ 1 to ⁇ 5 , respectively 450, 550, 650, 865 and 945 nm, pixels arranged in macropixels 110 each comprising 16 photosensitive pixels as illustrated by FIG. 4 in C).
- the first three wavelengths correspond respectively to three interference filters B, G and R respectively transmitting blue, green and red radiation from the visible range, the last two wavelengths corresponding respectively two interference filters NIR1 and NIR2 of the near infrared range,
- FIG. 3 illustrates in A) the spectral response of the five interference filters, with 5 transmission peaks corresponding respectively to the wavelengths ⁇ 1 to ⁇ 5 of the first-order resonances of each of the 5 filters, and 2 transmission peaks at 444 and 483 nm corresponding respectively to the second order resonances of the NIR1 and NIR2 filters.
- a filter layer 170 formed from a mosaic of elementary filters, here a classic Bayer matrix comprising filters organic Grg,B, Grg.G and Org.R respectively transmitting bands of blue, green and red radiation from the visible range as illustrated by FIG. 3 in B).
- FIG. 4 illustrates in A) the arrangement of the interference filters, according to the geometry of the macropixels 110, each filter being superimposed on one and only one of the photosensitive pixels of a given macropixel, with the resonance peaks of orders 1 and 2 of these filters.
- the organic filters are arranged according to the geometry of the macropixel 110 as illustrated in B) of FIG. 4, each filter being superimposed on one and only one of the photosensitive pixels, and so that the NIR1 and NIR2 filters are superimposed respectively on Org.G and Org.R filters, so as to respectively block radiation from peaks at 444 and 483 nm corresponding to second order resonances.
- the macropixel 110 is formed from a 2x2 matrix of 4 conventional Bayer matrices which are each formed from a 2x2 element matrix; a red filter Org.R, a blue filter Qrg.B and two green filters Org.G, the two green filters Org.G being placed along a diagonal of the Bayer matrix.
- the NIR1 and NIR2 filters are superimposed on an Org filter. G and an Org filter. R of each of two Bayer matrices placed along a diagonal of the macropixel 110.
- the arrangement of the filters detailed above and illustrated in A) and B) of FIG. 4 is advantageous in the sense that it allows on the one hand use of all the photosensitive pixels 115 , each being of a wavelength capable of reaching it, and on the other hand a high spatial resolution and has a high sensitivity combined with the possible use of a commercial photosensitive sensor already equipped with a Bayer matrix and mass-produced , therefore at a reasonable cost.
- FIG. 3 illustrates in C) the result of the combination of the interference filters with the organic filters; the two peaks at 444 and 483 nm are extremely reduced whereas the 5 peaks of the first order resonances remain transmitted.
- ⁇ I and ⁇ II correspond for example respectively to ⁇ 2 and ⁇ 4 , PP1 and PP2 to the photosensitive pixels 115 respectively dedicated to the spectral bands of interest centered on these wavelengths, IF1 and IF2 to the interference filters G and NIR1 superimposed respectively at PP1 and PP2, I ⁇ I and I ⁇ II to the radiation transmitted by IF1 and IF2 by resonance of order 1, I ⁇ II — P to the radiation transmitted by IF2 by resonance of order 2 at 444 nm, and two parts of a filtering layer FL' with two elementary filters Org.G of the filtering layer 170 superimposed respectively on PP1 and PP2.
- the two spectral bands of interest are distinct, that is to say centered on different wavelengths, and preferably do not overlap.
- the filtering layer is superimposed on the two photosensitive pixels, but it transmits i3 ⁇ 4 to PP1 while blocking I ⁇ II — P at the level of PP2 due to its spectral response which is different depending on the pixels considered.
- the filtering layer FL′ also blocks radiation with a wavelength half that of ⁇ II at the level of PP2.
- the organic filters form a Bayer matrix, transmitting in the blue, green and red of the visible spectral domain (particular type of so-called RGB filter), but other types of filtering matrices, and in general any type A filter in the form of a matrix of filters and other transmission bands could be envisaged to design a spectral imager according to the invention, such as for example filters of the RGBE, RYYB, CYYM or else RGBW type.
- the spectral imager structure of FIG. 1A taken by way of example in the two embodiments above corresponds to a structure obtained by a hybrid technology, that is to say which is based on the parallel fabrication of an image sensor and a filtering structure on two separate substrates then their association, including an array of lenses, but other structures are also appropriate, such as a hybrid structure identical to that of the figure 1A but without lenses as illustrated by FIG. 5 in A), or even a hybrid structure in which the filtering layer 170 is formed on the sensor substrate and. is optionally covered with a planarization layer 175, with or without an array of lenses above the planarization layer, as illustrated respectively in B) and C) of FIG. 5.
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Spectrometry And Color Measurement (AREA)
- Solid State Image Pick-Up Elements (AREA)
Abstract
Description
Claims
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US18/039,052 US20240102861A1 (en) | 2020-11-30 | 2021-11-18 | Multispectral imager with enlarged spectral domain |
EP21823963.0A EP4251961A1 (fr) | 2020-11-30 | 2021-11-18 | Imageur multispectral à domaine spectral élargi |
CA3200228A CA3200228A1 (fr) | 2020-11-30 | 2021-11-18 | Imageur multispectral a domaine spectral elargi |
CN202180079694.0A CN116507892A (zh) | 2020-11-30 | 2021-11-18 | 具有扩展光谱域的多光谱成像仪 |
JP2023532573A JP2023551686A (ja) | 2020-11-30 | 2021-11-18 | 拡大されたスペクトル領域を有するマルチスペクトルイメージャ |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
FR2012418A FR3116899B1 (fr) | 2020-11-30 | 2020-11-30 | Imageur multispectral à domaine spectral élargi. |
FRFR2012418 | 2020-11-30 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2022112688A1 true WO2022112688A1 (fr) | 2022-06-02 |
Family
ID=74871509
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/FR2021/052036 WO2022112688A1 (fr) | 2020-11-30 | 2021-11-18 | Imageur multispectral à domaine spectral élargi |
Country Status (7)
Country | Link |
---|---|
US (1) | US20240102861A1 (fr) |
EP (1) | EP4251961A1 (fr) |
JP (1) | JP2023551686A (fr) |
CN (1) | CN116507892A (fr) |
CA (1) | CA3200228A1 (fr) |
FR (1) | FR3116899B1 (fr) |
WO (1) | WO2022112688A1 (fr) |
Citations (3)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE112013002560T5 (de) * | 2012-05-18 | 2015-02-05 | Hamamatsu Photonics K.K. | Spektralsensor |
US20170163901A1 (en) | 2015-12-02 | 2017-06-08 | Industrial Technology Research Institute | Multi-point spectral system |
WO2017187029A1 (fr) * | 2016-04-29 | 2017-11-02 | Silios Technologies | Dispositif d'imagerie multispectrale |
-
2020
- 2020-11-30 FR FR2012418A patent/FR3116899B1/fr active Active
-
2021
- 2021-11-18 CA CA3200228A patent/CA3200228A1/fr active Pending
- 2021-11-18 JP JP2023532573A patent/JP2023551686A/ja active Pending
- 2021-11-18 WO PCT/FR2021/052036 patent/WO2022112688A1/fr active Application Filing
- 2021-11-18 CN CN202180079694.0A patent/CN116507892A/zh active Pending
- 2021-11-18 EP EP21823963.0A patent/EP4251961A1/fr active Pending
- 2021-11-18 US US18/039,052 patent/US20240102861A1/en active Pending
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE112013002560T5 (de) * | 2012-05-18 | 2015-02-05 | Hamamatsu Photonics K.K. | Spektralsensor |
US20150138560A1 (en) | 2012-05-18 | 2015-05-21 | Hamamatsu Photonics K.K. | Spectroscopic sensor |
US20170163901A1 (en) | 2015-12-02 | 2017-06-08 | Industrial Technology Research Institute | Multi-point spectral system |
WO2017187029A1 (fr) * | 2016-04-29 | 2017-11-02 | Silios Technologies | Dispositif d'imagerie multispectrale |
US20190145823A1 (en) | 2016-04-29 | 2019-05-16 | Silios Technologies | Multispectral imaging device |
Also Published As
Publication number | Publication date |
---|---|
EP4251961A1 (fr) | 2023-10-04 |
CA3200228A1 (fr) | 2022-06-02 |
US20240102861A1 (en) | 2024-03-28 |
FR3116899A1 (fr) | 2022-06-03 |
FR3116899B1 (fr) | 2023-07-21 |
CN116507892A (zh) | 2023-07-28 |
JP2023551686A (ja) | 2023-12-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US9823128B2 (en) | Multispectral imaging based on computational imaging and a narrow-band absorptive filter array | |
EP2773929B1 (fr) | Caméra spectrale ayant une mosaïque de filtres pour chaque pixel d'image | |
EP2515335B1 (fr) | Circuit integré imageur et dispositif de capture d'images stéréoscopiques | |
FR2994282A1 (fr) | Structure de filtrage optique dans le domaine visible et/ou infrarouge | |
KR20180025137A (ko) | 광학모듈 및 이를 이용한 광학디바이스 | |
EP3387824B1 (fr) | Système et procédé d'acquisition d'images visibles et dans le proche infrarouge au moyen d'un capteur matriciel unique | |
WO2018185265A1 (fr) | Dispositif et procede d'imagerie multispectrale dans l'infrarouge | |
EP3449228B1 (fr) | Dispositif d'imagerie multispectrale | |
FR2855608A1 (fr) | Spectrometre statique par transformee de fourier | |
EP3198625B1 (fr) | Dispositif d'acquisition d'images bimode a photocathode | |
EP3458819B1 (fr) | Spectro-imageur multivoie a transformee de fourier | |
WO2022112688A1 (fr) | Imageur multispectral à domaine spectral élargi | |
Gupta | Acousto-optic tunable filter based spectropolarimetric imagers | |
FR3084459A1 (fr) | Capteur d'imagerie multispectrale pourvu de moyens de limitation de la diaphonie | |
Harvey et al. | Imaging spectrometry at visible and infrared wavelengths using image replication | |
EP2991115A1 (fr) | Capteur photosensible | |
EP2002226B1 (fr) | Dispositif de formation de spectre sur un capteur optique a rejet spatial | |
He et al. | Metasurfaces and Multispectral Imaging | |
WO2023110922A1 (fr) | Camera multispectrale a acquisition " snapshot " (instantanee) | |
EP2373962B1 (fr) | Engin aeronautique | |
EP4390343A1 (fr) | Capteur d'images polarimétrique | |
EP4390475A1 (fr) | Filtre polariseur et capteur d'images polarimétrique intégrant un tel filtre | |
EP3784998A1 (fr) | Spectrometre a imagerie pupillaire | |
FR2765971A1 (fr) | Filtre optique a transmission spectrale variable et largeur de bande spectrale constante |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 21823963 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 3200228 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 202180079694.0 Country of ref document: CN |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2023532573 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2021823963 Country of ref document: EP Effective date: 20230630 |