CN116448246A - Hyperspectral video imaging system - Google Patents
Hyperspectral video imaging system Download PDFInfo
- Publication number
- CN116448246A CN116448246A CN202310269211.4A CN202310269211A CN116448246A CN 116448246 A CN116448246 A CN 116448246A CN 202310269211 A CN202310269211 A CN 202310269211A CN 116448246 A CN116448246 A CN 116448246A
- Authority
- CN
- China
- Prior art keywords
- light
- lens group
- path
- prism
- imaging system
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Pending
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 66
- 230000005540 biological transmission Effects 0.000 claims abstract description 28
- 230000010354 integration Effects 0.000 claims abstract description 21
- 238000001228 spectrum Methods 0.000 claims description 17
- 239000006185 dispersion Substances 0.000 claims description 13
- 239000013307 optical fiber Substances 0.000 claims description 4
- 238000000701 chemical imaging Methods 0.000 abstract description 29
- 230000003595 spectral effect Effects 0.000 abstract description 16
- 238000005516 engineering process Methods 0.000 abstract description 7
- 238000005070 sampling Methods 0.000 description 28
- 230000004927 fusion Effects 0.000 description 9
- 230000003287 optical effect Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- YZEUHQHUFTYLPH-UHFFFAOYSA-N 2-nitroimidazole Chemical compound [O-][N+](=O)C1=NC=CN1 YZEUHQHUFTYLPH-UHFFFAOYSA-N 0.000 description 3
- 239000000463 material Substances 0.000 description 3
- 238000004026 adhesive bonding Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000007547 defect Effects 0.000 description 1
- 229910052500 inorganic mineral Inorganic materials 0.000 description 1
- 239000011707 mineral Substances 0.000 description 1
- 238000011084 recovery Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/28—Investigating the spectrum
- G01J3/2823—Imaging spectrometer
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
- G01J3/0208—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows using focussing or collimating elements, e.g. lenses or mirrors; performing aberration correction
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
- G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
- G01J3/02—Details
- G01J3/0205—Optical elements not provided otherwise, e.g. optical manifolds, diffusers, windows
- G01J3/0237—Adjustable, e.g. focussing
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A40/00—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production
- Y02A40/10—Adaptation technologies in agriculture, forestry, livestock or agroalimentary production in agriculture
Landscapes
- Physics & Mathematics (AREA)
- Spectroscopy & Molecular Physics (AREA)
- General Physics & Mathematics (AREA)
- Color Television Image Signal Generators (AREA)
- Optical Elements Other Than Lenses (AREA)
Abstract
The invention relates to a hyperspectral video imaging system which comprises a front objective lens and a beam splitting prism for splitting light into a transmission path and a reflection path according to the incidence direction of the light, wherein one path of the transmission path and one path of the reflection path sequentially passes through a field integration element and a beam splitting imaging assembly to be imaged to a full-color focal plane detector, and the other path of the transmission path and the reflection path is imaged to a multispectral focal plane detector. The hyperspectral video imaging system has the advantages of excellent spectral imaging performance, high spatial and spectral resolution, high shooting speed and strong anti-interference capability, is suitable for light and small platforms such as unmanned aerial vehicles, unmanned vehicles and unmanned boats or portable handheld application, and widens the application scene of hyperspectral imaging technology.
Description
Technical Field
The invention relates to the technical field of hyperspectral imaging, in particular to a hyperspectral video imaging system.
Background
The hyperspectral imaging technology is an emerging field integrating the space imaging technology and the spectrum technology, and is widely applied to the application range of fields such as ground remote sensing, agriculture and forestry, mineral exploration, biomedical treatment and the like. The snapshot hyperspectral imaging technology can obtain target two-dimensional space information and one-dimensional spectrum information through one-frame shooting, and then the target two-dimensional space information and the one-dimensional spectrum information are processed through a near-real-time spectrum recovery algorithm, so that hyperspectral video imaging is realized, and the snapshot hyperspectral imaging technology can be applied to light and small platforms such as unmanned aerial vehicles, unmanned vehicles and the like or handheld application scenes.
The patent with the Chinese patent publication number of CN205539913U discloses a video hyperspectral camera, which consists of two paths of imaging light paths, wherein an RGB camera is arranged on the way, a primary image of a scene target formed by a telescopic objective lens is imaged for the second time to obtain a color image with high spatial resolution, a light splitting prism and a mask are additionally arranged in front of a full-color camera on the other way, a hyperspectral image with low spatial resolution of a target scene is obtained by the full-color camera through downsampling of the mask and light splitting of the prism, and then a data cube with high spatial resolution and hyperspectral resolution is obtained by image fusion. According to the scheme, the high-spatial resolution image and the hyperspectral data are respectively acquired and recombined through the two paths of optical systems, and the higher frame rate can be realized. However, the relative position relation between the color images acquired by the RGB cameras in the two paths of light paths and the space sampling points in the hyperspectral images acquired by the full-color cameras cannot be kept completely consistent, the alignment difficulty of the color images and the hyperspectral images is high, all elements used in the system light paths are shelf products and are placed separately, the integration level is poor, and the optimal imaging performance cannot be achieved.
Disclosure of Invention
The technical problem to be solved by the invention is to overcome the defects in the prior art, and provide a hyperspectral video imaging system which has the advantages of excellent spectral imaging performance, high spatial and spectral resolution, high shooting speed and strong anti-interference capability, is suitable for small light platforms or portable handheld applications such as unmanned aerial vehicles, unmanned vehicles and unmanned boats, and widens the application scene of hyperspectral imaging technology.
According to the technical scheme provided by the invention, the hyperspectral video imaging system comprises a front objective lens and a beam splitting prism for splitting light into a transmission path and a reflection path according to the incident direction of the light, wherein one path of the transmission path and the reflection path sequentially passes through a field integration element and a beam splitting imaging assembly to be imaged to a full-color focal plane detector, and the other path of the transmission path and the reflection path is imaged to a multispectral focal plane detector.
In one embodiment of the present invention, the spectral imaging assembly includes a collimating lens group, a dispersing element group, and a focusing lens group, where the light incident directions of the collimating lens group, the dispersing element group, and the focusing lens group are sequentially set.
In one embodiment of the present invention, the dispersive element group includes two amix prisms and an aperture stop, and the two amix prisms are symmetrically disposed at both sides of the aperture stop.
In one embodiment of the present invention, the dispersive element group includes a catadioptric prism, and a transmitting prism is connected to a light incident side and a light emergent side of the catadioptric prism respectively.
In one embodiment of the invention, the set of dispersive elements comprises a dispersive prism which is a single prism, a cemented prism or a catadioptric prism.
In one embodiment of the present invention, the light beam between the collimating lens group and the dispersing element group is an incident light beam, the light beam between the dispersing element group and the focusing lens group is an outgoing light beam, the incident light beam and the outgoing light beam are symmetrical about a symmetry plane, and the collimating lens group and the focusing lens group are symmetrical about the symmetry plane.
In one embodiment of the invention, the front objective is a transmissive objective, a reflective objective or a catadioptric objective.
In one embodiment of the invention, the multispectral focal plane detector is an RGB detector or a mosaic filter array detector having a plurality of spectral channels.
In one embodiment of the invention, the field integration element is an array of apertures, a microlens array, an array of optical fibers, or a spatial light modulator.
In one embodiment of the invention, the beam-splitting imaging assembly comprises a collimating lens group and a focusing lens group, and the focal length ratio of the collimating lens group to the focusing lens group is 0.1-10.
Compared with the prior art, the technical scheme of the invention has the following advantages:
1. the hyperspectral video imaging system is realized, and an optical system with excellent spectral imaging performance is obtained through the joint design of the front lens, the field integration element and the spectral imaging component; and obtaining high spatial resolution and high spectral resolution images with high frame frequency by independently sampling and fusing the high spatial resolution multispectral images and the low spatial resolution hyperspectral images, so as to realize hyperspectral video imaging.
2. The multispectral light path and the hyperspectral light path share the front lens and do not have secondary imaging, the obtained multispectral and hyperspectral two-dimensional space images have different resolutions, no parallax, image size difference and distortion difference, and the object point registration during image fusion is very convenient.
3. The multispectral information of each object point can be directly acquired, and the hyperspectral image with full resolution is obtained by utilizing the fusion of the hyperspectral data of part of object points and the multispectral data of all object points, so that the inaccuracy of hyperspectral reconstruction caused by the complete loss of the spectrum information of part of object points is avoided.
4. The high-integration modularized design can obtain a compact structure, and meanwhile, the front lens, the field integration element or the dispersion prism can be replaced according to different application scenes, so that the application flexibility is high.
Drawings
In order that the invention may be more readily understood, a more particular description of the invention will be rendered by reference to specific embodiments thereof that are illustrated in the appended drawings.
FIG. 1 is a schematic diagram of a hyperspectral video imaging system in accordance with one embodiment of the present invention;
FIG. 2 is a schematic diagram of a field integration component in a hyperspectral video imaging system in accordance with one embodiment of the present invention;
FIG. 3 is a schematic representation of a dispersive spectrum collected by a full color focal plane detector in a hyperspectral video imaging system of the present invention;
FIG. 4 is a graph of MTF for a first embodiment of the hyperspectral video imaging system of the present invention;
FIG. 5 is a schematic diagram of a hyperspectral video imaging system in accordance with a second embodiment of the present invention;
fig. 6 is a light path diagram of a third embodiment of the hyperspectral video imaging system of the present invention.
Description of the specification reference numerals: 1-a front objective; 2-a beam-splitting prism; a 3-multispectral focal plane detector; 4-a first field integration element; 5-a first spectroscopic imaging assembly; 6-a first collimating lens group; 7-a first set of dispersive elements; 8-a first focusing lens group; 9-aperture stop; a 10-full color focal plane detector; 11-ray; 12-a second field integration element; 13-a second collimating lens group; 14-a second set of dispersive elements; 15-a second focusing lens group; 16-a second spectral imaging assembly; 17-a third field integration element; 18-a third spectral imaging assembly; 19-a third set of dispersive elements; 20-a first transmissive prism; 21-a refractive prism; 22-a second transmissive prism.
Detailed Description
The present invention will be further described with reference to the accompanying drawings and specific examples, which are not intended to be limiting, so that those skilled in the art will better understand the invention and practice it.
Referring to fig. 1, in order to make the imaging system have excellent spectral imaging performance and high spatial and spectral resolution, the invention comprises a front objective lens 1 and a beam splitting prism 2 for splitting an optical fiber into a projection path and a reflection path according to the incident direction of light rays 11, wherein one path of the transmission path and the reflection path sequentially passes through a field integration element and a spectral imaging assembly to be imaged to a full-color focal plane detector 10, and the other path of the transmission path and the reflection path is imaged to a multi-spectral focal plane detector 3.
The beam-splitting imaging assembly comprises a collimating lens group, a dispersing element group and a focusing lens group, wherein the incidence directions of the collimating lens group, the dispersing element group and the focusing lens group are sequentially set. The front objective lens 1 is a transmission objective lens, a reflection objective lens or a catadioptric objective lens. The multispectral focal plane detector 3 is an RGB detector or a mosaic filter array type detector with a plurality of spectral channels. The focal length ratio of the collimating lens group to the focusing lens group is 0.1-10.
The light 11 between the collimating lens group and the dispersing element group is incident light 11, the light 11 between the dispersing element group and the focusing lens group is emergent light 11, the incident light 11 and the emergent light 11 are symmetrical about a symmetry plane, and the collimating lens group and the focusing lens group are symmetrical about the symmetry plane.
Specifically, the hyperspectral video imaging system of the invention has the following working principle: the light 11 from the target scene is imaged after passing through the front objective 1, the light 11 is divided into a transmission path and a reflection path by the beam splitting prism 2 in an imaging light path, the reflection path light 11 is imaged to the multi-spectrum focal plane detector 3, the transmission path light 11 is imaged to a field integration element for example, the field integration element carries out discrete sampling on the imaging of the transmission path of the front objective 1, the light 11 is transmitted into a beam splitting imaging assembly after discrete sampling, and the light 11 is respectively collimated by a collimating lens group, dispersed and split by a dispersing element group and focused and imaged by a focusing lens group, and then spectrum data of discrete sampling points are obtained at the full-color focal plane detector 10.
In the transmission path, the field integration element may be a device capable of realizing discrete sampling, such as a pinhole array, a microlens array, an optical fiber array or a spatial light modulator, and the like, and the field integration element may be an example of the pinhole array is illustrated herein, as shown in fig. 2, fig. 2 is a schematic view of the pinhole array, and fig. 3 is a schematic view of a dispersion spectrum collected by the panchromatic focal plane detector 10, because the field integration element performs array discrete sampling on an image plane of the front objective lens 1, a certain gap is left between sampling points, the spectral imaging component uniformly disperses the complex color light input by each sampling point to the gap between the sampling points, the dispersion spectrum of each sampling point obtained by recording is mutually independent and is not aliased, and the hyperspectral data of each sampling point can be extracted through a spectrum reconstruction algorithm, so as to obtain the hyperspectral data of a scene target with low spatial resolution.
The system acquires a multispectral image with high spatial resolution by a multispectral focal plane detector 3 through one frame shooting, acquires and reconstructs a hyperspectral image with low spatial resolution by a panchromatic focal plane detector 10, and acquires the hyperspectral image with high spatial resolution after the two images are fused. The multispectral focal plane detector 3 and the panchromatic focal plane detector 10 are controlled by a circuit system to realize simultaneous exposure and image acquisition with the same frame frequency, and an image fusion algorithm is operated in a frame period to realize hyperspectral video imaging. The multispectral light path and the hyperspectral light path share the front lens, the obtained two-dimensional space images have different resolutions, no parallax, image size difference and distortion difference, and the object point registration during image fusion is very convenient. In addition, the multispectral information of each object point can be directly acquired, and the hyperspectral image with full resolution is obtained by utilizing the fusion of the hyperspectral data of part of object points and the multispectral data of all object points, so that the inaccuracy of hyperspectral reconstruction caused by the complete loss of the multispectral information of part of object points is avoided.
Embodiment 1:
as shown in fig. 1, the invention comprises a pre-objective lens 1, a beam splitter prism 2, an RGB detector, a first field integration element 4-aperture array, a first beam splitter imaging assembly 5, and a full-color focal plane detector 10. Wherein the first spectral imaging assembly 5 comprises a first collimating lens group 6, a first dispersive element group 7, a focusing lens group and an aperture stop 9. Light rays 11 from the target scene are imaged after passing through the pre-objective lens 1, and the light rays 11 are divided into a transmission path and a reflection path by the beam splitting prism 2 in an imaging light path, wherein the reflection path light rays 11 are imaged to an RGB detector, and the transmission path light rays 11 are imaged to an array of small holes. The aperture array performs discrete sampling on the imaging of the transmission path of the front objective 1, light 11 is transmitted into the first spectral imaging assembly 5 after discrete sampling, and spectral data of discrete sampling points are obtained at the full-color focal plane array after collimation of the first collimating lens group 6, dispersion and splitting of the first dispersing prism and focusing imaging of the first focusing lens group 8 respectively.
Fig. 2 is a schematic diagram of a small hole array, in which the chromatic dispersion spectrum collected by the full-color focal plane detector 10 is shown, and since the small hole array performs array discrete sampling on the image plane of the front objective lens 1, a certain gap is left between sampling points, the first spectral imaging component 5 uniformly disperses the complex color light input by each sampling point to the gap between the sampling points, the chromatic dispersion spectrum of each sampling point obtained by recording is independent of each other and has no aliasing, and the hyperspectral data of each sampling point can be extracted through a spectrum reconstruction algorithm, so as to obtain the hyperspectral data of a scene target with low spatial resolution.
The system acquires RGB color images with high spatial resolution through one frame shooting by an RGB detector, acquires and reconstructs hyperspectral images with low spatial resolution by a panchromatic focal plane detector 10, and acquires hyperspectral images with high spatial resolution after the two images are fused. The RGB detector and the full-color focal plane detector 10 are controlled by a circuit system to realize simultaneous exposure and image acquisition with the same frame frequency, and an image fusion algorithm is operated in a frame period to realize hyperspectral video imaging.
The relevant indexes of the hyperspectral video imaging system provided in the embodiment 1 are as follows:
spectral range: 400-1000 nm;
system F number: 4.5;
angle of view: 30 °;
front objective 1 focal length: 30mm;
image resolution: 300 ten thousand;
spectral resolution: 5nm.
The RGB detector and full color focal plane detector 10 employed in example 1 each had a resolution of 2000 x 1500, the splitting prism 2 had a transmitted to reflected light intensity ratio of 5:1, and the array of wells contained 100 x 75 sample points.
In the embodiment 1, the front objective lens 1 adopts a transmission type double Gaussian objective lens, and has a 5-group 7-piece structure; the first collimating lens group 6 and the first focusing lens group 8 in the first spectral imaging assembly 5 are symmetrically arranged in the same optical system, and are respectively in a 4-group 4-piece structure. The optical system parameters are as follows:
the first dispersing element group 7 in the first spectral imaging assembly 5 is two groups of separated amicin prisms, each group of amicin prisms is formed by gluing H-FK61 and H-LAK4L materials, the vertex angles are 45.5 degrees and 34 degrees respectively, the center thickness is 10mm, and the two groups of amicin prisms form a direct-view dispersing prism group.
The MTF curve of the hyperspectral video imaging system provided by the embodiment is shown in fig. 4, and the hyperspectral video imaging system has excellent imaging quality and is close to the diffraction limit.
Example 2:
as shown in fig. 5, the hyperspectral video imaging system of the present invention includes: a pre-objective lens 1, a beam splitter prism 2, an RGB detector, a second field integration element 12, a microlens array, a second beam splitter imaging assembly 16, and a full color focal plane detector 10. Wherein the second spectral imaging assembly 16 comprises a second set of collimating lenses 13, a second set of dispersive elements 14, a second set of focusing lenses 15 and an aperture stop 9. Light rays 11 from the target scene are imaged after passing through the pre-objective lens 1, and the light rays 11 are divided into a transmission path and a reflection path by the beam splitting prism 2 in an imaging light path, wherein the reflection path light rays 11 are imaged to an RGB detector, and the transmission path light rays 11 are imaged to a micro lens array. The microlens array performs downsampling on the image formed by the transmission path of the front objective 1, each microlens can form an image point, the downsampled light 11 is transmitted into the second beam splitting imaging component 16, and the spectral data of the downsampled sampling point is obtained at the full-color focal plane array after the downsampled light 11 is collimated by the second collimating lens group 13, split by the second dispersing element group 14 and focused and imaged by the second focusing lens group 15. The system acquires RGB color images with high spatial resolution through one frame shooting by an RGB detector, acquires and reconstructs hyperspectral images with low spatial resolution by a panchromatic focal plane detector 10, and acquires hyperspectral images with high spatial resolution after the two images are fused. The RGB detector and the full-color focal plane detector 10 are controlled by a circuit system to realize simultaneous exposure and image acquisition with the same frame frequency, and an image fusion algorithm is operated in a frame period to realize hyperspectral video imaging.
The hyperspectral video imaging system related indexes provided by the embodiment are as follows:
spectral range: 400-950 nm;
system F number: 4.5;
angle of view: 30 °;
front objective 1 focal length: 30mm;
image resolution: 1200 ten thousand;
spectral resolution: 2.5nm.
The resolution ratio of the RGB detector and the full-color focal plane detector 10 adopted in the system is 4000×3000, the ratio of the transmitted light intensity to the reflected light intensity of the beam splitting prism 2 is 9:1, and the small hole array comprises 200×150 sampling points.
The front objective lens 1 in this embodiment is the same system as the front objective lens 1 in embodiment 1.
In this embodiment, the second collimating lens group 13 and the second focusing lens group 15 in the second spectral imaging assembly 16 are symmetrically disposed for the same optical system, and are respectively 5 groups of 7-piece structures, and parameters of the optical systems are as follows:
the second dispersive element group 14 in the second spectral imaging assembly 16 is two separate amix prisms, each of which is formed by gluing H-LAF54 and H-ZF88 materials, with apex angles of 13.5 ° and 5.8 °, respectively, center thicknesses of 6mm and 4mm, respectively, and the light ray 11 passes through the two amix prisms to produce a 29 ° optical path turn.
The hyperspectral video imaging system provided in example 2 employs a microlens array, which has high energy utilization.
Example 3:
as shown in fig. 6, the hyperspectral video imaging system of the present invention includes: the system comprises a front objective lens 1, a beam splitting prism 2, a multispectral focal plane detector 3, a third field integration element 17-small hole array, a third beam splitting imaging component 18 and a full-color focal plane detector 10. The third spectral imaging assembly 18 includes a third collimating lens group, a third dispersing prism group, and a third focusing lens group. Light rays 11 from the target scene are imaged after passing through the pre-objective lens 1, and the light rays 11 are divided into a transmission path and a reflection path by the beam splitting prism 2 in an imaging light path, wherein the transmission path light rays 11 are imaged to the multi-spectrum focal plane detector 3, and the reflection path light rays 11 are imaged to the small hole array. The aperture array performs discrete sampling on the imaging of the reflection path of the front objective 1, the light 11 after discrete sampling is transmitted into the third spectral imaging assembly 18, and the spectral data of discrete sampling points are obtained at the full-color focal plane array after the light is collimated by the third collimating lens group, dispersed and split by the third dispersing element group 19 and focused and imaged by the third focusing lens group respectively. The system acquires a multispectral image with high spatial resolution by a multispectral focal plane detector 3 through one frame shooting, acquires and reconstructs a hyperspectral image with low spatial resolution by a panchromatic focal plane detector 10, and acquires the hyperspectral image with high spatial resolution after the two images are fused. The multispectral focal plane detector 3 and the panchromatic focal plane detector 10 are controlled by a circuit system to realize simultaneous exposure and image acquisition with the same frame frequency, and an image fusion algorithm is operated in a frame period to realize hyperspectral video imaging.
The relevant indexes of the hyperspectral video imaging system provided in the embodiment 3 are as follows:
spectral range: 400-950 nm;
system F number: 4.5;
angle of view: 30 °;
front objective 1 focal length: 30mm;
image resolution: 200 ten thousand;
spectral resolution: 2.5nm.
The multispectral focal plane detector 3 adopted in the system is a mosaic filter array type multispectral detector, the pixel number is 200 ten thousand, wherein every 4×4 subunits form a pixel array period, and each pixel array period contains 16 narrowband filters with wave bands, so that the multispectral detector can acquire multispectral images with 200 ten thousand spatial resolutions and 16 spectral channel numbers. The full-color focal plane detector 10 has a resolution of 1600×1250, the beam splitting prism 2 transmits and reflects light with a ratio of 2:1, and the aperture array contains 100×80 sampling points.
In embodiment 3, the pre-objective lens 1 is the same system as the pre-objective lens 1 in embodiment 1, and the third collimating system and the third focusing system in the third spectral imaging assembly 18 are the same as the second collimating system and the second focusing system in embodiment 2.
In embodiment 3, the third dispersion element group 19 includes a catadioptric prism, and a transmissive prism is connected to the side of the catadioptric prism on which the light 11 is incident and the side from which the light 11 is emitted, respectively. The third dispersive element group 19 in the third spectral imaging assembly 18 is a three-cemented catadioptric prism, and is cemented by a first transmissive prism 20, a catadioptric prism 21, and a second transmissive prism 22. Wherein the two transmission prisms have the same structure, the material is H-LAF54, the apex angle is 23.5 degrees, and the center thickness is 5mm. The refractive prism 21 is made of H-ZF88GT, the vertex angle is 63.7 degrees, and the center thickness is 15mm.
The hyperspectral video imaging system provided in embodiment 3 partially corrects the nonlinearity of the prism dispersion by using the third dispersive element group 19, so that the spectrum sampling interval is more uniform, and the wavelength resolution difference is small.
It is apparent that the above examples are given by way of illustration only and are not limiting of the embodiments. Other variations and modifications of the present invention will be apparent to those of ordinary skill in the art in light of the foregoing description. It is not necessary here nor is it exhaustive of all embodiments. And obvious variations or modifications thereof are contemplated as falling within the scope of the present invention.
Claims (10)
1. A hyperspectral video imaging system, characterized by: according to the incidence direction of light rays, the device comprises a front objective lens and a beam splitting prism for splitting the light rays into a transmission path and a reflection path, wherein one path of the transmission path and the reflection path sequentially passes through a field integration element and a beam splitting imaging assembly to be imaged to a full-color focal plane detector, and the other path of the transmission path and the reflection path is imaged to a multispectral focal plane detector.
2. The hyperspectral video imaging system of claim 1, wherein: the beam-splitting imaging assembly comprises a collimating lens group, a dispersing element group and a focusing lens group, wherein the light incidence directions of the collimating lens group, the dispersing element group and the focusing lens group are sequentially set.
3. The hyperspectral video imaging system of claim 2, wherein: the dispersion element group comprises two amix prisms and an aperture diaphragm, and the two amix prisms are symmetrically arranged on two sides of the aperture diaphragm.
4. The hyperspectral video imaging system of claim 2, wherein: the dispersion element group comprises a refraction and reflection prism, and a transmission prism is respectively connected with one side of the refraction and reflection prism, on which light is incident, and one side of the refraction and reflection prism, on which the light is emergent.
5. The hyperspectral video imaging system of claim 2, wherein: the dispersion element group comprises a dispersion prism, and the dispersion prism is a single prism, a glued prism or a catadioptric prism.
6. The hyperspectral video imaging system of claim 2, wherein: the light between the collimating lens group and the dispersing element group is incident light, the light between the dispersing element group and the focusing lens group is emergent light, the incident light and the emergent light are symmetrical about a symmetry plane, and the collimating lens group and the focusing lens group are symmetrical about the symmetry plane.
7. The hyperspectral video imaging system of claim 1, wherein: the front objective is a transmission objective, a reflection objective or a catadioptric objective.
8. The hyperspectral video imaging system of claim 1, wherein: the multispectral focal plane detector is an RGB detector or a mosaic filter array type detector with a plurality of spectrum channels.
9. The hyperspectral video imaging system of claim 1, wherein: the field integration element is an array of apertures, a microlens array, an optical fiber array, or a spatial light modulator.
10. The hyperspectral video imaging system of claim 1, wherein: the beam-splitting imaging component comprises a collimating lens group and a focusing lens group, and the focal length ratio of the collimating lens group to the focusing lens group is 0.1-10.
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202310148512 | 2023-02-22 | ||
| CN2023101485121 | 2023-02-22 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CN116448246A true CN116448246A (en) | 2023-07-18 |
Family
ID=87126501
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202310269211.4A Pending CN116448246A (en) | 2023-02-22 | 2023-03-20 | Hyperspectral video imaging system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN116448246A (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116630148A (en) * | 2023-07-25 | 2023-08-22 | 芯视界（北京）科技有限公司 | Spectral image processing method and device, electronic equipment and storage medium |
| CN117686089A (en) * | 2024-02-04 | 2024-03-12 | 中国海洋大学 | Double-channel integral view field snapshot type hyperspectral imaging system and image fusion method |
-
2023
- 2023-03-20 CN CN202310269211.4A patent/CN116448246A/en active Pending
Cited By (4)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN116630148A (en) * | 2023-07-25 | 2023-08-22 | 芯视界（北京）科技有限公司 | Spectral image processing method and device, electronic equipment and storage medium |
| CN116630148B (en) * | 2023-07-25 | 2023-09-26 | 芯视界（北京）科技有限公司 | Spectral image processing method and device, electronic equipment and storage medium |
| CN117686089A (en) * | 2024-02-04 | 2024-03-12 | 中国海洋大学 | Double-channel integral view field snapshot type hyperspectral imaging system and image fusion method |
| CN117686089B (en) * | 2024-02-04 | 2024-05-10 | 中国海洋大学 | Double-channel integral view field snapshot type hyperspectral imaging system and image fusion method |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| AU731476B2 (en) | Multi-spectral two-dimensional imaging spectrometer | |
| Gao et al. | A review of snapshot multidimensional optical imaging: measuring photon tags in parallel | |
| US5982497A (en) | Multi-spectral two-dimensional imaging spectrometer | |
| CN116448246A (en) | Hyperspectral video imaging system | |
| US7471451B2 (en) | Multiple field of view optical system | |
| US7636158B1 (en) | Optimal coupling of high performance line imaging spectrometer to imaging system | |
| US8351031B2 (en) | Single-shot spectral imager | |
| US20170026570A1 (en) | Devices and methods for optically multiplexed imaging | |
| CN103234632A (en) | Push broom type spectrum imaging optical system with high resolution and wide visual field | |
| CN105258796A (en) | Co-optical-path miniature multispectral imaging system | |
| CN110319932A (en) | A kind of high light spectrum image-forming optics system | |
| US11268856B1 (en) | Enhanced co-registered optical systems | |
| CN114360364A (en) | Multispectral imaging module and portable display device | |
| CN110632000A (en) | Dynamic double-arm multi-channel staring spectral imaging system based on compressed sensing | |
| US10976194B1 (en) | Pupil division multiplexed imaging systems | |
| US11092489B2 (en) | Wide-angle computational imaging spectroscopy method and apparatus | |
| CN110567581A (en) | DMD-based multi-target imaging spectrum system and method | |
| CN210774358U (en) | Dynamic double-arm multi-channel staring spectral imaging system based on compressed sensing | |
| Fisher et al. | Survey and analysis of fore-optics for hyperspectral imaging systems | |
| US10948715B2 (en) | Chromatic lens and methods and systems using same | |
| US11353359B1 (en) | Pupil division multiplexed imaging systems | |
| US11892349B1 (en) | Pupil division multiplexed imaging systems | |
| Ding et al. | Snapshot spectral imaging: from spatial-spectral mapping to metasurface-based imaging | |
| Mansur et al. | Fiber optic snapshot hyperspectral imager | |
| Mas et al. | Comparison of a kaleidoscope-based multi-view infrared system with its TOMBO-based counterpart |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination |