CN112033540B - Low-cost rotary swing-scanning hyperspectral imaging system - Google Patents

Low-cost rotary swing-scanning hyperspectral imaging system Download PDF

Info

Publication number
CN112033540B
CN112033540B CN202010853422.9A CN202010853422A CN112033540B CN 112033540 B CN112033540 B CN 112033540B CN 202010853422 A CN202010853422 A CN 202010853422A CN 112033540 B CN112033540 B CN 112033540B
Authority
CN
China
Prior art keywords
module
hyperspectral
linear
image
rotary
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN202010853422.9A
Other languages
Chinese (zh)
Other versions
CN112033540A (en
Inventor
何赛灵
罗晶
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Zhejiang University ZJU
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN202010853422.9A priority Critical patent/CN112033540B/en
Publication of CN112033540A publication Critical patent/CN112033540A/en
Application granted granted Critical
Publication of CN112033540B publication Critical patent/CN112033540B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/2823Imaging spectrometer
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/06Scanning arrangements arrangements for order-selection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/12Generating the spectrum; Monochromators
    • G01J3/18Generating the spectrum; Monochromators using diffraction elements, e.g. grating
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02Details
    • G01J3/06Scanning arrangements arrangements for order-selection
    • G01J2003/061Mechanisms, e.g. sine bar

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Microscoopes, Condenser (AREA)
  • Spectrometry And Color Measurement (AREA)

Abstract

The invention discloses a low-cost rotary swing scanning type hyperspectral imaging system which comprises a linear hyperspectral module, a mechanical rotary module, an information processing module and a cloud server, wherein the linear hyperspectral module is connected with the mechanical rotary module; the linear hyperspectral module sequentially comprises an imaging lens, a slit, a first lens, a first optical wedge, a grating, a second optical wedge, a second lens and a camera; imaging an object to be detected at the position of a slit by an imaging lens, enabling the image of the object to be detected to pass through a linear region corresponding to the slit, diffracting and splitting reflected light by a grating, and acquiring a diffraction image by a camera; the mechanical rotating module drives the linear hyperspectral module to rotate and sweep in the opening angle range; when the mechanical rotation module rotates to an opening angle range angle, the system generates a panoramic hyperspectral image in a scene; and the information processing module sends the map data acquired by the hyperspectral imaging system in real time to the cloud server for data visualization and analysis. The invention overcomes the defects of high price, time-consuming operation, single scale, map distortion and the like of the traditional hyperspectral imaging technology.

Description

Low-cost rotary swing-scanning hyperspectral imaging system
Technical Field
The invention relates to a low-cost rotary swing scanning hyperspectral imaging system.
Background
At present, an imaging spectrometer is based on a multichannel spectrum technology, integrates optical imaging and spectrum measurement, and can acquire image information and corresponding spectrum information of a target at the same time. The imaging spectrometer can analyze, measure and process the structure and the components of the substance, has the advantages of high analysis precision, wide measurement range and the like, and is widely applied to the fields of petroleum, materials, agriculture, geological exploration, biochemistry, medicine and health, environmental protection, safety detection and the like. At present, a push-broom type utilizing surface detector receives information of a target wave band, the space required by push-broom is larger, the precision requirement on a push-broom platform is higher, and a mechanical device is complex. The staring hyperspectral imaging utilizes a spectroscopic mode such as an acousto-optic tunable filter, a gradual filter and the like to split light, but the image information and the spectrum information of a target cannot be extracted at the same time, the later data processing is difficult, the spatial resolution is limited, and the number of spectrum channels is limited. It can be seen that the conventional hyperspectral imaging systems all require mechanical space scanning or wavelength scanning devices, and the imaging mode is complex, long in time and high in price. In addition, the two imaging modes often obtain information which is tens of times more than the needed information, and the resource utilization rate is low. The conventional swing scan type is also called swing scan type and optical machine scan type, and the line detector is used to receive the information of each wave band of the target. The traditional swing scanning hyperspectral imaging system is mechanically complex, a precise motor is required to control a reflecting mirror to swing and scan, the system is large in size, and 360-degree panoramic scanning cannot be achieved. And the image of the traditional rotary swing scanning hyperspectral imaging system has distortion.
The cloud connection technology is the comprehensive expression of network connection in the cloud computing era, integrates multiple modes and technologies of a computer network, each user is equivalent to a node, and the user can safely and quickly acquire required resources from any place through each node at any time by only establishing a connection channel.
Disclosure of Invention
In order to overcome the defects in the prior art, the invention provides a low-cost rotary swing scanning hyperspectral imaging system.
The technical scheme adopted for solving the technical problems is as follows:
A low-cost rotary swing-scanning hyperspectral imaging system comprises a linear hyperspectral module, a mechanical rotary module, an information processing module and a cloud server; the linear hyperspectral module sequentially comprises an imaging lens, a slit, a first lens, a first optical wedge, a grating, a second optical wedge, a second lens and a camera; imaging an object to be detected at a slit position by an imaging lens, enabling the image of the object to be detected to pass through a linear region corresponding to the slit, collimating reflected light into parallel light by a first lens at a back focal plane of the slit, diffracting and splitting the reflected light by a grating, providing deflection angles by a first optical wedge and a second optical wedge, shifting a first-order diffraction spectrum to the center of a field of view, and collecting diffraction images by a camera; the mechanical rotating module drives the linear hyperspectral module to perform rotating sweeping within the opening angle range;
When the hyperspectral imaging system detects a scene, the mechanical rotation module rotates once in steps, and the linear hyperspectral module automatically acquires the spectral information of each point of the linear region corresponding to the slit; when the mechanical rotation module rotates to an angle in the opening angle range, the system generates a panoramic hyperspectral image in a scene;
and the information processing module sends the map data acquired by the hyperspectral imaging system in real time to the cloud server for data visualization and analysis.
The information processing module comprises a storage unit, a processing unit and a sending unit; the processing unit is used for reconstructing a hyperspectral image of the scene without distortion.
The mechanical rotating module comprises an electric rotating platform, a controller and a tripod, and the controller controls the electric rotating platform to swing around the shaft.
The imaging lens adopts a microscope objective lens for realizing hyperspectral imaging under a microscopic scene.
The mechanical rotation module rotates for an angle theta 0, the stepping precision is delta theta each time, the current stepping times are n, the mechanical rotation module drives the linear hyperspectral module to rotate so as to cause scaling distortion of the size of a space image of an object to be detected, the scaling factor of the size of the space image of the object to be detected at the current rotation angle relative to the space image of the initial angle is shown as a formula 1, the rotation of the mechanical rotation module is expressed as rotation around an X axis in a camera coordinate system of the linear hyperspectral module, the pose distortion is caused by the pose orientation change of the system, a rotation matrix R is shown as a formula 2, a transformation relation of the image coordinate system of the linear hyperspectral module in the rotation process is established, and each frame of space image is circularly spliced together through transformation as shown as a formula 3 so as to obtain a undistorted hyperspectral image;
wherein θ 0 is the rotation opening angle range of the mechanical rotation module, Δθ is the stepping precision of the rotary table, n is the current stepping times, α is the scaling factor of the space image size of the object to be measured at the current rotation angle relative to the space image of the initial angle, R is the rotation factor of the camera coordinate system of the current rotation angle relative to the camera coordinate system of the initial angle, u 0,v0 is the coordinates of the pixel points of the current camera image coordinate system, and u 1,v1 is the camera image pixel coordinates after correcting the scaling distortion and the pose distortion.
The invention has the beneficial effects that the invention provides a low-cost rotary swing scanning hyperspectral imaging system, which combines a mechanical rotary module and a linear hyperspectral imaging module, and can quickly and accurately obtain a hyperspectral panoramic image without distortion at low cost. The front objective can be freely switched into the micro objective to realize hyperspectral imaging of a target to be detected in a microscopic scale, and has important significance for in-situ low-cost in-situ microscopic map observation. The system overcomes the limitations of expensive price, time-consuming operation, huge volume, single imaging scale and the like of the traditional hyperspectral imaging system, and greatly improves the acquisition efficiency of spectral data. The cloud connection technology is introduced to share the spectrum data, so that the cost of a large amount of manpower and material resources is avoided, the efficiency of spectrum data acquisition is greatly improved, and the data can visually show the value in a cloud network. The low-cost rotary swing-broom hyperspectral imaging system can be well applied to the fields of ocean in-situ spectrum monitoring, human health assessment and food safety detection.
Drawings
FIG. 1 is a schematic diagram of a low cost rotary swept hyperspectral imaging system;
In fig. 1, an imaging lens 1, a slit 2, a first lens 3, a first optical wedge 4, a grating 5, a second optical wedge 6, a second lens 7, a camera 8, a linear hyperspectral module 9, a rotating platform 10, a controller 11, an information processing module 12, a triangle fixing frame 13, a mechanical rotating module 14, a cloud server 15, a reflecting mirror 16, and a microscope objective 17.
Fig. 2 is a panoramic hyperspectral image obtained by 360-degree rotational scanning with a low-cost rotational-swing-scanning hyperspectral imaging system.
Detailed Description
The invention is further illustrated in the following figures and examples.
Example 1
As shown in fig. 1, a low-cost rotary swing-scanning hyperspectral imaging system mainly comprises a linear hyperspectral module, a mechanical rotary module, an information processing module and a cloud server; the linear hyperspectral module diffracts and splits the reflected light of the linear region corresponding to the slit of the scene, and the light diffraction image is collected by a photosensitive chip in the spectrum module camera; the mechanical rotation module drives the linear hyperspectral module to perform multi-angle free-selection rotation scanning imaging. And then combining the image distortion correction algorithm to process the scanned image, so as to obtain the hyperspectral image of the scene. The front lens of the hyperspectral imaging system can be replaced by a common imaging objective lens or a microscope objective lens, so that hyperspectral imaging is realized on objects to be detected under different scales. The information processing module 12 shares the map data to the cloud server 15 in real time, so that the data can be efficiently visualized and analyzed.
As shown in fig. 1, the linear spectrum hyperspectral module 9 is composed of an imaging lens 1, a slit 2, a first lens 3, a first optical wedge 4, a grating 5, a second optical wedge 6, a second lens 7 and a camera 8. The image of the object to be measured is imaged at the position of the slit 2 through the imaging lens 1, the image corresponding to the linear region of the slit is collimated into parallel light through the lens 3, and the parallel light sequentially passes through the light splitting modules of the first optical wedge 4, the grating 5 and the second optical wedge 6, and is focused at the position of the camera 8 through the second lens 7. The information processing module 12 of the low-cost rotary swing scanning hyperspectral imaging system comprises a storage unit, a processing unit and a sending unit; the information processing module sends the map data acquired by the real-time hyperspectral imaging system to the cloud server 15 through the information processing module 12 for data visualization and analysis.
The mechanical rotating module 14 of the low-cost rotating swing scanning hyperspectral imaging system is composed of a rotating platform 10, a controller 11 and a tripod fixing frame 13. The mechanical rotary platform structure drives the linear hyperspectral module 9 to carry out rotary scanning, and the linear hyperspectral module 9 collects an original hyperspectral image.
The hyperspectral imaging algorithm of the low-cost rotary swing-broom hyperspectral imaging system is different from that of a common push-broom hyperspectral imaging system. The mechanical rotation module rotates by an angle theta 0 degrees, the stepping precision of each time is delta theta, and the current stepping times are n. The mechanical module drives the spectrum module to rotate, so that the size of the space image of the object to be measured is scaled, and the scaling factor of the space image size of the object to be measured at the current rotation angle relative to the space image of the initial angle is shown as a formula 1. The rotation of the mechanical module is expressed as a rotation about the X-axis in the camera coordinate system of the spectrum module, and the rotation matrix R is shown in equation 2. And establishing a transformation relation of an image coordinate system of the spectrum module in the rotation process, as shown in a formula 3. And the space images of each frame line are circularly spliced together through the transformation to obtain a normal hyperspectral image.
The imaging lens 1 of the system can be replaced by a combination of a microscope objective 17 and a reflecting mirror 16, so that hyperspectral imaging of an object to be measured under a microscopic scale is realized. As shown in fig. 2, the low-cost rotary swing-sweeping type hyperspectral imaging system performs 360-degree rotary scanning to obtain panoramic hyperspectral images of building bodies, ponds and tree vegetation opposite to a building corridor.
The embodiments in the foregoing description may be further combined or replaced, and the embodiments are merely illustrative of the preferred embodiments of the present invention and are not intended to limit the spirit and scope of the present invention, and various changes and modifications made by those skilled in the art to which the present invention pertains without departing from the spirit of the present invention. The scope of the invention is given by the appended claims and any equivalents thereof.

Claims (4)

1. The low-cost rotary swing scanning type hyperspectral imaging system is characterized by comprising a linear hyperspectral module, a mechanical rotary module, an information processing module and a cloud server;
The linear hyperspectral module sequentially comprises an imaging lens, a slit, a first lens, a first optical wedge, a grating, a second optical wedge, a second lens and a camera; imaging an object to be detected at a slit position by an imaging lens, enabling the image of the object to be detected to pass through a linear region corresponding to the slit, collimating reflected light into parallel light by a first lens at a back focal plane of the slit, diffracting and splitting the reflected light by a grating, providing deflection angles by a first optical wedge and a second optical wedge, shifting a first-order diffraction spectrum to the center of a field of view, and collecting diffraction images by a camera; the mechanical rotating module drives the linear hyperspectral module to perform rotating sweeping within the opening angle range;
When the hyperspectral imaging system detects a scene, the mechanical rotation module rotates once in steps, and the linear hyperspectral module automatically acquires the spectral information of each point of the linear region corresponding to the slit; when the mechanical rotation module rotates to an angle in the opening angle range, the system generates a panoramic hyperspectral image in a scene;
the information processing module sends map data acquired by the hyperspectral imaging system in real time to the cloud server for data visualization and analysis;
The low-cost rotary swing scanning type hyperspectral imaging system is characterized in that a mechanical rotary module rotates for an angle theta 0, the stepping precision is delta theta each time, the current stepping times are n, the mechanical rotary module drives a linear hyperspectral module to rotate so as to cause the size of a space image of an object to be detected to generate scaling distortion, the scaling factor of the size of the space image of the object to be detected at the current rotary angle relative to a space image at an initial angle is shown as a formula (1), the rotation of the mechanical rotary module is shown as rotation around an X axis in a camera coordinate system of the linear hyperspectral module, the pose orientation of the system is changed so as to cause splicing to generate pose distortion, a rotary matrix R is shown as a formula (2), a transformation relation of the image coordinate system of the linear hyperspectral module in the rotation process is established, and each frame of space image is spliced together through the transformation cycle so as to obtain a hyperspectral image without distortion as shown as a formula (3);
Wherein f x,fy is a scaling factor on a relative camera image coordinate system, c x,cy is a pixel coordinate of an optical center position on a current camera image coordinate system, θ 0 is a rotation opening angle range of a mechanical rotation module, Δθ is stepping precision of a rotary table, n is current stepping times, α is a scaling factor of a space image size of an object to be measured at a current rotation angle relative to a space image at a starting angle, R is a rotation factor of a camera coordinate system at the current rotation angle relative to the camera coordinate system at the starting angle, u 0,v0 is a coordinate of a pixel point of the current camera image coordinate system, and u 1,v1 is a camera image pixel coordinate after correcting scaling distortion and pose distortion.
2. The low-cost rotary swing scanning hyperspectral imaging system according to claim 1, wherein the information processing module comprises a storage unit, a processing unit and a transmitting unit; the processing unit is used for reconstructing a hyperspectral image of the scene without distortion.
3. The low cost rotary swing scan hyperspectral imaging system of claim 1, wherein the mechanical rotary module comprises an electric rotary platform, a controller, and a tripod, the controller controlling the electric rotary platform to swing around an axis.
4. The low-cost rotary swing scanning hyperspectral imaging system of claim 1, wherein the imaging lens employs a microscope objective for hyperspectral imaging in microscopic scenes.
CN202010853422.9A 2020-08-23 2020-08-23 Low-cost rotary swing-scanning hyperspectral imaging system Active CN112033540B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202010853422.9A CN112033540B (en) 2020-08-23 2020-08-23 Low-cost rotary swing-scanning hyperspectral imaging system

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202010853422.9A CN112033540B (en) 2020-08-23 2020-08-23 Low-cost rotary swing-scanning hyperspectral imaging system

Publications (2)

Publication Number Publication Date
CN112033540A CN112033540A (en) 2020-12-04
CN112033540B true CN112033540B (en) 2024-05-14

Family

ID=73580591

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202010853422.9A Active CN112033540B (en) 2020-08-23 2020-08-23 Low-cost rotary swing-scanning hyperspectral imaging system

Country Status (1)

Country Link
CN (1) CN112033540B (en)

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103411670A (en) * 2013-06-27 2013-11-27 中国科学院光电研究院 Novel prism chromatic dispersion imaging spectrograph
CN103743482A (en) * 2013-11-22 2014-04-23 中国科学院光电研究院 Spectrum imaging apparatus and spectrum imaging inversion method
CN104535184A (en) * 2014-12-22 2015-04-22 中国科学院长春光学精密机械与物理研究所 Light path structure of prism-grating imaging spectrometer
CN207717227U (en) * 2018-01-06 2018-08-10 蔡夫鸿 A kind of pivoting scan-type imaging spectrometer system
CN111504917A (en) * 2020-06-14 2020-08-07 苏州优函信息科技有限公司 Low-cost quick linear spectral imaging system

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6831688B2 (en) * 2002-04-08 2004-12-14 Recon/Optical, Inc. Multispectral or hyperspectral imaging system and method for tactical reconnaissance

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103411670A (en) * 2013-06-27 2013-11-27 中国科学院光电研究院 Novel prism chromatic dispersion imaging spectrograph
CN103743482A (en) * 2013-11-22 2014-04-23 中国科学院光电研究院 Spectrum imaging apparatus and spectrum imaging inversion method
CN104535184A (en) * 2014-12-22 2015-04-22 中国科学院长春光学精密机械与物理研究所 Light path structure of prism-grating imaging spectrometer
CN207717227U (en) * 2018-01-06 2018-08-10 蔡夫鸿 A kind of pivoting scan-type imaging spectrometer system
CN111504917A (en) * 2020-06-14 2020-08-07 苏州优函信息科技有限公司 Low-cost quick linear spectral imaging system

Also Published As

Publication number Publication date
CN112033540A (en) 2020-12-04

Similar Documents

Publication Publication Date Title
RU2734018C2 (en) Method and device for generating data representing a light field
US9239263B2 (en) Image mapped spectropolarimetry
CN108007574B (en) The fast illuminated image spectrum linear polarization detection device of resolution ratio adjustable type and method
KR20190096831A (en) Polarization Measuring Device, Polarization Measuring Method and Optical Alignment Method
US20100103309A1 (en) Method and system for compressed imaging
WO2010018515A1 (en) Measuring and correcting lens distortion in a multispot scanning device.
CN114279564B (en) Parallel compressed sensing computed tomography spectrometer and imaging spectrum reconstruction method thereof
CN111443045B (en) Spectral imaging analysis system and spectral imaging analysis method
CN107436285A (en) Fast high-flux bloom spectrum detection device and detection method based on linear light source excitation
JP5424108B2 (en) Raman imaging equipment
CN209264115U (en) A kind of spectrometer system
CN1702452B (en) Digital microscope multi-objective imaging spectrometer apparatus
CN108332853A (en) A kind of vehicle-mounted 360 degree of panorama target identification systems based on spectrum
CN114264370B (en) Compressed sensing computed tomography spectrometer system and imaging method
CN205981445U (en) Multiple spot scanning that can be used to spectral analysis is total to focusing imaging system
CN104792416A (en) Push-broom complete-polarization high-spectral integrated imaging unit
CN112432705A (en) Multispectral imaging system and method based on dynamic visual axis adjustment principle
Zhao et al. Field imaging system for hyperspectral data, 3D structural data and panchromatic image data measurement based on acousto-optic tunable filter
CN207923289U (en) A kind of wide spectrum imaging system for historical relic in-situ scanning
CN112033540B (en) Low-cost rotary swing-scanning hyperspectral imaging system
EP3288253A1 (en) Method and apparatus for generating data representative of a bokeh associated to light-field data
Wehlburg et al. Optimization and characterization of an imaging Hadamard spectrometer
Luo et al. Rotational hyperspectral scanner and related image reconstruction algorithm
CN109781260A (en) The fast illuminated polarization spectrum imaging detection device of ultra-compact and detection method
Skauli et al. Simplified measurement of point spread functions of hyperspectral cameras for assessment of spatial coregistration

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant