CN111721718B - Spectral imaging method and system - Google Patents
Spectral imaging method and system Download PDFInfo
- Publication number
- CN111721718B CN111721718B CN202010605498.XA CN202010605498A CN111721718B CN 111721718 B CN111721718 B CN 111721718B CN 202010605498 A CN202010605498 A CN 202010605498A CN 111721718 B CN111721718 B CN 111721718B
- Authority
- CN
- China
- Prior art keywords
- light
- data
- image data
- processor
- imaged
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
- G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/25—Fusion techniques
- G06F18/251—Fusion techniques of input or preprocessed data
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Data Mining & Analysis (AREA)
- Life Sciences & Earth Sciences (AREA)
- Pathology (AREA)
- Bioinformatics & Computational Biology (AREA)
- Biochemistry (AREA)
- Immunology (AREA)
- Analytical Chemistry (AREA)
- Chemical & Material Sciences (AREA)
- Health & Medical Sciences (AREA)
- Artificial Intelligence (AREA)
- Bioinformatics & Cheminformatics (AREA)
- General Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Spectrometry And Color Measurement (AREA)
Abstract
The application provides a spectrum imaging method and a system, wherein the method comprises the steps that a processor sends an irradiation starting instruction to a light source device according to an externally input image acquisition instruction; the light source device emits illumination light; the object to be imaged absorbs the irradiation light and emits excitation light; the excitation light sequentially passes through the excitation light converging lens group, the slit device and the long-wave pass filter to generate light filtering treatment light; reflecting the first quantity of random matrix data loaded in sequence by a digital micromirror device to generate a first quantity of reflected light; the optical fiber collimator collects a first quantity of reflected light through the reflected light converging lens group; and performing collimation processing to generate a first number of collimation optical signals, transmitting the first number of collimation optical signals to a spectrometer through an optical fiber for spectrum measurement to obtain a first number of first spectrum data, transmitting the first number of first spectrum data to a processor for image reconstruction processing to obtain a second number of reconstructed image data, and performing fusion processing on the second number of reconstructed image data to obtain image data of an object to be imaged.
Description
Technical Field
The application relates to the field of data processing, in particular to a spectrum imaging method and a spectrum imaging system.
Background
Spectral imaging is a method commonly used in basic and applied science research for microscopic analysis of specific chemical compositions and physical structures. Spectral imaging may generally be defined as the combined acquisition of spatial and spectral information. Imaging spectrometers are also installed in space and on satellites for remote sensing and astronomical observation. Spectral information can be used for mass analysis in many fields. In biomedical research, a wide range of applications, such as protein localization and interaction studies, require quantitative methods to simultaneously analyze several different fluorescent molecules in the same sample. In fact, these applications are becoming more and more common with the advent of various fluorescent dyes and proteins with emissions ranging from ultraviolet to far infrared. Fluorescence spectral imaging techniques have indeed become a fundamental tool in scientific research.
However, conventional spectral imaging has some drawbacks. In most current spectroscopic imaging techniques, spatial information is obtained by mechanically scanning the sample point by point using a spectrometer. Inevitably, the mechanical movement will produce errors in the spatial domain, potentially requiring repeated measurements, which wastes resources.
Disclosure of Invention
In view of the defects in the prior art, the embodiment of the application provides a spectrum imaging method and a system, which have a large amount of data based on spectrum imaging and are usually highly compressible and remarkable characteristics, and spectrum information and spatial information can be obtained simultaneously without mechanical scanning by using a spectrometer and spatial light modulation, so that imaging of an object to be imaged is completed.
To solve the above problems, in a first aspect, the present application provides a spectral imaging method, the method comprising: the processor sends an irradiation starting instruction to the light source equipment according to an externally input image acquisition instruction;
the light source equipment emits irradiation light to a target object to be imaged according to the irradiation starting instruction;
the target object to be imaged absorbs the irradiation light and emits excitation light;
the excitation light passes through the excitation light converging lens group and the slit device and irradiates to the long-wave pass filter;
the long-wave pass filter performs filtering treatment on the received excitation light to generate filtering treatment light;
the digital micromirror device sequentially generates a first quantity of reflected light according to the sequentially loaded first quantity of random matrix data and the received filtering processing light;
the optical fiber collimator collects the received first quantity of reflected light through the reflected light converging lens group;
the optical fiber collimator sequentially collimates the first quantity of reflected light received in sequence to generate a first quantity of collimated light signals, and the first quantity of collimated light signals are transmitted to the spectrometer through optical fibers;
the spectrometer performs spectrum measurement processing on the received first number of collimated light signals to obtain first number of first spectrum data, and sends the first number of first spectrum data to the processor; wherein the first spectral data comprises a second number of peaks;
the processor determining a second number of sets of vertical data from a second number of peak data in the first number of first spectral data;
the processor invokes a preset compressed sensing algorithm to carry out image reconstruction processing on the second number of sets of vertical data to obtain second number of reconstructed image data;
and the processor performs fusion processing on the second number of reconstructed image data to obtain the image data of the object to be imaged.
Preferably, the object to be imaged is composed of a second number of fluorescent materials.
Preferably, the first number is 2468.
Preferably, the excitation light converging lens group includes a first lens and a second lens, and the excitation light irradiates the long-wave pass filter after passing through the excitation light converging lens group and the slit device specifically includes:
the first lens focuses the passed excitation light to obtain focused light focused at a slit of the slit device;
the slit device adjusts the light flux of the passing focused light according to the preset light flux to obtain light flux adjusting light;
and the second lens performs light path adjustment treatment on the received light flux adjustment light and irradiates the light flux adjustment light to the long-wave pass filter.
Preferably, the digital micromirror device sequentially generates a first amount of reflected light according to the sequentially loaded first amount of random matrix data and the received filter processing light, which specifically includes:
the processor acquires a first number of random matrix data from the storage unit according to the image acquisition instruction;
the processor sequentially transmits the random matrix data to the digital micromirror device according to a preset time interval;
and the digital micromirror device adjusts the reflecting element according to each piece of random matrix data, and reflects the received light subjected to the light filtering treatment to obtain a first quantity of reflected light.
Preferably, after the optical fiber collimator sequentially collimates the sequentially received first quantity of reflected light to generate a first quantity of collimated light signals, the method further includes: the collimated light signal is transmitted to the spectrometer via an optical fiber.
Preferably, the processor invokes a preset compressed sensing algorithm to perform image reconstruction processing on the second number of sets of vertical data, and the obtaining of the second number of reconstructed image data specifically includes:
and the processor calls a TVAL3 algorithm to respectively carry out image reconstruction processing on each group of vertical data of the second number of groups of vertical data to obtain a second number of different reconstructed image data.
Preferably, the processor performs fusion processing on the second number of reconstructed image data, and the generating of the image data of the object to be imaged specifically includes:
the processor obtains a second number of first pixel values according to the pixel values of the first pixel points of each reconstructed image data in the second number of reconstructed image data;
the processor adds the second number of the first pixel values to obtain a first fused pixel value corresponding to the first pixel point;
and the processor generates image data of the object to be imaged according to the first fusion pixel value corresponding to each first pixel point.
Preferably, after obtaining the image data of the object to be imaged, the method further comprises: the processor sends the image data to a display device for displaying an image corresponding to the image data.
In a second aspect, the present application provides a spectral imaging system, the system comprising: the device comprises a processor, a light source device, an excitation light converging lens group, a slit device, a long-wave pass filter, a digital micromirror device, a reflected light converging lens group, an optical fiber collimator and a spectrometer;
the processor is used for sending an irradiation starting instruction to the light source equipment according to an externally input image acquisition instruction;
the light source device is used for emitting irradiation light to the target object to be imaged according to the irradiation starting instruction; the target object to be imaged absorbs the irradiation light and emits excitation light;
the excitation light passes through the excitation light converging lens group and the slit device and irradiates to the long-wave pass filter;
the long-wave pass filter is used for generating light filtering treatment light after the received excitation light is subjected to light filtering treatment;
the digital micromirror device is used for sequentially generating a first quantity of reflected light according to the sequentially loaded first quantity of random matrix data and the received light filtering processing light;
the optical fiber collimator is used for collecting the received first quantity of reflected light through the reflected light converging lens group; sequentially collimating the sequentially received first quantity of reflected light to generate a first quantity of collimated light signals;
the spectrometer is used for carrying out spectrum measurement processing on the received first number of collimated light signals to obtain first number of first spectrum data, and sending the first number of first spectrum data to the processor; wherein the first spectral data comprises a second number of peaks;
the processor is further configured to determine a second number of sets of vertical data from a second number of peak data in the first number of first spectral data;
the processor is further used for calling a preset compressed sensing algorithm to perform image reconstruction processing on the second number of sets of vertical data to obtain second number of reconstructed image data;
and the processor is also used for carrying out fusion processing on the second number of reconstructed image data to obtain the image data of the object to be imaged.
According to the spectrum imaging method and system provided by the embodiment of the application, a large amount of data of spectrum imaging is usually highly compressible and remarkable characteristics, under the condition of no mechanical scanning, spatial resolution is provided by utilizing DMD modulation, meanwhile, a first amount of spectrum data is obtained by a method for obtaining spectrum data in a wavelength range of a spectrometer, then image reconstruction processing is carried out on the first amount of spectrum data comprising a second amount of peaks by a preset compressed sensing reconstruction method to obtain a second amount of reconstructed image data, fusion processing is carried out on the reconstructed image data, finally, image data of an object to be imaged is obtained, and image display is carried out on corresponding display equipment.
Drawings
FIG. 1 is a block diagram of a spectral imaging system according to an embodiment of the present application
Fig. 2 is a flowchart of a spectral imaging method according to an embodiment of the present application.
Detailed Description
The application is described in further detail below with reference to the drawings and examples. It is to be understood that the specific embodiments described herein are merely illustrative of the application and are not limiting of the application. It should be noted that, for convenience of description, only the portions related to the present application are shown in the drawings.
It should be noted that, without conflict, the embodiments of the present application and features of the embodiments may be combined with each other. The application will be described in detail below with reference to the drawings in connection with embodiments.
The application provides a spectrum imaging method for imaging an object to be imaged of a fluorescent material, which is based on a spectrum imaging system provided by the application. Fig. 1 is a block diagram of a spectral imaging system according to an embodiment of the present application, where as shown in the drawing, the spectral imaging system includes: a light source device 1, an excitation light converging lens group 2, a slit device 4, a long-wave pass filter 5, a digital micromirror device 6, a reflected light converging lens group 7, an optical fiber collimator 8, a spectrometer 9 and a processor 10.
A light source device 1 for generating illumination light to be irradiated to a target object 3 to be imaged. The object to be imaged in the embodiment of the application is an object composed of a fluorescent material or an object decorated by using the fluorescent material.
The excitation light converging lens group 2 is used for changing the optical path of the excitation light emitted by the object to be imaged 3 after absorbing the irradiation light, and in the embodiment of the application, the excitation light converging lens group is used for converging the light beam of the excitation light emitted by the object to be imaged to form a tighter light beam.
And the slit device 4 is used for adjusting the luminous flux of the excitation light and blocking the light which is stray from the outside.
The long-wave pass filter 5 is used for filtering the excitation light with the light path adjusted by the excitation light converging lens group, filtering the mixed irradiation light in the excitation light, and generating filtering treatment light.
And the digital micro-mirror device 6 receives the random matrix data of 0-1 sent by the processor, and independently reflects the light for filtering treatment to two directions according to the random matrix data, wherein the light reflected by the micro-mirror corresponding to 1 is the reflected light which needs to be treated by the application.
The reflected light converging lens group 7 is used for changing the optical path of the radiated light so that the beam of the reflected light can be converged into a more compact beam and then irradiated to the optical fiber collimator 8.
And the optical fiber collimator 8 is used for carrying out collimation treatment on the received light to generate a collimated light signal, and transmitting the collimated light signal to the spectrometer through an optical fiber.
And the spectrometer 9 is used for carrying out spectrum analysis on the received optical signals to obtain spectrum data.
The processor 10 is configured to control the whole system, and includes receiving an image acquisition instruction input from the outside, generating an irradiation start instruction according to the received image acquisition instruction, sending the irradiation start instruction to the light source device, acquiring random matrix data from the storage device according to the image acquisition instruction, sending the random matrix data to the digital micromirror device, reconstructing the received spectrum data to generate reconstructed image data, and performing fusion processing on the generated reconstructed image data to obtain image data of the object to be imaged.
The spectral imaging method provided by the embodiment of the present application is described in detail below based on the spectral imaging system provided by the embodiment of the present application, and fig. 2 is a flowchart of the spectral imaging method provided by the embodiment of the present application, and as shown in the drawing, the method includes the following steps:
step 101, the processor sends an irradiation start instruction to the light source device according to an externally input image acquisition instruction.
Specifically, the external input image capturing instruction may be input by pressing a button connected to the processor, or by inputting an image capturing instruction on an input device connected to the processor. When the processor receives the image acquisition instruction, an irradiation start instruction is generated according to the image acquisition instruction, and the irradiation start instruction is sent to a light source device which is in wired and/or wireless connection with the processor.
Step 102, the light source device emits irradiation light to the target object to be imaged according to the irradiation start instruction.
Specifically, the light source device receives the illumination start instruction sent by the processor, turns on illumination, and emits illumination light. In a preferred embodiment of the present application, the light source device is a laser emitting device, and the irradiation light emitted by the light source device is continuous laser with a wavelength of 405 nm.
Step 103, the object to be imaged absorbs the irradiation light and emits excitation light.
In particular, the object to be imaged is an object composed of a plurality of fluorescent materials, or an object decorated with a plurality of different fluorescent materials. The fluorescent material of the object to be imaged absorbs the irradiation light to emit excitation light. Since the object to be imaged is an object composed of or decorated with a plurality of fluorescent materials, the excitation light emitted therefrom includes excitation light of different wavelengths. The composition of light of each wavelength in the excitation light is determined by the type of fluorescent material. In a specific example of a preferred embodiment of the present application, the fluorescent material constituting the object to be imaged or decorating the object to be imaged includes a second number of different fluorescent materials.
Step 104, the excitation light passes through the excitation light converging lens group and the slit device and irradiates the long-wave pass filter.
Specifically, the excitation light converging lens group receives excitation light of an object to be imaged, changes a light path of the excitation light, adjusts luminous flux through the slit device, and irradiates the long-wave pass filter. The excitation light in the embodiment of the application is similar to a beam of parallel light, and after passing through the excitation light converging lens group, the excitation light is changed into a beam of converging parallel light with smaller cross section diameter.
In a preferred embodiment of the present application, the excitation light converging lens group includes a first lens and a second lens, and the excitation light irradiates the long-wave pass filter after passing through the excitation light converging lens group and the slit device specifically includes:
firstly, focusing the passed excitation light by a first lens to obtain focused light focused at a slit of a slit device; secondly, the slit device adjusts the light flux of the passing focused light according to the preset light flux to obtain light flux adjusting light; finally, the second lens performs light path adjustment treatment on the received light flux adjustment light and irradiates the light to the long-wave pass filter.
Step 105, the long-wave pass filter performs a filtering process on the received excitation light to generate a filtered light.
Specifically, the long-wave-pass filter chip is selected to correspond to the wavelength of the irradiation light emitted by the light source device because the irradiation light is reflected by the object to be measured while the object to be measured emits the excitation light. The long-wave pass filter capable of filtering the irradiation light emitted by the light source device is selected, and the function of the long-wave pass filter is to filter the irradiation light carried in the excitation light and the reflected light of the irradiation light reflected by the object to be imaged. In a preferred scheme of the embodiment of the application, a long-wave pass filter capable of filtering laser with the wavelength of 405 nanometers is selected and used for filtering 405 nanometer irradiation light emitted by a light source device and 405 nanometer reflected light with the wavelength after the object to be imaged reflects the irradiation light. The excitation light is filtered through a long-wave pass filter to generate filtered treatment light.
At step 106, the digital micromirror sequentially generates a first amount of reflected light based on the sequentially loaded first amount of random matrix data and the received filtered processed light.
Specifically, the digital micromirror device of the embodiment of the application is composed of 1024×768 micromirrors. These micromirrors reflect light independently into two directions "0" and "1", where "0" and "1" occur at-12 ° and +12° of the micromirror, respectively. After receiving the image acquisition instruction, the processor acquires a first number of 0-1 random matrix data corresponding to the digital micro-mirror device from a storage unit of the processor and sequentially sends the first number of 0-1 random matrix data to the digital micro-mirror device according to a preset time interval. The digital micromirror device performs micromirror adjustment according to the received random matrix data so that it generates reflected light in the direction of "1". Since the first number of random matrices sequentially transmitted by the processor is different, the digital micromirror sequentially generates a first number of different reflected lights in accordance with the received different random matrix data. In a preferred version of the embodiment of the application, the first number is 2468.
In step 107, the fiber collimator collects the received first quantity of reflected light through the reflected light converging lens group.
Specifically, the reflected light generated by the reflection of the digital micromirror device is collected by the reflected light converging lens group and converged into the optical fiber collimator. The reflected light is reflected by the digital micromirror device and can be regarded as a similar parallel light beam, and after passing through the reflected light converging lens group, the similar parallel light beam which can be received by the optical fiber collimator is generated.
And step 108, the optical fiber collimator sequentially collimates the sequentially received first quantity of reflected light to generate a first quantity of collimated light signals.
Specifically, the optical fiber collimator performs collimation treatment on the received reflected light to generate a collimated light signal. Since the optical fiber collimator receives the first quantity of reflected light continuously, the optical fiber collimator also performs collimation treatment on the received reflected light continuously, and outputs collimated light signals to the optical fiber continuously. The collimated light signal is then transmitted through an optical fiber to the spectrometer.
In step 109, the spectrometer performs a spectral measurement process on the received first number of collimated light signals to obtain a first number of first spectral data, and sends the first number of first spectral data to the processor.
Wherein the first spectral data comprises a second number of peaks.
Specifically, the spectrometer performs spectrum measurement processing on the received collimated light signal to obtain first spectrum data corresponding to the collimated light. In the embodiment of the application, since the object to be imaged is composed of or decorated with the second number of fluorescent materials, the first spectrum data obtained after the spectrometer receives the received collimated light for spectral measurement includes the second number of peaks. The spectrometer analyzes the received first quantity of different collimated light signals, obtains first quantity of first spectrum data through processing, and sequentially sends the first quantity of first spectrum data to the processor in turn, or packages the first quantity of spectrum data into a data packet and sends the data packet to the processor.
In the embodiment of the application, the spectrum range of the spectrometer is 200-1100 nanometers, the spectrum resolution is 1.4 nanometers, and the minimum integration time is 10 mu s.
In step 110, the processor determines a second number of sets of vertical data from a second number of peak data in the first number of first spectral data.
Specifically, because the first number of different random matrixes are loaded on the digital micromirror device, the excitation light of different parts of the object to be measured is reflected, and then is collected by the optical fiber collimator through the reflected light converging lens group and transmitted to the spectrometer, so that the first number of collimated light signals collected by the spectrometer comprise different parts of the object to be measured. For example, an N-random matrix a will be loaded onto the digital micromirror device, and the first spectral data line y corresponding to N is analyzed by the spectrometer. The random matrix a and the spectral data y constitute a linear equation:
y(λ)＝A(x)t(x，λ) (1)
where λ represents the wavelength, and where t (x, λ) is the wavelength λ, the transmission function of the object, x is the two-dimensional coordinates of the image on the digital micromirror device. The measurement matrix a is independent of λ because the reflection of the digital micromirror is uniform for each wavelength in the 400-760nm operating range. Thus, objects of different wavelengths can be imaged separately using the intensity of each wavelength in the spectral line and the corresponding measurement matrix.
In a preferred embodiment of the present application, the object is imaged by selecting the wavelengths of the second number of peaks. Thus, the processor determines a second number of sets of vertical data from a second number of peak data in the first number of first spectral data. For example, in a specific example, where the second number is 2 and the first spectral data peak occurs at a wavelength position of 468 nm and 636 nm, respectively, then the determined 2 sets of vertical data are a data set consisting of the first number of spectral data values at 468 nm and the first number of spectral data values at 636 nm, respectively.
In step 111, the processor invokes a preset compressed sensing algorithm to perform image reconstruction processing on the second number of sets of vertical data, so as to obtain a second number of reconstructed image data.
Specifically, the processor acquires a preset compressed sensing algorithm, and performs image reconstruction processing on the second number of sets of vertical data by using the preset compressed sensing algorithm to obtain second number of reconstructed image data.
In a preferred scheme of the embodiment of the application, a full-variation augmentation Lagrangian alternating direction algorithm (Total variation Augmented Lagrangian Alternating Direction Algorithm, TVAL 3) is selected to reconstruct the image of the second number of sets of vertical data. In one specific example of an embodiment of the present application, the reconstructed image at 468 nm and the reconstructed image at 636 nm are obtained by reconstruction.
In step 112, the processor performs fusion processing on the second number of reconstructed image data to obtain image data of the object to be imaged.
Specifically, the processor performs fusion processing on the second number of reconstructed image data by adopting a plurality of image fusion algorithms in the prior art, so as to obtain image data of the object to be imaged.
In a preferred scheme of the embodiment of the application, the processor performs fusion processing on the second number of reconstructed image data, and the generation of the image data of the object to be imaged is specifically as follows: firstly, the processor obtains a second number of first pixel values according to the pixel values of the first pixel points of each reconstructed image data in the second number of reconstructed image data; secondly, the processor adds the second number of first pixel values to obtain a first fused pixel value corresponding to the first pixel point; and finally, the processor generates image data of the object to be imaged according to the first fusion pixel value corresponding to each first pixel point.
In step 113, the processor image data is sent to a display device for displaying an image corresponding to the image data.
Specifically, in a preferred embodiment of the present application, the processor transmits the image data to a display device, such as a liquid crystal display, which is in data connection with the processor. The display device displays an image corresponding to the image data on a screen.
According to the spectrum imaging method and system provided by the embodiment of the application, a large amount of data of spectrum imaging is usually highly compressible and remarkable characteristics, under the condition of no mechanical scanning, spatial resolution is provided by utilizing DMD modulation, meanwhile, a first amount of spectrum data is obtained by a method for obtaining spectrum data in a wavelength range of a spectrometer, then image reconstruction processing is carried out on the first amount of spectrum data comprising a second amount of peaks by a preset compressed sensing reconstruction method, a second amount of reconstructed image data is obtained, fusion processing is carried out on the reconstructed image data, finally, image data of an object to be imaged is obtained, and image display is carried out on corresponding display equipment.
Those of skill would further appreciate that the various illustrative elements and algorithm steps described in connection with the embodiments disclosed herein may be implemented as electronic hardware, computer software, or combinations of both, and that the various illustrative elements and steps are described above generally in terms of function in order to clearly illustrate the interchangeability of hardware and software. Whether such functionality is implemented as hardware or software depends upon the particular application and design constraints imposed on the solution. Skilled artisans may implement the described functionality in varying ways for each particular application, but such implementation decisions should not be interpreted as causing a departure from the scope of the present application.
The steps of a method or algorithm described in connection with the embodiments disclosed herein may be embodied in hardware, in a software module executed by a processor, or in a combination of the two. The software modules may be disposed in Random Access Memory (RAM), memory, read Only Memory (ROM), electrically programmable ROM, electrically erasable programmable ROM, registers, hard disk, a removable disk, a CD-ROM, or any other form of storage medium known in the art.
The foregoing detailed description of the application has been presented for purposes of illustration and description, and it should be understood that the application is not limited to the particular embodiments disclosed, but is intended to cover all modifications, equivalents, alternatives, and improvements within the spirit and principles of the application.
Claims (7)
1. A method of spectral imaging, the method comprising: the processor sends an irradiation starting instruction to the light source equipment according to an externally input image acquisition instruction;
the light source equipment emits irradiation light to a target object to be imaged according to the irradiation starting instruction;
the target object to be imaged absorbs the irradiation light and emits excitation light; wherein the object to be imaged is composed of or decorated with a second number of different fluorescent materials;
the excitation light passes through the excitation light converging lens group and the slit device and irradiates to the long-wave pass filter;
the long-wave pass filter performs filtering treatment on the received excitation light to generate filtering treatment light;
the digital micromirror device sequentially generates a first quantity of reflected light according to the sequentially loaded first quantity of random matrix data and the received light filtering processing light;
the optical fiber collimator collects the received first quantity of reflected light through the reflected light converging lens group;
the optical fiber collimator sequentially collimates the first quantity of reflected light received in sequence to generate a first quantity of collimated light signals, and the first quantity of collimated light signals are transmitted to the spectrometer through optical fibers;
the spectrometer performs spectrum measurement processing on the received first number of collimated light signals to obtain first number of first spectrum data, and sends the first number of first spectrum data to the processor; wherein the first spectral data comprises a second number of peaks;
the processor determining a second number of sets of vertical data from a second number of peak data in the first number of first spectral data;
the processor invokes a preset compressed sensing algorithm to carry out image reconstruction processing on the second number of sets of vertical data to obtain second number of reconstructed image data;
the processor performs fusion processing on the second number of reconstructed image data to obtain image data of the object to be imaged;
the processor invokes a preset compressed sensing algorithm to reconstruct the image of the second number of sets of vertical data, and the second number of reconstructed image data is specifically obtained by:
the processor calls a TVAL3 algorithm to respectively carry out image reconstruction processing on each group of vertical data of the second number of groups of vertical data to obtain a second number of different reconstructed image data;
the processor performs fusion processing on the second number of reconstructed image data, and the generation of the image data of the object to be imaged specifically includes:
the processor obtains a second number of first pixel values according to the pixel values of the first pixel points of each reconstructed image data in the second number of reconstructed image data;
the processor adds the second number of the first pixel values to obtain a first fused pixel value corresponding to the first pixel point;
and the processor generates image data of the object to be imaged according to the first fusion pixel value corresponding to each first pixel point.
2. The spectroscopic imaging method as set forth in claim 1 wherein the first number is 2468.
3. The spectral imaging method according to claim 1, wherein the excitation light converging lens group includes a first lens and a second lens, and the excitation light passes through the excitation light converging lens group and the slit device and irradiates the long-wave pass filter specifically:
the first lens focuses the passed excitation light to obtain focused light focused at a slit of the slit device;
the slit device adjusts the light flux of the passing focused light according to the preset light flux to obtain light flux adjusting light;
and the second lens performs light path adjustment treatment on the received light flux adjustment light and irradiates the light flux adjustment light to the long-wave pass filter.
4. The spectral imaging method of claim 1, wherein the digital micromirror sequentially generating a first number of reflected lights from a sequentially loaded first number of random matrix data and the received filter processing lights is specifically:
the processor acquires a first number of random matrix data from the storage unit according to the image acquisition instruction;
the processor sequentially transmits the random matrix data to the digital micromirror device according to a preset time interval;
and the digital micromirror device adjusts the reflecting element according to each piece of random matrix data, and reflects the received light subjected to the light filtering treatment to obtain a first quantity of reflected light.
5. The spectral imaging method of claim 1, wherein after the fiber collimator sequentially collimates the sequentially received first quantity of the reflected light to generate a first quantity of collimated light signals, the method further comprises: the collimated light signal is transmitted to the spectrometer via an optical fiber.
6. The spectroscopic imaging method as set forth in claim 1, wherein after obtaining the image data of the object to be imaged, the method further comprises: the processor sends the image data to a display device for displaying an image corresponding to the image data.
7. A spectral imaging system, the system comprising: the device comprises a processor, a light source device, an excitation light converging lens group, a slit device, a long-wave pass filter, a digital micromirror device, a reflected light converging lens group, an optical fiber collimator and a spectrometer;
the processor is used for sending an irradiation starting instruction to the light source equipment according to an externally input image acquisition instruction;
the light source device is used for emitting irradiation light to the target object to be imaged according to the irradiation starting instruction; the target object to be imaged absorbs the irradiation light and emits excitation light; wherein the object to be imaged is composed of or decorated with a second number of different fluorescent materials;
the excitation light passes through the excitation light converging lens group and the slit device and irradiates to the long-wave pass filter;
the long-wave pass filter is used for generating light filtering treatment light after the received excitation light is subjected to light filtering treatment;
the digital micromirror device is used for sequentially generating a first quantity of reflected light according to the sequentially loaded first quantity of random matrix data and the received light filtering processing light;
the optical fiber collimator is used for collecting the received first quantity of reflected light through the reflected light converging lens group; sequentially collimating the sequentially received first quantity of reflected light to generate a first quantity of collimated light signals;
the spectrometer is used for carrying out spectrum measurement processing on the received first number of collimated light signals to obtain first number of first spectrum data, and sending the first number of first spectrum data to the processor; wherein the first spectral data comprises a second number of peaks;
the processor is further configured to determine a second number of sets of vertical data from a second number of peak data in the first number of first spectral data;
the processor is further used for calling a preset compressed sensing algorithm to perform image reconstruction processing on the second number of sets of vertical data to obtain second number of reconstructed image data;
the processor is further configured to perform fusion processing on the second number of reconstructed image data to obtain image data of the object to be imaged;
the method comprises the steps of calling a preset compressed sensing algorithm to reconstruct the second number of groups of vertical data, wherein the second number of reconstructed image data is specifically:
invoking a TVAL3 algorithm to respectively carry out image reconstruction processing on each group of vertical data of the second number of groups of vertical data to obtain a second number of different reconstructed image data;
the fusing processing is performed on the second number of reconstructed image data, and the obtaining of the image data of the object to be imaged specifically includes:
obtaining a second number of first pixel values according to the pixel values of the first pixel points of each reconstructed image data in the second number of reconstructed image data;
adding the second number of the first pixel values to obtain a first fused pixel value corresponding to the first pixel point;
and generating image data of the object to be imaged according to the first fusion pixel value corresponding to each first pixel point.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010605498.XA CN111721718B (en) | 2020-06-29 | 2020-06-29 | Spectral imaging method and system |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010605498.XA CN111721718B (en) | 2020-06-29 | 2020-06-29 | Spectral imaging method and system |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111721718A CN111721718A (en) | 2020-09-29 |
| CN111721718B true CN111721718B (en) | 2023-09-01 |
Family
ID=72569689
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010605498.XA Active CN111721718B (en) | 2020-06-29 | 2020-06-29 | Spectral imaging method and system |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111721718B (en) |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103575396A (en) * | 2013-11-19 | 2014-02-12 | 中国科学院空间科学与应用研究中心 | Imaging spectral system and method based on compressed sensing and Hadamard transformation |
| CN103925999A (en) * | 2014-05-06 | 2014-07-16 | 中山大学 | Image spectrum detection method and system |
| CN106092891A (en) * | 2016-08-11 | 2016-11-09 | 广东工业大学 | A kind of confocal three-dimensional spectrum micro imaging method and device |
| CN107942338A (en) * | 2017-09-28 | 2018-04-20 | 北京华航无线电测量研究所 | A kind of multi-wavelength relevance imaging system based on Digital Micromirror Device |
| CN108955887A (en) * | 2018-07-10 | 2018-12-07 | 北京理工大学 | Full polarization EO-1 hyperion compressed sensing imaging system and method based on LCTF |
| CN110044481A (en) * | 2019-04-11 | 2019-07-23 | 南昌大学 | A kind of system and method compressing EO-1 hyperion micro-imaging |
| CN110793633A (en) * | 2019-11-14 | 2020-02-14 | 北京理工大学 | Single-pixel multispectral calculation imaging system and imaging method based on bundled optical fibers |
| CN111257299A (en) * | 2020-02-19 | 2020-06-09 | 南京工业大学 | Coded imaging Raman spectrometer and method based on DMD |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN104054266B (en) * | 2011-10-25 | 2016-11-23 | 中国科学院空间科学与应用研究中心 | A kind of time resolution single photon or pole low light level multiplanar imaging spectroscopic system and method |
| US10282630B2 (en) * | 2017-03-08 | 2019-05-07 | Raytheon Company | Multi-channel compressive sensing-based object recognition |
-
2020
- 2020-06-29 CN CN202010605498.XA patent/CN111721718B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103575396A (en) * | 2013-11-19 | 2014-02-12 | 中国科学院空间科学与应用研究中心 | Imaging spectral system and method based on compressed sensing and Hadamard transformation |
| CN103925999A (en) * | 2014-05-06 | 2014-07-16 | 中山大学 | Image spectrum detection method and system |
| CN106092891A (en) * | 2016-08-11 | 2016-11-09 | 广东工业大学 | A kind of confocal three-dimensional spectrum micro imaging method and device |
| CN107942338A (en) * | 2017-09-28 | 2018-04-20 | 北京华航无线电测量研究所 | A kind of multi-wavelength relevance imaging system based on Digital Micromirror Device |
| CN108955887A (en) * | 2018-07-10 | 2018-12-07 | 北京理工大学 | Full polarization EO-1 hyperion compressed sensing imaging system and method based on LCTF |
| CN110044481A (en) * | 2019-04-11 | 2019-07-23 | 南昌大学 | A kind of system and method compressing EO-1 hyperion micro-imaging |
| CN110793633A (en) * | 2019-11-14 | 2020-02-14 | 北京理工大学 | Single-pixel multispectral calculation imaging system and imaging method based on bundled optical fibers |
| CN111257299A (en) * | 2020-02-19 | 2020-06-09 | 南京工业大学 | Coded imaging Raman spectrometer and method based on DMD |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111721718A (en) | 2020-09-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US8310669B2 (en) | Spectroscopic imaging method and system for exploring the surface of a sample | |
| US7564541B2 (en) | System for obtaining images in bright field and crossed polarization modes and chemical images in raman, luminescence and absorption modes | |
| CN109416321B (en) | Hyperspectral confocal microscope based on spatial light modulator and use method thereof | |
| CN111650180B (en) | Raman spectrum imaging system based on signal coding and space compression | |
| US10481092B2 (en) | Multiplexed excitation emission matrix spectroscopy | |
| JP7538624B2 (en) | Time-resolved hyperspectral single-pixel imaging | |
| JPH11249023A (en) | Confocal spectral system and spectral method | |
| JP7190561B2 (en) | Raman spectrometer | |
| CN109196333A (en) | System and method for 4-D hyperspectral imaging | |
| JP2006071611A (en) | Fluorescence microscope, and fluorescence correlated spectroscopic analyzer | |
| US7554659B2 (en) | Hyperspectral visible absorption imaging of molecular probes and dyes in biomaterials | |
| CN109632735B (en) | Optical super-resolution microscopic imaging system and imaging method | |
| JP2013546000A (en) | Image map spectroscopic polarization | |
| JP3757854B2 (en) | Method and apparatus for analyzing sample containing a plurality of fluorescent substances | |
| JP5424108B2 (en) | Raman imaging equipment | |
| CN111721720B (en) | Spectral imaging system | |
| JP2004526962A (en) | Spectroscopic device and method | |
| CN114279564A (en) | Parallel compressed sensing computed tomography spectrometer and imaging spectrum reconstruction method thereof | |
| CN115248498A (en) | Structured light super-resolution self-adaptive microscope device based on LED light source and imaging method | |
| CN111855639B (en) | Spectrum acquisition system and spectrum acquisition method | |
| JP2012047502A (en) | Spectroscopic image acquisition device and method | |
| CN111721718B (en) | Spectral imaging method and system | |
| CN116249891A (en) | Method for detecting emitted light, detection device and laser scanning microscope | |
| RU2579640C1 (en) | Confocal image spectrum analyser | |
| CN117007187A (en) | Broad spectrum microscopic Raman ghost imaging device and imaging method based on structured light illumination |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |