CN107807091B - Compressed sensing imaging device and method - Google Patents

Compressed sensing imaging device and method Download PDF

Info

Publication number
CN107807091B
CN107807091B CN201711222571.XA CN201711222571A CN107807091B CN 107807091 B CN107807091 B CN 107807091B CN 201711222571 A CN201711222571 A CN 201711222571A CN 107807091 B CN107807091 B CN 107807091B
Authority
CN
China
Prior art keywords
light
psf
unit
light source
air
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201711222571.XA
Other languages
Chinese (zh)
Other versions
CN107807091A (en
Inventor
黄帆
韩捷飞
初宁
蔡栋
龙涛
邹诚
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Jiaoshi Intelligent Technology Co ltd
Original Assignee
Suzhou Jiaoshi Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Jiaoshi Intelligent Technology Co ltd filed Critical Suzhou Jiaoshi Intelligent Technology Co ltd
Priority to CN201711222571.XA priority Critical patent/CN107807091B/en
Publication of CN107807091A publication Critical patent/CN107807091A/en
Application granted granted Critical
Publication of CN107807091B publication Critical patent/CN107807091B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01VGEOPHYSICS; GRAVITATIONAL MEASUREMENTS; DETECTING MASSES OR OBJECTS; TAGS
    • G01V8/00Prospecting or detecting by optical means
    • G01V8/10Detecting, e.g. by using light barriers

Abstract

The invention discloses a compressed sensing imaging device and a method, wherein the imaging device comprises a carrier, a PSF measuring system and an imaging system which are positioned on the carrier, the PSF measuring system is arranged, a first light beam emitted by a first light source passes through air/water body and is received by a first photoelectric detection unit to obtain energy distribution information of a light spot influenced by PSF, a PSF calculating unit calculates a spectrum value of the PSF of the air/water body under a specific distance according to the energy distribution of the light spot emitted by the first light source and the energy distribution information of the light spot imaging detected by the first photoelectric detection unit, a central processing unit calculates a spectrum value of the PSF of the air/water body corresponding to the imaging unit, and a micromirror in a spatial light modulator is adjusted according to the spectrum value, so that the light intensity distribution projected onto a detection target is the same as an original modulation matrix, and the influence of the PSF is inhibited.

Description

Compressed sensing imaging device and method
Technical Field
The invention relates to the field of target detection, identification and imaging, in particular to a compressed sensing imaging device and method.
Background
Correlation imaging (correlated imaging), also known as ghost imaging (ghOSimaging), is a novel imaging technique that can delocally acquire target image information by intensity correlation operations between a reference light field and a target detection light field based on quantum or classical correlation characteristics of light field fluctuations. However, the conventional correlated imaging has the problems of more sampling times, long imaging time and complex system structure, and is not suitable for imaging in complex and changeable environments. The compressed sensing (Compressive Sensing) technology is a brand new signal sampling technology which appears in recent years, and is different from the traditional nyquist sampling theorem, the technology completes the compression process and the sampling process of the signal synchronously, namely, high-dimensional original signals are projected onto a low-dimensional space through an observation matrix, and the high-probability original signals are reconstructed by solving an optimization problem through a small number of projection parameters. The technology can effectively improve the signal sampling efficiency and reduce the signal processing time and the calculation cost.
The associated imaging technology based on compressed sensing can effectively overcome the problems of detection time and system complexity of the traditional associated imaging technology. In severe weather or underwater environment, the technology still adopts a single-pixel detector as a receiving core device, so that the photoelectric conversion efficiency is high, the gain is high, the response speed is high, and the technology is very suitable for detection in a weak light environment. Since the signal with spatial resolution is not received by the photodetector, but the total light intensity value in the field of view is not easily interfered by impurities in the environment. In addition, the reference arm is replaced by a device with a modulation function, so that the complexity and the volume of the system are greatly reduced, and the environment adaptability and the stability of the system are greatly improved.
In the compressed sensing process, the more accurate the modulation of the light intensity distribution is, the closer the modulation distribution pattern when the target is irradiated to the original modulation pattern is, and the more accurate the finally reconstructed image is. However, due to the PSF of the medium, the light intensity distribution when reaching the target differs significantly from the preset modulation pattern, as shown in fig. 1a-1b, respectively the preset modulation pattern and the light intensity distribution when reaching the target. And as the imaging distance increases, the PSF is more affected, so that in order to reduce the negative influence of the environment on image reconstruction, the PSF of the air/water needs to be grasped in real time, and the spatial light modulator or the modulation matrix is readjusted so that the light intensity distribution when reaching the target is the same as the preset modulation pattern.
However, the particle situation included in the actual environment is often very complex and varies with time, and the existing theoretical model of PSF cannot completely express the PSF parameter of the environment where the actual system is located.
Disclosure of Invention
The invention provides a compressed sensing imaging device and a method thereof, which are used for solving the problems of low image reconstruction precision, and reduced imaging distance and imaging quality caused by the influence of PSF in severe weather conditions or water in the prior art.
In order to solve the technical problems, the technical scheme of the invention is as follows: a compressed sensing imaging apparatus comprising: a carrier, and a PSF measurement system and an imaging system located on the carrier:
the PSF measurement system comprises a first light source, a first photoelectric detection unit and a PSF calculation unit, wherein the first photoelectric detection unit is connected with the PSF calculation unit, an air/water environment is arranged between the first light source and the first photoelectric detection unit, a first light beam emitted by the first light source enters the first photoelectric detection unit after passing through the air/water, the divergence angle of the first light beam is smaller than 5mrad, and the first photoelectric detection unit is an area array detector;
the imaging system comprises a second light source, a spatial light modulator, a projection system, a second photoelectric detection unit and a central processing unit, wherein the second light source, the spatial light modulator, the projection system, the detection target, the second photoelectric detection unit and the central processing unit are sequentially arranged along a light path, and the central processing unit is respectively connected with the PSF calculation unit and the spatial light modulator.
Further, the PSF measurement system further comprises a first beam shaping device, and the first beam passes through the first beam shaping device to form a circular light spot with uniform energy distribution.
Further, the main optical axis of the first light beam is perpendicular to the detection surface of the first photoelectric detection unit.
Further, the PSF measurement system is located in front of the carrier, and the traveling direction of the first light beam is the same as the traveling direction of the second light beam emitted by the second light source projected onto the detection target.
Further, the first light source and the second light source are monochromatic light sources with the same wavelength.
Further, the second light source is a broad spectrum light source, a wavelength selection unit is further arranged behind the light path of the broad spectrum light source, the light beams emitted by the broad spectrum light source comprise monochromatic light with different multiple wave bands, the first light source comprises monochromatic light sources with different multiple wave bands corresponding to the monochromatic light with different multiple wave bands one by one, the wavelength selection unit and the monochromatic light sources with different multiple wave bands are connected to the central processing unit, and the first photoelectric detection unit receives light rays emitted by the monochromatic light sources with different multiple wave bands respectively.
Furthermore, the first light source and the second light source adopt the same monochromatic light source array formed by a plurality of monochromatic light sources with different wave bands, a light splitting unit is arranged behind the monochromatic light source array along a light path, and light rays emitted by each monochromatic light source respectively form a first light beam and a second light beam after passing through the light splitting unit.
The invention also provides an imaging method of the compressed sensing imaging device, which comprises the following steps:
s1: measuring a distance R traveled by the first light beam in the air/water body and a distance R traveled by the second light beam in the air/water body when the second light beam is projected onto the detection target;
s2: the method comprises the steps of turning on a first light source to emit a first light beam, firstly detecting energy distribution information of an original light spot of the first light source, enabling the first light beam to enter a first photoelectric detection unit for detection after passing through air/water, and sending the energy distribution information of the detected light spot to a PSF calculation unit by the first photoelectric detection unit;
s3: the PSF calculation unit calculates the spectrum value of the PSF of the air/water body at the distance r according to the energy distribution of the original light spot and the energy distribution information of the light spot detected by the first photoelectric detection unit, and sends the calculated spectrum value of the PSF to the central processing unit;
s4: the central processing unit calculates a spectrum value of a PSF under a distance R through an MTF formula under a meter scattering condition, and adjusts the spatial light modulator according to the spectrum value of the PSF so that the light intensity distribution reaching a detection target is the same as a preset modulation matrix; wherein, the MTF formula under the meter scattering condition is:
wherein, MTF a For the actual MTF value, S a And A a Finite dispersion of impurity particles to lightCoefficient of emission and absorption, v c Is the cut-off frequency of impurity particles, R is the optical path;
s5: the second light source emits a second light beam, the second light beam is modulated by the spatial light modulator and then projected onto the detection target through a projection system, and the light reflected by the detection target is received by the second photoelectric detection unit;
s6: the second photoelectric detection unit receives the light reflected by the detection target and transmits the light to the central processing unit, and the central processing unit performs association operation according to a preset modulation matrix of the spatial light modulator and detection information of the second photoelectric detection unit to obtain an imaging result.
Further, in the step S3, the PSF calculating unit calculates a spectrum value of the PSF of the air/water body at the distance r, including the steps of:
s31: performing Fourier transform on the energy distribution of the light spot detected by the first photoelectric detection unit to obtain a frequency spectrum of the detected light spot, and performing Fourier transform on the energy distribution of the original light spot of the first light source to obtain a frequency spectrum of the original light spot;
s32: and performing point division operation on the spectrum of the detected light spot and the spectrum of the original light spot to obtain a PSF spectrum value of the air/water body corresponding to the distance r.
Further, in the step S4, the step of the central processing unit adjusting the spatial light modulator is as follows:
s41: measuring divergence angle of the second light beam in the air/water body and distance R between the detection target and the second light source 1
S42: based on the size of one pixel of the modulation matrix modulated on the spatial light modulator irradiated by the second light source and the measured divergence angle and distance R 1 Calculating to obtain the size of a pixel unit in the modulated light spot at the detection target, wherein the size is used as the size of the pixel unit of the light spot after the PSF of the air/water body influences;
s43: deconvolution operation is carried out on the size of the pixel unit of the light spot affected by the PSF of the air/water body and the spectrum value of the PSF at the corresponding distance to obtain the size of the pixel unit of the light spot unaffected by the air/water body;
s44: obtaining the size of a pixel unit in a modulation matrix on the spatial light modulator by utilizing the object-image relationship;
s45: the central processing unit controls a number of micromirrors corresponding to the size of one pixel unit to react as one pixel unit according to the size of the pixel unit in the modulation matrix on the spatial light modulator, so that the light intensity distribution reaching the detection target is the same as the preset modulation matrix.
The invention also provides an imaging method of the compressed sensing imaging device, which comprises the following steps:
s1: measuring a distance R traveled by the first light beam in the air/water body and a distance R traveled by the second light beam in the air/water body when the second light beam is projected onto the detection target;
s2: the method comprises the steps of turning on a first light source to emit a first light beam, firstly detecting energy distribution information of an original light spot of the first light source, enabling the first light beam to enter a first photoelectric detection unit for detection after passing through air/water, and sending the energy distribution information of the detected light spot imaging to a PSF calculation unit by the first photoelectric detection unit;
s3: the PSF calculation unit calculates the spectrum value of the PSF of the air/water body at the distance r according to the energy distribution of the original light spot sent by the first light source and the energy distribution information of the received light spot imaging, and sends the calculated spectrum value of the PSF to the central processing unit;
s4: the central processing unit calculates a spectrum value of the PSF of the air/water body under the distance R through an MTF formula under the meter scattering condition, performs inverse Fourier transform on the spectrum value of the PSF of the air/water body under the distance R to obtain a PSF value of the air/water body, and then performs convolution operation on a preset modulation matrix of the spatial modulation unit and the PSF value to obtain a new modulation matrix; wherein, the MTF formula under the meter scattering condition is:
wherein, MTF a For the actual MTF value, S a And A a Representing the finite scattering and absorption coefficient of the impurity particles for light, v c Is the cut-off frequency of impurity particles, R is the optical path;
s5: the second light source emits a second light beam, the second light beam is modulated by the spatial light modulator and then projected onto the detection target, and the light reflected by the detection target is received by the second photoelectric detection unit;
s6: the second photoelectric detection unit receives the light reflected by the detection target and transmits the light to the central processing unit, and the central processing unit performs association operation according to the new modulation matrix and detection information of the second photoelectric detection unit to obtain an imaging result.
According to the compressed sensing imaging device and method, the PSF measurement system is arranged, the first light beam emitted by the first light source passes through the air/water body and then is received by the first photoelectric detection unit, the energy distribution information of the light spots influenced by the PSF is obtained, the PSF calculation unit calculates the spectrum value of the PSF of the air/water body at a specific distance according to the energy distribution of the light spots emitted by the first light source and the energy distribution information of the light spot imaging detected by the first photoelectric detection unit, the central processing unit calculates the spectrum value of the PSF of the air/water body corresponding to the imaging system, and the micro mirrors in the spatial light modulator are adjusted according to the spectrum value of the PSF, so that the light intensity distribution projected onto a detection target is identical to a preset modulation matrix, and the influence of the PSF is restrained. In addition, the central processing unit can also calculate according to a preset modulation matrix of the spatial light modulator and PSF values of air/water to obtain a new modulation matrix, and apply the new modulation matrix to final correlation operation to obtain an imaging result. The invention can well avoid the influence caused by PSF, and improves the accuracy of the reconstructed image and the final imaging result.
Drawings
FIGS. 1a-1b are, respectively, a modulation pattern on a prior art spatial light modulator and a light intensity profile when a target is reached;
FIG. 2 is a schematic diagram showing a compression sensing imaging apparatus according to embodiment 1 of the present invention;
FIGS. 3 to 5 are schematic views showing three specific structures of the compressed sensing imaging apparatus according to embodiment 1 of the present invention;
FIG. 6 is a schematic diagram showing a structure of a compressed sensing imaging apparatus according to embodiment 3 of the present invention;
FIG. 7 is a schematic diagram showing a structure of a compressed sensing imaging apparatus according to embodiment 4 of the present invention;
the figure shows: 10. a carrier; 20. a PSF measurement system; 210. a first light source; 220. a first photodetection unit; 230. a PSF calculation unit; 240. a first beam shaping device; 260. an optical path turning element;
30. an imaging system; 310. a second light source; 320. a spatial light modulator; 330. a projection system; 340. a second photodetection unit; 350. a central processing unit; 360. a wavelength selection unit; 370. a second beam shaping and collimating unit;
40. detecting a target; 50. and a spectroscopic unit.
Detailed Description
The present invention will be described in detail with reference to the accompanying drawings.
Example 1
As shown in fig. 2-3, the present invention provides a compressed sensing imaging apparatus, comprising: a carrier 10 and a PSF measurement system 20 and an imaging system 30 located on said carrier.
The PSF measurement system 20 includes a first light source 210, a first photo-detection unit 220, and a PSF calculation unit 230, where the first photo-detection unit 220 is connected to the PSF calculation unit 230, a first light beam emitted by the first light source 210 passes through air/water body and then enters the first photo-detection unit 220, the divergence angle of the first light beam is less than 5mrad, that is, the first light beam is guaranteed to have better collimation degree, and a spot light spot with a size as small as possible is formed, so that the spot light spot is better detected by the first photo-detection unit 220, and the measurement accuracy of the PSF is improved. Preferably, the first photo-detecting unit 220 is an area array detector, and can receive the energy distribution of the whole light spot reaching the detection surface of the area array detector, and transmit the received energy distribution of the whole light spot to the PSF calculating unit 230 for directly calculating the PSF value. The PSF measurement system 20 further includes a first beam shaping device 240, and the first beam passes through the first beam shaping device 240 to form a circular light spot with uniform energy distribution. And the first light beam is perpendicular to the detection surface of the first photoelectric detection unit 220, so as to ensure that the first photoelectric detection unit 220 can accurately detect the energy distribution of the light spot. Specifically, an air/water environment is disposed between the first light source 210 and the first photo-detecting unit 220, and a travelling distance r of the first light beam in the air/water is a fixed value and is known. The air herein refers to an air environment of severe weather on land, such as a more severely polluted air environment, such as haze weather, and when the traveling distance r should be increased by a value of, for example, more than 2m for the air environment, the first light source 210 and the first photo detection unit 220 may be disposed on different carriers 10.
The imaging system 30 includes a second light source 310, a spatial light modulator 320, a projection system 330, a second photo-detection unit 340, and a central processing unit 350, where the second light source 310, the spatial light modulator 320, the projection system 330, the detection target 40, the second photo-detection unit 340, and the central processing unit 350 are sequentially arranged along an optical path, and the central processing unit 350 is respectively connected to the PSF calculating unit 230 and the spatial light modulator 320. The second light source 310 is further provided with a second beam shaping and collimating unit 370 along the rear of the light path, for shaping and collimating the second beam to obtain a desired spot. Specifically, the spatial light modulator 320 is a digital micromirror array (DMD) and is composed of a plurality of micromirrors, and the state of each micromirror is controlled according to a set modulation matrix, thereby modulating the light beam. The projection system 330 projects an image of the spatial light modulator 320 onto the detection target 40. Projection system 330 may employ a projection lens, or any other lens, as long as this function is achieved. The second photo-detecting unit 340 employs a single pixel detector.
Fig. 3 is a schematic compact structure, in which the PSF measurement system 20 and the imaging system 30 are closely adjacent, in fig. 3, the PSF measurement system 20 is located above or below the imaging system 30 near a side, a groove is formed on the carrier 10 corresponding to the PSF measurement system 20, the first light source 210 and the first photoelectric detection unit 220 are respectively disposed on two sides of the groove, and an air/water environment is formed in a middle gap, which needs to be explained, when the water environment is aimed, in order to make the first light beam pass through the water, the light outlet of the first light source 210 and the detection surface of the second photoelectric detection unit 340 should be lower than the water surface. However, with this arrangement, when the carrier 10 or the water flow is in a moving state, the front of the carrier 10 tends to block the water flow to cause the fluctuation, and the fluctuation tends to be different from the fluctuation of the front of the carrier 10, that is, the fluctuation potential of the water body in which the PSF measurement system 20 and the imaging system 30 are located is different, so that the PSF measurement is inaccurate, and thus the method can only be suitable for the static state of the air or the water body or the motionless state of the carrier 10. In order to avoid the above-mentioned problems, the PSF measurement system 20 is disposed in front of the carrier 10, and it should be noted that, in front of this point, with respect to the moving direction of the carrier 10 or the outgoing direction of the first beam, as shown in fig. 4, a groove similar to that in fig. 1 is formed by extending outwards in front of the carrier 10, and the first light source 210 and the first photoelectric detection unit 220 are disposed on two sides of the groove, respectively, and the air/water environment is disposed in the middle space, where when the carrier 10 or the air/water flows, the shielding effect is greatly reduced due to the smaller mass of the carrier 10 on the front side, and the fluctuation potential of the air/water where the PSF measurement system 20 and the imaging system 30 are located is considered to be the same. Of course, to avoid blocking of the front carrier 10 as much as possible, the recess may be rotated 90 degrees counterclockwise to allow the PSF measurement system 20 and the imaging system 30 to be in the same air/water environment as shown in fig. 5.
Preferably, the first light source 210 and the second light source 310 are monochromatic light sources with the same wavelength, and in order to ensure the measurement accuracy of the PSF, when the second light source 310 is a monochromatic light source, it is required to ensure that the wavelengths of the first light source 210 and the second light source 310 are the same, and the first light source 210 and the second light source 310 may use a laser with better collimation or other monochromatic light sources with better collimation.
The embodiment also provides an imaging method of the compressed sensing imaging device, which comprises the following steps:
s1: measuring a distance R traveled by the first light beam in the air/water body and a distance R traveled by the second light beam in the air/water body when projected onto the detection target 40; since the PSF value measured by the PSF measurement system 20 is a value for the distance R, however, since the distance R traveled in the air/water body when the second light beam is projected onto the detection target 40 is different from the distance R, a conversion is performed once according to the distance between the two to obtain the corresponding PSF value when imaging, in this embodiment, the measured PSF is mainly the spectral value MTF (Modulation Transfer Function ) of the measured PSF, and if the measured PSF is converted into the PSF value, only the MTF needs to be subjected to inverse fourier transform.
S2: turning on the first light source 210 to emit a first light beam, firstly detecting energy distribution information of an original light spot of the first light source, then enabling the first light beam emitted by the first light source 210 to pass through air/water body and then enter the first photoelectric detection unit 220 to be detected, and sending the energy distribution information of the detected light spot to the PSF calculation unit 230 by the first photoelectric detection unit 220; in this embodiment, the first photoelectric detection unit 220 is an area array detector, such as a CCD or CMOS, and can directly detect the energy distribution of the entire light spot reaching the detection surface, where the energy distribution of the light spot is the energy distribution of the light spot corresponding to the original light spot after the PSF influence. Specifically, the energy distribution of the original light spot of the first light beam needs to be detected before the first light beam enters the air/water body, and the distance between the detection point and the first light source 210 should be the same as the distance traveled in the air when the first light source 210 enters the air/water body, so as to avoid errors, and the detection value is sent to the PSF calculating unit 230, so that the first photoelectric detecting unit 220 may be directly used for detecting for convenience, or other photoelectric detectors may be used for detecting the energy distribution of the original light spot.
S3: the PSF calculating unit 230 calculates a PSF value of the air/water body at a distance r according to the energy distribution of the original light spot of the first light source 210 and the energy distribution information of the light spot detected by the first photoelectric detecting unit 220, and sends the calculated PSF value to the central processing unit 350; specifically, the PSF calculating unit 230 calculates the PSF corresponding to the air/water body, including the steps of:
s31: performing fourier transform on the energy distribution I' (x, y) of the light spot detected by the first photoelectric detection unit 220 to obtain a frequency spectrum of the detected light spot, and performing fourier transform on the energy distribution I (x, y) of the original light spot emitted by the first light source 210 to obtain a frequency spectrum of the original light spot;
s32: performing point division operation on the spectrum of the detected light spot and the spectrum of the original light spot to obtain a spectrum value of the PSF of the air/water body at a distance r, namely MTF; specifically, since I ' (x, y) =i (x, y) ×psf, where×represents a convolution operation, in order to calculate PSF, the above equation needs to be converted from a spatial domain to a frequency domain, that is, F [ I ' (x, y) ] =f [ I (x, y) ], MTF, where F [ ] represents fourier transform, represents a point multiplication operation, MTF is a frequency domain value corresponding to PSF, and mtf=f [ I ' (x, y) ]/F [ I (x, y) ], where/represents a point division operation. The spectral values of the PSF can also be estimated here robustly by spectral wiener filtering techniques, i.e. using a wiener filter as a parameter, such as the reaction air/water turbidity.
S4: the central processing unit 350 calculates a spectrum value of a PSF of the air/water body under the distance R according to an MTF formula under the meter scattering condition, and adjusts the spatial light modulator 320 according to the spectrum value of the PSF so that the light intensity distribution reaching the detection target 40 is the same as a preset modulation matrix; specifically, the influence of severe weather conditions and turbid water conditions on the imaging system is attributed to the influence of rice scattering, and the calculated expression is the same although the media are different. Wherein, the MTF formula under the meter scattering condition is:
wherein, MTF a For the actual MTF value, S a And A a Representing the finite scattering and absorption coefficient of the impurity particles for light, v c Is the cut-off frequency of impurity particles, R is the optical path, the spectral value MTF of PSF corresponding to the distance R calculated in the step S3 is brought into the formula (1) to calculate S a 、A a And v c Of course, it is necessary to change the value of the distance R to a plurality of sets of data, and then sum the distance R and the estimated S a 、A a And v c The value of (2) is substituted into the formula (1) to obtain the MTF value corresponding to the distance R.
The step of the central processing unit 350 adjusting the spatial light modulator 320 is as follows:
s41: measuring the divergence angle of the second light beam in the air/water body and the distance R between the detection target 40 and the second light source 310 1
S42: based on the size of one pixel unit of the modulation matrix modulated on the spatial light modulator 320 irradiated by the second light source 310 and the measured divergence angle and distance R 1 Calculating to obtain the size of a pixel unit in the modulated light spot at the detection target 40, wherein the size is used as the size of the pixel unit of the light spot after the PSF of the air/water body influences;
s43: deconvolution operation is carried out on the size of the pixel unit of the light spot affected by the PSF of the air/water body and the spectrum value of the PSF at the corresponding distance to obtain the size of the pixel unit of the light spot unaffected by the air/water body;
s44: the object-image relationship is used to obtain the size of one pixel unit in the modulation matrix on the spatial light modulator 320, i.e., the ratio of the size of the spot on the detection target 40 that is not affected by the air/water body to the size of one pixel on the spatial light modulator 320 is equal to the image distance (the ratio between the detection target 40 and the projection system 330) and the object distance (the distance between the projection system 330 and the spatial light modulator 320).
S45: the central processing unit 350 controls the number of micromirrors corresponding to the size of one pixel unit as one pixel unit according to the size of the one pixel unit in the modulation matrix on the spatial light modulator 320, so that the light intensity distribution reaching the detection target 40 is the same as the preset modulation matrix.
S5: the second light source 310 emits a second light beam, the second light beam is modulated by the spatial light modulator 320 and then projected onto the detection target 40 by the projection system 330, and the light reflected by the detection target 40 is received by the second photoelectric detection unit 340.
S6: the second photo-detecting unit 340 receives the light reflected by the detection target 40 and transmits the light to the central processing unit 350, and the second photo-detecting unit 340 uses a single-pixel detector to perform an association operation according to a preset modulation matrix of the spatial light modulator 320 and detection information of the second photo-detecting unit 340, so as to obtain an imaging result.
Example 2
Unlike embodiment 1, the imaging method provided in this embodiment includes the steps of:
s1: measuring a distance R that the first light beam needs to travel in the air/water body and a distance R that the second light beam needs to travel in the air/water body when projected onto the detection target 40; since the PSF value measured by the PSF measurement system 20 is a value for the distance R, however, since the distance R traveled in the air/water body when the second light beam is projected onto the detection target 40 is different from the distance R, it is also necessary to perform one conversion according to the distance between the two to obtain the corresponding PSF value at the time of imaging. Similarly, in this embodiment, the measurement of the PSF mainly refers to the measurement of the MTF, and if the PSF is converted into the spectrum value, the MTF is only required to be subjected to inverse fourier transform.
S2: turning on the first light source 210 to emit a first light beam, firstly detecting energy distribution information of an original light spot of the first light beam, then enabling the first light beam to enter the first photoelectric detection unit 220 for detection after passing through air/water, and transmitting the energy distribution information of the detected light spot to the PSF calculation unit 230 by the first photoelectric detection unit 220; in this embodiment, the first photoelectric detection unit 220 is an area array detector, and can directly receive the energy distribution of the whole light spot reaching the detection surface of the detector, that is, the energy distribution of the light spot is the energy distribution of the corresponding light spot after the original light spot is affected by the PSF. The method for detecting the energy distribution of the original light spot is the same as in example 1.
S3: the PSF calculating unit calculates a spectrum value of the PSF of the air/water body at the distance r according to the energy distribution of the original light spot of the first light source 210 and the energy distribution information of the light spot detected by the first photoelectric detecting unit 220, and sends the calculated spectrum value of the PSF to the central processing unit 350;
s4: the central processing unit 350 calculates the spectrum value of the PSF of the air/water body under the distance R according to the MTF formula under the meter scattering condition, performs inverse fourier transform on the spectrum value of the PSF of the air/water body under the distance R to obtain the PSF value of the air/water body, and performs convolution operation on the original modulation matrix of the spatial light modulator 320 and the PSF value to obtain a new modulation matrix, and specifically, performs convolution operation on the original modulation matrix of the spatial light modulator 320 and the PSF value of the air/water body to obtain the new modulation matrix. By adopting the method, the micro mirrors in the spatial light modulator 320 are not required to be regulated, the PSF value of air/water body is directly used for updating the modulation matrix, and the operation is simpler.
S5: the second light source 310 emits a second light beam, the second light beam is modulated by the spatial light modulator 320 and then projected onto the detection target 40 by the projection system 330, and the light reflected by the detection target 40 is received by the second photoelectric detection unit 340.
S6: the second photo-detecting unit 340 receives the light reflected by the detection target 40 and transmits the light to the central processing unit 350, the second photo-detecting unit 340 adopts a single-pixel detector, each time detects to obtain the pixel sum of each frame of image, and the central processing unit 350 performs the correlation operation according to the new modulation matrix and the detection information of the second photo-detecting unit 340 to obtain the imaging result.
Example 3
As shown in fig. 6, unlike embodiment 1, in this embodiment, the second light source 310 is a broad spectrum light source, a wavelength selecting unit 360 is further disposed behind the light path of the broad spectrum light source, the light beam emitted by the broad spectrum light source includes a plurality of monochromatic light sources with different wavelength bands, the first light source 210 includes a plurality of monochromatic light sources with different wavelength bands corresponding to the monochromatic light with different wavelength bands one to one, the wavelength selecting unit 360 and the monochromatic light sources with different wavelength bands are both connected to the central processing unit 350, and the first photo-detecting unit 220 receives the light rays emitted by the monochromatic light sources with different wavelength bands respectively. Specifically, in this embodiment, the broad spectrum light source adopts a color mixing light source, such as a white light source based on LARP (laser-based remote excitation phosphor) technology, or a tunable laser or a light source array composed of several monochromatic light sources, such as a laser source, LED light, etc., and the first light source 210 may adopt a tunable laser or a laser array, and the first beam shaping device 240 is disposed behind the first light source 210 to form a circular light spot with uniform energy distribution. In this embodiment, the wavelength selecting unit 360 may be a wavelength selecting unit, or other devices may be used, and the central processing unit 350 may control the wavelength selecting unit to rotate, so that different colors of light can perform time-sharing detection on the detection target 40, and meanwhile, the first light source 210 is controlled to make the wavelength band of the first light beam currently emitted and the wavelength band of the second light beam transmitted through the wavelength selecting unit in the second light source 310 be the same, and the first photoelectric detecting unit 220 detects the first light beams with different wavelength bands respectively, and calculates the PSF value at the distance r through the PSF calculating unit 230, and during imaging, the spatial light modulator 320 is controlled to perform modulation or image reconstruction according to the PSF value measured according to the light of the corresponding wavelength band, so as to ensure synchronism and improve the image reconstruction precision. In this case, when reconstructing an image, the central processing unit 350 needs to reconstruct to obtain a monochrome image according to the color information of the light source in the period, the PSF value corresponding to the color light source, and the data received by the single-pixel detector, and finally, all the monochrome images are linearly superimposed to obtain a color image. It should be noted that, when the first light source 210 and the second light source 310 are both monochromatic light arrays, the laser sources in the first light source 210 and the second light source 310 are in one-to-one correspondence, and the wavelength selection unit 360 may not be disposed behind the second light source 310, and the central processing unit 350 may directly perform synchronous control to make the wavelengths of the first light beam and the second light beam correspond to each other.
Example 4
As shown in fig. 7, unlike embodiment 3, in this embodiment, the first light source 210 and the second light source 310 share a single-color light source array formed by a plurality of single-color light sources with different wavelength bands, each single-color light source is provided with a light splitting unit 50 along the rear of the light path, the light emitted by each single-color light source is split by the light splitting unit 50 to form a first light beam and a second light beam respectively, where the first light beam passes through the air/water body and is detected by the first photoelectric detection unit 220, the PSF calculating unit 230 calculates the PSF of the air/water body at the corresponding distance r, and the PSF value is transmitted to the central processing unit 350 to control the state of the micromirror in the spatial light modulator 320 or directly calculate to obtain a new modulation matrix to reconstruct to obtain the image of the single color corresponding to each light source. Specifically, the monochromatic light source is preferably a laser source, and has good collimation. The light splitting unit 50 may adopt a beam splitter, through which all the monochromatic light sources split light, or may adopt a plurality of beam splitters, which are in one-to-one correspondence with each monochromatic light source, and each monochromatic light source splits light through a separate beam splitter, in this embodiment, the angle between the beam splitter and the horizontal direction is 45 °, as shown in fig. 7. Of course, the optical path turning element 260, such as a mirror, may be disposed in the optical path of the PSF measurement system 20 as required, so that the first light beam is perpendicular to the detection surface of the first photoelectric detection unit 220. The adoption of the structure only needs to control the time-sharing emergent of the monochromatic light sources in the monochromatic light source array through the central processing unit 350, and synchronous control is not needed, namely the wavelength selection unit 360 and a synchronous control mechanism are omitted, meanwhile, the structure of the device is reduced, and the occupied space is saved.
According to the compressed sensing imaging device and method provided by the invention, through setting the PSF measurement system 20, the first light beam emitted by the first light source 210 passes through the air/water body, then is received by the first photoelectric detection unit 220, and the energy distribution information of the light spot affected by the PSF is obtained, the PSF value of the air/water body under a specific distance is calculated by the PSF calculation unit 230 according to the energy distribution of the original light spot emitted by the first light source 210 and the energy distribution information of the light spot detected by the first photoelectric detection unit 220, and the PSF value of the air/water body corresponding to the imaging system 30 is obtained by calculation by the central processing unit 350, and the micromirror in the spatial light modulator 320 is adjusted according to the PSF value, so that the light intensity distribution projected onto the detection target 40 is the same as the preset modulation matrix, thereby inhibiting the influence of the PSF. In addition, the central processing unit 350 may also calculate a new modulation matrix according to the preset modulation matrix of the spatial light modulator 320 and the PSF value of the air/water body, and apply the new modulation matrix to the final correlation operation to reconstruct the image to obtain the imaging result. The invention can well avoid the influence caused by PSF and improve the accuracy of the reconstructed image.
Although embodiments of the present invention have been described in the specification, these embodiments are presented only, and should not limit the scope of the present invention. Various omissions, substitutions and changes in the form of examples are intended in the scope of the invention.

Claims (10)

1. A compressed sensing imaging apparatus, comprising: a carrier, and a PSF measurement system and an imaging system located on the carrier:
the PSF measurement system comprises a first light source, a first photoelectric detection unit and a PSF calculation unit, wherein the first photoelectric detection unit is connected with the PSF calculation unit, an air/water environment is arranged between the first light source and the first photoelectric detection unit, a first light beam emitted by the first light source enters the first photoelectric detection unit after passing through the air/water, the divergence angle of the first light beam is smaller than 5mrad, and the first photoelectric detection unit is an area array detector;
the imaging system comprises a second light source, a spatial light modulator, a projection system, a second photoelectric detection unit and a central processing unit, wherein the second light source, the spatial light modulator, the projection system, the detection target, the second photoelectric detection unit and the central processing unit are sequentially arranged along a light path, and the central processing unit is respectively connected with the PSF calculation unit and the spatial light modulator.
2. The compressed sensing imaging apparatus of claim 1, wherein the PSF measurement system further comprises a first beam shaping device, the first beam passing through the first beam shaping device to form a circular spot having a uniform energy distribution.
3. The compressed sensing imaging apparatus of claim 1, wherein a main optical axis of the first light beam is perpendicular to a detection plane of the first photodetection unit.
4. A compressed sensing imaging device according to claim 3, wherein the first and second light sources are monochromatic light sources of the same wavelength.
5. The compressed sensing imaging device according to claim 3, wherein the second light source is a broad spectrum light source, a wavelength selecting unit is further disposed behind the light path of the broad spectrum light source, the light beam emitted by the broad spectrum light source includes monochromatic light with different multiple wave bands, the first light source includes monochromatic light sources corresponding to the monochromatic light with different multiple wave bands one by one, the wavelength selecting unit and the monochromatic light sources with different multiple wave bands are connected to the central processing unit, and the first photoelectric detecting unit receives the light emitted by the monochromatic light sources in a time-sharing manner.
6. The compressed sensing imaging device according to claim 3, wherein the first light source and the second light source adopt a single-color light source array composed of a plurality of single-color light sources with different wave bands, a light splitting unit is arranged behind the single-color light source array along the light path, and light rays emitted by each single-color light source respectively form a first light beam and a second light beam after passing through the light splitting unit.
7. A method of imaging a compressed sensing imaging apparatus of claim 1, comprising the steps of:
s1: measuring a distance R traveled by the first light beam in the air/water body and a distance R traveled by the second light beam in the air/water body when the second light beam is projected onto the detection target;
s2: the method comprises the steps of turning on a first light source to emit a first light beam, firstly detecting energy distribution information of an original light spot of the first light source, enabling the first light beam to enter a first photoelectric detection unit for detection after passing through air/water, and sending the energy distribution information of the detected light spot to a PSF calculation unit by the first photoelectric detection unit;
s3: the PSF calculation unit calculates the spectrum value of the PSF of the air/water body at the distance r according to the energy distribution of the original light spot and the energy distribution information of the light spot detected by the first photoelectric detection unit, and sends the calculated spectrum value of the PSF to the central processing unit;
s4: the central processing unit calculates and obtains a spectrum value of PSF of air/water under a distance R through an MTF formula under a meter scattering condition, and adjusts the spatial light modulator according to the spectrum value to enable light intensity distribution reaching a detection target to be the same as a preset modulation matrix; wherein, the MTF formula under the meter scattering condition is:
wherein, MTF a For the actual MTF value, S a And A a Representing the finite scattering and absorption coefficient of the impurity particles for light, v c Is the cut-off frequency of impurity particles, R is the optical path;
s5: the second light source emits a second light beam, the second light beam is modulated by the spatial light modulator and then projected onto the detection target through a projection system, and the light reflected by the detection target is received by the second photoelectric detection unit;
s6: the second photoelectric detection unit receives the light reflected by the detection target and transmits the light to the central processing unit, and the central processing unit performs association operation according to a preset modulation matrix of the spatial light modulator and detection information of the second photoelectric detection unit to obtain an imaging result.
8. The imaging method according to claim 7, wherein in the step S3, the PSF calculating unit calculates a spectral value of the PSF of the air/water body at the distance r, comprising the steps of:
s31: performing Fourier transform on the energy distribution of the light spot detected by the first photoelectric detection unit to obtain a frequency spectrum of the detected light spot, and performing Fourier transform on the energy distribution of the original light spot of the first light source to obtain a frequency spectrum of the original light spot;
s32: and performing point division operation on the spectrum of the detected light spot and the spectrum of the original light spot to obtain a spectrum value of the PSF corresponding to the air/water body.
9. The imaging method according to claim 8, wherein in the step S4, the step of adjusting the spatial light modulator by the central processing unit is as follows:
s41: measuring divergence angle of the second light beam in the air/water body and distance R between the detection target and the second light source 1
S42: based on the size of one pixel of the modulation matrix modulated on the spatial light modulator irradiated by the second light source and the measured divergence angle and distance R 1 Calculating to obtain the size of one pixel in the modulated light spot at the detection target, and taking the size of the modulated light spot as the light spot size influenced by the PSF of air/water;
s43: deconvolution operation is carried out on the size of the pixel unit of the light spot affected by the PSF of the air/water body and the spectrum value of the PSF at the corresponding distance to obtain the size of the pixel unit of the light spot unaffected by the air/water body;
s44: obtaining the size of a pixel unit in a modulation matrix on the spatial light modulator by utilizing the object-image relationship;
s45: and the central processing unit controls the micromirrors corresponding to the pixel unit in size to react as one pixel unit according to the size of one pixel unit in the modulation matrix on the spatial light modulator, so that the light intensity distribution reaching the detection target is the same as the preset modulation matrix.
10. A method of imaging a compressed sensing imaging apparatus of claim 1, comprising the steps of:
s1: measuring a distance R traveled by the first light beam in the air/water body and a distance R traveled by the second light beam in the air/water body when the second light beam is projected onto the detection target;
s2: the method comprises the steps of turning on a first light source to emit a first light beam, firstly detecting energy distribution information of an original light spot of the first light source, enabling the first light beam to enter a first photoelectric detection unit for detection after passing through air/water, and sending the energy distribution information of the detected light spot imaging to a PSF calculation unit by the first photoelectric detection unit;
s3: the PSF calculation unit calculates the spectrum value of the PSF of the air/water body at the distance r according to the energy distribution of the light spot emitted by the first light source and the energy distribution information of the received light spot imaging, and sends the calculated spectrum value of the PSF to the central processing unit;
s4: the central processing unit calculates a spectrum value of the PSF of the air/water body under the distance R through an MTF formula under the meter scattering condition, performs inverse Fourier transform on the spectrum value of the PSF of the air/water body under the distance R to obtain a PSF value of the air/water body, and then performs convolution operation on a preset modulation matrix of the spatial modulation unit and the PSF value to obtain a new modulation matrix;
wherein, the MTF formula under the meter scattering condition is:
wherein, MTF a For the actual MTF value, S a And A a Representing the finite scattering and absorption coefficient of the impurity particles for light, v c Is the cut-off frequency of impurity particles, R is the optical path;
s5: the second light source emits a second light beam, the second light beam is modulated by the spatial light modulator and then projected onto the detection target, and the light reflected by the detection target is received by the second photoelectric detection unit;
s6: the second photoelectric detection unit receives the light reflected by the detection target and transmits the light to the central processing unit, and the central processing unit performs association operation according to the new modulation matrix and detection information of the second photoelectric detection unit to obtain an imaging result.
CN201711222571.XA 2017-11-29 2017-11-29 Compressed sensing imaging device and method Active CN107807091B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711222571.XA CN107807091B (en) 2017-11-29 2017-11-29 Compressed sensing imaging device and method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711222571.XA CN107807091B (en) 2017-11-29 2017-11-29 Compressed sensing imaging device and method

Publications (2)

Publication Number Publication Date
CN107807091A CN107807091A (en) 2018-03-16
CN107807091B true CN107807091B (en) 2024-03-19

Family

ID=61582062

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711222571.XA Active CN107807091B (en) 2017-11-29 2017-11-29 Compressed sensing imaging device and method

Country Status (1)

Country Link
CN (1) CN107807091B (en)

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012174940A1 (en) * 2011-06-20 2012-12-27 中国科学院空间科学与应用研究中心 Multi-spectral imaging method for ultraweak photon emission and system thereof
CN103326779A (en) * 2013-06-21 2013-09-25 中国科学院空间科学与应用研究中心 Free space light communication system and method based on compressed sensing
CN104243837A (en) * 2014-08-28 2014-12-24 浙江大学 Vibration detection and remote sensing image recovery method based on single-exposure video reconstruction
CN105676613A (en) * 2016-03-29 2016-06-15 山东大学 Digital holography ghost imaging system by adopting single-pixel or bucket detector and working method thereof
WO2017117695A1 (en) * 2016-01-08 2017-07-13 上海理工大学 Method for increasing spectral signal-to-noise ratio of terahertz-based optical detection system
CN106950195A (en) * 2017-02-24 2017-07-14 西安电子科技大学 Programmable optical elements and light field regulator control system and method based on scattering medium
CN207457047U (en) * 2017-11-29 2018-06-05 苏州蛟视智能科技有限公司 A kind of compressed sensing imaging device

Family Cites Families (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
FR2967791B1 (en) * 2010-11-22 2012-11-16 Ecole Polytech METHOD AND SYSTEM FOR CALIBRATION OF A SPATIAL OPTICAL MODULATOR IN AN OPTICAL MICROSCOPE

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2012174940A1 (en) * 2011-06-20 2012-12-27 中国科学院空间科学与应用研究中心 Multi-spectral imaging method for ultraweak photon emission and system thereof
CN103326779A (en) * 2013-06-21 2013-09-25 中国科学院空间科学与应用研究中心 Free space light communication system and method based on compressed sensing
CN104243837A (en) * 2014-08-28 2014-12-24 浙江大学 Vibration detection and remote sensing image recovery method based on single-exposure video reconstruction
WO2017117695A1 (en) * 2016-01-08 2017-07-13 上海理工大学 Method for increasing spectral signal-to-noise ratio of terahertz-based optical detection system
CN105676613A (en) * 2016-03-29 2016-06-15 山东大学 Digital holography ghost imaging system by adopting single-pixel or bucket detector and working method thereof
CN106950195A (en) * 2017-02-24 2017-07-14 西安电子科技大学 Programmable optical elements and light field regulator control system and method based on scattering medium
CN207457047U (en) * 2017-11-29 2018-06-05 苏州蛟视智能科技有限公司 A kind of compressed sensing imaging device

Also Published As

Publication number Publication date
CN107807091A (en) 2018-03-16

Similar Documents

Publication Publication Date Title
US20230392920A1 (en) Multiple channel locating
RU2653772C1 (en) System for forming broadband hyperspectral image based on compressible probing with a random diffraction grating
US9514378B2 (en) Space-time modulated active 3D imager
RU2535640C2 (en) Forming multispectral images
CN102768069B (en) Single-photon spectral counting and imaging system and method for complementary measurement
CA2938319C (en) Fabry-perot interferometer based satellite detection of atmospheric trace gases
WO2018194920A1 (en) Polarization sensitive devices, methods and applications
CN108291800A (en) Spectrum imaging method and system
CN106123915B (en) A kind of pneumatic degraded image recovery system based on direct point spread function
CN103868596B (en) A kind of large aperture space heterodyne interference spectrum formation method and spectrometer
CN108051088B (en) High-spectrum high-spatial-resolution integral field spectrum imaging system for underwater detection
RU188541U1 (en) MULTIWAVE LIDAR FOR SENSING ATMOSPHERE
CN114859381A (en) Atmospheric composition differential absorption laser imaging radar profile detection method and system
CN107807091B (en) Compressed sensing imaging device and method
CN107783149B (en) Compressed sensing imaging device and method
CN103558160B (en) A kind of method and system improving light spectrum image-forming spatial resolution
CN113108908B (en) Relative spectral response measuring device and method of broadband imaging sensor
CN207457047U (en) A kind of compressed sensing imaging device
US20150211849A1 (en) Shared-aperture electro-optic imaging and ranging sensor
CN113125341B (en) Gas telemetry method and device based on multispectral imaging technology
Zhou et al. Multispectral single pixel imaging based on spatial and spectral dimension decoupling
CN207457509U (en) A kind of compressed sensing imaging device
CN107831116B (en) Self-adaptive imaging device and method
CN105761212A (en) Hadamard transform high sensitivity imaging method based on DMD encoding
CN112556849B (en) Hyperspectral imaging device

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant