CN110779625B - Four-dimensional ultrafast photographic arrangement - Google Patents

Four-dimensional ultrafast photographic arrangement Download PDF

Info

Publication number
CN110779625B
CN110779625B CN201910999266.4A CN201910999266A CN110779625B CN 110779625 B CN110779625 B CN 110779625B CN 201910999266 A CN201910999266 A CN 201910999266A CN 110779625 B CN110779625 B CN 110779625B
Authority
CN
China
Prior art keywords
data acquisition
lens
image
acquisition system
data
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910999266.4A
Other languages
Chinese (zh)
Other versions
CN110779625A (en
Inventor
丁鹏鹏
曹烽燕
杨承帅
齐大龙
何一林
姚佳丽
姚云华
金诚挚
张诗按
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
East China Normal University
Original Assignee
East China Normal University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by East China Normal University filed Critical East China Normal University
Priority to CN201910999266.4A priority Critical patent/CN110779625B/en
Publication of CN110779625A publication Critical patent/CN110779625A/en
Application granted granted Critical
Publication of CN110779625B publication Critical patent/CN110779625B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/2823Imaging spectrometer
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01JMEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28Investigating the spectrum
    • G01J3/2889Rapid scan spectrometers; Time resolved spectrometry

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • General Physics & Mathematics (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Spectrometry And Color Measurement (AREA)

Abstract

The invention discloses a four-dimensional ultrafast photographing device, which comprises a data acquisition system, a data reconstruction system and a synchronization system, wherein the data acquisition system is used for acquiring data; according to the method, an integral image is obtained from a dynamic scene to be measured through a data acquisition system, namely the image obtained after the whole ultrafast dynamic process is compressed, the image from the data acquisition system is processed through a data reconstruction system, namely, denoising is carried out, the dynamic scene to be measured is reconstructed by utilizing an augmented Lagrange algorithm, and finally the image of the space x-y, time t and spectrum lambda four-dimensional scene of a recorded object is obtained. The invention is used for controlling the working time of the stripe camera through a synchronous system. The invention makes the existing optical imaging technology break through and expand, and realizes the measurement of four-dimensional dynamic scenes. The invention has certain application value in fluorescence measurement and diagnosis of organism tissues.

Description

Four-dimensional ultrafast photographic arrangement
Technical Field
The invention relates to the technical field of optics and computer imaging, which comprises an early data acquisition part and a later data reconstruction part to obtain a four-dimensional space scene containing spectral dynamic information, in particular to a four-dimensional ultrafast photographic device. The scanning speed of the streak camera determines that the device has certain application in some ultra-fast optical imaging and medical biological tissue diagnosis.
Background
In scientific research, it is very important to obtain the spatial structure, temporal evolution and spectral composition of an object. It can help human to better understand natural phenomena such as biomedical optics, environmental remote sensing, nuclear explosion and astrophysics. Optical imaging technology, as a direct viewing method, provides a powerful tool for exploring the mysterious nature of human history and the unknown world, due to its unique capabilities in terms of spatial, temporal and spectral resolution. However, existing optical imaging methods can only obtain spatio-temporal or spatial spectral information through a single shot, which greatly limits the information extraction of objects. For example, ultrafast imaging techniques, including compressed ultrafast imaging (cpu), compressed ultrafast spectral-time (CUST) imaging, and time-series plenoptic mapping imaging (STAMP), can only acquire spatiotemporal information of an object. It is worth noting that CUST and STAMP seem to be able to obtain spectral information, but it is the illuminating light, i.e. the chirped femtosecond laser, and not the spectrum of the object to be measured. However, spectral imaging techniques, such as classical hyperspectral imaging (HSI) and Coded Aperture Snapshot Spectral Imagers (CASSI), can only obtain spatial and spectral information of an object. Thus, no optical imaging technique can simultaneously record a four-dimensional scene of spatial x-y, temporal t, and spectral λ information of an object with a single shot.
Disclosure of Invention
The invention aims to provide a four-dimensional ultrafast photographing device aiming at the defects of the prior art. The invention comprises a data acquisition system, a data reconstruction system and a synchronization system; according to the method, an integral image is obtained from a dynamic scene to be measured through a data acquisition system, namely the image obtained after the whole ultrafast dynamic process is compressed, the image from the data acquisition system is processed through a data reconstruction system, namely, denoising is carried out, the dynamic scene to be measured is reconstructed by utilizing an augmented Lagrange algorithm, and finally the image of the space x-y, time t and spectrum lambda four-dimensional scene of a recorded object is obtained. The invention is used for controlling the working time of the stripe camera through a synchronous system. The invention makes the existing optical imaging technology break through and expand, and realizes the measurement of four-dimensional dynamic scenes.
The specific technical scheme for realizing the purpose of the invention is as follows:
a four-dimensional ultrafast photographing apparatus, characterized in that the apparatus comprises:
a data acquisition system composed of a focusing lens, a beam splitting cube, a first lens, a second lens, a digital micromirror device, a grating and a stripe camera;
a data reconstruction system comprising a computer;
a synchronous system composed of a photoelectric detector and a digital delay pulse generator;
the adjustable-focus lens of the data acquisition system is connected with the beam splitting cube, one path of the beam splitting cube is connected with the first lens, the first lens is connected with the second lens, and the second lens is connected with the digital micromirror device; the other path of the beam splitting cube is connected with a grating, and the grating is connected with a stripe camera;
the photoelectric detector of the synchronous system is connected with the digital delay pulse generator;
and the stripe camera of the data acquisition system is respectively connected with the digital delay pulse generator of the synchronous system and the computer of the data reconstruction system.
The invention comprises a data acquisition system, a data reconstruction system and a synchronization system; according to the method, an integral image is obtained from a dynamic scene to be measured through a data acquisition system, namely the image obtained after the whole ultrafast dynamic process is compressed, the image from the data acquisition system is processed through a data reconstruction system, namely, denoising is carried out, the dynamic scene to be measured is reconstructed by utilizing an augmented Lagrange algorithm, and finally the image of the space x-y, time t and spectrum lambda four-dimensional scene of a recorded object is obtained. The invention is used for controlling the working time of the stripe camera through a synchronous system. The invention makes the existing optical imaging technology break through and expand, and realizes the measurement of four-dimensional dynamic scenes.
The invention discloses a data reconstruction system formed by a computer, wherein the reconstruction adopts an augmented Lagrange (A-L) algorithm, and the specific algorithm is as follows:
setting: the method comprises the following steps that a dynamic scene of a shot object is recorded as X, the result obtained in a CMOS stripe camera is recorded as Y, the data acquisition process is Y-LX, L-MTSC, wherein C is a spatial coding operator, S is a spectral offset operator, T is a time offset operator, and M is a multiplexing integral operator; the following optimal solution problem is solved:
Figure BDA0002240761430000021
wherein lambda is an algorithm multiplier, beta is a regularization parameter, and phi (X) is a total variation function;
the first step is as follows: introducing a new variable W, wherein W is DX, D is gradient operator, let phi (X) become DX | |2After constrained re-deformation, the above equation becomes:
Figure BDA0002240761430000022
wherein ν is a lagrangian multiplier of Φ (X), μ is a corresponding regularization parameter;
the second step is that: during each iteration, the problem described in (1) is decomposed into two sub-problems with respect to the variables W and X
W-sub problem:
Figure BDA0002240761430000031
the corresponding solution is:
Figure BDA0002240761430000032
x-subproblem:
Figure BDA0002240761430000033
the corresponding solution is:
Xj=Xj-1-αd(Xj-1) (5)
wherein D (x) ═ DT(DX-W)-DTν)+βLT(LX-Y)-LTLambda is the derivative of X, alpha is the iterative optimization parameter, and T is the sign of the transpose matrix;
the third step: and (5) substituting (3) and (5) into (1) to repeat the first step and the second step, and searching for the optimal solution X.
The invention has the advantages of
1) The four-dimensional (x-y-t-lambda) simultaneous imaging is realized for the first time, the time resolution is 2ps, and the imaging depends on a stripe camera; spectral resolution was 1.72nm, depending on the grating used; the spatial resolution is 1.26lp/mm in the transverse direction and 1.41lp/mm in the longitudinal direction, and the spatial resolution can be calibrated by using a test target depending on the optical performance of the system;
2) time, space and spectrum information of the whole scene to be measured are reconstructed by single shooting, and non-repeated or irreversible events can be shot;
3) for receive-only imaging, active detection light illumination is not required in the detection of self-luminous scenes.
Drawings
FIG. 1 is a schematic structural view of the present invention;
FIG. 2 is a diagram of a single pulse signal taken in accordance with the present invention when the dynamic scene to be measured is a chirped picosecond pulse signal;
FIG. 3 is a schematic diagram of a dynamic process of the whole fluorescence attenuation photographed by the present invention when the dynamic scene to be measured is a fluorescence signal emitted by rhodamine.
Detailed Description
The present invention will be described in further detail with reference to the following specific examples and the accompanying drawings. The procedures, conditions, experimental methods and the like for carrying out the present invention are general knowledge and common general knowledge in the art except for the contents specifically mentioned below, and the present invention is not particularly limited.
Referring to fig. 1, the present invention includes a data acquisition system 1 composed of a focus-adjustable lens 12, a beam-splitting cube 13, a first lens 14, a second lens 15, a digital micromirror device 16, a grating 17 and a stripe camera 18;
a data reconstruction system 2 constituted by a computer;
a synchronization system 3 composed of a photoelectric detector 31 and a digital delay pulse generator 32;
the adjustable-focus lens 12 of the data acquisition system 1 is connected with a beam splitting cube 13, one path of the beam splitting cube 13 is connected with a first lens 14, the first lens 14 is connected with a second lens 15, and the second lens 15 is connected with a digital micromirror device 16; the other path of the beam splitting cube 13 is connected with a grating 17, and the grating 17 is connected with a stripe camera 18;
the photoelectric detector 31 of the synchronous system 3 is connected with a digital delay pulse generator 32;
the stripe camera 18 of the data acquisition system 1 is respectively connected with the digital delay pulse generator 32 of the synchronization system 3 and the computer of the data reconstruction system 2.
Example 1
Referring to fig. 1, in the present embodiment, the digital delay pulse generator 32 is a DG645 digital delay pulse generator; the stripe camera 18 is a CMOS industrial camera; the scale of the grating 17 is 300 lp/mm;
the data acquisition system 1 works by selecting a dynamic scene 11 to be measured, enabling a dynamic image to enter a focusing lens 12, a beam splitting cube 13, a first lens 14 and a second lens 15 in sequence to reach a digital micromirror device 16, carrying out a pseudo-random encoding by the digital micromirror device 16, reflecting the encoded image back to the original 4f system by a small unit on the digital micromirror device 16 and returning to the beam splitting cube 13 again, splitting the image by the beam splitting cube 13 and then reflecting the image to enter a grating 17, carrying out spectrum offset by the grating 17, and finally entering a stripe camera 18 for time offset and compression.
The data reconstruction system 2 operates, and the computer of the data reconstruction system 2 reconstructs the data acquired by the streak camera 18 by using an augmented lagrangian algorithm.
The synchronous system 3 works, the optical signal entering the system is converted into an electrical signal through the photoelectric detector 31, the converted electrical signal is input to the digital delay pulse generator 32, and the digital delay pulse generator 32 carries out delay processing on the electrical signal to control the starting working time of the streak camera.
Example 2
Referring to fig. 1 and 2, the selected dynamic scene 11 to be measured is a chirped picosecond pulse signal, and the entire single pulse signal is shot by the invention.
The data acquisition system 1 works by selecting a dynamic scene 11 to be detected as a chirped picosecond pulse signal, sequentially inputting a dynamic image into the adjustable-focus lens 12, the beam splitting cube 13, the first lens 14 and the second lens 15 to reach the digital micromirror device 16, performing a pseudo-random encoding by the digital micromirror device 16, reflecting the encoded image back to the original 4f system by a small unit on the digital micromirror device 16, returning to the beam splitting cube 13 again, dividing the beam by the beam splitting cube 13, inputting to the grating 17, performing spectral shift by the grating 17, and finally inputting to the stripe camera 18 for time shift and compression.
The data reconstruction system 2 works, and the computer of the data reconstruction system 2 reconstructs a chirped picosecond pulse evolution image from the data acquired by the streak camera 18 by using an augmented lagrange algorithm, wherein the horizontal axis in fig. 2 is spectral resolution, and the vertical axis is time resolution.
The synchronous system 3 works, and the photoelectric detector 31 and the digital delay pulse generator 32 provide time delay signals to control the working time of the stripe camera 18, so that the four-dimensional information extraction of the light spot signals is realized.
Example 3
Referring to fig. 1 and 3, the selected dynamic scene 11 to be measured is a dynamic process of generating fluorescence attenuation of rhodamine B solution by using a laser pulse of 50fs, and the dynamic process schematic diagram of the whole fluorescence attenuation is shot by the invention.
The data acquisition system 1 works, firstly, a dynamic scene 11 to be detected is selected as a dynamic process of using 50fs laser pulse to be shot in a rhodamine B solution to generate fluorescence attenuation of the dynamic scene, a dynamic image sequentially enters a focusing lens 12, a beam splitting cube 13, a first lens 14 and a second lens 15 to reach a digital micromirror device 16, the digital micromirror device 16 carries out pseudorandom coding, the coded image is reflected back to the original 4f system by a small unit on the digital micromirror device 16 and returns to the beam splitting cube 13 again, the coded image is reflected to a grating 17 after being split by the beam splitting cube 13, spectral shift is carried out by the grating 17, and finally the coded image enters a stripe camera 18 to carry out time shift and compression.
The data reconstruction system 2 works, and a computer of the data reconstruction system 2 reconstructs a fluorescence spot evolution image from the data acquired by the streak camera 18 by using an augmented lagrangian algorithm, wherein the horizontal axis in fig. 3 is spectral resolution, and the vertical axis is time resolution.
The synchronous system 3 works, and the photoelectric detector 31 and the digital delay pulse generator 32 provide time delay signals to control the working time of the stripe camera 18, so that four-dimensional extraction of fluorescence information is realized.
In the data acquisition system 1, the information of a dynamic scene 11 to be detected is received through the adjustable focus lens 12 and is used for changing the spatial resolution of the system and adjusting the definition of the imaging system; for changing the light path by means of a beam-splitting cube 13; the first lens 14 is connected with the beam splitting cube 13, and the second lens 15 is connected with the first lens 14 and used for building a 4f optical system; the digital micromirror device 16 is connected with the second lens 15 and is used for encoding the input information of the dynamic scene 11 to be detected; the system is connected with the beam splitting cube 13 through a grating 17 and used for receiving the dynamic scene 11 to be detected which is reflected by the digital micro-mirror device 16 and passes through the 4f system, and performing spectral shift broadening on the dynamic scene 11 to be detected; connected to the grating 17 by a stripe camera 18 for time shifting and space-time compression of the preceding spectrally shifted broadened images.
In the data reconstruction system 2 of the present invention, the data collected by the streak camera 18 is received by the computer and used for reconstructing the original dynamic scene to be measured. The reconstruction adopts an augmented Lagrangian A-L algorithm.
In the synchronization system 3 of the present invention, the photodetector 31 receives the optical information of the dynamic scene 11 to be measured and converts the optical information into electrical information, and then the electrical information is transmitted to the digital delay pulse generator 32, and the digital delay pulse generator 32 outputs an electrical signal with compensated optical path difference to the streak camera 18, so as to control the working time of the streak camera 18.

Claims (1)

1. A four-dimensional ultrafast photographing apparatus, comprising:
a data acquisition system (1) which is composed of a focusing lens (12), a beam splitting cube (13), a first lens (14), a second lens (15), a digital micromirror device (16), a grating (17) and a stripe camera (18);
a data reconstruction system (2) formed by a computer;
a synchronization system (3) consisting of a photodetector (31) and a digital delay pulse generator (32);
a focusing lens (12) of the data acquisition system (1) is connected with a beam splitting cube (13), one path of the beam splitting cube (13) is connected with a first lens (14), the first lens (14) is connected with a second lens (15), and the second lens (15) is connected with a digital micromirror device (16); the other path of the beam splitting cube (13) is connected with a grating (17), and the grating (17) is connected with a stripe camera (18);
the photoelectric detector (31) of the synchronous system (3) is connected with the digital delay pulse generator (32);
the stripe camera (18) of the data acquisition system (1) is respectively connected with the digital delay pulse generator (32) of the synchronization system (3) and the computer of the data reconstruction system (2); wherein:
the scale of the grating (17) is 300 lp/mm;
the reconstruction of the data reconstruction system formed by the computer adopts an augmented Lagrange (A-L) algorithm, and the specific algorithm is as follows:
setting: the method comprises the following steps that a dynamic scene of a shot object is recorded as X, the result obtained in a CMOS stripe camera is recorded as Y, the data acquisition process is Y-LX, L-MTSC, wherein C is a spatial coding operator, S is a spectral offset operator, T is a time offset operator, and M is a multiplexing integral operator; the following optimal solution problem is solved:
Figure FDF0000010270140000011
wherein lambda is an algorithm multiplier, beta is a regularization parameter, and phi (X) is a total variation function;
an integral image is obtained from the dynamic scene to be measured through the data acquisition system, namely the image obtained after the whole ultrafast dynamic process is compressed, the image from the data acquisition system is processed through the data reconstruction system, namely, denoising is carried out, the dynamic scene to be measured is reconstructed by utilizing an augmented Lagrange algorithm, and finally the image of the space x-y, time t and spectrum lambda four-dimensional scene of the recorded object is obtained.
CN201910999266.4A 2019-10-21 2019-10-21 Four-dimensional ultrafast photographic arrangement Active CN110779625B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910999266.4A CN110779625B (en) 2019-10-21 2019-10-21 Four-dimensional ultrafast photographic arrangement

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910999266.4A CN110779625B (en) 2019-10-21 2019-10-21 Four-dimensional ultrafast photographic arrangement

Publications (2)

Publication Number Publication Date
CN110779625A CN110779625A (en) 2020-02-11
CN110779625B true CN110779625B (en) 2022-04-05

Family

ID=69386144

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910999266.4A Active CN110779625B (en) 2019-10-21 2019-10-21 Four-dimensional ultrafast photographic arrangement

Country Status (1)

Country Link
CN (1) CN110779625B (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN114088202A (en) * 2020-08-25 2022-02-25 南京大学 Passive ultrafast process acquisition device and method
CN113296346B (en) * 2021-04-14 2022-01-11 华东师范大学 Space-time-frequency five-dimensional compression ultrafast photographing device
CN114979590B (en) * 2022-03-30 2023-04-07 华东师范大学 Ultrafast image device of line integral compression

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016085571A2 (en) * 2014-09-30 2016-06-02 Washington University Compressed-sensing ultrafast photography (cup)
CN109343238A (en) * 2018-09-20 2019-02-15 华东师范大学 A kind of compression ultrahigh speed camera based on electro-optic crystal deflection

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9880054B2 (en) * 2013-07-26 2018-01-30 Inview Technology Corporation Simplified compressive sensing spectral imager
CN109186785A (en) * 2018-09-06 2019-01-11 华东师范大学 A kind of time space measure device of ultrafast laser field

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2016085571A2 (en) * 2014-09-30 2016-06-02 Washington University Compressed-sensing ultrafast photography (cup)
CN109343238A (en) * 2018-09-20 2019-02-15 华东师范大学 A kind of compression ultrahigh speed camera based on electro-optic crystal deflection

Also Published As

Publication number Publication date
CN110779625A (en) 2020-02-11

Similar Documents

Publication Publication Date Title
CN110779625B (en) Four-dimensional ultrafast photographic arrangement
CN107111125B (en) System and method for multiplexed fourier ptychographic imaging
Yang et al. Hyperspectrally compressed ultrafast photography
US10992924B2 (en) Stereo-polarimetric compressed ultrafast photography (SP-CUP) systems and methods
US20190353887A1 (en) Smart coded access optical sensor
CN113296346B (en) Space-time-frequency five-dimensional compression ultrafast photographing device
WO2012174940A1 (en) Multi-spectral imaging method for ultraweak photon emission and system thereof
CN110793633B (en) Single-pixel multispectral calculation imaging system and imaging method based on bundled optical fibers
JP2006508363A5 (en)
US11231323B2 (en) Time-resolved hyper-spectral single-pixel imaging
US20120330162A1 (en) Modulated aperture imaging for automatic moving target detection
CN113534596B (en) RGBD stereo camera and imaging method
US10955654B2 (en) Imaging device and method
CN109343238A (en) A kind of compression ultrahigh speed camera based on electro-optic crystal deflection
CN108156399A (en) Single pixel camera video imaging system based on compressive sensing theory
CN114051106A (en) Spatial spectrum filtering frequency domain reconstruction high-speed imaging system and method
JPWO2019171691A1 (en) Image processing device, imaging device, and image processing method
CN114076637B (en) Hyperspectral acquisition method and system, electronic equipment and coded broad spectrum imaging device
JP2019092088A (en) Imaging apparatus
US20070195298A1 (en) Imaging system
Soldevila et al. Multispectral Fluorescence Lifetime Imaging with Single-Pixel Cameras and Data Fusion
Soldevila et al. Multispectral time-resolved fluorescence imaging by single-pixel detection and data fusion
CN112911172B (en) Target scene distance extraction device and method based on InGaAs camera
Hanaoka et al. High-speed H-alpha camera and a real-time image processing system for solar observations
Brännlund et al. Detection and localization of light flashes using a single pixel camera in SWIR

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant