CN108121059A - A kind of parallel micro imaging systems of STED based on Structured Illumination - Google Patents

A kind of parallel micro imaging systems of STED based on Structured Illumination Download PDF

Info

Publication number
CN108121059A
CN108121059A CN201711150961.0A CN201711150961A CN108121059A CN 108121059 A CN108121059 A CN 108121059A CN 201711150961 A CN201711150961 A CN 201711150961A CN 108121059 A CN108121059 A CN 108121059A
Authority
CN
China
Prior art keywords
light
loss
sted
excitation
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201711150961.0A
Other languages
Chinese (zh)
Other versions
CN108121059B (en
Inventor
唐玉国
张运海
肖昀
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Guoke Medical Technology Development Co ltd
Suzhou Institute of Biomedical Engineering and Technology of CAS
Original Assignee
Suzhou Guoke Medical Technology Development Co ltd
Suzhou Institute of Biomedical Engineering and Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Guoke Medical Technology Development Co ltd, Suzhou Institute of Biomedical Engineering and Technology of CAS filed Critical Suzhou Guoke Medical Technology Development Co ltd
Priority to CN201711150961.0A priority Critical patent/CN108121059B/en
Publication of CN108121059A publication Critical patent/CN108121059A/en
Application granted granted Critical
Publication of CN108121059B publication Critical patent/CN108121059B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0032Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/06Means for illuminating specimens

Landscapes

  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Microscoopes, Condenser (AREA)

Abstract

本发明提供的基于结构光照明的STED并行显微成像系统,通过对照明模块进行设计,将激发光激光器出射的一束激发光分成两束相干光,将损耗光激光器出射的一束损耗光分成两束相干光,通过干涉分别得到均匀分布的激发结构光和损耗结构光,激发结构光和损耗结构光并对样品进行激发和损耗,进行STED并行显微成像,再采用STED的坐标定位方法和SIM频域频谱图融合法进行图像重建,实现超分辨成像,有助于扩大STED显微系统的视场范围和成像速度。

The STED parallel microscopic imaging system based on structured light illumination provided by the present invention divides a beam of excitation light emitted by the excitation light laser into two beams of coherent light by designing the illumination module, and divides a beam of depleted light emitted by the depletion laser into two beams of coherent light. Two beams of coherent light are obtained by interference to obtain uniformly distributed excitation structured light and loss structured light respectively, and then excite and deplete the sample for STED parallel microscopic imaging, and then use the STED coordinate positioning method and The SIM frequency-domain spectrogram fusion method is used for image reconstruction to realize super-resolution imaging, which is helpful to expand the field of view and imaging speed of the STED microscope system.

Description

一种基于结构光照明的STED并行显微成像系统A STED Parallel Microscopic Imaging System Based on Structured Light Illumination

技术领域technical field

本发明涉及显微检测仪器设计及制造领域,尤其是涉及一种基于结构光照明的STED并行显微成像系统。The invention relates to the field of design and manufacture of microscopic detection instruments, in particular to a STED parallel microscopic imaging system based on structured light illumination.

背景技术Background technique

超分辨显微成像技术是一种用于生物等研究领域中的前沿技术,主要分为坐标定位类和坐标随机类两大类显微成像方法。其中坐标定位类显微成像方法中的典型代表为受激辐射损耗(STED)显微成像,STED显微成像直接采用光学方法,对样品进行逐点扫描,实现超分辨成像。但受单点扫描方式的限制,STED显微成像的成像速度比较慢。Super-resolution microscopic imaging technology is a cutting-edge technology used in biological and other research fields. It is mainly divided into two types of microscopic imaging methods: coordinate positioning and coordinate random. Among them, the typical representative of the coordinate positioning microscopic imaging method is stimulated radiation depletion (STED) microscopic imaging. STED microscopic imaging directly uses optical methods to scan the sample point by point to achieve super-resolution imaging. However, limited by the single-point scanning method, the imaging speed of STED microscopic imaging is relatively slow.

近年来,为提高STED显微成像技术的成像速度,STED并行显微成像被提出。其中效果较好的是采用二维结构光照明模式,明显提高了成像速度。但是由于二维结构光的加入,导致成像系统复杂度变高,并且该技术中激发光没有采用结构光模式而采用宽场激发,使得有效荧光的信噪比显著降低,影响了成像分辨率。In recent years, in order to improve the imaging speed of STED microscopic imaging technology, STED parallel microscopic imaging has been proposed. Among them, the better effect is the use of two-dimensional structured light illumination mode, which significantly improves the imaging speed. However, due to the addition of two-dimensional structured light, the complexity of the imaging system becomes higher, and the excitation light in this technology does not use structured light mode but wide-field excitation, which significantly reduces the signal-to-noise ratio of effective fluorescence and affects the imaging resolution.

发明内容Contents of the invention

本发明的目的是:The purpose of the present invention is:

提供一种成像分辨率高且成像速度快的基于结构光照明的STED并行显微成像系统。A structured light illumination-based STED parallel microscopic imaging system with high imaging resolution and fast imaging speed is provided.

为实现上述目的,本发明采用下述技术方案:To achieve the above object, the present invention adopts the following technical solutions:

一种基于结构光照明的STED并行显微成像系统,包括照明模块、探测模块、控制模块及图像重建模块;A STED parallel microscopic imaging system based on structured light illumination, including an illumination module, a detection module, a control module and an image reconstruction module;

所述照明模块包括:激发光激光器、损耗光激光器、液晶空间光调制器、沃拉斯顿棱镜、第一透镜、通孔掩膜板、第二透镜、第一半波片、第二半波片、反射镜、第一二色镜、第二二色镜、筒镜、物镜及三维纳米位移台,所述三维纳米位移台可在XYZ三维方向移动,所述三维纳米位移台承载有待检测样品;The illumination module includes: an excitation light laser, a loss light laser, a liquid crystal spatial light modulator, a Wollaston prism, a first lens, a through-hole mask plate, a second lens, a first half-wave plate, a second half-wave sheet, reflecting mirror, first dichroic mirror, second dichroic mirror, tube lens, objective lens and three-dimensional nano-shift stage, the three-dimensional nano-shift stage can move in the XYZ three-dimensional direction, and the three-dimensional nano-shift stage carries the sample to be detected ;

所述探测模块包括滤光片、探测透镜以及面阵探测器,所述面阵探测器中的像素可形成虚拟针孔;The detection module includes an optical filter, a detection lens and an area array detector, and pixels in the area array detector can form a virtual pinhole;

所述控制模块电性连接于所述三维纳米位移台、面阵探测器以及液晶空间光调制器;所述图像重建模块电性连接于所述控制模块;其中:The control module is electrically connected to the three-dimensional nano-shift stage, the area array detector and the liquid crystal spatial light modulator; the image reconstruction module is electrically connected to the control module; wherein:

所述激发光激光器发出的高斯光束作为激发光,所述激发光入射到所述液晶空间光调制器,所述液晶空间光调制器对所述激发光进行调制生成衍射光,所述衍射光包括±1级衍射光和0级衍射光;所述衍射光经所述第一透镜聚焦后入射进入所述通孔掩膜板,所述通孔掩膜板遮挡所述0级衍射光,只允许所述±1级衍射光通过,所述±1级衍射光经所述第二透镜准直后再依次经所述第一半波片、所述反射镜、所述二色镜、所述第二二色镜及筒镜后进入所述物镜,并在所述物镜前焦面处进行干涉,生成干涉条纹状的激发结构光,所述激发结构光对样品进行照明激发;The Gaussian beam emitted by the excitation light laser is used as the excitation light, and the excitation light is incident on the liquid crystal spatial light modulator, and the liquid crystal spatial light modulator modulates the excitation light to generate diffracted light, and the diffracted light includes ±1st-order diffracted light and 0-order diffracted light; the diffracted light is incident on the through-hole mask after being focused by the first lens, and the through-hole mask blocks the 0-order diffracted light, allowing only The ±1st-order diffracted light passes through, and the ±1st-order diffracted light passes through the first half-wave plate, the reflecting mirror, the dichromatic mirror, and the first half-wave plate sequentially after being collimated by the second lens. The dichroic mirror and tube lens enter the objective lens, and interfere at the front focal plane of the objective lens to generate interference fringe-shaped excitation structured light, and the excitation structured light illuminates and excites the sample;

所述损耗光激光器发出的高斯光束作为损耗光,所述损耗光经所述沃拉斯顿棱镜损耗光分成两束偏振方向互相垂直的第一损耗光及第二损耗光,所述第一损耗光及第二损耗光经所述第二半波片后偏振方向相同,经所述第二半波片后的第一损耗光及第二损耗光再依次经所述第二二色镜和所述筒镜后进入所述物镜,并在所述物镜的前焦面处进行干涉,生成干涉条纹状的损耗结构光,所述损耗结构光对样品进行损耗;The Gaussian beam emitted by the lost light laser is used as the lost light, and the lost light is divided into two beams of the first lost light and the second lost light whose polarization directions are perpendicular to each other through the Wollaston prism. The light and the second loss light have the same polarization direction after passing through the second half-wave plate, and the first loss light and the second loss light after passing through the second half-wave plate pass through the second dichroic mirror and the second loss light sequentially. After the tube lens enters the objective lens, and interferes at the front focal plane of the objective lens to generate interference fringe-shaped loss structured light, the loss structured light depletes the sample;

样品经所述激发结构光的激发和损耗结构光的损耗,形成结构光光场,所述结构光光场依次经所述物镜、所述筒镜、所述第二二色镜、所述第一二色镜、所述滤光片及所述探测透镜,再在所述面阵探测器的感光面形成均匀条纹分布的图像,所述面阵探测器探测所述图像并通过所述虚拟针孔对所述图像进行空间滤波后将所述图像转化为电信号;The sample is excited by the excited structured light and lost by the loss of the structured light to form a structured light field, and the structured light field sequentially passes through the objective lens, the tube lens, the second dichromatic mirror, and the second dichromatic mirror. A dichroic mirror, the filter and the detection lens form an image with uniform fringe distribution on the photosensitive surface of the area array detector, and the area array detector detects the image and passes through the virtual needle converting the image into an electrical signal after performing spatial filtering on the image;

所述控制模块采集所述电信号,所述图像重建模块采用坐标定位及SIM频域频谱图融对所述电信号进行图像重建,实现基于结构光照明的STED并行显微成像。The control module collects the electrical signal, and the image reconstruction module reconstructs the image of the electrical signal by using coordinate positioning and SIM frequency-domain spectrogram fusion to realize STED parallel microscopic imaging based on structured light illumination.

在其中一些实施例中,所述液晶空间光调制器的感光面、所述物镜的前焦面、所述沃拉斯顿棱镜的出光平面和所述面阵探测器感光面处于共轭面。In some of the embodiments, the photosensitive surface of the liquid crystal spatial light modulator, the front focal plane of the objective lens, the light exit plane of the Wollaston prism and the photosensitive surface of the area array detector are in conjugate planes.

在其中一些实施例中,所述面阵探测器为CCD或CMOS相机中的一种。In some of the embodiments, the area detector is one of CCD or CMOS camera.

在其中一些实施例中,通过所述控制模块调整加载在液晶空间光调制器上的相位分布,可改变激发光光场的方向、周期和初相位,使得所述激发光结构光光场和损耗光结构光光场具有相同的方向和周期,初相位相差半个周期。In some of these embodiments, by adjusting the phase distribution loaded on the liquid crystal spatial light modulator through the control module, the direction, period and initial phase of the excitation light field can be changed, so that the excitation light structured light field and loss The optical structured light field has the same direction and period, and the initial phase difference is half a period.

本发明采用上述技术方案的优点是:The present invention adopts the advantage of above-mentioned technical scheme to be:

本发明提供的基于结构光照明的STED并行显微成像系统,通过对照明模块进行设计,将激发光激光器出射的一束激发光分成两束相干光,将损耗光激光器出射的一束损耗光分成两束相干光,通过干涉分别得到均匀分布的激发结构光和损耗结构光,激发结构光和损耗结构光并对样品进行激发和损耗,进行STED并行显微成像,再采用STED的坐标定位方法和SIM频域频谱图融合法进行图像重建,实现超分辨成像,有助于扩大STED显微系统的视场范围和成像速度。The STED parallel microscopic imaging system based on structured light illumination provided by the present invention divides a beam of excitation light emitted by the excitation light laser into two beams of coherent light by designing the illumination module, and divides a beam of depleted light emitted by the depletion laser into two beams of coherent light. Two beams of coherent light are obtained by interference to obtain uniformly distributed excitation structured light and loss structured light respectively, and then excite and deplete the sample for STED parallel microscopic imaging, and then use the STED coordinate positioning method and The SIM frequency-domain spectrogram fusion method is used for image reconstruction to realize super-resolution imaging, which is helpful to expand the field of view and imaging speed of the STED microscope system.

附图说明Description of drawings

图1为本发明实施例提供的基于结构光照明的STED并行显微成像系统结构示意图。FIG. 1 is a schematic structural diagram of a STED parallel microscopic imaging system based on structured light illumination provided by an embodiment of the present invention.

图2(a)为本发明实施例提供的激发结构光光场的结构示意图;Fig. 2 (a) is a schematic structural diagram of an excitation structured light light field provided by an embodiment of the present invention;

图2(b)为本发明实施例提供的损耗结构光光场的结构示意图;FIG. 2(b) is a schematic structural diagram of a lossy structured light field provided by an embodiment of the present invention;

图2(c)为本发明实施例提供的有效结构光光场的结构示意图;Fig. 2(c) is a schematic structural diagram of an effective structured light field provided by an embodiment of the present invention;

图3(a)为本发明实施例提供的面阵探测器上结构光的条纹状图像;Fig. 3 (a) is the striped image of structured light on the area array detector provided by the embodiment of the present invention;

图3(b)为本发明实施例提供的虚拟针孔的结构示意图;FIG. 3(b) is a schematic structural diagram of a virtual pinhole provided by an embodiment of the present invention;

图4(a)为本发明实施例提供的在频率域中将每幅二维图像的频域图进行融合的结构示意图;FIG. 4(a) is a schematic structural diagram of fusing frequency domain images of each two-dimensional image in the frequency domain provided by an embodiment of the present invention;

图4(b)为本发明实施例提供的经过逆傅里叶变换转换到空间域得到最终的超分辨图像的结构示意图。Fig. 4(b) is a schematic diagram of the structure of the final super-resolution image obtained through inverse Fourier transform transformation to the spatial domain provided by the embodiment of the present invention.

其中:照明模块110、探测模块120、控制模块130、图像重建模块140、激发光激光器111、损耗光激光器112、液晶空间光调制器113、沃拉斯顿棱镜114、第一透镜115、通孔掩膜板116、第二透镜117、第一半波片118、第二半波片119、反射镜1110、第一二色镜1111、第二二色镜1112、筒镜1113、物镜1114、三维纳米位移台1115、滤光片121、探测透镜122、面阵探测器123。Among them: illumination module 110, detection module 120, control module 130, image reconstruction module 140, excitation light laser 111, loss light laser 112, liquid crystal spatial light modulator 113, Wollaston prism 114, first lens 115, through hole Mask plate 116, second lens 117, first half-wave plate 118, second half-wave plate 119, mirror 1110, first dichroic mirror 1111, second dichromatic mirror 1112, tube lens 1113, objective lens 1114, three-dimensional Nano displacement stage 1115 , optical filter 121 , detection lens 122 , area array detector 123 .

具体实施方式Detailed ways

请参考图1,为本发明实施例提供的一种基于结构光照明的STED并行显微成像系统100,照明模块110、探测模块120、控制模块130及图像重建模块140。其中:Please refer to FIG. 1 , which is a STED parallel microscopic imaging system 100 based on structured light illumination provided by an embodiment of the present invention, an illumination module 110 , a detection module 120 , a control module 130 and an image reconstruction module 140 . in:

所述照明模块110包括:激发光激光器111、损耗光激光器112、液晶空间光调制器113、沃拉斯顿棱镜114、第一透镜115、通孔掩膜板116、第二透镜117、第一半波片118、第二半波片119、反射镜1110、第一二色镜1111、第二二色镜1112、筒镜1113、物镜1114及三维纳米位移台1115,所述三维纳米位移台1115可在XYZ三维方向移动,所述三维纳米位移台承载有待检测样品。The illumination module 110 includes: an excitation light laser 111, a loss light laser 112, a liquid crystal spatial light modulator 113, a Wollaston prism 114, a first lens 115, a through-hole mask 116, a second lens 117, a first Half-wave plate 118, second half-wave plate 119, mirror 1110, first dichroic mirror 1111, second dichromatic mirror 1112, tube lens 1113, objective lens 1114 and three-dimensional nano-displacement stage 1115, described three-dimensional nano-displacement stage 1115 It can move in the XYZ three-dimensional direction, and the three-dimensional nano-displacement platform carries the sample to be detected.

所述探测模块120包括滤光片121、探测透镜122以及面阵探测器123,所述面阵探测器123中的像素可形成虚拟针孔。The detection module 120 includes a filter 121 , a detection lens 122 and an area array detector 123 , and pixels in the area array detector 123 can form a virtual pinhole.

所述控制模块130电性连接于所述三维纳米位移台1115、面阵探测器123以及液晶空间光调制器113;所述图像重建模块140电性连接于所述控制模块130。The control module 130 is electrically connected to the three-dimensional nano-shift stage 1115 , the area array detector 123 and the liquid crystal spatial light modulator 113 ; the image reconstruction module 140 is electrically connected to the control module 130 .

以下详细说明本发明提供的基于结构光照明的STED并行显微成像系统100的工作原理:The working principle of the STED parallel microscopic imaging system 100 based on structured light illumination provided by the present invention is described in detail below:

所述激发光激光器111发出的高斯光束作为激发光,所述激发光111入射到所述液晶空间光调制器113,所述液晶空间光调制器113对所述激发光进行调制生成衍射光,所述衍射光包括±1级衍射光和0级衍射光;所述衍射光经所述第一透镜115聚焦后入射进入所述通孔掩膜板116,所述通孔掩膜板116遮挡所述0级衍射光,只允许所述±1级衍射光通过,所述±1级衍射光经所述第二透镜117准直后再依次经所述第一半波片118、所述反射镜1110、所述第一二色镜1111、所述第二二色镜1112及筒镜1113后进入所述物镜1114,并在所述物镜1114前焦面处进行干涉,生成干涉条纹状的激发结构光,所述激发结构光对样品进行照明激发;The Gaussian beam emitted by the excitation light laser 111 is used as the excitation light, and the excitation light 111 is incident on the liquid crystal spatial light modulator 113, and the liquid crystal spatial light modulator 113 modulates the excitation light to generate diffracted light, so The diffracted light includes ±1st-order diffracted light and 0-order diffracted light; the diffracted light enters the through-hole mask 116 after being focused by the first lens 115, and the through-hole mask 116 blocks the The 0-order diffracted light only allows the ±1-order diffracted light to pass through, and the ±1-order diffracted light is collimated by the second lens 117 and then passes through the first half-wave plate 118 and the mirror 1110 in turn. , the first dichroic mirror 1111, the second dichroic mirror 1112 and the tube lens 1113 enter the objective lens 1114, and interfere at the front focal plane of the objective lens 1114 to generate interference fringe-like excited structured light , the excited structured light illuminates and excites the sample;

所述损耗光激光器112发出的高斯光束作为损耗光,所述损耗光经所述沃拉斯顿棱镜114损耗光分成两束偏振方向互相垂直的第一损耗光及第二损耗光,所述第一损耗光及第二损耗光经所述第二半波片119后偏振方向相同,经所述第二半波片119后的第一损耗光及第二损耗光再依次经所述第二二色镜1112和所述筒镜1113后进入所述物镜1114,并在所述物镜1114的前焦面处进行干涉,生成干涉条纹状的损耗结构光,所述损耗结构光对样品进行损耗;The Gaussian beam emitted by the lost light laser 112 is used as the lost light, and the lost light is divided into two beams of the first lost light and the second lost light whose polarization directions are perpendicular to each other through the Wollaston prism 114. The first lost light and the second lost light have the same polarization direction after passing through the second half-wave plate 119, and the first lost light and the second lost light after passing through the second half-wave plate 119 pass through the second and second half-wave plates in turn. The color mirror 1112 and the tube lens 1113 enter the objective lens 1114, and interfere at the front focal plane of the objective lens 1114 to generate interference fringe-shaped loss structured light, and the loss structured light depletes the sample;

样品经所述激发结构光的激发和损耗结构光的损耗,形成结构光光场,所述结构光光场依次经所述物镜1114、所述筒镜1113、所述第二二色镜1112、所述第一二色镜1111、所述滤光片121及所述探测透镜122,再在所述面阵探测器122的感光面形成均匀条纹分布的图像,所述面阵探测器122探测所述图像并通过所述虚拟针孔对所述图像进行空间滤波后将所述图像转化为电信号;The sample is excited by the excitation structured light and lost by the loss of the structured light to form a structured light field, and the structured light field passes through the objective lens 1114, the tube lens 1113, the second dichroic mirror 1112, The first dichroic mirror 1111, the filter 121 and the detection lens 122 form an image with uniform fringe distribution on the photosensitive surface of the area array detector 122, and the area array detector 122 detects the converting the image into an electrical signal after performing spatial filtering on the image through the virtual pinhole;

所述控制模块130采集所述电信号,所述图像重建模块140采用坐标定位及SIM频域频谱图融对所述电信号进行图像重建,实现基于结构光照明的STED并行显微成像。The control module 130 collects the electrical signal, and the image reconstruction module 140 reconstructs the image of the electrical signal by using coordinate positioning and SIM frequency-domain spectrogram fusion to realize STED parallel microscopic imaging based on structured light illumination.

优选地,所述液晶空间光调制器113的感光面P1、物镜1114的前焦面P3、沃拉斯顿棱镜114出光平面P4和面阵探测器123感光面P5处于共轭面。Preferably, the photosensitive surface P1 of the liquid crystal spatial light modulator 113 , the front focal plane P3 of the objective lens 1114 , the light exit plane P4 of the Wollaston prism 114 and the photosensitive surface P5 of the area array detector 123 are in conjugate planes.

进一步地,面阵探测器123可以为CCD或CMOS相机,可以接收荧光样品中有效结构光的荧光信号,并将其转化为电信号;且面阵探测器123中的像素可以形成虚拟针孔,对探测到的结构光进行空间滤波。Further, the area array detector 123 can be a CCD or CMOS camera, which can receive the fluorescence signal of effective structured light in the fluorescent sample and convert it into an electrical signal; and the pixels in the area array detector 123 can form a virtual pinhole, Spatial filtering is performed on the detected structured light.

进一步地,由于所述控制模块140电性连接于所述三维纳米位移台1115、面阵探测器123以及液晶空间光调制器113,通过所述控制模块140可实现对所述三维纳米位移台1115、面阵探测器123以及液晶空间光调制器113的扫描控制,且所述控制模块130将采集电信号传输至所述图像重建模块140,所述图像重建模块140根据SIM频域频谱图融合法对所述电信号进行图像重建,实现基于结构光照明的STED并行显微成像。Further, since the control module 140 is electrically connected to the three-dimensional nano-displacement stage 1115, the area array detector 123 and the liquid crystal spatial light modulator 113, the three-dimensional nano-displacement stage 1115 can be controlled by the control module 140. , the scanning control of the area array detector 123 and the liquid crystal spatial light modulator 113, and the control module 130 transmits the collected electrical signal to the image reconstruction module 140, and the image reconstruction module 140 uses the SIM frequency domain spectrogram fusion method Image reconstruction is performed on the electrical signal to realize STED parallel microscopic imaging based on structured light illumination.

以下详细说明图像重建模块140采用坐标定位及SIM频域频谱图融对所述电信号进行图像重建,实现基于结构光照明的STED并行显微成像的工作过程:The image reconstruction module 140 uses coordinate positioning and SIM frequency-domain spectrogram fusion to reconstruct the image of the electrical signal, and realizes the working process of STED parallel microscopic imaging based on structured light illumination in detail below:

第一,并行探测有效结构光光场First, Parallel Detection of Effective Structured Light Fields

通过控制模块130调整加载在液晶空间光调制器113上的相位分布,改变激发光光场的方向、周期和初相位,使得激发光结构光光场和损耗光结构光光场具有相同的方向和周期,初相位相差半个周期;样品经过激发结构光的激发和损耗结构光的损耗后,形成有效结构光光场,该有效结构光光场依次经所述物镜1114、所述筒镜1113、所述第二二色镜1112、所述第一二色镜1111、所述滤光片121及所述探测透镜122,再在所述面阵探测器123的感光面形成均匀条纹分布的图像,从而实现并行光信号的探测收集,请参阅图2(a)、图2(b)及图2(c)分别表示为激发结构光光场,损耗结构光光场及有效结构光光场。The phase distribution loaded on the liquid crystal spatial light modulator 113 is adjusted by the control module 130, and the direction, period, and initial phase of the excitation light field are changed, so that the excitation light structured light field and the loss light structured light field have the same direction and period, the initial phase difference is half a period; the sample forms an effective structured light field after the excitation of the excited structured light and the loss of the loss structured light, and the effective structured light field passes through the objective lens 1114, the tube lens 1113, The second dichroic mirror 1112, the first dichroic mirror 1111, the filter 121 and the detection lens 122 form an image with uniform fringe distribution on the photosensitive surface of the area array detector 123, In order to realize the detection and collection of parallel optical signals, please refer to Fig. 2(a), Fig. 2(b) and Fig. 2(c) respectively representing the excited structured light field, the loss structured light field and the effective structured light field.

第二,获取给定结构光方向以及给定样本位置的STED图像Second, obtain the STED image of a given structured light direction and a given sample position

可以理解,给定结构光方向以及给定样本位置时,在面阵探测器123的感光面形成均匀条纹分布的图像中包含很多条光信号条纹,每条光信号条纹都对应一排虚拟针孔,如图3(a)和图3(b)分别为面阵探测器上结构光的条纹状图像和虚拟针孔,其中,长条状矩形代表一条条纹光强分布,小的正方形格子代表面阵探测器的像素,较大的正方形格子代表一个虚拟针孔(包含多个像素),虚拟针孔的排布位于光信号条纹的中央,抑制杂光干扰,将虚拟针孔中每个像素探测到的光强i叠加,可以得到样品中一点对应的STED图像像素值将每个光信号条纹对应的所有虚拟针孔进行同样的处理,可以得到样品中一行对应的STED图像像素值,将所有光信号条纹中的虚拟针孔都作相同的处理,将得到一幅像素值条状间隔分布的STED图像。It can be understood that when the direction of the structured light and the position of the sample are given, the image that forms a uniform stripe distribution on the photosensitive surface of the area array detector 123 contains many light signal stripes, and each light signal stripe corresponds to a row of virtual pinholes , Fig. 3(a) and Fig. 3(b) respectively show the striped image of structured light on the area array detector and the virtual pinhole, where the long striped rectangle represents the light intensity distribution of a strip, and the small square grid represents the surface The pixels of the array detector, the larger square grid represents a virtual pinhole (including multiple pixels), the arrangement of the virtual pinhole is located in the center of the light signal stripes, suppressing stray light interference, and detecting each pixel in the virtual pinhole The obtained light intensity i is superimposed, and the pixel value of the STED image corresponding to a point in the sample can be obtained Perform the same processing on all the virtual pinholes corresponding to each optical signal stripe to obtain the STED image pixel value corresponding to one row in the sample, and perform the same processing on the virtual pinholes in all optical signal stripes to obtain a pixel value STED image of the distribution of values in striped intervals.

第三,获取给定结构光方向下样本扫描后的STED图像Third, obtain the STED image of the sample after scanning in a given structured light direction

保持结构光(激发结构光及损耗结构光)方向不变,采用三维纳米位移台1115带动样本沿着垂直于结构光条纹方向分步移动,每个结构光条纹方向下总的移动次数为dp/ds-1,dp为条纹空间周期,ds为单次移动步距,位移台每停留一个位置,用面阵探测器123记录下该位置处的样本条纹状荧光图像,采用上述第二步的处理方法,将得到一幅像素值条状间隔分布的STED图像,这样一来,每一个结构光条纹方向下将得到dp/ds幅像素值条状间隔分布的STED图像,将这些图像叠加,生成对应于一个结构光条纹方向的一幅图像,将这种图像重建方法记为坐标定位法,该图像在与该结构光条纹相垂直的方向实现了超分辨成像。Keeping the direction of the structured light (excited structured light and depleted structured light) unchanged, the three-dimensional nano-shift stage 1115 is used to drive the sample to move step by step along the direction perpendicular to the structured light stripe, and the total number of times of movement in each structured light stripe direction is d p /d s -1, d p is the fringe spatial period, d s is the single moving step distance, each time the translation stage stays at a position, the area array detector 123 is used to record the sample stripe-shaped fluorescent image at this position, and the above-mentioned first The two-step processing method will obtain a STED image with pixel values distributed in strips and intervals. In this way, d p /d s STED images with pixel values distributed in strips and intervals will be obtained in each structured light stripe direction. These images are superimposed to generate an image corresponding to the direction of a structured light stripe. This image reconstruction method is recorded as a coordinate positioning method. The image realizes super-resolution imaging in a direction perpendicular to the structured light stripe.

第四,获取各个方向结构光下样本扫描后的STED图像Fourth, obtain the STED image of the sample scanned under structured light in all directions

旋转沃拉斯顿棱镜114,并相应地旋转液晶空间光调制器113上加载的相位图,使得物镜1114焦面处激发光和损耗光的结构光光场条纹能够位于不同的方向,生成不同方向的有效荧光结构光光场,对于各个方向的有效荧光结构光光场进行第三步和第二步相同的处理,可以得到结构光场各个方向上包含一维超分辨信息的二维图像。Rotate the Wollaston prism 114, and correspondingly rotate the phase diagram loaded on the liquid crystal spatial light modulator 113, so that the structured light field fringes of the excitation light and loss light at the focal plane of the objective lens 1114 can be located in different directions, and generate different directions The effective fluorescent structured light field of each direction, the third step and the second step are performed on the effective fluorescent structured light field in all directions, and a two-dimensional image containing one-dimensional super-resolution information in each direction of the structured light field can be obtained.

第五,经过SIM频域频谱融合得到超分辨图像Fifth, the super-resolution image is obtained through SIM frequency domain spectrum fusion

采用SIM频域频谱图融合法进行图像重建,先将第四步得到的多幅二维图像进行傅里叶变换转换到频率域,如图4(a)所示,在频率域中将每幅二维图像的频域图进行融合,如图4(b)所示,最后再经过逆傅里叶变换转换到空间域,得到最终的超分辨图像。The SIM frequency-domain spectrogram fusion method is used for image reconstruction. First, the multiple two-dimensional images obtained in the fourth step are transformed into the frequency domain by Fourier transform, as shown in Figure 4(a). In the frequency domain, each The frequency domain images of the two-dimensional images are fused, as shown in Figure 4(b), and finally converted to the spatial domain through inverse Fourier transform to obtain the final super-resolution image.

本发明提供的基于结构光照明的STED并行显微成像系统,通过对照明模块110进行设计,将激发光激光器111出射的一束激发光分成两束相干光,将损耗光激光器112出射的一束损耗光分成两束相干光,通过干涉分别得到均匀分布的激发结构光和损耗结构光,激发结构光和损耗结构光并对样品进行激发和损耗,进行STED并行显微成像,再采用STED的坐标定位方法和SIM频域频谱图融合法进行图像重建,实现超分辨成像,有助于扩大STED显微系统的视场范围和成像速度。In the STED parallel microscopic imaging system based on structured light illumination provided by the present invention, by designing the illumination module 110, one beam of excitation light emitted by the excitation light laser 111 is divided into two beams of coherent light, and one beam emitted by the lossy light laser 112 is The loss light is divided into two beams of coherent light, and uniformly distributed excitation structured light and loss structure light are obtained by interference, respectively, and the excitation and loss structure light are excited and lost to the sample, and STED parallel microscopic imaging is carried out, and then the coordinates of STED are used The positioning method and the SIM frequency-domain spectrogram fusion method are used for image reconstruction to realize super-resolution imaging, which is helpful to expand the field of view and imaging speed of the STED microscope system.

当然本发明的基于结构光照明的STED并行显微成像系统还可具有多种变换及改型,并不局限于上述实施方式的具体结构。总之,本发明的保护范围应包括那些对于本领域普通技术人员来说显而易见的变换或替代以及改型。Of course, the structured light illumination-based STED parallel microscopic imaging system of the present invention can also have various transformations and modifications, and is not limited to the specific structure of the above-mentioned embodiment. In a word, the protection scope of the present invention shall include those transformations, substitutions and modifications obvious to those skilled in the art.

Claims (4)

1. the parallel micro imaging systems of a kind of STED based on Structured Illumination, which is characterized in that including lighting module, detection mould Block, control module and image reconstruction module;
The lighting module includes:Excite light laser, loss light laser, LCD space light modulator, Wollaston prism, First lens, vias masks plate, the second lens, the first half-wave plate, the second half-wave plate, speculum, the first dichroic mirror, the two or two color Mirror, cylinder mirror, object lens and three-dimensional manometer displacement platform, the three-dimensional manometer displacement platform can be in XYZ three-dimensional direction movings, three wieners Rice displacement platform carries detected sample;
The detecting module includes optical filter, finder lens and planar array detector, and the pixel in the planar array detector can shape Into dummy pinhole;
The control module is electrically connected at the three-dimensional manometer displacement platform, planar array detector and LCD space light modulator; Described image rebuilds module and is electrically connected at the control module;Wherein:
For the Gaussian beam that the excitation light laser is sent as exciting light, the exciting light incides into the liquid crystal spatial light tune Device processed, the LCD space light modulator are modulated the exciting light generation diffraction light, and the diffraction light spreads out including ± 1 grade Penetrate light and 0 order diffraction light;The diffraction light is incident after first lens focus to enter the vias masks plate, the through hole 0 order diffraction light described in mask plate shielding only allows ± 1 order diffraction light by the way that ± 1 order diffraction light is saturating through described second It is laggard through first half-wave plate, the speculum, the dichroic mirror, second dichroic mirror and cylinder mirror successively again after mirror collimation Enter the object lens, and interfered at the object lens front focal plane, generate the excitation structure light of interference fringe shape, the excitation knot Structure light is illuminated sample excitation;
The Gaussian beam that the loss light laser is sent is lost as loss light, the loss light through the Wollaston prism Light is divided into the mutually perpendicular first loss light in two beam polarization directions and the second loss light, the first loss light and the second loss light It is identical through the second half-wave plate rear polarizer direction, after second half-wave plate first loss light and second loss light again according to It is secondary to enter the object lens after second dichroic mirror and the cylinder mirror, and interfered at the front focal plane of the object lens, it is raw Into the loss structure light of interference fringe shape, sample is lost in the loss structure light;
The loss of excitation and loss structure light of the sample through the excitation structure light, forms structure light light field, the structure light light Field is successively through the object lens, the cylinder mirror, second dichroic mirror, first dichroic mirror, the optical filter and the detection Lens, then form the image of uniform stripe distribution in the photosurface of the planar array detector, described in planar array detector detection Described image is simultaneously converted into electric signal after carrying out space filtering to described image by the dummy pinhole by image;
The control module gathers the electric signal, and described image rebuilds module and coordinate setting and SIM frequency-domain spectrum figures is used to melt Image reconstruction is carried out to the electric signal, realizes the parallel micro-imagings of STED based on Structured Illumination.
2. the parallel micro imaging systems of the STED according to claim 1 based on Structured Illumination, which is characterized in that described The photosurface of LCD space light modulator, the front focal plane of the object lens, the exit plane of the Wollaston prism and the face Array detector photosurface is in conjugate planes.
3. the parallel micro imaging systems of the STED according to claim 1 based on Structured Illumination, which is characterized in that described Planar array detector is the magazine one kind of CCD or CMOS.
4. the parallel micro imaging systems of the STED according to claim 1 based on Structured Illumination, which is characterized in that pass through Phase distribution of the control module adjustment loading on LCD space light modulator can change direction, the week of exciting light light field Phase and initial phase so that the exciting light structure light light field and loss photo structure light light field have identical direction and cycle, just Phase differs half period.
CN201711150961.0A 2017-11-18 2017-11-18 STED (stimulated emission depletion) parallel microscopic imaging system based on structured light illumination Active CN108121059B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201711150961.0A CN108121059B (en) 2017-11-18 2017-11-18 STED (stimulated emission depletion) parallel microscopic imaging system based on structured light illumination

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201711150961.0A CN108121059B (en) 2017-11-18 2017-11-18 STED (stimulated emission depletion) parallel microscopic imaging system based on structured light illumination

Publications (2)

Publication Number Publication Date
CN108121059A true CN108121059A (en) 2018-06-05
CN108121059B CN108121059B (en) 2022-01-28

Family

ID=62227841

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201711150961.0A Active CN108121059B (en) 2017-11-18 2017-11-18 STED (stimulated emission depletion) parallel microscopic imaging system based on structured light illumination

Country Status (1)

Country Link
CN (1) CN108121059B (en)

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108957720A (en) * 2018-09-26 2018-12-07 中国科学院化学研究所 Lighting system and STED optical microscopy for STED optical microscopy
CN109739016A (en) * 2019-01-16 2019-05-10 中国科学院苏州生物医学工程技术研究所 Fast 3D imaging system and synchronization control method based on structured light illumination microscope
CN109856789A (en) * 2019-02-26 2019-06-07 中国科学院苏州生物医学工程技术研究所 High intension super-resolution integration micro imaging system and method
CN112326672A (en) * 2020-11-06 2021-02-05 之江实验室 A Fast Imaging System Based on Multicolor Parallel Frequency Shift Illumination
CN117451683A (en) * 2023-12-20 2024-01-26 深圳赛陆医疗科技有限公司 Super-resolution microscopic imaging system, imaging method of sample to be detected and gene sequencer
WO2024144454A1 (en) * 2022-12-27 2024-07-04 National University Of Singapore System and method for image reconstruction using structured illumination microscopy

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103487421A (en) * 2013-09-29 2014-01-01 浙江大学 Super-resolution microscopic method and device of time-gated wide-field stimulated emission
CN104296685A (en) * 2014-11-05 2015-01-21 哈尔滨工业大学 Device and method for measuring smooth free-form surface sample based on differential STED
CN105182523A (en) * 2015-09-23 2015-12-23 北京大学 STED super-resolution microscope based on first-order Bessel beams and adjustment method thereof
CN107014795A (en) * 2017-05-10 2017-08-04 中国科学院苏州生物医学工程技术研究所 A kind of burnt parallel micro imaging system of the copolymerization based on homogeneous texture optical illumination

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103487421A (en) * 2013-09-29 2014-01-01 浙江大学 Super-resolution microscopic method and device of time-gated wide-field stimulated emission
CN104296685A (en) * 2014-11-05 2015-01-21 哈尔滨工业大学 Device and method for measuring smooth free-form surface sample based on differential STED
CN105182523A (en) * 2015-09-23 2015-12-23 北京大学 STED super-resolution microscope based on first-order Bessel beams and adjustment method thereof
WO2017049752A1 (en) * 2015-09-23 2017-03-30 北京大学 Sted super-resolution microscope based on a first-order bessel beam, and adjusting method
CN107014795A (en) * 2017-05-10 2017-08-04 中国科学院苏州生物医学工程技术研究所 A kind of burnt parallel micro imaging system of the copolymerization based on homogeneous texture optical illumination

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108957720A (en) * 2018-09-26 2018-12-07 中国科学院化学研究所 Lighting system and STED optical microscopy for STED optical microscopy
US11726309B2 (en) 2018-09-26 2023-08-15 Institute Of Chemistry Chinese Academy Of Sciences Illumination system for STED optical microscope and STED optical microscope
CN109739016A (en) * 2019-01-16 2019-05-10 中国科学院苏州生物医学工程技术研究所 Fast 3D imaging system and synchronization control method based on structured light illumination microscope
CN109856789A (en) * 2019-02-26 2019-06-07 中国科学院苏州生物医学工程技术研究所 High intension super-resolution integration micro imaging system and method
CN112326672A (en) * 2020-11-06 2021-02-05 之江实验室 A Fast Imaging System Based on Multicolor Parallel Frequency Shift Illumination
CN112326672B (en) * 2020-11-06 2023-12-19 之江实验室 A fast imaging system based on multi-color parallel frequency-shifted illumination
WO2024144454A1 (en) * 2022-12-27 2024-07-04 National University Of Singapore System and method for image reconstruction using structured illumination microscopy
CN117451683A (en) * 2023-12-20 2024-01-26 深圳赛陆医疗科技有限公司 Super-resolution microscopic imaging system, imaging method of sample to be detected and gene sequencer
CN117451683B (en) * 2023-12-20 2024-03-08 深圳赛陆医疗科技有限公司 Super-resolution microscopic imaging system, imaging method of sample to be detected and gene sequencer

Also Published As

Publication number Publication date
CN108121059B (en) 2022-01-28

Similar Documents

Publication Publication Date Title
CN108121059A (en) A kind of parallel micro imaging systems of STED based on Structured Illumination
CN108181235A (en) A kind of parallel micro imaging systems of STED based on homogeneous texture optical illumination
CN108982452B (en) Multifocal scanning 3D imaging method and system based on double helix point spread function
CN108680544B (en) Structured illumination light slice fluorescence microscopic imaging method and device
US8019136B2 (en) Optical sectioning microscopy
US6909105B1 (en) Method and device for representing an object
CN110262026B (en) Aperture scanning Fourier ptychographic imaging
US9075013B2 (en) Apparatus and methods for microscopy having resolution beyond the Abbe limit
CN107014795B (en) Confocal parallel microscopic imaging system based on uniform structured light illumination
CN110954523A (en) A two-photon scanning structured light microscopy imaging method and device
DE112009001652T5 (en) Multichannel recording
CN111103678B (en) Lattice light sheet microscope and method for tiling lattice light sheets in a lattice light sheet microscope
JP7181537B2 (en) Time-resolved imaging method with high spatial resolution
CN105510290A (en) Non-linear super-resolution microscopic method and device adopting photon recombination
CN114594588B (en) Structured light illumination microscopic device and method based on grating projection and SLM phase shift
CN103941568B (en) The automatic super-resolution digital hologram imaging device of multidimensional and method
US20250013026A1 (en) Multi-focal light-sheet structured illumination fluorescence microscopy system
AU2018352821A1 (en) Image reconstruction method, device and microscopic imaging device
CN113504700B (en) Atomic time imaging device and method based on all-optical grid principle
CN107272218B (en) High speed structured light imaging system
CN116183568B (en) High-fidelity reconstruction method and device for three-dimensional structured light illumination super-resolution microscopic imaging
CN107678151A (en) The burnt parallel microscopic imaging apparatus of copolymerization based on interference array light field
CN113702288A (en) Bimodal microscopic imaging system and imaging method thereof
CN104570620B (en) A kind of angle pencil of ray scanning exposure method
RU2579640C1 (en) Confocal image spectrum analyser

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Kolding road high tech Zone of Suzhou City, Jiangsu province 215163 No. 78 Building No. 7 room 205

Applicant after: Suzhou Guoke medical technology development (Group) Co., Ltd

Applicant after: Suzhou Institute of Biomedical Engineering and Technology Chinese Academy of Sciences

Address before: Kolding road high tech Zone of Suzhou City, Jiangsu province 215163 No. 78 Building No. 7 room 205

Applicant before: SUZHOU GUOKE MEDICAL TECHNOLOGY DEVELOPMENT Co.,Ltd.

Applicant before: Suzhou Institute of Biomedical Engineering and Technology Chinese Academy of Sciences

GR01 Patent grant
GR01 Patent grant