CN108121059A - A kind of parallel micro imaging systems of STED based on Structured Illumination - Google Patents
A kind of parallel micro imaging systems of STED based on Structured Illumination Download PDFInfo
- Publication number
- CN108121059A CN108121059A CN201711150961.0A CN201711150961A CN108121059A CN 108121059 A CN108121059 A CN 108121059A CN 201711150961 A CN201711150961 A CN 201711150961A CN 108121059 A CN108121059 A CN 108121059A
- Authority
- CN
- China
- Prior art keywords
- light
- loss
- sted
- excitation
- lens
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 46
- 238000005286 illumination Methods 0.000 title claims abstract description 29
- 230000005284 excitation Effects 0.000 claims abstract description 39
- 238000001514 detection method Methods 0.000 claims description 17
- 239000004973 liquid crystal related substance Substances 0.000 claims description 17
- 238000006073 displacement reaction Methods 0.000 claims description 10
- 230000003287 optical effect Effects 0.000 claims description 9
- 230000010287 polarization Effects 0.000 claims description 5
- 238000001914 filtration Methods 0.000 claims description 4
- 238000001228 spectrum Methods 0.000 claims description 2
- 240000007594 Oryza sativa Species 0.000 claims 1
- 235000007164 Oryza sativa Nutrition 0.000 claims 1
- 235000009566 rice Nutrition 0.000 claims 1
- 238000009738 saturating Methods 0.000 claims 1
- 238000000034 method Methods 0.000 abstract description 9
- 230000001427 coherent effect Effects 0.000 abstract description 8
- 238000007500 overflow downdraw method Methods 0.000 abstract description 5
- 238000010586 diagram Methods 0.000 description 7
- 238000005516 engineering process Methods 0.000 description 4
- 230000004927 fusion Effects 0.000 description 4
- 230000009466 transformation Effects 0.000 description 3
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000012545 processing Methods 0.000 description 2
- 238000000844 transformation Methods 0.000 description 2
- 102000016751 Fringe-like Human genes 0.000 description 1
- 108050006300 Fringe-like Proteins 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000000694 effects Effects 0.000 description 1
- 238000004519 manufacturing process Methods 0.000 description 1
- 238000010587 phase diagram Methods 0.000 description 1
- 238000003672 processing method Methods 0.000 description 1
- 230000005855 radiation Effects 0.000 description 1
- 238000011160 research Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
- 238000013519 translation Methods 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0032—Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/06—Means for illuminating specimens
Landscapes
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Microscoopes, Condenser (AREA)
Abstract
本发明提供的基于结构光照明的STED并行显微成像系统,通过对照明模块进行设计,将激发光激光器出射的一束激发光分成两束相干光,将损耗光激光器出射的一束损耗光分成两束相干光,通过干涉分别得到均匀分布的激发结构光和损耗结构光,激发结构光和损耗结构光并对样品进行激发和损耗,进行STED并行显微成像,再采用STED的坐标定位方法和SIM频域频谱图融合法进行图像重建,实现超分辨成像,有助于扩大STED显微系统的视场范围和成像速度。
The STED parallel microscopic imaging system based on structured light illumination provided by the present invention divides a beam of excitation light emitted by the excitation light laser into two beams of coherent light by designing the illumination module, and divides a beam of depleted light emitted by the depletion laser into two beams of coherent light. Two beams of coherent light are obtained by interference to obtain uniformly distributed excitation structured light and loss structured light respectively, and then excite and deplete the sample for STED parallel microscopic imaging, and then use the STED coordinate positioning method and The SIM frequency-domain spectrogram fusion method is used for image reconstruction to realize super-resolution imaging, which is helpful to expand the field of view and imaging speed of the STED microscope system.
Description
技术领域technical field
本发明涉及显微检测仪器设计及制造领域,尤其是涉及一种基于结构光照明的STED并行显微成像系统。The invention relates to the field of design and manufacture of microscopic detection instruments, in particular to a STED parallel microscopic imaging system based on structured light illumination.
背景技术Background technique
超分辨显微成像技术是一种用于生物等研究领域中的前沿技术,主要分为坐标定位类和坐标随机类两大类显微成像方法。其中坐标定位类显微成像方法中的典型代表为受激辐射损耗(STED)显微成像,STED显微成像直接采用光学方法,对样品进行逐点扫描,实现超分辨成像。但受单点扫描方式的限制,STED显微成像的成像速度比较慢。Super-resolution microscopic imaging technology is a cutting-edge technology used in biological and other research fields. It is mainly divided into two types of microscopic imaging methods: coordinate positioning and coordinate random. Among them, the typical representative of the coordinate positioning microscopic imaging method is stimulated radiation depletion (STED) microscopic imaging. STED microscopic imaging directly uses optical methods to scan the sample point by point to achieve super-resolution imaging. However, limited by the single-point scanning method, the imaging speed of STED microscopic imaging is relatively slow.
近年来,为提高STED显微成像技术的成像速度,STED并行显微成像被提出。其中效果较好的是采用二维结构光照明模式,明显提高了成像速度。但是由于二维结构光的加入,导致成像系统复杂度变高,并且该技术中激发光没有采用结构光模式而采用宽场激发,使得有效荧光的信噪比显著降低,影响了成像分辨率。In recent years, in order to improve the imaging speed of STED microscopic imaging technology, STED parallel microscopic imaging has been proposed. Among them, the better effect is the use of two-dimensional structured light illumination mode, which significantly improves the imaging speed. However, due to the addition of two-dimensional structured light, the complexity of the imaging system becomes higher, and the excitation light in this technology does not use structured light mode but wide-field excitation, which significantly reduces the signal-to-noise ratio of effective fluorescence and affects the imaging resolution.
发明内容Contents of the invention
本发明的目的是:The purpose of the present invention is:
提供一种成像分辨率高且成像速度快的基于结构光照明的STED并行显微成像系统。A structured light illumination-based STED parallel microscopic imaging system with high imaging resolution and fast imaging speed is provided.
为实现上述目的,本发明采用下述技术方案:To achieve the above object, the present invention adopts the following technical solutions:
一种基于结构光照明的STED并行显微成像系统,包括照明模块、探测模块、控制模块及图像重建模块;A STED parallel microscopic imaging system based on structured light illumination, including an illumination module, a detection module, a control module and an image reconstruction module;
所述照明模块包括:激发光激光器、损耗光激光器、液晶空间光调制器、沃拉斯顿棱镜、第一透镜、通孔掩膜板、第二透镜、第一半波片、第二半波片、反射镜、第一二色镜、第二二色镜、筒镜、物镜及三维纳米位移台,所述三维纳米位移台可在XYZ三维方向移动,所述三维纳米位移台承载有待检测样品;The illumination module includes: an excitation light laser, a loss light laser, a liquid crystal spatial light modulator, a Wollaston prism, a first lens, a through-hole mask plate, a second lens, a first half-wave plate, a second half-wave sheet, reflecting mirror, first dichroic mirror, second dichroic mirror, tube lens, objective lens and three-dimensional nano-shift stage, the three-dimensional nano-shift stage can move in the XYZ three-dimensional direction, and the three-dimensional nano-shift stage carries the sample to be detected ;
所述探测模块包括滤光片、探测透镜以及面阵探测器,所述面阵探测器中的像素可形成虚拟针孔;The detection module includes an optical filter, a detection lens and an area array detector, and pixels in the area array detector can form a virtual pinhole;
所述控制模块电性连接于所述三维纳米位移台、面阵探测器以及液晶空间光调制器;所述图像重建模块电性连接于所述控制模块;其中:The control module is electrically connected to the three-dimensional nano-shift stage, the area array detector and the liquid crystal spatial light modulator; the image reconstruction module is electrically connected to the control module; wherein:
所述激发光激光器发出的高斯光束作为激发光,所述激发光入射到所述液晶空间光调制器,所述液晶空间光调制器对所述激发光进行调制生成衍射光,所述衍射光包括±1级衍射光和0级衍射光;所述衍射光经所述第一透镜聚焦后入射进入所述通孔掩膜板,所述通孔掩膜板遮挡所述0级衍射光,只允许所述±1级衍射光通过,所述±1级衍射光经所述第二透镜准直后再依次经所述第一半波片、所述反射镜、所述二色镜、所述第二二色镜及筒镜后进入所述物镜,并在所述物镜前焦面处进行干涉,生成干涉条纹状的激发结构光,所述激发结构光对样品进行照明激发;The Gaussian beam emitted by the excitation light laser is used as the excitation light, and the excitation light is incident on the liquid crystal spatial light modulator, and the liquid crystal spatial light modulator modulates the excitation light to generate diffracted light, and the diffracted light includes ±1st-order diffracted light and 0-order diffracted light; the diffracted light is incident on the through-hole mask after being focused by the first lens, and the through-hole mask blocks the 0-order diffracted light, allowing only The ±1st-order diffracted light passes through, and the ±1st-order diffracted light passes through the first half-wave plate, the reflecting mirror, the dichromatic mirror, and the first half-wave plate sequentially after being collimated by the second lens. The dichroic mirror and tube lens enter the objective lens, and interfere at the front focal plane of the objective lens to generate interference fringe-shaped excitation structured light, and the excitation structured light illuminates and excites the sample;
所述损耗光激光器发出的高斯光束作为损耗光,所述损耗光经所述沃拉斯顿棱镜损耗光分成两束偏振方向互相垂直的第一损耗光及第二损耗光,所述第一损耗光及第二损耗光经所述第二半波片后偏振方向相同,经所述第二半波片后的第一损耗光及第二损耗光再依次经所述第二二色镜和所述筒镜后进入所述物镜,并在所述物镜的前焦面处进行干涉,生成干涉条纹状的损耗结构光,所述损耗结构光对样品进行损耗;The Gaussian beam emitted by the lost light laser is used as the lost light, and the lost light is divided into two beams of the first lost light and the second lost light whose polarization directions are perpendicular to each other through the Wollaston prism. The light and the second loss light have the same polarization direction after passing through the second half-wave plate, and the first loss light and the second loss light after passing through the second half-wave plate pass through the second dichroic mirror and the second loss light sequentially. After the tube lens enters the objective lens, and interferes at the front focal plane of the objective lens to generate interference fringe-shaped loss structured light, the loss structured light depletes the sample;
样品经所述激发结构光的激发和损耗结构光的损耗,形成结构光光场,所述结构光光场依次经所述物镜、所述筒镜、所述第二二色镜、所述第一二色镜、所述滤光片及所述探测透镜,再在所述面阵探测器的感光面形成均匀条纹分布的图像,所述面阵探测器探测所述图像并通过所述虚拟针孔对所述图像进行空间滤波后将所述图像转化为电信号;The sample is excited by the excited structured light and lost by the loss of the structured light to form a structured light field, and the structured light field sequentially passes through the objective lens, the tube lens, the second dichromatic mirror, and the second dichromatic mirror. A dichroic mirror, the filter and the detection lens form an image with uniform fringe distribution on the photosensitive surface of the area array detector, and the area array detector detects the image and passes through the virtual needle converting the image into an electrical signal after performing spatial filtering on the image;
所述控制模块采集所述电信号,所述图像重建模块采用坐标定位及SIM频域频谱图融对所述电信号进行图像重建,实现基于结构光照明的STED并行显微成像。The control module collects the electrical signal, and the image reconstruction module reconstructs the image of the electrical signal by using coordinate positioning and SIM frequency-domain spectrogram fusion to realize STED parallel microscopic imaging based on structured light illumination.
在其中一些实施例中,所述液晶空间光调制器的感光面、所述物镜的前焦面、所述沃拉斯顿棱镜的出光平面和所述面阵探测器感光面处于共轭面。In some of the embodiments, the photosensitive surface of the liquid crystal spatial light modulator, the front focal plane of the objective lens, the light exit plane of the Wollaston prism and the photosensitive surface of the area array detector are in conjugate planes.
在其中一些实施例中,所述面阵探测器为CCD或CMOS相机中的一种。In some of the embodiments, the area detector is one of CCD or CMOS camera.
在其中一些实施例中,通过所述控制模块调整加载在液晶空间光调制器上的相位分布,可改变激发光光场的方向、周期和初相位,使得所述激发光结构光光场和损耗光结构光光场具有相同的方向和周期,初相位相差半个周期。In some of these embodiments, by adjusting the phase distribution loaded on the liquid crystal spatial light modulator through the control module, the direction, period and initial phase of the excitation light field can be changed, so that the excitation light structured light field and loss The optical structured light field has the same direction and period, and the initial phase difference is half a period.
本发明采用上述技术方案的优点是:The present invention adopts the advantage of above-mentioned technical scheme to be:
本发明提供的基于结构光照明的STED并行显微成像系统,通过对照明模块进行设计,将激发光激光器出射的一束激发光分成两束相干光,将损耗光激光器出射的一束损耗光分成两束相干光,通过干涉分别得到均匀分布的激发结构光和损耗结构光,激发结构光和损耗结构光并对样品进行激发和损耗,进行STED并行显微成像,再采用STED的坐标定位方法和SIM频域频谱图融合法进行图像重建,实现超分辨成像,有助于扩大STED显微系统的视场范围和成像速度。The STED parallel microscopic imaging system based on structured light illumination provided by the present invention divides a beam of excitation light emitted by the excitation light laser into two beams of coherent light by designing the illumination module, and divides a beam of depleted light emitted by the depletion laser into two beams of coherent light. Two beams of coherent light are obtained by interference to obtain uniformly distributed excitation structured light and loss structured light respectively, and then excite and deplete the sample for STED parallel microscopic imaging, and then use the STED coordinate positioning method and The SIM frequency-domain spectrogram fusion method is used for image reconstruction to realize super-resolution imaging, which is helpful to expand the field of view and imaging speed of the STED microscope system.
附图说明Description of drawings
图1为本发明实施例提供的基于结构光照明的STED并行显微成像系统结构示意图。FIG. 1 is a schematic structural diagram of a STED parallel microscopic imaging system based on structured light illumination provided by an embodiment of the present invention.
图2(a)为本发明实施例提供的激发结构光光场的结构示意图;Fig. 2 (a) is a schematic structural diagram of an excitation structured light light field provided by an embodiment of the present invention;
图2(b)为本发明实施例提供的损耗结构光光场的结构示意图;FIG. 2(b) is a schematic structural diagram of a lossy structured light field provided by an embodiment of the present invention;
图2(c)为本发明实施例提供的有效结构光光场的结构示意图;Fig. 2(c) is a schematic structural diagram of an effective structured light field provided by an embodiment of the present invention;
图3(a)为本发明实施例提供的面阵探测器上结构光的条纹状图像;Fig. 3 (a) is the striped image of structured light on the area array detector provided by the embodiment of the present invention;
图3(b)为本发明实施例提供的虚拟针孔的结构示意图;FIG. 3(b) is a schematic structural diagram of a virtual pinhole provided by an embodiment of the present invention;
图4(a)为本发明实施例提供的在频率域中将每幅二维图像的频域图进行融合的结构示意图;FIG. 4(a) is a schematic structural diagram of fusing frequency domain images of each two-dimensional image in the frequency domain provided by an embodiment of the present invention;
图4(b)为本发明实施例提供的经过逆傅里叶变换转换到空间域得到最终的超分辨图像的结构示意图。Fig. 4(b) is a schematic diagram of the structure of the final super-resolution image obtained through inverse Fourier transform transformation to the spatial domain provided by the embodiment of the present invention.
其中:照明模块110、探测模块120、控制模块130、图像重建模块140、激发光激光器111、损耗光激光器112、液晶空间光调制器113、沃拉斯顿棱镜114、第一透镜115、通孔掩膜板116、第二透镜117、第一半波片118、第二半波片119、反射镜1110、第一二色镜1111、第二二色镜1112、筒镜1113、物镜1114、三维纳米位移台1115、滤光片121、探测透镜122、面阵探测器123。Among them: illumination module 110, detection module 120, control module 130, image reconstruction module 140, excitation light laser 111, loss light laser 112, liquid crystal spatial light modulator 113, Wollaston prism 114, first lens 115, through hole Mask plate 116, second lens 117, first half-wave plate 118, second half-wave plate 119, mirror 1110, first dichroic mirror 1111, second dichromatic mirror 1112, tube lens 1113, objective lens 1114, three-dimensional Nano displacement stage 1115 , optical filter 121 , detection lens 122 , area array detector 123 .
具体实施方式Detailed ways
请参考图1,为本发明实施例提供的一种基于结构光照明的STED并行显微成像系统100,照明模块110、探测模块120、控制模块130及图像重建模块140。其中:Please refer to FIG. 1 , which is a STED parallel microscopic imaging system 100 based on structured light illumination provided by an embodiment of the present invention, an illumination module 110 , a detection module 120 , a control module 130 and an image reconstruction module 140 . in:
所述照明模块110包括:激发光激光器111、损耗光激光器112、液晶空间光调制器113、沃拉斯顿棱镜114、第一透镜115、通孔掩膜板116、第二透镜117、第一半波片118、第二半波片119、反射镜1110、第一二色镜1111、第二二色镜1112、筒镜1113、物镜1114及三维纳米位移台1115,所述三维纳米位移台1115可在XYZ三维方向移动,所述三维纳米位移台承载有待检测样品。The illumination module 110 includes: an excitation light laser 111, a loss light laser 112, a liquid crystal spatial light modulator 113, a Wollaston prism 114, a first lens 115, a through-hole mask 116, a second lens 117, a first Half-wave plate 118, second half-wave plate 119, mirror 1110, first dichroic mirror 1111, second dichromatic mirror 1112, tube lens 1113, objective lens 1114 and three-dimensional nano-displacement stage 1115, described three-dimensional nano-displacement stage 1115 It can move in the XYZ three-dimensional direction, and the three-dimensional nano-displacement platform carries the sample to be detected.
所述探测模块120包括滤光片121、探测透镜122以及面阵探测器123,所述面阵探测器123中的像素可形成虚拟针孔。The detection module 120 includes a filter 121 , a detection lens 122 and an area array detector 123 , and pixels in the area array detector 123 can form a virtual pinhole.
所述控制模块130电性连接于所述三维纳米位移台1115、面阵探测器123以及液晶空间光调制器113;所述图像重建模块140电性连接于所述控制模块130。The control module 130 is electrically connected to the three-dimensional nano-shift stage 1115 , the area array detector 123 and the liquid crystal spatial light modulator 113 ; the image reconstruction module 140 is electrically connected to the control module 130 .
以下详细说明本发明提供的基于结构光照明的STED并行显微成像系统100的工作原理:The working principle of the STED parallel microscopic imaging system 100 based on structured light illumination provided by the present invention is described in detail below:
所述激发光激光器111发出的高斯光束作为激发光,所述激发光111入射到所述液晶空间光调制器113,所述液晶空间光调制器113对所述激发光进行调制生成衍射光,所述衍射光包括±1级衍射光和0级衍射光;所述衍射光经所述第一透镜115聚焦后入射进入所述通孔掩膜板116,所述通孔掩膜板116遮挡所述0级衍射光,只允许所述±1级衍射光通过,所述±1级衍射光经所述第二透镜117准直后再依次经所述第一半波片118、所述反射镜1110、所述第一二色镜1111、所述第二二色镜1112及筒镜1113后进入所述物镜1114,并在所述物镜1114前焦面处进行干涉,生成干涉条纹状的激发结构光,所述激发结构光对样品进行照明激发;The Gaussian beam emitted by the excitation light laser 111 is used as the excitation light, and the excitation light 111 is incident on the liquid crystal spatial light modulator 113, and the liquid crystal spatial light modulator 113 modulates the excitation light to generate diffracted light, so The diffracted light includes ±1st-order diffracted light and 0-order diffracted light; the diffracted light enters the through-hole mask 116 after being focused by the first lens 115, and the through-hole mask 116 blocks the The 0-order diffracted light only allows the ±1-order diffracted light to pass through, and the ±1-order diffracted light is collimated by the second lens 117 and then passes through the first half-wave plate 118 and the mirror 1110 in turn. , the first dichroic mirror 1111, the second dichroic mirror 1112 and the tube lens 1113 enter the objective lens 1114, and interfere at the front focal plane of the objective lens 1114 to generate interference fringe-like excited structured light , the excited structured light illuminates and excites the sample;
所述损耗光激光器112发出的高斯光束作为损耗光,所述损耗光经所述沃拉斯顿棱镜114损耗光分成两束偏振方向互相垂直的第一损耗光及第二损耗光,所述第一损耗光及第二损耗光经所述第二半波片119后偏振方向相同,经所述第二半波片119后的第一损耗光及第二损耗光再依次经所述第二二色镜1112和所述筒镜1113后进入所述物镜1114,并在所述物镜1114的前焦面处进行干涉,生成干涉条纹状的损耗结构光,所述损耗结构光对样品进行损耗;The Gaussian beam emitted by the lost light laser 112 is used as the lost light, and the lost light is divided into two beams of the first lost light and the second lost light whose polarization directions are perpendicular to each other through the Wollaston prism 114. The first lost light and the second lost light have the same polarization direction after passing through the second half-wave plate 119, and the first lost light and the second lost light after passing through the second half-wave plate 119 pass through the second and second half-wave plates in turn. The color mirror 1112 and the tube lens 1113 enter the objective lens 1114, and interfere at the front focal plane of the objective lens 1114 to generate interference fringe-shaped loss structured light, and the loss structured light depletes the sample;
样品经所述激发结构光的激发和损耗结构光的损耗,形成结构光光场,所述结构光光场依次经所述物镜1114、所述筒镜1113、所述第二二色镜1112、所述第一二色镜1111、所述滤光片121及所述探测透镜122,再在所述面阵探测器122的感光面形成均匀条纹分布的图像,所述面阵探测器122探测所述图像并通过所述虚拟针孔对所述图像进行空间滤波后将所述图像转化为电信号;The sample is excited by the excitation structured light and lost by the loss of the structured light to form a structured light field, and the structured light field passes through the objective lens 1114, the tube lens 1113, the second dichroic mirror 1112, The first dichroic mirror 1111, the filter 121 and the detection lens 122 form an image with uniform fringe distribution on the photosensitive surface of the area array detector 122, and the area array detector 122 detects the converting the image into an electrical signal after performing spatial filtering on the image through the virtual pinhole;
所述控制模块130采集所述电信号,所述图像重建模块140采用坐标定位及SIM频域频谱图融对所述电信号进行图像重建,实现基于结构光照明的STED并行显微成像。The control module 130 collects the electrical signal, and the image reconstruction module 140 reconstructs the image of the electrical signal by using coordinate positioning and SIM frequency-domain spectrogram fusion to realize STED parallel microscopic imaging based on structured light illumination.
优选地,所述液晶空间光调制器113的感光面P1、物镜1114的前焦面P3、沃拉斯顿棱镜114出光平面P4和面阵探测器123感光面P5处于共轭面。Preferably, the photosensitive surface P1 of the liquid crystal spatial light modulator 113 , the front focal plane P3 of the objective lens 1114 , the light exit plane P4 of the Wollaston prism 114 and the photosensitive surface P5 of the area array detector 123 are in conjugate planes.
进一步地,面阵探测器123可以为CCD或CMOS相机,可以接收荧光样品中有效结构光的荧光信号,并将其转化为电信号;且面阵探测器123中的像素可以形成虚拟针孔,对探测到的结构光进行空间滤波。Further, the area array detector 123 can be a CCD or CMOS camera, which can receive the fluorescence signal of effective structured light in the fluorescent sample and convert it into an electrical signal; and the pixels in the area array detector 123 can form a virtual pinhole, Spatial filtering is performed on the detected structured light.
进一步地,由于所述控制模块140电性连接于所述三维纳米位移台1115、面阵探测器123以及液晶空间光调制器113,通过所述控制模块140可实现对所述三维纳米位移台1115、面阵探测器123以及液晶空间光调制器113的扫描控制,且所述控制模块130将采集电信号传输至所述图像重建模块140,所述图像重建模块140根据SIM频域频谱图融合法对所述电信号进行图像重建,实现基于结构光照明的STED并行显微成像。Further, since the control module 140 is electrically connected to the three-dimensional nano-displacement stage 1115, the area array detector 123 and the liquid crystal spatial light modulator 113, the three-dimensional nano-displacement stage 1115 can be controlled by the control module 140. , the scanning control of the area array detector 123 and the liquid crystal spatial light modulator 113, and the control module 130 transmits the collected electrical signal to the image reconstruction module 140, and the image reconstruction module 140 uses the SIM frequency domain spectrogram fusion method Image reconstruction is performed on the electrical signal to realize STED parallel microscopic imaging based on structured light illumination.
以下详细说明图像重建模块140采用坐标定位及SIM频域频谱图融对所述电信号进行图像重建,实现基于结构光照明的STED并行显微成像的工作过程:The image reconstruction module 140 uses coordinate positioning and SIM frequency-domain spectrogram fusion to reconstruct the image of the electrical signal, and realizes the working process of STED parallel microscopic imaging based on structured light illumination in detail below:
第一,并行探测有效结构光光场First, Parallel Detection of Effective Structured Light Fields
通过控制模块130调整加载在液晶空间光调制器113上的相位分布,改变激发光光场的方向、周期和初相位,使得激发光结构光光场和损耗光结构光光场具有相同的方向和周期,初相位相差半个周期;样品经过激发结构光的激发和损耗结构光的损耗后,形成有效结构光光场,该有效结构光光场依次经所述物镜1114、所述筒镜1113、所述第二二色镜1112、所述第一二色镜1111、所述滤光片121及所述探测透镜122,再在所述面阵探测器123的感光面形成均匀条纹分布的图像,从而实现并行光信号的探测收集,请参阅图2(a)、图2(b)及图2(c)分别表示为激发结构光光场,损耗结构光光场及有效结构光光场。The phase distribution loaded on the liquid crystal spatial light modulator 113 is adjusted by the control module 130, and the direction, period, and initial phase of the excitation light field are changed, so that the excitation light structured light field and the loss light structured light field have the same direction and period, the initial phase difference is half a period; the sample forms an effective structured light field after the excitation of the excited structured light and the loss of the loss structured light, and the effective structured light field passes through the objective lens 1114, the tube lens 1113, The second dichroic mirror 1112, the first dichroic mirror 1111, the filter 121 and the detection lens 122 form an image with uniform fringe distribution on the photosensitive surface of the area array detector 123, In order to realize the detection and collection of parallel optical signals, please refer to Fig. 2(a), Fig. 2(b) and Fig. 2(c) respectively representing the excited structured light field, the loss structured light field and the effective structured light field.
第二,获取给定结构光方向以及给定样本位置的STED图像Second, obtain the STED image of a given structured light direction and a given sample position
可以理解,给定结构光方向以及给定样本位置时,在面阵探测器123的感光面形成均匀条纹分布的图像中包含很多条光信号条纹,每条光信号条纹都对应一排虚拟针孔,如图3(a)和图3(b)分别为面阵探测器上结构光的条纹状图像和虚拟针孔,其中,长条状矩形代表一条条纹光强分布,小的正方形格子代表面阵探测器的像素,较大的正方形格子代表一个虚拟针孔(包含多个像素),虚拟针孔的排布位于光信号条纹的中央,抑制杂光干扰,将虚拟针孔中每个像素探测到的光强i叠加,可以得到样品中一点对应的STED图像像素值将每个光信号条纹对应的所有虚拟针孔进行同样的处理,可以得到样品中一行对应的STED图像像素值,将所有光信号条纹中的虚拟针孔都作相同的处理,将得到一幅像素值条状间隔分布的STED图像。It can be understood that when the direction of the structured light and the position of the sample are given, the image that forms a uniform stripe distribution on the photosensitive surface of the area array detector 123 contains many light signal stripes, and each light signal stripe corresponds to a row of virtual pinholes , Fig. 3(a) and Fig. 3(b) respectively show the striped image of structured light on the area array detector and the virtual pinhole, where the long striped rectangle represents the light intensity distribution of a strip, and the small square grid represents the surface The pixels of the array detector, the larger square grid represents a virtual pinhole (including multiple pixels), the arrangement of the virtual pinhole is located in the center of the light signal stripes, suppressing stray light interference, and detecting each pixel in the virtual pinhole The obtained light intensity i is superimposed, and the pixel value of the STED image corresponding to a point in the sample can be obtained Perform the same processing on all the virtual pinholes corresponding to each optical signal stripe to obtain the STED image pixel value corresponding to one row in the sample, and perform the same processing on the virtual pinholes in all optical signal stripes to obtain a pixel value STED image of the distribution of values in striped intervals.
第三,获取给定结构光方向下样本扫描后的STED图像Third, obtain the STED image of the sample after scanning in a given structured light direction
保持结构光(激发结构光及损耗结构光)方向不变,采用三维纳米位移台1115带动样本沿着垂直于结构光条纹方向分步移动,每个结构光条纹方向下总的移动次数为dp/ds-1,dp为条纹空间周期,ds为单次移动步距,位移台每停留一个位置,用面阵探测器123记录下该位置处的样本条纹状荧光图像,采用上述第二步的处理方法,将得到一幅像素值条状间隔分布的STED图像,这样一来,每一个结构光条纹方向下将得到dp/ds幅像素值条状间隔分布的STED图像,将这些图像叠加,生成对应于一个结构光条纹方向的一幅图像,将这种图像重建方法记为坐标定位法,该图像在与该结构光条纹相垂直的方向实现了超分辨成像。Keeping the direction of the structured light (excited structured light and depleted structured light) unchanged, the three-dimensional nano-shift stage 1115 is used to drive the sample to move step by step along the direction perpendicular to the structured light stripe, and the total number of times of movement in each structured light stripe direction is d p /d s -1, d p is the fringe spatial period, d s is the single moving step distance, each time the translation stage stays at a position, the area array detector 123 is used to record the sample stripe-shaped fluorescent image at this position, and the above-mentioned first The two-step processing method will obtain a STED image with pixel values distributed in strips and intervals. In this way, d p /d s STED images with pixel values distributed in strips and intervals will be obtained in each structured light stripe direction. These images are superimposed to generate an image corresponding to the direction of a structured light stripe. This image reconstruction method is recorded as a coordinate positioning method. The image realizes super-resolution imaging in a direction perpendicular to the structured light stripe.
第四,获取各个方向结构光下样本扫描后的STED图像Fourth, obtain the STED image of the sample scanned under structured light in all directions
旋转沃拉斯顿棱镜114,并相应地旋转液晶空间光调制器113上加载的相位图,使得物镜1114焦面处激发光和损耗光的结构光光场条纹能够位于不同的方向,生成不同方向的有效荧光结构光光场,对于各个方向的有效荧光结构光光场进行第三步和第二步相同的处理,可以得到结构光场各个方向上包含一维超分辨信息的二维图像。Rotate the Wollaston prism 114, and correspondingly rotate the phase diagram loaded on the liquid crystal spatial light modulator 113, so that the structured light field fringes of the excitation light and loss light at the focal plane of the objective lens 1114 can be located in different directions, and generate different directions The effective fluorescent structured light field of each direction, the third step and the second step are performed on the effective fluorescent structured light field in all directions, and a two-dimensional image containing one-dimensional super-resolution information in each direction of the structured light field can be obtained.
第五,经过SIM频域频谱融合得到超分辨图像Fifth, the super-resolution image is obtained through SIM frequency domain spectrum fusion
采用SIM频域频谱图融合法进行图像重建,先将第四步得到的多幅二维图像进行傅里叶变换转换到频率域,如图4(a)所示,在频率域中将每幅二维图像的频域图进行融合,如图4(b)所示,最后再经过逆傅里叶变换转换到空间域,得到最终的超分辨图像。The SIM frequency-domain spectrogram fusion method is used for image reconstruction. First, the multiple two-dimensional images obtained in the fourth step are transformed into the frequency domain by Fourier transform, as shown in Figure 4(a). In the frequency domain, each The frequency domain images of the two-dimensional images are fused, as shown in Figure 4(b), and finally converted to the spatial domain through inverse Fourier transform to obtain the final super-resolution image.
本发明提供的基于结构光照明的STED并行显微成像系统,通过对照明模块110进行设计,将激发光激光器111出射的一束激发光分成两束相干光,将损耗光激光器112出射的一束损耗光分成两束相干光,通过干涉分别得到均匀分布的激发结构光和损耗结构光,激发结构光和损耗结构光并对样品进行激发和损耗,进行STED并行显微成像,再采用STED的坐标定位方法和SIM频域频谱图融合法进行图像重建,实现超分辨成像,有助于扩大STED显微系统的视场范围和成像速度。In the STED parallel microscopic imaging system based on structured light illumination provided by the present invention, by designing the illumination module 110, one beam of excitation light emitted by the excitation light laser 111 is divided into two beams of coherent light, and one beam emitted by the lossy light laser 112 is The loss light is divided into two beams of coherent light, and uniformly distributed excitation structured light and loss structure light are obtained by interference, respectively, and the excitation and loss structure light are excited and lost to the sample, and STED parallel microscopic imaging is carried out, and then the coordinates of STED are used The positioning method and the SIM frequency-domain spectrogram fusion method are used for image reconstruction to realize super-resolution imaging, which is helpful to expand the field of view and imaging speed of the STED microscope system.
当然本发明的基于结构光照明的STED并行显微成像系统还可具有多种变换及改型,并不局限于上述实施方式的具体结构。总之,本发明的保护范围应包括那些对于本领域普通技术人员来说显而易见的变换或替代以及改型。Of course, the structured light illumination-based STED parallel microscopic imaging system of the present invention can also have various transformations and modifications, and is not limited to the specific structure of the above-mentioned embodiment. In a word, the protection scope of the present invention shall include those transformations, substitutions and modifications obvious to those skilled in the art.
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711150961.0A CN108121059B (en) | 2017-11-18 | 2017-11-18 | STED (stimulated emission depletion) parallel microscopic imaging system based on structured light illumination |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201711150961.0A CN108121059B (en) | 2017-11-18 | 2017-11-18 | STED (stimulated emission depletion) parallel microscopic imaging system based on structured light illumination |
Publications (2)
Publication Number | Publication Date |
---|---|
CN108121059A true CN108121059A (en) | 2018-06-05 |
CN108121059B CN108121059B (en) | 2022-01-28 |
Family
ID=62227841
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201711150961.0A Active CN108121059B (en) | 2017-11-18 | 2017-11-18 | STED (stimulated emission depletion) parallel microscopic imaging system based on structured light illumination |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN108121059B (en) |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108957720A (en) * | 2018-09-26 | 2018-12-07 | 中国科学院化学研究所 | Lighting system and STED optical microscopy for STED optical microscopy |
CN109739016A (en) * | 2019-01-16 | 2019-05-10 | 中国科学院苏州生物医学工程技术研究所 | Fast 3D imaging system and synchronization control method based on structured light illumination microscope |
CN109856789A (en) * | 2019-02-26 | 2019-06-07 | 中国科学院苏州生物医学工程技术研究所 | High intension super-resolution integration micro imaging system and method |
CN112326672A (en) * | 2020-11-06 | 2021-02-05 | 之江实验室 | A Fast Imaging System Based on Multicolor Parallel Frequency Shift Illumination |
CN117451683A (en) * | 2023-12-20 | 2024-01-26 | 深圳赛陆医疗科技有限公司 | Super-resolution microscopic imaging system, imaging method of sample to be detected and gene sequencer |
WO2024144454A1 (en) * | 2022-12-27 | 2024-07-04 | National University Of Singapore | System and method for image reconstruction using structured illumination microscopy |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103487421A (en) * | 2013-09-29 | 2014-01-01 | 浙江大学 | Super-resolution microscopic method and device of time-gated wide-field stimulated emission |
CN104296685A (en) * | 2014-11-05 | 2015-01-21 | 哈尔滨工业大学 | Device and method for measuring smooth free-form surface sample based on differential STED |
CN105182523A (en) * | 2015-09-23 | 2015-12-23 | 北京大学 | STED super-resolution microscope based on first-order Bessel beams and adjustment method thereof |
CN107014795A (en) * | 2017-05-10 | 2017-08-04 | 中国科学院苏州生物医学工程技术研究所 | A kind of burnt parallel micro imaging system of the copolymerization based on homogeneous texture optical illumination |
-
2017
- 2017-11-18 CN CN201711150961.0A patent/CN108121059B/en active Active
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN103487421A (en) * | 2013-09-29 | 2014-01-01 | 浙江大学 | Super-resolution microscopic method and device of time-gated wide-field stimulated emission |
CN104296685A (en) * | 2014-11-05 | 2015-01-21 | 哈尔滨工业大学 | Device and method for measuring smooth free-form surface sample based on differential STED |
CN105182523A (en) * | 2015-09-23 | 2015-12-23 | 北京大学 | STED super-resolution microscope based on first-order Bessel beams and adjustment method thereof |
WO2017049752A1 (en) * | 2015-09-23 | 2017-03-30 | 北京大学 | Sted super-resolution microscope based on a first-order bessel beam, and adjusting method |
CN107014795A (en) * | 2017-05-10 | 2017-08-04 | 中国科学院苏州生物医学工程技术研究所 | A kind of burnt parallel micro imaging system of the copolymerization based on homogeneous texture optical illumination |
Cited By (9)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108957720A (en) * | 2018-09-26 | 2018-12-07 | 中国科学院化学研究所 | Lighting system and STED optical microscopy for STED optical microscopy |
US11726309B2 (en) | 2018-09-26 | 2023-08-15 | Institute Of Chemistry Chinese Academy Of Sciences | Illumination system for STED optical microscope and STED optical microscope |
CN109739016A (en) * | 2019-01-16 | 2019-05-10 | 中国科学院苏州生物医学工程技术研究所 | Fast 3D imaging system and synchronization control method based on structured light illumination microscope |
CN109856789A (en) * | 2019-02-26 | 2019-06-07 | 中国科学院苏州生物医学工程技术研究所 | High intension super-resolution integration micro imaging system and method |
CN112326672A (en) * | 2020-11-06 | 2021-02-05 | 之江实验室 | A Fast Imaging System Based on Multicolor Parallel Frequency Shift Illumination |
CN112326672B (en) * | 2020-11-06 | 2023-12-19 | 之江实验室 | A fast imaging system based on multi-color parallel frequency-shifted illumination |
WO2024144454A1 (en) * | 2022-12-27 | 2024-07-04 | National University Of Singapore | System and method for image reconstruction using structured illumination microscopy |
CN117451683A (en) * | 2023-12-20 | 2024-01-26 | 深圳赛陆医疗科技有限公司 | Super-resolution microscopic imaging system, imaging method of sample to be detected and gene sequencer |
CN117451683B (en) * | 2023-12-20 | 2024-03-08 | 深圳赛陆医疗科技有限公司 | Super-resolution microscopic imaging system, imaging method of sample to be detected and gene sequencer |
Also Published As
Publication number | Publication date |
---|---|
CN108121059B (en) | 2022-01-28 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN108121059A (en) | A kind of parallel micro imaging systems of STED based on Structured Illumination | |
CN108181235A (en) | A kind of parallel micro imaging systems of STED based on homogeneous texture optical illumination | |
CN108982452B (en) | Multifocal scanning 3D imaging method and system based on double helix point spread function | |
CN108680544B (en) | Structured illumination light slice fluorescence microscopic imaging method and device | |
US8019136B2 (en) | Optical sectioning microscopy | |
US6909105B1 (en) | Method and device for representing an object | |
CN110262026B (en) | Aperture scanning Fourier ptychographic imaging | |
US9075013B2 (en) | Apparatus and methods for microscopy having resolution beyond the Abbe limit | |
CN107014795B (en) | Confocal parallel microscopic imaging system based on uniform structured light illumination | |
CN110954523A (en) | A two-photon scanning structured light microscopy imaging method and device | |
DE112009001652T5 (en) | Multichannel recording | |
CN111103678B (en) | Lattice light sheet microscope and method for tiling lattice light sheets in a lattice light sheet microscope | |
JP7181537B2 (en) | Time-resolved imaging method with high spatial resolution | |
CN105510290A (en) | Non-linear super-resolution microscopic method and device adopting photon recombination | |
CN114594588B (en) | Structured light illumination microscopic device and method based on grating projection and SLM phase shift | |
CN103941568B (en) | The automatic super-resolution digital hologram imaging device of multidimensional and method | |
US20250013026A1 (en) | Multi-focal light-sheet structured illumination fluorescence microscopy system | |
AU2018352821A1 (en) | Image reconstruction method, device and microscopic imaging device | |
CN113504700B (en) | Atomic time imaging device and method based on all-optical grid principle | |
CN107272218B (en) | High speed structured light imaging system | |
CN116183568B (en) | High-fidelity reconstruction method and device for three-dimensional structured light illumination super-resolution microscopic imaging | |
CN107678151A (en) | The burnt parallel microscopic imaging apparatus of copolymerization based on interference array light field | |
CN113702288A (en) | Bimodal microscopic imaging system and imaging method thereof | |
CN104570620B (en) | A kind of angle pencil of ray scanning exposure method | |
RU2579640C1 (en) | Confocal image spectrum analyser |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
CB02 | Change of applicant information | ||
CB02 | Change of applicant information |
Address after: Kolding road high tech Zone of Suzhou City, Jiangsu province 215163 No. 78 Building No. 7 room 205 Applicant after: Suzhou Guoke medical technology development (Group) Co., Ltd Applicant after: Suzhou Institute of Biomedical Engineering and Technology Chinese Academy of Sciences Address before: Kolding road high tech Zone of Suzhou City, Jiangsu province 215163 No. 78 Building No. 7 room 205 Applicant before: SUZHOU GUOKE MEDICAL TECHNOLOGY DEVELOPMENT Co.,Ltd. Applicant before: Suzhou Institute of Biomedical Engineering and Technology Chinese Academy of Sciences |
|
GR01 | Patent grant | ||
GR01 | Patent grant |