CN112798564A - Stochastic optical reconstruction and structured light illumination composite super-resolution imaging system - Google Patents

Stochastic optical reconstruction and structured light illumination composite super-resolution imaging system Download PDF

Info

Publication number
CN112798564A
CN112798564A CN202011524528.0A CN202011524528A CN112798564A CN 112798564 A CN112798564 A CN 112798564A CN 202011524528 A CN202011524528 A CN 202011524528A CN 112798564 A CN112798564 A CN 112798564A
Authority
CN
China
Prior art keywords
light
illumination
dichroic mirror
optical
lens
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN202011524528.0A
Other languages
Chinese (zh)
Other versions
CN112798564B (en
Inventor
李思黾
陈晓虎
文刚
梁永
金鑫
李辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Suzhou Institute of Biomedical Engineering and Technology of CAS
Original Assignee
Suzhou Institute of Biomedical Engineering and Technology of CAS
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Suzhou Institute of Biomedical Engineering and Technology of CAS filed Critical Suzhou Institute of Biomedical Engineering and Technology of CAS
Priority to CN202011524528.0A priority Critical patent/CN112798564B/en
Publication of CN112798564A publication Critical patent/CN112798564A/en
Application granted granted Critical
Publication of CN112798564B publication Critical patent/CN112798564B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6428Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6486Measuring fluorescence of biological material, e.g. DNA, RNA, cells

Landscapes

  • Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Chemical & Material Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Optics & Photonics (AREA)
  • Microscoopes, Condenser (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)

Abstract

本发明公开了一种随机光学重建与结构光照明复合超分辨成像系统,包括:光源模块,用于提供多个不同波长的合束照明光线,并控制光线照明时序,还用于控制单一波长光线照明,或者多个波长光线交替照明,或者多个波长光线同时照明;复合光场调控模块,包括用于将入射光场调控为余弦结构照明光场的第一光学调控装置,和用于将入射光场调控为均匀照明光场的第二光学调控装置;两种光学调控装置可以独立工作、交替工作或者同时工作;荧光成像模块,用于采集样本的多幅原始荧光图像并由计算机重建超分辨图像。本发明通过在一套光学成像平台实现随机光学重建与结构光照明两种超分辨成像技术联用,可实现对复杂生物体系的多模式、跨分辨率尺度同时成像。

Figure 202011524528

The invention discloses a composite super-resolution imaging system of random optical reconstruction and structured light illumination. Illumination, or alternate illumination of multiple wavelengths of light, or simultaneous illumination of multiple wavelengths of light; a compound light field control module, comprising a first optical control device for adjusting the incident light field into a cosine structure illumination light field, and for adjusting the incident light field to a cosine structure illumination light field. Light field regulation is a second optical regulation device for uniform illumination light field; two optical regulation devices can work independently, alternately or simultaneously; fluorescence imaging module, used to collect multiple original fluorescence images of the sample and reconstruct super-resolution by computer image. The present invention can realize multi-mode and cross-resolution scale simultaneous imaging of complex biological systems by realizing the combination of two super-resolution imaging technologies of random optical reconstruction and structured light illumination on a set of optical imaging platforms.

Figure 202011524528

Description

Random optical reconstruction and structured light illumination composite super-resolution imaging system
Technical Field
The invention belongs to the technical field of microscopic imaging, and particularly relates to a random optical reconstruction and structured light illumination composite super-resolution imaging system.
Background
Fluorescence super-resolution imaging has a wide application prospect, and various super-resolution imaging technologies exist at present, including a random optical reconstruction super-resolution imaging technology, a structured light illumination super-resolution imaging technology, a stimulated radiation loss super-resolution imaging technology and the like. These techniques, while improving resolution, are accompanied by disadvantages such as reduced imaging speed, increased illumination light power, increased phototoxicity, and a smaller imaging field of view.
In the prior art, the technical principle of the random optical reconstruction super-resolution imaging method (STORM) is as follows: by utilizing the photoswitch fluorescent protein, single molecules in the diffraction limit range are randomly activated at different time, and each fluorescent molecule is accurately positioned and recombined, so that a super-resolution image is obtained by superposition, and the resolution can reach 10nm or even higher. The random optical reconstruction microscope is mainly used for intracellular single molecule imaging and observation of fine subcellular structures, such as observation of accurate positioning of single proteins in cells, observation of interaction between proteins, and fine structures such as microwires, microtubules, adhesive plaques and inclusions in cells. However, the random optical reconstruction microscope needs to acquire a large number of original images (typically 2 ten thousand images) to reconstruct a super-resolution image, the imaging time varies from several seconds to tens of minutes, the time resolution is low, and the random optical reconstruction microscope is difficult to be used for live cell imaging.
The technical principle of the structured light illumination super-resolution imaging method (SIM) is as follows: multiple mutually interfering beams are irradiated onto the sample, and then high-resolution information is extracted from the collected fluorescence image, and a super-resolution image is reconstructed. The structured light illumination super-resolution technology is high in imaging speed, low in excitation light energy and small in damage to cells, and is mainly used for observing living body observation of a subcellular level, including dynamic changes of mitochondria, dynamic changes of cytoskeleton, dynamic changes of chromosomes, movement of vesicles in cells, movement of viruses in cells and the like. But the imaging resolution of structured light illumination is improved by 2 times compared with the traditional fluorescence microscope at the highest energy, reaches the level of 100nm, and is difficult to carry out fine biochemical reactions such as the movement of motor protein along cytoskeleton and the invasion process of pathogen particles into cells, and the like, thereby limiting the application of the structured light illumination in the fields of ultramicrobiology, medicine and the like.
The requirements of fields such as life science, basic medicine and the like on high-end imaging technology cover ultrahigh spatial resolution, high imaging speed, low illumination power, low phototoxicity, large imaging field of view and the like, and the requirements have contradictions which are difficult to reconcile from the technical aspect.
Disclosure of Invention
The invention aims to provide a random optical reconstruction and structured light illumination composite super-resolution imaging system, which meets the urgent need of cross-resolution scale imaging in life science and basic medical research.
The technical solution for realizing the purpose of the invention is as follows: a stochastic optical reconstruction and structured light illumination combined super-resolution imaging system, the system comprising:
the light source module is used for providing a plurality of combined illumination light rays with different wavelengths, controlling the light illumination time sequence, and also used for controlling the illumination of light rays with single wavelength, or the alternate illumination of light rays with a plurality of wavelengths, or the simultaneous illumination of light rays with a plurality of wavelengths;
the composite light field regulation and control module comprises a first optical regulation and control device and a second optical regulation and control device, wherein the first optical regulation and control device is used for regulating and controlling an incident light field into a cosine structure illumination light field, and the second optical regulation and control device is used for regulating and controlling the incident light field into a uniform illumination light field; the two optical regulation and control devices can work independently, alternately or simultaneously;
and the fluorescence imaging module is used for acquiring a plurality of original fluorescence images of the sample and reconstructing a super-resolution image by a computer.
Further, the light source module includes: the device comprises a plurality of light sources with different wavelengths, a reflection beam combination component, an acousto-optic tunable filter, an optical fiber coupler and a polarization maintaining optical fiber; light rays emitted by the light sources with different wavelengths are combined through the reflection beam combination assembly and then irradiate the acousto-optic tunable filter, first-order diffraction light of the acousto-optic tunable filter is collected through the optical fiber coupler and enters the polarization maintaining optical fiber, and then the light rays are introduced into the composite light field regulation and control module through the polarization maintaining optical fiber.
Further, the reflective beam combining assembly comprises:
the plurality of reflectors respectively correspond to the light sources with different wavelengths and guide the light rays emitted by all the light sources to the dichroic mirror to complete beam combination;
the plurality of dichroic mirrors are used for combining the light rays from the reflecting mirrors into one light beam and transmitting the light beam to the acousto-optic tunable filter;
or, the light emitted by one or more light sources is directly matched with a certain dichroic mirror, and the corresponding reflecting mirror is omitted.
Further, the plurality of light sources with different wavelengths include a first light source, a second light source, a third light source and a fourth light source; the reflecting beam combining assembly comprises a first reflecting mirror, a second reflecting mirror, a third reflecting mirror, a fourth reflecting mirror, a fifth reflecting mirror, a first dichroic mirror, a second dichroic mirror and a third dichroic mirror;
the light rays emitted by the first light source sequentially pass through the second reflecting mirror and the first reflecting mirror and then sequentially pass through the first dichroic mirror, the second dichroic mirror and the third dichroic mirror;
after passing through the third reflector, the light emitted by the second light source is reflected by the first dichroic mirror and then sequentially passes through the second dichroic mirror and the third dichroic mirror;
after passing through a fifth reflector, light rays emitted by the third light source are reflected by the second dichroic mirror and then pass through the third dichroic mirror;
and light rays emitted by the fourth light source are reflected by the third dichroic mirror after passing through the fourth reflector, and are combined with light rays from other three lasers and then transmitted to the acousto-optic tunable filter.
Further, the composite light field regulation module comprises:
the optical fiber collimation beam expanding assembly comprises an optical fiber collimator, a laser beam expander and a first achromatic half wave plate which are sequentially arranged along an optical axis where the emergent light of the light source module is located;
the first optical regulation and control device comprises a spatial light modulator, a polarization beam splitter prism, a Fourier lens, a porous mask plate, a polarization rotator, a liquid crystal phase compensator and a collimating lens;
the second optical regulation and control device comprises a two-dimensional scanning galvanometer, a second achromatic half wave plate, a polarization splitting prism, a Fourier lens, a porous mask plate, a polarization rotator, a liquid crystal phase compensator and a collimating lens;
the 4f imaging system comprises a Fourier lens and a collimating lens, wherein the rear focal plane of the Fourier lens is superposed with the front focal plane of the collimating lens;
the spatial light modulator and the two-dimensional scanning galvanometer are both positioned on the front focal plane of the 4f imaging system; the porous mask plate is arranged on a Fourier surface of a 4f imaging system;
the 4f imaging system is optically connected with the fluorescence imaging module;
the process of the composite light field regulation and control module for realizing the structured light illumination mode is as follows: light output by the optical fiber collimation beam expanding assembly is transmitted by the polarization beam splitting prism to be incident to the spatial light modulator, then is reflected by the spatial light modulator and the polarization beam splitting prism and then sequentially passes through the Fourier lens, the porous mask plate, the polarization rotator, the liquid crystal phase compensator and the collimating lens;
the process of the composite light field regulation and control module for realizing the uniform illumination mode is as follows: the light output by the fiber collimation beam expanding assembly passes through the second achromatic half wave plate and the two-dimensional scanning galvanometer after being reflected by the polarization splitting prism, passes through the second achromatic half wave plate and the polarization splitting prism after being reflected by the two-dimensional scanning galvanometer, is transmitted by the polarization splitting prism and passes through the Fourier lens, the porous mask plate, the polarization rotator, the liquid crystal phase compensator and the collimating lens.
Furthermore, a binary periodic fringe calculation hologram is loaded on the spatial light modulator, and light is diffracted to a plurality of orders by the spatial light modulator;
the porous mask plate is composed of 2N pinholes which are rotationally and symmetrically distributed, each pinhole is of a rectangular structure, the central position of a long edge corresponds to the critical angle of total internal reflection of a sample surface, and N is an integer; the porous mask plate is used for realizing spatial filtering, only light rays meeting a specific incident angle are allowed to enter the fluorescence imaging module to illuminate a sample, and light rays passing through different positions of the pinhole have different incident angles;
the polarization rotator is used for enabling the polarization state of the light beam passing through any pinhole to be vertical to a plane determined by the central point of the pinhole and the optical axis of the 4f imaging system;
the fast axis direction of the phase compensator is parallel to the polarization direction of the transmitted light of the polarization beam splitter prism, and the phase compensator is used for actively compensating laser phase drift caused by the optical element, so that the polarization state of any beam of light finally reaching the sample surface is kept in a linear polarization state, and the polarization direction is vertical to the incident surface of the light.
Furthermore, the first achromatic half-wave plate is arranged on the electric rotating wave plate frame, the included angle between the fast axis direction of the first achromatic half-wave plate and the polarization direction of the transmission light of the polarization beam splitter prism is theta, and the light intensity and sin of the liquid crystal spatial light modulator are transmitted through the polarization beam splitter prism to illuminate2(2 theta) is in direct proportion, and the intensity of the light reflected by the polarization beam splitter prism and illuminating the two-dimensional scanning galvanometer is related to cos2(2 θ) is proportional.
Further, when sin2(2θ)=1,cos2When the (2 theta) is 0, the composite light field regulation and control module independently works in a structured light illumination mode; when sin2(2θ)=0,cos2When the (2 theta) is 1, the composite light field regulation and control module independently works in a uniform illumination mode; when theta is equal to other values, the two imaging modes work simultaneously; by controlling the value of the included angle theta, the composite light field regulation and control module can be switched between the structured light illumination mode and the uniform illumination mode, and can also be switchedThe two imaging modes operate simultaneously.
Furthermore, the fluorescence imaging module comprises two cameras, one camera receives and images fluorescence excited by the structure illumination light field, the other camera receives and images fluorescence excited by the uniform illumination light field, the original images acquired by the cameras are reconstructed into super-resolution images through a computer, and the image acquisition time sequences of the two cameras, the composite light field regulation and control module and the light source module are synchronously controlled through the computer.
Further, the fluorescence imaging module includes:
the device for realizing the structured light illumination super-resolution imaging comprises a lens, a microscope objective, a sample stage, a fourth dichroic mirror, a fifth dichroic mirror, a first tube lens and a first camera; emergent light of the composite light field regulation and control module penetrates through the lens, is reflected by the fourth dichroic mirror and then irradiates the surface of a sample placed on the sample stage, a cosine structure illumination light field is generated, the sample is excited to emit fluorescence, the excited fluorescence is collected by the microscope objective, and then is sequentially transmitted by the fourth dichroic mirror, transmitted by the fifth dichroic mirror and imaged on a detection surface of the first camera through the first tube lens;
the device for realizing uniform light illumination super-resolution imaging comprises a lens, a microscope objective, a sample stage, a fourth dichroic mirror, a fifth dichroic mirror, a second tube lens and a second camera; emergent light of the composite light field regulation and control module penetrates through the lens, is reflected by the fourth dichroic mirror and then irradiates the surface of a sample placed on the sample stage, an even illumination light field is generated, the sample is excited to emit fluorescence, the excited fluorescence is collected by the microscope objective, and then is sequentially transmitted by the fourth dichroic mirror, reflected by the fifth dichroic mirror and imaged on a detection surface of the second camera through the second tube lens.
Aiming at the imaging requirements in the fields of cell biology, clinical pathological diagnosis and the like, the invention provides a random optical reconstruction and structured light illumination composite super-resolution imaging method and system, which essentially integrates the advantages of two technologies and has the following advantages compared with the traditional microscopic detection system:
1) the simultaneous imaging observation of cross-resolution scale can be realized by combining the STORM technology and the SIM technology, for example, in the research of the movement of living cell motor protein along cytoskeleton, the nano-resolution STORM imaging of the motor protein can be realized, and meanwhile, the hundred-nano-resolution SIM imaging of the cytoskeleton can be realized. The cross-resolution scale simultaneous imaging capability has wide requirements in the fields of cell mass transport, pathogen infection process and the like, and the prior art cannot meet the requirements.
2) In the research aiming at SIM imaging, in-situ STROM ultrahigh resolution imaging can be carried out on an interested key area, the problems of high SIM imaging speed, large imaging field of view but low resolution are solved, and the problems of inaccurate positioning, sample state change and the like caused by secondary imaging are avoided.
3) In the research aiming at STORM imaging, the STORM imaging and analysis are guided by quick SIM imaging, so that the amount of STROM original data can be obviously reduced, and the imaging speed is improved.
4) STORM and SIM imaging are realized on one set of imaging platform, most hardware equipment can be shared, the economic cost for obtaining the same imaging function is obviously reduced, and the biological laboratory space resource occupied by the instrument is reduced.
The present invention is described in further detail below with reference to the attached drawing figures.
Drawings
FIG. 1 is a schematic structural diagram of a random optical reconstruction and structured light illumination combined super-resolution imaging system in an embodiment.
FIG. 2(a) is a structure diagram of a porous mask plate, and (b) is an incident light spot distribution measured at the rear pupil plane of a microscope in a uniform illumination mode; (c) and (e) the distribution of the incident light spots measured on the back pupil surface of the microscope objective in the structured light illumination mode.
Fig. 3 is a super-resolution image taken by the present invention in one embodiment, in which (a) breast cancer cell HER2 positive signal SIM is imaged and (b) breast cancer cytoskeleton STORM is imaged.
The respective symbols in the figure are as follows: 1 laser 647 nm; 2, 561nm of laser; 3, 488nm of laser; 4, 405nm of laser; mirrors 9, 5, 10, 11, 12; dichroic mirrors 6, 7, 8, 29; 13 acousto-optic tunable filter; 14 a fiber coupler; 15 polarization maintaining fiber; 16 fiber collimator; 17 a laser beam expander; 18 an achromatic half wave plate; 19 polarization beam splitting prism; 20 a spatial light modulator; 21 a Fourier lens; 22 a porous mask plate; 23 a polarization rotator; 24 liquid crystal phase compensator; 25 a collimating lens; 26 lenses; 27 microscope objective lens; 28 sample stage; 30 a fluorescent color filter; a 31-tube lens; 32 cameras; 33 two-dimensional scanning galvanometer; 34 an achromatic half wave plate; a 35 tube lens; 36 cameras; 37 fluorescent color filter.
Detailed Description
In order to make the objects, technical solutions and advantages of the present application more apparent, the present application is described in further detail below with reference to the accompanying drawings and embodiments. It should be understood that the specific embodiments described herein are merely illustrative of the present application and are not intended to limit the present application.
In addition, if there is a description of "first", "second", etc. in an embodiment of the present invention, the description of "first", "second", etc. is for descriptive purposes only and is not to be construed as indicating or implying relative importance or implicitly indicating the number of technical features indicated. Thus, a feature defined as "first" or "second" may explicitly or implicitly include at least one such feature. In addition, technical solutions between various embodiments may be combined with each other, but must be realized by a person skilled in the art, and when the technical solutions are contradictory or cannot be realized, such a combination should not be considered to exist, and is not within the protection scope of the present invention.
In one embodiment, the present invention provides a stochastic optical reconstruction and structured light illumination combined super-resolution imaging system, the system comprising:
the light source module is used for providing a plurality of combined illumination light rays with different wavelengths, controlling the light illumination time sequence, and also used for controlling the illumination of light rays with single wavelength, or the alternate illumination of light rays with a plurality of wavelengths, or the simultaneous illumination of light rays with a plurality of wavelengths;
the composite light field regulation and control module comprises a first optical regulation and control device and a second optical regulation and control device, wherein the first optical regulation and control device is used for regulating and controlling an incident light field into a cosine structure illumination light field, and the second optical regulation and control device is used for regulating and controlling the incident light field into a uniform illumination light field; the two optical regulation and control devices can work independently, alternately or simultaneously;
and the fluorescence imaging module is used for acquiring a plurality of original fluorescence images of the sample and reconstructing a super-resolution image by a computer.
The invention realizes composite super-resolution imaging by combining the random optical reconstruction super-resolution imaging technology and the structured light illumination super-resolution imaging technology, namely SIM or STOM imaging can be independently carried out; or firstly, quickly imaging through the SIM, positioning an interested key area, and then carrying out STROM ultrahigh-resolution imaging on the key area; SIM and STOM imaging can also be performed simultaneously on the sample. The system has the advantages of high spatial resolution, high imaging speed, large imaging field of view, low phototoxicity and the like, can meet the imaging requirements of multiple modes at the same time, and particularly can realize in-situ cross-resolution scale simultaneous imaging of the same biological sample. In addition, the composite imaging system can simultaneously realize the combination of two super-resolution imaging technologies of SIM and STORM on one imaging platform, the SIM and the STORM share most hardware equipment, the economic cost for obtaining the same imaging function can be reduced, the laboratory space resource occupied by the equipment is reduced, and the complexity of system maintenance is simplified.
Further, in one embodiment, the light source module includes: a plurality of light sources with different wavelengths, a reflection beam combination component, an acousto-optic tunable filter 13, an optical fiber coupler 14 and a polarization maintaining optical fiber 15; light rays emitted by the light sources with different wavelengths are combined by the reflection beam combination component and then irradiate the acousto-optic tunable filter 13, first-order diffraction light of the acousto-optic tunable filter 13 is collected by the optical fiber coupler 14 and enters the polarization maintaining optical fiber 15, and then the light rays are introduced into the composite light field regulation and control module through the polarization maintaining optical fiber 15.
The control of the light illumination time sequence is also used for controlling the illumination of light with single wavelength, or the alternate illumination of light with multiple wavelengths, or the simultaneous illumination of light with multiple wavelengths, which are all realized by controlling the acousto-optic tunable filter 13.
Further, in one embodiment, the reflective beam combiner assembly includes:
the plurality of reflectors respectively correspond to the light sources with different wavelengths and guide the light rays emitted by all the light sources to the dichroic mirror to complete beam combination;
a plurality of dichroic mirrors for combining the light from the reflecting mirrors into one light beam and transmitting the light beam to the acousto-optic tunable filter 13;
or, the light emitted by one or more light sources is directly matched with a certain dichroic mirror, and the corresponding reflecting mirror is omitted.
Further, in one embodiment, the plurality of light sources with different wavelengths includes a first light source 1, a second light source 2, a third light source 3, and a fourth light source 4; the reflecting beam combining component comprises a first reflecting mirror 5, a second reflecting mirror 9, a third reflecting mirror 10, a fourth reflecting mirror 11, a fifth reflecting mirror 12, a first dichroic mirror 6, a second dichroic mirror 7 and a third dichroic mirror 8;
the light emitted by the first light source 1 sequentially passes through the second reflecting mirror 9 and the first reflecting mirror 5, and then sequentially passes through the first dichroic mirror 6, the second dichroic mirror 7 and the third dichroic mirror 8;
after passing through the third reflector 10, the light emitted by the second light source 2 is reflected by the first dichroic mirror 6, and then sequentially passes through the second dichroic mirror 7 and the third dichroic mirror 8;
after passing through the fifth reflector 12, the light emitted by the third light source 3 is reflected by the second dichroic mirror 7 and then passes through the third dichroic mirror 8;
light emitted by the fourth light source 4 passes through the fourth reflector 11, is reflected by the third dichroic mirror 8, and is combined with light from other three lasers and then transmitted to the acousto-optic tunable filter 13.
Here, exemplarily, in one embodiment, the first light source 1, the second light source 2, the third light source 3, and the fourth light source 4 employ lasers, and the wavelengths are 647nm, 4561nm, 488nm, and 405nm, respectively.
It should be noted that the light source is not limited to a laser, but may also be an LED light source, and the light wavelength is not limited to the above four wavelengths, and the light sources do not have a primary-secondary relationship, and parameter selection, number increase and decrease, or replacement may be performed according to requirements.
Further, in one embodiment, the composite light field modulation module comprises:
the optical fiber collimation and beam expansion assembly comprises an optical fiber collimator 16, a laser beam expander 17 and a first achromatic half wave plate 18 which are sequentially arranged along an optical axis where the emergent light of the light source module is located;
the first optical regulation and control device comprises a spatial light modulator 20, a polarization beam splitter prism 19, a Fourier lens 21, a porous mask plate 22, a polarization rotator 23, a liquid crystal phase compensator 24 and a collimating lens 25;
the second optical regulation and control device comprises a two-dimensional scanning galvanometer 33, a second achromatic half wave plate 34, a polarization beam splitter prism 19, a Fourier lens 21, a porous mask plate 22, a polarization rotator 23, a liquid crystal phase compensator 24 and a collimating lens 25;
the 4f imaging system comprises a Fourier lens 21 and a collimating lens 25, namely, the back focal plane of the Fourier lens 21 is coincided with the front focal plane of the collimating lens 25;
the spatial light modulator 20 and the two-dimensional scanning galvanometer 33 are both positioned on the front focal plane of the 4f imaging system; the reticle 22 is in the fourier plane of the 4f imaging system;
the 4f imaging system is optically connected with the fluorescence imaging module;
the process of the composite light field regulation and control module for realizing the structured light illumination mode is as follows: light output by the fiber collimation and beam expansion assembly is transmitted by the polarization beam splitter prism 19 and enters the spatial light modulator 20, then is reflected by the spatial light modulator 20 and the polarization beam splitter prism 19, and then passes through the Fourier lens 21, the porous mask plate 22, the polarization rotator 23, the liquid crystal phase compensator 24 and the collimating lens 25 in sequence;
the process of the composite light field regulation and control module for realizing the uniform illumination mode is as follows: the light output by the fiber collimation beam expanding assembly is reflected by the polarization splitting prism 19 and then sequentially passes through the second achromatic half wave plate 34 and the two-dimensional scanning galvanometer 33, is reflected by the two-dimensional scanning galvanometer 33 and then sequentially passes through the second achromatic half wave plate 34 and the polarization splitting prism 19, is transmitted by the polarization splitting prism 19 and then sequentially passes through the Fourier lens 21, the porous mask plate 22, the polarization rotator 23, the liquid crystal phase compensator 24 and the collimating lens 25.
Further, in one embodiment, the spatial light modulator 20 is loaded with a binary periodic fringe computer hologram, and light is diffracted into a plurality of orders by the spatial light modulator 20. Changing the phase and spatial orientation of the loaded image on spatial light modulator 20 changes the orientation and phase of the two-dimensional cosine illumination field on the sample plane.
The porous mask plate 22 is composed of 2N rotationally symmetrically distributed pinholes, each pinhole is of a rectangular structure, the central position of a long edge corresponds to the critical angle of total internal reflection of the sample surface, and N is an integer. The porous mask plate 22 is used for realizing spatial filtering, only light rays meeting a specific incident angle are allowed to enter the fluorescence imaging module to illuminate a sample, and light rays passing through different positions of the pinhole have different incident angles; meanwhile, the incident angle of the rectangular structure can be adjusted within a certain range, the central position of the rectangle corresponds to the critical angle of total internal reflection, when an incident beam passes through a pinhole along the inner side, large-angle incident illumination on a sample can be realized, when the position of the incident beam is changed along the inner side of the central position, the period size of a structured light field can be adjusted, and the illumination on the samples with different structural characteristics by optimal structured light is realized; when the incident light beam passes through the pinhole along the outer side, the total internal reflection illumination of the sample can be realized, and when the position of the incident light beam is changed along the outer side of the central position, the penetration depth of evanescent waves can be adjusted, so that the illumination of samples with different depths is realized.
Here, fig. 2(a) is an exemplary 6-hole mask plate, which is composed of 6 rotationally symmetrically distributed pinholes; FIGS. 2(c) - (e) are the intensity distributions of the positive and negative primary beams at the back pupil plane of the microscope objective in the SIM imaging mode; fig. 2(b) shows the intensity distribution of the incident beam at the back pupil plane of the microscope objective in the STORM imaging mode, and these 6 light spots are formed by fast scanning 1 light spot, the scanning speed is 8kHz, which is much faster than the camera acquisition speed (less than 100Hz), and it can be equivalently considered that there are 6 light spots illuminating at the same time.
The polarization rotator 23 is used for enabling the polarization state of the light beam passing through any pinhole to be perpendicular to the plane determined by the central point of the pinhole and the optical axis of the 4f imaging system (the polarization directions of the positive and negative primary light beams can be always perpendicular to the plane where the positive and negative primary light beams are located together);
the fast axis direction of the phase compensator 24 is parallel to the polarization direction of the transmitted light of the polarization beam splitter 19, the phase compensator 24 is used for actively compensating the laser phase drift caused by optical elements such as the collimating lens 25, the lens 26, the fourth dichroic mirror 29, the microscope objective 27, etc., the phase compensation amount, the phase difference between the fast axis and the slow axis can be controlled by computer programming, when the incident azimuth angle of the incident light is changed, or the wavelength of the incident light is changed, the phase compensation amount is synchronously changed, so that the polarization state of any beam of light finally reaching the sample surface is kept in a linear polarization state, and the polarization direction is perpendicular to the incident surface of the beam (the polarization direction is perpendicular to the plane where the positive and negative primary beams are jointly located), thereby obtaining the maximum structural light modulation degree, and because the phase drift is related to the laser wavelength, when the laser wavelength is changed, the phase compensation amount of the liquid crystal phase compensator needs to be changed, this is very important to make the structured light field with any wavelength have the maximum modulation degree, and is also the key design to make the present invention obtain high quality SIM super-resolution image.
Further, in one embodiment, the first achromatic half waveplate 18 is mounted on the electric rotating waveplate frame, the fast axis direction of the first achromatic half waveplate and the polarization direction of the transmitted light of the polarization beam splitter 19 form an included angle θ, and the light intensity and sin of the liquid crystal spatial light modulator 20 transmitted through the polarization beam splitter 19 are transmitted and illuminated2(2 theta) is proportional to cos, and the intensity of light reflected by the polarizing beam splitter 19 and illuminating the two-dimensional scanning galvanometer 332(2 θ) is proportional.
Further, in one embodiment, sin is used2(2θ)=1,cos2When the (2 theta) is 0, the composite light field regulation and control module independently works in a structured light illumination mode; when sin2(2θ)=0,cos2When the (2 theta) is 1, the composite light field regulation and control module independently works in a uniform illumination mode; when theta is equal to other values, the two imaging modes work simultaneously, and the relative illumination intensity of the two modes is controllable. By controlling the value of the included angle theta, the composite light field regulation and control module can be positionedThe structured light illumination mode and the uniform illumination mode are switched, and the two imaging modes can work simultaneously.
Further, in one embodiment, the fluorescence imaging module includes two cameras, one camera receives and images fluorescence excited by the structure illumination light field, the other camera receives and images fluorescence excited by the uniform illumination light field, the original images acquired by the cameras are reconstructed into super-resolution images through a computer, and the image acquisition time sequence of the two cameras, the composite light field regulation and control module and the light source module are synchronously controlled through the computer.
Further, in one embodiment, the fluorescence imaging module comprises:
the device for realizing the structured light illumination super-resolution imaging comprises a lens 26, a microscope objective 27, a sample stage 28, a fourth dichroic mirror 29, a fifth dichroic mirror 37, a first tube lens 31 and a first camera 32; emergent light of the composite light field regulation module penetrates through the lens 26, is reflected by the fourth dichroic mirror 29 and then irradiates the surface of a sample placed on the sample stage 28, a cosine structure illumination light field is generated, the sample is excited to emit fluorescence, the excited fluorescence is collected by the microscope objective 27, and then is sequentially transmitted by the fourth dichroic mirror 29, transmitted by the fifth dichroic mirror 37 and imaged on a detection surface of the first camera 32 through the first tube lens 31;
the device for realizing uniform light illumination super-resolution imaging comprises a lens 26, a microscope objective 27, a sample stage 28, a fourth dichroic mirror 29, a fifth dichroic mirror 37, a second tube lens 35 and a second camera 36; emergent light of the composite light field regulation module penetrates through the lens 26, is reflected by the fourth dichroic mirror 29 and then irradiates the surface of a sample placed on the sample stage 28, a uniform illumination light field is generated, the sample is excited to emit fluorescence, the excited fluorescence is collected by the microscope objective 27, and then is transmitted by the fourth dichroic mirror 29, reflected by the fifth dichroic mirror 37 and imaged on a detection surface of the second camera 36 after passing through the second tube lens 35 in sequence.
Here, the camera may be an EMCCD, SCMOS, or other two-dimensional image detector.
Here, the fluorescence imaging module can be built by itself, and a commercial microscope can also be used.
Based on the embodiment, the step of the system for realizing the structured light illumination super-resolution imaging comprises the following steps: the laser emits light and wavelength gating and illumination time sequence control are carried out through the acousto-optic tunable filter 13; loading a binary periodic fringe calculation hologram on a spatial light modulator 20, diffracting light rays into multiple orders through a liquid crystal spatial light modulator 20, reflecting the light rays through a polarization beam splitter prism 19, sequentially passing through a Fourier lens 21, a porous mask plate 22, a polarization rotator 23, a liquid crystal phase compensator 24, a collimating lens 25 and a fluorescence imaging module, irradiating the light rays onto the surface of a sample, and enabling positive and negative first-order diffracted light to interfere on the surface of the sample (the light diffracted by the spatial light modulator 20 passes through the porous mask plate filter 22, so that only the positive and negative first-order diffracted light can be irradiated onto the surface of the sample to interfere), generating a cosine structure illumination light field and exciting the sample to emit fluorescence; the fluorescence emitted by the sample is collected by the fluorescence imaging module, transmitted by fourth dichroic mirror 29, transmitted by fifth dichroic mirror 37, and imaged on the detection surface of camera 32 by first tube lens 31. The phase and the spatial orientation of the loaded image on the spatial light modulator are changed, the orientation and the phase of the sample surface structure illumination light field can be changed, and fluorescence is excited to obtain the image. Repeating the above process, collecting the fluorescence images of 3 direction angles and 3 phases, and finally reconstructing the super-resolution image from the 9 original images collected by the camera by using an image processing algorithm.
The system of the invention realizes uniform light illumination super-resolution imaging, namely random optical reconstruction illumination super-resolution imaging, and comprises the following steps: the propagation direction of the light is controlled by the two-dimensional scanning galvanometer 33, and the light reflected by the two-dimensional scanning galvanometer 33 passes through the second achromatic half wave plate 34, the polarization splitting prism 19, the fourier lens 21, the porous mask plate 22, the polarization rotator 23, the liquid crystal phase compensator 24, the collimating lens 25 and the imaging module in sequence and irradiates the surface of the sample. The incident angle is alpha, the alpha is made to be larger than the critical angle of total internal reflection, the incident light is subjected to total internal reflection at the surface of the sample, a beam evanescent wave illumination light field is formed on the surface of the sample, the fluorescence emitted by the sample is collected by the objective lens, and is transmitted by the fourth dichroic mirror 29, reflected by the fifth dichroic mirror 37 and imaged on the detection surface of the second camera 36 by the second tube lens 35.
The step of random optical reconstruction illumination super-resolution imaging further comprises the steps of rapidly switching the deflection direction of the two-dimensional scanning galvanometer 33, changing the angular distribution of incident light, rotating the incident surface of the incident light by integral multiples of 360 degrees along the optical axis of the microscope objective within the one-time imaging integration time of the camera, and distributing light ray tracks on a cone with the vertex angle of 2 alpha, so that the evanescent wave light field is uniformly distributed, and the negative effect of laser speckle on the imaging quality is eliminated. Meanwhile, the penetration depth of evanescent waves can be accurately controlled by controlling the size of the alpha angle.
Exemplarily, fig. 3 shows a super-resolution image taken by the present invention, wherein (a) is a SIM image of a positive signal of HER2 for breast cancer cells, and (b) is a STORM image of breast cancer cytoskeleton.
Further, in one embodiment, the system of the present invention can also perform two-color labeling on the sample, and a light source with one wavelength is used to excite one of the proteins to perform structured light illumination for fast super-resolution imaging, while a light source with another wavelength is used to excite a second protein to perform single-molecule random optical reconstruction for ultrahigh-resolution imaging.
By integrating the above embodiments, the random optical reconstruction and structured light illumination composite super-resolution imaging system provided by the invention comprises a light source module for providing multi-wavelength combined illumination light, a composite light field regulation and control device for modulating a light field into a two-dimensional cosine structure illumination light field and a uniform illumination light field, and an imaging module for acquiring fluorescence signal imaging and reconstructing a super-resolution image. Wavelength gating and time sequence control of the multi-wavelength combined light rays are realized through the acousto-optic tunable filter, and single-wavelength light ray illumination, multiple-wavelength light ray alternate illumination and multiple-wavelength light ray simultaneous illumination are realized. Incident light is diffracted to a plurality of orders through a spatial light modulator, and only positive and negative first-order diffracted light is allowed to reach the surface of a sample and interfere to generate a cosine structure light field through filtering of a porous mask plate; the polarization direction of the positive and negative first-order diffracted light is controlled by the polarization rotator and is always vertical to the incident surface of the polarization rotator; and a liquid crystal phase compensator is arranged behind the polarization rotator and actively compensates random phase shift caused by the optical element, so that the light finally reaching the sample surface is kept in linear polarization and the polarization direction is vertical to the incident surface. The azimuth angle of the illumination light is rapidly scanned through the two-dimensional scanning galvanometer, multi-angle incidence averaging is achieved within one-time exposure time of the camera, an even illumination light field is generated, and adverse effects of laser speckles on imaging are eliminated. By controlling the rotation angle of the achromatic half wave plate, the illumination of a structural light field, or the illumination of a uniform light field, or the simultaneous illumination of the structural light field and the uniform light field but with different wavelengths can be realized. The imaging module is provided with two cameras, fluorescence excited by the structure light field illumination is detected and imaged by one camera, and fluorescence excited by the uniform light field illumination is detected and imaged by the other camera.
In summary, the system of the present invention has the following features:
1. the incident azimuth angle of illumination light is rapidly switched through the two-dimensional scanning galvanometer, a light ray track is rapidly swept in one-time exposure integration time of the camera to form a cone with the optical axis of the microscope objective as an axis, and the total illumination light intensity received by the sample is equal to the sum of the light intensity of the incident light rays at different angles, so that the random laser speckles can be effectively inhibited in the summing process, and an even illumination light field is formed on the surface of the sample. Meanwhile, the incident angle of incident light can be controlled through the two-dimensional scanning galvanometer, so that the penetration depth of an evanescent wave illumination light field is controlled.
2. The computer hologram loaded on the spatial light modulator is controlled, and the structure illumination light intensity with any light intensity distribution can be formed on the sample surface. The structure illumination light field is generated based on double-beam interference, and the system comprises an active phase compensator, so that an incident beam can be kept as linearly polarized light all the time, and the polarization direction is vertical to an incident surface, and the structure illumination light field obtains the maximum modulation degree. Meanwhile, as the phase shift of laser introduced by optical elements such as a lens, a dichroic mirror, a microscope objective and the like is related to the wavelength of the laser, the phase compensation amount can be actively adjusted in real time by the liquid crystal phase compensator when the incident wavelength is changed, so that the optimal modulation degree can be always realized for different wavelengths.
3. The random optical reconstruction/structured light illumination composite super-resolution imaging method comprises the following steps:
a) independent working mode: the invention can independently carry out STORM imaging and SIM imaging or quickly switch between the STORM imaging and the SIM imaging. The structured light illumination imaging is used for imaging the sample quickly and in a large view field, an interested key area is found, a random optical reconstruction mode is switched, and ultrahigh resolution imaging is carried out on the area. This is important, and in many cases, it is only a small portion of the sample that is of interest, and it is not necessary to perform ultra-high resolution imaging on the entire sample area, and how to quickly locate the focal region and super-resolution image the region is a technical difficulty. The invention adopts wide-field structured light to perform fast high-resolution imaging on the whole sample, and then uses a two-dimensional scanning galvanometer to enable light to fast scan a heavy spot area and randomly optically reconstruct ultrahigh-resolution imaging, thereby solving the problem.
b) And simultaneously, the working mode is as follows: the invention can simultaneously carry out structured light illumination super-resolution imaging and random optical reconstruction super-resolution imaging on the sample, can collect more information and complete the imaging process which can not be carried out by a single imaging method, for example, carrying out two-color marking on the sample, exciting one protein by using laser with one wavelength to carry out structured light illumination rapid super-resolution imaging, and exciting the second protein by using laser with the other wavelength to carry out single-molecule random optical reconstruction super-resolution imaging, which is very important for observing the dynamic process at certain accurate sites.
The invention realizes the combination of two super-resolution imaging technologies of random optical reconstruction and structured light illumination on a set of optical imaging platform, and can realize multi-mode and cross-resolution scale simultaneous imaging of a complex biological system.
The description and applications of the invention herein are illustrative and are not intended to limit the scope of the invention to the embodiments described above. Variations and modifications of the embodiments disclosed herein are possible, and alternative and equivalent various components of the embodiments will be apparent to those skilled in the art. It will be clear to those skilled in the art that the present invention may be embodied in other forms, structures, arrangements, proportions, and with other components, materials, and parts, without departing from the spirit or essential characteristics thereof. Other variations and modifications of the embodiments disclosed herein may be made without departing from the scope and spirit of the invention. The embodiments in the present description are described in a progressive manner, each embodiment focuses on differences from other embodiments, and similar parts between the embodiments are referred to each other. The previous description of the disclosed embodiments is provided to enable any person skilled in the art to make or use the present invention. Various modifications to these embodiments will be readily apparent to those skilled in the art, and the generic principles defined herein may be applied to other embodiments without departing from the spirit or scope of the invention. Thus, the present invention is not intended to be limited to the embodiments shown herein but is to be accorded the widest scope consistent with the principles and novel features disclosed herein.

Claims (10)

1.一种随机光学重建与结构光照明复合超分辨成像系统,其特征在于,所述系统包括:1. a random optical reconstruction and structured light illumination composite super-resolution imaging system, is characterized in that, described system comprises: 光源模块,用于提供多个不同波长的合束照明光线,并控制光线照明时序,还用于控制单一波长光线照明,或者多个波长光线交替照明,或者多个波长光线同时照明;The light source module is used to provide a plurality of combined illumination lights of different wavelengths, and control the lighting sequence of the light, and is also used to control the illumination of a single wavelength of light, or the alternate illumination of multiple wavelengths of light, or the simultaneous illumination of multiple wavelengths of light; 复合光场调控模块,包括用于将入射光场调控为余弦结构照明光场的第一光学调控装置,和用于将入射光场调控为均匀照明光场的第二光学调控装置;两种光学调控装置可以独立工作、交替工作或者同时工作;The composite light field control module includes a first optical control device for adjusting the incident light field into a cosine structure illumination light field, and a second optical control device for adjusting the incident light field into a uniform illumination light field; two optical control devices The control devices can work independently, alternately or simultaneously; 荧光成像模块,用于采集样本的多幅原始荧光图像并由计算机重建超分辨图像。The fluorescence imaging module is used to acquire multiple original fluorescence images of the sample and reconstruct the super-resolution images by the computer. 2.根据权利要求1所述的随机光学重建与结构光照明复合超分辨成像系统,其特征在于,所述光源模块包括:多个波长不同的光源、反射合束组件、声光可调谐滤波器(13)、光纤耦合器(14)、保偏光纤(15);所述多个波长不同的光源发出的光线通过反射合束组件合束后,照射到声光可调谐滤波器(13),所述声光可调谐滤波器(13)的一级衍射光经光纤耦合器(14)收集进入保偏光纤(15)中,之后经保偏光纤(15)将光线引入复合光场调控模块。2. The composite super-resolution imaging system of random optical reconstruction and structured light illumination according to claim 1, wherein the light source module comprises: a plurality of light sources with different wavelengths, a reflection beam combining assembly, an acousto-optic tunable filter (13), an optical fiber coupler (14), and a polarization-maintaining fiber (15); after the light emitted by the multiple light sources with different wavelengths is combined by the reflection beam combining component, it is irradiated to the acousto-optic tunable filter (13), The first-order diffracted light of the acousto-optic tunable filter (13) is collected by a fiber coupler (14) into a polarization-maintaining fiber (15), and then the light is introduced into a composite optical field control module through the polarization-maintaining fiber (15). 3.根据权利要求2所述的随机光学重建与结构光照明复合超分辨成像系统,其特征在于,所述反射合束组件包括:3. The stochastic optical reconstruction and structured light illumination composite super-resolution imaging system according to claim 2, wherein the reflection beam combining assembly comprises: 多个反射镜,分别对应不同波长的光源,并将所有光源发出的光线引导至二向色镜上完成合束;Multiple reflectors correspond to light sources of different wavelengths, and guide the light emitted by all light sources to the dichroic mirror to complete the beam combination; 多个二向色镜,用于将来自反射镜的光线合束为一个光束,并将该光束传输给声光可调谐滤波器(13);a plurality of dichroic mirrors for combining the light from the mirror into a light beam, and transmitting the light beam to the acousto-optic tunable filter (13); 或,其中某个或多个光源发出的光线直接与某个二向色镜匹配,省略与之对应的反射镜。Or, the light emitted by one or more light sources is directly matched with a certain dichroic mirror, and the corresponding reflector is omitted. 4.根据权利要求3所述的随机光学重建与结构光照明复合超分辨成像系统,其特征在于,所述多个波长不同的光源包括第一光源(1)、第二光源(2)、第三光源(3)、第四光源(4);所述反射合束组件包括第一反射镜(5)、第二反射镜(9)、第三反射镜(10)、第四反射镜(11)、第五反射镜(12)、第一二向色镜(6)、第二二向色镜(7)、第三二向色镜(8);4. The composite super-resolution imaging system of random optical reconstruction and structured light illumination according to claim 3, wherein the plurality of light sources with different wavelengths comprise a first light source (1), a second light source (2), a Three light sources (3) and a fourth light source (4); the reflection beam combining assembly includes a first reflection mirror (5), a second reflection mirror (9), a third reflection mirror (10), and a fourth reflection mirror (11) ), the fifth reflecting mirror (12), the first dichroic mirror (6), the second dichroic mirror (7), the third dichroic mirror (8); 所述第一光源(1)发出的光线依次通过第二反射镜(9)、第一反射镜(5)后,依次透过第一二向色镜(6)、第二二向色镜(7)、第三二向色镜(8);The light emitted by the first light source (1) passes through the second reflecting mirror (9) and the first reflecting mirror (5) in sequence, and then passes through the first dichroic mirror (6) and the second dichroic mirror ( 7), the third dichroic mirror (8); 所述第二光源(2)发出的光线通过第三反射镜(10)后,经第一二向色镜(6)反射,再依次透过第二二向色镜(7)、第三二向色镜(8);The light emitted by the second light source (2) passes through the third reflecting mirror (10), is reflected by the first dichroic mirror (6), and then passes through the second dichroic mirror (7), the third Chromatic mirror (8); 所述第三光源(3)发出的光线通过第五反射镜(12)后,经第二二向色镜(7)反射,再透过第三二向色镜(8);The light emitted by the third light source (3) passes through the fifth reflecting mirror (12), is reflected by the second dichroic mirror (7), and then passes through the third dichroic mirror (8); 所述第四光源(4)发出的光线通过第四反射镜(11)后,经第三二向色镜(8)反射,与来自其他三个激光器的光线合束后一起传输给声光可调谐滤波器(13)。The light emitted by the fourth light source (4) passes through the fourth reflecting mirror (11), is reflected by the third dichroic mirror (8), and is combined with the light from the other three lasers and then transmitted to the acousto-optic sensor. Tuning filter (13). 5.根据权利要求4所述的随机光学重建与结构光照明复合超分辨成像系统,其特征在于,所述复合光场调控模块包括:5. The stochastic optical reconstruction and structured light illumination composite super-resolution imaging system according to claim 4, wherein the composite light field control module comprises: 光纤准直扩束组件,包括沿光源模块出射光线所在光轴依次设置的光纤准直器(16)、激光扩束器(17)、第一消色差二分之一波片(18);an optical fiber collimating beam expanding assembly, comprising an optical fiber collimator (16), a laser beam expander (17), and a first achromatic half-wave plate (18) arranged in sequence along the optical axis where the light emitted from the light source module is located; 第一光学调控装置,包括空间光调制器(20)、偏振分光棱镜(19)、傅里叶透镜(21)、多孔掩模板(22)、偏振旋转器(23)、液晶位相补偿器(24)、准直透镜(25);A first optical control device, comprising a spatial light modulator (20), a polarization beam splitter prism (19), a Fourier lens (21), a porous mask (22), a polarization rotator (23), and a liquid crystal phase compensator (24) ), a collimating lens (25); 第二光学调控装置,包括二维扫描振镜(33)、第二消色差二分之一波片(34)、偏振分光棱镜(19)、傅里叶透镜(21)、多孔掩模板(22)、偏振旋转器(23)、液晶位相补偿器(24)、准直透镜(25);The second optical control device includes a two-dimensional scanning galvanometer (33), a second achromatic half-wave plate (34), a polarizing beam splitter prism (19), a Fourier lens (21), and a porous mask (22) ), a polarization rotator (23), a liquid crystal phase compensator (24), a collimating lens (25); 4f成像系统,包括傅里叶透镜(21)和准直透镜(25),即傅里叶透镜(21)的后焦面与准直透镜(25)的前焦面重合;4f imaging system, comprising a Fourier lens (21) and a collimating lens (25), that is, the back focal plane of the Fourier lens (21) coincides with the front focal plane of the collimating lens (25); 所述空间光调制器(20)和二维扫描振镜(33)均位于所述4f成像系统的前焦面;所述多孔掩模板(22)处于4f成像系统的傅里叶面;The spatial light modulator (20) and the two-dimensional scanning galvanometer (33) are both located on the front focal plane of the 4f imaging system; the porous mask plate (22) is located on the Fourier plane of the 4f imaging system; 所述4f成像系统与荧光成像模块光学连接;The 4f imaging system is optically connected to the fluorescence imaging module; 所述复合光场调控模块实现结构光照明模式的过程:光纤准直扩束组件输出的光经偏振分光棱镜(19)透射入射至空间光调制器(20),之后经空间光调制器(20)反射、偏振分光棱镜(19)反射后依次通过傅里叶透镜(21)、多孔掩模板(22)、偏振旋转器(23)、液晶位相补偿器(24)、准直透镜(25);The process in which the composite light field control module realizes the structured light illumination mode: the light output by the optical fiber collimating beam expanding assembly is transmitted and incident on the spatial light modulator (20) through the polarization beam splitting prism (19), and then passes through the spatial light modulator (20). ) reflection, the polarization beam splitting prism (19) is reflected and successively passes through the Fourier lens (21), the porous mask plate (22), the polarization rotator (23), the liquid crystal phase compensator (24), and the collimating lens (25); 所述复合光场调控模块实现均匀照明模式的过程:光纤准直扩束组件输出的光经偏振分光棱镜(19)反射后依次通过第二消色差二分之一波片(34)、二维扫描振镜(33),经二维扫描振镜(33)反射后依次通过第二消色差二分之一波片(34)、偏振分光棱镜(19),再经偏振分光棱镜(19)透射后依次通过傅里叶透镜(21)、多孔掩模板(22)、偏振旋转器(23)、液晶位相补偿器(24)、准直透镜(25)。The process of realizing the uniform illumination mode by the composite light field control module: the light output by the optical fiber collimating beam expanding assembly is reflected by the polarization beam splitting prism (19) and then passes through the second achromatic half-wave plate (34), the two-dimensional The scanning galvanometer (33) is reflected by the two-dimensional scanning galvanometer (33) and then passes through the second achromatic half-wave plate (34) and the polarizing beam splitting prism (19) in turn, and is then transmitted through the polarizing beam splitting prism (19) and then pass through a Fourier lens (21), a porous mask plate (22), a polarization rotator (23), a liquid crystal phase compensator (24), and a collimating lens (25) in sequence. 6.根据权利要求5所述的随机光学重建与结构光照明复合超分辨成像系统,其特征在于,所述空间光调制器(20)上加载了二元周期性条纹计算全息图,光线经空间光调制器(20)衍射到多个级次;6. The composite super-resolution imaging system of random optical reconstruction and structured light illumination according to claim 5, wherein a binary periodic fringe computational hologram is loaded on the spatial light modulator (20), and the light passes through the space. the light modulator (20) diffracts into multiple orders; 所述多孔掩模板(22)由2N个旋转对称分布的针孔构成,每个针孔为长方形结构,长边中心位置对应样品面全内反射临界角,其中N为整数;该多孔掩模板(22)用于实现空间滤波,仅允许满足特定入射角度的光线进入荧光成像模块照明样品,且从针孔不同位置通过的光线具有不同的入射角度;The porous mask plate (22) is composed of 2N rotationally symmetrically distributed pinholes, each pinhole has a rectangular structure, and the center position of the long side corresponds to the critical angle of total internal reflection of the sample surface, wherein N is an integer; the porous mask plate ( 22) It is used to realize spatial filtering, allowing only light that meets a specific incident angle to enter the fluorescence imaging module to illuminate the sample, and the light passing through different positions of the pinhole has different incident angles; 所述偏振旋转器(23)用于使从任意一个针孔通过的光束的偏振态都垂直于该针孔中心点与4f成像系统光轴所确定的平面;The polarization rotator (23) is used to make the polarization state of the light beam passing through any pinhole perpendicular to the plane defined by the pinhole center point and the optical axis of the 4f imaging system; 所述位相补偿器(24)的快轴方向与偏振分光棱镜(19)的透射光偏振方向平行,位相补偿器(24)用于主动补偿光学元件引起的激光位相漂移,使得最终到达样品面的任意一束光线的偏振态都保持为线偏振态,且偏振方向垂直该光线的入射面。The fast axis direction of the phase compensator (24) is parallel to the polarization direction of the transmitted light of the polarizing beam splitter prism (19), and the phase compensator (24) is used for actively compensating the laser phase drift caused by the optical element, so that the laser beam that finally reaches the sample surface is provided. The polarization state of any beam of light remains linear, and the polarization direction is perpendicular to the plane of incidence of the light. 7.根据权利要求6所述的随机光学重建与结构光照明复合超分辨成像系统,其特征在于,所述第一消色差二分之一波片(18)安装在电动旋转波片架上,其快轴方向与偏振分光棱镜(19)透射光偏振方向夹角为θ,经偏振分光棱镜(19)透射照明液晶空间光调制器(20)的光强与sin2(2θ)成正比,经偏振分光棱镜(19)反射照明二维扫描振镜(33)的光强与cos2(2θ)成正比。7. The stochastic optical reconstruction and structured light illumination composite super-resolution imaging system according to claim 6, wherein the first achromatic half-wave plate (18) is mounted on an electric rotating wave plate holder, The angle between the fast axis direction and the polarization direction of the transmitted light of the polarizing beam splitting prism (19) is θ, and the light intensity of the liquid crystal spatial light modulator (20) transmitted through the polarizing beam splitting prism (19) is proportional to sin 2 (2θ), The light intensity of the polarization beam splitting prism (19) reflecting and illuminating the two-dimensional scanning galvanometer (33) is proportional to cos 2 (2θ). 8.根据权利要求7所述的随机光学重建与结构光照明复合超分辨成像系统,其特征在于,当sin2(2θ)=1,cos2(2θ)=0时,复合光场调控模块独立工作在结构光照明模式;当sin2(2θ)=0,cos2(2θ)=1时,复合光场调控模块独立工作在均匀照明模式;当θ等于其它值时,两种成像模式同时工作;通过控制夹角θ的取值,可使复合光场调控模块在结构光照明模式和均匀照明模式之间相互切换,也可以使两种成像模式同时工作。8 . The stochastic optical reconstruction and structured light illumination composite super-resolution imaging system according to claim 7 , wherein when sin 2 (2θ)=1 and cos 2 (2θ)=0, the composite light field control module is independent Works in structured light illumination mode; when sin 2 (2θ)=0, cos 2 (2θ)=1, the composite light field control module independently works in uniform illumination mode; when θ is equal to other values, the two imaging modes work simultaneously ; By controlling the value of the included angle θ, the composite light field control module can be switched between the structured light illumination mode and the uniform illumination mode, and the two imaging modes can also work at the same time. 9.根据权利要求8所述的随机光学重建与结构光照明复合超分辨成像系统,其特征在于,所述荧光成像模块包括两个相机,一个相机接收结构照明光场激发的荧光并成像,另一个相机接收均匀照明光场激发的荧光并成像,相机采集的原始图像经计算机重建超分辨图像,且两个相机的图像采集时序与复合光场调控模块和光源模块通过计算机同步控制。9 . The composite super-resolution imaging system of stochastic optical reconstruction and structured light illumination according to claim 8 , wherein the fluorescence imaging module comprises two cameras, one camera receives the fluorescence excited by the structured illumination light field and images, the other One camera receives the fluorescence excited by the uniform illumination light field and takes an image. The original image collected by the camera is reconstructed by the computer as a super-resolution image, and the image acquisition sequence of the two cameras is controlled synchronously with the compound light field control module and the light source module by the computer. 10.根据权利要求9所述的随机光学重建与结构光照明复合超分辨成像系统,其特征在于,所述荧光成像模块包括:10. The stochastic optical reconstruction and structured light illumination composite super-resolution imaging system according to claim 9, wherein the fluorescence imaging module comprises: 实现结构光照明超分辨成像的装置,包括透镜(26)、显微物镜(27)、样品台(28)、第四二向色镜(29)、第五二向色镜(37)、第一管透镜(31)、第一相机(32);复合光场调控模块的出射光透过透镜(26)后再经第四二向色镜(29)反射后照射放置于样品台(28)上的样品表面,产生余弦结构照明光场,激发样品发射荧光,激发的荧光经显微物镜(27)收集,之后依次经第四二向色镜(29)透射、第五二向色镜(37)透射、第一管透镜(31)后成像到第一相机(32)的探测面;A device for realizing structured light illumination super-resolution imaging, comprising a lens (26), a microscope objective lens (27), a sample stage (28), a fourth dichroic mirror (29), a fifth dichroic mirror (37), a third A tube lens (31) and a first camera (32); the light emitted from the composite light field control module passes through the lens (26) and is then reflected by a fourth dichroic mirror (29) before being irradiated and placed on the sample stage (28) On the sample surface, a cosine structure illumination light field is generated, and the sample is excited to emit fluorescence. The excited fluorescence is collected by the microscope objective lens (27), and then transmitted through the fourth dichroic mirror (29) and the fifth dichroic mirror ( 37) transmitting and imaging the first tube lens (31) to the detection surface of the first camera (32); 实现均匀光照明超分辨成像的装置,包括透镜(26)、显微物镜(27)、样品台(28)、第四二向色镜(29)、第五二向色镜(37)、第二管透镜(35)、第二相机(36);复合光场调控模块的出射光透过透镜(26)后再经第四二向色镜(29)反射后照射放置于样品台(28)上的样品表面,产生均匀照明光场,激发样品发射荧光,激发的荧光经显微物镜(27)收集,之后依次经第四二向色镜(29)透射、第五二向色镜(37)反射、第二管透镜(35)后成像到第二相机(36)的探测面。A device for realizing super-resolution imaging under uniform light illumination, comprising a lens (26), a microscope objective lens (27), a sample stage (28), a fourth dichroic mirror (29), a fifth dichroic mirror (37), a third A two-tube lens (35) and a second camera (36); the light emitted from the compound light field control module passes through the lens (26) and is then reflected by the fourth dichroic mirror (29) before being irradiated and placed on the sample stage (28) A uniform illumination light field is generated on the surface of the sample on the surface, and the sample is excited to emit fluorescence. The excited fluorescence is collected by the microscope objective lens (27), and then transmitted through the fourth dichroic mirror (29) and the fifth dichroic mirror (37) in turn. ) is reflected and then imaged by the second tube lens (35) to the detection surface of the second camera (36).
CN202011524528.0A 2020-12-22 2020-12-22 Stochastic Optical Reconstruction and Structured Light Illumination Composite Super-resolution Imaging System Active CN112798564B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202011524528.0A CN112798564B (en) 2020-12-22 2020-12-22 Stochastic Optical Reconstruction and Structured Light Illumination Composite Super-resolution Imaging System

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202011524528.0A CN112798564B (en) 2020-12-22 2020-12-22 Stochastic Optical Reconstruction and Structured Light Illumination Composite Super-resolution Imaging System

Publications (2)

Publication Number Publication Date
CN112798564A true CN112798564A (en) 2021-05-14
CN112798564B CN112798564B (en) 2022-10-11

Family

ID=75807167

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202011524528.0A Active CN112798564B (en) 2020-12-22 2020-12-22 Stochastic Optical Reconstruction and Structured Light Illumination Composite Super-resolution Imaging System

Country Status (1)

Country Link
CN (1) CN112798564B (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113238389A (en) * 2021-05-25 2021-08-10 中国科学院苏州生物医学工程技术研究所 Structured light filtering device and structured light illumination microscopic imaging system with same
CN113466192A (en) * 2021-06-16 2021-10-01 浙大宁波理工学院 Ultra-high-speed real-time super-resolution microscopic imaging method
CN113835207A (en) * 2021-08-12 2021-12-24 浙江大学 Double-objective-lens single-molecule fluorescence microscopic imaging method and device based on three-dimensional illumination modulation
CN114486892A (en) * 2022-01-20 2022-05-13 之江实验室 Structured light illumination microscopic imaging device and method based on acousto-optic deflection scanning
CN115236043A (en) * 2022-07-01 2022-10-25 浙江大学 A visible light dual-comb high-resolution ultrafast microscope imaging device and method
CN115293981A (en) * 2022-08-02 2022-11-04 中国科学院生物物理研究所 Denoising and super-resolution reconstruction method and system for structured light illumination fluorescence microscopic image
CN115308184A (en) * 2022-09-05 2022-11-08 中国科学院苏州生物医学工程技术研究所 A method and system for super-resolution microscopy imaging with active structured light illumination
CN116165185A (en) * 2023-02-15 2023-05-26 西北工业大学青岛研究院 Laser interference large-field super-resolution high-speed microscopic imaging method
CN116858812A (en) * 2023-05-26 2023-10-10 中国科学院生态环境研究中心 Dual-color laser alternate excitation single-molecule imaging detection device, use method and application
WO2025059947A1 (en) * 2023-09-20 2025-03-27 深圳华大生命科学研究院 Structured-light illumination system, structured-light illumination method, and super-resolution optical system

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102735617A (en) * 2012-06-29 2012-10-17 浙江大学 Super-resolution microscopic method and super-resolution microscopic device
US20150015879A1 (en) * 2012-03-29 2015-01-15 Ecole Polytechnique Federale De Lausanne (Epfl) Methods and apparatus for imaging with multimode optical fibers
CN105784653A (en) * 2016-03-08 2016-07-20 浙江大学 Wide-field super resolution fluorescence microscopic imaging device
US20170307440A1 (en) * 2014-09-25 2017-10-26 Northwestern University Devices, methods, and systems relating to super resolution imaging
CN206627440U (en) * 2017-04-01 2017-11-10 北京工业大学 A kind of super-resolution fluorescence digital holography tomography micro imaging system
CN214374304U (en) * 2020-12-22 2021-10-08 中国科学院苏州生物医学工程技术研究所 Composite super-resolution imaging device

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20150015879A1 (en) * 2012-03-29 2015-01-15 Ecole Polytechnique Federale De Lausanne (Epfl) Methods and apparatus for imaging with multimode optical fibers
CN102735617A (en) * 2012-06-29 2012-10-17 浙江大学 Super-resolution microscopic method and super-resolution microscopic device
US20170307440A1 (en) * 2014-09-25 2017-10-26 Northwestern University Devices, methods, and systems relating to super resolution imaging
CN105784653A (en) * 2016-03-08 2016-07-20 浙江大学 Wide-field super resolution fluorescence microscopic imaging device
CN206627440U (en) * 2017-04-01 2017-11-10 北京工业大学 A kind of super-resolution fluorescence digital holography tomography micro imaging system
CN214374304U (en) * 2020-12-22 2021-10-08 中国科学院苏州生物医学工程技术研究所 Composite super-resolution imaging device

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
VIRGINIE HAME ET.AL: "Correlative multicolor 3D SIM and STORM microscopy", 《BIOMEDICAL OPTICS EXPRESS》 *
YONG LIANG ET.AL: "High Dynamic Range Structured Illumination Microscope Based on Multiple Exposures", 《FRONTIERS IN PHYSICS》 *

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN113238389A (en) * 2021-05-25 2021-08-10 中国科学院苏州生物医学工程技术研究所 Structured light filtering device and structured light illumination microscopic imaging system with same
CN113466192A (en) * 2021-06-16 2021-10-01 浙大宁波理工学院 Ultra-high-speed real-time super-resolution microscopic imaging method
CN113835207A (en) * 2021-08-12 2021-12-24 浙江大学 Double-objective-lens single-molecule fluorescence microscopic imaging method and device based on three-dimensional illumination modulation
CN114486892B (en) * 2022-01-20 2024-01-16 之江实验室 A structured illumination microscopy imaging device and method based on acousto-optic deflection scanning
CN114486892A (en) * 2022-01-20 2022-05-13 之江实验室 Structured light illumination microscopic imaging device and method based on acousto-optic deflection scanning
CN115236043A (en) * 2022-07-01 2022-10-25 浙江大学 A visible light dual-comb high-resolution ultrafast microscope imaging device and method
CN115293981A (en) * 2022-08-02 2022-11-04 中国科学院生物物理研究所 Denoising and super-resolution reconstruction method and system for structured light illumination fluorescence microscopic image
CN115308184A (en) * 2022-09-05 2022-11-08 中国科学院苏州生物医学工程技术研究所 A method and system for super-resolution microscopy imaging with active structured light illumination
WO2024051079A1 (en) * 2022-09-05 2024-03-14 中国科学院苏州生物医学工程技术研究所 Super-resolution microscopic imaging method and system based on active-structured illumination
CN116165185A (en) * 2023-02-15 2023-05-26 西北工业大学青岛研究院 Laser interference large-field super-resolution high-speed microscopic imaging method
CN116165185B (en) * 2023-02-15 2025-06-24 西北工业大学青岛研究院 Laser interference large-field super-resolution high-speed microscopic imaging method
CN116858812A (en) * 2023-05-26 2023-10-10 中国科学院生态环境研究中心 Dual-color laser alternate excitation single-molecule imaging detection device, use method and application
WO2025059947A1 (en) * 2023-09-20 2025-03-27 深圳华大生命科学研究院 Structured-light illumination system, structured-light illumination method, and super-resolution optical system

Also Published As

Publication number Publication date
CN112798564B (en) 2022-10-11

Similar Documents

Publication Publication Date Title
CN112798564B (en) Stochastic Optical Reconstruction and Structured Light Illumination Composite Super-resolution Imaging System
CN107014793B (en) A multi-mode wide-field super-resolution microscopy imaging system based on dual galvo mirrors and dual objectives
CN115308184B (en) A super-resolution microscopic imaging method and system using active structured light illumination
US7009700B2 (en) Method and device for obtaining a sample with three-dimensional microscopy
CN105973853B (en) A kind of super-resolution microscopic method and device based on double mode competition excitation
CN114324245B (en) Quantitative phase microscopic device and method based on partially coherent structured light illumination
US7903247B2 (en) Method and microscope for high spatial resolution examination of samples
US20140085623A1 (en) Technique for tomographic image recording
CN104634766B (en) Super-resolution device and method based on pumping-probe technology
US10976532B2 (en) Structured illumination microscopy system using digital micromirror device and time-complex structured illumination, and operation method therefor
US5589936A (en) Optical measuring apparatus for measuring physichemical properties
US20250321408A1 (en) Super-Resolution Single-Objective Light-Sheet Optical Microscopy System and Imaging System Comprising Same
CN107356566A (en) A kind of wide field three-dimensional super-resolution to intact cell positions and imaging method and device
CN106980174A (en) A kind of comprehensive fluorescence super-resolution microscopic imaging device
CN109870441B (en) Frequency-shift-based 3D super-resolution optical section fluorescence microscopy imaging method and device
CN214374304U (en) Composite super-resolution imaging device
US20250013026A1 (en) Multi-focal light-sheet structured illumination fluorescence microscopy system
WO2013176549A1 (en) Optical apparatus for multiple points of view three-dimensional microscopy and method
CN217112868U (en) Multi-mode multi-color fast switching structured light illumination system
CN102866137B (en) Two-dimensional super-resolution microscopy method and apparatus
RU2579640C1 (en) Confocal image spectrum analyser
CN119901716A (en) A confocal single-molecule three-dimensional detection and tracking method and system
CN119087652A (en) A reflective non-labeling super-resolution optical microscopy system and method
CN210571973U (en) A Raman Microsystem with Optical Tweezers
CN117250178B (en) Fluorescence anisotropy detection method and detection system thereof

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant