WO2021243754A1 - Super-resolution imaging method and imaging system based on low-power stimulated emission depletion - Google Patents

Super-resolution imaging method and imaging system based on low-power stimulated emission depletion Download PDF

Info

Publication number
WO2021243754A1
WO2021243754A1 PCT/CN2020/096779 CN2020096779W WO2021243754A1 WO 2021243754 A1 WO2021243754 A1 WO 2021243754A1 CN 2020096779 W CN2020096779 W CN 2020096779W WO 2021243754 A1 WO2021243754 A1 WO 2021243754A1
Authority
WO
WIPO (PCT)
Prior art keywords
super
resolution
laser
image
signal
Prior art date
Application number
PCT/CN2020/096779
Other languages
French (fr)
Chinese (zh)
Inventor
严伟
王璐玮
屈军乐
王佳林
张佳
Original Assignee
深圳大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳大学 filed Critical 深圳大学
Publication of WO2021243754A1 publication Critical patent/WO2021243754A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/01Arrangements or apparatus for facilitating the optical investigation
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6402Atomic fluorescence; Laser induced fluorescence
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6486Measuring fluorescence of biological material, e.g. DNA, RNA, cells

Definitions

  • This application relates to the technical field of super-resolution optical microscopy imaging, in particular to a super-resolution imaging method and imaging system based on low-power stimulated emission loss.
  • Live cell and tissue imaging is very important to the research in the field of biomedicine.
  • advanced imaging methods and imaging systems can guarantee the greatest degree of protection while maintaining the biological characteristics of the observed samples.
  • Optical microscope has the advantages of non-contact, non-damage and specificity. It is an important symbol of the beginning of the development of modern natural science. It can be well applied to imaging of living cells and tissues. However, the diffraction of light limits the resolution capability of optical microscopes, making it impossible to clearly distinguish microscopic biological structures with a size below 200 nm.
  • Super-resolution optical microscopy (SRM) technology inherits the non-contact and specific advantages of optical microscopy.
  • German scientist Stefan W. Hell proposed stimulated emission depletion (STED) microscopy technology based on Einstein's radiation theory. Based on the non-linear relationship between fluorescence saturation and excited fluorescence stimulated emission, STED technology uses a second wavelength red-shifted laser to selectively dissipate excited molecules in advance, and improve imaging by compressing the effective point spread function of the excitation spot Resolution, theoretically, nanometer-level resolution can be achieved in three-dimensional space. As the first far-field super-resolution imaging method proposed theoretically and realized in experiments, STED technology has the advantages of fast imaging and no need for post-image reconstruction.
  • the loss laser wavelength is usually at the tail end of the fluorescent dye emission spectrum. Due to the extremely small stimulated radiation cross section at the tail end of the emission spectrum, STED technology requires extremely high loss energy (usually more than three orders of magnitude higher than the energy of the excitation light) to improve resolution. Excessive laser energy can cause photobleaching and phototoxicity, and cause damage to fluorescent probes and biological tissues, thus limiting the application of this technology in live cell and tissue imaging.
  • Fluorescence lifetime imaging microscopy is a microscope imaging technique that describes the spatial distribution of fluorescence lifetimes. It can be applied to the imaging of fixed cells and living cells, revealing more biological information (such as the microenvironment within the cell). Variety). FLIM technology based on time-correlated single photon counting (TCSPC) divides the pulse period into multiple equally spaced time channels, and converts it into memory based on the time difference of the photon relative to the reference signal reaching the detector. Address, the fluorescence decay curve of the dye is obtained after the accumulation of the photon signal.
  • TCSPC time-correlated single photon counting
  • the intensity and lifetime information of the fluorescence signal can be obtained at the same time, and the dual-mode STED-FLIM super-resolution fluorescence lifetime imaging can be realized.
  • Confocal-FLIM confocal fluorescence lifetime imaging
  • STED-FLIM STED super-resolution fluorescence lifetime imaging
  • STED-FLIM can achieve super-resolution fluorescence lifetime imaging, too high laser energy changes the fluorescence lifetime characteristics of the fluorescent dye itself, so it cannot truly reflect the changes in the microenvironment, resulting in the inability to present fine structural features when imaging the sample , Resulting in poor imaging effects and difficult to obtain high-resolution images.
  • the embodiments of the present application provide a super-resolution imaging method and imaging system based on low-power stimulated emission loss, aiming to solve the high demand for loss laser power in the stimulated radiation loss super-resolution imaging method and super-resolution images under high laser power.
  • the problem of poor quality is a problem of poor quality.
  • an embodiment of the present application provides a super-resolution imaging method based on low-power stimulated emission loss, which includes:
  • Emitting an excitation laser and a loss laser, the excitation laser and the loss laser are both Gaussian pulse lasers, wherein the wavelength of the loss laser is greater than the wavelength of the excitation laser;
  • the fluorescence signal contains the time information and spatial information of the fluorescence photon
  • the confocal image and the initial super-resolution image are analyzed and processed according to preset image processing rules to obtain a higher-resolution target super-resolution image.
  • the embodiments of the present application provide a super-resolution imaging system based on low-power stimulated emission loss, which includes:
  • the signal acquisition device is configured to acquire the excitation light pulse signal as a reference signal, and acquire the fluorescent signal generated after the sample is irradiated;
  • the imaging processing terminal is configured to process the excitation light pulse signal and the fluorescence signal collected by the signal collection device to obtain the target super-resolution image.
  • the embodiments of the present application provide a super-resolution imaging method and imaging system based on low-power stimulated emission loss.
  • the low-power Gaussian loss laser is converted into a ring loss laser and overlaps with the excitation laser to focus and irradiate the sample.
  • Make the collected fluorescence lifetime data include confocal signal and super-resolution signal at the same time.
  • the confocal image and the initial super-resolution image are separated from the fluorescence signal through data processing, and the confocal image and the initial super-resolution image are analyzed and processed according to the image processing rules to obtain the target super-resolution image with further improved resolution.
  • the use of low-power loss lasers reduces the damage to biological samples, reduces the photobleaching effect of fluorescent dyes, and prolongs the effective time of super-resolution imaging.
  • image enhancement processing high resolutions containing fine structural features are obtained. Images have achieved good technical results in the actual application process.
  • FIG. 1 is a schematic flowchart of a super-resolution imaging method based on low-power stimulated emission loss according to an embodiment of the application;
  • FIG. 2 is a schematic diagram of a sub-flow of a super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application;
  • FIG. 3 is a schematic diagram of a sub-process of a super-resolution imaging method based on low-power stimulated emission loss according to an embodiment of the application;
  • FIG. 4 is a schematic diagram of a sub-process of a super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application;
  • FIG. 5 is a schematic diagram of a super-resolution imaging system based on low-power stimulated emission loss according to an embodiment of the application;
  • FIG. 6 is a schematic block diagram of an imaging processing terminal provided by an embodiment of the application.
  • FIG. 7 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss according to an embodiment of the application;
  • FIG. 8 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss according to an embodiment of the application;
  • FIG. 9 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application.
  • FIG. 10 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application.
  • FIG. 1 is a schematic flowchart of a super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of this application
  • FIG. 5 is a low-power stimulated emission loss-based method provided by an embodiment of this application.
  • the super-resolution imaging method based on low-power stimulated emission loss is applied to an imaging system.
  • the imaging system includes a signal acquisition device 10 and an imaging processing terminal 20.
  • the method combines the signal acquisition device 10 with application software installed in the imaging processing terminal 20
  • the imaging system is a system device used to implement a super-resolution imaging method based on low-power stimulated emission loss to achieve high-resolution imaging of the sample
  • the signal acquisition device 10 is used to emit excitation laser and loss
  • the laser detects the sample and collects the excitation light pulse signal and the fluorescence signal.
  • the imaging processing terminal 20 is used to obtain the excitation light pulse signal and the fluorescence signal collected by the signal collection device and perform imaging processing to obtain the target super-resolution image.
  • terminal devices such as workstations, desktop computers, laptops, tablets, or mobile phones.
  • the method includes steps S110 to S160.
  • S110 Place the sample dyed by the fluorescent dye on the stage and adjust the position of the corner reflector in the first light path.
  • the sample can be biological materials such as living cells, viruses or tissues.
  • Fluorescent dyes are dyes that are excited by light and generate fluorescent photons. Adjusting the position of the corner reflector can prolong the loss.
  • FIG. 10 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application. Specifically, as shown in FIG. 10, when the corner reflector is not adjusted, the corner reflector is located in the position in FIG.
  • the optical path length of the lossy laser propagating along the first optical path (the time required for the light to travel a certain distance along a certain path) is ⁇ 1
  • the optical path interval between the excitation laser pulse and the loss laser pulse is ⁇ 1 (excitation The time difference between the laser pulse and the loss laser pulse acting on the sample); adjust the position of the corner reflector to position 2 in Figure 10, and the distance between position 1 and position 2 is S
  • the optical path of the loss laser propagating along the first optical path is ⁇ 1 +2S/c, where c is the speed of light
  • both of the excitation laser and the loss laser are Gaussian pulse lasers, wherein the wavelength of the loss laser is greater than the wavelength of the excitation laser.
  • Both excitation laser and loss laser can be emitted at the same time.
  • Both lasers are pulsed lasers, and the pulse frequency is the same (such as 80MHz).
  • the frequency of the laser is inversely proportional to the pulse period of the laser.
  • the pulse period should include at least a complete autofluorescence process ( Usually on the order of nanoseconds and above). The longer the fluorescence lifetime, the larger the pulse period of the laser, and the smaller the pulse frequency of the laser.
  • the power of the excitation laser is less than the power of the loss laser.
  • the power of the loss laser here is at least an order of magnitude (such as less than 10mW) lower than the traditional stimulated radiation loss super-resolution imaging ( ⁇ 100mW).
  • the power of is related to the spectral characteristics of the luminescent material, usually 0.1-100 ⁇ W.
  • the pulse width of the excitation laser and the pulse width of the loss laser are both on the order of one hundred picoseconds.
  • the pulse width of the excitation laser and the pulse width of the loss laser can both be in the range of 0.1-1 nanoseconds.
  • a spiral phase plate can be installed after the corner reflector of the first optical path, and the loss laser of the Gaussian pulse laser is converted into ring loss laser through the spiral phase plate, and the ring loss laser coincides with the excitation laser propagating along the second optical path.
  • the focal planes of the two laser beams precisely coincide in space and then focus and irradiate the sample. After the dyed sample is irradiated, the fluorescent dye will produce a fluorescent signal.
  • S140 Collect the excitation light pulse signal of the excitation laser and the fluorescence signal generated after the sample is irradiated at the same time, and the fluorescence signal contains time information and spatial information of the fluorescence photon.
  • the excitation light pulse signal of the excitation laser and the fluorescence signal generated after the sample is irradiated are collected.
  • the collected excitation light pulse signal of the excitation laser is used as the starting point of fluorescence lifetime detection; the fluorescent dye is irradiated and spontaneously emits fluorescence photons Signal, the obtained fluorescent photon signal constitutes the above-mentioned fluorescent signal.
  • the fluorescent signal contains the time information and spatial information of the fluorescent photon.
  • the spatial information of the fluorescent photon is the specific position of the radiated fluorescent photon on the two-dimensional plane. Information, the intensity of the fluorescent photon emitted by the fluorescent molecule gradually decreases with time within a single pulse period, and the time information of the fluorescent photon is the time information when the relative reference signal of the collected fluorescent photon reaches the detector.
  • the excitation light pulse signal and the fluorescence signal are respectively transmitted to the imaging processing terminal, and the excitation light pulse signal and the fluorescence signal are analyzed and processed through the imaging processing terminal to obtain a super-resolution image for high-resolution imaging of the sample.
  • the fluorescence signal is segmented according to the segmentation rule and the excitation light pulse signal to obtain the confocal image and the initial super-resolution image.
  • the confocal image is the fluorescence lifetime imaging generated by the excitation laser irradiating the sample
  • the initial super-resolution image is For STED (Stimulated Emission Depletion) super-resolution fluorescence lifetime imaging produced by irradiating the sample with the excitation laser and ring loss laser at the same time.
  • step S150 includes sub-steps S151, S152, S153, and S154.
  • the time at which the excitation light pulse signal is detected is regarded as the start time of fluorescence lifetime detection, that is, as the zero point of the time channel, and the intensity change of the fluorescent photon on the time channel is obtained according to the start time, that is, the time is taken as the horizontal
  • the coordinate is to obtain the intensity change of the fluorescent photon through the accumulation of the number of photons.
  • a time channel is a unit time (for example, a time channel can be set to 0.05 nanoseconds).
  • the ordinate is the intensity value of the fluorescent photon, and the intensity of the fluorescent photon can be It is reflected by the number of fluorescent photons collected by time accumulation in each time channel. The greater the number of fluorescent photons in a certain time channel, the higher the intensity of fluorescent photons, and finally the fluorescence decay curve of the fluorescent signal is obtained.
  • FIG. 7 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application.
  • a sample of fluorescent beads with a diameter of 23nm was used for the experiment.
  • the wavelength of the excitation laser was 635nm
  • the power was 35 ⁇ W
  • the wavelength of the loss laser was 730nm
  • the power was 10mW.
  • the frequency of the excitation laser and the frequency of the loss laser were both 80MHz.
  • the pulse width of the wide and depleted laser is about 0.3 nanoseconds (ns), and the optical path interval ⁇ 2 between the excitation laser pulse and the depleted laser pulse is 2 nanoseconds.
  • the fluorescence decay curve of the obtained fluorescence signal is shown in Figure 7 .
  • the time channel position of the intensity mutation in the fluorescence decay curve according to the segmentation rule as the segmentation point.
  • the signal intensity of the fluorescence signal will have a sudden change, and the sudden change of signal intensity can be reflected in the obtained fluorescence decay curve.
  • step S152 includes sub-steps S1521, S1522, and S1523.
  • S1521 calculate the slope value of each point in the fluorescence decay curve according to the slope value calculation formula to obtain the corresponding slope curve; S1522, calculate the slope change value of each point in the slope curve according to the slope change value calculation formula S1523. Obtain a time channel position in the fluorescence decay curve corresponding to the slope change value with the largest value as the segmentation point.
  • the fluorescence decay curve is composed of multiple points, and the slope calculation formula can calculate the slope value of each point in the fluorescence decay curve to obtain the slope curve.
  • the slope value of y r+2 is the ordinate of the point on the right side of the rth point 2 pixels apart from it
  • y r-2 is the ordinate of the point on the left side of the rth point 2 pixels apart from it
  • x r+2 is the abscissa of the point 2 pixels away from the right of the rth point
  • x r+2 is the abscissa of the point 2 pixels away from the left of the rth point
  • x r+2 is the abscissa of the point 2 pixels away from the left of the r
  • the slope calculation formula can also be a calculation formula for deriving points in the fluorescence attenuation curve.
  • the slope change value calculation formula is used to calculate the slope change value of each point in the slope curve.
  • the calculation method of the slope change value is the same as the calculation method of the above slope value.
  • a non-negative value corresponding to a slope change value is obtained, and the time channel position corresponding to the time channel position in the fluorescence decay curve of the slope change value with the largest value among the non-negative values is obtained as the division point, that is, the slope change value with the largest value is obtained.
  • the corresponding abscissa value in the fluorescence decay curve is used as the dividing point.
  • the spatial information of the fluorescent photons from the start time to the segmentation point in the fluorescence signal is obtained to form a confocal image
  • the spatial information of the fluorescence photons after the segmentation point in the fluorescence signal is obtained to form an initial Super-resolution image.
  • FIG. 8 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application. For example, after segmenting the obtained fluorescent signal, a confocal image of the sample is obtained as shown in Fig. 8(a), and a corresponding initial super-resolution image is obtained as shown in Fig. 8(b).
  • the confocal image and the initial super-resolution image are analyzed and processed through the image processing rules, which can greatly improve the resolution of imaging the sample and obtain the target super-resolution image of the sample.
  • step S160 includes sub-steps S161, S162, and S163.
  • the field of view of the confocal image, the initial super-resolution image, and the resulting ring image is the same (the image size is the same). Specifically, the pixel value of a pixel in the confocal image is subtracted from the pixel value corresponding to the pixel in the initial super-resolution image to obtain the pixel difference value of the pixel, and the pixel difference value of each pixel in the confocal image is obtained and combined You can get a corresponding ring image.
  • the focused image in Figure 8 is named image A
  • the initial super-resolution image is named image B
  • the resulting ring image is named image C
  • the pixel value of each pixel in the ring image is multiplied by the enhancement coefficient to obtain the corresponding enhanced ring image.
  • the enhancement coefficient is a coefficient value preset by the user, the value of the enhancement coefficient is greater than 1, and the enhancement coefficient may be an integer or a decimal number.
  • FIG. 9 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application.
  • the enhancement factor is 1, the ring image is shown in Figure 9(1), and the enhanced ring image obtained at this time is the same as the ring image C; if the enhancement factor is 2, the enhanced ring image obtained at this time is as As shown in Fig. 9(2); taking the enhancement coefficient as 4, the enhanced ring image obtained at this time is as shown in Fig. 9(3).
  • the obtained super-resolution image of the target also has the same field of view as the confocal image. Specifically, the pixel value of a pixel in the initial super-resolution image is subtracted from the pixel value corresponding to the pixel in the ring image to obtain the pixel difference value of the pixel, and the initial super-resolution image and the pixel value of each pixel in the ring image are obtained. The pixel difference can be combined to obtain the corresponding target super-resolution image.
  • the obtained ring image can be expressed as 1 ⁇ C, and the target super-resolution image obtained at this time is shown in Figure 9 (4); if the enhancement factor is 2, the obtained ring image can be expressed as 2 ⁇ C, the target super-resolution image obtained at this time is shown in Figure 9(5); taking the enhancement coefficient as 4, the obtained ring image can be expressed as 4 ⁇ C, and the target super-resolution image obtained at this time is shown in Figure 9(5). Shown in 9(6).
  • the super-resolution imaging method based on low-power stimulated emission loss extends the optical path of the lossy laser propagating in the first optical path by adjusting the position of the corner reflector in the first optical path, and reduces the low-power
  • the Gaussian loss laser is converted into a ring loss laser and coincides with the excitation laser to focus and irradiate the sample, so that the collected fluorescence lifetime data contains both confocal and super-resolution signals.
  • the confocal image and the initial super-resolution image are separated from the fluorescence signal through data processing, and the confocal image and the initial super-resolution image are analyzed and processed according to the image processing rules to obtain the target super-resolution image with further improved resolution.
  • the use of low-power loss lasers reduces the damage to biological samples, reduces the photobleaching effect of fluorescent dyes, and prolongs the effective time of super-resolution imaging.
  • image enhancement processing high resolutions containing fine structural features are obtained. Images have achieved good technical results in the actual application process.
  • the embodiment of the present application also provides a super-resolution imaging system based on low-power stimulated emission loss.
  • the super-resolution imaging system based on low-power stimulated emission loss can be used to realize the aforementioned super-resolution imaging method based on low-power stimulated emission loss. Any embodiment of. Specifically, please refer to FIGS. 5-6.
  • FIG. 5 is a schematic diagram of a super-resolution imaging system based on low-power stimulated emission loss according to an embodiment of the application
  • FIG. 6 is a schematic diagram of an imaging processing terminal provided by an embodiment of the application.
  • the imaging system includes a signal acquisition device 10 and an imaging processing terminal 20.
  • the signal acquisition device 10 is used for acquiring the excitation light pulse signal as a reference signal, and acquiring the fluorescent signal generated after the sample is irradiated.
  • the signal acquisition device includes an excitation laser 101, a loss laser 102, a beam splitter 103, a first dichroic mirror 104, a second dichroic mirror 105, the corner reflector 106, a spiral phase plate 107, a scanning galvanometer 108, The objective lens 109, the stage 110, the preamplifier 111, the first detector 112, the second detector 113, and a time dependent single photon counter (TCSPC) 114.
  • TCSPC time dependent single photon counter
  • the excitation laser 101 is used to emit Gaussian pulse excitation laser; the loss laser 102 is used to emit Gaussian pulse loss laser; the spectroscope is used to split the excitation laser light to A part of the excitation laser light is propagated along the second optical path, and the other part of the excitation laser light is injected into the second detector; The laser light is reflected to propagate to the spiral phase plate; the spiral phase plate 107 is used to convert the incident loss laser light of the Gaussian pulse into ring loss laser light so that it propagates to the second dichroic mirror
  • the first dichroic mirror 104 is used to reflect the excitation laser propagating along the second optical path to make it propagate to the second dichroic mirror, and to transmit the fluorescent signal generated after the sample is irradiated
  • the second dichroic mirror 105 is used to reflect the ring loss laser and transmit the excitation laser propagating along the second optical path so that the two lasers overlap and propagate to the scanning galvanometer, and The fluorescence signal is transmitted; the scanning galvan
  • an electrical connection is made between the excitation laser 101 and the loss laser 102, and the excitation laser 101 is triggered synchronously by the loss laser 102, so that the two laser pulses maintain a stable pulse interval.
  • the imaging processing terminal 20 is configured to process the excitation light pulse signal and the fluorescence signal collected by the signal collection device to obtain the target super-resolution image.
  • the imaging processing terminal 20 is a terminal device used to obtain the excitation light pulse signal and the fluorescence signal collected by the signal acquisition device and then perform imaging processing to obtain the target super-resolution image, such as a workstation, a desktop computer, a notebook computer, a tablet computer, or a mobile phone. Wait.
  • the imaging processing terminal 20 may perform the following steps: separate a confocal image and an initial super-resolution image from the fluorescence signal according to the excitation light pulse signal and a preset segmentation rule; The focused image and the initial super-resolution image are analyzed and processed to obtain a high-resolution target super-resolution image.
  • the imaging processing terminal 20 includes a fluorescent signal dividing unit 210 and an image processing unit 220.
  • the fluorescence signal segmentation unit 210 is used to separate the confocal image and the initial super-resolution image from the fluorescence signal according to the excitation light pulse signal and preset segmentation rules; the image processing unit 220 is used to separate the confocal image and the initial super-resolution image according to the preset image
  • the processing rules analyze and process the confocal image and the initial super-resolution image to obtain a higher-resolution target super-resolution image.

Landscapes

  • Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Immunology (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Molecular Biology (AREA)
  • Optics & Photonics (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)

Abstract

Provided are a super-resolution imaging method and imaging system based on low-power stimulated emission depletion. The method comprises: by adjusting the position of a corner reflector (106) arranged in a first optical path, extending the optical distance of depletion laser light propagated in the first optical path, converting low-power Gaussian-type depletion laser light into annular depletion laser light, and the annular depletion laser light coinciding with excitation laser light and then focusing on and irradiating a sample, such that acquired fluorescence service life data includes both a confocal signal and a super-resolution signal; and separating a confocal image and an initial super-resolution image from a fluorescence signal by means of data processing, analyzing and processing the confocal image and the initial super-resolution image according to an image processing rule, and thus obtaining a target super-resolution image, the resolution of which has been further improved. By means of the method, damage to a biological sample is reduced by using low-power depletion laser light, a photobleaching effect on a fluorescent dye is reduced, the effective time of super-resolution imaging is prolonged, and a high-resolution image including fine structural features can be obtained.

Description

基于低功率受激发射损耗的超分辨成像方法及成像系统Super-resolution imaging method and imaging system based on low-power stimulated emission loss
本申请是以申请号为202010500061.X、申请日为2020年6月4日的中国专利申请为基础,并主张其优先权,该申请的全部内容在此作为整体引入本申请中。This application is based on a Chinese patent application with an application number of 202010500061.X and an application date of June 4, 2020, and claims its priority. The entire content of this application is hereby incorporated into this application as a whole.
技术领域Technical field
本申请涉及超分辨光学显微成像的技术领域,尤其涉及一种基于低功率受激发射损耗的超分辨成像方法及成像系统。This application relates to the technical field of super-resolution optical microscopy imaging, in particular to a super-resolution imaging method and imaging system based on low-power stimulated emission loss.
背景技术Background technique
活细胞和组织成像对生物医学领域的研究至关重要,除了正确的细胞培养条件和样品制备方法,先进的成像方法及成像系统可以在保持被观测样品自身生物特性的基础上,最大程度地保障获取信息的真实性和有效性。光学显微镜具有非接触、无损伤和特异性的优点,是近代自然科学发展开端的重要标志,它可以很好地应用于活细胞和组织的成像。但是,光的衍射限制了光学显微镜的分辨率能力,使其无法清晰地辨别尺寸在200nm以下的微观生物结构。超分辨光学显微镜(Super-resolution optical microscopy,SRM)技术继承了光学显微镜的非接触和特异性优点,通过物理化学原理将光学显微镜的分辨率提升1~2个数量级,可以在分子水平了解生命的发展变化规律,揭示生物体的抗/耐药性和干预治疗作用的细胞分子机理,是本世纪光学显微成像领域最重大的突破之一。近年来,超分辨光学成像技术的快速发展让光学显微镜与生物医学等领域的联系更加紧密,但是现有的技术对样品(制备)和荧光染料有着极其严格的要求,限制了在活体生物成像中的应用。Live cell and tissue imaging is very important to the research in the field of biomedicine. In addition to correct cell culture conditions and sample preparation methods, advanced imaging methods and imaging systems can guarantee the greatest degree of protection while maintaining the biological characteristics of the observed samples. Obtain the authenticity and validity of the information. Optical microscope has the advantages of non-contact, non-damage and specificity. It is an important symbol of the beginning of the development of modern natural science. It can be well applied to imaging of living cells and tissues. However, the diffraction of light limits the resolution capability of optical microscopes, making it impossible to clearly distinguish microscopic biological structures with a size below 200 nm. Super-resolution optical microscopy (SRM) technology inherits the non-contact and specific advantages of optical microscopy. Through physical and chemical principles, the resolution of optical microscopy is increased by 1 to 2 orders of magnitude, and life can be understood at the molecular level. The law of development and change, revealing the cellular and molecular mechanisms of biological resistance/drug resistance and intervention therapy is one of the most significant breakthroughs in the field of optical microscopy in this century. In recent years, the rapid development of super-resolution optical imaging technology has made optical microscopes more closely related to the fields of biomedicine, but the existing technology has extremely strict requirements on samples (preparation) and fluorescent dyes, which limits the use of in vivo biological imaging. Applications.
1994年,德国科学家Stefan W.Hell根据爱因斯坦辐射理论提出受激发射损耗(Stimulated emission depletion,STED)显微技术。基于荧光饱和与激发态荧光受激辐射之间的非线性关系,STED技术利用第二束波长红移的激光对激发态分子提前进行选择性耗散,通过压缩激发光斑的有效点扩展函数提高成像分辨率,理论上可以实现三维空间上纳米级的分辨率。作为第一个理论上提出和实验中实现的远场超分辨成像方法,STED技术具有快速成像和无需后期图像重构的优势。但是,为了避免再激发效应对超分辨图像质量的影响,损耗激光波长通常位于荧光染料发射光谱尾端。由于发射光谱尾端的受激辐射截面极小,STED技术需要极高的损耗能量(通常比激发光能量高三个数量级以上)实现分辨率的 提升。过高的激光能量会引起光漂白和光毒性,对荧光探针和生物组织产生破坏,因此限制了该技术在活细胞和组织成像中的应用。In 1994, German scientist Stefan W. Hell proposed stimulated emission depletion (STED) microscopy technology based on Einstein's radiation theory. Based on the non-linear relationship between fluorescence saturation and excited fluorescence stimulated emission, STED technology uses a second wavelength red-shifted laser to selectively dissipate excited molecules in advance, and improve imaging by compressing the effective point spread function of the excitation spot Resolution, theoretically, nanometer-level resolution can be achieved in three-dimensional space. As the first far-field super-resolution imaging method proposed theoretically and realized in experiments, STED technology has the advantages of fast imaging and no need for post-image reconstruction. However, in order to avoid the impact of re-excitation effect on the quality of super-resolution images, the loss laser wavelength is usually at the tail end of the fluorescent dye emission spectrum. Due to the extremely small stimulated radiation cross section at the tail end of the emission spectrum, STED technology requires extremely high loss energy (usually more than three orders of magnitude higher than the energy of the excitation light) to improve resolution. Excessive laser energy can cause photobleaching and phototoxicity, and cause damage to fluorescent probes and biological tissues, thus limiting the application of this technology in live cell and tissue imaging.
荧光寿命成像显微镜(Fluorescence lifetime imaging microscopy,FLIM)是一种描述荧光寿命空间分布的显微镜成像技术,可以应用于固定细胞和活细胞的成像中,揭示更多的生物信息(如细胞内微环境的变化)。基于时间相关单光子计数器(Time-correlated single photon counting,TCSPC)的FLIM技术通过将脉冲周期划分为多个等间距的时间通道,根据光子相对参考信号到达探测器的时间差,将其转换为存储器的地址,光子信号积累后得到染料的荧光衰减曲线。将STED和FLIM两种成像技术相结合,可以同时获取荧光信号的强度和寿命信息,实现双模态STED-FLIM超分辨荧光寿命成像。在共聚焦荧光寿命成像(Confocal-FLIM)中,荧光寿命曲线随时间呈单指数衰减;但是在STED超分辨荧光寿命成像(STED-FLIM)中,由于损耗激光对激发态分子的受激辐射作用,荧光寿命曲线随时间呈多指数衰减。虽然STED-FLIM可以实现超分辨率的荧光寿命成像,但是过高的激光能量改变了荧光染料自身的荧光寿命特性,因此无法真实的反映微环境变化,导致对样品进行成像时无法呈现细微结构特征,造成成像效果较差而难以获取高分辨率的图像。Fluorescence lifetime imaging microscopy (FLIM) is a microscope imaging technique that describes the spatial distribution of fluorescence lifetimes. It can be applied to the imaging of fixed cells and living cells, revealing more biological information (such as the microenvironment within the cell). Variety). FLIM technology based on time-correlated single photon counting (TCSPC) divides the pulse period into multiple equally spaced time channels, and converts it into memory based on the time difference of the photon relative to the reference signal reaching the detector. Address, the fluorescence decay curve of the dye is obtained after the accumulation of the photon signal. Combining the two imaging technologies of STED and FLIM, the intensity and lifetime information of the fluorescence signal can be obtained at the same time, and the dual-mode STED-FLIM super-resolution fluorescence lifetime imaging can be realized. In confocal fluorescence lifetime imaging (Confocal-FLIM), the fluorescence lifetime curve decays single exponentially with time; but in STED super-resolution fluorescence lifetime imaging (STED-FLIM), due to the stimulated radiation effect of the depleted laser on excited molecules , The fluorescence lifetime curve decays exponentially with time. Although STED-FLIM can achieve super-resolution fluorescence lifetime imaging, too high laser energy changes the fluorescence lifetime characteristics of the fluorescent dye itself, so it cannot truly reflect the changes in the microenvironment, resulting in the inability to present fine structural features when imaging the sample , Resulting in poor imaging effects and difficult to obtain high-resolution images.
申请内容Application content
本申请实施例提供了一种基于低功率受激发射损耗的超分辨成像方法及成像系统,旨在解决受激辐射损耗超分辨成像方法对损耗激光功率需求高,以及高激光功率下超分辨图像质量差的问题。The embodiments of the present application provide a super-resolution imaging method and imaging system based on low-power stimulated emission loss, aiming to solve the high demand for loss laser power in the stimulated radiation loss super-resolution imaging method and super-resolution images under high laser power. The problem of poor quality.
第一方面,本申请实施例提供了一种基于低功率受激发射损耗的超分辨成像方法,其包括:In the first aspect, an embodiment of the present application provides a super-resolution imaging method based on low-power stimulated emission loss, which includes:
将被荧光染料染色的样品置于载物台上并调整第一光路中角反射器的位置;Place the sample dyed with fluorescent dye on the stage and adjust the position of the corner reflector in the first light path;
发射激发激光及损耗激光,所述激发激光及所述损耗激光均为高斯型脉冲激光,其中,所述损耗激光的波长大于所述激发激光的波长;Emitting an excitation laser and a loss laser, the excitation laser and the loss laser are both Gaussian pulse lasers, wherein the wavelength of the loss laser is greater than the wavelength of the excitation laser;
将沿所述第一光路传播的所述损耗激光转换为环形损耗激光并与沿第二光路传播的所述激发激光重合后,聚焦照射所述样品;After converting the loss laser propagating along the first optical path into a ring loss laser and overlapping the excitation laser propagating along the second optical path, focus and irradiate the sample;
同时采集所述激发激光的激发光脉冲信号以及所述样品被照射后产生的荧光信号,所述荧光信号中包含荧光光子的时间信息和空间信息;Simultaneously collecting the excitation light pulse signal of the excitation laser and the fluorescence signal generated after the sample is irradiated, and the fluorescence signal contains the time information and spatial information of the fluorescence photon;
根据所述激发光脉冲信号及预置的分割规则从所述荧光信号中分离出共聚焦图像及初始超分辨图像;Separating a confocal image and an initial super-resolution image from the fluorescence signal according to the excitation light pulse signal and a preset segmentation rule;
根据预置的图像处理规则对所述共聚焦图像及所述初始超分辨图像进行分析处理,以得到更高分辨率的目标超分辨图像。The confocal image and the initial super-resolution image are analyzed and processed according to preset image processing rules to obtain a higher-resolution target super-resolution image.
第二方面,本申请实施例提供了一种基于低功率受激发射损耗的超分辨成像系统,其包括:In the second aspect, the embodiments of the present application provide a super-resolution imaging system based on low-power stimulated emission loss, which includes:
信号采集装置及成像处理终端;Signal acquisition device and imaging processing terminal;
所述信号采集装置,用于采集得到所述激发光脉冲信号作为参考信号,并采集所述样品被照射后产生的荧光信号;The signal acquisition device is configured to acquire the excitation light pulse signal as a reference signal, and acquire the fluorescent signal generated after the sample is irradiated;
所述成像处理终端,用于对所述信号采集装置所采集的所述激发光脉冲信号及所述荧光信号进行处理以得到所述目标超分辨图像。The imaging processing terminal is configured to process the excitation light pulse signal and the fluorescence signal collected by the signal collection device to obtain the target super-resolution image.
本申请实施例提供了一种基于低功率受激发射损耗的超分辨成像方法及成像系统。通过调整设置于第一光路中角反射器的位置延长损耗激光在第一光路中进行传播的光程,将低功率的高斯型损耗激光转换为环形损耗激光并与激发激光重合后聚焦照射样品,使采集到的荧光寿命数据中同时包含共聚焦信号和超分辨信号。通过数据处理从荧光信号中分离出共聚焦图像及初始超分辨图像,根据图像处理规则对共聚焦图像及初始超分辨图像进行分析处理后得到分辨率进一步提升的目标超分辨图像。通过上述方法,采用低功率的损耗激光减小了对生物样品的破坏,降低了荧光染料的光漂白效应,延长了超分辨成像的有效时间,结合图像增强处理得到包含细微结构特征的高分辨率图像,在实际应用过程中取得了良好的技术效果。The embodiments of the present application provide a super-resolution imaging method and imaging system based on low-power stimulated emission loss. By adjusting the position of the corner reflector in the first optical path to extend the optical path of the loss laser propagating in the first optical path, the low-power Gaussian loss laser is converted into a ring loss laser and overlaps with the excitation laser to focus and irradiate the sample. Make the collected fluorescence lifetime data include confocal signal and super-resolution signal at the same time. The confocal image and the initial super-resolution image are separated from the fluorescence signal through data processing, and the confocal image and the initial super-resolution image are analyzed and processed according to the image processing rules to obtain the target super-resolution image with further improved resolution. Through the above methods, the use of low-power loss lasers reduces the damage to biological samples, reduces the photobleaching effect of fluorescent dyes, and prolongs the effective time of super-resolution imaging. Combined with image enhancement processing, high resolutions containing fine structural features are obtained. Images have achieved good technical results in the actual application process.
附图说明Description of the drawings
为了更清楚地说明本申请实施例技术方案,下面将对实施例描述中所需要使用的附图作简单地介绍,显而易见地,下面描述中的附图是本申请的一些实施例,对于本领域普通技术人员来讲,在不付出创造性劳动的前提下,还可以根据这些附图获得其他的附图。In order to explain the technical solutions of the embodiments of the present application more clearly, the following will briefly introduce the drawings used in the description of the embodiments. Obviously, the drawings in the following description are some embodiments of the present application. Ordinary technicians can obtain other drawings based on these drawings without creative work.
图1为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的流程示意图;FIG. 1 is a schematic flowchart of a super-resolution imaging method based on low-power stimulated emission loss according to an embodiment of the application;
图2为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的子流程示意图;2 is a schematic diagram of a sub-flow of a super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application;
图3为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的子流程示意图;3 is a schematic diagram of a sub-process of a super-resolution imaging method based on low-power stimulated emission loss according to an embodiment of the application;
图4为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的 子流程示意图;4 is a schematic diagram of a sub-process of a super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application;
图5为本申请实施例提供的基于低功率受激发射损耗的超分辨成像系统的示意图;5 is a schematic diagram of a super-resolution imaging system based on low-power stimulated emission loss according to an embodiment of the application;
图6为本申请实施例提供的成像处理终端的示意性框图;FIG. 6 is a schematic block diagram of an imaging processing terminal provided by an embodiment of the application;
图7为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的使用效果示意图;FIG. 7 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss according to an embodiment of the application;
图8为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的使用效果示意图;FIG. 8 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss according to an embodiment of the application;
图9为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的使用效果示意图;9 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application;
图10为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的使用效果示意图。FIG. 10 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application.
具体实施方式detailed description
下面将结合本申请实施例中的附图,对本申请实施例中的技术方案进行清楚、完整地描述,显然,所描述的实施例是本申请一部分实施例,而不是全部的实施例。基于本申请中的实施例,本领域普通技术人员在没有做出创造性劳动前提下所获得的所有其他实施例,都属于本申请保护的范围。The technical solutions in the embodiments of the present application will be described clearly and completely in conjunction with the accompanying drawings in the embodiments of the present application. Obviously, the described embodiments are part of the embodiments of the present application, rather than all of them. Based on the embodiments in this application, all other embodiments obtained by a person of ordinary skill in the art without creative work shall fall within the protection scope of this application.
应当理解,当在本说明书和所附权利要求书中使用时,术语“包括”和“包含”指示所描述特征、整体、步骤、操作、元素和/或组件的存在,但并不排除一个或多个其它特征、整体、步骤、操作、元素、组件和/或其集合的存在或添加。It should be understood that when used in this specification and appended claims, the terms "including" and "including" indicate the existence of the described features, wholes, steps, operations, elements and/or components, but do not exclude one or The existence or addition of multiple other features, wholes, steps, operations, elements, components, and/or collections thereof.
还应当理解,在此本申请说明书中所使用的术语仅仅是出于描述特定实施例的目的而并不意在限制本申请。如在本申请说明书和所附权利要求书中所使用的那样,除非上下文清楚地指明其它情况,否则单数形式的“一”、“一个”及“该”意在包括复数形式。It should also be understood that the terms used in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit the application. As used in the specification of this application and the appended claims, unless the context clearly indicates other circumstances, the singular forms "a", "an" and "the" are intended to include plural forms.
还应当进一步理解,在本申请说明书和所附权利要求书中使用的术语“和/或”是指相关联列出的项中的一个或多个的任何组合以及所有可能组合,并且包括这些组合。It should be further understood that the term "and/or" used in the specification and appended claims of this application refers to any combination of one or more of the items listed in the associated and all possible combinations, and includes these combinations .
请参阅图1及图5,图1是为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的流程示意图,图5为本申请实施例提供的基于低功率受激发射损耗的超分辨成像系统的示意图。该基于低功率受激发射损耗的超分辨成像方法应用于成像系统中,成像系统包括信号采集装置10及成像处理终端20, 该方法通过信号采集装置10结合安装于成像处理终端20中的应用软件进行执行,成像系统即是用于执行基于低功率受激发射损耗的超分辨成像方法以实现对所述样品进行高分辨率成像的系统装置,信号采集装置10即是用于发射激发激光及损耗激光对所述样品进行探测并采集激发光脉冲信号和荧光信号的装置,成像处理终端20即是用于获取信号采集装置所采集的激发光脉冲信及荧光信号后进行成像处理得到目标超分辨图像的终端设备,例如工作站、台式电脑、笔记本电脑、平板电脑或手机等。Please refer to FIG. 1 and FIG. 5. FIG. 1 is a schematic flowchart of a super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of this application, and FIG. 5 is a low-power stimulated emission loss-based method provided by an embodiment of this application. Schematic diagram of the super-resolution imaging system. The super-resolution imaging method based on low-power stimulated emission loss is applied to an imaging system. The imaging system includes a signal acquisition device 10 and an imaging processing terminal 20. The method combines the signal acquisition device 10 with application software installed in the imaging processing terminal 20 For execution, the imaging system is a system device used to implement a super-resolution imaging method based on low-power stimulated emission loss to achieve high-resolution imaging of the sample, and the signal acquisition device 10 is used to emit excitation laser and loss The laser detects the sample and collects the excitation light pulse signal and the fluorescence signal. The imaging processing terminal 20 is used to obtain the excitation light pulse signal and the fluorescence signal collected by the signal collection device and perform imaging processing to obtain the target super-resolution image. Of terminal devices, such as workstations, desktop computers, laptops, tablets, or mobile phones.
如图1所示,该方法包括步骤S110~S160。As shown in Figure 1, the method includes steps S110 to S160.
S110、将被荧光染料染色的样品置于载物台上并调整第一光路中角反射器的位置。S110: Place the sample dyed by the fluorescent dye on the stage and adjust the position of the corner reflector in the first light path.
将被荧光染料染色的样品置于载物台上并调整第一光路中角反射器的位置。首先采用荧光染料对样品进行染色,具体的,样品可以是活细胞、病毒或组织等生物材料,荧光染料即为被光照后受激并产生荧光光子的染料,调节角反射器的位置可延长损耗激光在第一光路中进行传播的光程。Place the sample dyed with fluorescent dye on the stage and adjust the position of the corner reflector in the first light path. First, use fluorescent dyes to dye the sample. Specifically, the sample can be biological materials such as living cells, viruses or tissues. Fluorescent dyes are dyes that are excited by light and generate fluorescent photons. Adjusting the position of the corner reflector can prolong the loss. The optical path of the laser in the first optical path.
图10为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的使用效果示意图,具体的,如图10所示,未调节角反射器时角反射器位于图10中位置①处,损耗激光沿第一光路传播的光程(光沿某一路径传播一定路程所需的时间)为τ 1,此时激发激光脉冲与损耗激光脉冲之间的光程间隔为Δτ 1(激发激光脉冲与损耗激光脉冲作用于样品的时间差);调节角反射器的位置至图10中位置②处,位置①与位置②的距离为S,则损耗激光沿第一光路传播的光程为τ 1+2S/c,其中c为光速,则此时激发激光脉冲与损耗激光脉冲之间的光程间隔为Δτ 2=Δτ 1+2S/c。 FIG. 10 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application. Specifically, as shown in FIG. 10, when the corner reflector is not adjusted, the corner reflector is located in the position in FIG. 10 ① Where the optical path length of the lossy laser propagating along the first optical path (the time required for the light to travel a certain distance along a certain path) is τ 1 , at this time the optical path interval between the excitation laser pulse and the loss laser pulse is Δτ 1 (excitation The time difference between the laser pulse and the loss laser pulse acting on the sample); adjust the position of the corner reflector to position ② in Figure 10, and the distance between position ① and position ② is S, then the optical path of the loss laser propagating along the first optical path is τ 1 +2S/c, where c is the speed of light, then the optical path interval between the excitation laser pulse and the loss laser pulse at this time is Δτ 2 =Δτ 1 +2S/c.
S120、发射激发激光及损耗激光,所述激发激光及所述损耗激光均为高斯型脉冲激光,其中,所述损耗激光的波长大于所述激发激光的波长。S120. Emit an excitation laser and a loss laser, both of the excitation laser and the loss laser are Gaussian pulse lasers, wherein the wavelength of the loss laser is greater than the wavelength of the excitation laser.
可同时发射激发激光及损耗激光,两束激光均为脉冲型激光,且脉冲频率相同(如80MHz),激光的频率与激光的脉冲周期呈反比,脉冲周期应至少包含一个完整的自发荧光过程(通常为纳秒及以上的时间量级)。荧光寿命越长,则激光的脉冲周期就要越大,激光的脉冲频率就越小。其中,所述激发激光的功率小于所述损耗激光的功率,具体的,此处损耗激光的功率比传统受激辐射损耗超分辨成像(~100mW)低至少一个数量级(如小于10mW),激发激光的功率与发光材料的光谱特性有关,通常为0.1-100μW。损耗激光的功率越大, 所得到的环状图像中环形光斑的中心零强度区域越小,且峰值强度越大。所述激发激光的脉宽与所述损耗激光的脉宽均为百皮秒量级,例如,激发激光的脉宽与损耗激光的脉宽的取值范围均可以是0.1-1纳秒,损耗激光的波长大于激发激光的波长,脉宽即为激发激光脉冲或损耗激光脉冲的宽度,为实现对样品进行超分辨成像,需控制激发激光的脉宽及损耗激光的脉宽均为百皮秒量级(100皮秒=0.1纳秒)。Both excitation laser and loss laser can be emitted at the same time. Both lasers are pulsed lasers, and the pulse frequency is the same (such as 80MHz). The frequency of the laser is inversely proportional to the pulse period of the laser. The pulse period should include at least a complete autofluorescence process ( Usually on the order of nanoseconds and above). The longer the fluorescence lifetime, the larger the pulse period of the laser, and the smaller the pulse frequency of the laser. Wherein, the power of the excitation laser is less than the power of the loss laser. Specifically, the power of the loss laser here is at least an order of magnitude (such as less than 10mW) lower than the traditional stimulated radiation loss super-resolution imaging (~100mW). The power of is related to the spectral characteristics of the luminescent material, usually 0.1-100μW. The greater the power of the loss laser, the smaller the central zero-intensity area of the ring-shaped spot in the ring-shaped image obtained, and the greater the peak intensity. The pulse width of the excitation laser and the pulse width of the loss laser are both on the order of one hundred picoseconds. For example, the pulse width of the excitation laser and the pulse width of the loss laser can both be in the range of 0.1-1 nanoseconds. The wavelength of the laser is greater than the wavelength of the excitation laser, and the pulse width is the width of the excitation laser pulse or the loss laser pulse. In order to achieve super-resolution imaging of the sample, the pulse width of the excitation laser and the pulse width of the loss laser must be controlled to be 100 picoseconds Magnitude (100 picoseconds = 0.1 nanosecond).
S130、将沿所述第一光路传播的所述损耗激光转换为环形损耗激光并与沿第二光路传播的所述激发激光重合后,聚焦照射所述样品。S130. After converting the lossy laser light propagating along the first optical path into a ring-shaped lossy laser light and overlapping the excitation laser light propagating along the second optical path, focus and irradiate the sample.
具体的,可在第一光路的角反射器之后设置螺旋相位板,通过螺旋相位板将高斯型脉冲激光的损耗激光转换为环形损耗激光,环形损耗激光与沿第二光路传播的激发激光重合,两束激光的焦平面在空间上精准重合后进行聚焦并照射样品,已染色的样品被照射后荧光染料会产生荧光信号。Specifically, a spiral phase plate can be installed after the corner reflector of the first optical path, and the loss laser of the Gaussian pulse laser is converted into ring loss laser through the spiral phase plate, and the ring loss laser coincides with the excitation laser propagating along the second optical path. The focal planes of the two laser beams precisely coincide in space and then focus and irradiate the sample. After the dyed sample is irradiated, the fluorescent dye will produce a fluorescent signal.
S140、同时采集所述激发激光的激发光脉冲信号以及所述样品被照射后产生的荧光信号,所述荧光信号中包含荧光光子的时间信息和空间信息。S140. Collect the excitation light pulse signal of the excitation laser and the fluorescence signal generated after the sample is irradiated at the same time, and the fluorescence signal contains time information and spatial information of the fluorescence photon.
同时采集得到激发激光的激发光脉冲信号,以及样品被照射后产生的荧光信号,所采集到的激发激光的激发光脉冲信号作为荧光寿命探测的起始点;荧光染料被照射后自发辐射产生荧光光子信号,所得到的荧光光子的信号即组成上述荧光信号,荧光信号中包含荧光光子的时间信息和空间信息,荧光光子的空间信息即为所辐射出的该荧光光子在二维平面上的具体位置信息,荧光分子所辐射出的荧光光子强度在单个脉冲周期内随时间逐渐减弱,荧光光子的时间信息即为采集到该荧光光子的相对参考信号到达探测器的时间信息。At the same time, the excitation light pulse signal of the excitation laser and the fluorescence signal generated after the sample is irradiated are collected. The collected excitation light pulse signal of the excitation laser is used as the starting point of fluorescence lifetime detection; the fluorescent dye is irradiated and spontaneously emits fluorescence photons Signal, the obtained fluorescent photon signal constitutes the above-mentioned fluorescent signal. The fluorescent signal contains the time information and spatial information of the fluorescent photon. The spatial information of the fluorescent photon is the specific position of the radiated fluorescent photon on the two-dimensional plane. Information, the intensity of the fluorescent photon emitted by the fluorescent molecule gradually decreases with time within a single pulse period, and the time information of the fluorescent photon is the time information when the relative reference signal of the collected fluorescent photon reaches the detector.
S150、根据所述激发光脉冲信号及预置的分割规则从所述荧光信号中分离出共聚焦图像及初始超分辨图像。S150. Separate a confocal image and an initial super-resolution image from the fluorescence signal according to the excitation light pulse signal and a preset segmentation rule.
激发光脉冲信号及荧光信号分别被传输至成像处理终端,通过该成像处理终端对激发光脉冲信号及荧光信号进行解析处理,以得到对所述样品进行高分辨率成像的超分辨图像。具体的,首先根据分割规则及激发光脉冲信号对荧光信号进行分割,得到共聚焦图像及初始超分辨图像,共聚焦图像即为通过激发激光照射样品所产生的荧光寿命成像,初始超分辨图像即为通过激发激光及环形损耗激光同时照射样品所产生的STED(受激发射损耗,Stimulated emission depletion)超分辨荧光寿命成像。The excitation light pulse signal and the fluorescence signal are respectively transmitted to the imaging processing terminal, and the excitation light pulse signal and the fluorescence signal are analyzed and processed through the imaging processing terminal to obtain a super-resolution image for high-resolution imaging of the sample. Specifically, firstly, the fluorescence signal is segmented according to the segmentation rule and the excitation light pulse signal to obtain the confocal image and the initial super-resolution image. The confocal image is the fluorescence lifetime imaging generated by the excitation laser irradiating the sample, and the initial super-resolution image is For STED (Stimulated Emission Depletion) super-resolution fluorescence lifetime imaging produced by irradiating the sample with the excitation laser and ring loss laser at the same time.
在一实施例中,如图2所示,步骤S150包括子步骤S151、S152、S153和 S154。In one embodiment, as shown in FIG. 2, step S150 includes sub-steps S151, S152, S153, and S154.
S151、将采集到的所述激发光脉冲信号的时间点作为荧光寿命探测的起始时间,获取所述荧光光子在时间通道上的强度变化,以得到所述荧光信号的荧光衰减曲线。S151. Use the collected time point of the excitation light pulse signal as the start time of fluorescence lifetime detection, and obtain the intensity change of the fluorescence photon on the time channel to obtain the fluorescence decay curve of the fluorescence signal.
将探测到激发光脉冲信号的时刻作为荧光寿命探测的起始时间,也即是作为时间通道的零点,根据该起始时间获取荧光光子在时间通道上的强度变化,也即是以时间作为横坐标,通过光子数累积获取荧光光子的强度变化,一个时间通道即为一段单位时间(例如,可设置一个时间通道为0.05纳秒),纵坐标即为荧光光子的强度值,荧光光子的强度可通过每一时间通道内时间积累采集得到的荧光光子的数量进行体现,某一时间通道内荧光光子数量越多则荧光光子的强度越高,最后得到荧光信号的荧光衰减曲线。The time at which the excitation light pulse signal is detected is regarded as the start time of fluorescence lifetime detection, that is, as the zero point of the time channel, and the intensity change of the fluorescent photon on the time channel is obtained according to the start time, that is, the time is taken as the horizontal The coordinate is to obtain the intensity change of the fluorescent photon through the accumulation of the number of photons. A time channel is a unit time (for example, a time channel can be set to 0.05 nanoseconds). The ordinate is the intensity value of the fluorescent photon, and the intensity of the fluorescent photon can be It is reflected by the number of fluorescent photons collected by time accumulation in each time channel. The greater the number of fluorescent photons in a certain time channel, the higher the intensity of fluorescent photons, and finally the fluorescence decay curve of the fluorescent signal is obtained.
图7为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的使用效果示意图。采用直径为23nm的荧光珠样品进行试验,激发激光的波长为635nm,功率为35μW,损耗激光的波长为730nm,功率为10mW,激发激光的频率及损耗激光的频率均为80MHz,激发激光的脉宽及损耗激光的脉宽约为0.3纳秒(ns),激发激光脉冲与损耗激光脉冲之间的光程间隔Δτ 2为2纳秒,所得到的荧光信号的荧光衰减曲线如图7所示。 FIG. 7 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application. A sample of fluorescent beads with a diameter of 23nm was used for the experiment. The wavelength of the excitation laser was 635nm, the power was 35μW, the wavelength of the loss laser was 730nm, and the power was 10mW. The frequency of the excitation laser and the frequency of the loss laser were both 80MHz. The pulse width of the wide and depleted laser is about 0.3 nanoseconds (ns), and the optical path interval Δτ 2 between the excitation laser pulse and the depleted laser pulse is 2 nanoseconds. The fluorescence decay curve of the obtained fluorescence signal is shown in Figure 7 .
S152、根据所述分割规则获取所述荧光衰减曲线中强度突变的时间通道位置作为分割点。S152: Obtain the time channel position of the intensity mutation in the fluorescence attenuation curve as a segmentation point according to the segmentation rule.
根据分割规则获取荧光衰减曲线中强度突变的时间通道位置作为分割点。当激发激光及环形损耗激光同时照射样品时,荧光信号的信号强度会产生突变,信号强度的突变即可在所得到的荧光衰减曲线中得到体现,获取荧光衰减曲线中强度突变的时间通道位置作为分割点,即可对荧光信号进行分割。Obtain the time channel position of the intensity mutation in the fluorescence decay curve according to the segmentation rule as the segmentation point. When the excitation laser and ring loss laser irradiate the sample at the same time, the signal intensity of the fluorescence signal will have a sudden change, and the sudden change of signal intensity can be reflected in the obtained fluorescence decay curve. Obtain the time channel position of the intensity change in the fluorescence decay curve as By dividing the point, the fluorescence signal can be divided.
在一实施例中,如图3所示,步骤S152包括子步骤S1521、S1522和S1523。In an embodiment, as shown in FIG. 3, step S152 includes sub-steps S1521, S1522, and S1523.
S1521、根据所述斜率值计算公式计算所述荧光衰减曲线中每一点的斜率值以得到对应的斜率曲线;S1522、根据所述斜率变化值计算公式计算所述斜率曲线中每一点的斜率变化值;S1523、获取数值最大的一个所述斜率变化值在所述荧光衰减曲线中对应的时间通道位置作为所述分割点。S1521, calculate the slope value of each point in the fluorescence decay curve according to the slope value calculation formula to obtain the corresponding slope curve; S1522, calculate the slope change value of each point in the slope curve according to the slope change value calculation formula S1523. Obtain a time channel position in the fluorescence decay curve corresponding to the slope change value with the largest value as the segmentation point.
具体的,荧光衰减曲线由多个点组成,斜率计算公式即可对荧光衰减曲线中每一点的斜率值进行计算,得到斜率曲线。例如,斜率计算公式可以是A r=(y r+2-y r-2)/(x r+2-x r-2),其中A r为计算所得到的荧光衰减曲线中第r个点的斜率 值,y r+2为第r个点右侧与之间隔2个像素的点的纵坐标,y r-2为第r个点左侧与之间隔2个像素的点的纵坐标,x r+2为第r个点右侧与之间隔2个像素的点的横坐标,x r+2为第r个点左侧与之间隔2个像素的点的横坐标,在r为任意点的情况下,x r+2-x r-2恒等于5。若第r个点左侧没有点,则y r-2=y r、x r-2=x r;若第r个点右侧没有点,则y r+2=y r、x r+2=x r。斜率计算公式还可以是对荧光衰减曲线中的点进行求导的计算公式。通过斜率变化值计算公式对斜率曲线中的每一点的斜率变化值进行计算,斜率变化值的计算方法同上述的斜率值的计算方法,对所计算得到的斜率变化值取绝对值,得到与每一斜率变化值对应的一个非负数值,获取非负数值中数值最大的一个斜率变化值在荧光衰减曲线中对应的时间通道位置作为所述分割点,也即是获取数值最大的一个斜率变化值在荧光衰减曲线中对应的横坐标值作为分割点。 Specifically, the fluorescence decay curve is composed of multiple points, and the slope calculation formula can calculate the slope value of each point in the fluorescence decay curve to obtain the slope curve. For example, the slope calculation formula can be A r =(y r+2 -y r-2 )/(x r+2 -x r-2 ), where A r is the rth point in the calculated fluorescence attenuation curve The slope value of y r+2 is the ordinate of the point on the right side of the rth point 2 pixels apart from it, and y r-2 is the ordinate of the point on the left side of the rth point 2 pixels apart from it, x r+2 is the abscissa of the point 2 pixels away from the right of the rth point, x r+2 is the abscissa of the point 2 pixels away from the left of the rth point, where r is arbitrary In the case of points, x r+2 -x r-2 is always equal to 5. If there is no point on the left of the rth point, then y r-2 = y r , x r-2 = x r ; if there is no point on the right of the rth point, then y r+2 = y r , x r+2 = X r . The slope calculation formula can also be a calculation formula for deriving points in the fluorescence attenuation curve. The slope change value calculation formula is used to calculate the slope change value of each point in the slope curve. The calculation method of the slope change value is the same as the calculation method of the above slope value. A non-negative value corresponding to a slope change value is obtained, and the time channel position corresponding to the time channel position in the fluorescence decay curve of the slope change value with the largest value among the non-negative values is obtained as the division point, that is, the slope change value with the largest value is obtained The corresponding abscissa value in the fluorescence decay curve is used as the dividing point.
例如,对图7中所示的荧光衰减曲线采用上述方法得到的分割点的横坐标值为τ x=3ns,则可以3ns作为分割点对荧光信号进行分割。 For example, for the fluorescence attenuation curve shown in FIG. 7, the abscissa value of the dividing point obtained by the above method is τ x =3ns, then 3ns can be used as the dividing point to divide the fluorescence signal.
S153、根据所述荧光信号中位于所述分割点之前的荧光光子的空间信息组成所述共聚焦图像。S153. Compose the confocal image according to the spatial information of the fluorescent photons located before the dividing point in the fluorescent signal.
S154、根据所述荧光信号中位于所述分割点之后的荧光光子的空间信息组成所述初始超分辨图像。S154. Compose the initial super-resolution image according to the spatial information of the fluorescent photons located after the dividing point in the fluorescent signal.
以分割点为基准,获取荧光信号中从起始时间至该分割点的荧光光子的空间信息组成一张共聚焦图像,获取荧光信号中从该分割点之后的荧光光子的空间信息组成一张初始超分辨图像。Taking the segmentation point as the reference, the spatial information of the fluorescent photons from the start time to the segmentation point in the fluorescence signal is obtained to form a confocal image, and the spatial information of the fluorescence photons after the segmentation point in the fluorescence signal is obtained to form an initial Super-resolution image.
图8为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的使用效果示意图。例如,对所得到的荧光信号进行分割后,得到样品的一张共聚焦图像如图8(a)所示,得到对应的一张初始超分辨图像如图8(b)所示。FIG. 8 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application. For example, after segmenting the obtained fluorescent signal, a confocal image of the sample is obtained as shown in Fig. 8(a), and a corresponding initial super-resolution image is obtained as shown in Fig. 8(b).
S160、根据预置的图像处理规则对所述共聚焦图像及所述初始超分辨图像进行分析处理,以得到高分辨率的目标超分辨图像。S160. Analyze and process the confocal image and the initial super-resolution image according to a preset image processing rule to obtain a high-resolution target super-resolution image.
通过图像处理规则对共聚焦图像及初始超分辨图像进行分析处理,可大幅提升对样品进行成像的分辨率,得到样品的目标超分辨图像。The confocal image and the initial super-resolution image are analyzed and processed through the image processing rules, which can greatly improve the resolution of imaging the sample and obtain the target super-resolution image of the sample.
在一实施例中,如图4所示,步骤S160包括子步骤S161、S162和S163。In an embodiment, as shown in FIG. 4, step S160 includes sub-steps S161, S162, and S163.
S161、将所述共聚焦图像的强度值减去所述初始超分辨图像的强度值得到环状图像。S161. Subtract the intensity value of the initial super-resolution image from the intensity value of the confocal image to obtain a ring-shaped image.
共聚焦图像、初始超分辨图像以及所得到的环状图像的视场相同(图像尺 寸相同)。具体的,将共聚焦图像中一个像素的像素值减去初始超分辨图像中与该像素对应的像素值,得到该像素的像素差值,获取共聚焦图像中每一像素的像素差值进行组合即可得到对应的一张环状图像。The field of view of the confocal image, the initial super-resolution image, and the resulting ring image is the same (the image size is the same). Specifically, the pixel value of a pixel in the confocal image is subtracted from the pixel value corresponding to the pixel in the initial super-resolution image to obtain the pixel difference value of the pixel, and the pixel difference value of each pixel in the confocal image is obtained and combined You can get a corresponding ring image.
例如,图8中的聚焦图像命名为图像A,初始超分辨图像命名为图像B,所得到的环状图像命名为图像C,则C=A-B,所得到的一张环状图像如图8(c)所示。For example, the focused image in Figure 8 is named image A, the initial super-resolution image is named image B, and the resulting ring image is named image C, then C=AB, and the resulting ring image is shown in Figure 8 ( c) as shown.
S162、将所述环状图像与所述图像处理规则中的增强系数相乘以得到增强环状图像。S162. Multiply the ring image and the enhancement coefficient in the image processing rule to obtain an enhanced ring image.
具体的,将环状图像中每一像素的像素值与增强系数相乘,得到对应的增强环状图像。其中,所述增强系数为用户预设的一个系数值,增强系数的取值大于1,增强系数可以为整数或者小数。Specifically, the pixel value of each pixel in the ring image is multiplied by the enhancement coefficient to obtain the corresponding enhanced ring image. Wherein, the enhancement coefficient is a coefficient value preset by the user, the value of the enhancement coefficient is greater than 1, and the enhancement coefficient may be an integer or a decimal number.
图9为本申请实施例提供的基于低功率受激发射损耗的超分辨成像方法的使用效果示意图。例如,取增强系数为1,环状图像如图9(1)所示,此时得到的增强环状图像与环状图像C相同;取增强系数为2,此时得到的增强环状图像如图9(2)所示;取增强系数为4,此时得到的增强环状图像如图9(3)所示。FIG. 9 is a schematic diagram of the use effect of the super-resolution imaging method based on low-power stimulated emission loss provided by an embodiment of the application. For example, if the enhancement factor is 1, the ring image is shown in Figure 9(1), and the enhanced ring image obtained at this time is the same as the ring image C; if the enhancement factor is 2, the enhanced ring image obtained at this time is as As shown in Fig. 9(2); taking the enhancement coefficient as 4, the enhanced ring image obtained at this time is as shown in Fig. 9(3).
S163、将所述初始超分辨图像的强度值减去所述增强环状图像的强度值得到所述目标超分辨图像。S163. Subtract the intensity value of the enhanced annular image from the intensity value of the initial super-resolution image to obtain the target super-resolution image.
所得到的目标超分辨图像也与共聚焦图像的视场相同。具体的,将初始超分辨图像中一个像素的像素值减去环状图像中与该像素对应的像素值,得到该像素的像素差值,获取初始超分辨图像和环状图像中每一像素的像素差值进行组合即可得到对应的目标超分辨图像。The obtained super-resolution image of the target also has the same field of view as the confocal image. Specifically, the pixel value of a pixel in the initial super-resolution image is subtracted from the pixel value corresponding to the pixel in the ring image to obtain the pixel difference value of the pixel, and the initial super-resolution image and the pixel value of each pixel in the ring image are obtained. The pixel difference can be combined to obtain the corresponding target super-resolution image.
例如,取增强系数为1,得到的环状图像可表示为1×C,此时得到的目标超分辨图像如图9(4)所示;取增强系数为2,得到的环状图像可表示为2×C,此时得到的目标超分辨图像如图9(5)所示;取增强系数为4,得到的环状图像可表示为4×C,此时得到的目标超分辨图像如图9(6)所示。For example, if the enhancement factor is 1, the obtained ring image can be expressed as 1×C, and the target super-resolution image obtained at this time is shown in Figure 9 (4); if the enhancement factor is 2, the obtained ring image can be expressed as 2×C, the target super-resolution image obtained at this time is shown in Figure 9(5); taking the enhancement coefficient as 4, the obtained ring image can be expressed as 4×C, and the target super-resolution image obtained at this time is shown in Figure 9(5). Shown in 9(6).
本申请实施例所提供的基于低功率受激发射损耗的超分辨成像方法,通过调整设置于第一光路中角反射器的位置延长损耗激光在第一光路中进行传播的光程,将低功率的高斯型损耗激光转换为环形损耗激光并与激发激光重合后聚焦照射样品,使采集到的荧光寿命数据中同时包含共聚焦信号和超分辨信号。通过数据处理从荧光信号中分离出共聚焦图像及初始超分辨图像,根据图像处理规则对共聚焦图像及初始超分辨图像进行分析处理后得到分辨率进一步提升 的目标超分辨图像。通过上述方法,采用低功率的损耗激光减小了对生物样品的破坏,降低了荧光染料的光漂白效应,延长了超分辨成像的有效时间,结合图像增强处理得到包含细微结构特征的高分辨率图像,在实际应用过程中取得了良好的技术效果。The super-resolution imaging method based on low-power stimulated emission loss provided by the embodiment of the present application extends the optical path of the lossy laser propagating in the first optical path by adjusting the position of the corner reflector in the first optical path, and reduces the low-power The Gaussian loss laser is converted into a ring loss laser and coincides with the excitation laser to focus and irradiate the sample, so that the collected fluorescence lifetime data contains both confocal and super-resolution signals. The confocal image and the initial super-resolution image are separated from the fluorescence signal through data processing, and the confocal image and the initial super-resolution image are analyzed and processed according to the image processing rules to obtain the target super-resolution image with further improved resolution. Through the above methods, the use of low-power loss lasers reduces the damage to biological samples, reduces the photobleaching effect of fluorescent dyes, and prolongs the effective time of super-resolution imaging. Combined with image enhancement processing, high resolutions containing fine structural features are obtained. Images have achieved good technical results in the actual application process.
本申请实施例还提供一种基于低功率受激发射损耗的超分辨成像系统,该基于低功率受激发射损耗的超分辨成像系统可用于实现前述基于低功率受激发射损耗的超分辨成像方法的任一实施例。具体地,请参阅图5-图6,图5为本申请实施例提供的基于低功率受激发射损耗的超分辨成像系统的示意图,图6为本申请实施例提供的成像处理终端的示意性框图,所述成像系统包括信号采集装置10及成像处理终端20。The embodiment of the present application also provides a super-resolution imaging system based on low-power stimulated emission loss. The super-resolution imaging system based on low-power stimulated emission loss can be used to realize the aforementioned super-resolution imaging method based on low-power stimulated emission loss. Any embodiment of. Specifically, please refer to FIGS. 5-6. FIG. 5 is a schematic diagram of a super-resolution imaging system based on low-power stimulated emission loss according to an embodiment of the application, and FIG. 6 is a schematic diagram of an imaging processing terminal provided by an embodiment of the application. In a block diagram, the imaging system includes a signal acquisition device 10 and an imaging processing terminal 20.
所述信号采集装置10,用于采集得到所述激发光脉冲信号作为参考信号,并采集所述样品被照射后产生的荧光信号。The signal acquisition device 10 is used for acquiring the excitation light pulse signal as a reference signal, and acquiring the fluorescent signal generated after the sample is irradiated.
具体的,所述信号采集装置包括激发激光器101、损耗激光器102、分光镜103、第一双色镜104、第二双色镜105、所述角反射器106、螺旋相位板107、扫描振镜108、物镜109、所述载物台110、前置放大器111、第一探测器112、第二探测器113、时间相关单光子计数器(TCSPC)114。Specifically, the signal acquisition device includes an excitation laser 101, a loss laser 102, a beam splitter 103, a first dichroic mirror 104, a second dichroic mirror 105, the corner reflector 106, a spiral phase plate 107, a scanning galvanometer 108, The objective lens 109, the stage 110, the preamplifier 111, the first detector 112, the second detector 113, and a time dependent single photon counter (TCSPC) 114.
其中,所述激发激光器101,用于发射高斯型脉冲的激发激光;所述损耗激光器102,用于发射高斯型脉冲的损耗激光;所述分光镜,用于对所述激发激光进行分光,以使一部分所述激发激光沿所述第二光路传播、另一部分所述激发激光射入所述第二探测器;所述角反射器106,用于对沿所述第一光路传播的所述损耗激光进行反射以使其传播至所述螺旋相位板;所述螺旋相位板107,用于将入射的所述高斯型脉冲的损耗激光转换为环形损耗激光以使其传播至所述第二双色镜;所述第一双色镜104,用于对沿所述第二光路传播的激发激光进行反射以使其传播至所述第二双色镜,并对所述样品被照射后产生的荧光信号进行透射;所述第二双色镜105,用于对所述环形损耗激光进行反射、对沿所述第二光路传播的激发激光进行透射以使两束激光重合后传播至所述扫描振镜,并对所述荧光信号进行透射;所述扫描振镜108,用于对入射的激发激光及环形损耗激光进行同步扫描,以实现对样品的面阵成像;所述物镜109,用于对入射的激光进行聚焦后照射所述样品;所述载物台110,用于放置和固定样品,并对所述样品进行三维移动;所述第一探测器112,用于探测和收集荧光染料被照射后发出的荧光光子信号;所述第二探测器113,用于对入射的激发激光进行探测以 得到所述激发光脉冲信号;所述前置放大器111,用于对来自所述第一探测器的荧光光子信号进行放大和滤波;所述时间相关单光子计数器(TCSPC)114,用于信号存储和荧光寿命成像以得到所述荧光信号。Wherein, the excitation laser 101 is used to emit Gaussian pulse excitation laser; the loss laser 102 is used to emit Gaussian pulse loss laser; the spectroscope is used to split the excitation laser light to A part of the excitation laser light is propagated along the second optical path, and the other part of the excitation laser light is injected into the second detector; The laser light is reflected to propagate to the spiral phase plate; the spiral phase plate 107 is used to convert the incident loss laser light of the Gaussian pulse into ring loss laser light so that it propagates to the second dichroic mirror The first dichroic mirror 104 is used to reflect the excitation laser propagating along the second optical path to make it propagate to the second dichroic mirror, and to transmit the fluorescent signal generated after the sample is irradiated The second dichroic mirror 105 is used to reflect the ring loss laser and transmit the excitation laser propagating along the second optical path so that the two lasers overlap and propagate to the scanning galvanometer, and The fluorescence signal is transmitted; the scanning galvanometer 108 is used to synchronously scan the incident excitation laser and ring loss laser to realize the area array imaging of the sample; the objective lens 109 is used to perform the incident laser After focusing, illuminate the sample; the stage 110 is used to place and fix the sample, and to move the sample three-dimensionally; the first detector 112 is used to detect and collect the fluorescent dye emitted after being irradiated The fluorescent photon signal; the second detector 113 is used to detect the incident excitation laser light to obtain the excitation light pulse signal; the preamplifier 111 is used to detect the fluorescent photon from the first detector The signal is amplified and filtered; the time-correlated single photon counter (TCSPC) 114 is used for signal storage and fluorescence lifetime imaging to obtain the fluorescence signal.
更具体的,激发激光器101与损耗激光器102之间进行电连接,激发激光器101由损耗激光器102同步触发,使两束激光脉冲保持稳定的脉冲间隔。More specifically, an electrical connection is made between the excitation laser 101 and the loss laser 102, and the excitation laser 101 is triggered synchronously by the loss laser 102, so that the two laser pulses maintain a stable pulse interval.
所述成像处理终端20,用于对所述信号采集装置所采集的所述激发光脉冲信号及所述荧光信号进行处理以得到所述目标超分辨图像。The imaging processing terminal 20 is configured to process the excitation light pulse signal and the fluorescence signal collected by the signal collection device to obtain the target super-resolution image.
所述成像处理终端20即是用于获取信号采集装置所采集的激发光脉冲信及荧光信号后进行成像处理得到目标超分辨图像的终端设备,例如工作站、台式电脑、笔记本电脑、平板电脑或手机等。The imaging processing terminal 20 is a terminal device used to obtain the excitation light pulse signal and the fluorescence signal collected by the signal acquisition device and then perform imaging processing to obtain the target super-resolution image, such as a workstation, a desktop computer, a notebook computer, a tablet computer, or a mobile phone. Wait.
成像处理终端20可执行以下步骤:根据所述激发光脉冲信号及预置的分割规则从所述荧光信号中分离出共聚焦图像及初始超分辨图像;根据预置的图像处理规则对所述共聚焦图像及所述初始超分辨图像进行分析处理,以得到高分辨率的目标超分辨图像。The imaging processing terminal 20 may perform the following steps: separate a confocal image and an initial super-resolution image from the fluorescence signal according to the excitation light pulse signal and a preset segmentation rule; The focused image and the initial super-resolution image are analyzed and processed to obtain a high-resolution target super-resolution image.
在一实施例中,如图6所示,所述成像处理终端20包括荧光信号分割单元210及图像处理单元220。In an embodiment, as shown in FIG. 6, the imaging processing terminal 20 includes a fluorescent signal dividing unit 210 and an image processing unit 220.
荧光信号分割单元210,用于根据所述激发光脉冲信号及预置的分割规则从所述荧光信号中分离出共聚焦图像及初始超分辨图像;图像处理单元220,用于根据预置的图像处理规则对所述共聚焦图像及所述初始超分辨图像进行分析处理,以得到更高分辨率的目标超分辨图像。The fluorescence signal segmentation unit 210 is used to separate the confocal image and the initial super-resolution image from the fluorescence signal according to the excitation light pulse signal and preset segmentation rules; the image processing unit 220 is used to separate the confocal image and the initial super-resolution image according to the preset image The processing rules analyze and process the confocal image and the initial super-resolution image to obtain a higher-resolution target super-resolution image.
以上所述,仅为本申请的具体实施方式,但本申请的保护范围并不局限于此,任何熟悉本技术领域的技术人员在本申请揭露的技术范围内,可轻易想到各种等效的修改或替换,这些修改或替换都应涵盖在本申请的保护范围之内。因此,本申请的保护范围应以权利要求的保护范围为准。The above are only specific implementations of this application, but the scope of protection of this application is not limited to this. Anyone familiar with the technical field can easily think of various equivalents within the technical scope disclosed in this application. Modifications or replacements, these modifications or replacements shall be covered within the scope of protection of this application. Therefore, the protection scope of this application shall be subject to the protection scope of the claims.

Claims (10)

  1. 一种基于低功率受激发射损耗的超分辨成像方法,应用于成像系统,其特征在于,所述方法包括:A super-resolution imaging method based on low-power stimulated emission loss, applied to an imaging system, characterized in that the method includes:
    将被荧光染料染色的样品置于载物台上并调整第一光路中角反射器的位置;Place the sample dyed with fluorescent dye on the stage and adjust the position of the corner reflector in the first light path;
    发射激发激光及损耗激光,所述激发激光及所述损耗激光均为高斯型脉冲激光,其中,所述损耗激光的波长大于所述激发激光的波长;Emitting an excitation laser and a loss laser, the excitation laser and the loss laser are both Gaussian pulse lasers, wherein the wavelength of the loss laser is greater than the wavelength of the excitation laser;
    将沿所述第一光路传播的所述损耗激光转换为环形损耗激光并与沿第二光路传播的所述激发激光重合后,聚焦照射所述样品;After converting the loss laser propagating along the first optical path into a ring loss laser and overlapping the excitation laser propagating along the second optical path, focus and irradiate the sample;
    同时采集所述激发激光的激发光脉冲信号以及所述样品被照射后产生的荧光信号,所述荧光信号中包含荧光光子的时间信息和空间信息;Simultaneously collecting the excitation light pulse signal of the excitation laser and the fluorescence signal generated after the sample is irradiated, and the fluorescence signal contains the time information and spatial information of the fluorescence photon;
    根据所述激发光脉冲信号及预置的分割规则从所述荧光信号中分离出共聚焦图像及初始超分辨图像;Separating a confocal image and an initial super-resolution image from the fluorescence signal according to the excitation light pulse signal and a preset segmentation rule;
    根据预置的图像处理规则对所述共聚焦图像及所述初始超分辨图像进行分析处理,以得到更高分辨率的目标超分辨图像。The confocal image and the initial super-resolution image are analyzed and processed according to preset image processing rules to obtain a higher-resolution target super-resolution image.
  2. 根据权利要求1所述的基于低功率受激发射损耗的超分辨成像方法,其特征在于,所述根据所述激发光脉冲信号及预置的分割规则从所述荧光信号中分离出共聚焦图像及初始超分辨图像,包括:The super-resolution imaging method based on low-power stimulated emission loss according to claim 1, wherein the confocal image is separated from the fluorescent signal according to the excitation light pulse signal and a preset segmentation rule And the initial super-resolution image, including:
    将采集到的所述激发光脉冲信号的时间点作为荧光寿命探测的起始时间,获取所述荧光光子在时间通道上的强度变化,以得到所述荧光信号的荧光衰减曲线;Taking the collected time point of the excitation light pulse signal as the start time of fluorescence lifetime detection, and obtaining the intensity change of the fluorescence photon on the time channel to obtain the fluorescence decay curve of the fluorescence signal;
    根据所述分割规则获取所述荧光衰减曲线中强度突变的时间通道位置作为分割点;Acquiring, according to the segmentation rule, the time channel position of the intensity mutation in the fluorescence decay curve as a segmentation point;
    根据所述荧光信号中位于所述分割点之前的荧光光子的空间信息组成所述共聚焦图像;Composing the confocal image according to the spatial information of the fluorescent photons located before the dividing point in the fluorescent signal;
    根据所述荧光信号中位于所述分割点之后的荧光光子的空间信息组成所述初始超分辨图像。The initial super-resolution image is composed according to the spatial information of the fluorescent photons located after the dividing point in the fluorescent signal.
  3. 根据权利要求1所述的基于低功率受激发射损耗的超分辨成像方法,其特征在于,所述根据预置的图像处理规则对所述共聚焦图像及所述初始超分辨图像进行分析处理,以得到高分辨率的目标超分辨图像,包括:The super-resolution imaging method based on low-power stimulated emission loss according to claim 1, wherein said analyzing and processing said confocal image and said initial super-resolution image according to preset image processing rules, In order to obtain high-resolution super-resolution images of the target, including:
    将所述共聚焦图像的强度值减去所述初始超分辨图像的强度值得到环状图像;Subtracting the intensity value of the initial super-resolution image from the intensity value of the confocal image to obtain a ring image;
    将所述环状图像与所述图像处理规则中的增强系数相乘以得到增强环状图像;Multiplying the ring image and the enhancement coefficient in the image processing rule to obtain an enhanced ring image;
    将所述初始超分辨图像的强度值减去所述增强环状图像的强度值得到所述目标超分辨图像。The intensity value of the enhanced annular image is subtracted from the intensity value of the initial super-resolution image to obtain the target super-resolution image.
  4. 根据权利要求3所述的基于低功率受激发射损耗的超分辨成像方法,其特征在于,所述增强系数的取值大于1。The super-resolution imaging method based on low-power stimulated emission loss according to claim 3, wherein the value of the enhancement coefficient is greater than 1.
  5. 根据权利要求2所述的基于低功率受激发射损耗的超分辨成像方法,其特征在于,所述分割规则包括斜率值计算公式及斜率变化值计算公式,所述根据所述分割规则获取所述荧光衰减曲线中强度突变的时间通道位置作为分割点,包括:The super-resolution imaging method based on low-power stimulated emission loss according to claim 2, wherein the segmentation rule includes a slope value calculation formula and a slope change value calculation formula, and the segmentation rule obtains the The time channel position of the intensity mutation in the fluorescence decay curve is used as the dividing point, including:
    根据所述斜率值计算公式计算所述荧光衰减曲线中每一点的斜率值以得到对应的斜率曲线;Calculate the slope value of each point in the fluorescence decay curve according to the slope value calculation formula to obtain the corresponding slope curve;
    根据所述斜率变化值计算公式计算所述斜率曲线中每一点的斜率变化值;Calculate the slope change value of each point in the slope curve according to the slope change value calculation formula;
    获取数值最大的一个所述斜率变化值在所述荧光衰减曲线中对应的时间通道位置作为所述分割点。Obtain the time channel position corresponding to the one of the slope change values with the largest value in the fluorescence decay curve as the segmentation point.
  6. 根据权利要求1-5任一项所述的基于低功率受激发射损耗的超分辨成像方法,其特征在于,所述损耗激光的功率大于所述激发激光的功率。The super-resolution imaging method based on low-power stimulated emission loss according to any one of claims 1-5, wherein the power of the loss laser is greater than the power of the excitation laser.
  7. 根据权利要求6所述的基于低功率受激发射损耗的超分辨成像方法,其特征在于,所述激发激光的脉宽与所述损耗激光的脉宽均为百皮秒量级。The super-resolution imaging method based on low-power stimulated emission loss according to claim 6, wherein the pulse width of the excitation laser and the pulse width of the loss laser are both on the order of one hundred picoseconds.
  8. 一种基于低功率受激发射损耗的超分辨成像系统,所述成像系统用于实现如权利要求1-7任一项所述的基于低功率受激发射损耗的超分辨成像方法,其特征在于,所述成像系统包括信号采集装置及成像处理终端;A super-resolution imaging system based on low-power stimulated emission loss, which is used to implement the super-resolution imaging method based on low-power stimulated emission loss according to any one of claims 1-7, characterized in that , The imaging system includes a signal acquisition device and an imaging processing terminal;
    所述信号采集装置,用于采集得到所述激发光脉冲信号作为参考信号,并采集所述样品被照射后产生的荧光信号;The signal acquisition device is configured to acquire the excitation light pulse signal as a reference signal, and acquire the fluorescent signal generated after the sample is irradiated;
    所述成像处理终端,用于对所述信号采集装置所采集的所述激发光脉冲信号及所述荧光信号进行处理以得到所述目标超分辨图像。The imaging processing terminal is configured to process the excitation light pulse signal and the fluorescence signal collected by the signal collection device to obtain the target super-resolution image.
  9. 根据权利要求8所述的基于低功率受激发射损耗的超分辨成像系统,其特征在于,所述成像处理终端包括:The super-resolution imaging system based on low-power stimulated emission loss according to claim 8, wherein the imaging processing terminal comprises:
    荧光信号分割单元,用于根据所述激发光脉冲信号及预置的分割规则从所 述荧光信号中分离出共聚焦图像及初始超分辨图像;A fluorescent signal segmentation unit for separating a confocal image and an initial super-resolution image from the fluorescent signal according to the excitation light pulse signal and a preset segmentation rule;
    图像处理单元,用于根据预置的图像处理规则对所述共聚焦图像及所述初始超分辨图像进行分析处理,以得到更高分辨率的目标超分辨图像。The image processing unit is configured to analyze and process the confocal image and the initial super-resolution image according to preset image processing rules to obtain a higher-resolution target super-resolution image.
  10. 根据权利要求8所述的基于低功率受激发射损耗的超分辨成像系统,其特征在于,所述信号采集装置包括激发激光器、损耗激光器、分光镜、第一双色镜、第二双色镜、所述角反射器、螺旋相位板、扫描振镜、物镜、所述载物台、前置放大器、第一探测器、第二探测器、时间相关单光子计数器;The super-resolution imaging system based on low-power stimulated emission loss according to claim 8, wherein the signal acquisition device includes an excitation laser, a lossy laser, a beam splitter, a first dichroic mirror, a second dichroic mirror, and a The corner reflector, the spiral phase plate, the scanning galvanometer, the objective lens, the stage, the preamplifier, the first detector, the second detector, and the time-dependent single photon counter;
    所述激发激光器,用于发射高斯型脉冲的激发激光;The excitation laser is used to emit a Gaussian pulse excitation laser;
    所述损耗激光器,用于发射高斯型脉冲的损耗激光;The lossy laser is used to emit a lossy laser with Gaussian pulses;
    所述分光镜,用于对所述激发激光进行分光,以使一部分所述激发激光沿所述第二光路传播、另一部分所述激发激光射入所述第二探测器;The beam splitter is configured to split the excitation laser light so that a part of the excitation laser light propagates along the second optical path, and the other part of the excitation laser light enters the second detector;
    所述角反射器,用于对沿所述第一光路传播的所述损耗激光进行反射以使其传播至所述螺旋相位板;The corner reflector is used to reflect the lossy laser light propagating along the first optical path so as to propagate to the spiral phase plate;
    所述螺旋相位板,用于将入射的所述高斯型脉冲的损耗激光转换为环形损耗激光以使其传播至所述第二双色镜;The spiral phase plate is used to convert the incident loss laser of the Gaussian pulse into a ring loss laser so that it can propagate to the second dichroic mirror;
    所述第一双色镜,用于对沿所述第二光路传播的激发激光进行反射以使其传播至所述第二双色镜,并对所述样品被照射后产生的荧光信号进行透射;The first dichroic mirror is used to reflect the excitation laser propagating along the second optical path so that it can propagate to the second dichroic mirror, and transmit the fluorescent signal generated after the sample is irradiated;
    所述第二双色镜,用于对所述环形损耗激光进行反射、对沿所述第二光路传播的激发激光进行透射以使两束激光重合后传播至所述扫描振镜,并对所述荧光信号进行透射;The second dichroic mirror is used to reflect the ring-loss laser light and transmit the excitation laser light propagating along the second optical path so that the two laser beams overlap and then propagate to the scanning galvanometer, and to Fluorescence signal is transmitted;
    所述扫描振镜,用于对入射的激发激光及环形损耗激光进行同步扫描,以实现对样品的面阵成像;The scanning galvanometer is used to synchronously scan the incident excitation laser and ring loss laser to realize the area array imaging of the sample;
    所述物镜,用于对入射的激光进行聚焦后照射所述样品;The objective lens is used to focus the incident laser light and irradiate the sample;
    所述载物台,用于放置和固定样品,并对所述样品进行三维移动;The stage is used to place and fix a sample, and to move the sample in three dimensions;
    所述第一探测器,用于探测和收集荧光染料被照射后发出的荧光光子信号;The first detector is used to detect and collect the fluorescent photon signal emitted by the fluorescent dye after being irradiated;
    所述第二探测器,用于对入射的激发激光进行探测以得到所述激发光脉冲信号;The second detector is used to detect incident excitation laser light to obtain the excitation light pulse signal;
    所述前置放大器,用于对来自所述第一探测器的荧光光子信号进行放大和滤波;The preamplifier is used to amplify and filter the fluorescence photon signal from the first detector;
    所述时间相关单光子计数器,用于信号存储和荧光寿命成像以得到所述荧光信号,其中,所述荧光信号中包含荧光光子的时间信息和空间信息。The time-dependent single-photon counter is used for signal storage and fluorescence lifetime imaging to obtain the fluorescence signal, wherein the fluorescence signal contains time information and spatial information of the fluorescence photons.
PCT/CN2020/096779 2020-06-04 2020-06-18 Super-resolution imaging method and imaging system based on low-power stimulated emission depletion WO2021243754A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN202010500061.XA CN111579486B (en) 2020-06-04 2020-06-04 Super-resolution imaging method and imaging system based on low-power stimulated emission loss
CN202010500061.X 2020-06-04

Publications (1)

Publication Number Publication Date
WO2021243754A1 true WO2021243754A1 (en) 2021-12-09

Family

ID=72114442

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2020/096779 WO2021243754A1 (en) 2020-06-04 2020-06-18 Super-resolution imaging method and imaging system based on low-power stimulated emission depletion

Country Status (2)

Country Link
CN (1) CN111579486B (en)
WO (1) WO2021243754A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024087614A1 (en) * 2022-10-29 2024-05-02 深圳大学 Ratiometric fluorescence emission super-resolution imaging method

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109211871A (en) * 2018-11-26 2019-01-15 深圳大学 A kind of stimulated emission depletion fluorescence lifetime super-resolution imaging device
CN110068560A (en) * 2019-04-17 2019-07-30 深圳大学 A kind of stimulated radiation loss super-resolution imaging system and method
CN110954520A (en) * 2019-12-18 2020-04-03 深圳大学 Scanning structure light microscopic imaging method and device

Family Cites Families (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102007039111B4 (en) * 2007-08-18 2014-11-20 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. STED fluorescence microscopy with two-photon excitation
WO2011086519A1 (en) * 2010-01-15 2011-07-21 Koninklijke Philips Electronics N.V. A stimulated emission depletion (sted) microscopy system
DE102010060121C5 (en) * 2010-10-22 2023-09-28 Leica Microsystems Cms Gmbh SPIM microscope with sequential lightsheet
JP5776992B2 (en) * 2010-11-22 2015-09-09 マックス−プランク−ゲゼルシャフト ツル フォルデルング デル ヴィッゼンシャフテン イー.ヴイ. STED microscopy, STED fluorescence correlation spectroscopy, and STED fluorescence microscope for pulse excitation, continuous deexcitation, and gate recording of spontaneous emission fluorescence
EP2592412A1 (en) * 2011-11-08 2013-05-15 Deutsches Krebsforschungszentrum Stiftung des Öffentlichen Rechts A method, system and computer program product for determining the mobility of fluorescent particles
CN102661938B (en) * 2012-05-10 2014-04-23 浙江大学 Method and device of stimulated emission depletion (STED) microscopy based on tangential polarized light
CN103048299B (en) * 2012-11-26 2015-01-21 浙江大学 Super-resolution microscopic method and device based on fluorescence lifetime difference
CN103257130B (en) * 2013-05-31 2015-04-01 中国科学院苏州生物医学工程技术研究所 Stimulated radiation loss micro imaging system
JP6400933B2 (en) * 2014-04-04 2018-10-03 浜松ホトニクス株式会社 Stimulated radiation suppression microscope
WO2017153430A1 (en) * 2016-03-07 2017-09-14 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. Method for a high-resolution local imaging of a structure in a sample in order to detect reactions of an object of interest to altered environmental conditions
CN107831147B (en) * 2017-09-30 2021-01-15 华南师范大学 Multi-band fluorescence loss method, and multi-color super-resolution imaging method and device
US11965831B2 (en) * 2018-03-01 2024-04-23 The Regents Of The University Of Colorado, A Body Corporate Methods and systems for stimulated emission depletion microscopy
WO2020028942A1 (en) * 2018-08-06 2020-02-13 University Of Technology Sydney A super-resolution imaging method, a plurality of upconversion nanoparticle fluorophores, and a super-resolution scanning microscope
CN110836876B (en) * 2018-08-15 2021-05-14 浙江大学 Super-resolution microscopy method and system based on saturated pumping-stimulated radiation detection
CN108957719B (en) * 2018-09-07 2020-04-10 苏州国科医疗科技发展有限公司 Two-photon stimulated emission loss composite microscope

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109211871A (en) * 2018-11-26 2019-01-15 深圳大学 A kind of stimulated emission depletion fluorescence lifetime super-resolution imaging device
CN110068560A (en) * 2019-04-17 2019-07-30 深圳大学 A kind of stimulated radiation loss super-resolution imaging system and method
CN110954520A (en) * 2019-12-18 2020-04-03 深圳大学 Scanning structure light microscopic imaging method and device

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
WANG LUWEI, CHEN BINGLING, YAN WEI, YANG ZHIGANG, PENG XIAO, LIN DANYING, WENG XIAOYU, YE TONG, QU JUNLE: "Resolution improvement in STED super-resolution microscopy at low power using a phasor plot approach", NANOSCALE, ROYAL SOCIETY OF CHEMISTRY, UNITED KINGDOM, vol. 10, no. 34, 1 January 2018 (2018-01-01), United Kingdom , pages 16252 - 16260, XP055877294, ISSN: 2040-3364, DOI: 10.1039/C8NR03584A *
WANG LUWEI, CHEN YUE, PENG XIAO, ZHANG JIA, WANG JIALIN, LIU LIWEI, YANG ZHIGANG, YAN WEI, QU JUNLE: "Ultralow power demand in fluorescence nanoscopy with digitally enhanced stimulated emission depletion", NANOPHOTONICS, vol. 9, no. 4, 21 February 2020 (2020-02-21), pages 831 - 839, XP055877295, DOI: 10.1515/nanoph-2019-0475 *
WEI TONGDA, ZHANG YUNHAI, YANG HAOMIN : "Super resolution imaging technology of stimulated emission depletion", INFRARED AND LASER ENGINEERING, ZHONGGUO HANGTIAN KE-GONG JITUAN GONSI DI-3 YANJIUYUAN DI-8358 YANJIUSUO, CN, vol. 45, no. 6, 30 June 2016 (2016-06-30), CN , pages 0624001, XP055877183, ISSN: 1007-2276, DOI: 10.3788/irla201645.0624001 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2024087614A1 (en) * 2022-10-29 2024-05-02 深圳大学 Ratiometric fluorescence emission super-resolution imaging method

Also Published As

Publication number Publication date
CN111579486A (en) 2020-08-25
CN111579486B (en) 2021-02-26

Similar Documents

Publication Publication Date Title
WO2021243755A1 (en) Fluorescence difference super-resolution imaging method and imaging system
Liu et al. Fast fluorescence lifetime imaging techniques: A review on challenge and development
Sytsma et al. Time‐gated fluorescence lifetime imaging and microvolume spectroscopy using two‐photon excitation
Bird et al. Simultaneous two-photon spectral and lifetime fluorescence microscopy
US20130126755A1 (en) Method and device for simultaneous multi-channel and multi-method acquisition of synchronized parameters in cross-system fluorescence lifetime applications
HU227859B1 (en) Real-time 3d nonlinear microscope measuring system and its application
Enderlein Breaking the diffraction limit with dynamic saturation optical microscopy
JP5823287B2 (en) Luminescence microscope with improved resolution
CN108956561A (en) Copolymerization coke and annular total internal reflection double mode microscopic system based on scanning galvanometer
CN103163106A (en) Super-resolution fluorescent lifetime imaging method and device based on stimulated emission lost
CN103487421A (en) Super-resolution microscopic method and device of time-gated wide-field stimulated emission
Kuang et al. Far-field optical nanoscopy based on continuous wave laser stimulated emission depletion
CN212489863U (en) Stimulated Raman scattering imaging system with rapid and efficient adaptive optical compensation
WO2021243754A1 (en) Super-resolution imaging method and imaging system based on low-power stimulated emission depletion
Niesner et al. Intravital two‐photon microscopy: focus on speed and time resolved imaging modalities
WO2024087614A1 (en) Ratiometric fluorescence emission super-resolution imaging method
JP2006275964A (en) Shading correction method for scanning fluorescence microscope
CN101248986A (en) Method and device for improving dual-color two-photon fluorescent imaging layer analyse deepness
WO2024087615A1 (en) Fluorescence emission ratio three-dimensional super-resolution imaging method
Bettiol et al. High-resolution fast ion microscopy of single whole biological cells
Ramponi et al. An instrument for simultaneous acquisition of fluorescence spectra and fluorescence lifetimes from single cells
Chandler et al. High-resolution mosaic imaging with multifocal, multiphoton photon-counting microscopy
Birch et al. A wide field fluorescence lifetime imaging system using a light sheet microscope
CN114740008A (en) Super-resolution wafer defect detection system
Bettiol et al. Ion beam induced fluorescence imaging in biological systems

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 20939121

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22/03/2023)

122 Ep: pct application non-entry in european phase

Ref document number: 20939121

Country of ref document: EP

Kind code of ref document: A1