WO2020037527A1 - Super-resolution imaging method and apparatus, and terminal device - Google Patents

Super-resolution imaging method and apparatus, and terminal device Download PDF

Info

Publication number
WO2020037527A1
WO2020037527A1 PCT/CN2018/101648 CN2018101648W WO2020037527A1 WO 2020037527 A1 WO2020037527 A1 WO 2020037527A1 CN 2018101648 W CN2018101648 W CN 2018101648W WO 2020037527 A1 WO2020037527 A1 WO 2020037527A1
Authority
WO
WIPO (PCT)
Prior art keywords
fluorescence intensity
wavelength signal
short
long
wavelength
Prior art date
Application number
PCT/CN2018/101648
Other languages
French (fr)
Chinese (zh)
Inventor
杨志刚
刘毋凡
屈军乐
Original Assignee
深圳大学
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳大学 filed Critical 深圳大学
Priority to PCT/CN2018/101648 priority Critical patent/WO2020037527A1/en
Publication of WO2020037527A1 publication Critical patent/WO2020037527A1/en

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence

Definitions

  • the present invention relates to the field of image processing technology, and in particular, to a super-resolution imaging method, device, and terminal device.
  • Fluorescence microscopy is widely used in cell microbiology imaging.
  • super-resolution localized imaging is a representative super-resolution fluorescence imaging technology. This technology combines single-molecule imaging with high-precision molecular positioning algorithms on the basis of an optical reconstruction microscope to achieve an ultra-high spatial resolution of 20-30nm to observe the ultrastructure of cells.
  • the key to this technique is to use an excited fluorescent probe to randomly bind to the affinity reagent in the surrounding environment, causing its fluorescence to decay into the dark state, and then using another wavelength or activating light of the same wavelength to make the affinity reagent from the fluorescent molecule
  • the random drop off has the ability to emit light again, so that the fluorescent molecules change randomly between luminous and dark states, and then continuously record multiple frames of fluorescent molecules, perform a single molecule positioning algorithm to determine the center position, and finally reconstruct super-resolution fluorescence from the image image.
  • optical reconstruction microscopes can only perform super-resolution imaging on the structure of biological samples, and cannot perform functional super-resolution imaging or super-resolution imaging research on quantification of sample parameters.
  • an optical reconstruction microscope can only perform super-resolution imaging on the structure of a biological sample, and cannot perform functional super-resolution imaging or super-resolution imaging research on quantification of sample parameters.
  • a first aspect of the embodiments of the present invention provides a super-resolution imaging method, including:
  • Fluorescent probes with double emission peaks on biological samples are excited by excitation light, and affinity reagents are applied to the excited fluorescent probes;
  • STORM Stochastic Optical Reconstruction Microscopy, Random Optical Reconstruction Microscope
  • super-resolution imaging method is used to reconstruct the proportional fluorescence image to obtain a super-resolution image
  • the super-resolution imaging method further includes:
  • the establishing a function model of the environmental parameter of the fluorescent probe and the ratio of the fluorescent intensity includes:
  • a fluorescence intensity test ratio is calculated, and a function model of the first parameter and the fluorescence intensity test ratio is established.
  • the forming a dual-channel fluorescence intensity image by activating the light and irradiating the fluorescent probe after the action of the affinity reagent includes:
  • the first structure or the second structure emits fluorescence
  • the first structure and the second structure alternately emit light according to the binding state with the affinity reagent to form the dual-channel fluorescence intensity image.
  • the dual-channel fluorescence intensity image includes a fluorescence intensity image of a short-wavelength signal and a fluorescence intensity image of a long-wavelength signal;
  • the fluorescence intensity image of the short-wavelength signal corresponds to the light emission process of the first structure in the fluorescent probe
  • the fluorescence intensity image of the long-wavelength signal corresponds to the light emission process of the second structure in the fluorescent probe.
  • the short-wavelength signal of the short-wavelength emission peak and the long-wavelength signal of the long-wavelength emission peak include :
  • the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror transmits the filtered short-wavelength signal to A first EMCCD; the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to the first EMCCD, thereby collecting the dual-channel fluorescence intensity image. ;
  • Different regions of the first EMCCD receive the filtered short-wavelength signal and the filtered long-wavelength signal, respectively.
  • the separately collecting a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the fluorescence emission spectrum includes:
  • the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror transmits the filtered short-wavelength signal to A first EMCCD; the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to a second EMCCD;
  • the first EMCCD and the second EMCCD respectively receive the filtered short-wavelength signal and the filtered long-wavelength signal, thereby collecting the dual-channel fluorescence intensity image. .
  • the selected N-frame two-channel fluorescence intensity images are obtained according to the separately acquired short-wavelength signals and For the long-wavelength signal, in the two-channel fluorescence intensity image of the same frame, the fluorescence intensity image of the short-wavelength signal and the fluorescence intensity image of the long-wavelength signal are selected, and the fluorescence intensity ratios thereof are calculated to obtain N Ratio fluorescent images, where N is a positive integer, including:
  • IBN is the emission peak fluorescence intensity of the long-wavelength signal
  • IAN is the emission peak fluorescence intensity of the short-wavelength signal.
  • a second aspect of the present invention provides a super-resolution imaging device, including:
  • An excitation module for exciting a fluorescent probe having a double emission peak on a biological sample by using excitation light, and applying an affinity reagent to the excited fluorescent probe;
  • a fluorescence intensity image acquisition module configured to obtain a dual-channel fluorescence intensity image by activating light and irradiating a fluorescent probe after the action of an affinity reagent
  • a signal acquisition module configured to separately acquire a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image;
  • a proportional fluorescence image calculation module is configured to select N frames of two-channel fluorescence intensity images, and select the selected one of the two-channel fluorescence intensity images in the same frame according to the separately acquired short-wavelength signals and the long-wavelength signals.
  • the fluorescence intensity image of the short-wavelength signal and the fluorescence intensity image of the long-wavelength signal and respectively calculating a fluorescence intensity ratio thereof to obtain N proportional fluorescence images, where N is a positive integer, where N is a positive integer;
  • An image reconstruction module configured to reconstruct the proportional fluorescence image by using the STORM super-resolution imaging method to obtain a super-resolution image
  • An image acquisition module is configured to color the super-resolution image according to N of the proportional fluorescence images to obtain a proportional-type super-resolution image.
  • a third aspect of the embodiments of the present invention provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor.
  • the processor executes the computer program, the first implementation is implemented as above.
  • a fourth aspect of the embodiments of the present invention provides a computer-readable storage medium.
  • the computer-readable storage medium stores a computer program.
  • the steps of the method provided by the first aspect are implemented. .
  • the super-resolution imaging method proposed in the embodiment of the present invention uses a fluorescent probe with dual emission peaks to label a biological sample. After exciting the fluorescent probe, a super-resolution image is reconstructed by the STORM super-resolution imaging method. After excitation, it can generate a fluorescent signal with double emission peaks, that is, a short-wavelength signal with a short-wavelength emission peak and a long-wavelength signal with a long-wavelength emission peak. Therefore, it can be formed when a nucleophile and an activating light act on this fluorescent probe. The two-channel fluorescence intensity image is then separately collected by the optical signal acquisition device.
  • the short-wavelength signal with a short-wavelength emission peak and the long-wavelength signal with a long-wavelength emission peak can be calculated based on the two-channel fluorescence intensity image at the same time. And the ratio of the fluorescence intensity with a long-wavelength signal emission peak to obtain a proportional fluorescence image. Finally, the super-resolution image is colored according to the proportional fluorescence image to obtain a proportional-type super-resolution image.
  • the proportional super-resolution image obtained by the super-resolution imaging method provided by the embodiment of the present invention can not only reflect the structure of the biological sample, but also reflect the sample parameters at the fluorescent probe mark in the biological sample by the ratio of the fluorescence intensity, so that it can be based on Sample parameters, functions for analyzing biological samples.
  • FIG. 1 is a schematic flowchart of a super-resolution imaging method provided by Embodiment 1 of the present invention
  • FIG. 2 is a detailed implementation flowchart of S103 in FIG. 1 provided in Embodiment 2 of the present invention.
  • FIG. 3 is a schematic diagram of alternate light emission of a fluorescent probe provided in Embodiment 2 of the present invention.
  • FIG. 4 is a detailed implementation flowchart of S104 in FIG. 1 provided in Embodiment 3 of the present invention.
  • FIG. 5 is a schematic diagram of a device for implementing the steps in FIG. 2;
  • FIG. 6 is an implementation effect diagram of a super-resolution imaging method provided by Embodiment 4 of the present invention.
  • FIG. 7 is a schematic structural diagram of a super-resolution imaging device provided by Embodiment 6 of the present invention.
  • an embodiment of the present invention provides a super-resolution imaging method, which can be applied to super-resolution positioning imaging of an optical reconstruction microscope, which includes:
  • step S101 after the fluorescent probe having dual emission peaks is excited, two emission peaks will be displayed in the fluorescent emission spectrum of the fluorescent probe, that is, a short-wavelength emission peak and a long-wavelength emission peak.
  • the excitation light before the excitation light acts on the biological sample, it should also pass through optical processing elements, such as lenses, field diaphragms, tube lenses, objective lenses, etc., so that the excitation light can be uniformly and concentratedly illuminated on the biological sample. Thereby, the fluorescent probe is excited.
  • optical processing elements such as lenses, field diaphragms, tube lenses, objective lenses, etc.
  • a dual-channel fluorescence intensity image is formed by irradiating the fluorescent probe after the action of the affinity reagent with activating light.
  • the affinity reagent is not bound to the probe.
  • the affinity reagent covers the structure in the fluorescent probe, the structure does not emit light, and when the affinity reagent falls off the structure, the structure has the light-emitting ability again.
  • the affinity reagent is reversible, that is, under certain conditions, the affinity reagent can be transferred between the structures in the fluorescent probe.
  • the activation light and the excitation light may have the same frequency or different frequencies, which are not specifically limited in the embodiments of the present invention.
  • S103 Collect a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image, respectively.
  • step S103 since the fluorescent probe after the action of the reagent is still a fluorescent probe having a double emission peak, the fluorescence emission spectrum obtained in step S103 still has a double emission peak.
  • the affinity reagent can be transferred from one structure in the fluorescent probe to the other structure in the fluorescent probe, and the two structures will emit light alternately; In the light-emitting structure, a short-wavelength signal with a short-wavelength emission peak and a long-wavelength signal with a long-wavelength emission peak can be obtained in the obtained fluorescence emission spectrum.
  • collecting signals in the fluorescence emission spectrum can be achieved by any spectral analysis instrument or a combination of optical components, such as EMCCD, which is not specifically limited in the embodiments of the present invention.
  • S104 Select an N-frame dual-channel fluorescence intensity image, and select the fluorescence of the short-wavelength signal in the dual-channel fluorescence intensity image of the same frame according to the separately acquired short-wavelength signal and the long-wavelength signal.
  • the intensity image and the fluorescence intensity image of the long-wavelength signal, and the fluorescence intensity ratios thereof are calculated respectively to obtain N proportional fluorescence images, where N is a positive integer.
  • the fluorescence intensity images corresponding to the short-wavelength signal and the long-wavelength signal are selected, and the fluorescence intensity ratios thereof are calculated to obtain N ratio fluorescence images, which is equivalent to a period of time.
  • Multi-frame images of fluorescence probe flicker are continuously recorded inside, and the N-th proportional fluorescence image is the N-th dual-channel fluorescence intensity image, which can reflect the fluorescence intensity images corresponding to the short-wavelength signal and the long-wavelength signal at the same time, and
  • the N-th ratio fluorescence image and the N + 1-th ratio fluorescence image may be two adjacent frames of images or two non-adjacent frames of images.
  • the embodiment of the present invention also provides detailed implementation steps for calculating the fluorescence intensity ratio in the above step S104, which includes:
  • IBN is the emission peak fluorescence intensity of the long-wavelength signal
  • IAN is the emission peak fluorescence intensity of the short-wavelength signal.
  • proportional fluorescent images for example, 1,000 proportional fluorescent images are needed as a basis for image reconstruction.
  • An embodiment of the present invention further provides a super-resolution imaging method for establishing a function model of the environmental parameter of the fluorescent probe and the ratio of the fluorescent intensity;
  • the establishing a function model of the environmental parameter of the fluorescent probe and the ratio of the fluorescent intensity includes:
  • a fluorescence intensity test ratio is calculated, and a function model of the first parameter and the fluorescence intensity test ratio is established.
  • a function model of the first parameter and the fluorescence intensity test ratio that is, the correspondence between the fluorescence intensity ratio and the sample parameter at the fluorescent probe label in the biological sample; for example, if the first parameter is the solution concentration, then When this probe is applied to a biological sample including a solution, the fluorescence intensity ratio can reflect the concentration of the solution at the probe mark of the biological sample.
  • the STORM super-resolution imaging method uses a random optical reconstruction microscope to continuously record multiple frames of fluorescent molecules, performs a single-molecule positioning algorithm to determine the center position, and finally reconstructs a super-resolution fluorescent image from the image.
  • the super-resolution imaging method proposed in the embodiment of the present invention uses a fluorescent probe with dual emission peaks to label a biological sample. After exciting the fluorescent probe, a super-resolution image is reconstructed by the STORM super-resolution imaging method. After excitation, it can generate a fluorescent signal with double emission peaks, that is, a short-wavelength signal with a short-wavelength emission peak and a long-wavelength signal with a long-wavelength emission peak. Therefore, it can be formed when a nucleophile and an activating light act on this fluorescent probe The two-channel fluorescence intensity image is then collected separately by the optical signal acquisition device.
  • the short-wavelength signal with a short-wavelength emission peak and the long-wavelength signal with a long-wavelength emission peak can be calculated from the two-channel fluorescence intensity image at the same time And the ratio of the fluorescence intensity with a long-wavelength signal emission peak to obtain a proportional fluorescence image.
  • the super-resolution image is colored according to the proportional fluorescence image to obtain a proportional-type super-resolution image.
  • the proportional super-resolution image obtained by the super-resolution imaging method provided by the embodiment of the present invention can not only reflect the structure of the biological sample, but also reflect the sample parameters at the fluorescent probe mark in the biological sample by the ratio of the fluorescence intensity, so that it can be based on Sample parameters, functions for analyzing biological samples.
  • step S102 is:
  • a dual-channel fluorescence intensity image is obtained by irradiating the fluorescent probe after the action of the affinity reagent with activating light.
  • the wavelength of the activation light is the same as the wavelength of the excitation light, wherein the short-wavelength emission peak is caused by the first structure in the probe, and the long-wavelength emission peak is caused by the second structure in the probe. And the fluorescence emission spectra of the two emission peaks do not completely overlap.
  • the first structure and the second structure alternately emit light according to a binding state with the affinity reagent to form the dual channel. Image of fluorescence intensity.
  • both the first structure and the second structure in the fluorescent probe may absorb the excitation light energy and transition to the excited state to emit fluorescence, that is, the laser irradiates the fluorescent probe.
  • the first structure may emit fluorescence or the second structure may emit fluorescence.
  • the first structure of one of the fluorescent probes emits fluorescence after the excitation light is irradiated
  • the first structure is an energy acceptor and the second structure is an energy donor
  • the energy provided by the body causes the energy acceptor to emit fluorescence, and the energy donor emits weak fluorescence due to the loss of energy.
  • the energy donor no longer provides energy to the energy acceptor. So that the energy acceptor does not emit fluorescence, and the energy donor emits fluorescence because it does not lose energy. Due to the randomness of the binding of the affinity reagent and the fluorescent probe, in the biological sample, the fluorescence emitted by the first structure and the second structure of each fluorescent probe is also random.
  • FIG. 3 it is a schematic diagram of alternately emitting light by a fluorescent probe provided by an embodiment of the present invention.
  • the energy receptor emits light after the excitation light is irradiated; when the affinity reagent is not bound to the fluorescent probe, the energy receptor no longer absorbs the energy of the energy donor and the excitation light, and no longer emits fluorescence, due to the reversibility of the affinity reagent
  • the energy donor reversely absorbs the activation light energy to emit fluorescence, and then based on this, it randomly circulates to achieve the purpose of the fluorescent probe to alternately emit light.
  • the two-channel fluorescence intensity images described in the above steps S1021 to S1024 include a fluorescence intensity image of a short wavelength signal and a fluorescence intensity image of a long wavelength signal; the fluorescence intensity image of the short wavelength signal corresponds to The light emission process of the first structure in the fluorescent probe; the fluorescence intensity image of the long-wavelength signal corresponds to the light emission process of the second structure in the fluorescent probe.
  • the super-resolution imaging method proposed in the embodiment of the present invention uses a fluorescent probe with dual emission peaks to label a biological sample, and under the action of activating light irradiation and the reversible action of an affinity reagent, a single fluorescent probe molecule in the biological sample emits two randomly alternately. Different wavelengths of fluorescence.
  • step S103 is:
  • S103 Collect a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image, respectively.
  • the dichroic mirror almost completely transmits light of a certain wavelength and almost completely reflects light of other wavelengths.
  • the light emitted by the fluorescent probe on the biological sample includes a short-wavelength signal, a long-wavelength signal, and a small amount of excitation light. Wavelength signals are separated from long-wavelength signals.
  • the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror separates the filtered short-wavelength signal.
  • a first EMCCD ElectroBon-MultiplyinACCD
  • the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to the first EMCCD.
  • the light wave signal is also separated by a dichroic mirror, and the separated short-wavelength signal and long-wavelength signal are filtered by a filter and sent to the same EMCCD.
  • single emission wavelengths are susceptible to environmental noise interference, which will result in an increase in the proportion of system noise in the imaging results and blurring of reconstructed images.
  • algorithmic noise reduction is required during subsequent results processing.
  • filtering it can simplify the post-processing algorithm in the super-resolution imaging method based on optical reconstruction microscope.
  • Different regions of the first EMCCD receive the filtered short-wavelength signal and the filtered long-wavelength signal, respectively, so as to collect the dual-channel fluorescence intensity image.
  • the size of the short-wavelength signal or the long-wavelength signal should be smaller than the maximum pixel size of the EMCCD; More than 256 * 256.
  • an embodiment of the present invention also provides a schematic structural diagram of a device for implementing steps S1031 to S1032.
  • the reference numerals are as follows: 51. laser; 52. lens group; 53. field diaphragm; 54. tube mirror; 55. biological sample; 56. objective lens; 57. first dichroic mirror; 58. reflector; 59. Second dichroic mirror; 510. first filter; 511. second filter; 512. EMCCD.
  • the lens group is used to converge or diverge the light beam; the field diaphragm is used to appropriately adjust the beam size.
  • two identical EMCCDs can also be used to receive the short-wavelength signal and the long-wavelength signal, respectively.
  • the detailed implementation process is as follows:
  • the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror transmits the filtered short-wavelength signal to A first EMCCD; the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to a second EMCCD;
  • the first EMCCD and the second EMCCD respectively receive the filtered short-wavelength signal and the filtered long-wavelength signal, thereby collecting the dual-channel fluorescence intensity image.
  • the signal light is separated into two channels by a dichroic mirror, part of the stray light is filtered by a filter, and then the two signal lights are collected by EMCCD, thereby improving the anti-noise of biological samples
  • EMCCD electro-resolution imaging method
  • the embodiment of the present invention exemplarily describes the implementation process of the super-resolution imaging methods provided in the first to third embodiments.
  • FIG. 6 after a short-wavelength signal with a short-wavelength emission peak and a long-wavelength signal with a long-wavelength emission peak are separately collected, data processing is performed based on the two signals to obtain a proportional fluorescence image.
  • the data processing process can be represented by FIG. 6, where IB + IA is expressed as an unseparated long-wavelength signal and a short-wavelength signal.
  • the data are separated into optical long-wavelength signals IB and Short-wavelength signal IA; when the fluorescence intensity ratio of emission peaks is calculated after the acquisition is completed, the fluorescence intensity map of the two signals at the same time is used as the ratio, that is, To obtain a proportional fluorescence image, and finally reconstruct a large number of proportional images by algorithm to obtain a super-resolution image and color the marked points with pseudo color to obtain a proportional-type super-resolution image, in which different colors represent the ratio The size of the value.
  • the embodiment of the present invention exemplarily illustrates the practical application of the super-resolution imaging methods provided in the first to third embodiments.
  • how to reflect the ratio of the sample parameters at the fluorescent probe markers in the biological sample to the proportional super-resolution image is used to analyze the function of the biological sample according to the sample parameters.
  • the embodiment of the present invention provides an example of super-resolution imaging using the super-resolution imaging methods provided in the first to fourth embodiments to realize a quantitative study of the microenvironment viscosity value of a labeled sample.
  • the fluorescent probe provided is a viscosity-sensitive fluorescent probe.
  • the short-wavelength emission peak is caused by the structure A in the probe
  • the long-wavelength emission peak is caused by the structure B in the probe
  • IB is the fluorescence intensity of the emission peak of structure B
  • IA is the structure A Emission peak fluorescence intensity.
  • IB / IA as a function of viscosity, that is, measure the steady-state emission spectra of fluorescent probes in different viscosity solutions, and separately process the steady-state spectra at different viscosities with IB / IA.
  • fluorescent probes are used to label biological samples, lasers are used for excitation, and imaging is performed in a super-resolution imaging system to obtain a large number of proportional fluorescent images.
  • the ratio of the two-channel proportional fluorescence image IB to IA is firstly calculated for each frame, and then a large number of fluorescence intensity ratio images are algorithmically reconstructed to obtain a super-resolution image of the structure of the labeled organism, and the pseudo-color pairs are used to Each pixel of the marker structure is colored. The value of each pixel in the image is the value of IB / IA.
  • the size of the IB / IA ratio can be expressed in the fitting function relationship of the solution test result.
  • the viscosity values under different ratios are found, that is, the difference in pseudo-colors represents the difference in the distribution of viscosity values in the microenvironment.
  • the reconstructed super-resolution image shows an ultra-fine structure diagram of the labeled structure.
  • the embodiment of the present invention also provides an example of super-resolution imaging using the super-resolution imaging methods provided in the first to third embodiments to realize the quantitative study of the mitochondrial membrane protein of the labeled sample.
  • the fluorescent probe provided is a fluorescent probe that can specifically label mitochondrial membrane proteins.
  • the short-wavelength emission peak is caused by the structure A in the probe
  • the long-wavelength emission peak is caused by the structure B in the probe.
  • IB is the structure B.
  • Emission peak fluorescence intensity, IA is the fluorescence intensity of emission peak of structure A.
  • a function equation of the value of IB / IA with respect to the content or concentration of mitochondrial membrane protein that is, measure the steady-state emission spectra of fluorescent probe 2 in solutions with different mitochondrial membrane protein content or concentration.
  • the IB / IA treatment is performed on the steady-state spectrum at the content or concentration, respectively, to obtain the value of IB / IA at different mitochondrial membrane protein content or concentration, and then the proportional value is plotted against the content or concentration and fitted with a linear or non-linear function.
  • the fitted function relationship of IB / IA to mitochondrial membrane protein content or concentration was obtained.
  • fluorescent probes are used to label biological mitochondrial membrane proteins, excitation is performed using excitation light, and imaging is performed in a super-resolution imaging system to obtain a large number of fluorescent images.
  • the ratio of each frame of the two-channel fluorescence intensity image IB to IA is firstly compared, and then a large number of proportional fluorescence images are reconstructed by algorithm to obtain a super-resolution image of the structure of the labeled organism, and the labels are marked in pseudo-color.
  • Each pixel of the structure is colored. The value of each pixel in the image is the value of IB / IA.
  • the size of the IB / IA ratio can be in the fitting function relationship of the solution test result.
  • the difference in pseudo-colors represents the difference in the distribution of the protein content value in the microenvironment.
  • the reconstructed super-resolution image shows an ultra-fine structure map of the labeled structure.
  • an embodiment of the present invention provides a super-resolution imaging device 70, including:
  • An excitation module 71 configured to excite a fluorescent probe having a double emission peak on a biological sample through excitation light, and apply an affinity reagent to the excited fluorescent probe;
  • a fluorescence intensity image acquisition module 72 configured to obtain a dual-channel fluorescence intensity image by activating light and irradiating a fluorescent probe after the action of an affinity reagent;
  • a signal acquisition module 73 configured to separately acquire a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image;
  • a proportional fluorescence image calculation module 74 is configured to select N frames of two-channel fluorescence intensity images, and select the two-channel fluorescence intensity images in the same frame according to the separately acquired short-wavelength signals and the long-wavelength signals. Calculate the fluorescence intensity ratio of the short-wavelength signal fluorescence image and the long-wavelength signal fluorescence intensity image, respectively, to obtain N proportional fluorescence images, where N is a positive integer, where N is a positive integer;
  • An image reconstruction module 75 configured to reconstruct the proportional fluorescence image by using a STORM super-resolution imaging method to obtain a super-resolution image
  • An image acquisition module 76 is configured to color the super-resolution image according to N number of the proportional fluorescence images to obtain a proportional-type super-resolution image.
  • the above-mentioned fluorescence intensity image acquisition module 73 includes:
  • a short-wavelength emission peak acquisition unit configured to obtain the short-wavelength emission peak according to a first structure in the fluorescent probe
  • a long-wavelength emission peak acquisition unit configured to obtain the long-wavelength emission peak according to a second structure in the fluorescent probe
  • the first structure is an energy acceptor, and the second structure is an energy donor;
  • a dual-channel fluorescence intensity image acquisition unit is configured to apply the activated light to the processed fluorescent probe to cause the first structure and the second structure to emit light alternately to obtain the dual-channel fluorescence intensity image.
  • An embodiment of the present invention further provides a terminal device including a memory, a processor, and a computer program stored in the memory and executable on the processor.
  • a terminal device including a memory, a processor, and a computer program stored in the memory and executable on the processor.
  • the processor executes the computer program, the implementation is implemented as in Embodiments 1 to 3. Each step in the super-resolution imaging method described in.
  • An embodiment of the present invention also provides a storage medium.
  • the storage medium is a computer-readable storage medium, and a computer program is stored thereon.
  • the computer program is executed by a processor, the implementation is as described in Embodiments 1 to 3. Steps in a super-resolution imaging method.
  • the super-resolution imaging method proposed by the present invention uses a fluorescent probe with dual emission peaks to label a biological sample. After the fluorescent probe is excited, a super-resolution image is reconstructed by the STORM super-resolution imaging method. Able to generate fluorescent signals with dual emission peaks, that is, short-wavelength signals with short-wavelength emission peaks and long-wavelength signals with long-wavelength emission peaks, so dual channels can be formed when this fluorescent probe is acted on by a nucleophile and activating light The fluorescence intensity image is then collected by an optical signal acquisition device. The short-wavelength signal with a short-wavelength emission peak and the long-wavelength signal with a long-wavelength emission peak can be calculated from the two-channel fluorescence intensity image at the same time.
  • the ratio of the fluorescence intensity of the long-wavelength signal emission peak is used to obtain a proportional fluorescence image.
  • the super-resolution image is colored according to the proportional fluorescence image to obtain a proportional-type super-resolution image.
  • the proportional super-resolution image obtained by the super-resolution imaging method provided by the embodiment of the present invention can not only reflect the structure of the biological sample, but also reflect the sample parameters at the fluorescent probe mark in the biological sample by the ratio of the fluorescence intensity, so that it can be based on Sample parameters, functions for analyzing biological samples.

Abstract

A super-resolution imaging method and apparatus, and a terminal device. The method comprises: exciting a fluorescent probe having a dual emission peak on a biological sample by means of an excitation light, and acting an affinity reagent onto the excited fluorescent probe (S101); irradiating, by means of an activated light, the fluorescent probe acted by the affinity reagent to obtain a dual-channel fluorescence intensity image (S102); respectively acquiring a short wavelength signal having a short wavelength emitting peak and a long wavelength signal having a long wavelength emitting peak in the dual-channel fluorescence intensity image (S103); selecting a fluorescence intensity image of the short wavelength signal and that of the long wavelength signal from the same frame of dual-channel fluorescence intensity image according to the respectively acquired short wavelength signal and long wavelength signal, and respectively calculating a fluorescence intensity ratio of the images to obtain N proportional fluorescence images, N being a positive integer (S104); reconstructing the proportional fluorescence image to obtain a super-resolution image by means of a STORM super-resolution imaging method (S105); and coloring the super-resolution image according to the N proportional fluorescence images to obtain a proportional super-resolution image (S106). According to the method, the proportional super-resolution image can be obtained for reflecting sample parameters at a fluorescent probe mark in the biological sample.

Description

一种超分辨成像方法、装置及终端设备Super-resolution imaging method, device and terminal equipment 技术领域Technical field
本发明涉及图像处理技术领域,尤其涉及一种超分辨成像方法、装置及终端设备。The present invention relates to the field of image processing technology, and in particular, to a super-resolution imaging method, device, and terminal device.
背景技术Background technique
荧光显微镜被广泛应用于细胞微生物成像,其中,超分辨定位成像是一种代表性的超分辨荧光成像技术。该技术在光学重构显微镜的基础上,将单分子成像与高精度分子定位算法相结合,实现了20~30nm的超高空间分辨率,以观察到细胞中的超微结构。这种技术的关键在于使用激发态的荧光探针与周围环境中的亲和试剂随机结合,导致其荧光衰减进入暗态,再利用另一波长或同一波长的活化光使亲和试剂从荧光分子上随机脱落重新具备发光能力,从而使得荧光分子在发光与暗态之间随机变化,然后连续记录荧光分子的多帧图像,进行单分子定位算法确定中心位置,最后通过图像重构出超分辨荧光图像。Fluorescence microscopy is widely used in cell microbiology imaging. Among them, super-resolution localized imaging is a representative super-resolution fluorescence imaging technology. This technology combines single-molecule imaging with high-precision molecular positioning algorithms on the basis of an optical reconstruction microscope to achieve an ultra-high spatial resolution of 20-30nm to observe the ultrastructure of cells. The key to this technique is to use an excited fluorescent probe to randomly bind to the affinity reagent in the surrounding environment, causing its fluorescence to decay into the dark state, and then using another wavelength or activating light of the same wavelength to make the affinity reagent from the fluorescent molecule The random drop off has the ability to emit light again, so that the fluorescent molecules change randomly between luminous and dark states, and then continuously record multiple frames of fluorescent molecules, perform a single molecule positioning algorithm to determine the center position, and finally reconstruct super-resolution fluorescence from the image image.
然而,目前光学重构显微镜仅能够对生物样品的结构进行超分辨成像,无法做功能性超分辨成像或样品参数定量的超分辨成像研究。However, at present, optical reconstruction microscopes can only perform super-resolution imaging on the structure of biological samples, and cannot perform functional super-resolution imaging or super-resolution imaging research on quantification of sample parameters.
发明概述Summary of invention
技术问题technical problem
现有技术中,光学重构显微镜仅能够对生物样品的结构进行超分辨成像,无法做功能性超分辨成像或样品参数定量的超分辨成像研究。In the prior art, an optical reconstruction microscope can only perform super-resolution imaging on the structure of a biological sample, and cannot perform functional super-resolution imaging or super-resolution imaging research on quantification of sample parameters.
问题的解决方案Problem solution
技术解决方案Technical solutions
本发明实施例第一方面提供一种超分辨成像方法,包括:A first aspect of the embodiments of the present invention provides a super-resolution imaging method, including:
通过激发光,激发生物样品上具有双发射峰的荧光探针,将亲和试剂作用于激发后的荧光探针上;Fluorescent probes with double emission peaks on biological samples are excited by excitation light, and affinity reagents are applied to the excited fluorescent probes;
通过活化光,照射亲和试剂作用后的荧光探针,形成双通道荧光强度图像;By activating light and irradiating the fluorescent probe after the action of the affinity reagent, a dual-channel fluorescence intensity image is formed;
分别采集所述双通道荧光强度图像中,短波长发射峰的短波长信号和长波长发 射峰的长波长信号;Respectively collecting a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image;
选择N帧双通道荧光强度图像,根据所述分别采集的所述短波长信号和所述长波长信号,在同一帧的所述双通道荧光强度图像中,选择所述短波长信号的荧光强度图像和所述长波长信号的荧光强度图像,并分别计算其荧光强度比值,获得N个比例荧光图像,其中N为正整数;Select N frames of two-channel fluorescence intensity images, and select the fluorescence intensity images of the short-wavelength signals in the two-channel fluorescence intensity images of the same frame according to the separately acquired short-wavelength signals and the long-wavelength signals. And the fluorescence intensity image of the long-wavelength signal, and calculating the fluorescence intensity ratios thereof, to obtain N proportional fluorescence images, where N is a positive integer;
通过STORM(Stochastic Optical Reconstruction Microscopy,随机光学重构显微镜)超分辨成像方法,对所述比例荧光图像进行重构,获得超分辨图像;STORM (Stochastic Optical Reconstruction Microscopy, Random Optical Reconstruction Microscope) super-resolution imaging method is used to reconstruct the proportional fluorescence image to obtain a super-resolution image;
根据N个所述比例荧光图像对所述超分辨图像着色,获得比例型超分辨图像。Color the super-resolution image according to N number of the proportional fluorescence images to obtain a proportional-type super-resolution image.
结合本发明第一方面,本发明第一方面的第一实施方式中,所述超分辨成像方法还包括:With reference to the first aspect of the present invention, in a first embodiment of the first aspect of the present invention, the super-resolution imaging method further includes:
建立所述荧光探针的环境参数与所述荧光强度比值的函数模型;Establishing a function model of the environmental parameter of the fluorescent probe and the ratio of the fluorescent intensity;
所述建立所述荧光探针环境参数与所述荧光强度比值的函数模型包括:The establishing a function model of the environmental parameter of the fluorescent probe and the ratio of the fluorescent intensity includes:
将所述具有双发射峰的荧光探针置于探针溶液测试环境,通过激发光,激发所述荧光探针;Placing the fluorescent probe with a double emission peak in a probe solution test environment, and exciting the fluorescent probe through excitation light;
改变所述探针溶液测试环境的第一参数,获取在不同的所述第一参数下,所述荧光探针的稳态荧光发射光谱;Changing a first parameter of the test environment of the probe solution to obtain a steady-state fluorescence emission spectrum of the fluorescent probe under different first parameters;
根据所述稳态荧光发射光谱中的双发射峰,计算荧光强度测试比值,并建立所述第一参数与所述荧光强度测试比值的函数模型。According to the double emission peak in the steady-state fluorescence emission spectrum, a fluorescence intensity test ratio is calculated, and a function model of the first parameter and the fluorescence intensity test ratio is established.
结合本发明第一方面,本发明第一方面的第二实施方式中,所述通过活化光,照射亲和试剂作用后的荧光探针,形成双通道荧光强度图像包括:With reference to the first aspect of the present invention and the second embodiment of the first aspect of the present invention, the forming a dual-channel fluorescence intensity image by activating the light and irradiating the fluorescent probe after the action of the affinity reagent includes:
根据所述荧光探针中的第一结构,获得所述短波长信号;Obtaining the short-wavelength signal according to a first structure in the fluorescent probe;
根据所述荧光探针中的第二结构,获得所述长波长信号;Obtaining the long-wavelength signal according to a second structure in the fluorescent probe;
所述激发光照射所述荧光探针时,所述第一结构或第二结构发射荧光;When the excitation light irradiates the fluorescent probe, the first structure or the second structure emits fluorescence;
所述活化光作用于所述亲和试剂作用后的荧光探针时,所述第一结构和所述第二结构根据与所述亲和试剂的结合状态交替发光,形成所述双通道荧光强度图像。When the activating light acts on the fluorescent probe after the affinity reagent acts, the first structure and the second structure alternately emit light according to the binding state with the affinity reagent to form the dual-channel fluorescence intensity image.
结合本发明第一方面的第二实施方式,本发明第一方面的第三实施方式中,所述双通道荧光强度图像,包括短波长信号的荧光强度图像和长波长信号的荧光 强度图像;With reference to the second embodiment of the first aspect of the present invention, in the third embodiment of the first aspect of the present invention, the dual-channel fluorescence intensity image includes a fluorescence intensity image of a short-wavelength signal and a fluorescence intensity image of a long-wavelength signal;
所述短波长信号的荧光强度图像,对应所述荧光探针中的第一结构的发光过程;The fluorescence intensity image of the short-wavelength signal corresponds to the light emission process of the first structure in the fluorescent probe;
所述长波长信号的荧光强度图像,对应所述荧光探针中的第二结构的发光过程。The fluorescence intensity image of the long-wavelength signal corresponds to the light emission process of the second structure in the fluorescent probe.
结合本发明第一方面,本发明第一方面的第四实施方式中,所述分别采集所述双通道荧光强度图像中,短波长发射峰的短波长信号和长波长发射峰的长波长信号包括:With reference to the first aspect of the present invention, in a fourth embodiment of the first aspect of the present invention, in the acquiring the two-channel fluorescence intensity images, the short-wavelength signal of the short-wavelength emission peak and the long-wavelength signal of the long-wavelength emission peak include :
通过第一双色镜将所述激发光与所述短波长信号和所述长波长信号分离;Separating the excitation light from the short-wavelength signal and the long-wavelength signal through a first dichroic mirror;
通过第二双色镜将所述短波长信号和所述长波长信号分离后,所述短波长信号经过第一滤波器发送至反射镜,所述反射镜将所述滤波后的短波长信号传输至第一EMCCD;所述长波长信号经过第二滤波器,所述滤波后的长波长信号传输至所述第一EMCCD,从而收集所述双通道荧光强度图像。;After the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror transmits the filtered short-wavelength signal to A first EMCCD; the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to the first EMCCD, thereby collecting the dual-channel fluorescence intensity image. ;
所述第一EMCCD的不同区域分别接收所述滤波后的短波长信号和所述滤波后的长波长信号。Different regions of the first EMCCD receive the filtered short-wavelength signal and the filtered long-wavelength signal, respectively.
结合本发明第一方面,本发明第一方面的第五实施方式中,所述分别采集所述荧光发射光谱中,短波长发射峰的短波长信号和长波长发射峰的长波长信号,包括:With reference to the first aspect of the present invention, in a fifth embodiment of the first aspect of the present invention, the separately collecting a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the fluorescence emission spectrum includes:
通过第一双色镜将所述激发光与所述短波长信号和所述长波长信号分离;Separating the excitation light from the short-wavelength signal and the long-wavelength signal through a first dichroic mirror;
通过第二双色镜将所述短波长信号和所述长波长信号分离后,所述短波长信号经过第一滤波器发送至反射镜,所述反射镜将所述滤波后的短波长信号传输至第一EMCCD;所述长波长信号经过第二滤波器,所述滤波后的长波长信号传输至第二EMCCD;After the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror transmits the filtered short-wavelength signal to A first EMCCD; the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to a second EMCCD;
所述第一EMCCD和所述第二EMCCD分别接收所述滤波后的短波长信号和所述滤波后的长波长信号,从而收集所述双通道荧光强度图像。。The first EMCCD and the second EMCCD respectively receive the filtered short-wavelength signal and the filtered long-wavelength signal, thereby collecting the dual-channel fluorescence intensity image. .
结合本发明第一方面的第一至第五实施方式,本发明第一方面的第六实施方式中,所述选择N帧双通道荧光强度图像,根据所述分别采集的所述短波长信号和所述长波长信号,在同一帧的所述双通道荧光强度图像中,选择所述短波长信 号的荧光强度图像和所述长波长信号的荧光强度图像,并分别计算其荧光强度比值,获得N个比例荧光图像,其中N为正整数包括:With reference to the first to fifth embodiments of the first aspect of the present invention, in the sixth embodiment of the first aspect of the present invention, the selected N-frame two-channel fluorescence intensity images are obtained according to the separately acquired short-wavelength signals and For the long-wavelength signal, in the two-channel fluorescence intensity image of the same frame, the fluorescence intensity image of the short-wavelength signal and the fluorescence intensity image of the long-wavelength signal are selected, and the fluorescence intensity ratios thereof are calculated to obtain N Ratio fluorescent images, where N is a positive integer, including:
根据所述双通道荧光强度图像和所述分别采集的短波长信号,选择所述第N个所述短波长信号的荧光强度图像,计算其发射峰荧光强度;Selecting the N-th fluorescence intensity image of the short-wavelength signal according to the dual-channel fluorescence intensity image and the separately collected short-wavelength signal, and calculating the emission peak fluorescence intensity thereof;
根据所述双通道荧光强度图像和所述分别采集的长波长信号,选择所述第N个所述长波长信号的荧光强度图像,计算其发射峰荧光强度;Selecting the Nth long-wavelength signal fluorescence intensity image according to the two-channel fluorescence intensity image and the separately acquired long-wavelength signal, and calculating the emission peak fluorescence intensity thereof;
计算所述荧光强度比值的计算公式为:The calculation formula for calculating the fluorescence intensity ratio is:
Figure dest_path_image001
Figure dest_path_image001
,
其中,IBN为所述长波长信号的发射峰荧光强度,IAN为所述短波长信号的发射峰荧光强度。Wherein, IBN is the emission peak fluorescence intensity of the long-wavelength signal, and IAN is the emission peak fluorescence intensity of the short-wavelength signal.
本发明第二方面提供了一种超分辨成像装置,包括:A second aspect of the present invention provides a super-resolution imaging device, including:
激发模块,用于通过激发光,激发生物样品上具有双发射峰的荧光探针,并将亲和试剂作用于激发后的荧光探针上;An excitation module for exciting a fluorescent probe having a double emission peak on a biological sample by using excitation light, and applying an affinity reagent to the excited fluorescent probe;
荧光强度图像获取模块,用于通过活化光,照射亲和试剂作用后的荧光探针,获得双通道荧光强度图像;A fluorescence intensity image acquisition module, configured to obtain a dual-channel fluorescence intensity image by activating light and irradiating a fluorescent probe after the action of an affinity reagent;
信号采集模块,用于分别采集所述双通道荧光强度图像中,短波长发射峰的短波长信号和长波长发射峰的长波长信号;A signal acquisition module configured to separately acquire a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image;
比例荧光图像计算模块,用于选择N帧双通道荧光强度图像,根据所述分别采集的所述短波长信号和所述长波长信号,在同一帧的所述双通道荧光强度图像中,选择所述短波长信号的荧光强度图像和所述长波长信号的荧光强度图像,并分别计算其荧光强度比值,获得N个比例荧光图像,其中N为正整数,其中N为正整数;A proportional fluorescence image calculation module is configured to select N frames of two-channel fluorescence intensity images, and select the selected one of the two-channel fluorescence intensity images in the same frame according to the separately acquired short-wavelength signals and the long-wavelength signals. The fluorescence intensity image of the short-wavelength signal and the fluorescence intensity image of the long-wavelength signal, and respectively calculating a fluorescence intensity ratio thereof to obtain N proportional fluorescence images, where N is a positive integer, where N is a positive integer;
图像重构模块,用于通过STORM超分辨成像方法,对所述比例荧光图像进行重构,获得超分辨图像;An image reconstruction module, configured to reconstruct the proportional fluorescence image by using the STORM super-resolution imaging method to obtain a super-resolution image;
图像获取模块,用于根据N个所述比例荧光图像对所述超分辨图像着色,获得比例型超分辨图像。An image acquisition module is configured to color the super-resolution image according to N of the proportional fluorescence images to obtain a proportional-type super-resolution image.
本发明实施例的第三方面提供了一种终端设备,包括存储器、处理器以及存储在上述存储器中并可在上述处理器上运行的计算机程序,上述处理器执行上述计算机程序时实现如上第一方面所提供的方法的步骤。A third aspect of the embodiments of the present invention provides a terminal device, including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the first implementation is implemented as above. Aspects of the provided method steps.
本发明实施例的第四方面提供了一种计算机可读存储介质,上述计算机可读存储介质存储有计算机程序,上述计算机程序被处理器执行时实现如上第一方面所提供的方法的步骤。。A fourth aspect of the embodiments of the present invention provides a computer-readable storage medium. The computer-readable storage medium stores a computer program. When the computer program is executed by a processor, the steps of the method provided by the first aspect are implemented. .
发明的有益效果The beneficial effects of the invention
有益效果Beneficial effect
本发明实施例提出的超分辨成像方法,使用具有双发射峰的荧光探针,对生物样品进行标记,激发荧光探针后通过STORM超分辨成像方法重构出超分辨图像,由于荧光探针在激发后能够产生具有双发射峰的荧光信号,即具有短波长发射峰的短波长信号和具有长波长发射峰的长波长信号,因此通过亲核剂和活化光作用于此荧光探针时能够形成双通道荧光强度图像,然后通过光信号采集装置分别采集,具有短波长发射峰的短波长信号和具有长波长发射峰的长波长信号,根据同一时刻的双通道荧光强度图像,可以计算短波长信号和具有长波长信号发射峰的荧光强度比值,获得比例荧光图像,最终根据比例荧光图像对超分辨图像着色,获得比例型超分辨图像。通过本发明实施例提出的超分辨成像方法而获得的比例型超分辨图像,不仅可以反映生物样品的结构,还可以通过荧光强度比值反映生物样品中荧光探针标记处的样品参数,从而能够根据样品参数,分析生物样品的功能。The super-resolution imaging method proposed in the embodiment of the present invention uses a fluorescent probe with dual emission peaks to label a biological sample. After exciting the fluorescent probe, a super-resolution image is reconstructed by the STORM super-resolution imaging method. After excitation, it can generate a fluorescent signal with double emission peaks, that is, a short-wavelength signal with a short-wavelength emission peak and a long-wavelength signal with a long-wavelength emission peak. Therefore, it can be formed when a nucleophile and an activating light act on this fluorescent probe. The two-channel fluorescence intensity image is then separately collected by the optical signal acquisition device. The short-wavelength signal with a short-wavelength emission peak and the long-wavelength signal with a long-wavelength emission peak can be calculated based on the two-channel fluorescence intensity image at the same time. And the ratio of the fluorescence intensity with a long-wavelength signal emission peak to obtain a proportional fluorescence image. Finally, the super-resolution image is colored according to the proportional fluorescence image to obtain a proportional-type super-resolution image. The proportional super-resolution image obtained by the super-resolution imaging method provided by the embodiment of the present invention can not only reflect the structure of the biological sample, but also reflect the sample parameters at the fluorescent probe mark in the biological sample by the ratio of the fluorescence intensity, so that it can be based on Sample parameters, functions for analyzing biological samples.
对附图的简要说明Brief description of the drawings
附图说明BRIEF DESCRIPTION OF THE DRAWINGS
图1为本发明实施例一提供的超分辨成像方法的实现流程示意图;FIG. 1 is a schematic flowchart of a super-resolution imaging method provided by Embodiment 1 of the present invention; FIG.
图2为本发明实施例二提供的图1中S103的详细实现流程示意图;FIG. 2 is a detailed implementation flowchart of S103 in FIG. 1 provided in Embodiment 2 of the present invention; FIG.
图3为本发明实施例二提供的荧光探针交替发光的示意图;3 is a schematic diagram of alternate light emission of a fluorescent probe provided in Embodiment 2 of the present invention;
图4为本发明实施例三提供的图1中S104的详细实现流程示意图;FIG. 4 is a detailed implementation flowchart of S104 in FIG. 1 provided in Embodiment 3 of the present invention; FIG.
图5为实现图2中步骤的装置示意图;5 is a schematic diagram of a device for implementing the steps in FIG. 2;
图6为本发明实施例四提供的超分辨成像方法的实现效果图;FIG. 6 is an implementation effect diagram of a super-resolution imaging method provided by Embodiment 4 of the present invention; FIG.
图7为本发明实施例六提供的超分辨成像装置的结构示意图。FIG. 7 is a schematic structural diagram of a super-resolution imaging device provided by Embodiment 6 of the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。。The realization of the purpose, functional characteristics and advantages of the present invention will be further explained with reference to the embodiments and the drawings. .
实施该发明的最佳实施例The best embodiment for carrying out the invention
本发明的最佳实施方式Best Mode of the Invention
实施例一Example one
如图1所示,本发明实施例提供了一种超分辨成像方法,可以应用于光学重构显微镜的超分辨定位成像中,其包括:As shown in FIG. 1, an embodiment of the present invention provides a super-resolution imaging method, which can be applied to super-resolution positioning imaging of an optical reconstruction microscope, which includes:
S101、通过激发光,激发生物样品上具有双发射峰的荧光探针,并将亲和试剂作用于激发后的荧光探针上。S101. Exciting a fluorescent probe having a double emission peak on a biological sample through excitation light, and applying an affinity reagent to the excited fluorescent probe.
上述步骤S101中,具有双发射峰的荧光探针被激发后,荧光探针的荧光发射光谱中将显示两个发射峰,即短波长发射峰和长波长发射峰。In the above step S101, after the fluorescent probe having dual emission peaks is excited, two emission peaks will be displayed in the fluorescent emission spectrum of the fluorescent probe, that is, a short-wavelength emission peak and a long-wavelength emission peak.
在具体应用中,激发光作用于生物样品之前,还应经过光学处理元件,如透镜、视场光阑、管镜、物镜等,以使激发光能够均匀地、集中地照射在生物样品上,从而激发荧光探针。In specific applications, before the excitation light acts on the biological sample, it should also pass through optical processing elements, such as lenses, field diaphragms, tube lenses, objective lenses, etc., so that the excitation light can be uniformly and concentratedly illuminated on the biological sample. Thereby, the fluorescent probe is excited.
S102、通过活化光,照射亲和试剂作用后的荧光探针,形成双通道荧光强度图像。S102. A dual-channel fluorescence intensity image is formed by irradiating the fluorescent probe after the action of the affinity reagent with activating light.
上述步骤S102中,亲和试剂不与探针结合,当亲和试剂覆盖荧光探针中的结构时,此结构不发光,当亲和试剂从此结构上脱落时,此结构重新具备发光能力。In the above step S102, the affinity reagent is not bound to the probe. When the affinity reagent covers the structure in the fluorescent probe, the structure does not emit light, and when the affinity reagent falls off the structure, the structure has the light-emitting ability again.
在本发明实施例中,亲和试剂具有可逆性,即在一定条件下,亲和试剂能够在荧光探针中的结构间转移。In the embodiment of the present invention, the affinity reagent is reversible, that is, under certain conditions, the affinity reagent can be transferred between the structures in the fluorescent probe.
在具体应用中,活化光与激发光可以具有相同的频率,也可以具有不同的频率,在本发明实施例中不对其作具体限定。In specific applications, the activation light and the excitation light may have the same frequency or different frequencies, which are not specifically limited in the embodiments of the present invention.
S103、分别采集所述双通道荧光强度图像中,短波长发射峰的短波长信号和长波长发射峰的长波长信号。S103. Collect a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image, respectively.
上述步骤S103中,由于试剂作用后的荧光探针仍是具有双发射峰的荧光探针,因此步骤S103中所获得的荧光发射光谱仍具有双发射峰。而当活化光照射亲和 试剂作用后的荧光探针时,可以使亲和试剂从荧光探针中的一个结构转移到荧光探针中的另一个结构,两个结构将交替发光;因此从交替发光的结构,所得到的荧光发射光谱中,能够分别获得短波长发射峰的短波长信号和长波长发射峰的长波长信号。In the above step S103, since the fluorescent probe after the action of the reagent is still a fluorescent probe having a double emission peak, the fluorescence emission spectrum obtained in step S103 still has a double emission peak. When activating light irradiates the fluorescent probe after the action of the affinity reagent, the affinity reagent can be transferred from one structure in the fluorescent probe to the other structure in the fluorescent probe, and the two structures will emit light alternately; In the light-emitting structure, a short-wavelength signal with a short-wavelength emission peak and a long-wavelength signal with a long-wavelength emission peak can be obtained in the obtained fluorescence emission spectrum.
在具体应用中,采集荧光发射光谱中的信号可以通过任意的光谱分析仪器或光学元器件组合实现,例如EMCCD,本发明实施例中不对其做具体限定。In specific applications, collecting signals in the fluorescence emission spectrum can be achieved by any spectral analysis instrument or a combination of optical components, such as EMCCD, which is not specifically limited in the embodiments of the present invention.
S104、选择N帧双通道荧光强度图像,根据所述分别采集的所述短波长信号和所述长波长信号,在同一帧的所述双通道荧光强度图像中,选择所述短波长信号的荧光强度图像和所述长波长信号的荧光强度图像,并分别计算其荧光强度比值,获得N个比例荧光图像,其中N为正整数。S104. Select an N-frame dual-channel fluorescence intensity image, and select the fluorescence of the short-wavelength signal in the dual-channel fluorescence intensity image of the same frame according to the separately acquired short-wavelength signal and the long-wavelength signal. The intensity image and the fluorescence intensity image of the long-wavelength signal, and the fluorescence intensity ratios thereof are calculated respectively to obtain N proportional fluorescence images, where N is a positive integer.
上述步骤S104中,选择同一帧的双通道荧光强度图像中,短波长信号和长波长信号所对应的荧光强度图像,并分别计算其荧光强度比值,获得N个比例荧光图像,相当于在一段时间内连续记录了荧光探针闪烁的多帧图像,第N个比例荧光图像为第N帧双通道荧光强度图像,其可以反映时间相同的短波长信号和长波长信号所对应的荧光强度图像,而第N个比例荧光图像与第N+1个比例荧光图像,可为相邻的两帧图像,也可为不相邻的两帧图像。In the above step S104, in the two-channel fluorescence intensity image of the same frame, the fluorescence intensity images corresponding to the short-wavelength signal and the long-wavelength signal are selected, and the fluorescence intensity ratios thereof are calculated to obtain N ratio fluorescence images, which is equivalent to a period of time. Multi-frame images of fluorescence probe flicker are continuously recorded inside, and the N-th proportional fluorescence image is the N-th dual-channel fluorescence intensity image, which can reflect the fluorescence intensity images corresponding to the short-wavelength signal and the long-wavelength signal at the same time, and The N-th ratio fluorescence image and the N + 1-th ratio fluorescence image may be two adjacent frames of images or two non-adjacent frames of images.
本发明实施例还提出了上述步骤S104中计算荧光强度比值的详细实现步骤,其包括:The embodiment of the present invention also provides detailed implementation steps for calculating the fluorescence intensity ratio in the above step S104, which includes:
根据所述双通道荧光强度图像和所述分别采集的短波长信号,选择所述第N个所述短波长信号的荧光强度图像,计算其发射峰荧光强度;Selecting the N-th fluorescence intensity image of the short-wavelength signal according to the dual-channel fluorescence intensity image and the separately collected short-wavelength signal, and calculating the emission peak fluorescence intensity thereof;
根据所述双通道荧光强度图像和所述分别采集的长波长信号,选择所述第N个所述长波长信号的荧光强度图像,计算其发射峰荧光强度;Selecting the Nth long-wavelength signal fluorescence intensity image according to the two-channel fluorescence intensity image and the separately acquired long-wavelength signal, and calculating the emission peak fluorescence intensity thereof;
计算所述荧光强度比值的计算公式为:The calculation formula for calculating the fluorescence intensity ratio is:
Figure dest_path_image002
Figure dest_path_image002
,
其中,IBN为所述长波长信号的发射峰荧光强度,IAN为所述短波长信号的发射峰荧光强度。Wherein, IBN is the emission peak fluorescence intensity of the long-wavelength signal, and IAN is the emission peak fluorescence intensity of the short-wavelength signal.
在具体应用中,需要以较大数量的比例荧光图像(例如1000个的比例荧光图像),作为图像重构的基础。In specific applications, a larger number of proportional fluorescent images (for example, 1,000 proportional fluorescent images) are needed as a basis for image reconstruction.
本发明实施例还提供一种超分辨成像方法,用于建立所述荧光探针的环境参数与所述荧光强度比值的函数模型;An embodiment of the present invention further provides a super-resolution imaging method for establishing a function model of the environmental parameter of the fluorescent probe and the ratio of the fluorescent intensity;
所述建立所述荧光探针环境参数与所述荧光强度比值的函数模型包括:The establishing a function model of the environmental parameter of the fluorescent probe and the ratio of the fluorescent intensity includes:
将所述具有双发射峰的荧光探针置于探针溶液测试环境,通过激发光,激发所述荧光探针;Placing the fluorescent probe with a double emission peak in a probe solution test environment, and exciting the fluorescent probe through excitation light;
改变所述探针溶液测试环境的第一参数,获取在不同的所述第一参数下,所述荧光探针的稳态荧光发射光谱;Changing a first parameter of the test environment of the probe solution to obtain a steady-state fluorescence emission spectrum of the fluorescent probe under different first parameters;
根据所述稳态荧光发射光谱中的双发射峰,计算荧光强度测试比值,并建立所述第一参数与所述荧光强度测试比值的函数模型。According to the double emission peak in the steady-state fluorescence emission spectrum, a fluorescence intensity test ratio is calculated, and a function model of the first parameter and the fluorescence intensity test ratio is established.
在具体应用中,第一参数与所述荧光强度测试比值的函数模型,即荧光强度比值与生物样品中荧光探针标记处的样品参数的对应关系;例如,若第一参数为溶液浓度,则将此探针作用于包括溶液的生物样品中时,荧光强度比值可以反映生物样品的探针标记处的溶液浓度。In specific applications, a function model of the first parameter and the fluorescence intensity test ratio, that is, the correspondence between the fluorescence intensity ratio and the sample parameter at the fluorescent probe label in the biological sample; for example, if the first parameter is the solution concentration, then When this probe is applied to a biological sample including a solution, the fluorescence intensity ratio can reflect the concentration of the solution at the probe mark of the biological sample.
S105、通过STORM(Stochastic Optical Reconstruction Microscopy,随机光学重构显微镜)超分辨成像方法,对所述比例荧光图像进行重构,获得超分辨图像。S105. Reconstruct the proportional fluorescence image by using a STORM (Stochastic Optical Reconstruction Microscopy) method to obtain a super-resolution image.
在具体应用中,STORM超分辨成像方法即通过随机光学重构显微镜,连续记录荧光分子的多帧图像,进行单分子定位算法确定中心位置,最后通过图像重构出超分辨荧光图像。In specific applications, the STORM super-resolution imaging method uses a random optical reconstruction microscope to continuously record multiple frames of fluorescent molecules, performs a single-molecule positioning algorithm to determine the center position, and finally reconstructs a super-resolution fluorescent image from the image.
S106、根据N个所述比例荧光图像对所述超分辨图像着色,获得比例型超分辨图像。S106. Color the super-resolution image according to the N fluorescence images to obtain a proportional super-resolution image.
本发明实施例提出的超分辨成像方法,使用具有双发射峰的荧光探针,对生物样品进行标记,激发荧光探针后通过STORM超分辨成像方法重构出超分辨图像,由于荧光探针在激发后能够产生具有双发射峰的荧光信号,即具有短波长发射峰的短波长信号和具有长波长发射峰的长波长信号,因此通过亲核剂和活化光作用于此荧光探针时能够形成双通道荧光强度图像,然后通过光信号采集装 置分别收集,具有短波长发射峰的短波长信号和具有长波长发射峰的长波长信号,根据同一时刻的双通道荧光强度图像,可以计算短波长信号和具有长波长信号发射峰的荧光强度比值,获得比例荧光图像,最终根据比例荧光图像对超分辨图像着色,获得比例型超分辨图像。通过本发明实施例提出的超分辨成像方法而获得的比例型超分辨图像,不仅可以反映生物样品的结构,还可以通过荧光强度比值反映生物样品中荧光探针标记处的样品参数,从而能够根据样品参数,分析生物样品的功能。The super-resolution imaging method proposed in the embodiment of the present invention uses a fluorescent probe with dual emission peaks to label a biological sample. After exciting the fluorescent probe, a super-resolution image is reconstructed by the STORM super-resolution imaging method. After excitation, it can generate a fluorescent signal with double emission peaks, that is, a short-wavelength signal with a short-wavelength emission peak and a long-wavelength signal with a long-wavelength emission peak. Therefore, it can be formed when a nucleophile and an activating light act on this fluorescent probe The two-channel fluorescence intensity image is then collected separately by the optical signal acquisition device. The short-wavelength signal with a short-wavelength emission peak and the long-wavelength signal with a long-wavelength emission peak can be calculated from the two-channel fluorescence intensity image at the same time And the ratio of the fluorescence intensity with a long-wavelength signal emission peak to obtain a proportional fluorescence image. Finally, the super-resolution image is colored according to the proportional fluorescence image to obtain a proportional-type super-resolution image. The proportional super-resolution image obtained by the super-resolution imaging method provided by the embodiment of the present invention can not only reflect the structure of the biological sample, but also reflect the sample parameters at the fluorescent probe mark in the biological sample by the ratio of the fluorescence intensity, so that it can be based on Sample parameters, functions for analyzing biological samples.
发明实施例Invention Examples
本发明的实施方式Embodiments of the invention
实施例二Example two
如图2所示,本发明实施例示例性的示出了上述实施例一中S102的一种详细实现流程,其中,步骤S102为:As shown in FIG. 2, an embodiment of the present invention exemplarily shows a detailed implementation process of S102 in the first embodiment, where step S102 is:
S102、通过活化光,照射亲和试剂作用后的荧光探针,获得双通道荧光强度图像。S102. A dual-channel fluorescence intensity image is obtained by irradiating the fluorescent probe after the action of the affinity reagent with activating light.
其详细实现流程包括:The detailed implementation process includes:
S1021、根据所述荧光探针中的第一结构,获得所述短波长信号。S1021. Obtain the short-wavelength signal according to a first structure in the fluorescent probe.
S1022、根据所述荧光探针中的第二结构,获得所述长波长信号。S1022. Obtain the long-wavelength signal according to a second structure in the fluorescent probe.
上述步骤S1021和步骤S1022中,由活化光的波长与激发光的波长相同,其中,短波长发射峰由探针中第一结构所致,长波长发射峰由探针中第二结构所致,且两个发射峰的荧光发射光谱不完全重叠。In the above steps S1021 and S1022, the wavelength of the activation light is the same as the wavelength of the excitation light, wherein the short-wavelength emission peak is caused by the first structure in the probe, and the long-wavelength emission peak is caused by the second structure in the probe. And the fluorescence emission spectra of the two emission peaks do not completely overlap.
S1023、所述激发光照射所述荧光探针时,所述第一结构或第二结构发射荧光。S1023. When the excitation light irradiates the fluorescent probe, the first structure or the second structure emits fluorescence.
S1024、所述活化光作用于所述亲和试剂作用后的荧光探针时,所述第一结构和所述第二结构根据与所述亲和试剂的结合状态交替发光,形成所述双通道荧光强度图像。S1024. When the activating light acts on the fluorescent probe after the affinity reagent acts, the first structure and the second structure alternately emit light according to a binding state with the affinity reagent to form the dual channel. Image of fluorescence intensity.
上述步骤S1023和步骤S1024中,在激光照射荧光探针的情况下,荧光探针中的第一结构和第二结构均有可能吸收激发光能量跃迁到激发态在发射荧光,即激光照射荧光探针时,可以是第一结构发射荧光,也可以是第二结构发射荧光。In the above steps S1023 and S1024, when the fluorescent probe is irradiated with the laser, both the first structure and the second structure in the fluorescent probe may absorb the excitation light energy and transition to the excited state to emit fluorescence, that is, the laser irradiates the fluorescent probe. In the case of needles, the first structure may emit fluorescence or the second structure may emit fluorescence.
在本发明实施例中,若激发光照射后,其中一个荧光探针的第一结构发射荧光,则第一结构为能量受体,第二结构为能量供体;此时能量供体向能量受体提供能量,使得能量受体发射荧光,能量供体因失去能量发微弱荧光;而通过活化光,照射此亲和试剂作用后的荧光探针时,能量供体不再向能量受体提供能量,使得能量受体不发射荧光,能量供体因不失去能量发射荧光。由于亲和试剂与荧光探针结合的随机性,使得生物样品中,各荧光探针第一结构和第二结构发射荧光也具有随机性。In the embodiment of the present invention, if the first structure of one of the fluorescent probes emits fluorescence after the excitation light is irradiated, the first structure is an energy acceptor and the second structure is an energy donor; The energy provided by the body causes the energy acceptor to emit fluorescence, and the energy donor emits weak fluorescence due to the loss of energy. When the light is illuminated by the fluorescent probe after the affinity reagent is activated, the energy donor no longer provides energy to the energy acceptor. So that the energy acceptor does not emit fluorescence, and the energy donor emits fluorescence because it does not lose energy. Due to the randomness of the binding of the affinity reagent and the fluorescent probe, in the biological sample, the fluorescence emitted by the first structure and the second structure of each fluorescent probe is also random.
如图3所示,是本发明实施例提供的荧光探针交替发光的示意图。首先,激发光照射后能量受体发光;在亲和试剂不与荧光探针结合时,能量受体不再吸收能量供体和激发光的能量,不再发射荧光,由于亲和试剂的可逆性,且在活化光的照射下,能量供体逆向的吸收活化光能量发射荧光,然后在此基础上,随机循环,达到荧光探针交替发光的目的。As shown in FIG. 3, it is a schematic diagram of alternately emitting light by a fluorescent probe provided by an embodiment of the present invention. First, the energy receptor emits light after the excitation light is irradiated; when the affinity reagent is not bound to the fluorescent probe, the energy receptor no longer absorbs the energy of the energy donor and the excitation light, and no longer emits fluorescence, due to the reversibility of the affinity reagent And, under the irradiation of activation light, the energy donor reversely absorbs the activation light energy to emit fluorescence, and then based on this, it randomly circulates to achieve the purpose of the fluorescent probe to alternately emit light.
在本发明实施例中,上述步骤S1021至步骤S1024所述的双通道荧光强度图像,包括短波长信号的荧光强度图像和长波长信号的荧光强度图像;所述短波长信号的荧光强度图像,对应所述荧光探针中的第一结构的发光过程;所述长波长信号的荧光强度图像,对应所述荧光探针中的第二结构的发光过程。In the embodiment of the present invention, the two-channel fluorescence intensity images described in the above steps S1021 to S1024 include a fluorescence intensity image of a short wavelength signal and a fluorescence intensity image of a long wavelength signal; the fluorescence intensity image of the short wavelength signal corresponds to The light emission process of the first structure in the fluorescent probe; the fluorescence intensity image of the long-wavelength signal corresponds to the light emission process of the second structure in the fluorescent probe.
本发明实施例提出的超分辨成像方法,利用具有双发射峰的荧光探针对生物样品进行标记,在活化光照射和亲和试剂可逆作用下,使生物样品中单个荧光探针分子随机交替发射两个不同波长的荧光。The super-resolution imaging method proposed in the embodiment of the present invention uses a fluorescent probe with dual emission peaks to label a biological sample, and under the action of activating light irradiation and the reversible action of an affinity reagent, a single fluorescent probe molecule in the biological sample emits two randomly alternately. Different wavelengths of fluorescence.
实施例三Example three
如图4所示,本发明实施例示例性的示出了上述实施例一中步骤S103的一种详细实现流程,其中,步骤S103为:As shown in FIG. 4, an embodiment of the present invention exemplarily illustrates a detailed implementation process of step S103 in the foregoing first embodiment, where step S103 is:
S103、分别采集所述双通道荧光强度图像中,短波长发射峰的短波长信号和长波长发射峰的长波长信号。S103. Collect a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image, respectively.
其详细实现流程包括:The detailed implementation process includes:
S1031、通过第一双色镜将所述激发光与所述短波长信号和所述长波长信号分离。S1031. Separate the excitation light from the short-wavelength signal and the long-wavelength signal through a first dichroic mirror.
上述步骤S1031中,双色镜对一定波长的光几乎完全透过,而对另一些波长的 光几乎完全反射。In the above step S1031, the dichroic mirror almost completely transmits light of a certain wavelength and almost completely reflects light of other wavelengths.
在具体应用中,激发光作用于生物样品后,生物样品上的荧光探针所发射的光线中包括短波长信号、长波长信号以及少数的激发光,因此通过第一双色镜将激发光与短波长信号和长波长信号分离。In specific applications, after the excitation light acts on the biological sample, the light emitted by the fluorescent probe on the biological sample includes a short-wavelength signal, a long-wavelength signal, and a small amount of excitation light. Wavelength signals are separated from long-wavelength signals.
S1032、通过第二双色镜将所述短波长信号和所述长波长信号分离后,所述短波长信号经过第一滤波器发送至反射镜,所述反射镜将所述滤波后的短波长信号传输至第一EMCCD(ElectBon-MultiplyinA CCD,电子倍增CCD);所述长波长信号经过第二滤波器,所述滤波后的长波长信号传输至所述第一EMCCD。S1032. After the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror separates the filtered short-wavelength signal. Transmitting to a first EMCCD (ElectBon-MultiplyinACCD); the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to the first EMCCD.
上述步骤S1032中,同样通过双色镜分离光波信号,同时将分离后的短波长信号和长波长信号经滤波器滤波后发送至同一EMCCD中。In the above step S1032, the light wave signal is also separated by a dichroic mirror, and the separated short-wavelength signal and long-wavelength signal are filtered by a filter and sent to the same EMCCD.
在具体应用中,单发射波长容易受环境噪声干扰,会造成成像结果中系统噪声比例增加、重构图像模糊等结果,为避免或减轻这种影响,后期结果处理时要进行算法降噪,因此在图像重构之前,对其做滤波处理能够简化基于光学重构显微镜的超分辨成像方法中的后期算法处理。In specific applications, single emission wavelengths are susceptible to environmental noise interference, which will result in an increase in the proportion of system noise in the imaging results and blurring of reconstructed images. To avoid or mitigate this effect, algorithmic noise reduction is required during subsequent results processing. Before image reconstruction, filtering it can simplify the post-processing algorithm in the super-resolution imaging method based on optical reconstruction microscope.
S1033、所述第一EMCCD的不同区域分别接收所述滤波后的短波长信号和所述滤波后的长波长信号,从而收集所述双通道荧光强度图像。S1033. Different regions of the first EMCCD receive the filtered short-wavelength signal and the filtered long-wavelength signal, respectively, so as to collect the dual-channel fluorescence intensity image.
上述步骤S1033中,短波长信号或长波长信号的尺寸应小于EMCCD的最大像素尺寸;例如假如EMCCD的最大像素尺寸为512*512,则所采集的短波长信号或长波长信号的像素尺寸不应大于256*256。In step S1033, the size of the short-wavelength signal or the long-wavelength signal should be smaller than the maximum pixel size of the EMCCD; More than 256 * 256.
在具体应用中,使用一个EMCCD的不同区域分别接收光路信号则不需要同步控制。In specific applications, the use of different areas of an EMCCD to receive optical path signals separately does not require synchronous control.
如图5所示,本发明实施例还给出了实现上述步骤S1031至步骤S1032的装置结构示意图。As shown in FIG. 5, an embodiment of the present invention also provides a schematic structural diagram of a device for implementing steps S1031 to S1032.
其附图标记如下:51.激光器;52.透镜组;53.视场光阑;54.管镜;55.生物样品;56.物镜;57.第一双色镜;58.反射镜;59.第二双色镜;510.第一滤波器;511.第二滤波器;512.EMCCD。The reference numerals are as follows: 51. laser; 52. lens group; 53. field diaphragm; 54. tube mirror; 55. biological sample; 56. objective lens; 57. first dichroic mirror; 58. reflector; 59. Second dichroic mirror; 510. first filter; 511. second filter; 512. EMCCD.
在本发明实施例中,透镜组用于会聚或发散光束;视场光阑用于对光束大小进行适当调节。In the embodiment of the present invention, the lens group is used to converge or diverge the light beam; the field diaphragm is used to appropriately adjust the beam size.
在本发明实施例中,还可以使用两个相同的EMCCD分别接收短波长信号和长波长信号,其详细实现流程如下:In the embodiment of the present invention, two identical EMCCDs can also be used to receive the short-wavelength signal and the long-wavelength signal, respectively. The detailed implementation process is as follows:
通过第一双色镜将所述激发光与所述短波长信号和所述长波长信号分离;Separating the excitation light from the short-wavelength signal and the long-wavelength signal through a first dichroic mirror;
通过第二双色镜将所述短波长信号和所述长波长信号分离后,所述短波长信号经过第一滤波器发送至反射镜,所述反射镜将所述滤波后的短波长信号传输至第一EMCCD;所述长波长信号经过第二滤波器,所述滤波后的长波长信号传输至第二EMCCD;After the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror transmits the filtered short-wavelength signal to A first EMCCD; the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to a second EMCCD;
所述第一EMCCD和所述第二EMCCD分别接收所述滤波后的短波长信号和所述滤波后的长波长信号,从而收集所述双通道荧光强度图像。The first EMCCD and the second EMCCD respectively receive the filtered short-wavelength signal and the filtered long-wavelength signal, thereby collecting the dual-channel fluorescence intensity image.
在具体应用中,使用两个相同的EMCCD在相同条件下分别对两路信号光进行采集,能实现更大像素区域的数据采集,但对两EMCCD的高度同步提出了要求,需要进行同步控制。In specific applications, using two identical EMCCDs to separately collect two signal lights under the same conditions can achieve data collection in a larger pixel area, but the requirements for the high synchronization of the two EMCCDs require synchronous control.
本发明实施例提出的超分辨成像方法,在双色镜将信号光分离成两路之后,分别经过滤波器滤除部分杂散光,再通过EMCCD对两路信号光进行采集,从而提高生物样品抗噪声、抗环境介质不均匀及抗系统不稳定性的能力,提高成像信噪比,简化了后期数据处理的过程。In the super-resolution imaging method provided by the embodiment of the present invention, after the signal light is separated into two channels by a dichroic mirror, part of the stray light is filtered by a filter, and then the two signal lights are collected by EMCCD, thereby improving the anti-noise of biological samples The ability to resist environmental media inhomogeneity and system instability, improve imaging signal-to-noise ratio, and simplify the process of later data processing.
实施例四Embodiment 4
本发明实施例对实施例一至实施例三所提供的超分辨成像方法的实现流程进行示例性的说明。The embodiment of the present invention exemplarily describes the implementation process of the super-resolution imaging methods provided in the first to third embodiments.
如图6所示,在分别采集短波长发射峰的短波长信号和长波长发射峰的长波长信号后,需根据此两路信号进行数据处理,获得比例荧光图像。其数据处理过程可以通过图6表示,其中IB+IA表示为未分离的长波长信号和短波长信号,经过实施例三所提供的超分辨成像方法,分别采集后分离为光长波长信号IB和短波长信号IA;采集完成后,进行发射峰荧光强度比值计算时,再将同一时刻下的两路信号荧光强度图作比值,即
Figure dest_path_image003
,得到比例荧光图像,最后将大量的比例图进行算法重构得到超分辨图像并以伪彩色对标记点着色,获得比例型超分辨图像,其中,不同颜色代表比
Figure dest_path_image004
值的大小。
As shown in FIG. 6, after a short-wavelength signal with a short-wavelength emission peak and a long-wavelength signal with a long-wavelength emission peak are separately collected, data processing is performed based on the two signals to obtain a proportional fluorescence image. The data processing process can be represented by FIG. 6, where IB + IA is expressed as an unseparated long-wavelength signal and a short-wavelength signal. After the super-resolution imaging method provided in the third embodiment, the data are separated into optical long-wavelength signals IB and Short-wavelength signal IA; when the fluorescence intensity ratio of emission peaks is calculated after the acquisition is completed, the fluorescence intensity map of the two signals at the same time is used as the ratio, that is,
Figure dest_path_image003
To obtain a proportional fluorescence image, and finally reconstruct a large number of proportional images by algorithm to obtain a super-resolution image and color the marked points with pseudo color to obtain a proportional-type super-resolution image, in which different colors represent the ratio
Figure dest_path_image004
The size of the value.
实施例五Example 5
本发明实施例对实施例一至实施例三所提供的超分辨成像方法的实际应用进行示例性的说明。以表现比例型超分辨图像在实际应用中如何反映生物样品中荧光探针标记处的样品参数,从而根据样品参数,分析生物样品的功能。The embodiment of the present invention exemplarily illustrates the practical application of the super-resolution imaging methods provided in the first to third embodiments. In the practical application, how to reflect the ratio of the sample parameters at the fluorescent probe markers in the biological sample to the proportional super-resolution image is used to analyze the function of the biological sample according to the sample parameters.
本发明实施例提出一种,使用上述实施例一至实施例四所提供的超分辨成像方法,实现被标记样品微环境粘度值定量研究的超分辨成像的实例。The embodiment of the present invention provides an example of super-resolution imaging using the super-resolution imaging methods provided in the first to fourth embodiments to realize a quantitative study of the microenvironment viscosity value of a labeled sample.
本发明实施例中,所提供的荧光探针为对粘度敏感的荧光探针,当环境粘度发生改变时,其稳态发射光谱也会相应的发生改变。短波长发射峰由探针中结构A所致,长波长发射峰由探针中结构B所致,且两个荧光发射光谱不存在重叠区域,IB为结构B发射峰荧光强度,IA为结构A发射峰荧光强度。In the embodiment of the present invention, the fluorescent probe provided is a viscosity-sensitive fluorescent probe. When the environmental viscosity changes, the steady-state emission spectrum also changes accordingly. The short-wavelength emission peak is caused by the structure A in the probe, the long-wavelength emission peak is caused by the structure B in the probe, and there is no overlap region between the two fluorescence emission spectra, IB is the fluorescence intensity of the emission peak of structure B, and IA is the structure A Emission peak fluorescence intensity.
在具体应用中,先构建IB/IA的值相对于粘度的函数关系式,即测量荧光探针在不同粘度溶液中的稳态发射光谱,将不同粘度下的稳态光谱分别进行IB/IA处理,得到不同粘度下IB/IA的值,再将各比例点值作图并进行线性或非线性函数拟合,得到IB/IA相对于粘度的拟合函数关系式。In specific applications, first construct a function of IB / IA as a function of viscosity, that is, measure the steady-state emission spectra of fluorescent probes in different viscosity solutions, and separately process the steady-state spectra at different viscosities with IB / IA. , Get the value of IB / IA under different viscosities, and then plot the value of each proportional point and fit a linear or non-linear function to get the fitting function relationship formula of IB / IA to viscosity.
在实际应用中,使用荧光探针对生物样品进行标记,使用激光进行激发,并在超分辨成像系统中进行成像,获得大量比例荧光图像。后期数据处理时,先将每一帧双通道比例荧光图像IB与IA做比值,然后将大量荧光强度比值图像进行算法重构,得到被标记生物体结构的超分辨图像,并以伪彩色对被标记结构每个像素着色,图像中每个像素点的值即IB/IA的值,不同颜色代表IB/IA比值的大小,而IB/IA比值的大小可以在溶液测试结果的拟合函数关系式中对应的找到不同比值下的粘度值,即伪彩色的差异代表微环境中粘度值的分布差异,同时重构出的超分辨图像所显示的是被标记结构的超精细结构图,最终实现微环境粘度值定量研究的超分辨成像。In practical applications, fluorescent probes are used to label biological samples, lasers are used for excitation, and imaging is performed in a super-resolution imaging system to obtain a large number of proportional fluorescent images. In the later data processing, the ratio of the two-channel proportional fluorescence image IB to IA is firstly calculated for each frame, and then a large number of fluorescence intensity ratio images are algorithmically reconstructed to obtain a super-resolution image of the structure of the labeled organism, and the pseudo-color pairs are used to Each pixel of the marker structure is colored. The value of each pixel in the image is the value of IB / IA. Different colors represent the size of the IB / IA ratio, and the size of the IB / IA ratio can be expressed in the fitting function relationship of the solution test result. Correspondingly, the viscosity values under different ratios are found, that is, the difference in pseudo-colors represents the difference in the distribution of viscosity values in the microenvironment. At the same time, the reconstructed super-resolution image shows an ultra-fine structure diagram of the labeled structure. Super-resolution Imaging for Quantitative Study of Ambient Viscosity Values.
本发明实施例还提出一种,使用上述实施例一至实施例三所提供的超分辨成像方法,实现被标记样品线粒体膜蛋白定量研究的超分辨成像的实例。The embodiment of the present invention also provides an example of super-resolution imaging using the super-resolution imaging methods provided in the first to third embodiments to realize the quantitative study of the mitochondrial membrane protein of the labeled sample.
本发明实施例中,所提供的荧光探针为可特异性标记线粒体膜蛋白的荧光探针,进行溶液或生物测试时,环境中膜蛋白与探针特异结合后,其稳态发射光谱也会相应的发生改变。短波长发射峰由探针中结构A所致,长波长发射峰由探针中结构B所致,且两个荧光发射光谱不存在严重重叠区域,避免二者荧光发射产生窜扰,IB为结构B发射峰荧光强度,IA为结构A发射峰荧光强度。In the embodiment of the present invention, the fluorescent probe provided is a fluorescent probe that can specifically label mitochondrial membrane proteins. When a solution or a biological test is performed, after the membrane protein and the probe specifically bind in the environment, the steady-state emission spectrum will also be Corresponding changes. The short-wavelength emission peak is caused by the structure A in the probe, and the long-wavelength emission peak is caused by the structure B in the probe. There is no serious overlap region between the two fluorescence emission spectra to avoid crosstalk between the two fluorescence emission. IB is the structure B. Emission peak fluorescence intensity, IA is the fluorescence intensity of emission peak of structure A.
在具体应用在,先构建IB/IA的值相对于线粒体膜蛋白含量或浓度的函数关系式,即测量荧光探针2在不同线粒体膜蛋白含量或浓度的溶液中的稳态发射光谱,将不同含量或浓度下的稳态光谱分别进行IB/IA处理,得到不同线粒体膜蛋白含量或浓度下IB/IA的值,再将比例值对含量或浓度作图并进行线性或非线性函数拟合,得到IB/IA相对于线粒体膜蛋白含量或浓度的拟合函数关系式。In specific applications, first construct a function equation of the value of IB / IA with respect to the content or concentration of mitochondrial membrane protein, that is, measure the steady-state emission spectra of fluorescent probe 2 in solutions with different mitochondrial membrane protein content or concentration. The IB / IA treatment is performed on the steady-state spectrum at the content or concentration, respectively, to obtain the value of IB / IA at different mitochondrial membrane protein content or concentration, and then the proportional value is plotted against the content or concentration and fitted with a linear or non-linear function. The fitted function relationship of IB / IA to mitochondrial membrane protein content or concentration was obtained.
在实际应用中,使用荧光探针对生物体线粒体膜蛋白进行标记,使用激发光进行激发,并在超分辨成像系统中进行成像,获得大量比例荧光图像。后期数据处理时,先将每一帧双通道荧光强度图像IB与IA做比值,然后将大量比例荧光图像进行算法重构,得到被标记生物体结构的超分辨图像,并以伪彩色对被标记结构每个像素着色,图像中每个像素点的值即IB/IA的值,不同颜色代表IB/IA比值的大小,而IB/IA比值的大小可以在溶液测试结果的拟合函数关系式中对应的找到不同比值下的蛋白质含量值,即伪彩色的差异代表微环境中蛋白质含量值的分布差异,同时重构出的超分辨图像所显示的是被标记结构的超精细结构图,最终实现线粒体膜蛋白含量值定量研究的超分辨成像。In practical applications, fluorescent probes are used to label biological mitochondrial membrane proteins, excitation is performed using excitation light, and imaging is performed in a super-resolution imaging system to obtain a large number of fluorescent images. In the later data processing, the ratio of each frame of the two-channel fluorescence intensity image IB to IA is firstly compared, and then a large number of proportional fluorescence images are reconstructed by algorithm to obtain a super-resolution image of the structure of the labeled organism, and the labels are marked in pseudo-color. Each pixel of the structure is colored. The value of each pixel in the image is the value of IB / IA. Different colors represent the size of the IB / IA ratio, and the size of the IB / IA ratio can be in the fitting function relationship of the solution test result. Correspondingly find the protein content value at different ratios, that is, the difference in pseudo-colors represents the difference in the distribution of the protein content value in the microenvironment. At the same time, the reconstructed super-resolution image shows an ultra-fine structure map of the labeled structure. Super-resolution Imaging of Quantitative Study of Mitochondrial Membrane Protein Content Values
实施例六Example Six
如图7所示,本发明实施例提供了一种超分辨成像装置70,包括:As shown in FIG. 7, an embodiment of the present invention provides a super-resolution imaging device 70, including:
激发模块71,用于通过激发光,激发生物样品上具有双发射峰的荧光探针,并将亲和试剂作用于激发后的荧光探针上;An excitation module 71, configured to excite a fluorescent probe having a double emission peak on a biological sample through excitation light, and apply an affinity reagent to the excited fluorescent probe;
荧光强度图像获取模块72,用于通过活化光,照射亲和试剂作用后的荧光探针,获得双通道荧光强度图像;A fluorescence intensity image acquisition module 72, configured to obtain a dual-channel fluorescence intensity image by activating light and irradiating a fluorescent probe after the action of an affinity reagent;
信号采集模块73,用于分别采集所述双通道荧光强度图像中,短波长发射峰的 短波长信号和长波长发射峰的长波长信号;A signal acquisition module 73, configured to separately acquire a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image;
比例荧光图像计算模块74,用于选择N帧双通道荧光强度图像,根据所述分别采集的所述短波长信号和所述长波长信号,在同一帧的所述双通道荧光强度图像中,选择所述短波长信号的荧光强度图像和所述长波长信号的荧光强度图像,并分别计算其荧光强度比值,获得N个比例荧光图像,其中N为正整数,其中N为正整数;A proportional fluorescence image calculation module 74 is configured to select N frames of two-channel fluorescence intensity images, and select the two-channel fluorescence intensity images in the same frame according to the separately acquired short-wavelength signals and the long-wavelength signals. Calculate the fluorescence intensity ratio of the short-wavelength signal fluorescence image and the long-wavelength signal fluorescence intensity image, respectively, to obtain N proportional fluorescence images, where N is a positive integer, where N is a positive integer;
图像重构模块75,用于通过STORM超分辨成像方法,对所述比例荧光图像进行重构,获得超分辨图像;An image reconstruction module 75, configured to reconstruct the proportional fluorescence image by using a STORM super-resolution imaging method to obtain a super-resolution image;
图像获取模块76,用于根据N个所述比例荧光图像对所述超分辨图像着色,获得比例型超分辨图像。An image acquisition module 76 is configured to color the super-resolution image according to N number of the proportional fluorescence images to obtain a proportional-type super-resolution image.
在具体应用中,上述荧光强度图像获取模块73包括:In specific applications, the above-mentioned fluorescence intensity image acquisition module 73 includes:
短波长发射峰获取单元,用于根据所述荧光探针中的第一结构,获得所述短波长发射峰;A short-wavelength emission peak acquisition unit, configured to obtain the short-wavelength emission peak according to a first structure in the fluorescent probe;
长波长发射峰获取单元,用于根据所述荧光探针中的第二结构,获得所述长波长发射峰;A long-wavelength emission peak acquisition unit, configured to obtain the long-wavelength emission peak according to a second structure in the fluorescent probe;
其中,所述第一结构为能量受体,所述第二结构为能量供体;The first structure is an energy acceptor, and the second structure is an energy donor;
双通道荧光强度图像获取单元,用于将所述活化光作用于所述处理后的荧光探针,使所述第一结构和所述第二结构交替发光,获得所述双通道荧光强度图像。A dual-channel fluorescence intensity image acquisition unit is configured to apply the activated light to the processed fluorescent probe to cause the first structure and the second structure to emit light alternately to obtain the dual-channel fluorescence intensity image.
本发明实施例还提供一种终端设备包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,所述处理器执行所述计算机程序时,实现如实施例一至实施例三中所述的超分辨成像方法中的各个步骤。An embodiment of the present invention further provides a terminal device including a memory, a processor, and a computer program stored in the memory and executable on the processor. When the processor executes the computer program, the implementation is implemented as in Embodiments 1 to 3. Each step in the super-resolution imaging method described in.
本发明实施例还提供一种存储介质,所述存储介质为计算机可读存储介质,其上存储有计算机程序,所述计算机程序被处理器执行时,实现如实施例一至实施例三中所述的超分辨成像方法中的各个步骤。An embodiment of the present invention also provides a storage medium. The storage medium is a computer-readable storage medium, and a computer program is stored thereon. When the computer program is executed by a processor, the implementation is as described in Embodiments 1 to 3. Steps in a super-resolution imaging method.
以上所述实施例仅用以说明本发明的技术方案,而非对其限制;尽管前述实施例对本发明进行了详细的说明,本领域的普通技术人员应当理解:其依然可以对前述各实施例所记载的技术方案进行修改,或者对其中部分技术特征进行等 同替换;而这些修改或者替换,并不使相应技术方案的本质脱离本发明各实施例技术方案的精神和范围,均应包含在本发明的保护范围之内。The above-mentioned embodiments are only used to illustrate the technical solutions of the present invention, but are not limited thereto. Although the foregoing embodiments describe the present invention in detail, those skilled in the art should understand that they can still implement the foregoing embodiments. Modifications to the recorded technical solutions, or equivalent replacements of some of the technical features thereof; and these modifications or replacements do not deviate the essence of the corresponding technical solutions from the spirit and scope of the technical solutions of the embodiments of the present invention, and should be included in the present invention Within the scope of the invention.
工业实用性Industrial applicability
本发明提出的超分辨成像方法,使用具有双发射峰的荧光探针,对生物样品进行标记,激发荧光探针后通过STORM超分辨成像方法重构出超分辨图像,由于荧光探针在激发后能够产生具有双发射峰的荧光信号,即具有短波长发射峰的短波长信号和具有长波长发射峰的长波长信号,因此通过亲核剂和活化光作用于此荧光探针时能够形成双通道荧光强度图像,然后通过光信号采集装置分别采集,具有短波长发射峰的短波长信号和具有长波长发射峰的长波长信号,根据同一时刻的双通道荧光强度图像,可以计算短波长信号和具有长波长信号发射峰的荧光强度比值,获得比例荧光图像,最终根据比例荧光图像对超分辨图像着色,获得比例型超分辨图像。通过本发明实施例提出的超分辨成像方法而获得的比例型超分辨图像,不仅可以反映生物样品的结构,还可以通过荧光强度比值反映生物样品中荧光探针标记处的样品参数,从而能够根据样品参数,分析生物样品的功能。The super-resolution imaging method proposed by the present invention uses a fluorescent probe with dual emission peaks to label a biological sample. After the fluorescent probe is excited, a super-resolution image is reconstructed by the STORM super-resolution imaging method. Able to generate fluorescent signals with dual emission peaks, that is, short-wavelength signals with short-wavelength emission peaks and long-wavelength signals with long-wavelength emission peaks, so dual channels can be formed when this fluorescent probe is acted on by a nucleophile and activating light The fluorescence intensity image is then collected by an optical signal acquisition device. The short-wavelength signal with a short-wavelength emission peak and the long-wavelength signal with a long-wavelength emission peak can be calculated from the two-channel fluorescence intensity image at the same time. The ratio of the fluorescence intensity of the long-wavelength signal emission peak is used to obtain a proportional fluorescence image. Finally, the super-resolution image is colored according to the proportional fluorescence image to obtain a proportional-type super-resolution image. The proportional super-resolution image obtained by the super-resolution imaging method provided by the embodiment of the present invention can not only reflect the structure of the biological sample, but also reflect the sample parameters at the fluorescent probe mark in the biological sample by the ratio of the fluorescence intensity, so that it can be based on Sample parameters, functions for analyzing biological samples.

Claims (10)

  1. 一种超分辨成像方法,其特征在于,包括:A super-resolution imaging method, comprising:
    通过激发光,激发生物样品上具有双发射峰的荧光探针,并将亲和试剂作用于激发后的荧光探针上;Exciting a fluorescent probe having a double emission peak on a biological sample by exciting light, and applying an affinity reagent to the excited fluorescent probe;
    通过活化光,照射亲和试剂作用后的荧光探针,形成双通道荧光强度图像;By activating light and irradiating the fluorescent probe after the action of the affinity reagent, a dual-channel fluorescence intensity image is formed;
    分别采集所述双通道荧光强度图像中,短波长发射峰的短波长信号和长波长发射峰的长波长信号;Respectively collecting a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image;
    选择N帧双通道荧光强度图像,根据所述分别采集的所述短波长信号和所述长波长信号,在同一帧的所述双通道荧光强度图像中,选择所述短波长信号的荧光强度图像和所述长波长信号的荧光强度图像,并分别计算其荧光强度比值,获得N个比例荧光图像,其中N为正整数;Select N frames of two-channel fluorescence intensity images, and select the fluorescence intensity images of the short-wavelength signals in the two-channel fluorescence intensity images of the same frame according to the separately acquired short-wavelength signals and the long-wavelength signals. And the fluorescence intensity image of the long-wavelength signal, and calculating the fluorescence intensity ratios thereof, to obtain N proportional fluorescence images, where N is a positive integer;
    通过STORM超分辨成像方法,对所述比例荧光图像进行重构,获得超分辨图像;Reconstructing the proportional fluorescence image using a STORM super-resolution imaging method to obtain a super-resolution image;
    根据N个所述比例荧光图像对所述超分辨图像着色,获得比例型超分辨图像。Color the super-resolution image according to N number of the proportional fluorescence images to obtain a proportional-type super-resolution image.
  2. 如权利要求1所述的超分辨成像方法,其特征在于,所述超分辨成像方法还包括:The super-resolution imaging method according to claim 1, wherein the super-resolution imaging method further comprises:
    建立所述荧光探针的环境参数与所述荧光强度比值的函数模型;Establishing a function model of the environmental parameter of the fluorescent probe and the ratio of the fluorescent intensity;
    所述建立所述荧光探针环境参数与所述荧光强度比值的函数模型包括:The establishing a function model of the environmental parameter of the fluorescent probe and the ratio of the fluorescent intensity includes:
    将所述具有双发射峰的荧光探针置于探针溶液测试环境,通过激发光,激发所述荧光探针;Placing the fluorescent probe with a double emission peak in a probe solution test environment, and exciting the fluorescent probe through excitation light;
    改变所述探针溶液测试环境的第一参数,获取在不同的所述第一参数下,所述荧光探针的稳态荧光发射光谱;Changing a first parameter of the test environment of the probe solution to obtain a steady-state fluorescence emission spectrum of the fluorescent probe under different first parameters;
    根据所述稳态荧光发射光谱中的双发射峰,计算荧光强度比值,并建立所述第一参数与所述荧光强度比值的函数模型。According to the double emission peak in the steady-state fluorescence emission spectrum, a fluorescence intensity ratio is calculated, and a function model of the first parameter and the fluorescence intensity ratio is established.
  3. 如权利要求1所述的超分辨成像方法,其特征在于,所述通过活化光,照射亲和试剂作用后的荧光探针,获得双通道荧光强度图像包括:The super-resolution imaging method according to claim 1, wherein obtaining a dual-channel fluorescence intensity image by activating light and irradiating a fluorescent probe under the action of an affinity reagent comprises:
    根据所述荧光探针中的第一结构,获得所述短波长信号;Obtaining the short-wavelength signal according to a first structure in the fluorescent probe;
    根据所述荧光探针中的第二结构,获得所述长波长信号;Obtaining the long-wavelength signal according to a second structure in the fluorescent probe;
    所述激发光照射所述荧光探针时,所述第一结构或第二结构发射荧光;When the excitation light irradiates the fluorescent probe, the first structure or the second structure emits fluorescence;
    所述活化光作用于所述亲和试剂作用后的荧光探针时,所述第一结构和所述第二结构根据与所述亲和试剂的结合状态交替发光,形成所述双通道荧光强度图像。When the activating light acts on the fluorescent probe after the affinity reagent acts, the first structure and the second structure alternately emit light according to the binding state with the affinity reagent to form the dual-channel fluorescence intensity image.
  4. 如权利要求3所述的超分辨成像方法,其特征在于,所述双通道荧光强度图像,包括短波长信号的荧光强度图像和长波长信号的荧光强度图像;The super-resolution imaging method according to claim 3, wherein the dual-channel fluorescence intensity image comprises a fluorescence intensity image of a short-wavelength signal and a fluorescence intensity image of a long-wavelength signal;
    所述短波长信号的荧光强度图像,对应所述荧光探针中的第一结构的发光过程;The fluorescence intensity image of the short-wavelength signal corresponds to the light emission process of the first structure in the fluorescent probe;
    所述长波长信号的荧光强度图像,对应所述荧光探针中的第二结构的发光过程。The fluorescence intensity image of the long-wavelength signal corresponds to the light emission process of the second structure in the fluorescent probe.
  5. 如权利要求1所述的超分辨成像方法,其特征在于,所述分别采集所述双通道荧光强度图像中,短波长发射峰的短波长信号和长波长发射峰的长波长信号包括:The super-resolution imaging method according to claim 1, wherein in the acquiring the two-channel fluorescence intensity images, a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak respectively include:
    通过第一双色镜将所述激发光与所述短波长信号和所述长波长信号分离;Separating the excitation light from the short-wavelength signal and the long-wavelength signal through a first dichroic mirror;
    通过第二双色镜将所述短波长信号和所述长波长信号分离后,所述短波长信号经过第一滤波器发送至反射镜,所述反射镜将所述滤波后的短波长信号传输至第一EMCCD;所述长波长信号经过第二滤波器,所述滤波后的长波长信号传输至所述第一EMCCD;After the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror transmits the filtered short-wavelength signal to A first EMCCD; the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to the first EMCCD;
    所述第一EMCCD的不同区域分别接收所述滤波后的短波长信号和所述滤波后的长波长信号,从而收集所述双通道荧光强度图像。Different regions of the first EMCCD receive the filtered short-wavelength signal and the filtered long-wavelength signal, respectively, so as to collect the dual-channel fluorescence intensity image.
  6. 如权利要求1所述的超分辨成像方法,其特征在于,所述分别采集所述荧光发射光谱中,短波长发射峰的短波长信号和长波长发射峰的长波长信号,包括:The super-resolution imaging method according to claim 1, wherein said collecting the short-wavelength signal of a short-wavelength emission peak and the long-wavelength signal of a long-wavelength emission peak in the fluorescence emission spectrum separately comprises:
    通过第一双色镜将所述激发光与所述短波长信号和所述长波长信号分离;Separating the excitation light from the short-wavelength signal and the long-wavelength signal through a first dichroic mirror;
    通过第二双色镜将所述短波长信号和所述长波长信号分离后,所述短波长信号经过第一滤波器发送至反射镜,所述反射镜将所述滤波后的短波长信号传输至第一EMCCD;所述长波长信号经过第二滤波器,所述滤波后的长波长信号传输至第二EMCCD;After the short-wavelength signal and the long-wavelength signal are separated by a second dichroic mirror, the short-wavelength signal is sent to a reflecting mirror through a first filter, and the reflecting mirror transmits the filtered short-wavelength signal to A first EMCCD; the long-wavelength signal passes through a second filter, and the filtered long-wavelength signal is transmitted to a second EMCCD;
    所述第一EMCCD和所述第二EMCCD分别接收所述滤波后的短波长信号和所述滤波后的长波长信号,从而收集所述双通道荧光强度图像。The first EMCCD and the second EMCCD respectively receive the filtered short-wavelength signal and the filtered long-wavelength signal, thereby collecting the dual-channel fluorescence intensity image.
  7. 如权利要求1至6任一项所述的超分辨成像方法,其特征在于,所述选择N帧双通道荧光强度图像,根据所述分别采集的所述短波长信号和所述长波长信号,在同一帧的所述双通道荧光强度图像中,选择所述短波长信号的荧光强度图像和所述长波长信号的荧光强度图像,并分别计算其荧光强度比值,获得N个比例荧光图像,其中N为正整数包括:The super-resolution imaging method according to any one of claims 1 to 6, wherein the selected N-frame two-channel fluorescence intensity images are based on the short-wavelength signal and the long-wavelength signal acquired separately, In the two-channel fluorescence intensity image of the same frame, the fluorescence intensity image of the short-wavelength signal and the fluorescence intensity image of the long-wavelength signal are selected, and the fluorescence intensity ratios thereof are calculated to obtain N ratio fluorescence images, where N is a positive integer including:
    根据所述双通道荧光强度图像和所述分别采集的短波长信号,选择所述第N个所述短波长信号的荧光强度图像,计算其发射峰荧光强度;Selecting the N-th fluorescence intensity image of the short-wavelength signal according to the dual-channel fluorescence intensity image and the separately collected short-wavelength signal, and calculating the emission peak fluorescence intensity thereof;
    根据所述双通道荧光强度图像和所述分别采集的长波长信号,选择所述第N个所述长波长信号的荧光强度图像,计算其发射峰荧光强度;Selecting the Nth long-wavelength signal fluorescence intensity image according to the two-channel fluorescence intensity image and the separately acquired long-wavelength signal, and calculating the emission peak fluorescence intensity thereof;
    计算所述荧光强度比值的计算公式为:The calculation formula for calculating the fluorescence intensity ratio is:
    Figure dest_path_image001
    Figure dest_path_image001
    ,
    其中,IBN为所述长波长信号的发射峰荧光强度,IAN为所述短波长信号的发射峰荧光强度。Wherein, IBN is the emission peak fluorescence intensity of the long-wavelength signal, and IAN is the emission peak fluorescence intensity of the short-wavelength signal.
  8. 一种超分辨成像装置,其特征在于,包括:A super-resolution imaging device, comprising:
    激发模块,用于通过激发光,激发生物样品上具有双发射峰的荧光探针,并将亲和试剂作用于激发后的荧光探针上;An excitation module for exciting a fluorescent probe having a double emission peak on a biological sample by using excitation light, and applying an affinity reagent to the excited fluorescent probe;
    荧光强度图像获取模块,用于通过活化光,照射亲和试剂作用后的荧光探针,获得双通道荧光强度图像;A fluorescence intensity image acquisition module, configured to obtain a dual-channel fluorescence intensity image by activating light and irradiating a fluorescent probe after the action of an affinity reagent;
    信号采集模块,用于分别采集所述双通道荧光强度图像中,短波长发射峰的短波长信号和长波长发射峰的长波长信号;A signal acquisition module configured to separately acquire a short-wavelength signal of a short-wavelength emission peak and a long-wavelength signal of a long-wavelength emission peak in the dual-channel fluorescence intensity image;
    比例荧光图像计算模块,用于选择N帧双通道荧光强度图像,根据所述分别采集的所述短波长信号和所述长波长信号,在同一帧的所述双通道荧光强度图像中,选择所述短波长信号的荧光强度图像和所述长波长信号的荧光强度图像,并分别计算其荧光强度比值,获得N个比例荧光图像,其中N为正整数,其中N为正整数;A proportional fluorescence image calculation module is configured to select N frames of two-channel fluorescence intensity images, and select the selected one of the two-channel fluorescence intensity images in the same frame according to the separately acquired short-wavelength signals and the long-wavelength signals. The fluorescence intensity image of the short-wavelength signal and the fluorescence intensity image of the long-wavelength signal, and respectively calculating a fluorescence intensity ratio thereof to obtain N proportional fluorescence images, where N is a positive integer, where N is a positive integer;
    图像重构模块,用于通过STORM超分辨成像方法,对所述比例荧光图像进行重构,获得超分辨图像;An image reconstruction module, configured to reconstruct the proportional fluorescence image by using the STORM super-resolution imaging method to obtain a super-resolution image;
    图像获取模块,用于根据N个所述比例荧光图像对所述超分辨图像着色,获得比例型超分辨图像。An image acquisition module is configured to color the super-resolution image according to N of the proportional fluorescence images to obtain a proportional-type super-resolution image.
  9. 一种终端设备,其特征在于,包括存储器、处理器及存储在存储器上并可在处理器上运行的计算机程序,其特征在于,所述处理器执行所述计算机程序时,实现如权利要求1至7任一项所述的超分辨成像方法中的各个步骤。A terminal device, comprising a memory, a processor, and a computer program stored on the memory and operable on the processor, and is characterized in that when the processor executes the computer program, it implements claim 1 Each step in the super-resolution imaging method according to any one of 7 to 7.
  10. 一种存储介质,所述存储介质为计算机可读存储介质,其上存储有计算机程序,其特征在于,所述计算机程序被处理器执行时,实现如权利要求1至7任一项所述的超分辨成像方法中的各个步骤。A storage medium is a computer-readable storage medium on which a computer program is stored, wherein when the computer program is executed by a processor, the computer program according to any one of claims 1 to 7 is implemented. Steps in a super-resolution imaging method.
PCT/CN2018/101648 2018-08-22 2018-08-22 Super-resolution imaging method and apparatus, and terminal device WO2020037527A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/101648 WO2020037527A1 (en) 2018-08-22 2018-08-22 Super-resolution imaging method and apparatus, and terminal device

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/CN2018/101648 WO2020037527A1 (en) 2018-08-22 2018-08-22 Super-resolution imaging method and apparatus, and terminal device

Publications (1)

Publication Number Publication Date
WO2020037527A1 true WO2020037527A1 (en) 2020-02-27

Family

ID=69592341

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2018/101648 WO2020037527A1 (en) 2018-08-22 2018-08-22 Super-resolution imaging method and apparatus, and terminal device

Country Status (1)

Country Link
WO (1) WO2020037527A1 (en)

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102692401A (en) * 2012-06-06 2012-09-26 中国科学院半导体研究所 Gating fluorescence service life imaging device based on light delay
CN102939555A (en) * 2010-06-11 2013-02-20 株式会社尼康 Microscope device, and observation method
CN104764729A (en) * 2015-04-22 2015-07-08 华南师范大学 Up-conversion-nanocrystal-based stimulated depletion super-resolution optical microscopic method and up-conversion-nanocrystal-based stimulated depletion super-resolution optical microscopic system
CN107831147A (en) * 2017-09-30 2018-03-23 华南师范大学 A kind of multiband fluorescence loss method, polychrome super-resolution imaging method and device

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102939555A (en) * 2010-06-11 2013-02-20 株式会社尼康 Microscope device, and observation method
CN102692401A (en) * 2012-06-06 2012-09-26 中国科学院半导体研究所 Gating fluorescence service life imaging device based on light delay
CN104764729A (en) * 2015-04-22 2015-07-08 华南师范大学 Up-conversion-nanocrystal-based stimulated depletion super-resolution optical microscopic method and up-conversion-nanocrystal-based stimulated depletion super-resolution optical microscopic system
CN107831147A (en) * 2017-09-30 2018-03-23 华南师范大学 A kind of multiband fluorescence loss method, polychrome super-resolution imaging method and device

Similar Documents

Publication Publication Date Title
Eggeling et al. Lens-based fluorescence nanoscopy
JP6416887B2 (en) Microscopic observation of tissue samples using structured illumination
JP5540102B2 (en) Multiple modality contrast and bright field context representation for enhanced pathological determination, and multiple specimen detection in tissues
DE112009005521B4 (en) Method and device for the localization of individual dye molecules in fluorescence microscopy
Kumar et al. FLIM FRET technology for drug discovery: Automated multiwell‐plate high‐content analysis, multiplexed readouts and application in situ
Thorley et al. Super-resolution microscopy: a comparison of commercially available options
JP2024019180A (en) Multispectral sample imaging
CN111971606B (en) Time-resolved imaging method with high spatial resolution
EP1291627A1 (en) Method and arrangement for multiparameter acquisition of single photons to produce simultaneously time and space as well as time and wavelength resolved fluorescence images
DE102004039035A1 (en) Method and apparatus for fluorescence lifetime imaging nanoscopy
Pawlowska et al. Embracing the uncertainty: the evolution of SOFI into a diverse family of fluctuation-based super-resolution microscopy methods
Descloux et al. Experimental combination of super-resolution optical fluctuation imaging with structured illumination microscopy for large fields-of-view
CN105044066B (en) A kind of nanometer OCT image method and system based on broadband stimulated radiation
WO2020037527A1 (en) Super-resolution imaging method and apparatus, and terminal device
CN108982460B (en) Super-resolution imaging method and device and terminal equipment
US20200132976A1 (en) Luminescence imaging apparatus and methods
Prakash High-density superresolution microscopy with an incoherent light source and a conventional epifluorescence microscope setup
Premadasa et al. Spatially co-registered wide-field nonlinear optical imaging of living and complex biosystems in a total internal reflection geometry
CN114076751B (en) Super-resolution microscopic imaging method based on point scanning strategy
WO2022249583A1 (en) Information processing device, biological sample observation system, and image generation method
US20220236189A1 (en) Hyperspectral nonlinear microscopy
Ryan et al. Quantum-enabled ghost imaging for non-invasive imaging of plants
Pantoja et al. Fractal patterns from dried droplets. A method to test nanoscale features of nanoparticles and vesicles
Dean et al. OOPS: A GUI-based software package for object-oriented analysis of fluorescence polarization microscopy data
CN115190969A (en) Systems and methods for use in FRET microscopy

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 18930997

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

32PN Ep: public notification in the ep bulletin as address of the adressee cannot be established

Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 22/06/2021)

122 Ep: pct application non-entry in european phase

Ref document number: 18930997

Country of ref document: EP

Kind code of ref document: A1