EP3698124A1 - Method of stimulated emission depletion microscophy having high spatial resolution - Google Patents
Method of stimulated emission depletion microscophy having high spatial resolutionInfo
- Publication number
- EP3698124A1 EP3698124A1 EP18815011.4A EP18815011A EP3698124A1 EP 3698124 A1 EP3698124 A1 EP 3698124A1 EP 18815011 A EP18815011 A EP 18815011A EP 3698124 A1 EP3698124 A1 EP 3698124A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- sted
- image
- modulation
- intensity
- fluorescence
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6408—Fluorescence; Phosphorescence with measurement of decay time, time resolved fluorescence
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6486—Measuring fluorescence of biological material, e.g. DNA, RNA, cells
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/008—Details of detection or image processing, including general computer control
- G02B21/0084—Details of detection or image processing, including general computer control time-scale detection, e.g. strobed, ultra-fast, heterodyne detection
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
Definitions
- the present invention relates to a method for increasing the optical resolution of a stimulated emission depletion microscope, or STED microscope (Stimulated Emission Depletion) based on the modulation of the intensity of a STED beam on an arbitrary time scale during the acquisition of an image and the analysis of the induced dynamics, without increasing the intensity of the STED beam and in a simple a nd economic manner.
- STED microscope Stimulated Emission Depletion
- Such method is based on the principle that the fluorescence at the centre of a n observation volume is not modulated, while the fluorescence at the periphery of said volume is modulated.
- the exploitation of this difference in the modulation of the fluorescence signal entails an increase in the spatial resolution.
- STED microscopy is one of the many different types of super-resolution microscopy techniques which have been recently developed to increase spatial resolution through exceeding the limit of diffraction of conventional light microscopy.
- STED microscopy The main application of STED microscopy is directed to the study of sub-cellular architectures and dynamics and takes advantage of the non-linear response of fluorophores commonly used for marking biological samples.
- One sample is excited with a first radiation beam, the excitation beam, and the fluorescence is measured in a conventional manner.
- One donut-shaped second radiation beam, the STED beam de-energizes by stimulated emission the fluorophores in an annular region around the axis of the first beam, allowing receiving the signal only from the central region of the first beam.
- the mechanism responsible for the increase in resolution is the saturation of the fluorescence reduction by stimulated emission. With STED microscopy high spatial resolutions were reached.
- the spatial resolution w of a STED microscope depends on the intensity ISTED of the STED beam according to the equation :
- wo is the spatial resolution of the confocal microscope used in STED microscopy and Isat is a constant representing the intensity value of the STED beam, required to increase the resolution of a factor ⁇ /2 that depends on the sa mple.
- Isat is a constant representing the intensity value of the STED beam, required to increase the resolution of a factor ⁇ /2 that depends on the sa mple.
- a n unlimited spatial resolution could be obtained by increasing the intensity value ISTED of the STED beam.
- the maximum resolution of a STED microscope is limited by the maximum power "tolerated" by the sample due to detrimental photo-damage effects induced by illumination with the STED beam, such as for example phototoxicity and photobleaching. For this reason strategies were developed to increase the spatial resolution without increasing the intensity of the STEAD beam.
- document WO2015/022635 Al discloses a method that uses a pulsed excitation beam (in the picoseconds time scale) and a continuous wave, by varying the detection time window. Since the average life of the fluorescent decay after a pulsed excitation is always in the time scale of nanoseconds, such method involves the use of an ultra fast detection electronics in the time scale of nanoseconds.
- the SPLIT analysis method is based on the linear superposition of one slow decay component (due to fluorophores in the centre of the actual observation volume) and one fast decay component (due to fluorophores at the periphery of the actual observation volume).
- the fraction associated with the slow component can be extracted effectively without using minimization algorithms, with consequent increase in the spatial resolution.
- the SPLIT analysis method requires the use of a pulsed excitation and ultra fast detection electronics, in order to record the fluorescence dynamics in the time scale of nanoseconds.
- the object of the present invention is to overcome the disadvantages described heretofore, allowing to increase the optical resolution of a STED microscope in a reliable, simple and economical way, without increasing the intensity of the STED beam and without work in the time scale of nanoseconds.
- the method uses one STED light beam having a donut-shaped spatial pattern (in English doughnut or donut) which has the advantage of acting only on the periphery of the observation volume of the microscope. Thanks to the "donut" shape, since only the signal at the periphery is modulated, the latter can be subtracted from the whole signal and a smaller observation volume can be obtained.
- the method advantageously allows increasing the spatial resolution without increasing the intensity of the STED beam, thus avoiding damaging the sample.
- the method of the present invention based on the slow modulation of the intensity of the STED beam and the analysis of the dynamics induced entails a general simplification of procedure and can be integrated into any STED microscope.
- the fluorescence modulation at the periphery of the observation volume is performed on an arbitrary time scale, whereby it is not necessary to use a pulsed excitation beam.
- This entails the advantage of being able to use light sources such as for example laser, which are inexpensive compared to those required for a pulsed excitation of other techniques.
- Another important advantage is that it is not necessary to detect the fluorescence dynamics in the time scale of nanoseconds and therefore a simple and economical electronic detection can be used.
- Figure 1 is a diagram of the principles on which standard STED microscopy (la) and STED microscopy integrated with the present method (lb) are based;
- Figure 2 is a flow diagram of a first embodiment of the method for increasing the optical resolution of a STED microscope, according to the invention
- Figure 3 schematically shows some of the results of a simulated first experiment, obtained by performing the first embodiment of the method of Figure 2.
- Figure 4 is a flow diagram of a second embodiment of the method for increasing the optical resolution of a STED microscope, according to the invention.
- Figure 5 schematically shows some of the results of a simulated second experiment, obtained by performing the second embodiment of the method of Figure 4;
- Figure 6 schematically shows some of the experimental results, obtained by performing the first embodiment of the method of Figure 2;
- Figure 7 illustrates the results of processing performed on simulated data in the first experiment of Figure 3.
- the principle on which STED microscopy is based is that excited fluorophores at the periphery of a confocal observation volume are "turned off” in a selective manner by means of a (donut-shaped) second beam, the STED beam. Since the fluorophores at the centre are not turned off, a smaller actual STED observation volume is obtained and an increase in the spatial resolution.
- the maximum resolution of a STED microscope is determined by the ability to turn off the molecules at the periphery of the observation volume, and this is generally determined by the intensity ISTED of the STED beam.
- the method of the present invention provides for a significant increase of the resolution by modulation of the STED beam intensity but without increasing the average intensity of the STED beam, as shown schematically in Figure lb.
- the STED beam modulation generates spatial variations in the temporal dynamic within the actua l STED observation volume.
- the analysis of the signal temporal evolution allows to separate smaller actual STED-modulated observation volume characterized by a specific temporal footprint.
- Fig. 2 is a flow diagram of a first embodiment of the method for increasing the optical resolution of a STED microscope.
- the method is performed automatically.
- I n an initial step 100 a sam ple is illuminated with either a pulsed or continuous excitation light beam with constant excitation intensity, in order to excite fluorophores in the sample.
- I n a step 200 the sa mple is illuminated with a depletion light beam, either pulsed or continuous, STED beam, modulated to de-energize fluorophores by stim ulated emission.
- F Point Spread Function
- the distribution of a sample object is three-dimensional, but since the preferred embodiments of the method described later have an effect only on the xy plane, the distribution is approximated on the xy plane.
- the convolution equation is: herein dS is an infinitesimal surface element a nd w is the spatia l resolution expressed by Eq whereby the Eq. 2 can be rewritten as:
- Eq. 3 and 4 represent the integral of the contributions of all fluorophores to the fluorescence signal.
- the intensity modulation of the STED beam performed at step 200 also causes the image function of the Eq. 3 to be a function of time:
- t-STED indicates an image resolved in time, obtained through modulation of the intensity of the STED beam.
- the modulation of the image function F is then obtained by the modulation of IsTEo(t) for each pixel.
- Modulation M(x,y) of an image is defined as the quantity:
- m(x,y) contains sub-diffractive information on the distribution of the object p(x, y) in the vicinity of the position (x,y).
- the multiplication factor 5(lsTEo(t)/lsat) is a function of the modulation of the intensity of IsTEo(t) of the STED beam.
- the modulation M(x,y) is calculated from the signal F t -sTED(x,y,t) through an algorithm based on Fourier transforms. For each pixel, the amounts g(x,y) and s(x,y) according to the following formulas are first calculated:
- N t is the total number of points in time wherein the signal F t -sTED(x,y,t) is sampled.
- the modulation M(x,y) is then calculated in each pixel, as:
- M(x,y) one fraction C enier(x,y) of intensity of the fluorescence signal, corresponding to the contribution to the fluorescence signal coming from the fluorophores at the centre of the observation volume, is calculated.
- the modulation M(x,y) in a given pixel can be expressed as a combination of the modulation value at the centre of the observation volume M ce nter and the modulation value in the periphery of the observation
- the values of constants Mcenter and Mpe ph are determined as follows.
- the value of Mcenter corresponds to the minimum modulation va lue measured in the sample to the given experimental conditions. I n other words, the va lue of Mcenter corresponds to the minimum modulation value for which the number of pixels is greater than or equal to a percentage ⁇ , optionally equal to 10%, of the peak value of the histogram of of M(x,y) values.
- the value of Mpe ph is calculated according to the equation :
- ⁇ and ⁇ 2 are the values of the standard deviation of the bi-dimensional gaussian distribution approximating a bi-dimensional histogram of g(x,y) and s(x,y) values.
- the values of constants Mcenter and Mpehph can be determined by using a known sa mple of fluorescent beads a nd evaluating the quality of the images obtained at different values of Mcenter and Mpehph.
- Figure 7 illustrates some processing of data obtained in a first simulated experiment, corresponding to a first experiment ca rried out with the first preferred em bodiment described above of the method according to the invention. Said first experiment will be described in detail below with reference to figure 3.
- Figure 7a shows the histogram of the measured M(x,y) values from which Mcenter is obtained
- Figure 7b shows the g(x,y) and s(x,y) values that are approximated with a bi-dimensional Gaussian distribution shown in figure 7c, whose standard deviation values are used for the calculation of Mpe ph.
- a final image of higher resolution is obtained : wherein the subscript "m-STED” indicates the STED technique with modulation of the intensity of the STED beam.
- the STED image F'sTED(x,y) used to generate the image FM-sTED(x,y) can be chosen between an image averaged in time ⁇ F-r-sTED(x,y,t)> and any image of the temporal series F T- sTED(x,y,t).
- acoustic-optical modulators (AOM, acoustic-optical modulator) commonly employed in confocal microscopes are used, which are much faster than any mechanical device.
- the response of the AOM is approximately limited to the transit time of the sound wave through the beam, typically ⁇ 50 ns.
- opto-electronic modulators (EOM, Electro-optic modulator) are used, wherein the time limit of the response is equal to tens of nanoseconds.
- T is the modulation period.
- the time window T coincides with the typical time of integration of intensity in a pixel of a confocal or STED microscope (pixel dwell time), whose values are equal to about 10 ⁇ up to about 100 ⁇ .
- the linear ramp temporal pattern has the advantage of making the analysis of the signal in the time domain more direct.
- the modulation 200 of the STED beam is obtained with different temporal pattern, such as sinusoidal patterns.
- a series of images of fluorescence are acquired, i.e. are scanned, corresponding to the image function f t -sTED(x,y,t) of Eq. 4, having increasing spatial resolution whereby the image at time T has the higher spatial resolution.
- the acquisition, i.e. the scanning, 300 of the fluorescence signal is solved in time and synchronised with the modulation of the STED bea m.
- the modulation period equa l to T and the number of acquired time instants equal to n being set the required temporal resolution is T/n.
- the timed acquisition must be synchronized with the scanning parameters.
- T coincides with the dwell time per total pixel.
- the synchronization ca n be performed even with other parameters, for example with the line scan time. I n this latter case, the scanning of a horizontal line in a given vertical position is performed consecutively for n times, using a different intensity level at each scan, a nd then it goes to a line on a different vertical position.
- n fluorescence intensity values are associated with each pixel, which values will be processed in a step 400 to obtain the modulation M (x, y) of the image on each pixel given by Eq. 7.
- the intensity fluorescence values are processed to a lso calculate a n averaged in time image ⁇ FT- sTED(x,y,t)>.
- Equation 14 also shows that a spatial distribution of the depletion decay rate Tdep ( x ' > y') ' s provided determined by the spatial distribution of hsTED ( ⁇ ', y').
- the signal from the fluorophores located at the periphery of the observation volume (maximum values of hsTEo) will decay more quickly while the signal from the center of the observation volume (values close to zero of hsTEo) will remain approximately constant, as schematically shown in the graph of Figure lb.
- the signal of the fluorophores located on the periphery of the observation volume will be modulated while the signal from the center of the observation volume will not be modulated. This modulation gradient between the center and the periphery of the volume is used to separate from the total signal, the signal coming from the center.
- the separation at step 500 is performed with the same formalism used in the SPLIT technique, with the difference that the period T is not determined by the fluorescence decay of the fluorophores in the order of nanoseconds, but rather it is arbitrarily selected by setting the period T of the ramp (T> 100ns).
- T the period of the ramp
- Figure 3 shows the results of a first experiment simulated by the inventors who have applied a first preferred embodiment of the method of the present invention.
- the first simulated experiment consisted in having randomly located punctiform fluorophores in a sample and simulating an acquisition according to the first embodiment of the method with a modulation of the intensity of the STED beam in the time domain.
- a sample is illuminated in step 100 with constant excitation intensity and is illuminated in step 200 with a modulated STED intensity with a linear ramp changing the STED intensity from value 0 to value / m0 x in the time window T, shown in Figure 3a.
- m-STED which is that of Figure 3and given by the contribution of the fluorescence of the fluorophores at the center, has a higher resolution than the STED image with the maximum resolution of Figure 3d, as shown by a comparison of the line profiles shown in Figure 3g (wherein it is also reported that obtained with confocal microscopy without STED technique).
- the time_ pattern of the modulation performed in a step 200' has a sinusoidal pattern with frequency ⁇ :
- the fluorescence signal f ( ⁇ ', y', t) is phase shifted with respect to a signal of the STED beam and will contain the main frequency ⁇ and the higher harmonics due to the non-linearity of the exponential factor.
- the modulation M of the image can be obtained by analysing the fluorescence signal at a frequency ⁇ or at higher frequencies. This can be done via a suitable hardware setting, wherein an analysis instrument acquires in a step 300' fluorescence signals from a sample and outputs, in a step 400', the values of the average intensity ⁇ FTSTED (X , y, t)> and modulation ⁇ ⁇ (x,y) of the fluorescence signal directly.
- a suitable hardware setting can be for example a standard lock-in detecting apparatus at frequency ⁇ , wherein a lock-in amplifier directly provides, in addition to the average value of intensity ⁇ FTSTED (X , y, t)>, the modulation values ⁇ ⁇ (x,y) and phase ⁇ ⁇ (x,y) during an acquisition 300' of fluorescence signals.
- the increase of the resolution can be obtained in a step 600' by using the average intensity ⁇ FTSTED (X , y, t)> in pixel (x,y) and the signal modulation ⁇ ⁇ (x,y) on the same pixel:
- the values of the constants M ce nter and Mperiph can be determined as described above, taking into account that the values of g(x,y) and s(x,y) can be obtained from ⁇ ⁇ (x,y) and ⁇ ⁇ (x,y) according to the following formulas:
- step 400 for calculating the modulation M(x,y) of the image to obtain the final image F/w-srfD(x,y) at higher resolution is not necessary.
- Figure 5 shows the results of a second experiment simulated by the inventors who have applied a second preferred embodiment of the method.
- the second simulated experiment consisted in using the same sample of the first experiment, i.e. with randomly located punctiform fluorophores, and simulating an acquisition according to the second embodiment of the method with a modulation of the intensity of the STED beam in the frequency domain.
- the results of which are shown schematically in Figure 3
- the simulated image is 32x32 pixels
- the pixel size is 20nm
- the value of wo 160nm
- the value of Imax/isat 4
- a sample is illuminated at step 100 with constant excitation intensity and is illuminated at step 200' with a STED intensity modulated with a sine wave at a frequency co, shown in Figure 5a.
- STED images are acquired, with detection techniques in lock-in at frequency co, whereby the fluorescence signal is modulated and phase shifted, with the highest modulation at the periphery of the observation volume as schematically shown in Figure 5b.
- m-STED which is that of Figure 5e given by the contribution of the fluorescence of the fluorophores at the center, has a higher resolution than the STED image with the maximum resolution of Figure 5d, as shown by a comparison of the line profiles shown in Figure 5g.
- the authors have also performed experimental tests on fluorescent beads analysed with a STED microscopy apparatus integrated with the first preferred embodiment of the method. Some experimental results are reported in Figure 6.
- the experiment was performed with a standard STED apparatus on a sample of fluorescent beads of about 40nm in size.
- the intensity of the STED beam was modulated (step 200) with an AOM driven in such a way as to generate a linear ramp, from a value 0 to a va lue l max , shown in Figure 6a.
- Figure 6d shows the STED image of fluorescence at maximum resolution.
Landscapes
- Physics & Mathematics (AREA)
- Health & Medical Sciences (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- General Physics & Mathematics (AREA)
- Life Sciences & Earth Sciences (AREA)
- Engineering & Computer Science (AREA)
- Immunology (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Pathology (AREA)
- Optics & Photonics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- General Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Molecular Biology (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Microscoopes, Condenser (AREA)
Abstract
Description
Claims
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| IT102017000118432A IT201700118432A1 (en) | 2017-10-19 | 2017-10-19 | COLLECTED MICROSCOPY METHOD BY MEANS OF HIGH SPATIAL STIMULATED EMISSION |
| PCT/IB2018/058123 WO2019077556A1 (en) | 2017-10-19 | 2018-10-19 | Method of stimulated emission depletion microscophy having high spatial resolution |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| EP3698124A1 true EP3698124A1 (en) | 2020-08-26 |
| EP3698124B1 EP3698124B1 (en) | 2021-07-07 |
Family
ID=61224389
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| EP18815011.4A Active EP3698124B1 (en) | 2017-10-19 | 2018-10-19 | Method of stimulated emission depletion microscopy at high spatial resolution |
Country Status (4)
| Country | Link |
|---|---|
| US (1) | US11372224B2 (en) |
| EP (1) | EP3698124B1 (en) |
| IT (1) | IT201700118432A1 (en) |
| WO (1) | WO2019077556A1 (en) |
Families Citing this family (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111474150B (en) * | 2020-04-08 | 2022-03-22 | 华南师范大学 | A method for differential suppression of background noise in STED super-resolution images |
| CN111521596B (en) * | 2020-06-04 | 2021-02-05 | 深圳大学 | Fluorescence differential super-resolution imaging method and imaging system |
| CN111982870B (en) | 2020-08-07 | 2023-04-28 | 深圳大学 | Scanning structure light super-resolution microscopic imaging device and method |
| EP4166930A1 (en) | 2021-10-15 | 2023-04-19 | Abberior Instruments GmbH | Method, device, microscope and computer program for analyzing microscopy data |
| CN114216887B (en) * | 2021-12-02 | 2023-11-28 | 南昌大学 | Method for improving resolution of stimulated emission depletion microscopic system by polarization modulation |
Family Cites Families (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| DE102006046369A1 (en) * | 2006-09-29 | 2008-04-03 | Carl Zeiss Microimaging Gmbh | Luminescence microscopy method for examining biological preparations, involves detecting luminescence radiation from sample partial volume in modulation-filtering manner, so that luminescence radiation from another volume is suppressed |
| ITTO20130692A1 (en) | 2013-08-13 | 2015-02-14 | Fond Istituto Italiano Di Tecnologia | COLLECTED MICROSCOPY WITH STIMULATED EMISSION (STED), WITH TEMPORAL GATING OF THE EXCITATION AND SYNCHRONOUS DETECTION OF FLUORESCENCE EMISSION |
-
2017
- 2017-10-19 IT IT102017000118432A patent/IT201700118432A1/en unknown
-
2018
- 2018-10-19 WO PCT/IB2018/058123 patent/WO2019077556A1/en not_active Ceased
- 2018-10-19 EP EP18815011.4A patent/EP3698124B1/en active Active
- 2018-10-19 US US16/756,281 patent/US11372224B2/en active Active
Also Published As
| Publication number | Publication date |
|---|---|
| WO2019077556A1 (en) | 2019-04-25 |
| EP3698124B1 (en) | 2021-07-07 |
| IT201700118432A1 (en) | 2019-04-19 |
| US11372224B2 (en) | 2022-06-28 |
| US20200333573A1 (en) | 2020-10-22 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| EP3698124B1 (en) | Method of stimulated emission depletion microscopy at high spatial resolution | |
| US10409047B2 (en) | High frame-rate multichannel beam-scanning microscopy | |
| Futia et al. | Spatially-chirped modulation imaging of absorbtion and fluorescent objects on single-element optical detector | |
| US10648934B2 (en) | Systems, apparatuses, and methods for optical focusing in scattering samples | |
| JP6260691B2 (en) | Structured illumination microscope apparatus and structured illumination observation method | |
| Buranachai et al. | Rapid frequency-domain FLIM spinning disk confocal microscope: lifetime resolution, image improvement and wavelet analysis | |
| KR101847334B1 (en) | Apparatus and method of obtaining fluorescence image | |
| CN106198466A (en) | A kind of method realizing the orientation parsing of super-resolution dipole | |
| JP7802099B2 (en) | Simultaneous multispecies super-resolution imaging with time multiplexing and single-photon detector arrays | |
| Spring et al. | Image analysis for denoising full‐field frequency‐domain fluorescence lifetime images | |
| JP2003255231A (en) | Optical imaging system and optical image data processing method | |
| US12518412B2 (en) | Method and device for light field microscopy | |
| Chang et al. | Temporal focusing‐based widefield multiphoton microscopy with spatially modulated illumination for biotissue imaging | |
| CN109916867B (en) | Fluorescence intensity related time-resolved enhanced imaging method and device | |
| US6731824B2 (en) | Spatial filtering method for failure analysis of a device | |
| JP2018531424A (en) | Dynamic lock-in detection bandwidth for SRS imaging | |
| JP2018531424A6 (en) | Dynamic lock-in detection bandwidth for SRS imaging | |
| Silva et al. | Accurate Rapid Lifetime Determination on Time‐Gated FLIM Microscopy with Optical Sectioning | |
| JP2010039323A (en) | Confocal microscope | |
| EP3471393A1 (en) | Data recovery device, microscope system, and data recovery method | |
| JP2006221190A (en) | Confocal scanning microscope system | |
| JP2016507739A (en) | Differential infrared nanomicroscopy system and method | |
| EP4019942A1 (en) | Biological tissue identification method, biological tissue identification device, and biological tissue identification program | |
| JP2005214728A (en) | Fluorescence detection device, contrast information correction method, contrast information correction program, and scanning type confocal laser microscope | |
| CN118229527A (en) | A microscope image processing method |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: UNKNOWN |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE INTERNATIONAL PUBLICATION HAS BEEN MADE |
|
| PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: REQUEST FOR EXAMINATION WAS MADE |
|
| 17P | Request for examination filed |
Effective date: 20200512 |
|
| AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| AX | Request for extension of the european patent |
Extension state: BA ME |
|
| DAV | Request for validation of the european patent (deleted) | ||
| DAX | Request for extension of the european patent (deleted) | ||
| GRAP | Despatch of communication of intention to grant a patent |
Free format text: ORIGINAL CODE: EPIDOSNIGR1 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: GRANT OF PATENT IS INTENDED |
|
| INTG | Intention to grant announced |
Effective date: 20210222 |
|
| GRAS | Grant fee paid |
Free format text: ORIGINAL CODE: EPIDOSNIGR3 |
|
| GRAA | (expected) grant |
Free format text: ORIGINAL CODE: 0009210 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE PATENT HAS BEEN GRANTED |
|
| AK | Designated contracting states |
Kind code of ref document: B1 Designated state(s): AL AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MK MT NL NO PL PT RO RS SE SI SK SM TR |
|
| REG | Reference to a national code |
Ref country code: GB Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: REF Ref document number: 1409066 Country of ref document: AT Kind code of ref document: T Effective date: 20210715 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R096 Ref document number: 602018019884 Country of ref document: DE |
|
| REG | Reference to a national code |
Ref country code: IE Ref legal event code: FG4D |
|
| REG | Reference to a national code |
Ref country code: LT Ref legal event code: MG9D |
|
| REG | Reference to a national code |
Ref country code: NL Ref legal event code: MP Effective date: 20210707 |
|
| REG | Reference to a national code |
Ref country code: AT Ref legal event code: MK05 Ref document number: 1409066 Country of ref document: AT Kind code of ref document: T Effective date: 20210707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: NL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: PT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211108 Ref country code: NO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211007 Ref country code: HR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: BG Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211007 Ref country code: AT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: LT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: RS Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: SE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: FI Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: ES Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: PL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: LV Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: GR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20211008 |
|
| REG | Reference to a national code |
Ref country code: DE Ref legal event code: R097 Ref document number: 602018019884 Country of ref document: DE |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: DK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 |
|
| PLBE | No opposition filed within time limit |
Free format text: ORIGINAL CODE: 0009261 |
|
| STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT |
|
| REG | Reference to a national code |
Ref country code: CH Ref legal event code: PL |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: SM Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: SK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: RO Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: EE Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: CZ Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 Ref country code: AL Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 |
|
| 26N | No opposition filed |
Effective date: 20220408 |
|
| REG | Reference to a national code |
Ref country code: BE Ref legal event code: MM Effective date: 20211031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MC Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LU Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211019 Ref country code: BE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: LI Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211031 Ref country code: CH Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211031 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: IE Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES Effective date: 20211019 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: CY Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: HU Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT; INVALID AB INITIO Effective date: 20181019 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MK Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: MT Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 |
|
| PG25 | Lapsed in a contracting state [announced via postgrant information from national office to epo] |
Ref country code: TR Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT Effective date: 20210707 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: DE Payment date: 20251010 Year of fee payment: 8 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: GB Payment date: 20251009 Year of fee payment: 8 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: IT Payment date: 20251014 Year of fee payment: 8 |
|
| PGFP | Annual fee paid to national office [announced via postgrant information from national office to epo] |
Ref country code: FR Payment date: 20251009 Year of fee payment: 8 |