WO2012171999A1 - Method and apparatus for imaging a structure marked with a fluorescent dye - Google Patents

Method and apparatus for imaging a structure marked with a fluorescent dye Download PDF

Info

Publication number
WO2012171999A1
WO2012171999A1 PCT/EP2012/061292 EP2012061292W WO2012171999A1 WO 2012171999 A1 WO2012171999 A1 WO 2012171999A1 EP 2012061292 W EP2012061292 W EP 2012061292W WO 2012171999 A1 WO2012171999 A1 WO 2012171999A1
Authority
WO
WIPO (PCT)
Prior art keywords
fluorescence
scanning
light
scanning range
light beam
Prior art date
Application number
PCT/EP2012/061292
Other languages
French (fr)
Inventor
Stefan W. Hell
Jale SCHNEIDER
Johann Engelhardt
Original Assignee
MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V.
Deutsches Krebsforschungszentrum
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from DE102011051086A external-priority patent/DE102011051086A1/en
Application filed by MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V., Deutsches Krebsforschungszentrum filed Critical MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V.
Priority to EP12728067.5A priority Critical patent/EP2721442B1/en
Publication of WO2012171999A1 publication Critical patent/WO2012171999A1/en
Priority to US14/102,758 priority patent/US20140097358A1/en

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/645—Specially adapted constructive features of fluorimeters
    • G01N21/6456—Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458—Fluorescence microscopy
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/16—Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
    • G—PHYSICS
    • G02—OPTICS
    • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00—Microscopes
    • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365—Control or image processing arrangements for digital or video microscopes

Definitions

  • the present invention relates to a method of imaging a structure marked with a fluorescent dye and to an apparatus for performing such a method. More particular, the present invention relates to a method of imaging a structure marked with a fluorescent dye in a sample, wherein the sample, in a scanning range, is repeatedly scanned with a light intensity distribution localised around a focal point of a focused fluorescence excitation light beam of fluorescence excitation light, wherein the light intensity distribution further includes a fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated such that a fluorescence inhibiting light intensity distribution comprises a minimum at the focal point of the fluorescence excitation light beam, and wherein fluorescence light emitted out of the scanning range is detected and allocated to the actual location of the focal point.
  • the invention particularly relates to an apparatus for executing the method according to any of the preceding claims, which comprises a fluorescence excitation light source for providing a fluorescence excitation light beam of fluorescence excitation light; a fluorescence inhibiting light source for providing a fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated; an objective lens focusing the fluorescence excitation light beam and the fluorescence inhibiting light beam; a raster scanner for repeatedly scanning a scanning range with a light intensity distribution which is localised around a focal point of the focused fluorescence excitation light beam and which further comprises a fluorescence inhibiting light intensity distribution comprising a minimum at the focal point of the fluorescence excitation light beam; a detector detecting fluorescence light emitted out of the scanning range; and an evaluation unit allocating the fluorescence light to the actual location of the focal point in the sample.
  • the invention thus concerns the field of raster fluorescence light microscopy.
  • the present invention concerns high resolution raster fluorescence light microscopy in which measures are taken which allow for allocating fluorescence light emitted out of a scanning range of a sample to a location in the sample at higher spatial resolution than the diffraction barrier at the wavelength of the fluorescence excitation light.
  • This location in the sample which is in fact an area around the focal point of the focused fluorescence excitation light beam comprising the dimensions of the spatial resolution achieved, will also be designated as “measurement area”, here.
  • the term "focal point of the focused fluorescence excitation light beam” refers to the geometric focal point, here.
  • Typical measures taken for increasing the spatial resolution beyond the diffraction barrier involve scanning the sample with a light intensity distribution which extends over a larger volume than the spatial resolution in allocating the fluorescence light to the respective location in the sample.
  • a particular area of the sample has already been subjected to considerable light intensities in scanning the sample with the light intensity distribution before it is reached by the measurement area.
  • the light intensities preceding the actual measurement area may have undesired results like for example an already extensive bleaching of the fluorescent dye. This particularly applies, if the spatial resolution is maximised by high light intensities of the additional light beam.
  • Sensitive fluorescent dyes are thus unsuited for the methods of high resolution scanning fluorescence light microscopy known up to now as they are already subjected to such high light intensities of the fluorescence excitation light beam and a stimulation light beam that they are completely bleached prior to being reached by the measurement area.
  • WO 2010/069987 A1 discloses a method and an apparatus for imaging a structure marked with a fluorescent dye in a sample and relates to the design of a raster scanner.
  • the raster scanner dynamically adjusts the combined fluorescence excitation and stimulation light beams with regard to the pupil of a common focusing optic such that a zero point of the light intensity distribution of the stimulation light at the focal point of the fluorescence excitation light is maintained over the entire scanning range.
  • DE 10 2005 027 896 A1 discloses a method and an apparatus for imaging a structure marked with a fluorescent dye in a sample in which same areas of the sample are only subjected to the light intensity distribution at an optimised temporal repetition interval. This is achieved by providing the light intensity distribution in pulses of comparatively long temporal intervals and/or by comparatively fast scanning the sample with the light intensity distribution. In this way, the intensity of the fluorescence light obtained from the sample is increased as the rate at which the respective fluorescent dye due to further excitation gets out of an excited intermediate state into a permanent or only slowly decaying dark state is strongly reduced.
  • the amount of fluorescence light obtainable from the sample during a certain interval of time is maximised.
  • a repetition frequency of a pulsed light intensity distribution is reduced from 80 MHz to 50 kHz.
  • This known method also reduces a tendency of the fluorescent dye to bleach upon the influence of the light intensity distribution, as a higher population of an excited state out of which a photochemical destruction of the fluorescent dye may occur is avoided.
  • Photochemically bleaching of the fluorescent dye is not the basic problem of DE 10 2005 027 896 A1.
  • the photons from the sample are preferably registered by a one- or two-dimensional light sensor array onto which at least a part of the sample is imaged without variation in time.
  • the focal point of the fluorescence excitation light which is shifted with regard to the sample upon scanning the sample is thus consecutively imaged onto other light sensors, the same light sensor always registering photons out of the same area of the sample.
  • the light sensor array may be a camera, particularly an electronic camera, like for example a CCD or CMOS camera. So far as photons are mentioned in this context in DE 10 2005 027 896 A1 , no reference is made to that individual photons but light intensities of the fluorescence light coming from the sample are detected with the light sensor array.
  • Bio-Rad MRC-500 a confocal microscope designated as Bio-Rad MRC-500 in which a structure marked with a fluorescent dye in a sample is imaged in that at a low excitation for fluorescence the signal of a photomultiplier is correlated to a certain number of photons at the respective image point and that in this way dark noise is filtered of the signal, and in that the numbers of photons registered for the same image point are added over several frames to achieve an enhanced signal-to-noise ratio as compared to simply integrating the signal from the photomultiplier over the same interval of time.
  • WO 201 1/015832 A1 describes a far field scanning microscope, particularly a multi photon laser scanning microscope.
  • the known microscope comprises a laser source for generating an excitation beam, self-focusing means for causing self-focusing of the excitation beam, thereby to reduce its lateral size, means for scanning the excitation beam of reduced size relative to a sample area, and means for forming an image of the sample using light reflected or transmitted through the sample.
  • Self-focusing is a non-linear optical effect, whereby a propagating light source self-focuses in a transparent medium. This is caused by the beam, via the Kerr nonlinear optical effect, interacting with a material with a positive value non-zero order, typically second order, refractive index component.
  • WO 2010/082048 A2 discloses fluorescence microscopy methods and apparatus concerning the control of photobleaching of fluorescence labels during the study of samples by fluorescence microscopy.
  • the idea here is to control the excitation for fluorescence such as to maximise the emission and therefore the information provided by a given type of fluorescence label, whilst reducing or minimising the rate at which the label is photo-bleached.
  • the procedure is determined with a view to increasing the overall emission rate at which the fluorescence labels can relax from their excited state to their ground state for a given experiment and given experimental conditions, whilst reducing the rate at which the fluorescence labels can move from the dark (or triplet) state to the bleached state.
  • the specific characteristics of the fluorescence labels present in the sample are taken into account in devising the experimental procedure.
  • the present invention relates to a method of imaging a structure marked with a fluorescent dye in a sample.
  • the method comprises the steps of repeatedly scanning the sample in a scanning range with a light intensity distribution localised around a focal point of a focused fluorescence excitation light beam of fluorescence excitation light, wherein the light intensity distribution further comprises a focused fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated such that a fluorescence inhibiting light intensity distribution comprises a minimum at the focal point of the fluorescence excitation light beam; detecting fluorescence light emitted out of the scanning range; and allocating the detected fluorescence light to the actual location of the focal point in the sample.
  • scanning conditions which, besides a scanning speed at which the focal point is shifted with regard to the sample and light intensities of the light intensity distribution, include properties and a concentration of the fluorescent dye in the scanning range are coordinated in such a way that the fluorescence light is emitted out of the scanning range as individually detectable photons.
  • An image of the structure is composed of locations which have been allocated to the detected photons during several repetitions of scanning the scanning range.
  • the present invention also relates to an apparatus for executing the method of the present invention .
  • the apparatus comprises a fluorescence excitation light source configured to provide a fluorescence excitation light beam of fluorescence excitation light; a fluorescence inhibiting light source configured to provide a fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated; an objective lens configured to focus the fluorescence excitation light beam and the fluorescence inhibiting light beam; a raster scanner configured to repeatedly scan a scanning range with a light intensity distribution which is localised around a focal point of the focused fluorescence excitation light beam and which further comprises a fluorescence inhibiting light intensity distribution comprising a minimum at the focal point of the fluorescence excitation light beam; a detector configured to detect fluorescence light emitted out of the scanning range; and an evaluation unit configured to allocate the fluorescence light to the actual location of the focal point in the sample.
  • the apparatus further comprises a controller configured to coordinate scanning conditions which, besides a scanning speed at which the focal point is shifted with regard to the sample and light intensities of the light intensity distribution, include properties and a concentration of the fluorescent dye in the scanning range such that the fluorescence light is emitted out of the scanning range as individually detectable photons; and the evaluation unit is configured to compose an image of the structure of locations which have been allocated to the detected photons during several repetitions of scanning the scanning range.
  • Fig. 1 shows the build-up of a STED scanning fluorescence light microscope as an embodiment of the apparatus of the present invention.
  • Fig. 2 shows one scanning of a scanning range with a focal point of an fluorescence excitation light beam in the STED scanning fluorescence light microscope according to Fig. 1 ;
  • Fig. 3 shows an image of a structure in a sample which has been generated from the locations in the sample to which the individually detected photons of fluorescence light out of the scanning range have been allocated after repeatedly scanning the sample according to Fig. 2.
  • the effective imaging speed at which images of the structure of interest are generated is much smaller than the rate at which the scanning range is scanned.
  • the scanning range with the light intensity distribution localised around the focal point of the focused fluorescence excitation light beam, typically only few photons are detected and individually allocated to the respective location of the focal point in the sample.
  • An image of the structure of interest only develops from a higher number of such allocations over several repetitions of scanning the scanning range and progressively becomes complete.
  • each detected photon is taken into account in the method of the present invention, every molecule of the fluorescent dye by which the structure of interest is marked is considered in the image of the structure of interest as soon as it only emits a single photon which is detected afterwards.
  • the method of the present invention is also suitable for highly sensitive fluorescent dyes, i.e. for fluorescent dyes highly susceptible to bleaching.
  • the excitation of the fluorescent dye for emission of fluorescence light at a level of just a few photons during each scanning of the scanning range means that the fluorescent dye in the entire scanning range is only bleached at a very low probability during each repetition of scanning the scanning range. This relation always applies as the probability of bleaching is positively correlated with the probability of the excitation for emission of fluorescence light, independently on how the individual relation looks like.
  • the measurement area which lies within the localised light intensity distribution around the focal point of the focused excitation light beam with which the scanning range is scanned reaches every point of the scanning range prior to that and even a high sensitive fluorescent dye, i.e. a fluorescent dye highly susceptible to bleaching, is bleached at a relevant proportion.
  • a high sensitive fluorescent dye i.e. a fluorescent dye highly susceptible to bleaching
  • the light intensity distribution - besides the fluorescence excitation light beam - includes a further fluorescence inhibiting light beam used for increasing the spatial resolution, such as a stimulation light beam in STED scanning fluorescence light microscopy, whose intensity distribution has a minimum or even a zero point at the focal point of the fluorescence excitation light beam but displays a very high intensity in the surroundings of the focal point of the fluorescence excitation light beam.
  • the bleaching effect of such a fluorescence inhibiting light beam is typically based on its interaction with the fluorescence excitation light beam.
  • the scanning conditions in the method of the invention are selected such that only individual, separately detectable photons are emitted out of the scanning range, this is tantamount to that this interaction only reaches a low level and thus only results into bleaching of the fluorescent dye at a very low probability.
  • the scanning conditions by which it is achieved that the fluorescence light is emitted as individually detectable photons out of the scanning range during scanning - in addition to the scanning speed at which the focal point is shifted with regard to the sample and the light intensities of the light intensity distribution - particularly include the characteristics and the concentration of the fluorescent dye in the scanning range.
  • the light intensity of the focused fluorescence excitation light beam may be reduced, as already mentioned. This reduction may effectively also be realised by high frequently modulating the light intensity of the focused fluorescence excitation light beam.
  • the stress to the fluorescent dye in the sample during each scanning of the scanning range is kept so small that the probability of bleaching a certain molecule of the fluorescent dye in the sample prior to getting into the measurement area around the focal point of the fluorescence excitation light beam during scanning is only small.
  • the probability that this molecule is excited in the measurement area for emission of a photon by fluorescence which is also detected is also not very high at the scanning conditions of the present invention. This probability, however, is much higher than in that case that said molecule of the fluorescent dye has already been bleached by the light intensities preceding the measurement area at a very high probability, prior to getting into the measurement area for the first time.
  • the probability of registering fluorescence light from any molecule of the fluorescent dye in the scanning range may be increased by up to about 25 % even if compared to common methods of STED scanning fluorescence light microscopy with a scanning speed optimally adjusted to the fluorescent dye.
  • the criterion of the present invention can be automated much easier than finding an optimum scanning speed with regard to the yield of fluorescence light in common STED scanning fluorescence light microscopy.
  • the yield of fluorescence light from the fluorescent dye in the entire scanning range maximised by the method of the present invention is virtually always available and is thus frequently higher by much more than 25 % as compared to the yield of fluorescence light which is practically obtained in common STED scanning fluorescence light microscopy.
  • the scanning speed is increased for adjusting the scanning conditions, the desired effect of the reduced stress to the fluorescent dye in the sample during each scanning of the scanning range is achieved without stretching the time for completely performing the method until sufficient photons for an image of the structure of interest in the sample are registered for a long time. It is no relevant feature of the method of the invention to only excite the emission of few photons during a certain interval of time but to only excite the emission of few photons during each repetition of scanning the scanning range.
  • the yield of photons from the sample may be increased in the method of the invention without increasing the bleaching of the fluorescent dye in that the scanning speed and thus the frequency at which the scanning range is scanned is increased.
  • the spatial distributions even of fluorescent dyes which are highly susceptible to bleaching can be registered with high resolution scanning fluorescence light microscopy, particularly with STED scanning fluorescence light microscopy.
  • the scanning speed may actually be set so high that a pixel dwell time of not more than 10 ns, preferably not more than 7 ns and most preferably about 6 ns is achieved.
  • the pixel dwell time is that interval of time within which the geometric focal point covers a distance which corresponds to the resolution of the respective scanning fluorescence light microscopy procedure.
  • the spatial resolution typically is about 20 nm.
  • the scanning speed is then preferably about 3 nm/ns, i.e. 3 m/s or about 10 km/h.
  • the locations allocated to the individual photons during at least 3, preferably at least 20, more preferably at least 100 and most preferably at least 1000 succeeding repetitions of scanning the scanning range are combined into an image of the structure of interest.
  • the locations in the sample which have been allocated to the individual photons during a longer measuring period may also be used to generate a movie, i.e. a series of temporarily succeeding images of the sample, in that a plurality of temporarily succeeding images of the structure are combined from the locations which have been allocated to individual photons during a plurality of succeeding repetitions of scanning the scanning range.
  • This combination takes place in an evaluation stage of the method of the present invention. I.e., without any loss of information, it may be tested how many repetitions of scanning the scanning range have to be combined to provide one image at a desired information density.
  • any method details which are generally known from scanning fluorescence light microscopy to be advantageous may be applied.
  • These method details include concentrating the scanning range to such areas of the sample in which the structure of interest is located. They also include that scanning the scanning range is performed in a precisely defined pattern at an as constant scanning speed and at an as constant line feed as possible.
  • a defined scanning pattern is for example a precondition for determining the location of the focal point of the fluorescence excitation light beam in the sample which is allocated to an individual photon of the fluorescence light emitted out of the scanning range, only from the point in time of the detection of the photon.
  • the coordinates of the location of the focal point in the sample may for example be derived from the count readings of two counters, one of which counting along each line and the other of which counting the line feeds.
  • the fluorescence excitation light source and the fluorescence inhibiting light source which, in an STED scanning fluorescence light microscope, is a stimulation light source may each comprise a continuous wave laser but also a laser pulsed or modulated at a high frequency.
  • the raster scanner typically comprises an electro-optical deflector at least for fast scanning along each line.
  • the line feed may be realised by a comparatively slower scanner, like for example a scanner based on a galvanometer.
  • the detector of the new apparatus is preferably a point detector which may be arranged confocally with regard to the focal point of the fluorescence excitation light beam.
  • a so-called hybrid detector which comprises several detector units to be able to individually detect succeeding photons at a high precision in time, even if the absolute temporal rate of the photons is high.
  • Fig. 1 shows a STED scanning fluorescence light microscope 2 as an example of an apparatus 1 of the present invention.
  • the apparatus 1 comprises an fluorescence excitation light source 3 comprising a laser and providing an fluorescence excitation light beam 4.
  • the wavelength of the fluorescence excitation light beam 4 is selected by an acousto-optically adjustable filter 5 to be able to later chromatically separate the fluorescence excitation light from fluorescence light which is emitted upon excitation by the fluorescence excitation light.
  • a stimulation light source 6 which provides a stimulation light beam 7.
  • the stimulation light beam 7 is formed by an optic 8, deflected towards a dichroic beam splitter 10 by a mirror 9 and its wave fronts are modulated by means of a wave front modulator 1 1 prior to reaching the dichroic beam splitter 10.
  • the dichroic beam splitter 1 0 the fluorescence excitation light beam 4 and the stimulation light beam 7 are merged on one optical axis. Along the optical axis they first pass through an electro-optical modulator 34, before they are deflected by a mirror 12 and pass through an electro-optical deflector 13.
  • a further mirror 17 deflects the light beams into an objective lens 18 in front of which a galvanometer 19 and, as an alternative to the wave front modulator 1 1 , a phase plate 20 are arranged.
  • the objective lens 18 focuses the two light beams 4, 7 into a common focal point in a sample 21.
  • the fluorescence excitation light of the fluorescence excitation light beam 4 has its maximum intensity in this focal point, whereas the stimulation light of the stimulation light beam 7, due to its modulated wave fronts, has a minimum or zero point here.
  • fluorescence light excited by the fluorescence excitation light of the fluorescence excitation light beam 4 may practically only stem from the area directly around the focal point of the fluorescence excitation light beam 4 and thus out of a smaller area than a diffraction-limited spot of the fluorescence excitation light.
  • the fluorescence light 22 from the sample 21 is registered by a detector 23 which is arranged behind the mirror 16, the bandpass filter of the mirror 16 being tuned to the wavelength of the fluorescence light 22.
  • Two mirrors 24 and 25, a two-part optic 26 and a slit diaphragm 27 are provided in the beam path of the isolated fluorescence light 22.
  • the arrangement of the detector 23 is confocal with regard to the focal point of the fluorescence excitation light beam 4 in the sample 21 in one direction.
  • the separated fluorescence light 22, however, is not completely de- scanned at the mirror 16 as the shifts of the light beams 4 and 7 by means of the electro-optical deflector 13 have not yet been reversed.
  • This electro-optical deflector 13 serves for quickly line- wise scanning or rasterising the scanning range in the sample 21 with the focal point of the fluorescence excitation light beam 4.
  • the galvanometer 19 is provided for a somewhat slower line feed between the individual lines in scanning the scanning range.
  • the electro-optical modulator 34 can be used to, for example, provide for a line reset in scanning without subjecting the sample to fluorescence excitation light and stimulation light.
  • Fig. 2 illustrates a scanning range 28 which is scanned with the focal point 29 of the fluorescence excitation light beam 4 according to Fig. 1.
  • the line direction 30 in which a quick scanning occurs is depicted vertically and the line feed direction 31 is depicted horizontally.
  • each line may be 6 ⁇ long and may be scanned within 2 s.
  • the spatial resolution in STED scanning fluorescence light microscopy typically is about 20 nm. This means that each line comprises about 300 resolvable pixels each of which being passed through by the focal point 29 within less than 7 ns.
  • the line feed between two neighbouring lines is in the order of the spatial resolution of 20 nm (Fig.
  • FIG. 3 Such an image is depicted in Fig. 3.
  • the structure 33 of interest becomes apparent by the sum of the individual locations 32 over a plurality of repetitions of scanning the scanning range 28.
  • Such an image may in this way also be recorded, if the fluorescent dye by which the structure 33 is marked is highly susceptible to bleaching due to combined effects of the light intensities of the stimulation light beam 7 and the fluorescence excitation light beam 4 to which it is subjected prior to getting into the measurement area around the focal point 29.
  • the scanning conditions are selected here such that during each scanning of the scanning range 28 only individual photons of fluorescence light are detected, not only the probability of the emission of fluorescence light but also the probability of bleaching the fluorescent dye is low during each scanning of the scanning range 28.
  • any bleaching of the fluorescent dye occurring takes place over many repetitions of scanning the scanning range 28 and is thus evenly distributed over the entire scanning range 28.
  • photons will be detected from all molecules of the fluorescent dye distributed over the entire scanning range 28 at a high probability prior to completely bleaching the fluorescent dye.
  • a sensitive fluorescent dye may already be completely bleached by the preceding light intensities before it is reached by the actual measurement area.

Abstract

In a method for imaging a structure (33) marked with a fluorescent dye in a sample, the sample is repeatedly scanned in a scanning range (28) with a light intensity distribution localised around a focal point (29) of a focused fluorescence excitation light beam. The light intensity distribution further comprises a focused fluorescence inhibiting light beam (7) whose wave fronts are modulated so that a fluorescence inhibiting light intensity distribution comprises a minimum at the focal point (29) of the fluorescence excitation light beam (4). The scanning conditions are coordinated in such a way that the fluorescence light is emitted out of the scanning range (28) as individually detectable photons. When these photons are detected, the location (32) of the focal point (28) at the respective point in time is allocated to them. An image of the structure (33) is composed of the locations (32) to which the detected photons have been allocated during several repetitions of scanning the scanning range (28).

Description

METHOD AND APPARATUS FOR IMAGING A STRUCTURE MARKED WITH A
FLUORESCENT DYE
CROSS REFERENCE TO RELATED APPLICATIONS
This application claims priority to German Patent Application No. DE 10 201 1 051 086.9 filed on June 15, 201 1 and DE 10 201 1 053 739.2 filed on September 19, 201 1 , both entitled "Verfahren und Vorrichtung zur Abbildung einer mit einem Fluoreszenzfarbstoff markierten Struktur in einer Probe".
FIELD
The present invention relates to a method of imaging a structure marked with a fluorescent dye and to an apparatus for performing such a method. More particular, the present invention relates to a method of imaging a structure marked with a fluorescent dye in a sample, wherein the sample, in a scanning range, is repeatedly scanned with a light intensity distribution localised around a focal point of a focused fluorescence excitation light beam of fluorescence excitation light, wherein the light intensity distribution further includes a fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated such that a fluorescence inhibiting light intensity distribution comprises a minimum at the focal point of the fluorescence excitation light beam, and wherein fluorescence light emitted out of the scanning range is detected and allocated to the actual location of the focal point.
With regard to the apparatus, the invention particularly relates to an apparatus for executing the method according to any of the preceding claims, which comprises a fluorescence excitation light source for providing a fluorescence excitation light beam of fluorescence excitation light; a fluorescence inhibiting light source for providing a fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated; an objective lens focusing the fluorescence excitation light beam and the fluorescence inhibiting light beam; a raster scanner for repeatedly scanning a scanning range with a light intensity distribution which is localised around a focal point of the focused fluorescence excitation light beam and which further comprises a fluorescence inhibiting light intensity distribution comprising a minimum at the focal point of the fluorescence excitation light beam; a detector detecting fluorescence light emitted out of the scanning range; and an evaluation unit allocating the fluorescence light to the actual location of the focal point in the sample.
The invention thus concerns the field of raster fluorescence light microscopy. Particularly, the present invention concerns high resolution raster fluorescence light microscopy in which measures are taken which allow for allocating fluorescence light emitted out of a scanning range of a sample to a location in the sample at higher spatial resolution than the diffraction barrier at the wavelength of the fluorescence excitation light. This location in the sample which is in fact an area around the focal point of the focused fluorescence excitation light beam comprising the dimensions of the spatial resolution achieved, will also be designated as "measurement area", here. The term "focal point of the focused fluorescence excitation light beam" refers to the geometric focal point, here.
Typical measures taken for increasing the spatial resolution beyond the diffraction barrier involve scanning the sample with a light intensity distribution which extends over a larger volume than the spatial resolution in allocating the fluorescence light to the respective location in the sample. As a result, a particular area of the sample has already been subjected to considerable light intensities in scanning the sample with the light intensity distribution before it is reached by the measurement area.
In high resolution scanning fluorescence light microscopy, in which, besides the fluorescence excitation light beam of fluorescence excitation light, a further light beam of fluorescence inhibiting light, such as a stimulation light beam in STED scanning fluorescence light microscopy, is used, the light intensities preceding the actual measurement area may have undesired results like for example an already extensive bleaching of the fluorescent dye. This particularly applies, if the spatial resolution is maximised by high light intensities of the additional light beam. Sensitive fluorescent dyes are thus unsuited for the methods of high resolution scanning fluorescence light microscopy known up to now as they are already subjected to such high light intensities of the fluorescence excitation light beam and a stimulation light beam that they are completely bleached prior to being reached by the measurement area.
BACKGROUND OF THE INVENTION
WO 2010/069987 A1 discloses a method and an apparatus for imaging a structure marked with a fluorescent dye in a sample and relates to the design of a raster scanner. The raster scanner dynamically adjusts the combined fluorescence excitation and stimulation light beams with regard to the pupil of a common focusing optic such that a zero point of the light intensity distribution of the stimulation light at the focal point of the fluorescence excitation light is maintained over the entire scanning range.
DE 10 2005 027 896 A1 discloses a method and an apparatus for imaging a structure marked with a fluorescent dye in a sample in which same areas of the sample are only subjected to the light intensity distribution at an optimised temporal repetition interval. This is achieved by providing the light intensity distribution in pulses of comparatively long temporal intervals and/or by comparatively fast scanning the sample with the light intensity distribution. In this way, the intensity of the fluorescence light obtained from the sample is increased as the rate at which the respective fluorescent dye due to further excitation gets out of an excited intermediate state into a permanent or only slowly decaying dark state is strongly reduced. In other words, with a comparatively long repetition interval of subjecting each individual area of the sample to the light intensity distribution, the amount of fluorescence light obtainable from the sample during a certain interval of time is maximised. Particularly, a repetition frequency of a pulsed light intensity distribution is reduced from 80 MHz to 50 kHz. This known method also reduces a tendency of the fluorescent dye to bleach upon the influence of the light intensity distribution, as a higher population of an excited state out of which a photochemical destruction of the fluorescent dye may occur is avoided. Photochemically bleaching of the fluorescent dye, however, is not the basic problem of DE 10 2005 027 896 A1.
If, according to DE 10 2005 027 896 A1 , the scanning speed at which the respective sample is scanned is increased, the photons from the sample are preferably registered by a one- or two-dimensional light sensor array onto which at least a part of the sample is imaged without variation in time. The focal point of the fluorescence excitation light which is shifted with regard to the sample upon scanning the sample is thus consecutively imaged onto other light sensors, the same light sensor always registering photons out of the same area of the sample. Thus, no problem with regard to separating photons out of different areas of the sample is associated with the fast scanning of the sample. The light sensor array may be a camera, particularly an electronic camera, like for example a CCD or CMOS camera. So far as photons are mentioned in this context in DE 10 2005 027 896 A1 , no reference is made to that individual photons but light intensities of the fluorescence light coming from the sample are detected with the light sensor array.
In the praxis of STED scanning fluorescence light microscopy it does not prove as being trivial to find a scanning speed which is advantageous for a certain sample and a fluorescent dye contained in the sample. Thus, in practice, often only a very low yield of fluorescence light is obtained from the sample.
From the Handbook of Biological Confocal Microscopy, a confocal microscope designated as Bio-Rad MRC-500 is known in which a structure marked with a fluorescent dye in a sample is imaged in that at a low excitation for fluorescence the signal of a photomultiplier is correlated to a certain number of photons at the respective image point and that in this way dark noise is filtered of the signal, and in that the numbers of photons registered for the same image point are added over several frames to achieve an enhanced signal-to-noise ratio as compared to simply integrating the signal from the photomultiplier over the same interval of time.
WO 201 1/015832 A1 describes a far field scanning microscope, particularly a multi photon laser scanning microscope. The known microscope comprises a laser source for generating an excitation beam, self-focusing means for causing self-focusing of the excitation beam, thereby to reduce its lateral size, means for scanning the excitation beam of reduced size relative to a sample area, and means for forming an image of the sample using light reflected or transmitted through the sample. Self-focusing is a non-linear optical effect, whereby a propagating light source self-focuses in a transparent medium. This is caused by the beam, via the Kerr nonlinear optical effect, interacting with a material with a positive value non-zero order, typically second order, refractive index component.
WO 2010/082048 A2 discloses fluorescence microscopy methods and apparatus concerning the control of photobleaching of fluorescence labels during the study of samples by fluorescence microscopy. The idea here is to control the excitation for fluorescence such as to maximise the emission and therefore the information provided by a given type of fluorescence label, whilst reducing or minimising the rate at which the label is photo-bleached. This shall be achieved by setting the parameters of the excitation procedure or regime (such as excitation pulse duration, power level, and pulse repetition rate) so that they increase and maximise the total photon emission. The procedure is determined with a view to increasing the overall emission rate at which the fluorescence labels can relax from their excited state to their ground state for a given experiment and given experimental conditions, whilst reducing the rate at which the fluorescence labels can move from the dark (or triplet) state to the bleached state. The specific characteristics of the fluorescence labels present in the sample are taken into account in devising the experimental procedure.
There still is a need for a method and an apparatus for imaging a structure marked with a fluorescent dye in a sample which allow for performing high resolution scanning fluorescence light microscopy even with fluorescent dyes highly susceptible to bleaching.
SUMMARY OF THE INVENTION
The present invention relates to a method of imaging a structure marked with a fluorescent dye in a sample. The method comprises the steps of repeatedly scanning the sample in a scanning range with a light intensity distribution localised around a focal point of a focused fluorescence excitation light beam of fluorescence excitation light, wherein the light intensity distribution further comprises a focused fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated such that a fluorescence inhibiting light intensity distribution comprises a minimum at the focal point of the fluorescence excitation light beam; detecting fluorescence light emitted out of the scanning range; and allocating the detected fluorescence light to the actual location of the focal point in the sample. While performing theses steps, scanning conditions which, besides a scanning speed at which the focal point is shifted with regard to the sample and light intensities of the light intensity distribution, include properties and a concentration of the fluorescent dye in the scanning range are coordinated in such a way that the fluorescence light is emitted out of the scanning range as individually detectable photons. An image of the structure is composed of locations which have been allocated to the detected photons during several repetitions of scanning the scanning range. The present invention also relates to an apparatus for executing the method of the present invention . The apparatus comprises a fluorescence excitation light source configured to provide a fluorescence excitation light beam of fluorescence excitation light; a fluorescence inhibiting light source configured to provide a fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated; an objective lens configured to focus the fluorescence excitation light beam and the fluorescence inhibiting light beam; a raster scanner configured to repeatedly scan a scanning range with a light intensity distribution which is localised around a focal point of the focused fluorescence excitation light beam and which further comprises a fluorescence inhibiting light intensity distribution comprising a minimum at the focal point of the fluorescence excitation light beam; a detector configured to detect fluorescence light emitted out of the scanning range; and an evaluation unit configured to allocate the fluorescence light to the actual location of the focal point in the sample. The apparatus further comprises a controller configured to coordinate scanning conditions which, besides a scanning speed at which the focal point is shifted with regard to the sample and light intensities of the light intensity distribution, include properties and a concentration of the fluorescent dye in the scanning range such that the fluorescence light is emitted out of the scanning range as individually detectable photons; and the evaluation unit is configured to compose an image of the structure of locations which have been allocated to the detected photons during several repetitions of scanning the scanning range.
Other features and advantages of the present invention will become apparent to one with skill in the art upon examination of the following drawings and the detailed description. It is intended that all such additional features and advantages be included herein within the scope of the present invention, as defined by the claims. SHORT DESCRIPTION OF THE DRAWINGS
The invention can be better understood with reference to the following drawings. The components in the drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the present invention. In the drawings, like reference numerals designate corresponding parts throughout the several views.
Fig. 1 shows the build-up of a STED scanning fluorescence light microscope as an embodiment of the apparatus of the present invention.
Fig. 2 shows one scanning of a scanning range with a focal point of an fluorescence excitation light beam in the STED scanning fluorescence light microscope according to Fig. 1 ; and
Fig. 3 shows an image of a structure in a sample which has been generated from the locations in the sample to which the individually detected photons of fluorescence light out of the scanning range have been allocated after repeatedly scanning the sample according to Fig. 2.
DETAILED DESCRIPTION
In the method of the present invention, the effective imaging speed at which images of the structure of interest are generated is much smaller than the rate at which the scanning range is scanned. During each scanning of the scanning range with the light intensity distribution localised around the focal point of the focused fluorescence excitation light beam, typically only few photons are detected and individually allocated to the respective location of the focal point in the sample. An image of the structure of interest only develops from a higher number of such allocations over several repetitions of scanning the scanning range and progressively becomes complete.
In that each detected photon is taken into account in the method of the present invention, every molecule of the fluorescent dye by which the structure of interest is marked is considered in the image of the structure of interest as soon as it only emits a single photon which is detected afterwards. For this reason alone, the method of the present invention is also suitable for highly sensitive fluorescent dyes, i.e. for fluorescent dyes highly susceptible to bleaching. Additionally, the excitation of the fluorescent dye for emission of fluorescence light at a level of just a few photons during each scanning of the scanning range means that the fluorescent dye in the entire scanning range is only bleached at a very low probability during each repetition of scanning the scanning range. This relation always applies as the probability of bleaching is positively correlated with the probability of the excitation for emission of fluorescence light, independently on how the individual relation looks like.
This particularly means that the measurement area which lies within the localised light intensity distribution around the focal point of the focused excitation light beam with which the scanning range is scanned reaches every point of the scanning range prior to that and even a high sensitive fluorescent dye, i.e. a fluorescent dye highly susceptible to bleaching, is bleached at a relevant proportion. This applies although the light intensity distribution - besides the fluorescence excitation light beam - includes a further fluorescence inhibiting light beam used for increasing the spatial resolution, such as a stimulation light beam in STED scanning fluorescence light microscopy, whose intensity distribution has a minimum or even a zero point at the focal point of the fluorescence excitation light beam but displays a very high intensity in the surroundings of the focal point of the fluorescence excitation light beam.
The bleaching effect of such a fluorescence inhibiting light beam is typically based on its interaction with the fluorescence excitation light beam. When the scanning conditions in the method of the invention are selected such that only individual, separately detectable photons are emitted out of the scanning range, this is tantamount to that this interaction only reaches a low level and thus only results into bleaching of the fluorescent dye at a very low probability. The scanning conditions by which it is achieved that the fluorescence light is emitted as individually detectable photons out of the scanning range during scanning - in addition to the scanning speed at which the focal point is shifted with regard to the sample and the light intensities of the light intensity distribution - particularly include the characteristics and the concentration of the fluorescent dye in the scanning range. For coordinating the scanning conditions to the respective fluorescent dye and the respective sample, the light intensity of the focused fluorescence excitation light beam may be reduced, as already mentioned. This reduction may effectively also be realised by high frequently modulating the light intensity of the focused fluorescence excitation light beam.
Independently on how the scanning conditions are coordinated to keep the criterion of the present invention of individually registrable photons of the fluorescence light emitted out of the scanning range, it is achieved that the stress to the fluorescent dye in the sample during each scanning of the scanning range is kept so small that the probability of bleaching a certain molecule of the fluorescent dye in the sample prior to getting into the measurement area around the focal point of the fluorescence excitation light beam during scanning is only small. The probability that this molecule is excited in the measurement area for emission of a photon by fluorescence which is also detected is also not very high at the scanning conditions of the present invention. This probability, however, is much higher than in that case that said molecule of the fluorescent dye has already been bleached by the light intensities preceding the measurement area at a very high probability, prior to getting into the measurement area for the first time.
In the method of the present invention, the probability of registering fluorescence light from any molecule of the fluorescent dye in the scanning range may be increased by up to about 25 % even if compared to common methods of STED scanning fluorescence light microscopy with a scanning speed optimally adjusted to the fluorescent dye. In the practice of the method of the present invention, it proves to be much easier to keep the criterion of the individually registrable photons of the fluorescence light emitted out of the scanning range than to optimise a scanning speed for a fluorescent dye in common methods of STED scanning fluorescence light microscopy. Further, keeping the criterion of the present invention can be automated much easier than finding an optimum scanning speed with regard to the yield of fluorescence light in common STED scanning fluorescence light microscopy. Thus, the yield of fluorescence light from the fluorescent dye in the entire scanning range maximised by the method of the present invention is virtually always available and is thus frequently higher by much more than 25 % as compared to the yield of fluorescence light which is practically obtained in common STED scanning fluorescence light microscopy.
If, in the method of the present invention, the scanning speed is increased for adjusting the scanning conditions, the desired effect of the reduced stress to the fluorescent dye in the sample during each scanning of the scanning range is achieved without stretching the time for completely performing the method until sufficient photons for an image of the structure of interest in the sample are registered for a long time. It is no relevant feature of the method of the invention to only excite the emission of few photons during a certain interval of time but to only excite the emission of few photons during each repetition of scanning the scanning range. Thus, the yield of photons from the sample may be increased in the method of the invention without increasing the bleaching of the fluorescent dye in that the scanning speed and thus the frequency at which the scanning range is scanned is increased.
In the method of the present invention, the spatial distributions even of fluorescent dyes which are highly susceptible to bleaching can be registered with high resolution scanning fluorescence light microscopy, particularly with STED scanning fluorescence light microscopy.
In adjusting the scanning conditions the scanning speed may actually be set so high that a pixel dwell time of not more than 10 ns, preferably not more than 7 ns and most preferably about 6 ns is achieved. The pixel dwell time is that interval of time within which the geometric focal point covers a distance which corresponds to the resolution of the respective scanning fluorescence light microscopy procedure. In STED scanning fluorescence light microscopy, the spatial resolution typically is about 20 nm. Correspondingly, the scanning speed is then preferably about 3 nm/ns, i.e. 3 m/s or about 10 km/h.
Due to the small number of photons which are detected during each scanning of the scanning range and allocated to individual locations in the sample in the method of the invention, the locations allocated to the individual photons during at least 3, preferably at least 20, more preferably at least 100 and most preferably at least 1000 succeeding repetitions of scanning the scanning range are combined into an image of the structure of interest.
The locations in the sample which have been allocated to the individual photons during a longer measuring period may also be used to generate a movie, i.e. a series of temporarily succeeding images of the sample, in that a plurality of temporarily succeeding images of the structure are combined from the locations which have been allocated to individual photons during a plurality of succeeding repetitions of scanning the scanning range. This combination takes place in an evaluation stage of the method of the present invention. I.e., without any loss of information, it may be tested how many repetitions of scanning the scanning range have to be combined to provide one image at a desired information density.
It is appreciated that in the method of the invention any method details which are generally known from scanning fluorescence light microscopy to be advantageous may be applied. These method details, for example, include concentrating the scanning range to such areas of the sample in which the structure of interest is located. They also include that scanning the scanning range is performed in a precisely defined pattern at an as constant scanning speed and at an as constant line feed as possible. A defined scanning pattern is for example a precondition for determining the location of the focal point of the fluorescence excitation light beam in the sample which is allocated to an individual photon of the fluorescence light emitted out of the scanning range, only from the point in time of the detection of the photon. With a constant scanning speed and a constant line feed, the coordinates of the location of the focal point in the sample may for example be derived from the count readings of two counters, one of which counting along each line and the other of which counting the line feeds.
In the apparatus of the present invention, the fluorescence excitation light source and the fluorescence inhibiting light source which, in an STED scanning fluorescence light microscope, is a stimulation light source may each comprise a continuous wave laser but also a laser pulsed or modulated at a high frequency. The raster scanner typically comprises an electro-optical deflector at least for fast scanning along each line. The line feed may be realised by a comparatively slower scanner, like for example a scanner based on a galvanometer.
The detector of the new apparatus is preferably a point detector which may be arranged confocally with regard to the focal point of the fluorescence excitation light beam. Particularly preferred, it is a so-called hybrid detector which comprises several detector units to be able to individually detect succeeding photons at a high precision in time, even if the absolute temporal rate of the photons is high.
Further preferred details of the apparatus of the invention have already been explained when explaining the method of the invention.
Referring now in greater detail to the drawings, Fig. 1 shows a STED scanning fluorescence light microscope 2 as an example of an apparatus 1 of the present invention. The apparatus 1 comprises an fluorescence excitation light source 3 comprising a laser and providing an fluorescence excitation light beam 4. The wavelength of the fluorescence excitation light beam 4 is selected by an acousto-optically adjustable filter 5 to be able to later chromatically separate the fluorescence excitation light from fluorescence light which is emitted upon excitation by the fluorescence excitation light. Besides the fluorescence excitation light source 3, there is a stimulation light source 6 which provides a stimulation light beam 7. The stimulation light beam 7 is formed by an optic 8, deflected towards a dichroic beam splitter 10 by a mirror 9 and its wave fronts are modulated by means of a wave front modulator 1 1 prior to reaching the dichroic beam splitter 10. By means of the dichroic beam splitter 1 0 the fluorescence excitation light beam 4 and the stimulation light beam 7 are merged on one optical axis. Along the optical axis they first pass through an electro-optical modulator 34, before they are deflected by a mirror 12 and pass through an electro-optical deflector 13. An optic 14 for beam shaping, a deflection arrangement made of a mirror 15 and a further mirror 16 also serving as a bandpass filter follow. Afterwards, a further mirror 17 deflects the light beams into an objective lens 18 in front of which a galvanometer 19 and, as an alternative to the wave front modulator 1 1 , a phase plate 20 are arranged. The objective lens 18 focuses the two light beams 4, 7 into a common focal point in a sample 21. The fluorescence excitation light of the fluorescence excitation light beam 4 has its maximum intensity in this focal point, whereas the stimulation light of the stimulation light beam 7, due to its modulated wave fronts, has a minimum or zero point here. As the stimulation light of the stimulation light beam 7 has a fluorescence inhibiting effect, fluorescence light excited by the fluorescence excitation light of the fluorescence excitation light beam 4 may practically only stem from the area directly around the focal point of the fluorescence excitation light beam 4 and thus out of a smaller area than a diffraction-limited spot of the fluorescence excitation light. The fluorescence light 22 from the sample 21 is registered by a detector 23 which is arranged behind the mirror 16, the bandpass filter of the mirror 16 being tuned to the wavelength of the fluorescence light 22. Two mirrors 24 and 25, a two-part optic 26 and a slit diaphragm 27 are provided in the beam path of the isolated fluorescence light 22. Due to the slit diaphragm27, the arrangement of the detector 23 is confocal with regard to the focal point of the fluorescence excitation light beam 4 in the sample 21 in one direction. The separated fluorescence light 22, however, is not completely de- scanned at the mirror 16 as the shifts of the light beams 4 and 7 by means of the electro-optical deflector 13 have not yet been reversed. This electro-optical deflector 13 serves for quickly line- wise scanning or rasterising the scanning range in the sample 21 with the focal point of the fluorescence excitation light beam 4. On the other hand, the galvanometer 19 is provided for a somewhat slower line feed between the individual lines in scanning the scanning range. The electro-optical modulator 34 can be used to, for example, provide for a line reset in scanning without subjecting the sample to fluorescence excitation light and stimulation light.
Fig. 2 illustrates a scanning range 28 which is scanned with the focal point 29 of the fluorescence excitation light beam 4 according to Fig. 1. Here, the line direction 30 in which a quick scanning occurs is depicted vertically and the line feed direction 31 is depicted horizontally. For example, each line may be 6 μηη long and may be scanned within 2 s. The spatial resolution in STED scanning fluorescence light microscopy typically is about 20 nm. This means that each line comprises about 300 resolvable pixels each of which being passed through by the focal point 29 within less than 7 ns. In the line feed direction 21 , the line feed between two neighbouring lines is in the order of the spatial resolution of 20 nm (Fig. 2 is not at the same scale in line direction 30 and in line feed direction 31 ). Photons individually detected by means of the detector 23 according to Fig. 1 during scanning the scanning range 28 with the focal point 29 are allocated to locations 32 at which the focal point 29 was when the respective photons were emitted and detected. From the information obtained in this way over several repetitions of scanning the scanning range 28 an image is composed which represents the distribution of the fluorescence light from the sample and which is thus a depiction of a structure which is marked with a fluorescent dye emitting this fluorescence light in the sample.
Such an image is depicted in Fig. 3. The structure 33 of interest becomes apparent by the sum of the individual locations 32 over a plurality of repetitions of scanning the scanning range 28. Such an image may in this way also be recorded, if the fluorescent dye by which the structure 33 is marked is highly susceptible to bleaching due to combined effects of the light intensities of the stimulation light beam 7 and the fluorescence excitation light beam 4 to which it is subjected prior to getting into the measurement area around the focal point 29. In that the scanning conditions are selected here such that during each scanning of the scanning range 28 only individual photons of fluorescence light are detected, not only the probability of the emission of fluorescence light but also the probability of bleaching the fluorescent dye is low during each scanning of the scanning range 28. Any bleaching of the fluorescent dye occurring takes place over many repetitions of scanning the scanning range 28 and is thus evenly distributed over the entire scanning range 28. As a result, photons will be detected from all molecules of the fluorescent dye distributed over the entire scanning range 28 at a high probability prior to completely bleaching the fluorescent dye. In contrast, in common STED scanning fluorescence light microscopy in which at each location of the focal point 29 as much fluorescence light as possible is registered, a sensitive fluorescent dye may already be completely bleached by the preceding light intensities before it is reached by the actual measurement area.
Many variations and modifications may be made to the preferred embodiments of the invention without departing substantially from the spirit and principles of the invention. All such modifications and variations are intended to be included herein within the scope of the present invention, as defined by the following claims.
LIST OF REFERENCE NUMERALS apparatus
STED scanning fluorescence light microscope fluorescence excitation light source
fluorescence excitation light beam
acousto-optically adjustable filter
stimulation light source
stimulation light beam
optic
mirror
dichroic beam splitter
wave front modulator
mirror
electro-optical deflector
optic
mirror
mirror with bandpass filter
mirror
objective lens
galvanometer
phase plate
sample
fluorescence light
detector
mirror
mirror
optic
slit diaphragm
scanning range
focal point
line direction
line feed direction
location structure
electro-optical modulator

Claims

1 . A method of imaging a structure (33) marked with a fluorescent dye in a sample (21 ), comprising
repeatedly scanning the sample (21 ) in a scanning range (28) with a light intensity distribution localised around a focal point (29) of a focused fluorescence excitation light beam (4) of fluorescence excitation light, wherein the light intensity distribution further comprises a focused fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated such that a fluorescence inhibiting light intensity distribution comprises a minimum at the focal point (29) of the fluorescence excitation light beam (4); detecting fluorescence light (22) emitted out of the scanning range (28); and allocating the detected fluorescence light (22) to the actual location (32) of the focal point (29) in the sample (21 );
wherein scanning conditions which, besides a scanning speed at which the focal point (29) is shifted with regard to the sample (21 ) and light intensities of the light intensity distribution, include properties and a concentration of the fluorescent dye in the scanning range (28) are coordinated in such a way that the fluorescence light (22) is emitted out of the scanning range (28) as individually detectable photons; and
wherein an image of the structure (33) is composed of locations (32) which have been allocated to the detected photons during several repetitions of scanning the scanning range.
2. The method of claim 1 , wherein the scanning conditions are coordinated in such a way that the fluorescence light (22) is emitted out of the scanning range (28) as temporarily separated individual photons.
3. The method of any of the preceding claims, wherein the light intensity of the focused fluorescence excitation light beam (4) is reduced for coordinating the scanning conditions.
4. The method of any of the preceding claims, wherein the light intensity of the focused fluorescence excitation light beam (4) is high frequently modulated for coordinating the scanning conditions.
5. The method of any of the preceding claims, wherein the scanning speed is increased for coordinating the scanning conditions.
6. The method of any of the preceding claims, wherein, in coordinating the scanning conditions, the scanning speed is set so high that a pixel dwell time of not more than 10 ns, preferably of not more than 7 ns is achieved.
7. The method of any of the preceding claims, wherein an image of the structure (33) is composed of locations (32) which have been allocated to the individual photons during at least 3, preferably at least 20, more preferably at least 100 and most preferably at least 1000 succeeding repetitions of scanning the scanning range (28).
8. The method of any of the preceding claims, wherein several temporarily succeeding images of the structure (33) are composed of locations (32) which have been allocated to the individual photons during a plurality of succeeding repetitions of scanning the scanning range (28).
9. An apparatus (1 ) for executing the method according to any of the preceding claims, the apparatus comprising
a fluorescence excitation light source (3) configured to provide a fluorescence excitation light beam (4) of fluorescence excitation light;
a fluorescence inhibiting light source configured to provide a fluorescence inhibiting light beam of fluorescence inhibiting light whose wave fronts are modulated;
an objective lens (18) configured to focus the fluorescence excitation light beam (4) and the fluorescence inhibiting light beam;
a raster scanner configured to repeatedly scan a scanning range (28) with a light intensity distribution which is localised around a focal point (29) of the focused fluorescence excitation light beam (4) and which further comprises a fluorescence inhibiting light intensity distribution comprising a minimum at the focal point (29) of the fluorescence excitation light beam (4);
a detector (23) configured to detect fluorescence light (22) emitted out of the scanning range (28); and
an evaluation unit configured to allocate the fluorescence light to the actual location of the focal point (29) in the sample (21 ),
wherein the apparatus further comprises a controller configured to coordinate scanning conditions which, besides a scanning speed at which the focal point (29) is shifted with regard to the sample and light intensities of the light intensity distribution, include properties and a concentration of the fluorescent dye in the scanning range (28) such that the fluorescence l ight (22) is emitted out of the scanning range (28) as individually detectable photons; and
wherein the evaluation unit is configured to compose an image of the structure (23) of locations (32) which have been allocated to the detected photons during several repetitions of scanning the scanning range (28).
10. The apparatus (1 ) of claim 9, wherein the controller adjusts the scanning conditions such that the fluorescence light (22) is emitted as temporarily separated individual photons out of the scanning range (28).
1 1 . The apparatus (1 ) of claim 9 or 10, wherein the fluorescence excitation light source (3) and the stimulation light source (6) each comprise a continuous wave laser or a high frequently pulsed laser.
12. The apparatus (1 ) of any of the preceding claims 9 to 1 1 , wherein the raster scanner comprises an electro-optical deflector.
13. The apparatus (1 ) of any of the preceding claims 9 to 12, wherein the detector (23) is a point detector.
14. The apparatus (1 ) of any of the preceding claims 9 to 13, wherein the detector (23) is a hybrid detector.
15. The apparatus (1 ) of any of the preceding claims, wherein the evaluation unit is configured to compose a plurality of temporarily succeeding images of the structure (23) of the locations (32) which have been allocated to the individual photons during a plurality of succeeding repetitions of scanning the scanning range (28).
PCT/EP2012/061292 2011-06-15 2012-06-14 Method and apparatus for imaging a structure marked with a fluorescent dye WO2012171999A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
EP12728067.5A EP2721442B1 (en) 2011-06-15 2012-06-14 Method and apparatus for imaging a structure marked with a fluorescent dye
US14/102,758 US20140097358A1 (en) 2011-06-15 2013-12-11 Method and Apparatus for Imaging a Structure Marked with a Fluorescent Dye

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
DE102011051086.9 2011-06-15
DE102011051086A DE102011051086A1 (en) 2011-06-15 2011-06-15 Method for imaging fluorescent dye with labeled structure in sample, involves emitting fluorescent light in form of detectable photons, and assigning image of structure from location to photons over repetitive scanning of scanning area
DE102011053739.2 2011-09-19
DE102011053739 2011-09-19

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US14/102,758 Continuation-In-Part US20140097358A1 (en) 2011-06-15 2013-12-11 Method and Apparatus for Imaging a Structure Marked with a Fluorescent Dye

Publications (1)

Publication Number Publication Date
WO2012171999A1 true WO2012171999A1 (en) 2012-12-20

Family

ID=46319120

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2012/061292 WO2012171999A1 (en) 2011-06-15 2012-06-14 Method and apparatus for imaging a structure marked with a fluorescent dye

Country Status (3)

Country Link
US (1) US20140097358A1 (en)
EP (1) EP2721442B1 (en)
WO (1) WO2012171999A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102013114860B3 (en) * 2013-12-23 2015-05-28 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. Method and device for determining the locations of individual molecules of a substance in a sample
CN104903701A (en) * 2013-01-09 2015-09-09 马克思-普朗克科学促进协会 Method for spatially high-resolved imaging of a structure of a sample that has a luminophore
CN104919303A (en) * 2013-01-09 2015-09-16 马克思-普朗克科学促进协会 Method for spatially high-resolved imaging of a structure of a sample that has a luminophore
JP2017072586A (en) * 2015-09-22 2017-04-13 マックス−プランク−ゲゼルシャフト ツール フェルデルンク デル ヴィッセンシャフテン エー．ファウ． Locally imaging structure in sample at high spatial resolution
DE102016119262A1 (en) 2016-10-10 2018-04-12 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample
DE102016119263A1 (en) 2016-10-10 2018-04-12 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample
DE102016119264A1 (en) 2016-10-10 2018-04-12 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample
WO2018069283A1 (en) 2016-10-10 2018-04-19 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. Method for the high spatial resolution localization of an individualized molecule which can be excited with excitation light in order to emit luminescent light in a sample
JP2019507921A (en) * 2016-03-07 2019-03-22 マックス−プランク−ゲゼルシャフト ツア フェルデルング デア ヴィッセンシャフテン イー．ヴイ．Ｍａｘ−Ｐｌａｎｃｋ−Ｇｅｓｅｌｌｓｃｈａｆｔ ｚｕｒ Ｆｏｒｄｅｒｕｎｇ ｄｅｒ Ｗｉｓｓｅｎｓｃｈａｆｔｅｎ ｅ．Ｖ． How to transport between a large number of target-specific locations

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102016103382B3 (en) 2016-02-25 2017-08-10 Abberior Instruments Gmbh Method, apparatus and laser scanning microscope for generating rastered images
EP3857284B1 (en) * 2018-09-27 2023-12-27 Max-Planck-Gesellschaft zur Förderung der Wissenschaften e.V. Method of and apparatus for forming and shifting a light intensity distribution in a focal area of an objective lens

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050024637A1 (en) * 2003-08-02 2005-02-03 Leical Microsystems Heidelberg Gmbh Detector and method for detecting weak fluorescent radiation with a microscope system
DE102005027896A1 (en) 2005-06-16 2006-12-28 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. Method and apparatus for optically measuring a sample
US20070291353A1 (en) * 2004-08-09 2007-12-20 Olympus Corporation Super-Resolution Microscope
WO2010069987A1 (en) 2008-12-19 2010-06-24 Deutsches Krebsforschungszentrum Method and device for dynamically shifting a light beam relative to an optic which focuses the light beam
WO2010082048A2 (en) 2009-01-14 2010-07-22 Perkinelmer Singapore Pte Ltd Fluorescence microscopy methods and apparatus
WO2011015832A1 (en) 2009-08-07 2011-02-10 University Of Strathclyde Far field scanning microscope
US20110081653A1 (en) * 2008-05-21 2011-04-07 Max-Planck-Gesellschaft Zur Forderung Der Wissenschaftern E.V. High Spatial Resolution Imaging of a Structure of Interest in a Specimen

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5995264A (en) * 1998-01-20 1999-11-30 University Of Washington Counter balanced optical scanner
US7835000B2 (en) * 2006-11-03 2010-11-16 Los Alamos National Security, Llc System and method for measuring particles in a sample stream of a flow cytometer or the like

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050024637A1 (en) * 2003-08-02 2005-02-03 Leical Microsystems Heidelberg Gmbh Detector and method for detecting weak fluorescent radiation with a microscope system
US20070291353A1 (en) * 2004-08-09 2007-12-20 Olympus Corporation Super-Resolution Microscope
DE102005027896A1 (en) 2005-06-16 2006-12-28 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. Method and apparatus for optically measuring a sample
US20110081653A1 (en) * 2008-05-21 2011-04-07 Max-Planck-Gesellschaft Zur Forderung Der Wissenschaftern E.V. High Spatial Resolution Imaging of a Structure of Interest in a Specimen
WO2010069987A1 (en) 2008-12-19 2010-06-24 Deutsches Krebsforschungszentrum Method and device for dynamically shifting a light beam relative to an optic which focuses the light beam
WO2010082048A2 (en) 2009-01-14 2010-07-22 Perkinelmer Singapore Pte Ltd Fluorescence microscopy methods and apparatus
WO2011015832A1 (en) 2009-08-07 2011-02-10 University Of Strathclyde Far field scanning microscope

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104903701A (en) * 2013-01-09 2015-09-09 马克思-普朗克科学促进协会 Method for spatially high-resolved imaging of a structure of a sample that has a luminophore
CN104919303A (en) * 2013-01-09 2015-09-16 马克思-普朗克科学促进协会 Method for spatially high-resolved imaging of a structure of a sample that has a luminophore
CN104903701B (en) * 2013-01-09 2017-06-23 马克思-普朗克科学促进协会 For the method for the spatial high resolution imaging of the structure with illuminator of sample
DE102013114860B3 (en) * 2013-12-23 2015-05-28 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. Method and device for determining the locations of individual molecules of a substance in a sample
US9719928B2 (en) 2013-12-23 2017-08-01 Max-Planck-Gesellschaft Zur Foerderung Der Wissenschaften E.V. High-resolution fluorescence microscopy using a structured beam of excitation light
JP2017072586A (en) * 2015-09-22 2017-04-13 マックス−プランク−ゲゼルシャフト ツール フェルデルンク デル ヴィッセンシャフテン エー．ファウ． Locally imaging structure in sample at high spatial resolution
JP7027316B2 (en) 2016-03-07 2022-03-01 マックス－プランク－ゲゼルシャフト ツア フェルデルング デア ヴィッセンシャフテン イー．ヴイ． How to transport between a large number of target-specific locations
JP2019507921A (en) * 2016-03-07 2019-03-22 マックス−プランク−ゲゼルシャフト ツア フェルデルング デア ヴィッセンシャフテン イー．ヴイ．Ｍａｘ−Ｐｌａｎｃｋ−Ｇｅｓｅｌｌｓｃｈａｆｔ ｚｕｒ Ｆｏｒｄｅｒｕｎｇ ｄｅｒ Ｗｉｓｓｅｎｓｃｈａｆｔｅｎ ｅ．Ｖ． How to transport between a large number of target-specific locations
DE102016119264A1 (en) 2016-10-10 2018-04-12 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample
WO2018069283A1 (en) 2016-10-10 2018-04-19 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. Method for the high spatial resolution localization of an individualized molecule which can be excited with excitation light in order to emit luminescent light in a sample
DE102016119264B4 (en) 2016-10-10 2018-05-30 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample
DE102016119262B4 (en) 2016-10-10 2018-06-07 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample
DE102016119263B4 (en) 2016-10-10 2018-06-07 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample
DE102016119263A1 (en) 2016-10-10 2018-04-12 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample
US10900901B2 (en) 2016-10-10 2021-01-26 Max-Planck-Gesellschaft Zur Foerderung Der Wissenschaften E.V. Method of high spatial resolution determining a position of a singularized molecule which is excitable for emission of luminescence light
US10908089B2 (en) 2016-10-10 2021-02-02 Max-Planck-Gesellschaft Zur Foerderung Der Wissenschaften E.V. Method of high spatial resolution determining a position of a singularized molecule which is excitable for emission of luminescence light
US10962479B2 (en) 2016-10-10 2021-03-30 Max-Planck-Gesellschaft Zur Foerderung Der Wissenschaften E.V. Method of high spatial resolution determining a position of a singularized molecule which is excitable for emission of luminescence light
DE102016119262A1 (en) 2016-10-10 2018-04-12 MAX-PLANCK-Gesellschaft zur Förderung der Wissenschaften e.V. A method for spatially high-resolution determination of the location of a singled, excitable light for the emission of luminescent light molecule in a sample

Also Published As

Publication number Publication date
EP2721442A1 (en) 2014-04-23
US20140097358A1 (en) 2014-04-10
EP2721442B1 (en) 2020-01-08

Similar Documents

Publication Publication Date Title
EP2721442B1 (en) Method and apparatus for imaging a structure marked with a fluorescent dye
JP6771490B2 (en) Evaluation of fluorescence scanning microscopy signals using a confocal laser scanning microscope
CN109477784B (en) Fluorescence imaging flow cytometry with enhanced image resolution
US7863585B2 (en) STED-fluorescent light microscopy with two-photon excitation
US8921809B2 (en) Device for microscopy having selective illumination of a plane
JP5776992B2 (en) STED microscopy, STED fluorescence correlation spectroscopy, and STED fluorescence microscope for pulse excitation, continuous deexcitation, and gate recording of spontaneous emission fluorescence
US10955348B2 (en) Method of locally imaging a structure in a sample at high spatial resolution in order to detect reactions of an object of interest to altered environmental conditions
JP5894180B2 (en) Microscope inspection with improved depth resolution
Becker et al. Picosecond fluorescence lifetime microscopy by TCSPC imaging
US9891417B2 (en) Locally imaging a structure in a sample at high spatial resolution
US20200150446A1 (en) Method and System for Improving Lateral Resolution in Optical Scanning Microscopy
US20110226965A1 (en) Increased resolution microscopy
US11237370B2 (en) Multiple inclined beam line-scanning imaging apparatus, methods, and applications
US8198604B2 (en) System and method for providing enhanced background rejection in thick tissue with differential-aberration two-photon microscopy
US11143854B2 (en) Method for imaging a sample using a fluorescence microscope with stimulated emission depletion
JP2010505094A (en) Luminescence microscopy with increased resolution
US20230384223A1 (en) Method and fluorescence microscope for determining the location of individual fluorescent dye molecules by means of adaptive scanning
US20160195704A1 (en) High-resolution 3d fluorescence microscopy
US10776955B2 (en) Method for the analysis of spatial and temporal information of samples by means of optical microscopy
JP6127818B2 (en) Method for setting adaptive optical element and microscope
JP6928757B2 (en) Systems and methods for image processing in light microscopy
US10539505B2 (en) Method for creating a digital fluorescent image
JP5655434B2 (en) Observation apparatus and observation method
US20220043248A1 (en) Method and microscope for the high-resolution imaging of a specimen by light microscopy
US20220137383A1 (en) Apparatus and method for capturing image data

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12728067

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE