US20070178602A1 - Method to be used in fluoresence microscopy - Google Patents

Method to be used in fluoresence microscopy Download PDF

Info

Publication number
US20070178602A1
US20070178602A1 US10/560,426 US56042604A US2007178602A1 US 20070178602 A1 US20070178602 A1 US 20070178602A1 US 56042604 A US56042604 A US 56042604A US 2007178602 A1 US2007178602 A1 US 2007178602A1
Authority
US
United States
Prior art keywords
reference spectra
recording
dyes
occurs
fluorescence
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US10/560,426
Other versions
US7688442B2 (en
Inventor
Ralf Wolleschensky
Bernhard Zimmermann
Richard Ankerhold
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Carl Zeiss Microscopy GmbH
Original Assignee
Carl Zeiss Jena GmbH
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Carl Zeiss Jena GmbH filed Critical Carl Zeiss Jena GmbH
Assigned to CARL ZEISS JENA GMBH reassignment CARL ZEISS JENA GMBH ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: ANKERHOLD, RICHARD, WOLLESCHENSKY, RALF, ZIMMERMANN, BERNHARD
Publication of US20070178602A1 publication Critical patent/US20070178602A1/en
Assigned to CARL ZEISS MICROIMAGING GMBH reassignment CARL ZEISS MICROIMAGING GMBH ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: CARL ZEISS JENA GMBH
Application granted granted Critical
Publication of US7688442B2 publication Critical patent/US7688442B2/en
Assigned to CARL ZEISS MICROSCOPY GMBH reassignment CARL ZEISS MICROSCOPY GMBH CHANGE OF NAME (SEE DOCUMENT FOR DETAILS). Assignors: CARL ZEISS MICROIMAGING GMBH
Active legal-status Critical Current
Adjusted expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6402Atomic fluorescence; Laser induced fluorescence
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/16Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N2021/6417Spectrofluorimetric devices

Definitions

  • the invention relates to a method used in fluorescence microscopy, especially laser scanning microscopy, in general, and to the use of dyes for image evaluation, in particular.
  • fluorescence microscopy A conventional application of light microscopy for investigation of biological preparations is fluorescence microscopy which is discussed in the “Handbook of Biological Confocal Microscopy, Second Edition”, Pawley, Plenum Press, 1995 . Specific dyes are used in fluorescence microscopy for specific marking of tissues, cells, cell parts, or other materials.
  • the emitted photons of a specific energy excite the dye molecules from the ground state to an excited state by absorption of a photon.
  • This excitation is generally referred to as one-photon absorption (See FIG. 1 a ).
  • the dye molecules so excited can return in different ways to the ground state.
  • the wavelength of the emitted photon is generally red-shifted based on the Stokes Shift in comparison to the excitation radiation and therefore has a greater wavelength.
  • the Stokes Shift permits separation of the fluorescence radiation from the excitation radiation.
  • FIG.1 b A multiphoton excitation is shown in FIG.1 b .
  • the fluorescence light is split and observed separately from the excitation radiation with appropriate dichroic beam splitters in combination with block filters.
  • the depiction of individual cell parts stained with different dyes is possible on this account.
  • several parts of a preparation, in principle, can also be simultaneously stained with different dyes by specifically adding dyes resulting in multiple fluorescence.
  • Special dichroic beam splitters are again used to distinguish the fluorescence signals emitted by the individual dyes.
  • LSM confocal laser scanning microscope
  • different wavelengths are used in an LSM laser.
  • the choice of excitation wavelength is guided according to the absorption properties of the dyes being investigated.
  • the excitation radiation is generated in the light source module L.
  • Different lasers 13.1 and 13.2 are used here (for example, argon, argon-krypton, TiSa lasers).
  • Selection of the wavelength and adjustment of the intensity of the required excitation wavelength additionally occurs in the light source module L, for example by using an acousto-optic crystal 15.1 and 15.2.
  • the laser radiation then goes to the scan module S via a fiber 14.1 and 14.2 and/or appropriate mirror arrangement.
  • the laser radiation generated in the light source is focused into the preparation with limited diffraction with objective 4 via the scanner 23 , scan optics 16 and 17 and tube lens 9 .
  • the focus scans the sample in the x-y direction point-like.
  • the pixel residence times during scanning over the sample are generally in the range of less than a microsecond to a few seconds.
  • the light emitted from the focal plane (specimen) 5 and from the overlying and underlying planes goes to a dichroic beam splitter (MDB) 24 via the scanner 23 .
  • MDB dichroic beam splitter
  • the fluorescence light is then focused on a diaphragm (confocal diaphragm/pinhole) 29 , which is situated precisely in a plane conjugated to the focal plane. Fluorescence light fractions outside of the focus are suppressed on this account.
  • EF dichroic block filter
  • the fluorescence light is measured by means of a point detector (PMT) 31 .
  • excitation of dye fluorescence occurs in a small volume on which the excitation intensity is particularly high. This region is only slightly larger than the detected region during use of a confocal arrangement.
  • the use of a confocal diaphragm can therefore be omitted and detection can occur directly after the objective 5 in the nondescanned detection region 71 of the microscope.
  • Only the plane (optical section) that is situated in the focal plane of the objective is detected by a three-dimensionally illuminated image by both detection arrangements in conjunction with the corresponding one photon or multiphoton absorption.
  • a three-dimensional image of the sample can then be generated in computer-controlled fashion.
  • the LMS is therefore suitable for investigating thick preparations.
  • the excitation wavelengths are determined by the employed dye with specific absorption properties.
  • Dichroic filters 30 adjusted to the emission properties of the dye ensure that only the fluorescence light emitted by the corresponding dye is measured by the point detector.
  • the previous detection devices reach their limits.
  • the spectral detection range In order to avoid overlap between two dyes, the spectral detection range must be restricted. The range in which the two dyes overlap is simply cut out for this purpose and not detected. The efficiency of the detection unit therefore deteriorates. An equal signal-to-noise ratio can only be achieved by increasing the excitation power, through which preparation damage can occur.
  • a maximum of up to six different dye probes are therefore simultaneously used, since the dyes otherwise could not be separated owing to the strongly overlapping emission bands.
  • FIG. 3 shows the emission spectra of different typical dyes.
  • the emission signal is plotted as a function of wavelength.
  • the dyes denoted 1 to 4 differ in position and form of their emission spectra. These dyes, however, are in most cases toxic for living preparations. Investigation of the evolution of cell structure in living preparations is therefore impossible.
  • fluorescing proteins GFP, YFP, CFP, TOPAS, GFT, RFP
  • Fluorescence dyes for specific marking of preparations are used in all of the aforementioned systems.
  • the present invention covers a method using fluorescence microscopy for image evaluation using a laser scanning microscope in which an at least partially spectrally resolved detection of the fluorescence spectrum occurs.
  • Reference spectra are used for spectral demixing.
  • Temporally and/or spectrally variable dyes and/or dye combinations are employed for recording of the reference spectra. Finally, the recorded reference spectra are inspected for image evaluation.
  • the inventive method records organic, intracellular, and intercellular processes.
  • Cells and/or cell populations can also be recorded.
  • Reference spectra of photoconvertible dyes, photoactivatable dyes, and indicator dyes can also be recorded.
  • dyes used in recording reference spectra change their spectra dynamically based on intracellular processes. Also, dyes that have a different rise in fluorescence intensity are used.
  • One fluorescing protein that has been used to practice the present invention is Kaede.
  • FIG. 1 a schematically illustrates the concept of one-photon absorption.
  • FIG. 1 b schematically illustrates the concept of multiphoton absorption.
  • FIG. 2 is a schematic drawing of a laser scan microscope used in practicing the inventive method.
  • FIG. 3 is a chart showing the emission spectra of several typical dyes.
  • FIG. 4 schematically depicts how different image channels are formed.
  • FIG. 5 is a block diagram of the main color divider (MDB) used in practicing the inventive method.
  • the fluorescence is spit spectrally.
  • the emission layer is split from the excitation light in the scan module S of in the microscope (during multiphoton absorption) by means of the main color divider (MDB) 24 .
  • MDB main color divider
  • the light of the sample is focused by means of an imaging optics 50 during confocal detection through an iris (pinhole) 52 so that fluorescence that originated outside of the focus is suppressed.
  • iris pinhole
  • the light is now broken down into its spectral fractions by means of an angle-dispersive element. Prisms, gratings and acousto-optic elements are considered as angle-dispersive elements.
  • the light split by the dispersive element into its spectral components is finally imaged in a line detector 56 .
  • This line detector 56 therefore measures the emission signal as a function of wavelength and converts it to electrical signals.
  • the detection unit can have a line filter (not shown) connected in front to suppress excitation wavelengths.
  • the depicted structure essentially describes a Cerny-Turner-Design.
  • the light 60 of the sample is focused with the pinhole optics 50 through the confocal diaphragm 52 .
  • this diaphragm can drop out.
  • the first imaging mirror 62 collimates the fluorescence light.
  • the light then impinges on a line grating 64 , for example a grating with a line number of 651 lines per mm.
  • the grating diffracts the light according to its wavelength in different directions.
  • the second imaging mirror 66 focuses the individual spectrally split wavelength fractions onto the corresponding channels of the line detector 56 .
  • the detector has 32 channels and high sensitivity.
  • the free spectral range of the aforementioned variant is about 350 nm.
  • the free spectral range in this arrangement is uniformly distributed in the 32 channels of the line detector so that an optical resolution of about 10 nm is produced.
  • This arrangement is only conditionally suitable for spectroscopy.
  • its use in an imaging system is advantageous, since the signal is still relatively large per detection channel because of the relatively broad detected spectral band.
  • a shift of the free spectral region can additionally occur by rotation of the grating.
  • Another possible variant involves the use of a matrix detector (for example CCD).
  • a matrix detector for example CCD
  • splitting into different wavelength fractions is carried out in one coordinate by the dispersive element.
  • a complete line (or column) of the scanned image is imaged on the matrix detector.
  • This variant is particularly advantageous in constructing a line scanner (lit.: Corle, Kino: “Confocal Scanning Optical Microscopy and Related Imaging Systems,” Academic Press, 1996).
  • the essential design corresponds essentially to that of an LSM according to FIG. 2 .
  • a line is imaged in the focus and the sample being investigated is only scanned in one direction.
  • a slit diaphragm instead of a perforated diaphragm serves as confocal diaphragm in such a structure.
  • a nondescanned detection during use of multiphoton absorption can also occur with this arrangement.
  • the confocal diaphragm can again drop out for this purpose.
  • spectral splitting of the fluorescence light after recording of the fluorescence spectra of the fluorescence markers in pure form and recording of the spectra with fluorescence fractions of several markers, a separate recording of the spectral fractions can occur by an unmixing method such as that disclosed in DE 19915137 A1.
  • the number of fluorescence markers used for fluorescence marking can be reduced or combinatorics can be utilized, if not only fluorescence spectra are to be used in pure form as reference spectra but also reference spectra of mixed forms are recorded.
  • These mixed forms can be characterized, for example, by the time-dependent color state of the biological material, if a fluorescence marker slowly leads to discoloration.
  • such mixed states can be characterized by a mixed color if a fluorescence marker changes it color or its excitation properties.
  • Such mixing conditions can be produced in different ways: they can be present in the sample, be produced by irradiation of the sample, or be the result of a biological process excited by irradiation.
  • Mixed spectra can characterize a biological process, for example, a concentration change, in which a first spectrum corresponds to a lower concentration state and at least one additional spectrum corresponds to a higher concentration state.
  • image channels are defined and correspondingly evaluated.
  • the generation of such references can occur over the entire image or advantageously over marked “regions of interest” (ROI).
  • ROI regions of interest
  • a deliberate manipulation by defined irradiation can also occur over such ROI.
  • a reference can also be determined in a first region and deliberate irradiation and measurement can occur in an additional region by extraction of mixed spectra. Demixing and depiction of the spectra can occur after imaging recording or during imaging recording.
  • different cells or cell groups in a cell population that has been marked with the dye Kaede can be exposed and converted for different lengths of time with UV or violet light. Different color mixing ratios are then established that are recorded as reference spectra. Different cell populations can then be individually recorded over time. This is true not only for cell cultures, but can also concern both subcellular structures and also entire organisms, in which a certain cell population is irradiated and can be observed in its development, in which the resulting reference can be assigned to specific image channels and can therefore be followed.
  • a corresponding region can be selected over the ROI.
  • An analysis of transport processes on the cellular and subcellular level can occur.
  • still only one dye is used, which is placed in different states via radiation of other effects that are clearly identifiable by reference formation.
  • time series dialog the start and end of the time series as well as intervals and delays between recordings are fixed.
  • the META detector permits the entire spectrum of emission, for example of Kaede, to be recorded and to separate the corresponding mixed forms spectrally during measurement and to display the demixed channels.
  • FIG. 4 schematically depicts how different image channels CH 1 -CH 3 are formed, in which as shown, different spectral mixed distribution of CH1-3 are used as reference and referred to for image evaluation.

Abstract

A method using fluorescence microscopy for image evaluation using a laser scanning microscope in which an at least partially spectrally resolved detection of the fluorescence spectrum occurs. Reference spectra are used for spectral demixing. Temporally and/or spectrally variable dyes and/or dye combinations are employed for recording of the reference spectra. Finally, the recorded reference spectra are inspected for image evaluation.

Description

    CROSS-REFERENCE TO RELATED APPLICATIONS
  • The present patent application is a nationalization of International Application No. PCT/EP2004/006202, filed Jun. 9, 2004, which is based on, and claims priority from, German Application No. DE 103 27 382, filed Jun. 16, 2003, both of which are incorporated herein by reference in their entireties.
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention
  • The invention relates to a method used in fluorescence microscopy, especially laser scanning microscopy, in general, and to the use of dyes for image evaluation, in particular.
  • 2. Description of Related Art
  • A conventional application of light microscopy for investigation of biological preparations is fluorescence microscopy which is discussed in the “Handbook of Biological Confocal Microscopy, Second Edition”, Pawley, Plenum Press, 1995. Specific dyes are used in fluorescence microscopy for specific marking of tissues, cells, cell parts, or other materials.
  • The emitted photons of a specific energy excite the dye molecules from the ground state to an excited state by absorption of a photon. This excitation is generally referred to as one-photon absorption (See FIG. 1 a). The dye molecules so excited can return in different ways to the ground state. In fluorescence microscopy the transition with emission of a fluorescence photon is most important. The wavelength of the emitted photon is generally red-shifted based on the Stokes Shift in comparison to the excitation radiation and therefore has a greater wavelength. The Stokes Shift permits separation of the fluorescence radiation from the excitation radiation.
  • A multiphoton excitation is shown in FIG.1 b. The fluorescence light is split and observed separately from the excitation radiation with appropriate dichroic beam splitters in combination with block filters. The depiction of individual cell parts stained with different dyes is possible on this account. However, several parts of a preparation, in principle, can also be simultaneously stained with different dyes by specifically adding dyes resulting in multiple fluorescence. Special dichroic beam splitters are again used to distinguish the fluorescence signals emitted by the individual dyes.
  • The prior art is explained as follows based on the example of a confocal laser scanning microscope (LSM) such as that show schematically in FIG. 2. An LSM is divided into essentially four modules: light source L, scan module S, detection unit D and microscope M. These modules are further described below. U.S. Pat. No. 6,167,173 also provides a detailed explanation of the LSM and is incorporated by reference herein as if reproduced in its entirety.
  • For specific excitation of different dyes in one preparation, different wavelengths are used in an LSM laser. The choice of excitation wavelength is guided according to the absorption properties of the dyes being investigated. The excitation radiation is generated in the light source module L. Different lasers 13.1 and 13.2 are used here (for example, argon, argon-krypton, TiSa lasers). Selection of the wavelength and adjustment of the intensity of the required excitation wavelength additionally occurs in the light source module L, for example by using an acousto-optic crystal 15.1 and 15.2. The laser radiation then goes to the scan module S via a fiber 14.1 and 14.2 and/or appropriate mirror arrangement.
  • The laser radiation generated in the light source is focused into the preparation with limited diffraction with objective 4 via the scanner 23, scan optics 16 and 17 and tube lens 9. The focus scans the sample in the x-y direction point-like. The pixel residence times during scanning over the sample are generally in the range of less than a microsecond to a few seconds.
  • During confocal detection (descanned detection) of the fluorescence light, the light emitted from the focal plane (specimen) 5 and from the overlying and underlying planes goes to a dichroic beam splitter (MDB) 24 via the scanner 23. This separates the fluorescence light from the excitation light. The fluorescence light is then focused on a diaphragm (confocal diaphragm/pinhole) 29, which is situated precisely in a plane conjugated to the focal plane. Fluorescence light fractions outside of the focus are suppressed on this account. By varying the diaphragm size the optical resolution of the microscope can be adjusted. Behind the diaphragm there is an additional dichroic block filter (EF) 30 that again suppresses the excitation radiation. After passing through the block filter, the fluorescence light is measured by means of a point detector (PMT) 31.
  • During use of multiphoton absorption, excitation of dye fluorescence occurs in a small volume on which the excitation intensity is particularly high. This region is only slightly larger than the detected region during use of a confocal arrangement. The use of a confocal diaphragm can therefore be omitted and detection can occur directly after the objective 5 in the nondescanned detection region 71 of the microscope.
  • In another arrangement for detection of dye fluorescence excited by multiphoton absorption, descanned detection again occurs, but this time the pupil of the objective is imaged in the detection unit (nonconfocal descanned detection) D.
  • Only the plane (optical section) that is situated in the focal plane of the objective is detected by a three-dimensionally illuminated image by both detection arrangements in conjunction with the corresponding one photon or multiphoton absorption. By marking several optical sections in the x-y plane at different depths z of the sample, a three-dimensional image of the sample can then be generated in computer-controlled fashion. The LMS is therefore suitable for investigating thick preparations. The excitation wavelengths are determined by the employed dye with specific absorption properties. Dichroic filters 30 adjusted to the emission properties of the dye ensure that only the fluorescence light emitted by the corresponding dye is measured by the point detector.
  • In biomedical applications several different cells or cell regions are now marked with different dyes simultaneously (multifluorescence). The individual dyes can be detected separately with the prior art based either on different absorption properties or emission properties (spectra). For this purpose additional splitting of the fluorescence light from several dyes occurs with the secondary beam splitters (DBS) 28 and a separate detection of the individual dye emissions in separate point detectors (PMT x) 31. Flexible adjustment of detection and excitation to corresponding new properties by the user is not possible with the arrangement described above. New dichroic beam splitters and block filters must instead be created for each (new) dye.
  • If the emission spectra of two dyes overlap, the previous detection devices reach their limits. In order to avoid overlap between two dyes, the spectral detection range must be restricted. The range in which the two dyes overlap is simply cut out for this purpose and not detected. The efficiency of the detection unit therefore deteriorates. An equal signal-to-noise ratio can only be achieved by increasing the excitation power, through which preparation damage can occur. Nowadays a maximum of up to six different dye probes are therefore simultaneously used, since the dyes otherwise could not be separated owing to the strongly overlapping emission bands.
  • Previously dyes have been modified so that they either differ from each in their absorption properties or in their emission properties. FIG. 3 shows the emission spectra of different typical dyes. The emission signal is plotted as a function of wavelength. The dyes denoted 1 to 4 differ in position and form of their emission spectra. These dyes, however, are in most cases toxic for living preparations. Investigation of the evolution of cell structure in living preparations is therefore impossible. In the late 90s, dyes occurring in nature, the so-called fluorescing proteins (GFP, YFP, CFP, TOPAS, GFT, RFP) were discovered by Clonetech, Mountain View, Calif. www.clontech.com. Fluorescence dyes for specific marking of preparations are used in all of the aforementioned systems.
  • BRIEF SUMMARY OF THE INVENTION
  • The present invention covers a method using fluorescence microscopy for image evaluation using a laser scanning microscope in which an at least partially spectrally resolved detection of the fluorescence spectrum occurs. Reference spectra are used for spectral demixing. Temporally and/or spectrally variable dyes and/or dye combinations are employed for recording of the reference spectra. Finally, the recorded reference spectra are inspected for image evaluation.
  • The inventive method records organic, intracellular, and intercellular processes. Cells and/or cell populations can also be recorded. Reference spectra of photoconvertible dyes, photoactivatable dyes, and indicator dyes can also be recorded.
  • Of interest to the inventive method is that dyes used in recording reference spectra change their spectra dynamically based on intracellular processes. Also, dyes that have a different rise in fluorescence intensity are used. One fluorescing protein that has been used to practice the present invention is Kaede.
  • BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS
  • FIG. 1 a schematically illustrates the concept of one-photon absorption.
  • FIG. 1 b schematically illustrates the concept of multiphoton absorption.
  • FIG. 2 is a schematic drawing of a laser scan microscope used in practicing the inventive method.
  • FIG. 3 is a chart showing the emission spectra of several typical dyes.
  • FIG. 4 schematically depicts how different image channels are formed.
  • FIG. 5 is a block diagram of the main color divider (MDB) used in practicing the inventive method.
  • DETAILED DESCRIPTION OF THE INVENTION
  • In describing preferred embodiments of the present invention illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the invention is not intended to be limited to the specific terminology so selected, and it is to be understood that each specific element includes all technical equivalents that operate in a similar manner to accomplish a similar purpose.
  • In a laser scanning microscope, such as the Zeiss META, the fluorescence is spit spectrally. For this purpose the emission layer is split from the excitation light in the scan module S of in the microscope (during multiphoton absorption) by means of the main color divider (MDB) 24. A block diagram of a detector unit used in practicing the present invention is shown in FIG. 5.
  • The light of the sample is focused by means of an imaging optics 50 during confocal detection through an iris (pinhole) 52 so that fluorescence that originated outside of the focus is suppressed. During nondescanned detection the diaphragm drops out. The light is now broken down into its spectral fractions by means of an angle-dispersive element. Prisms, gratings and acousto-optic elements are considered as angle-dispersive elements. The light split by the dispersive element into its spectral components is finally imaged in a line detector 56. This line detector 56 therefore measures the emission signal as a function of wavelength and converts it to electrical signals. In addition, the detection unit can have a line filter (not shown) connected in front to suppress excitation wavelengths.
  • The depicted structure essentially describes a Cerny-Turner-Design. During confocal detection the light 60 of the sample is focused with the pinhole optics 50 through the confocal diaphragm 52. During a nondescanned detection, in the case of multiphoton absorption, this diaphragm can drop out. The first imaging mirror 62 collimates the fluorescence light. The light then impinges on a line grating 64, for example a grating with a line number of 651 lines per mm. The grating diffracts the light according to its wavelength in different directions. The second imaging mirror 66 focuses the individual spectrally split wavelength fractions onto the corresponding channels of the line detector 56. The use of a line-secondary electron multiplier H7260 made by the Hamamatsu Photonics, K.K., headquartered in Hamamatsu City, Japan (www.hamamatsu.com), is particularly advantageous. The detector has 32 channels and high sensitivity. The free spectral range of the aforementioned variant is about 350 nm. The free spectral range in this arrangement is uniformly distributed in the 32 channels of the line detector so that an optical resolution of about 10 nm is produced. This arrangement is only conditionally suitable for spectroscopy. However, its use in an imaging system is advantageous, since the signal is still relatively large per detection channel because of the relatively broad detected spectral band. A shift of the free spectral region can additionally occur by rotation of the grating.
  • Another possible variant involves the use of a matrix detector (for example CCD). In this case splitting into different wavelength fractions is carried out in one coordinate by the dispersive element. In the remaining direction, a complete line (or column) of the scanned image is imaged on the matrix detector. This variant is particularly advantageous in constructing a line scanner (lit.: Corle, Kino: “Confocal Scanning Optical Microscopy and Related Imaging Systems,” Academic Press, 1996). The essential design corresponds essentially to that of an LSM according to FIG. 2. However, instead of a point focus, a line is imaged in the focus and the sample being investigated is only scanned in one direction. A slit diaphragm instead of a perforated diaphragm serves as confocal diaphragm in such a structure. A nondescanned detection during use of multiphoton absorption can also occur with this arrangement. The confocal diaphragm can again drop out for this purpose.
  • By spectral splitting of the fluorescence light, after recording of the fluorescence spectra of the fluorescence markers in pure form and recording of the spectra with fluorescence fractions of several markers, a separate recording of the spectral fractions can occur by an unmixing method such as that disclosed in DE 19915137 A1.
  • It has now been recognized according to the invention that the number of fluorescence markers used for fluorescence marking can be reduced or combinatorics can be utilized, if not only fluorescence spectra are to be used in pure form as reference spectra but also reference spectra of mixed forms are recorded. These mixed forms can be characterized, for example, by the time-dependent color state of the biological material, if a fluorescence marker slowly leads to discoloration. In addition, such mixed states can be characterized by a mixed color if a fluorescence marker changes it color or its excitation properties.
  • Such mixing conditions can be produced in different ways: they can be present in the sample, be produced by irradiation of the sample, or be the result of a biological process excited by irradiation.
  • Mixed spectra can characterize a biological process, for example, a concentration change, in which a first spectrum corresponds to a lower concentration state and at least one additional spectrum corresponds to a higher concentration state.
  • By means of the different reference spectra, image channels are defined and correspondingly evaluated. The generation of such references can occur over the entire image or advantageously over marked “regions of interest” (ROI). A deliberate manipulation by defined irradiation can also occur over such ROI. A reference can also be determined in a first region and deliberate irradiation and measurement can occur in an additional region by extraction of mixed spectra. Demixing and depiction of the spectra can occur after imaging recording or during imaging recording.
  • It was surprisingly found that new markers like the fluorescing protein Kaede, which turns from green to red during irradiation (lit.: Ando, R., Harna, H., Yamamoto-Hino, M., Mizuno, H. and Miyawaki, A. (2002), An optical marker based on the UV-induced green-to-red photoconversion of a fluorescent protein, PNAS 99/20, 12651-12656) during recording of organic processes, for example inter- and intracellular processes can be used for marking of individual cells or cell populations and spectrally detected. Photoconvertible dyes that change their spectra dynamically based on intracellular processes or dyes that are used for FRET, but also other indicator dyes can be advantageously used by the method according to the invention.
  • For example, different cells or cell groups in a cell population that has been marked with the dye Kaede can be exposed and converted for different lengths of time with UV or violet light. Different color mixing ratios are then established that are recorded as reference spectra. Different cell populations can then be individually recorded over time. This is true not only for cell cultures, but can also concern both subcellular structures and also entire organisms, in which a certain cell population is irradiated and can be observed in its development, in which the resulting reference can be assigned to specific image channels and can therefore be followed.
  • A corresponding region can be selected over the ROI. An analysis of transport processes on the cellular and subcellular level can occur. Advantageously, still only one dye is used, which is placed in different states via radiation of other effects that are clearly identifiable by reference formation.
  • A different rise in fluorescence intensity, as during PA-GFP (photoactivatable GFP, lit.: Patterson, G. H. and Lippincott-Schwartz, J. (2002), A photoactivatable GFP for selective photobleaching of proteins and cells, Science 297, 1873-1877) after excitation with violet light can serve as reference. In the Zeiss LSM META ROIs can be interactively defined directly in the image. The selected laser is switched on and off with pixel precision at the boundary of these regions.
  • In time series dialog, the start and end of the time series as well as intervals and delays between recordings are fixed. The irradiation parameters that lead to a change in dye properties by photoactivation or photoconversion, for example, repetition rate, wavelength, intensity, position can be automatically incorporated. Evaluation can occur after the experiment or on-line during recording in order to be able to intervene directly in the course of the experiment. The average intensities of ROI in time, as well as the times of photoactivations and conversions are indicated.
  • The META detector permits the entire spectrum of emission, for example of Kaede, to be recorded and to separate the corresponding mixed forms spectrally during measurement and to display the demixed channels.
  • FIG. 4 schematically depicts how different image channels CH1-CH3 are formed, in which as shown, different spectral mixed distribution of CH1-3 are used as reference and referred to for image evaluation.
  • It is to be understood that the present invention is not limited to the illustrated embodiments described herein. Modifications and variations of above-described embodiments of the present invention are possible, as appreciated by those skilled in the art in light of the above teachings. It is therefore to be understood that, within the scope of the appended claims and their equivalents, the invention may be practiced otherwise than as specifically described.

Claims (13)

1-12. (canceled)
13. A method using fluorescence microscopy for image evaluation, the method comprising the steps of:
using a laser scanning microscope in which an at least partially spectrally resolved detection of the fluorescence spectrum occurs;
using reference spectra for spectral demixing;
employing temporally and/or spectrally variable dyes and/or dye combinations for recording of the reference spectra; and
demixing the recorded reference spectra for image evaluation.
14. The method according to claim 13 wherein the method records organic processes.
15. The method according to claim 13 wherein the method records intracellular processes.
16. The method according to claim 14 wherein the method records intercellular processes.
17. The method according to claim 13 wherein the method records cells and/or cell populations.
18. The method according to one claim 13 in which recording of reference spectra of photoconvertible dyes occurs.
19. The method according to one claim 13 in which recording of reference spectra of photoactivatable dyes occurs.
20. The method according to claims 13 in which recording of reference spectra of indicator dyes occurs.
21. The method according to claim 13 in which recording of reference spectra of dyes occurs that change their spectra dynamically based on intracellular processes.
22. The method according to one claim 13 in which recording of reference spectra of dyes occurs with a different rise in fluorescence intensity.
23. The method according to claims 13 in which recording of reference spectra of the fluorescing protein Kaede occurs.
24. The method according to one claims 13 in which recording of reference spectra of PA-GFP occurs.
US10/560,426 2003-06-16 2004-06-09 Method to be used in fluorescence microscopy Active 2026-04-23 US7688442B2 (en)

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
DE10327382A DE10327382A1 (en) 2003-06-16 2003-06-16 Method for fluorescence microscopy
DE10327382.4 2003-06-16
DE10327382 2003-07-16
PCT/EP2004/006202 WO2004113987A1 (en) 2003-06-16 2004-06-09 Method to be used in fluorescence microscopy

Publications (2)

Publication Number Publication Date
US20070178602A1 true US20070178602A1 (en) 2007-08-02
US7688442B2 US7688442B2 (en) 2010-03-30

Family

ID=33495111

Family Applications (1)

Application Number Title Priority Date Filing Date
US10/560,426 Active 2026-04-23 US7688442B2 (en) 2003-06-16 2004-06-09 Method to be used in fluorescence microscopy

Country Status (5)

Country Link
US (1) US7688442B2 (en)
EP (1) EP1636624A1 (en)
JP (1) JP2006527858A (en)
DE (1) DE10327382A1 (en)
WO (1) WO2004113987A1 (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110137179A1 (en) * 2008-08-21 2011-06-09 University Of Florida Research Foundation, Inc. Differential laser-induced perturbation (dlip) for bioimaging and chemical sensing
US9918640B2 (en) 2010-02-12 2018-03-20 Helmholtz Zentrum München Deutsches Forschungszentrum Für Gesundheit Und Umwelt Gmbh Method and device for multi-spectral photonic imaging

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102005022880B4 (en) * 2005-05-18 2010-12-30 Olympus Soft Imaging Solutions Gmbh Separation of spectrally or color superimposed image contributions in a multi-color image, especially in transmission microscopic multi-color images
DE102012219136A1 (en) * 2012-10-19 2014-05-28 Leica Microsystems Cms Gmbh Microscope and a method for examining a sample with a microscope
CA2899158C (en) 2013-03-15 2021-05-04 Ventana Medical Systems, Inc. Spectral unmixing

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6167173A (en) * 1997-01-27 2000-12-26 Carl Zeiss Jena Gmbh Laser scanning microscope
US6602716B1 (en) * 1997-08-01 2003-08-05 Presens Precision Sensing Gmbh Method and device for referencing fluorescence intensity signals
US7009699B2 (en) * 2001-10-16 2006-03-07 Carl Zeiss Jena Gmbh Method for investigating a sample

Family Cites Families (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS60104238A (en) * 1983-11-10 1985-06-08 Japan Spectroscopic Co Method and device for quantitative analysis by detecting simultaneously multi-wavelength
JP2799191B2 (en) * 1989-08-24 1998-09-17 オリンパス光学工業株式会社 Method for forming two-dimensional concentration distribution image of intracellular ions
JPH04127039A (en) * 1990-09-19 1992-04-28 Hitachi Ltd Identification of material by fluorescent spectrum
JP3649823B2 (en) * 1996-09-17 2005-05-18 株式会社トプコン Organic matter analyzer
JPH10253622A (en) * 1997-03-14 1998-09-25 Nippon Schering Kk Method of measuring state of activity (energy) of cell (tissue)
DE19829657A1 (en) * 1997-08-01 1999-02-04 Ingo Klimant Method and device for referencing fluorescence intensity signals
DE19900135A1 (en) * 1998-01-07 1999-08-05 Univ Rockefeller Methods of determining the temperature of a single cell in a cell sample or tissue biopsy and method of using the same
DE19915137C2 (en) 1999-03-26 2001-10-18 Michael Schaefer Fluorescence microscopy method for quantifying multiple fluorochromes in a multi-colored sample and uses of the method
DE10033180B4 (en) * 2000-06-29 2006-08-31 Carl Zeiss Jena Gmbh Method for the detection of dyes in fluorescence microscopy
DE10038526B4 (en) * 2000-08-08 2004-09-02 Carl Zeiss Jena Gmbh Method and arrangement for recording the wavelength-dependent behavior of an illuminated sample
JP4827335B2 (en) * 2001-08-13 2011-11-30 オリンパス株式会社 Scanning laser microscope

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6167173A (en) * 1997-01-27 2000-12-26 Carl Zeiss Jena Gmbh Laser scanning microscope
US6602716B1 (en) * 1997-08-01 2003-08-05 Presens Precision Sensing Gmbh Method and device for referencing fluorescence intensity signals
US7009699B2 (en) * 2001-10-16 2006-03-07 Carl Zeiss Jena Gmbh Method for investigating a sample

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20110137179A1 (en) * 2008-08-21 2011-06-09 University Of Florida Research Foundation, Inc. Differential laser-induced perturbation (dlip) for bioimaging and chemical sensing
US8939966B2 (en) * 2008-08-21 2015-01-27 University Of Florida Research Foundation, Inc. Differential laser-induced perturbation (DLIP) for bioimaging and chemical sensing
US9918640B2 (en) 2010-02-12 2018-03-20 Helmholtz Zentrum München Deutsches Forschungszentrum Für Gesundheit Und Umwelt Gmbh Method and device for multi-spectral photonic imaging
US10314490B2 (en) 2010-02-12 2019-06-11 Helmholtz Zentrum München Deutsches Forschungszentrum Für Gesundheit Und Umwelt (Gmbh) Method and device for multi-spectral photonic imaging

Also Published As

Publication number Publication date
JP2006527858A (en) 2006-12-07
DE10327382A1 (en) 2005-01-05
EP1636624A1 (en) 2006-03-22
WO2004113987A1 (en) 2004-12-29
US7688442B2 (en) 2010-03-30

Similar Documents

Publication Publication Date Title
Elliott Confocal microscopy: principles and modern practices
Bayguinov et al. Modern laser scanning confocal microscopy
US10394008B2 (en) Hyperspectral multiphoton microscope for biomedical applications
Sytsma et al. Time‐gated fluorescence lifetime imaging and microvolume spectroscopy using two‐photon excitation
Claxton et al. Laser scanning confocal microscopy
AU2005256758B2 (en) Multimarking fiber fluorescence microscopic imagery system and method
US7420674B2 (en) Method and arrangement for analyzing samples
US7009699B2 (en) Method for investigating a sample
US6891613B2 (en) Method for the detection of dyes in fluorescence microscopy
JP4783931B2 (en) Method for increasing the spectroscopic and spatial resolution of a detector
EP1584918B1 (en) Method and device for fluorescence lifetime imaging nanoscopy
US6858852B2 (en) Method and apparatus for rapid change of fluorescence bands in the detection of dyes in fluorescence microscopy
US6703621B2 (en) Method for the optical acquisition of characteristic sizes of an illuminated sample
Masters The development of fluorescence microscopy
US6403332B1 (en) System and method for monitoring cellular activity
US20020180965A1 (en) Method for examining a specimen, and scanning microscope system
JP2006119152A (en) Method and device for grasping wavelength-dependent characteristic of illuminated sample
US7319520B2 (en) Method for separating fluorescence spectra of dyes present in a sample
US7257289B2 (en) Spectral microscope and method for data acquisition using a spectral microscope
Rai et al. The basics of confocal microscopy
US7119898B2 (en) Method for the detection of fluorescent light
US7688442B2 (en) Method to be used in fluorescence microscopy
US11953440B2 (en) Method and apparatus for simultaneous nonlinear excitation and detection of different chromophores across a wide spectral range using ultra-broadband light pulses and time-resolved detection
Fung et al. Combined spectrally-resolved multiphoton microscopy and transmission microscopy employing a high-sensitivity electron-multiplying CCD camera
Gugel et al. Confocal imaging at the nanoscale with two-color STED microscopy

Legal Events

Date Code Title Description
AS Assignment

Owner name: CARL ZEISS JENA GMBH,GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WOLLESCHENSKY, RALF;ZIMMERMANN, BERNHARD;ANKERHOLD, RICHARD;REEL/FRAME:019056/0759

Effective date: 20060216

Owner name: CARL ZEISS JENA GMBH, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:WOLLESCHENSKY, RALF;ZIMMERMANN, BERNHARD;ANKERHOLD, RICHARD;REEL/FRAME:019056/0759

Effective date: 20060216

FEPP Fee payment procedure

Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

AS Assignment

Owner name: CARL ZEISS MICROIMAGING GMBH,GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CARL ZEISS JENA GMBH;REEL/FRAME:023849/0657

Effective date: 20100119

Owner name: CARL ZEISS MICROIMAGING GMBH, GERMANY

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:CARL ZEISS JENA GMBH;REEL/FRAME:023849/0657

Effective date: 20100119

STCF Information on status: patent grant

Free format text: PATENTED CASE

CC Certificate of correction
AS Assignment

Owner name: CARL ZEISS MICROSCOPY GMBH, GERMANY

Free format text: CHANGE OF NAME;ASSIGNOR:CARL ZEISS MICROIMAGING GMBH;REEL/FRAME:030554/0419

Effective date: 20120403

FPAY Fee payment

Year of fee payment: 4

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 8TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1552)

Year of fee payment: 8

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 12TH YEAR, LARGE ENTITY (ORIGINAL EVENT CODE: M1553); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY

Year of fee payment: 12