WO1999047963A1 - Confocal microscopy imaging system - Google Patents

Confocal microscopy imaging system Download PDF

Info

Publication number
WO1999047963A1
WO1999047963A1 PCT/US1999/005589 US9905589W WO9947963A1 WO 1999047963 A1 WO1999047963 A1 WO 1999047963A1 US 9905589 W US9905589 W US 9905589W WO 9947963 A1 WO9947963 A1 WO 9947963A1
Authority
WO
WIPO (PCT)
Prior art keywords
ofthe
assay
objective lens
electromagnetic radiation
discontinuous surface
Prior art date
Application number
PCT/US1999/005589
Other languages
French (fr)
Other versions
WO1999047963A8 (en
WO1999047963A9 (en
Inventor
Jay K. Trautman
Timothy D. Harris
Richard L. Hansen
William Karsh
Neal A. Nicklaus
Original Assignee
Praelux Incorporated
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to EP99914908A priority Critical patent/EP1064579A4/en
Priority to IL13849699A priority patent/IL138496A0/en
Priority to JP2000537103A priority patent/JP4812937B2/en
Priority to AU33547/99A priority patent/AU758571B2/en
Priority to BRPI9908767-7A priority patent/BR9908767B1/en
Priority to CA2324262A priority patent/CA2324262C/en
Application filed by Praelux Incorporated filed Critical Praelux Incorporated
Priority to US09/333,749 priority patent/US6388788B1/en
Publication of WO1999047963A1 publication Critical patent/WO1999047963A1/en
Publication of WO1999047963A8 publication Critical patent/WO1999047963A8/en
Publication of WO1999047963A9 publication Critical patent/WO1999047963A9/en
Priority to NO20004601A priority patent/NO20004601L/en
Priority to US09/724,253 priority patent/US6400487B1/en
Priority to US10/227,552 priority patent/US20030036855A1/en
Priority to IL16431904A priority patent/IL164319A0/en
Priority to US12/028,345 priority patent/US7957911B2/en
Priority to US13/150,532 priority patent/US20110255756A1/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0028Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders specially adapted for specific applications, e.g. for endoscopes, ophthalmoscopes, attachments to conventional microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/008Details of detection or image processing, including general computer control
    • G02B21/0084Details of detection or image processing, including general computer control time-scale detection, e.g. strobed, ultra-fast, heterodyne detection
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N33/00Investigating or analysing materials by specific methods not covered by groups G01N1/00 - G01N31/00
    • G01N33/48Biological material, e.g. blood, urine; Haemocytometers
    • G01N33/50Chemical analysis of biological material, e.g. blood, urine; Testing involving biospecific ligand binding methods; Immunological testing
    • G01N33/5002Partitioning blood components
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/006Optical details of the image generation focusing arrangements; selection of the plane to be imaged
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0064Optical details of the image generation multi-spectral or wavelength-selective arrangements, e.g. wavelength fan-out, chromatic profiling
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0072Optical details of the image generation details concerning resolution or correction, including general design of CSOM objectives
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0076Optical details of the image generation arrangements using fluorescence or luminescence
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6428Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • G01N2021/6439Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" with indicators, stains, dyes, tags, labels, marks

Definitions

  • the present invention relates to methods and apparatus for identifying pharmacological agents useful for the diagnosis and treatment of disease by performing a variety of assays on cell extracts, cells or tissues where the measurement of biological activity involves the use of various embodiments of a line-scan confocal imaging system and associated data processing routines.
  • Cell-based assays are advantageously employed for assessing the biological activity of chemical compounds and the mechanism-of-action of new biological targets.
  • the activity of interest is measured in the presence of both competing and complementary processes.
  • information is available as to the specific activity ofthe compound. For example, it is possible to assess not only whether a compound binds the target ofthe assay, but also whether it is an agonist or an antagonist ofthe normal activity ofthe target. Frequently, the target is a cell-surface receptor.
  • the member ofthe pathway of greatest potential therapeutic value is not the receptor but an intracellular signaling protein associated with the receptor. It is, therefore, desirable to develop methods to assay activity throughout the pathway, preferably in the cellular milieu.
  • a typical assay consists of measuring the time-dependence ofthe fluorescence of an ion-sensitive dye, the fluorescence being a measure ofthe intra-cellular concentration ofthe ion of interest which changes as a consequence ofthe addition of a chemical compound.
  • the dye is loaded into the population of cells disposed on the bottom ofthe well of a multiwell plate at a time prior to the measurement.
  • the response ofthe cells is heterogeneous in both magnitude and time. This variability may obscure or prevent the observation of biological activity important to compound screening.
  • the heterogeneity may arise from experimental sources, but more importantly, heterogeneity is fundamental in any population of cells.
  • the origin ofthe variability may be a consequence ofthe life-cycle divergence among the population, or the result ofthe evolutionary divergence ofthe number of active target molecules.
  • a method that mitigates, compensates for, or even utilizes the variations would enhance the value of cell-based assays in the characterization ofthe pharmacological activity of chemical compounds.
  • Quantification ofthe response of individual cells circumvents the problems posed by the non-uniformity of that response of a population of cells.
  • a device that measures the average response will have less sensitivity than one determining individual cellular response.
  • the latter method generates a statistical characterization ofthe response profile permitting one to select the subset of active cells. Additional characterization ofthe population will enhance the interpretation ofthe response profile.
  • the present invention can be used to perform multi-parameter fluorescence imaging on single cells and cell populations in a manner that is sufficiently rapid and versatile for use in compound screening.
  • Methods and apparatus are provided for obtaining and analyzing both the primary response of individual cells and additional measures ofthe heterogeneity ofthe sample population.
  • the locations of these multiple fluorophores can be determined with sub-cellular resolution.
  • the present invention can be used to image rapidly changing events at video-rates. Together these capabilities enable new areas of research into the mechanism-of-action of drug candidates.
  • the present invention may also be employed in an inventive fluorescence- based biochemical assay, somewhat analogous to the surface scintillation assay ("SSA") which is among the more widely used methods for screening chemical compounds.
  • SSA surface scintillation assay
  • Figs. 1(a) - 1(f) depict the steps of a receptor-binding SSA.
  • soluble membranes 10 with chosen receptors 12 are added to a well 20 containing a liquid 30. These membranes are isolated from cells expressing the receptors.
  • radio- labeled ligands 14 are added to the well. The ligand is known to have a high binding affinity for the membrane receptors. The most common radio labels are 3 H, 35 S, 125 1, 33 P and 32 P.
  • beads 16 are added to the well. The beads are coated with a material, such as wheat germ agglutinin, to which the membranes strongly adhere.
  • the beads have a diameter of 3-8 ⁇ m and are made of plastic doped with a scintillant.
  • the radiolabels decay by emitting high energy electrons, or beta particles, which travel approximately 1-100 ⁇ m before stopping, depending on the radio-isotope. If the radiolabels are bound to the membranes attached to the beads, the beta particles may travel into the beads and cause bursts of luminescence. If the radio-labels are dispersed throughout the liquid, the emitted beta particles will not generally excite luminescence in the beads. In Fig. 1(d), the luminescence ofthe beads caused by decay ofthe radio labels is detected.
  • a test compound 18 is added to the well.
  • the purpose ofthe assay is to determine the extent to which this compound will displace the radio-labeled ligands. If radio-labeled ligands are displaced and diffuse into the liquid, the luminescence ofthe beads will be reduced. In Fig. 1(f), the luminescence ofthe beads is again detected. By measuring the reduction in luminescence, the activity ofthe test compound can be determined.
  • Figs. 2(a) - 2(f) depict an alternative embodiment of a receptor-binding SSA.
  • This embodiment is essentially the same as that described in Figs. 1(a) - 1(f) except that instead of using beads, the embodiment shown in Figs. 2(a) - 2(f) uses a well bottom 22 made of plastic doped with scintillant and coated with a material to which the membranes adhere. Consequently, instead of detecting the luminescence ofthe beads, the embodiment shown in Figs. 2(a) - 2(f) detects the luminescence ofthe well bottom.
  • Figs. 3(a) - 3(d) depict the steps of an embodiment of an enzyme SSA.
  • scintillant-doped beads 40 with radio-labeled peptides 42 attached thereto are added to a well 50 containing a liquid 60.
  • a test compound 44 is added to the well.
  • enzymes 46 are added to the well. If not inhibited, enzymes 46 will cleave radio-labeled peptides 42 from beads 40. As a result, the radio label will diffuse into the solution, and radio-label decay will not produce luminescence in beads 40.
  • test compound 44 inhibits enzymes 46, typically by blocking the enzyme active site, enzymes 46 will not cleave the radio label and the decay ofthe radio label will produce luminescence in the beads.
  • Fig. 3(d) the luminescence ofthe beads is measured and the activity ofthe test compound can be determined.
  • Figs. 4(a) - 4(d) depict an alternative embodiment of an enzyme SSA.
  • radio-labeled peptides 42 are attached to a scintillant-doped well bottom 52.
  • the test compound 44 is added to the well.
  • enzymes 46 are added to the well.
  • the luminescence ofthe well bottom is measured to determine the activity ofthe test compound.
  • a radioimmunoassay is a specific form of a receptor binding assay in which the receptor is an antibody and the ligand is most often a natural or synthetic peptide, protein, carboydrate or small organic molecule.
  • RIAs are an indirect method for measuring the concentration of ligand in any prepared sample, most often a biological sample such as plasma, cerebrospinal fluid, urine, or cellular extract.
  • the antibody has a specific affinity for the ligand and the assay contains the antibody, a fixed concentration of radiolabeled ligand and an unknown concentration of non-labelled ligand. The concentration ofthe unlabelled ligand is determined by the degree to which it binds to the antibody and thereby blocks binding ofthe labelled ligand.
  • RIAs are most often performed as heterogenous assays that require the separation of bound ligand from unbound ligand with a wash step.
  • RIAs have also been developed using an SSA configuration in which the antibody receptor is attached to a scintillant filled bead and the wash step is eliminated.
  • SSAs and RIAs suffer from a number of disadvantages.
  • these assays require handling radioactive material, which is both expensive and time consuming.
  • Second, these assays are only effective in large wells. The rate of luminescence emission from the beads or well bottoms is proportional to the beta particle emission rate.
  • a typical 3 H assay yields less than one detected photon per 3 H decay.
  • the quantity of radio-labeled ligand must be increased, and correspondingly the quantities of membranes, beads and test compound.
  • 10 7 beads In order to perform a tritium SSA in 10-60 seconds, 10 7 beads must be used. This quantity of beads requires a well of approximately 150 ⁇ L. SSAs are not effective in the ⁇ L-volume wells desirable for screening large numbers of compounds.
  • the present invention replaces the radio- labeled ligands ofthe SSA and the RIA with fluorescent-labeled ligands.
  • it introduces a homogenous format for the RIA and it advantageously retains the homogeneous format ofthe SSA. This is particularly important in ⁇ L-volume wells, for which surface tension renders washing impractical.
  • fluorescence can be a problem as can be illustrated with the receptor-binding assay.
  • some fluorescent-labeled ligands are displaced and diffuse freely throughout the volume ofthe well, while others remain attached to the membranes.
  • the Schroeder et al. method suffers from a number of disadvantages.
  • the detection devices appropriate to said scanning method are inferior, principally in terms of sensitivity, to those advantageously used in the present invention.
  • the degree of background rejection is diminished along with the resolution.
  • the device disclosed in the '849 patent has lesser sensitivity, higher background and lower resolution than the present invention, all of which are important in the present application.
  • the present invention includes novel embodiments of a line-scan confocal microscope.
  • Line-scan confocal microscopes are known in art. Two representative embodiments are the system disclosed by White et al. in U.S. Patent No. 5,452,125 and that published by Brakenhoff and Visscher in J. Microscopy 171 17-26 (1993), shown in Fig. 7. Both use a scanning mirror to sweep the illumination across the sample. The same mirror de-scans the fluorescence radiation. After spatial filtering with a slit, the fluorescence is rescanned for viewing by eye. The use ofthe oscillating mirror enables these microscopes to rapidly scan a field-of-view. Line illumination is advantageous principally in applications requiring rapid imaging.
  • An essential feature ofthe disclosed apparatus is the use of a detection device having manifold, independent detection elements in a plane conjugate to the object plane.
  • the sample must lie in a "plane", where the depth-of-field ofthe imaging system determines the precision of "planarity".
  • the imaged area is 1 mm 2 and the depth- of-field is 10 ⁇ m.
  • the sample must be flat to 1 part in 100.
  • sample substrates e.g. microtiter plates
  • a local area such as the central area ofthe well bottom. It is not practical, however, to require that the sample substrate be flat over its entire surface. For a microtiter plate having an extent of -100 mm, planarity of 1 part in 10,000 would be necessary.
  • the present invention provides for an optical autofocus system which maintains in "focus” the portion ofthe sample substrate being imaged.
  • An optical autofocus mechanism has the advantage of being fast and being operational with non-conducting substrates such as plastic microtiter plates and microscope slides.
  • this focus mechanism operates with negligible delay, that is, the response time ofthe focusing mechanism is short relative to the image acquisition-time, preferably a fraction of a second.
  • Optically-based autofocus mechanisms suitable for the present application are known.
  • the sample substrate is a microtiter plate.
  • the preferred means of accomplishing the focusing depends further on the properties ofthe plate. If the thickness ofthe plate bottom were uniform to within a fraction ofthe depth-of-focus, then a focusing mechanism that maintained the plate bottom at a constant offset from the object plane would be adequate. Presently, commonly used microtiter plates are not sufficiently uniform.
  • An aspect ofthe present invention is a novel autofocus mechanism for rapidly focusing on a discontinuous surface, such as the well bottom of a microtiter plate.
  • the present invention relates to a line-scan confocal microscope and the use of a line-scan confocal imaging (LCI) system to assay biological activity.
  • LCI line-scan confocal imaging
  • the line-scan confocal imaging system employs laser light sources of multiple wavelengths for illuminating the sample and exciting fluorophores to emit electromagnetic energy. These wavelengths include the ultraviolet spectrum as well as the visible.
  • the present invention is able to conduct a rapid series of assays on micro- well plates by use of an autofocus capability which allows the LCI system to rapidly move from one well to another but not lose the advantage ofthe confocal microscope's inherent ability to resolve thin optical sections.
  • the sample is moved to effect a scan ofthe line of illumination over the sample.
  • an oscillating mirror is used to produce a rapidly moving line of illumination effecting a scan of a sample which remains at a fixed position.
  • images can be obtained at a rate of up to 50 frames per second.
  • the present invention preferably provides for integrated dispensing allowing the addition of substances to initiate rapidly changing biological events, such as the propagation of an action potential in nerve or muscle cells.
  • the present invention preferably makes use of a multi-element solid state detection device such as a charged coupled device (CCD). This device is preferably read continuously.
  • CCD charged coupled device
  • the present invention uses a rectangular CCD which avoids the need for a full two dimensional detector and allows higher read speeds.
  • a larger effective field-of-view is achievable in the stage-scanning embodiment.
  • the present invention also provides in a preferred embodiment, a capability to conduct specialized data analysis simultaneously with data acquisition to allow it to operate in a high-throughput screening mode.
  • This invention provides methods of performing a wide variety of biological assays utilizing fluorescence.
  • the target of interest may be in a fixed or live cell or in a subcellular organelle or on the cell membrane.
  • These assays involve the determination of one or more parameters which requires the excitation of one or more fluorescent labels which are, in general, sensitive to different wavelengths of incident light.
  • these assays require the simultaneous and precise imaging ofthe emitted light at one or more wavelengths from which the location in two or three dimensions and the intensity ofthe fluorescently labeled species and their correlations are determined.
  • this invention provides methods to perform assays which require either a single imaging of a response, by means of fluorescent emission, or rapidly repeated imaging ofthe same area or cell. In various embodiments, imaging is performed at rates as high as 50 frames per second. This ability to image rapidly, in multiple wavelengths and with high spatial resolution allows the present invention to perform assays that could not previously be performed or to perform them in a superior manner.
  • the present invention relates to several methods for screening chemical compounds and for performing many types of assays involving the use of fluorophores or fluorescent probes.
  • these assays and screening procedures involve the use of a test compound and reagents some or all of which are intrinsically fluorescent, tagged with fluorescent labels or are metabolized into fluorescent product.
  • the test compound and the reagents may be combined in a variety of ways.
  • the reagents are added to a well containing a liquid.
  • a well containing a liquid This may be a single well or one of many wells on a multiwell plate.
  • the biological activity of interest is determined by the presence or absence of fluorophores disposed on the bottom ofthe well or on the surface of beads disposed on the bottom ofthe well as measured with a line-scan confocal microscope.
  • This embodiment has in common with the SSA format the determination of activity from the localization ofthe detected species.
  • the localization is proximal to the scintillant.
  • the localization is to a region ofthe well, preferably the bottom.
  • sensitivity to the proximal species is determined by the decay length ofthe beta particles.
  • sensitivity to the localized fluorophore is determined by the optical-sectioning depth ofthe confocal microscope.
  • the present invention can perform high throughput assays requiring scanning multiple samples in a rapid and automatic manner. These samples may be individual micro-wells and may involve wells containing a liquid and live or fixed cells or components of cells.
  • the present invention also provides environmental controls required to retain liquid samples or sustain live cells during the analysis.
  • Figs. 1(a) - 1(f) illustrate a first receptor-binding SSA.
  • Figs. 2(a) - 2(f) illustrate a second receptor-binding SSA.
  • Figs. 3(a) - 3(d) illustrate a first enzyme SSA.
  • Figs. 4(a) - 4(d) illustrate a second enzyme SSA.
  • Fig. 5(a) and 5(b) are schematic views of a prior art apparatus for imaging samples disposed on the bottom of a well.
  • Fig. 6 is a schematic view of a first embodiment of a line-scan confocal microscope used to image samples according to the present invention.
  • Fig. 7 is a schematic view of a prior art microscope..
  • Figs. 8(a) and 8(b) are, respectively, a top view and a side view ofthe ray path of a multicolor embodiment ofthe present invention, without a scanning mirror.
  • Fig. 8(c) is a top view ofthe ray path of a single beam autofocus.
  • Figs. 9(a) and 9(b) are, respectively, a top view and a side view ofthe ray path ofthe multicolor embodiment ofthe present invention with the scanning mirror.
  • Fig. 9(c) is a top view ofthe ray path ofthe single beam autofocus.
  • Fig. 10 is a side view ofthe two beam autofocus system.
  • Fig. 1 l(a)-l 1(c) illustrates the rectangular CCD camera and readout register
  • Figs. 12(a) and 12(b) are cross-sectional views of ray paths formed by the line-scan confocal microscope in the present invention employing conventional dark-field imaging.
  • Figs. 13(a) and 13(b) are cross-sectional views of ray paths formed by the line-scan confocal microscope in the present invention using inverse dark-field imaging.
  • Fig. 14 is a cross-sectional view of ray paths formed by the line-scan confocal microscope in the present invention using inverse dark-field imaging, where an area larger than the diffraction-limited area ofthe sample plane is illuminated.
  • Figs. 15(a) - 15(f) illustrate a first embodiment of a receptor-binding assay according to the present invention.
  • Figs. 16(a) - 16(f) illustrates a second embodiment of a receptor-binding assay according to the present invention.
  • Figs. 17(a) - 17(d) illustrate a first embodiment of an enzyme assay according to the present invention.
  • Figs. 18(a) - 18(d) illustrate a second embodiment of an enzyme assay according to the present invention.
  • Figs. 19(a) - 19(d) shows a transcription factor translocation assay.
  • Figs. 20(a) - 20(d) shows a translocation assay data analysis.
  • Figs. 21(a) - 21(e) shows another data analysis.
  • Fig. 22 shows neuroblastoma cell calcium response to Carbachol.
  • Figs. 23(a) - 23(h) shows neuroblastoma cell calcium response to 50 mM KC1.
  • Figs. 24(a) - 24(c) shows homogeneous live cell receptor binding assay.
  • Figs. 25(a) - 25(c) shows homogeneous live cell receptor binding assay.
  • Figs. 26(a) - 26(d) shows homogeneous live cell receptor binding assay with Cy3 labeled ligand.
  • Figs. 27(a) - 27(d) shows 4 m diameter silica beads with varying numbers of Cy5 labels.
  • Figs. 28(a) - 28(d) shows the data from the translocation assay, ion channel assay and cell surface receptor binding as graphs.
  • the present invention if useful for identifying pharmacological agents for the treatment of disease. It provides a high throughput method for conducting a wide variety of biological assays where one or more fluorescent reagents are employed to measure a biological response. Such assays can be conducted on chemical compounds or any molecule of biological interest, included but not limited to drug candidates, such as those found in combinatorial libraries.
  • this invention provides a method for the diagnosis of pathological states from cell and tissue samples. This invention also provides a method for profiling multiple biological responses of drug candidates on whole cells using fluorescent reagents.
  • the techniques ofthe present invention may be used in assays in which data is acquired on individual cells, on a cellular or sub-cellular level, sufficiently rapidly so as to permit the acquisition of such data on a sufficient number of cells to constitute a statistically meaningful sample ofthe cell population.
  • the present invention is able to make simultaneous measurements on multiple parameters and is also able to correlate multiple signals from individual cells. It may therefore be employed to assay heterogeneous cellular responses and to assay responses confined to a small subset of cells.
  • the present invention can image the simultaneous activation of multiple signal pathways and can correlate multiple signals simultaneously and over time. This capability is vital when the temporal response of individual cells or a comparison of the temporal response of individual cells is required for the specific assay.
  • the present invention can image fluorescent signals from the confocal plane of cells in the presence of unbound fluorophore or in the presence of intrinsically fluorescent chemical compounds, including potential drug candidates.
  • These assays may make use of any known fluorophore or fluorescent label including but not limited to fluorescein, rhodamine, Texas Red, Amersham Corp. stains Cy3, Cy5, Cy5.5 and Cy7, Hoechst's nuclear stains and Coumarin stains. (See Haugland R.P. Handbook of Fluorescent Probes and Research Chemicals 6 th Ed., 1996, Molecular Probes, Inc., Eugene, Oregon.)
  • These assays include but are not limited to receptor-binding assays, assays of
  • Receptor-binding and enzyme activity assays may be bead-based or cell- based assays. Some examples of bead-based assays are described in WO 98/55866. However, the method described therein makes use of point scan confocal technology and
  • the present linescan confocal imaging system would have a significant advantage in terms of rate of data acquisition.
  • Fig. 6 shows a first embodiment ofthe present invention.
  • a source 400 or 410 of electromagnetic radiation for example, in the optical range, 350-750nm, a cylindrical lens 420, a first slit mask 430, a first relay lens 440, a dichroic mirror 450, an objective lens 470, a microtiter plate 480 containing a two- dimensional array of sample wells 482, a tube lens 490, a filter 500, a second slit mask 510 and a detector 520.
  • These elements are arranged along optical axis OA with slit apertures
  • the focal lengths of lenses 440, 470 and 490 and the spacings between these lenses as well as the spacings between mask 430 and lens 440, between objective lens 470 and microtiter plate 480 and between lens 490 and mask 510 are such as to provide a confocal microscope.
  • electromagnetic radiation from a lamp 400 or a laser 410 is focused to a
  • the shape ofthe line is optimized by a first slit mask 430.
  • the slit mask 430 is depicted in an image plane ofthe optical system, that is in a plane conjugate to the object plane.
  • the illumination stripe formed by the aperture 432 in the slit mask 430 is relayed by lens 440, dichroic mirror 450 and objective lens 470 onto a microtiter plate 480 which contains a two-dimensional array of sample wells 482.
  • Fig. 6 the optical elements of Fig. 6 are depicted in cross-section and the well plate in perspective.
  • the projection ofthe line of illumination onto well plate 480 is depicted by line 484 and is also understood to be perpendicular to the plane of Fig. 6.
  • well plate 480 may be moved in two dimensions (X, Y) parallel to the dimensions ofthe array by means not shown.
  • the slit mask 430 resides in a Fourier plane of the optical system, that is in a plane conjugate to the objective back focal plane (BFP) 460.
  • the aperture 432 lies in the plane ofthe figure
  • the lens 440 relays the illumination stripe formed by the aperture 432 onto the back focal plane 460 ofthe objective 470 which transforms it into a line 484 in the object plane perpendicular to the plane of Fig. 6.
  • the slit mask 430 is removed entirely.
  • the illumination source is the laser 410, the light from which is focused into the back focal plane 460 ofthe objective 470. This can be accomplished by the combination ofthe cylindrical lens 420 and the spherical lens 440 as shown in Fig. 6, or the illumination can be focused directly into the plane 460 by the
  • An image ofthe sample area for example a sample in a sample well 482, is obtained by projecting the line of illumination onto a plane within the sample, imaging the fluorescence emission therefrom onto a detector 520 and moving the plate 480 in a direction perpendicular to the line of illumination, synchronously with the reading ofthe detector
  • the fluorescence emission is collected by the objective lens 470, projected through the dichroic beamsplitter 450, and imaged by lens 490 through filters 500 and a second slit mask 510 onto a detector 520, such as is appropriate to a confocal imaging system having an infinity-corrected objective lens 470.
  • the dichroic beamsplitter 450 and filter 500 preferentially block light at the illumination wavelength.
  • the detector 520 illustratively is a camera and may be either one dimensional or two dimensional. If a one dimensional detector is used, slit mask 510 is not needed. The illumination, detection and translation procedures are continued until the prescribed area has been imaged. Mechanical motion is simplified if the sample is translated at a continuous rate. Continuous motion is most useful if the camera read-time is small compared to the
  • the camera is read continuously.
  • the displacement d ofthe sample during the combined exposure-time and read-time may be greater than or less than the width ofthe illumination line W, exemplarily 0.5W ⁇ d ⁇ 5W. All ofthe wells of a multiwell plate can be imaged in a similar manner.
  • the microscope can be configured to focus a line of
  • the size and shape ofthe illumination stripe 484 is determined by the width and length ofthe Fourier transform stripe in the objective lens back focal plane 460.
  • the length ofthe line 484 is determined by the width ofthe line in 460 and
  • the width in 484 is determined by the length in 460.
  • the length ofthe illumination stripe at 460 is chosen to overfill the objective back aperture. It will be evident to one skilled in the art that the size and shape ofthe illumination stripe 484 can be controlled by the combination ofthe focal length ofthe cylindrical lens 420 and the beam size at 420, that is by the effective numerical aperture in each dimension, within the restrictions imposed by aberrations in the objective, and the objective field of view.
  • the dimensions ofthe line of illumination 484 are chosen to optimize the signal to noise ratio. Consequently, they are sample dependent. Depending on the assay, the resolution may be varied between diffraction-limited, i.e., less than 0.5 ⁇ m, and approximately 5 ⁇ m.
  • the beam length is preferably determined by the objective field of view, exemplarily between .5 and 1.5 mm.
  • a Nikon ELWD, 0.6 NA, 40X objective, for example, has a field of view of approximately 0.75 mm.
  • the diffraction-limited resolution for 633 nm radiation with this objective is approximately 0.6 ⁇ m or approximately 1100 resolution elements.
  • the effective depth resolution is determined principally by the width of aperture 512 in slit mask 510 or the width of the one dimensional detector and the image magnification created by the combination ofthe objective lens 470 and lens 490.
  • the best depth resolution of a confocal microscope approaches 1 ⁇ m. In the present application, a depth resolution of 5-10 ⁇ m may be sufficient or even advantageous.
  • the sample of interest such as a live cell
  • a similar situation prevails in the case of video-rate kinetics studies of transient events such as ion-channel openings. Practically, this is accomplished by underfilling the back aperture ofthe objective lens, which is equivalent to increasing the diameter ofthe illumination aperture.
  • the effective numerical aperture ("NA") ofthe illumination is less than the NA ofthe objective.
  • the fluorescence emission is, however, collected with the full NA ofthe objective lens.
  • the width of aperture 512 must be increased so as to detect emission from the larger illumination volume. At an aperture width a few times larger than the diffraction limit, geometrical optics provides an adequate approximation for the size ofthe detection- volume element:
  • MULTI-WAVELENGTH CONFIGURATION An embodiment enabling multi-wavelength fluorescence imaging is preferred for certain types of assays. It is generally advantageous and often necessary that two or more measurements be made simultaneously since one important parameter in a biological response is time.
  • Figs. 8(a) and 8(b) depict the ray paths in a three-color line-scan confocal imaging system, from a top view and a side view respectively.
  • the system comprises several sources S n of electromagnetic radiation, collimating lenses L n , and mirrors M devis for producing a collimated beam that is focused by cylindrical lines CL into an elongated beam at first spatial filter SF,, a confocal microscope between first spatial filter SF,, and second spatial filter SF 2 and an imaging lens IL, beamsplitters DM, and DM 2 and detectors D n for separating and detecting the different wavelength components of fluorescent radiation from the sample.
  • Spatial filters SF, and SF, and SF 2 preferably are slit masks.
  • Fig. 8(a) depicts sources, S,, S 2 and S 3 , for colors ⁇ ,, ⁇ 2 and ⁇ 3 and lenses L,, L 2 and L 3 that collimate the light from the respective sources.
  • Lenses L,, L 2 and L 3 preferably are adjusted to compensate for any chromaticity ofthe other lenses in the system.
  • Mirrors M,, M 2 and M 3 are used to combine the illumination colors from sources S n .
  • the mirrors M 2 and M are partially transmitting, partially reflecting and preferentially dichroic.
  • M 2 for example, should preferentially transmit ⁇ 3 , and preferentially reflect ⁇ 2 . It is thus preferential that ⁇ 3 be greater than ⁇ 2 .
  • the combined excitation beams from sources S n be focused to a "line", or an highly eccentric ellipse, in the object plane OP.
  • a variety of configurations may be used to accomplish this.
  • the combined illumination beams are focused by cylindrical lens CL into an elongated ellipse that is coincident with the slit in the spatial filter SF,.
  • the slit mask SF resides in an image plane ofthe system, aligned perpendicular to the propagation ofthe illumination light and with its long axis in the plane ofthe page of Fig. 8a.
  • the lenses TL and OL relay the illumination line from the plane containing SF, to the object plane OP.
  • a turning mirror, TM is for convemence.
  • DM 3 is between TL and OL and CL and focuses the illumination light directly into the BFP.
  • Other embodiments will be evident to one skilled in the art.
  • the light emitted by the sample and collected by the objective lens, OL is imaged by the tube lens, TL, onto the spatial filter, SF 2 .
  • SF 2 is preferentially a slit aligned so as to extend pe ⁇ endicular to the plane ofthe page.
  • the light passed by filter SF 2 is substantially a line of illumination.
  • SF 2 may be placed in the primary image plane or any plane conjugate thereto.
  • DM 3 is partially reflecting, partially transmitting and preferably "multichroic". Multi-wavelength "dichroic" mirrors, or “multichroic” mirrors can be obtained that preferentially reflect certain wavelength bands and preferentially transmit others.
  • will be defined to be the fluorescence emission excited by ⁇ .
  • the light transmitted by SF 2 is imaged onto the detection devices, which reside in planes conjugate to the primary image plane.
  • an image ofthe spatial filter SF 2 is created by lens IL on all three detectors, D n . This embodiment is preferred in applications requiring near-perfect registry between the images generated by the respective detectors.
  • individual lenses IL n are associated with the detection devices, the lens pairs IL and IL n serving to relay the image ofthe spatial filter SF 2 onto the respective detectors D n .
  • the light is split among the detectors by mirrors DM, and DM 2 .
  • the mirrors are partially transmitting, partially reflecting, and preferentially dichroic.
  • DM preferentially reflects ⁇ , and preferentially transmits ⁇ 2 and ⁇ 3 .
  • the blocking filter, BF may preferentially transmits ⁇ , effectively blocking all other wavelengths present.
  • DM 2 preferentially reflects ⁇ 2 and preferentially transmits ⁇ 3 .
  • the blocking filters, BF 2 and BF 3 preferentially transmit ⁇ 2 and ⁇ 3 respectively, effectively blocking all other wavelengths present.
  • Video-rate imaging generally refers to 30 or 60 frames per second. In the present use, it is intended to connote frame rates with an order-of-magnitude of 30 Hz.
  • video-rate imaging is achieved by illuminating along one dimension ofthe sample plane and scanning the illumination beam in the direction pe ⁇ endicular thereto so as to effect a relative translation ofthe illumination and sample.
  • the scanning stage is generally massive. Consequently, it cannot be moved sufficiently rapidly.
  • Fig. 9 depicts an embodiment ofthe invention utilizing a scanning mirror, SM.
  • the mirror is advantageously placed in a plane conjugate to the objective back focal plane (BFP):
  • BFP objective back focal plane
  • a rotation in the BFP (or a plane conjugate thereto) effects a translation in the object plane (OP) and its conjugate planes.
  • the full scan range of SM need only be a few degrees for typical values ofthe focal lengths ofthe lenses RL, and RL 2 .
  • this lens pair images the BFP onto the SM at a magnification of one, but a variety of magnifications can be advantageously used.
  • the limiting factors to the image acquisition rate are the camera read-rate and the signal strength. In the imaging mode described above, data can be acquired continuously at the camera read-rate, exemplarily 1 MHz.
  • the sample must lie in the object plane of an imaging system.
  • the invention provides an autofocus mechanism that maintains the portion ofthe sample in the field-of-view ofthe imaging system within the object plane of that system.
  • the precision of planarity is determined by the depth-of-field ofthe system.
  • the depth-of-field is approximately 10 ⁇ m and the field-of-view is approximately 1 mm 2 .
  • the disclosed autofocus system operates with negligible delay, that is, the response time is short relative to the image acquisition-time, exemplarily 0.01-0.1 s.
  • the autofocus light source is independent ofthe illumination light sources and the sample properties.
  • this configuration permits the position ofthe sample carrier along the optical axis ofthe imaging system to be determined independent of the position ofthe object plane.
  • a single-beam autofocus is provided in Figs. 8 and 9, where a separate light source, S 4 of wavelength ⁇ 4 , and detector D 4 are shown.
  • the wavelength ⁇ 4 is necessarily distinct from the sample fluorescence, and preferentially a wavelength that cannot excite appreciable fluorescence in the sample.
  • ⁇ 4 is preferentially in the near infrared, exemplarily 800-1000 nm.
  • the partially transmitting, partially reflecting mirror, DM 4 is preferentially dichroic, reflecting ⁇ 4 and transmitting ⁇ n and ⁇ n , n-1,2,3.
  • Optically-based autofocus mechanisms suitable for the present application are known.
  • an astigmatic-lens-based system for the generation of a position error signal suitable for servo control is disclosed in Applied Optics 23 565-570 (1984).
  • a focus error detection system utilizing a "skew beam” is disclosed in SPIE 200 73-78 (1979).
  • D 4 is a split detector.
  • the servo loop For use with a microtiter plate having a sample residing on the well bottom, the servo loop must, however, be broken to move between wells. This can result in substantial time delays because ofthe need to refocus each time the illumination is moved to another well.
  • This system utilizes two independent beams of electromagnetic radiation.
  • One, originating from S 5 is focused on the continuous surface, exemplarily the bottom of a microtiter plate.
  • the other, originating from S 4 is focused on the discontinuous surface, exemplarily the well bottom of a microtiter plate.
  • the beams originating from S 4 and S 5 have wavelengths ⁇ 4 and ⁇ 5 , respectively.
  • ⁇ 4 is collimated by L 4 , apertured by iris I 4 , and focused onto the discontinuous surface by the objective lens OL.
  • ⁇ 5 is collimated by L 5 , apertured by iris I 5 , and focused onto the continuous surface by the lens CFL in conjunction with the objective lens OL.
  • the reflected light is focused onto the detectors D 4 and D 5 by the lenses IL 4 and IL 5 , respectively.
  • the mirrors, M 4 , M 5 and M 6 are partially transmitting, partially reflecting. In the case that ⁇ 4 and ⁇ 5 are distinct, M 6 is preferentially dichroic.
  • ⁇ 4 is focused onto the well bottom.
  • the object plane can be offset from the well bottom by a variable distance. This is accomplished by adjusting L 4 or alternatively by an offset adjustment in the servo control loop. For convenience of description, it will be assumed that ⁇ 4 focuses in the object plane.
  • the operation ofthe autofocus system is as follows. If the bottom ofthe sample well is not in the focal plane of objective lens OL, detector D 4 generates an error signal that is supplied through switch SW to the Z control.
  • the Z control controls a motor (not shown) for moving the microtiter plate toward or away from the objective lens. Alternatively, the Z control could move the objective lens. If the bottom PB ofthe microtiter plate is not at the focal plane ofthe combination ofthe lens CFL and the objective lens OL, detector D 5 generates an error signal that is applied through switch SW to the Z control.
  • An XY control controls a motor (not shown) for moving the microtiter plate in the object plane OP of lens OL.
  • the entire scan is under computer control.
  • An exemplary scan follows: At the completion of an image in a particular well, the computer operates SW to switch control ofthe servo mechanism from the error signal generated by D 4 to that generated by D 5 ; the computer then directs the XY control to move the plate to the next well, after which the servo is switched back to D 4 .
  • the "coarse" focusing mechanism utilizing the signal from the bottom ofthe plate is used to maintain the position ofthe sample plane to within the well-to-well variations in the thickness ofthe plate bottom, so that the range over which the "fine” mechanism is required to search is minimized. If, for example, the diameter ofthe iris I 5 is 2 mm and IL 5 is 100 mm, then the image size on the detector will be - 100 ⁇ m. Similarly, if the diameter ofthe iris I 4 is 0.5 mm and IL 4 is 100 mm, then the image size on the detector will be - 400 ⁇ m. The latter is chosen to be less sensitive so as to function as a "coarse" focus.
  • the wavelengths ⁇ 4 and ⁇ 5 are necessarily distinct from the sample fluorescence, and preferentially wavelengths that cannot excite appreciable fluorescence in the sample.
  • ⁇ 4 and ⁇ 5 are preferentially in the near infrared, such as 800-1000 nm.
  • the two beams are polarized pe ⁇ endicular to one another and M 6 is a polarizing beamsplitter.
  • Pseudo-closed loop control is provided in the preferred embodiment of single-beam autofocus which operates as follows. At the end of a scan the computer operates SW to switch control to a sample-and-hold device which maintains the Z control output at a constant level while the plate is moved on to the next well after which SW is switched back to D 4
  • An essential feature ofthe disclosed apparatus is the use of a detection device having manifold, independent detection elements in a plane conjugate to the object plane.
  • line illumination is advantageous principally in applications requiring rapid imaging.
  • the potential speed increase inherent in the parallelism of line illumination as compared to point illumination is, however, only realized if the imaging system is capable of detecting the light emitted from each point ofthe sample along the illumination line, simultaneously.
  • CCD charge-coupled device
  • the resulting apparatus has three significant disadvantages compared to the present invention.
  • the present invention is designed to avoid these disadvantages and optimize not only imaging speed, within the constraints of high-sensitivity and low-noise detection, but also throughput.
  • One embodiment uses a continuous-read line-camera, and in a preferred embodiment a rectangular CCD is used as a line-camera. Both embodiments have no dead-time between lines within an image or between images.
  • An additional advantage ofthe present invention is that a larger effective field-of-view is achievable in the stage- scanning embodiment, discussed below.
  • the properties required ofthe detection device can be further clarified by considering the following preferred embodiment.
  • the resolution limit ofthe objective lens is ⁇ 1 ⁇ m, typically -0.5 ⁇ m, and the detector comprises an array of -1000 independent elements.
  • Resolution, field-of-view (FOV) and image acquisition-rate are not independent variables, necessitating compromise among these performance parameters.
  • the magnification ofthe optical system is set so as to image as large a FOV as possible without sacrificing resolution. For example, a -1 mm field-of-view could be imaged onto a 1000- element array at 1- ⁇ m pixelation. If the detection elements are 20- ⁇ m square, then the system magnification would be set to 20X. Note that this will not result in 1- ⁇ m resolution.
  • Pixelation is not equivalent to resolution. If, for example, the inherent resolution limit of the objective lens is 0.5 ⁇ m and each 0.5 ⁇ m X 0.5 ⁇ m region in the object plane is mapped onto a pixel, the true resolution ofthe resulting digital image is not 0.5 ⁇ m. To achieve true 0.5- ⁇ m resolution, the pixelation would need to correspond to a region -0.2 ⁇ m X 0.2 ⁇ m in the object plane.
  • the magnification ofthe imaging system is set to achieve the true resolution ofthe optics. Presently, the highest detection efficiency, lowest noise detection devices having sufficient read-out speed for the present applications are CCD cameras.
  • a rectangular CCD camera is depicted having an m x n array of detector elements where m is substantially less than n.
  • the image ofthe fluorescence emission covers one row that is preferably proximate to the read register. This minimizes transfer time and avoids accumulating spurious counts into the signal from the rows between the illuminated row and the read-register.
  • An additional advantage ofthe preferred embodiment having one or more rectangular CCD cameras as detection devices in conjunction with a variable-width detection spatial filter, SF 2 in Figs. 8 and 9 and 510 in Fig. 6, each disposed in a plane conjugate to the object plane, is elucidated by the following.
  • the detection spatial filter is omitted and a line-camera is used as a combined detection spatial filter and detection device.
  • a variable- width detection spatial filter permits the optimization ofthe detection volume so as to optimize the sample-dependent signal-to-noise ratio.
  • the following preferred embodiment retains the advantage of a line-camera, namely speed, and the flexibility of a variable detection volume.
  • the magnification is set so as to image a diffraction- limited line of height h onto one row ofthe camera.
  • the width ofthe detection spatial filter d is preferably variable h ⁇ d ⁇ lOh.
  • the detectors in the illuminated columns ofthe camera are binned, prior to reading, which is an operation that requires a negligible time compared to the exposure- and read-times.
  • the cameras are Princeton Instruments
  • the read-rate in a preferred embodiment is 1 MHz at a few electrons of read-noise.
  • the pixel format is 1340x100, and the camera can be wired to shift the majority ofthe rows (80%) away from the region of interest, making the camera effectively 1340x20.
  • an additional advantage is that it permits the acquisition of rectangular images having a length limited only by the extent ofthe sample. The length is determined by the lesser ofthe camera width and the extent ofthe line illumination.
  • the sample is disposed on the bottom of a well in a 96-well microtiter plate, the diameter of which is 7 mm.
  • a strip 1 ⁇ m X I mm is illuminated and the radiation emitted from the illuminated area is imaged onto the detection device.
  • the optical train is designed such that the field-of-view is -lmm 2 .
  • an image ofthe well-bottom can be generated at 1- ⁇ m pixelation over a 1 X 7-mm field.
  • assays are performed on live cells. Live-cell assays frequently require a reasonable approximation to physiological conditions to run properly. Among the important parameters is temperature. It is desirable to inco ⁇ orate a means to raise and lower the temperature, in particular, to maintain the temperature ofthe sample at 37C. In another embodiment, control over relative humidity, and/or CO 2 and/or O 2 is necessary to maintain the viability of live cells. In addition, controlling humidity to minimize evaporation is important for small sample volumes.
  • a microtiter plate at an elevated temperature preferably 37C, compatible with the LCI system follow.
  • the imaging system preferably resides within a light-proof enclosure.
  • the sample plate is maintained at the desired temperature by maintaining the entire interior ofthe enclosure at that temperature.
  • elevated humidity is pu ⁇ osefully maintained, evaporation cooling will reduce the sample volume limiting the assay duration.
  • a second embodiment provides a heated cover for the microwell plate which allows the plate to move under the stationary cover. The cover has a single opening above the well aligned with the optical axis ofthe microscope. This opening permits dispensing into the active well while maintaining heating and limited circulation to the remainder of the plate.
  • a space between the heated cover plate and microwell plate of approximately 0.5 mm allows free movement ofthe microwell plate and minimizes evaporation.
  • the contents ofthe interrogated well are exposed to ambient conditions though the dispenser opening for at most a few seconds, said contents suffer no significant temperature change during the measurement.
  • a thin, heated sapphire window is used as a plate bottom enclosure.
  • a pattern of resistive heaters along the well separators maintain the window temperature at the desired level.
  • the three disclosed methods can be variously combined.
  • One embodiment ofthe video-rate configuration ofthe imaging system is further configured to initiate kinetic assays, in particular ion-channel assays, with a timed reagent dispense. Initiation of channel opening is accomplished by dispensing a solution into the micro well. For example, voltage-gated channels can be opened by addition of a solution of KC1 to depolarize the plasma membrane. The time-dependence ofthe channel opening and subsequent closing and the corresponding change in intracellular concentration is often sufficiently rapid to require video-rate imaging. The intrinsic speed ofthe imaging system is irrelevant, however, unless the channel response can be initiated rapidly.
  • One embodiment ofthe present invention provides an integrated dispenser. For assays run in 96- or 384-well plates, addition volumes in this range 20-100 ⁇ L are desirable.
  • a single head dispenser as is appropriate, for example, to the addition of an agonist of ion-channel activity, is the IVEK Dispense 2000. Comparable units are available from CAVRO. More generally, it is desirable to be able to dispense a unique compound into each well.
  • One embodiment provides a single head dispenser on a robotic motion device that shuttles the dispense head between the analysis station, the source plate containing the unique compounds and the tip cleansing station. The latter is a wash station for a fixed tip dispenser and a tip changing station for a disposable tip dispenser.
  • This system provides the desired functionality relatively inexpensively, but it is low throughput, requiring approximately 30 seconds per compound aspiration-dispense-cleanse cycle.
  • An alternative embodiment is provided by integrating a multi-head dispenser such as the Hamilton Micro lab MPH-96 into the disclosed LCI system.
  • the MPH-96 consists of 96 independent fixed tip dispensers mounted to a robotic motion device capable of executing the aspirate-dispense-wash cycle described above.
  • the imaging system is integrated with plate-handling robots, such as the Zymark Twister.
  • Figs. 12(a) and 12(b) depict the ray paths in conventional dark-field.
  • a sample 600 is illuminated by a hollow cone of light 610 from an objective lens 620. This cone of light is created, for example, by placing an opaque bar 630 at lens 440 in Fig. 10(a).
  • the fluorescent emission from sample 600 is then collected through the center ofthe objective lens 620. Because ofthe differing angles of illumination and collection, the only plane which is both illuminated and detected is the plane containing sample 600.
  • Figs. 13(a) and 13(b) depict the ray paths in inverted dark-field.
  • a sample 700 is illuminated with a beam of light 710 that passes through the center of an objective lens 720.
  • fluorescent emissions are then collected only from around the outside of objective lens 720. Collection from around the outside ofthe objective may be achieved by placing, for example, an opaque bar 730 at lens 490 in Fig. 10(a).
  • inverted dark-field involves illumination at one angle and collection at a different angle so that only the sample plane is both illuminated and detected.
  • Fig. 14 depicts the focal region in the case described above where it is advantageous to illuminate a larger than diffraction- limited area ofthe sample plane.
  • the illumination and collection rays are the same as those in the inverted dark-field geometry of Fig. 13. If a stop is placed in a plane conjugate to the objective back focal plane having a width matched to the illumination beam, the dark-field configuration is achieved. That this configuration confers a decrease in the out-of-plane fluorescence impinging on the detector can be understood from Fig. 14.
  • the fluorescence from the shaded regions above and below the object plane is not passed by the stop. In point-scan confocal, fluorescence from these out-of-plane regions is rejected efficiently by the detection aperture.
  • line-scan confocal In line-scan confocal, the out-of-plane fluorescence from one lateral position along the line contributes to the background signal at other points along the line: this is the origin ofthe degradation in signal-to-background in line-scan relative to point-scan confocal.
  • the inverse dark-field configuration of line-scan confocal recovers a significant fraction ofthe background rejection attributes of point-scan confocal while retaining the speed advantage ofthe line- scan configuration.
  • the present invention is capable of generating megabytes of data per second, continuously.
  • the system is integrated with a fast high-density, high- volume storage device to which the data can be spooled in real time for subsequent analysis.
  • data analysis is run essentially simultaneously with data acquisition.
  • the data is processed prior to storage.
  • the results ofthe analysis are archived, but it is advantageous to archive selected raw data, as well. Examples of real time analysis routines are provided below in conjunction with each ofthe assay groups. In all cases, procedures are used to optimize the software code for operation on the hardware platform of interest.
  • the computer is a 32-bit processor such as the Pentium II. In this case, all data is accessed in 32-bit parcels.
  • the acquisition and analysis ofthe data comprises a number of discrete steps.
  • a correction is made for the non- uniform response ofthe imaging system across the field of view wherein the background subtracted data are divided by a so-called flat-field file.
  • Second, a binary bitmap is generated from one ofthe digital images in which all values meeting certain criteria are replaced by one, all values failing to meet the criteria are replaced by zero.
  • the criteria include a threshold value determined from the image itself.
  • Third, the bitmap is searched for groups of contiguous value-one pixels.
  • the groups are further tested against minimum- and/or maximum-size criteria.
  • the values ofthe corresponding pixels in the same image or in another image are summed and recorded, and the average and other statistical properties ofthe sums determined and recorded. Additions to and variations on this basic procedure appropriate to the various assays are disclosed below.
  • a characteristic spatial and/or temporal distribution of one or more fluorescently-labeled species is used to quantify the assay.
  • the fluorescence is observed from an essentially planar surface using a line-scan confocal microscope.
  • This section is organized by assay-type according generally to increasing degree of complexity in the associated data analysis routine. The organization is not strict, however, because the analysis algorithms are often applicable to more than one assay-type.
  • a first assay-type that can be advantageously performed according to the methods ofthe present invention is a binding assay.
  • the degree of binding of a fluorescently-labeled ligand to the target of interest is quantified from the analysis of one or more fluorescence images of a sample containing at least the target and the labeled ligand and obtained with the disclosed line-scan confocal imaging system.
  • the ligands utilized include, but are not limited to, fluorophore conjugated natural and synthetic peptides and proteins, sugars, lipids, nucleic acid sequences, viral particles, bacteriophage particles, natural and synthetic toxins, known pharmaceutical agents, small organic molecules or synthetic analogues of neuro-transmitters or intrinsically fluorescent small molecules, peptides or proteins, synthetic compounds from combinatorial libraries, random peptides, proteins from cDNA expression libraries, and peptidomimetics. (See Haugland R.P. Handbook of Fluorescent Probes and Research Chemicals 6 th Ed. Chap.
  • the targets include, but are not limited to cellular extracts or purified preparations of receptors, ligand- gated and ion-gated channel proteins, enzymes, transcription factors, cytoskeletal proteins, and antibodies and can be derived from viruses, bacteria, bacteriophages, invertebrate and vertebrate cells.
  • Exemplary receptors include but are not limited to acetylcholine, adrenergic ( ⁇ and ⁇ ), muscarinic, dopamine, glycine, glutamine, serotonin, aspartate, gamma-amino butyric acid (GABA), purinergic, histamine, norepinephrine, Substance P, Neuropeptide Y, enkephaline, neurotensin, cholecystokinin (CCK), endo ⁇ hin (opiod), melanocrotin ACTH, somatostatin, parathyroid hormone, growth hormone, thyrotropin, thyroxin, cytokine, chemokine, insulin, insulin-like growth factor (IGF), stem cell factor, Luteinizing hormone-releasing hormone, gonadotropin, angiotensin, endothelin, neurotensin, interferon, bradykinin, vasopressin, oxytocin, vasoactive intestinal polypeptide
  • Figs. 15(a) - 15(f) depict the steps of an embodiment of a receptor-binding assay that can be performed according to the present invention.
  • membranes 210 prepared from cells or tissues and containing the receptor target 212 are added to a well 220 containing a liquid 230.
  • fluorescent-labeled ligands 214 are added to well 220; these ligands bind to the membrane receptors 212.
  • beads 224 are added to the well 220.
  • the order of 15(b) and 15(c) may be interchanged, and in a preferred embodiment, the membrane-coated beads are prepared separately, prior to addition to the well.
  • Beads 224 have a diameter in the range of approximately 1-20 ⁇ m and are coated with a material, such as wheat germ agglutinin, to which the membranes 210 adhere or have a surface that allows for the direct covalent or non-covalent binding of membranes.
  • a material such as wheat germ agglutinin
  • beads 224 are not luminescent and they have a density such that they sink to, or can be spun down to, the bottom ofthe well or are magnetic so that they can be moved to the bottom ofthe well using an external magnet.
  • the fluorescent labels are imaged using, for example, a line-scan confocal microscope schematically depicted as element 240.
  • a test compound 218 is added to the well.
  • the pu ⁇ ose ofthe present assay is to determine the extent to which the test compound displaces the fluorescently-labeled ligands 214 from the membrane receptors 212.
  • the fluorescent labels still bound to the membranes 210 are imaged. By comparing the two fluorescent images, the activity ofthe test compound can be determined.
  • the imaging step depicted in Fig. 15(d) can be eliminated and the activity ofthe test compound can be determined by comparing the image obtained in Fig. 15(f) to the image of a control well or the image expected from the known quantity ofthe fluorescent-labeled ligands added to the well and their known affinity to the receptors.
  • the receptor is an antibody that recognizes the ligand
  • the fluorescently-labeled ligand is added to the reaction along with a sample containing an unknown amount of unlabelled ligand.
  • the pu ⁇ ose ofthe present assay is to determine the concentration of unlabelled ligand in the sample by measuring extent to which it displaces the fluorescently-labeled ligands 214 from the antibody receptor.
  • Figs. 16(a) - 16(f) depict the steps of a second embodiment of a receptor- binding assay according to the present invention.
  • membranes 250 prepared from cells or tissues and containing the receptor target 252 are added to a well 260 containing a liquid 270.
  • the well bottom 262 is coated with a material such as wheat germ agglutinin, to which the membranes adhere.
  • membranes 250 are shown bound to this material.
  • fluorescently-labeled ligands 254 are added to well 260 and bind to the membrane receptors 252.
  • the order of Figs. 16(b) and 16(c) may be interchanged.
  • Fig. 16(d) the fluorescence ofthe fluorescent labels is imaged using, for example, a line-scan confocal microscope schematically depicted by element 280.
  • a test compound 258 is added to well 260.
  • the fluorescent labels still attached to the membranes 250 are imaged and compared to the first image to determine the activity of test compound 258.
  • the imaging in Fig. 16(d) can be eliminated and the activity ofthe test compound can be determined by comparing the image obtained in Fig. 16(f) to the image of a control well or the image expected from the known quantity ofthe fluorescent-labeled ligands added to the well and their known affinity to the receptors.
  • ligand-target binding is advantageously assayed on collections of cells expressing the target.
  • the activity of interest is measured in the presence of both competing and complementary cellular processes affecting the biological activity ofthe compound.
  • cellular assays cells prepared from cell lines or tissues are placed in tissue culture wells or on microscope slides. The cells can be live and intact or permeabilized with reagents such as digoxigenin, or, alternatively, fixed with reagents such as formaldehyde.
  • One or more fluorescent- labelled ligands are added to the cells along with any non-fluorescent reagents required for the assay; the fluorescent-labelled ligands bind to one or more components ofthe cells. A test compound is then added to the cells. Alternatively, the order of addition of fluorescent ligands and chemical compounds may be interchanged.
  • the fluorescent labels are imaged using, for example, a line-scan confocal microscope schematically depicted as element 240.
  • the pu ⁇ ose ofthe present assay is to determine the extent to which the test compound displaces the fluorescently-labeled ligands from the receptors.
  • the fluorescent labels still bound to the cells are imaged in the presence and the absence of test compound. By comparing the two fluorescent images, the activity ofthe test compound can be determined.
  • the imaging step in the absence of compound can be eliminated and the activity ofthe test compound can be determined by comparing the image obtained in the presence of compound to the image of a control well or the image expected from the known quantity of the fluorescent-labeled ligands added to the well and their known affinity to the receptors.
  • ligand-target binding is performed with one excitation wavelength and one emission wavelength.
  • Data are provided in Fig. 27 exemplifying the speed and sensitivity ofthe present invention.
  • the prior art for receptor-ligand assays includes SSA formats as well as formats in which bound and unbound ligand are physically separated and the amount of ligand bound to the receptor is measured by the addition of liquid scintillant.
  • the present invention can be used in small-volume wells, exemplarily 1 ⁇ L.
  • each radio label 3 H for example, can decay only once, producing at most 90 photons per decay, at a decay rate of less than 10 '8 per second.
  • a single fluorescent molecule will produce 10 4 - 10 7 photons in total, and it will emit between 10 3 and 10 6 photons per second.
  • the count-rate for a fluorescent label is approximately 10" relative to 3 H.
  • the present invention therefore, requires enormous fewer labels, membranes and beads per well. For example, while a tritium SSA requires 10 7 beads per well, the present invention requires less than 10 3 beads per well. As a result, the present invention can be performed in ⁇ L-volume wells and in far less time.
  • the excitation rate of fluorescent labels can be increased so as to increase the photon emission rate, thereby reducing the required imaging time.
  • the excitation rate cannot, however, be increased without limit.
  • the so-called saturation limit ofthe fluorophore emission rate that underlies the substantial advantage ofthe line-scan confocal over the point-scan confocal in the present application.
  • the present invention does not require the time and expense of handling radioactivity.
  • the present invention can be performed in small-volume wells, the compound and reagent consumption is much lower than for SSAs resulting in further cost reductions.
  • the present invention does not require scintillant-doped beads or well bottoms, reducing costs even further.
  • the present invention uses a line-scan confocal microscope to image the fluorescence ofthe sample in the well.
  • the confocal aspect ofthe microscope allows for optical sectioning, i.e., detection of fluorescence from the plane in which the sample is located while minimizing the detection of fluorescence from the bulk ofthe solution. This eliminates the need for wash steps to remove unbound fluorescent-labeled ligand; this step, while it is not required in an SSA, is still required in any receptor-ligand binding assay, including RIA, in which scintillant containing beads are not used.
  • the confocal aspect ofthe microscope also eliminates any interference that may originate from intrinsic fluorescent test compounds.
  • the line-scan aspect allows the sample to be imaged more rapidly than in traditional point-scanning without losing appreciable background rejection.
  • the speed increase depends on the fluorophore density, the lateral resolution, the field of view, and parameters ofthe hardware including the objective NA, the detection sensitivity and camera read-rate. Theoretically, the speed increase can approach the number of pixels per line, which is 1000 in a preferred embodiment ofthe present invention. Practically, the increase is approximately 100X.
  • the assay is cell-based, wherein the location ofthe fluorescence is to be resolved to a precision of 1 ⁇ m.
  • the image of a 1-mm diameter sample area will consist of -10 3 lines of -10 3 pixels.
  • the fluorescence signal of interest might originate from ligands on the cell surface or from a localized source within the cell, such as a receptor in the nucleus. In either case, the local concentration ofthe fluorophore is the important parameter. For an engineered cell line expressing -10 5 receptors per cell, the cell-averaged concentration is -1 ⁇ M. A few thousand receptors localized in the nucleus results in a comparable local concentration.
  • the image be acquired in less than 1 second, preferably in a fraction of a second. If the pixels are acquired in a serial fashion, then the pixel dwell-time must be less than 1 ⁇ s, requiring a photon emission rate of greater than 10 8 per second per molecule. This is beyond the saturation value of most fluorophores, which is typically 10 6 . Importantly, the flux required to achieve saturation, 10 5 - 10 6 W/cm 2 , is sufficient to drive non- linear photo-induced bleaching ofthe fluorophores, as well. Finally, the highest efficiency detection devices cannot be used at the data rates required in serial scanning. By contrast, the emission rate per fluorophore need only be ⁇ 10 5 if 10 3 pixels are illuminated simultaneously.
  • exemplary data of Fig. 27 demonstrate that the disclosed system has sufficient sensitivity to quantify tens of fluorophores per bead, while clearly resolving hundreds of individual beads in less than 1 second. Comparable data can be acquired in cell-based binding experiments, as will be exemplified below.
  • the data analysis routines are closely related whether the binding be cell- based or bead-based and are presented together, below.
  • the data can be analyzed by the following routines, the simplest of which is the Threshold Image Analysis algorithm.
  • the pu ⁇ ose ofthe routine is to determine the amount of a fluorescently-labeled species that is localized in a contiguous or punctate manner so as to exceed a minimum fluorescence intensity, and optionally so as to not exceed a maximum fluorescence intensity.
  • the analysis is used to assay the activity of a chemical compound.
  • the steps ofthe algorithm are as follows: 1. Acquire a digitized image ofthe labeled species. 2. Open file row-by-row and i.
  • Subtract camera offset value from image ii. Multiply each row in the image by the inverse ofthe corresponding row in the flat-field image file. 3. Optionally, histogram the image to determine the background level. 4. Establish selection criteria including a minimum value and optionally a maximum value. The values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a predetermined value. 5. Compare each pixel in the image to the selection criteria. For each pixel in the image meeting the criteria, add the value to a running sum. The total number of qualified pixels and the average intensity are reported.
  • This routine is used advantageously to process data similar to that in Fig. 27, in which the individual beads are clearly distinguishable from the background and the artefacts due to clumped beads or cells are small.
  • Such a routine is appropriate for the assay-type having membranes bound to the well bottom, as well.
  • a second routine applicable to analyzing binding data is the Localization
  • the pu ⁇ ose is to determine the amount of a fluorescently-labeled species that is localized in a contiguous or punctate manner.
  • the analysis is used to assay the activity of a chemical compound.
  • the values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a predetermined value.
  • n is the number of dilation steps to be performed below and has been previously determined, ii. If step 8.i. was implemented, then dilate the object by applying a dilation step n times in which pixels of value 0 that touch 1-valued pixels are set to value 1. i ⁇ . For each collection of 1-valued pixels in either the dilated bitmap, or in the original bitmap if step 8.i. was not implemented, sum and average the corresponding pixel values from the image to calculate the average pixel intensities under the mask, iv.
  • the distinguishing operation in this routine is the creation ofthe binary mask in steps 4-6.
  • Mask generation is depicted in Fig. 20.
  • the selection criteria of objects for the mask can optionally include minimum and maximum values, size and shape.
  • the analysis routine for the bead-based assays include a roundness filter in step 7.iii.
  • the emission of two or more fluorescently-labeled species is detected simultaneously, excited by one or more illumination wavelengths.
  • the first fluorescently-labeled species is used to identify the object to which the second fluorescently-labeled species binds.
  • Two examples of two-color cell-based binding assays are provided in Figs. 24 and 26.
  • An exemplary procedure that can be used to analyze such images is the Co-localization Analysis routine which is designed to determine the amount of a first fluorescently-labeled species localized with respect to a second fluorescently-labeled species.
  • the analysis is used to assay the activity of a chemical compound, for example, where activity depends on a subcellular localization of interest.
  • Establish selection criteria including a minimum value and optionally a maximum value. These values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a predetermined value.
  • n is the number of dilation steps to be performed below and has been previously determined.
  • step 8.i. If step 8.i. was implemented, then dilate the object by applying a dilation step n times in which pixels of value 0 that touch 1-valued pixels are set to value 1.
  • step 8.i. For each collection of 1-valued pixels in either the dilated bitmap, or the original bitmap if step 8.i. was not executed, sum and average the corresponding pixel values from the image ofthe second species to calculate the average pixel intensities under the mask, iv.
  • the translocation assay is of one or more species, which may be proteins, lipids or other molecular complexes or sub-cellular structures such as vesicles, from one well-defined region of a cell to another. These include but are not limited to: synaptin (vesicle membrane protein), transcription factors (NF- ⁇ B, NFAT, AP- 1), hormone receptors, LDL/HDL receptors, T-cell receptors, and PTH receptors.
  • synaptin vesicle membrane protein
  • transcription factors NF- ⁇ B, NFAT, AP- 1
  • hormone receptors LDL/HDL receptors
  • T-cell receptors T-cell receptors
  • PTH receptors PTH receptors
  • the prototypical translocation assay is a special case ofthe co-localization measurement.
  • the co-localization ofthe first and second species is quantified by the fraction ofthe second species co-localized with respect to the first, or the ratio ofthe second species co-localized with the first and that resident elsewhere in the cell.
  • An expanded analysis routine preferentially used to process translocation image data is provided below.
  • the labeled location is the cell nucleus, the label being a fluorophore specific for DNA, such as Hoechst 33342.
  • Other nucleic acid specific stains are known in the art (e.g., see Haugland, R.P. Handbook of Fluorescent Probes and Research Chemicals, 6 th Ed. Chapter 8).
  • the second species is a transcription factor whose migration from the cytoplasm to the nucleus is the subject ofthe assay.
  • This protein can be labeled by a variety of methods, including expression as a fusion with GFP, and contacting the sample with a fluorescently-labeled antibody specific to the transcription factor protein.
  • the following Translocation Data Analysis routine can be used to determine the amount of a first fluorescently-labeled species that is distributed in a correlated or anti- correlated manner with respect to a second fluorescently-labeled species.
  • the analysis is used to assay the activity of a chemical compound.
  • the steps ofthe algorithm are as follows: 1. Acquire images ofthe first and second labeled species respectively. 2. Open files row-by-row and i. Subtract respective camera offset values from each image, ii. Multiply each row in each image by the inverse ofthe corresponding row in its respective flat-field image file. 3. Optionally, histogram the image ofthe first species to determine the background level and sum the intensity ofthe image ofthe second species. 4.
  • Establish selection criteria including a minimum value and optionally a maximum value. These values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a pre- determined value.
  • i- Create a new rectangular bitmap with extended borders that contains the object plus n extra 0 pixels in each direction from the edge ofthe object, n is the number of dilation steps to be performed below and has been previously determined, ii. Dilate the object by applying a dilation step n times in which pixels of value 0 that touch 1-valued pixels are set to value 1. iii. Compare the dilated bitmap with the original full size bitmap. Set to 0 all pixels in the dilated bitmap that are 1-valued in the corresponding region of the original bitmap. This produces an annular mask and ensures only one object is captured when the bitmap borders were increased during dilation. iv. Create another bitmap from the original object, erode it m times by setting to
  • m is typically equal to n and determined previously
  • v For each collection of 1-valued pixels in the annular and eroded bitmaps, average the corresponding pixel values from the image ofthe second species to calculate the average pixel intensities under the eroded and annular masks. vi. Calculate the ratio of eroded to annular intensities for each object and save in a table, vii. . Change to 0 all pixels ofthe object in the original bitmap image and return to step 7 to search for more objects. 9. After all objects have been counted, the average intensity ratio of all objects in the image is calculated along with statistical information such as the standard deviation.
  • Step 8 The new feature of this routine over those disclosed above is the creation in Step 8 of two daughter masks, one an annular extension ofthe primary mask, and one an eroded version ofthe primary mask.
  • the latter is used to quantify the co-localization of species-two with species-one, the transcription factor and the cell nucleus (actually, DNA), respectively, in the present example.
  • the former mask is used to quantify species-two not co-localized.
  • the ratio of these two quantities is formed on an cell- by-cell basis and the results tabulated.
  • the data acquisition and analysis can be performed in approximately one second. For comparison, two prior art examples are cited. In Ding et al. (J. Biol.
  • the advantages ofthe present invention include: 1) approximately 50X faster image acquisition per data channel, 2) simultaneous two-color image acquisition, 3) superior sensitivity of approximately 10X, permitting lower staining levels, 4) confocal detection, allowing elimination of a rinse step, 5) focus-time of approximately 0.1 s compared to approximately 30 s, 6) data analysis time of approximately 0.2 s/frame compared to 3-6 s/frame, and 7) continuous image acquisition.
  • the second example of prior art is Deptala et al. (Cytometry, 33, 376-382, (1998)).
  • the present invention provides 1) higher spatial resolution, approximately 4X, 2) approximately 16X higher pixel acquisition rates, 3) faster data analysis, 4) autofocus operable in microtiter plates, and 5) data analysis time of approximately 0.2 s/frame compared to 3-6 s/frame.
  • ENDOCYTOSIS,EXOCYTOSIS AND RECEPTORSEQUESTRATION Endocytosis and exocytosis, generally, and receptor sequestration and recycling, specifically, are additional processes that can be assayed according to the first or second embodiments and the associated image analysis protocols disclosed above.
  • Fluorescence labeling can be accomplished according to a variety of known methods. For example, an elegant experiment comprising the labeling of both the receptor and ligand is disclosed by Tarasova et al. (J. Biol. Chem., 272, 14817-14824 (1997)).
  • the present imaging system is approximately 5 OX faster per data channel and acquires the two images simultaneously.
  • the present analysis protocols, the Co-localization algorithm for example, can be used to process sequestration image data in real-time. No such examples are known in the prior art.
  • GFP green fluorescent protein
  • ION CHANNELS A third embodiment ofthe present invention, one version of which is depicted in Fig. 9, can be used to image the time-dependent response of one or more fluorescently-labeled species at a rate of approximately 30 frames per second. This permits the capture of transient phenomenon, such as the opening and closing of ion channels.
  • exemplary ion channels include but are not limited to: K + -gated voltage, Na + -gated voltage, Ca ⁇ -gated voltage, Cl " , Na7K + ATPase, and P-glycoproteins.
  • the following Kinetic imaging Data Analysis algorithm defines and tracks individual cells from frame to frame, enabling simultaneous kinetic analysis on a sufficient number of cells to obtain statistically meaningful data.
  • the steps ofthe algorithm are as follows: 1. Acquire one (indicator only), two (marker and indicator or two indicators) or more digitized images as a function of time. 2. Open files row-by-row and i. Subtract respective camera offset values from each image, ii. Multiply each row in each image by the inverse ofthe corresponding row in its respective flat-field image file. Subtract respective camera offset values from each image.
  • the values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a predetermined value.
  • step 8 For each object passing the filter criteria: average the corresponding pixels from each ofthe images in the time series. If a single indicator is used, record the intensities. If ratiometric indicators are used, divide the value of one image by the other for each image in the time series and record the results. 9. After all objects have been analyzed, the results ofthe analysis of step 8 are reported for each object. Kinetic parameters, including the rise time, fall time and amplitude are reported for each object as are statistical information derived from the set of kinetic analyses and from the set of all objects at fixed times.
  • Figs. 22 and 23 Two examples ofthe use ofthe present invention to image and analyze transient events associated with ion channels are provided in Figs. 22 and 23. These assays used the Ca ⁇ -sensitive dye, Fluo-3 to indicate the changes in intra-cellular Ca " ⁇ concentration. In the first ofthe experiments, the change was caused by a Ca ⁇ second signal initiated by the activation of acetylcholine receptors, and in the second experiment the change was due to activation of voltage-gated Ca ⁇ channels. Ion channels have been an area of intense research activity in recent years.
  • the capabilities ofthe present invention to image and analyze changes in intra-cellular ion concentrations in response to external stimuli has multiple applications in compound screening and in general biological research applications. (See e.g. J. Cell Biol.
  • the present invention can be used to assay Cl ' concentrations in vesicles, liposomes and live cells (see Am. J. Physiol. 259, c375 (1990).
  • the present invention can be used to assay changes in membrane potential in cells and sub-cellular organelles. The ability to rapidly image changes in membrane potential is vital to assays for cell and organelle viability, nerve-impulse generation, muscle contraction, cell signaling and ion-channel gating (see Biophys J.
  • Fluorescent indicators are available that respond to fast (millisecond) potential changes in excitable cells such as neurons, cardiac cells and intact brain cells. (See Haugland R.P. Handbook of Fluorescent probes and Research Chemicals, 6 th Ed. Chap. 25).
  • the fluorescent probes that respond to fast fransmembrane potential changes typically show only a 2-10% change in fluorescence per lOOmv.
  • the plasma membrane of a cell has a fransmembrane potential of approximately -70mv and some organelles such as mitochondria maintain fransmembrane potentials of - 150mV. Thus, assays involving such rapid changes require the high sensitivity, rapid data acquisition ability common to the various embodiments ofthe present invention.
  • the present invention can be advantageously used to perform assays which involve fluorescence resonance energy transfer (FRET).
  • FRET occurs when one fluorophore, the donor, absorbs a photon and transfers the absorbed energy non-radiatively to another fluorophore, the acceptor. The acceptor then emits the energy at its characteristic wavelength.
  • the donor and acceptor molecules must be in close proximity, less than approximately 10 nm, for efficient energy transfer to occur (see Methods Enzymol. 211, 353 - 388 (1992); Methods Enzymol. 246, 300-334 (1995)).
  • the proximity requirement can be used to construct assays sensitive to small separations between the donor-acceptor pair.
  • FRET typically requires a single excitation wavelength and two emission wavelengths, and an analysis consisting ofthe ratio ofthe donor and acceptor emission intensities.
  • FRET donor acceptor pairs can be constructed for both bead-based assays and cell-based assays.
  • Several green fluorescent protein (GFP) mutants displaying enhanced fluorescence and altered emission wavelengths can be paired for FRET cell-based assays by fusing the GFP FRET donor to one protein and the GFP FRET acceptor to either the same protein or to another protein expressed within the same cell.
  • GFP green fluorescent protein
  • Such FRET pairing can be used to measure intramolecular changes, such as Ca 2+ -calmodulin binding of Ca 2+ or intermolecular interactions, such as receptor dimerization.
  • the Kinetic Imaging algorithm disclosed above can be preferentially used.
  • TRANSIENT TRANSFECTION Among the significant advantages of an image-based measurement is the opportunity both to observe rare events, lost within the average, and to normalize the primary response on an object-by-object basis to a secondary, response. Both features can be important in assays using a cell line having a transiently transfected target. Gene expression and subsequent protein production following transfection is often inefficient and transient (see BioTechniques 24:478-482 (1998)). Methods to monitor the transfection efficiency that can be advantageously used with the present invention are known in the art. For example, the gene of interest can be transfected together with the gene for green fluorescent protein (GFP), so that the two proteins will be expressed either as a fusion or as separate entities.
  • GFP green fluorescent protein
  • the present invention can be used to measure the amount of indicator present at one wavelength and the response associated with the target at another.
  • the former signal can be used to normalize the response ofthe latter for the amount of target present.
  • the Kinetic Imaging algorithm disclosed above can be used to analyze such data, where only one image frame is required. Viral infection of cells can be monitored, either directly through expression of viral proteins, or indirectly by acquisition of a new phenotype, even if only a few percent of cells are infected.
  • this invention provides a method for detecting a rare event, such as the acquisition of a new phenotype by an individual cell or group of cells due to the transfection of a specific cDNA as a result ofthe transfection ofthe entire cell population with a library of diverse cDNAs.
  • the present invention can also be used to conduct general assays of enzyme activity.
  • exemplary intracellular enzymes include but are not limited to: carbonic anhydrase, guanine nucleotide-binding proteins (G proteins), adenyl cyclase, calmodulin, PI, PIP and PIP2 kinases, cAMP kinase and cAMP hydrolase, cytochrome P-450, serine/threonine protein kinases, tyrosine protein kinases, protein phosphatases, ⁇ -lactamase, ⁇ -galactosidase, dihydrofolate reductase, phosphodiesterases, caspases, proteosome proteases, nitric oxide synthase, thymidine kinase, nucleoside deaminase, glutathione-S- transferase, lipoxygenases, and phospholipases.
  • Figs. 17(a) - 17(d) depict the steps of a first embodiment of an enzyme assay according to the present invention.
  • beads 310 with a known quantity of fluorescent-labeled peptides 312 attached thereto are added to a well 320 containing a liquid 330. Beads 310 have a density such that they sink to the bottom ofthe well.
  • a test compound 314 is added to the well.
  • enzymes 316 are added to the well.
  • the fluorescent labels still attached to the beads are imaged using, for example, a line- scan confocal microscope schematically depicted as element 340. From this image, the activity of test compound 314 can be determined.
  • the activity ofthe test compound can be determined by comparing the image obtained in Fig.
  • Figs. 18(a) - 18(d) depict the steps of a second embodiment of an enzyme assay according to the present invention.
  • a known quantity of fluorescent- labeled peptides 352 are attached to the bottom 362 of a well 360.
  • Fig. 18(b) a test
  • 30 activity ofthe test compound can be determined by comparing the image obtained in Fig. 18(d) to the image obtained by imaging the fluorescence ofthe fluorescent labels in Figs. 18(a) or 18(b) or the image of a control well.
  • tyrosine kinase assay Another example of an assay that may be performed according to the present invention is a tyrosine kinase assay.
  • Tyrosine kinases phosphorylate tyrosine residues of
  • the substrate peptide has both a tyrosine residue and a fluorescent tag.
  • an antibody that at one end is selective for phosphorylated tyrosine is bound at the other end to a surface such as a bead or the bottom of a well.
  • Tyrosine kinase and a fluorescent-tagged peptide with a tyrosine residue are added to the well. If the tyrosine kinase phosphorylates the peptide, the phosphorylated tyrosine will bind to the antibody, thereby localizing the fluorescent tag on the surface to which the antibody is attached.
  • the fluorescent tags on the peptides will be dispersed throughout the well.
  • the extent of phosphorylation ofthe peptide can be determined by measuring the fluorescence adjacent to the surface.
  • Such an assay can also be conducted where an antibody is used that is specific to the fluorescent product produced by the action ofthe enzyme upon the fluorescent substrate.
  • live-cell enzyme assays can be performed according to the present invention. A number of techniques for investigating enzymatic activity in live cells are known in the art (See Biochem. Histochem 70,243 (1995), J. Fluorescence 3, 119 (1993)) as are substrates that yield fluorescent products when acted on by enzymes (See Haugland R.P. Handbook of Fluorescent Probes and Research Chemical 6 th Ed. Chap. 10).
  • these assays use probes that passively enter the cell and are subsequently processed by intracellular enzymes to generate products retained within the cell. Other substrates yield insoluble fluorescent products that precipitate at the site of enzymatic activity.
  • the present invention can assay the degree of enzymatic activity and determine the precise spatial localization ofthe enzymatic activity using such probes.
  • Probes are available 0 for assaying a wide variety of enzymes using the present invention including but not limited to phosphatases, ATPases, 5'-nucleotidase, DNA and RNA polymerases, peptidases, proteases, esterases and peroxidase.
  • Enzyme activity assays can be performed according either the first or second experimental embodiments and the associated image analysis protocols disclosed above. 5
  • the methods ofthe present invention can also be used to perform assays that require a determination of cellular or sub-cellular mo ⁇ hology, including but not limited to axons and organelles.
  • a fluorescent probe is introduced into the
  • the fluorescent label must be non-toxic and biologically inert. Many appropriate dyes are available commercially (See Haugland R.P. Handbook of Fluorescent Probes and Research Chemicals 6 th Ed. Chap.
  • 35 15) for use in assays for example, involving flow in capillaries, neuronal cell connectivity, translocation of dye through gap junctions, cell division and cell lysis and liposome fusion.
  • these tracers can be used to track movement of labeled cells in culture, tissues or intact organisms.
  • Many techniques employing fluorescent tracers to assay cell or subcellular mo ⁇ hology or movement are known in the art and may involve use of membrane tracers, biotinylated dextran conjugators, fluorescent microspheres or proteins and protein conjugates (See Meth. Cell Biol. 29, 153 (1989); Cytometry 21. 230 (1995); Cell 84, 381 (1996); Biochem. Biophys. Acta 988, 319 (1989); Cytometry 14, 747 (1993).
  • the various embodiments ofthe present invention have significant advantages when used in these types of assays.
  • the present invention allows rapid imaging of multiple parameters with very fine spatial resolution.
  • the present invention can also be used to conduct assays of nucleic acids.
  • a specific DNA assay that would benefit from the spatial resolution and multi-wavelength imaging capability ofthe present invention is fluorescence-in-situ hybridization (FISH).
  • FISH is an important technique for localizing and determining the relative abundance of specific nucleic acid sequences in cells, tissue, inte ⁇ hase nuclei and metaphase chromosomes and is used in clinical diagnostics and gene mapping (see Histo-chem J. 27, 4 (1995); Science 247, 64 (1990); Trends Genet. 9, 71 (1993) and Science 250, 559 (1990)).
  • a variety of fluorescent hybridization probes are available for multicolor fluorescent DNA and RNA hybridization techniques (see Haugland R.P.
  • the present invention can also be used to assay levels of various reactive oxygen species such as singlet oxygen, superoxides and nitric oxide.
  • reactive oxygen species such as singlet oxygen, superoxides and nitric oxide.
  • singlet oxygen is responsible for much ofthe physiological damage caused by reactive oxygen species (See J. Photochem. Photobiol. 11,241 (1991)).
  • Nitric Oxide (NO) in particular, is now known to play a critical role as a molecular mediator in a variety of physiological processes including neurotransmission and blood-pressure regulation (See Current Biology 2,437 (1995), J. Med. Chem. 38,4343 (1995), Cell 78, 919 (1994)).
  • the present invention can also be used to perform assays involving measurements of pH changes within cells or in cell-free media.
  • the importance ofthe role of intracellular pH has been recognized in many diverse physiological and pathological processes including cell proliferation, apoptosis, fertilization, malignancy, multi-drug resistance, ion transport, lysosomal storage disorders and Alzheimer's disease. (See Cell Physiol. Biochem. 2, 159 (1992); J. Biol. Chem. 270, 6235 (1995); Biophys. J. 68, 739 (1995); J. Biol. Chem. 270, 19599 (1995); Cancer Res, 54, 5670 (1994)).
  • Fluorescent probes useful for assays of pH in the physiological range are available commercially (See Haugland R.P., Handbook of Fluorescent Probes and Research Chemicals 6 th Ed. Chap. 23).
  • Transcription Factor Translocation Cells were grown in 96-well plates, fixed, incubated with Texas-Red-labeled antibody to the transcription factor protein, rinsed, and then stained with 5 ⁇ M Hoechst
  • the images in Fig. 19 are 0.5 x 0.5 mm 2 square with 1.08 x 1.08 ⁇ m 2 pixelation.
  • Texas Red emission was excited at 568 nm and detected with a 600-nm long pass filter.
  • Hoechst emission was excited at 364 nm and detected with a 420-480-nm bandpass filter.
  • Image acquisition time was 0.9 sec. There are -150 cells per image
  • Fig. 19 a is an image of a field of cells which were not activated before fixing.
  • the Texas Red intensity in the nucleus is low compared to the cytoplasm.
  • Fig. 19 b) is the composite ofthe images in Fig. 19 a) and that due to the Hoechst 33342 emission.
  • Fig. 19 c) is an image of a field of cells which were activated prior to fixing.
  • Fig. 19 d) is the composite ofthe images in Fig. 19 c) and that due to the Hoechst 33342 emission from the same sample.
  • Fig. 20 depicts the mask generation steps.
  • a binary representation ofthe Hoechst image was generated by applying an appropriate threshold, those values greater than the threshold were set to one, those less than the threshold were set to zero. This served as the primary mask.
  • Two daughter masks were then generated, one by eroding the primary mask, the other by dilating the primary mask and subtracting the original mask to form an annular mask.
  • the Texas-Red-emission image was multiplied by the eroded binary mask, as depicted in Fig. 21, and the pixels summed as a measure ofthe quantity of labeled transcription factor in the nucleus.
  • the Texas- Red-emission image was multiplied by the annular binary mask, as depicted in Fig. 21 , and the pixels summed as a measure ofthe quantity of labeled transcription factor in the cytoplasm. The degree of activation is assessed using the ratio of nuclear to cytoplasmic intensity.
  • This ratio is represented in the bar graph in Fig. 28a for cells with and without activation.
  • the cells in Figs. 22 and 23 were from a neuroblastoma line. They were grown and imaged in standard media. These cells express a muscarinic acetylcholine receptor that can be stimulated with Carbachol generating a large intra-cellular Ca release as a second signal. In addition the cells express a voltage-gated "L" Ca channel which can be stimulated by depolarizing the cell membrane with a large change in the external K + concentration and which can be inhibited with Verapamil.
  • the image sequences were initiated by rapidly adding 100 ⁇ L of reagent in growth media to cells in 100 ⁇ L of growth media in a 96-well plate.
  • the turbulence caused by the added volume generates a small distortion in cell shape. This distortion is visible as a transient alteration ofthe Ca fluorescence assigned to each cell in the first image frame after addition.
  • Fig. 22 a movie with 1.2 seconds between frames is displayed.
  • the image sequence was initiated by the rapid addition of 100 ⁇ M Carbachol.
  • the final image is a binary mask, used to identify and enumerate fluorescent objects in the image, generated from the pre-injection frame. Even though the pre-injection image appears dim, it is quite bright.
  • the mask is applied to each image in the series, and for each object, the integrated intensity, normalized to the pre-injection image, is plotted vs. time, as displayed in Fig. 28b.
  • the mask was not processed for overlapping cells. For example, object 1 is likely more than one cell, but showed no response. Object 7 may be 2 overlapping cells, with one showing a delayed response.
  • Fig. 23a-h are selected frames of a movie showing the response ofthe neuroblastoma cells to a depolarization event initiated by the addition of 50 mM KCl which opens the voltage-gated "L" channels.
  • the analysis procedure was as is described above in connection to Fig. 28b.
  • the results are displayed in Fig. 28c. Note the increased sensitivity obtained by using the "cell average” rather than the "image average”.
  • Figs. 24a-c to 25a-c were obtained on live cells in 96-well plates.
  • the cells had been transfected with a G-protein coupled receptor, for which the natural peptide ligand is known. Prior to imaging, the cells were incubated with the native unlabeled ligand in normal growth media containing 10% serum for 20 minutes at 15 37 °C, followed by 20 minutes with 20 nM fluorescein-labeled ligand and 100 nM LDS 751, also at 37 °C. Samples were not rinsed.
  • Fig. 24a is an image ofthe cells after incubation with the labeled ligand. No wash step was preformed prior to imaging. The substantial variation in reception activity is evident. Some cells bind so little ligand that they appear as depressions in the background. 25 A cell-by-cell analysis ofthe binding activity is facilitated by making a mask from an image of LDS 751 emission, a non-specific nucleic acid stain, shown in Fig. 25b. The staining is not entirely uniform, but the vast majority of cell volume is revealed. The overlay in Fig. 25c ofthe binary mask generated from thresholding the data in Fig. 25b with the receptor binding image yields a pseudo-color map of receptor activity. High activity is represented 30 as yellow, while low activity is shown as orange-red.
  • Fig. 25 three images are displayed corresponding to points on the titration curve ofthe 20-nM labeled ligand with the unlabeled ligand.
  • the curve is displayed in Fig. 28d.
  • a KL; 3 ⁇ 1 x 10 10 M for the unlabeled ligand is calculated.
  • Fig. 26a-d Images illustrating receptor binding on a different mammalian cell line are 35 shown in Fig. 26a-d.
  • Fig. 26a is an image ofthe cells incubated with a 256 nM Cy3-labeled ligand. A range of binding activity is visible.
  • Fig. 26b shows an overlay ofthe Cy3 data with a simultaneously acquired image ofthe 1- ⁇ M Hoechst 33342 stained nuclei. The latter serves as a reliable identifier ofthe individual cells.
  • Fig. 26c the image is ofthe cells incubated with 256 nM Cy3-labeled ligand in the presence of 10 ⁇ M unlabeled ligand, and in Fig.
  • Fig. 27a-d images of Cy5-labeled silica beads are presented.
  • the experiment is a simulation of a receptor-binding assay in which fluorescently-labeled ligands bind to membrane-bound receptors supported on microspheres.
  • Silica microspheres 4 ⁇ m in diameter, were coated with polyethylenimine and biotinylated with a biotin NHS-ester.
  • the activity ofthe beads was assayed with a fluorimeter by quantifying the amount of Cy5-labeled streptavidin removed from solution by adso ⁇ tion onto a known quantity of beads. Each bead was found to hold 1.3 x 10 6 streptavidin molecules.
  • Beads were loaded with a known quantity of Cy5 molecules by pre- mixing an appropriate ratio of Cy5-labeled and non-labeled streptavidin and incubating with the beads. The loadings were equivalent to 0.16, 1.6 and 16 fmole/200 ⁇ g of polystyrene beads.
  • Each bead had an average of 17, 170, or 1700 labels, respectively.
  • the samples were placed in Costar 96-well plates for imaging. Cy5 was excited with 647nm laser light and the emitted fluorescence was detected through a 40-nm bandpass filter centered at 690 nm. The scanned images were acquired at 1- ⁇ m pixelation in approximately 0.7 seconds.
  • Beads loaded with 170 and 1700 molecules were readily detectable and the 17-fluor beads are discernable in images constituting Fig. 27. Beads loaded only with non-labeled streptavidin did not produce appreciable intensities.

Landscapes

  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • General Health & Medical Sciences (AREA)
  • Immunology (AREA)
  • Hematology (AREA)
  • Surgery (AREA)
  • Biomedical Technology (AREA)
  • Radiology & Medical Imaging (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Ophthalmology & Optometry (AREA)
  • Molecular Biology (AREA)
  • Urology & Nephrology (AREA)
  • Pathology (AREA)
  • Biochemistry (AREA)
  • Medicinal Chemistry (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Food Science & Technology (AREA)
  • Microbiology (AREA)
  • Cell Biology (AREA)
  • Biotechnology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Microscoopes, Condenser (AREA)
  • Investigating Or Analysing Biological Materials (AREA)

Abstract

A confocal imaging system utilizing an elongated beam. Specific embodiments are directed to the apparatus with charged couple devices (CCD) and those in which the apparatus is used in fluorescent object observation.

Description

CONFOCAL MICROSCOPY IMAGING SYSTEM
This is a continuation-in-part of United States Patent Application Serial No. 09/042,527, filed March 16,1998, which is incoφorated by reference herein in its entirety.
Field of the Invention
The present invention relates to methods and apparatus for identifying pharmacological agents useful for the diagnosis and treatment of disease by performing a variety of assays on cell extracts, cells or tissues where the measurement of biological activity involves the use of various embodiments of a line-scan confocal imaging system and associated data processing routines.
Background of the Invention
There is currently a need in drug discovery and development and in general biological research for methods and apparatus for accurately performing cell-based assays. Cell-based assays are advantageously employed for assessing the biological activity of chemical compounds and the mechanism-of-action of new biological targets. In a cell- based assay, the activity of interest is measured in the presence of both competing and complementary processes. As pertains to chemical compound screening, information is available as to the specific activity ofthe compound. For example, it is possible to assess not only whether a compound binds the target ofthe assay, but also whether it is an agonist or an antagonist ofthe normal activity ofthe target. Frequently, the target is a cell-surface receptor. In some signaling pathways, the member ofthe pathway of greatest potential therapeutic value is not the receptor but an intracellular signaling protein associated with the receptor. It is, therefore, desirable to develop methods to assay activity throughout the pathway, preferably in the cellular milieu.
In addition, there is a need to quickly and inexpensively screen large numbers of chemical compounds. This need has arisen in the pharmaceutical industry where it is common to test chemical compounds for activity against a variety of biochemical targets, for example, receptors, enzymes and nucleic acids. These chemical compounds are collected in large libraries, sometimes exceeding one million distinct compounds. The use ofthe term chemical compound is intended to be interpreted broadly so as to include, but not be limited to, simple organic and inorganic molecules, proteins, peptides, nucleic acids and oligonucleotides, carbohydrates, lipids, or any chemical structure of biological interest. In the field of compound screening, cell-based assays are run on collections of cells. The measured response is usually an average over the cell population. For example, a popular instrument used for ion channel assays is disclosed in U.S. Patent No. 5,355,215. A typical assay consists of measuring the time-dependence ofthe fluorescence of an ion-sensitive dye, the fluorescence being a measure ofthe intra-cellular concentration ofthe ion of interest which changes as a consequence ofthe addition of a chemical compound. The dye is loaded into the population of cells disposed on the bottom ofthe well of a multiwell plate at a time prior to the measurement. In general, the response ofthe cells is heterogeneous in both magnitude and time. This variability may obscure or prevent the observation of biological activity important to compound screening. The heterogeneity may arise from experimental sources, but more importantly, heterogeneity is fundamental in any population of cells. Among others, the origin ofthe variability may be a consequence ofthe life-cycle divergence among the population, or the result ofthe evolutionary divergence ofthe number of active target molecules. A method that mitigates, compensates for, or even utilizes the variations would enhance the value of cell-based assays in the characterization ofthe pharmacological activity of chemical compounds.
Quantification ofthe response of individual cells circumvents the problems posed by the non-uniformity of that response of a population of cells. Consider the case where a minor fraction ofthe population responds to the stimulus. A device that measures the average response will have less sensitivity than one determining individual cellular response. The latter method generates a statistical characterization ofthe response profile permitting one to select the subset of active cells. Additional characterization ofthe population will enhance the interpretation ofthe response profile.
Various measurement devices have been used in the prior art in an attempt to address this need. Flow-cytometer-based assays are widely practiced and measure cell properties one at a time by passing cells through a focused laser beam. Several disadvantages accompany this method. Most important to the pharmaceutical industry is that assays can not readily be performed on compounds disposed in microtiter plates. In addition, the throughput is poor, typically 10-100 seconds per sample, the observation time of each cell is <1 ms, prohibiting kinetic assays, and finally, only the cell-averaged signal can be determined.
In addition, many assays require determination ofthe relative locations of the fluorescence signals. Devices called scanning cytometers, as disclosed in U.S. Patent No. 5,107,422 and U.S. Patent No. 5,547,849, are widely used for imaging single cells. In order to gain acceptable speed, these devices operate at low (~5-10μm) resolution. Thus, these devices offer little advantage over flow cytometers for assays requiring spatial information on the distribution ofthe fluorescence signals.
An additional alternative technology is the fast-camera, full-field microscope. These devices have the ability to obtain images at a resolution and speed comparable to the present invention, on certain samples. However, they are not confocal and are consequently susceptible to fluorescence background and cannot be used to optically section the sample. In addition, simultaneous, multi-parameter data is not readily obtained.
In contrast to the prior art, the present invention can be used to perform multi-parameter fluorescence imaging on single cells and cell populations in a manner that is sufficiently rapid and versatile for use in compound screening. Methods and apparatus are provided for obtaining and analyzing both the primary response of individual cells and additional measures ofthe heterogeneity ofthe sample population. In addition, the locations of these multiple fluorophores can be determined with sub-cellular resolution. Finally, the present invention can be used to image rapidly changing events at video-rates. Together these capabilities enable new areas of research into the mechanism-of-action of drug candidates.
The present invention may also be employed in an inventive fluorescence- based biochemical assay, somewhat analogous to the surface scintillation assay ("SSA") which is among the more widely used methods for screening chemical compounds.
Figs. 1(a) - 1(f) depict the steps of a receptor-binding SSA. In Fig. 1(a), soluble membranes 10 with chosen receptors 12 are added to a well 20 containing a liquid 30. These membranes are isolated from cells expressing the receptors. In Fig. 1(b), radio- labeled ligands 14 are added to the well. The ligand is known to have a high binding affinity for the membrane receptors. The most common radio labels are 3H, 35S, 1251, 33P and 32P. In Fig. 1(c), beads 16 are added to the well. The beads are coated with a material, such as wheat germ agglutinin, to which the membranes strongly adhere. The beads have a diameter of 3-8 μm and are made of plastic doped with a scintillant. Alternatively, the order ofthe operations depicted in Figs. 1(b) and 1(c) may be interchanged. The radiolabels decay by emitting high energy electrons, or beta particles, which travel approximately 1-100 μm before stopping, depending on the radio-isotope. If the radiolabels are bound to the membranes attached to the beads, the beta particles may travel into the beads and cause bursts of luminescence. If the radio-labels are dispersed throughout the liquid, the emitted beta particles will not generally excite luminescence in the beads. In Fig. 1(d), the luminescence ofthe beads caused by decay ofthe radio labels is detected. In Fig. 1(e), a test compound 18 is added to the well. The purpose ofthe assay is to determine the extent to which this compound will displace the radio-labeled ligands. If radio-labeled ligands are displaced and diffuse into the liquid, the luminescence ofthe beads will be reduced. In Fig. 1(f), the luminescence ofthe beads is again detected. By measuring the reduction in luminescence, the activity ofthe test compound can be determined.
Figs. 2(a) - 2(f) depict an alternative embodiment of a receptor-binding SSA. This embodiment is essentially the same as that described in Figs. 1(a) - 1(f) except that instead of using beads, the embodiment shown in Figs. 2(a) - 2(f) uses a well bottom 22 made of plastic doped with scintillant and coated with a material to which the membranes adhere. Consequently, instead of detecting the luminescence ofthe beads, the embodiment shown in Figs. 2(a) - 2(f) detects the luminescence ofthe well bottom.
Figs. 3(a) - 3(d) depict the steps of an embodiment of an enzyme SSA. In Fig. 3(a), scintillant-doped beads 40 with radio-labeled peptides 42 attached thereto are added to a well 50 containing a liquid 60. In Fig. 3(b), a test compound 44 is added to the well. In Fig. 3(c), enzymes 46 are added to the well. If not inhibited, enzymes 46 will cleave radio-labeled peptides 42 from beads 40. As a result, the radio label will diffuse into the solution, and radio-label decay will not produce luminescence in beads 40. If, on the other hand, test compound 44 inhibits enzymes 46, typically by blocking the enzyme active site, enzymes 46 will not cleave the radio label and the decay ofthe radio label will produce luminescence in the beads. In Fig. 3(d), the luminescence ofthe beads is measured and the activity ofthe test compound can be determined.
Figs. 4(a) - 4(d) depict an alternative embodiment of an enzyme SSA. In Fig. 4(a), radio-labeled peptides 42 are attached to a scintillant-doped well bottom 52. In Fig. 4(b), the test compound 44 is added to the well. In Fig. 4(c), enzymes 46 are added to the well. In Fig. 4(d), the luminescence ofthe well bottom is measured to determine the activity ofthe test compound.
The above examples illustrate the general principle ofthe SSA, namely that the activity of interest is assayed by a change in the number of radio labels within a radio- decay length ofthe scintillant. One ofthe attractions of SSAs is that the radio labels not attached to the scintillant need not be removed from the well in a wash step. That is SSAs are homogeneous assays.
A radioimmunoassay (RIA) is a specific form of a receptor binding assay in which the receptor is an antibody and the ligand is most often a natural or synthetic peptide, protein, carboydrate or small organic molecule. RIAs are an indirect method for measuring the concentration of ligand in any prepared sample, most often a biological sample such as plasma, cerebrospinal fluid, urine, or cellular extract. In a standard RIA, the antibody has a specific affinity for the ligand and the assay contains the antibody, a fixed concentration of radiolabeled ligand and an unknown concentration of non-labelled ligand. The concentration ofthe unlabelled ligand is determined by the degree to which it binds to the antibody and thereby blocks binding ofthe labelled ligand. RIAs are most often performed as heterogenous assays that require the separation of bound ligand from unbound ligand with a wash step. RIAs have also been developed using an SSA configuration in which the antibody receptor is attached to a scintillant filled bead and the wash step is eliminated. SSAs and RIAs, however, suffer from a number of disadvantages. First, these assays require handling radioactive material, which is both expensive and time consuming. Second, these assays are only effective in large wells. The rate of luminescence emission from the beads or well bottoms is proportional to the beta particle emission rate. A typical 3H assay yields less than one detected photon per 3H decay. To increase the speed ofthe assay, the quantity of radio-labeled ligand must be increased, and correspondingly the quantities of membranes, beads and test compound. In order to perform a tritium SSA in 10-60 seconds, 107 beads must be used. This quantity of beads requires a well of approximately 150 μL. SSAs are not effective in the μL-volume wells desirable for screening large numbers of compounds.
As described below, the present invention, inter alia, replaces the radio- labeled ligands ofthe SSA and the RIA with fluorescent-labeled ligands. In so doing, it introduces a homogenous format for the RIA and it advantageously retains the homogeneous format ofthe SSA. This is particularly important in μL-volume wells, for which surface tension renders washing impractical. However, in a homogeneous format, fluorescence can be a problem as can be illustrated with the receptor-binding assay. When the test compound is added, some fluorescent-labeled ligands are displaced and diffuse freely throughout the volume ofthe well, while others remain attached to the membranes. It is the fluorescence ofthe fluorescent-labeled ligands attached to the membranes that is used to determine the activity ofthe test compound. If the fluorescence is detected from the entire well, however, the emission from the fluorescent -labeled ligands in the volume ofthe well will obscure the emission from the fluorescent-labeled ligands attached to the membranes.
One method addressing this problem is described in U.S. Patent No. 5,355,215 to Schroeder et al. and shown in Figs. 5(a) and 5(b). According to the Schroeder et al. method, the samples are illuminated by a beam 134 of light that is directed at the bottom ofthe well at an oblique angle, shown as A in Fig. 5, so that it does not illuminate the entire well. In addition, while the beam illuminates area 114', fluorescence is detected only from area 114a which is under the well volume which receives the least amount of illumination.
The Schroeder et al. method, however, suffers from a number of disadvantages. First, because it detects only a small portion ofthe well bottom, the Schroeder et al. method can only be performed with a sufficient degree of accuracy on fairly large wells. It is not suitable to image samples disposed in the approximately 1-mm diameter wells of a 1536-well plate. Second, the geometric constraints ofthe angled illumination preclude the use of high numerical aperture collection optics, necessary to achieve sufficient sensitivity and resolution to image micron-sized objects, such as individual cells, at the bottom ofthe well.
Another approach to this problem uses a point-scan microscope. For example, in U.S. Patent No. 5,547,849 to Baer et al., the use of a point-scan confocal system is taught. Baer et al. teach a method to increase the slow speed of image acquisition, inherent in point-scan confocal techniques, by sacrificing spatial resolution. If, for example, one expands the diameter ofthe illumination beam on the sample by a factor of 10, then the illumination area is increased 100-fold, permitting one to scan 100-times faster, under certain conditions. The speed increase is achieved, however, at the expense of resolution. Further, the detection devices appropriate to said scanning method, as disclosed in the '849 patent, are inferior, principally in terms of sensitivity, to those advantageously used in the present invention. Finally, the degree of background rejection is diminished along with the resolution. Thus the device disclosed in the '849 patent has lesser sensitivity, higher background and lower resolution than the present invention, all of which are important in the present application.
The present invention includes novel embodiments of a line-scan confocal microscope. Line-scan confocal microscopes are known in art. Two representative embodiments are the system disclosed by White et al. in U.S. Patent No. 5,452,125 and that published by Brakenhoff and Visscher in J. Microscopy 171 17-26 (1993), shown in Fig. 7. Both use a scanning mirror to sweep the illumination across the sample. The same mirror de-scans the fluorescence radiation. After spatial filtering with a slit, the fluorescence is rescanned for viewing by eye. The use ofthe oscillating mirror enables these microscopes to rapidly scan a field-of-view. Line illumination is advantageous principally in applications requiring rapid imaging. The potential speed increase inherent in the parallelism of line illumination as compared to point illumination is, however, only realized if the imaging system is capable of detecting the light emitted from each point ofthe sample along the illumination line, simultaneously. An essential feature ofthe disclosed apparatus is the use of a detection device having manifold, independent detection elements in a plane conjugate to the object plane.
According to the present invention, the sample must lie in a "plane", where the depth-of-field ofthe imaging system determines the precision of "planarity". In a preferred embodiment, the imaged area is 1 mm2 and the depth- of-field is 10 μm. Thus, if the entire field is to be in focus simultaneously, the sample must be flat to 1 part in 100. This is true of many sample substrates (e.g. microtiter plates) over a local area (such as the central area ofthe well bottom). It is not practical, however, to require that the sample substrate be flat over its entire surface. For a microtiter plate having an extent of -100 mm, planarity of 1 part in 10,000 would be necessary.
The present invention provides for an optical autofocus system which maintains in "focus" the portion ofthe sample substrate being imaged. An optical autofocus mechanism has the advantage of being fast and being operational with non-conducting substrates such as plastic microtiter plates and microscope slides. Advantageously, this focus mechanism operates with negligible delay, that is, the response time ofthe focusing mechanism is short relative to the image acquisition-time, preferably a fraction of a second. Optically-based autofocus mechanisms suitable for the present application are known. For example, an astigmatic-lens-based system for the generation of a position error signal suitable for servo control is disclosed in Applied Optics 23 565-570 (1984), and a focus error detection system utilizing a "skew beam" is disclosed in SPIE 200 73-78 (1979). In a preferred embodiment ofthe present invention, the sample substrate is a microtiter plate. In this case, the preferred means of accomplishing the focusing depends further on the properties ofthe plate. If the thickness ofthe plate bottom were uniform to within a fraction ofthe depth-of-focus, then a focusing mechanism that maintained the plate bottom at a constant offset from the object plane would be adequate. Presently, commonly used microtiter plates are not sufficiently uniform. Thus, the focusing mechanism must track the surface on which the sample resides, which is typically the inside ofthe microtiter plate well. An aspect ofthe present invention is a novel autofocus mechanism for rapidly focusing on a discontinuous surface, such as the well bottom of a microtiter plate. There is, therefore, a need for a method and apparatus for screening large numbers of chemical compounds accurately, quickly and inexpensively, in a homogeneous format. In addition, there is a need for a methods and apparatus that can perform multi- parameter fluorescence imaging with sufficient resolution to image individual cells and sub- cellular events. There is also a need for an imaging system that can additionally monitor a statistically significant population of cells at video-rates. Summary of the Invention
The present invention relates to a line-scan confocal microscope and the use of a line-scan confocal imaging (LCI) system to assay biological activity.
In a preferred embodiment, the line-scan confocal imaging system employs laser light sources of multiple wavelengths for illuminating the sample and exciting fluorophores to emit electromagnetic energy. These wavelengths include the ultraviolet spectrum as well as the visible.
The present invention is able to conduct a rapid series of assays on micro- well plates by use of an autofocus capability which allows the LCI system to rapidly move from one well to another but not lose the advantage ofthe confocal microscope's inherent ability to resolve thin optical sections.
In various embodiments ofthe present invention the sample is moved to effect a scan ofthe line of illumination over the sample. In other embodiments, an oscillating mirror is used to produce a rapidly moving line of illumination effecting a scan of a sample which remains at a fixed position. By way of example, images can be obtained at a rate of up to 50 frames per second.
The present invention preferably provides for integrated dispensing allowing the addition of substances to initiate rapidly changing biological events, such as the propagation of an action potential in nerve or muscle cells. The present invention preferably makes use of a multi-element solid state detection device such as a charged coupled device (CCD). This device is preferably read continuously. In a preferred embodiment, the present invention uses a rectangular CCD which avoids the need for a full two dimensional detector and allows higher read speeds. In addition, a larger effective field-of-view is achievable in the stage-scanning embodiment. The present invention also provides in a preferred embodiment, a capability to conduct specialized data analysis simultaneously with data acquisition to allow it to operate in a high-throughput screening mode.
This invention provides methods of performing a wide variety of biological assays utilizing fluorescence. In one embodiment the target of interest may be in a fixed or live cell or in a subcellular organelle or on the cell membrane. These assays involve the determination of one or more parameters which requires the excitation of one or more fluorescent labels which are, in general, sensitive to different wavelengths of incident light. In addition these assays require the simultaneous and precise imaging ofthe emitted light at one or more wavelengths from which the location in two or three dimensions and the intensity ofthe fluorescently labeled species and their correlations are determined. In addition, this invention provides methods to perform assays which require either a single imaging of a response, by means of fluorescent emission, or rapidly repeated imaging ofthe same area or cell. In various embodiments, imaging is performed at rates as high as 50 frames per second. This ability to image rapidly, in multiple wavelengths and with high spatial resolution allows the present invention to perform assays that could not previously be performed or to perform them in a superior manner.
The present invention relates to several methods for screening chemical compounds and for performing many types of assays involving the use of fluorophores or fluorescent probes. In general these assays and screening procedures involve the use of a test compound and reagents some or all of which are intrinsically fluorescent, tagged with fluorescent labels or are metabolized into fluorescent product. The test compound and the reagents may be combined in a variety of ways.
In one embodiment, the reagents are added to a well containing a liquid. This may be a single well or one of many wells on a multiwell plate. The biological activity of interest is determined by the presence or absence of fluorophores disposed on the bottom ofthe well or on the surface of beads disposed on the bottom ofthe well as measured with a line-scan confocal microscope. This embodiment has in common with the SSA format the determination of activity from the localization ofthe detected species. In the case ofthe SSA, the localization is proximal to the scintillant. In the present method, the localization is to a region ofthe well, preferably the bottom. In the case ofthe SSA, sensitivity to the proximal species is determined by the decay length ofthe beta particles. In the present method, sensitivity to the localized fluorophore is determined by the optical-sectioning depth ofthe confocal microscope.
In addition, the present invention can perform high throughput assays requiring scanning multiple samples in a rapid and automatic manner. These samples may be individual micro-wells and may involve wells containing a liquid and live or fixed cells or components of cells. The present invention also provides environmental controls required to retain liquid samples or sustain live cells during the analysis.
Brief Description of the Drawings
These and other objects, features and advantages ofthe invention will be more readily apparent from the following detailed description in which: Figs. 1(a) - 1(f) illustrate a first receptor-binding SSA. Figs. 2(a) - 2(f) illustrate a second receptor-binding SSA. Figs. 3(a) - 3(d) illustrate a first enzyme SSA.
Figs. 4(a) - 4(d) illustrate a second enzyme SSA. Fig. 5(a) and 5(b) are schematic views of a prior art apparatus for imaging samples disposed on the bottom of a well.
Fig. 6 is a schematic view of a first embodiment of a line-scan confocal microscope used to image samples according to the present invention. Fig. 7 is a schematic view of a prior art microscope..
Figs. 8(a) and 8(b) are, respectively, a top view and a side view ofthe ray path of a multicolor embodiment ofthe present invention, without a scanning mirror. Fig. 8(c) is a top view ofthe ray path of a single beam autofocus.
Figs. 9(a) and 9(b) are, respectively, a top view and a side view ofthe ray path ofthe multicolor embodiment ofthe present invention with the scanning mirror. Fig. 9(c) is a top view ofthe ray path ofthe single beam autofocus.
Fig. 10 is a side view ofthe two beam autofocus system.
Fig. 1 l(a)-l 1(c) illustrates the rectangular CCD camera and readout register,
Figs. 12(a) and 12(b) are cross-sectional views of ray paths formed by the line-scan confocal microscope in the present invention employing conventional dark-field imaging.
Figs. 13(a) and 13(b) are cross-sectional views of ray paths formed by the line-scan confocal microscope in the present invention using inverse dark-field imaging.
Fig. 14 is a cross-sectional view of ray paths formed by the line-scan confocal microscope in the present invention using inverse dark-field imaging, where an area larger than the diffraction-limited area ofthe sample plane is illuminated.
Figs. 15(a) - 15(f) illustrate a first embodiment of a receptor-binding assay according to the present invention.
Figs. 16(a) - 16(f) illustrates a second embodiment of a receptor-binding assay according to the present invention.
Figs. 17(a) - 17(d) illustrate a first embodiment of an enzyme assay according to the present invention.
Figs. 18(a) - 18(d) illustrate a second embodiment of an enzyme assay according to the present invention. Figs. 19(a) - 19(d) shows a transcription factor translocation assay.
Figs. 20(a) - 20(d) shows a translocation assay data analysis.
Figs. 21(a) - 21(e) shows another data analysis.
Fig. 22 shows neuroblastoma cell calcium response to Carbachol.
Figs. 23(a) - 23(h) shows neuroblastoma cell calcium response to 50 mM KC1.
Figs. 24(a) - 24(c) shows homogeneous live cell receptor binding assay. Figs. 25(a) - 25(c) shows homogeneous live cell receptor binding assay.
Figs. 26(a) - 26(d) shows homogeneous live cell receptor binding assay with Cy3 labeled ligand.
Figs. 27(a) - 27(d) shows 4 m diameter silica beads with varying numbers of Cy5 labels.
Figs. 28(a) - 28(d) shows the data from the translocation assay, ion channel assay and cell surface receptor binding as graphs.
Detailed Description of the Invention All patent applications, publications, and other references that are listed herein are hereby incorporated by reference in their entireties.
The present invention if useful for identifying pharmacological agents for the treatment of disease. It provides a high throughput method for conducting a wide variety of biological assays where one or more fluorescent reagents are employed to measure a biological response. Such assays can be conducted on chemical compounds or any molecule of biological interest, included but not limited to drug candidates, such as those found in combinatorial libraries. In addition, this invention provides a method for the diagnosis of pathological states from cell and tissue samples. This invention also provides a method for profiling multiple biological responses of drug candidates on whole cells using fluorescent reagents.
The techniques ofthe present invention may be used in assays in which data is acquired on individual cells, on a cellular or sub-cellular level, sufficiently rapidly so as to permit the acquisition of such data on a sufficient number of cells to constitute a statistically meaningful sample ofthe cell population. The present invention is able to make simultaneous measurements on multiple parameters and is also able to correlate multiple signals from individual cells. It may therefore be employed to assay heterogeneous cellular responses and to assay responses confined to a small subset of cells.
In addition, the present invention can image the simultaneous activation of multiple signal pathways and can correlate multiple signals simultaneously and over time. This capability is vital when the temporal response of individual cells or a comparison of the temporal response of individual cells is required for the specific assay.
In addition, the present invention can image fluorescent signals from the confocal plane of cells in the presence of unbound fluorophore or in the presence of intrinsically fluorescent chemical compounds, including potential drug candidates. These assays may make use of any known fluorophore or fluorescent label including but not limited to fluorescein, rhodamine, Texas Red, Amersham Corp. stains Cy3, Cy5, Cy5.5 and Cy7, Hoechst's nuclear stains and Coumarin stains. (See Haugland R.P. Handbook of Fluorescent Probes and Research Chemicals 6th Ed., 1996, Molecular Probes, Inc., Eugene, Oregon.)
These assays include but are not limited to receptor-binding assays, assays of
5 infra-cellular electric potential or pH, assays of ion concentrations, enzyme activity assays, trafficking assays, kinetic imaging assays and assays of rare cellular events.
Receptor-binding and enzyme activity assays may be bead-based or cell- based assays. Some examples of bead-based assays are described in WO 98/55866. However, the method described therein makes use of point scan confocal technology and
10 the present linescan confocal imaging system would have a significant advantage in terms of rate of data acquisition.
OPTICAL CONFIGURATION
Fig. 6 shows a first embodiment ofthe present invention. The microscope
15 comprises a source 400 or 410 of electromagnetic radiation for example, in the optical range, 350-750nm, a cylindrical lens 420, a first slit mask 430, a first relay lens 440, a dichroic mirror 450, an objective lens 470, a microtiter plate 480 containing a two- dimensional array of sample wells 482, a tube lens 490, a filter 500, a second slit mask 510 and a detector 520. These elements are arranged along optical axis OA with slit apertures
20 432, 512 in masks 430, 510 extending perpendicular to the plane of Fig. 6. The focal lengths of lenses 440, 470 and 490 and the spacings between these lenses as well as the spacings between mask 430 and lens 440, between objective lens 470 and microtiter plate 480 and between lens 490 and mask 510 are such as to provide a confocal microscope. In this embodiment, electromagnetic radiation from a lamp 400 or a laser 410 is focused to a
25 line using a cylindrical lens 420. The shape ofthe line is optimized by a first slit mask 430. The slit mask 430 is depicted in an image plane ofthe optical system, that is in a plane conjugate to the object plane. The illumination stripe formed by the aperture 432 in the slit mask 430 is relayed by lens 440, dichroic mirror 450 and objective lens 470 onto a microtiter plate 480 which contains a two-dimensional array of sample wells 482. For
30 convenience of illustration, the optical elements of Fig. 6 are depicted in cross-section and the well plate in perspective. The projection ofthe line of illumination onto well plate 480 is depicted by line 484 and is also understood to be perpendicular to the plane of Fig. 6. As indicated by arrows A and B, well plate 480 may be moved in two dimensions (X, Y) parallel to the dimensions ofthe array by means not shown.
35 In an alternative embodiment, the slit mask 430 resides in a Fourier plane of the optical system, that is in a plane conjugate to the objective back focal plane (BFP) 460. In this case the aperture 432 lies in the plane ofthe figure, the lens 440 relays the illumination stripe formed by the aperture 432 onto the back focal plane 460 ofthe objective 470 which transforms it into a line 484 in the object plane perpendicular to the plane of Fig. 6. In an additional alternative embodiment the slit mask 430 is removed entirely. According to this embodiment, the illumination source is the laser 410, the light from which is focused into the back focal plane 460 ofthe objective 470. This can be accomplished by the combination ofthe cylindrical lens 420 and the spherical lens 440 as shown in Fig. 6, or the illumination can be focused directly into the plane 460 by the
10 cylindrical lens 420.
An image ofthe sample area, for example a sample in a sample well 482, is obtained by projecting the line of illumination onto a plane within the sample, imaging the fluorescence emission therefrom onto a detector 520 and moving the plate 480 in a direction perpendicular to the line of illumination, synchronously with the reading ofthe detector
15 520. In the embodiment depicted in Fig. 6, the fluorescence emission is collected by the objective lens 470, projected through the dichroic beamsplitter 450, and imaged by lens 490 through filters 500 and a second slit mask 510 onto a detector 520, such as is appropriate to a confocal imaging system having an infinity-corrected objective lens 470. The dichroic beamsplitter 450 and filter 500 preferentially block light at the illumination wavelength.
20 The detector 520 illustratively is a camera and may be either one dimensional or two dimensional. If a one dimensional detector is used, slit mask 510 is not needed. The illumination, detection and translation procedures are continued until the prescribed area has been imaged. Mechanical motion is simplified if the sample is translated at a continuous rate. Continuous motion is most useful if the camera read-time is small compared to the
25 exposure-time. In a preferred embodiment, the camera is read continuously. The displacement d ofthe sample during the combined exposure-time and read-time may be greater than or less than the width ofthe illumination line W, exemplarily 0.5W < d ≤ 5W. All ofthe wells of a multiwell plate can be imaged in a similar manner.
Alternatively, the microscope can be configured to focus a line of
30 illumination across a number of adjacent wells, limited primarily by the field-of-view ofthe optical system. Finally, more than one microscope can be used simultaneously.
The size and shape ofthe illumination stripe 484 is determined by the width and length ofthe Fourier transform stripe in the objective lens back focal plane 460. For example, the length ofthe line 484 is determined by the width ofthe line in 460 and
35 conversely the width in 484 is determined by the length in 460. For diffraction-limited performance, the length ofthe illumination stripe at 460 is chosen to overfill the objective back aperture. It will be evident to one skilled in the art that the size and shape ofthe illumination stripe 484 can be controlled by the combination ofthe focal length ofthe cylindrical lens 420 and the beam size at 420, that is by the effective numerical aperture in each dimension, within the restrictions imposed by aberrations in the objective, and the objective field of view.
The dimensions ofthe line of illumination 484 are chosen to optimize the signal to noise ratio. Consequently, they are sample dependent. Depending on the assay, the resolution may be varied between diffraction-limited, i.e., less than 0.5 μm, and approximately 5 μm. The beam length is preferably determined by the objective field of view, exemplarily between .5 and 1.5 mm. A Nikon ELWD, 0.6 NA, 40X objective, for example, has a field of view of approximately 0.75 mm. The diffraction-limited resolution for 633 nm radiation with this objective is approximately 0.6 μm or approximately 1100 resolution elements.
The effective depth resolution is determined principally by the width of aperture 512 in slit mask 510 or the width of the one dimensional detector and the image magnification created by the combination ofthe objective lens 470 and lens 490. The best depth resolution of a confocal microscope approaches 1 μm. In the present application, a depth resolution of 5-10 μm may be sufficient or even advantageous.
For example, when the sample of interest, such as a live cell, contains insufficient fluorophores in a diffraction-limited volume to permit an adequate signal-to- noise image in a sufficiently brief image-acquisition time, it is advantageous to illuminate and collect the emission from a larger than diffraction-limited volume. A similar situation prevails in the case of video-rate kinetics studies of transient events such as ion-channel openings. Practically, this is accomplished by underfilling the back aperture ofthe objective lens, which is equivalent to increasing the diameter ofthe illumination aperture. The effective numerical aperture ("NA") ofthe illumination is less than the NA ofthe objective. The fluorescence emission is, however, collected with the full NA ofthe objective lens. The width of aperture 512 must be increased so as to detect emission from the larger illumination volume. At an aperture width a few times larger than the diffraction limit, geometrical optics provides an adequate approximation for the size ofthe detection- volume element:
Lateral Width: ad = < /M, Axial Width: zd =
Figure imgf000016_0001
where M is the magnification, dd is the width of aperture 512 and α is the half-angle subtended by the objective 470. It is an important part ofthe present invention that the illumination aperture 432 or its equivalent in the embodiment having no aperture and the detection aperture 512 be independently controllable.
MULTI-WAVELENGTH CONFIGURATION An embodiment enabling multi-wavelength fluorescence imaging is preferred for certain types of assays. It is generally advantageous and often necessary that two or more measurements be made simultaneously since one important parameter in a biological response is time.
The number of independent wavelengths or colors will depend on the specific assay being performed. In one embodiment three illumination wavelengths are used. Figs. 8(a) and 8(b) depict the ray paths in a three-color line-scan confocal imaging system, from a top view and a side view respectively. In general, the system comprises several sources Sn of electromagnetic radiation, collimating lenses Ln, and mirrors M„ for producing a collimated beam that is focused by cylindrical lines CL into an elongated beam at first spatial filter SF,, a confocal microscope between first spatial filter SF,, and second spatial filter SF2 and an imaging lens IL, beamsplitters DM, and DM2 and detectors Dn for separating and detecting the different wavelength components of fluorescent radiation from the sample. Spatial filters SF, and SF, and SF2 preferably are slit masks.
In particular, Fig. 8(a) depicts sources, S,, S2 and S3, for colors λ,, λ2 and λ3 and lenses L,, L2 and L3 that collimate the light from the respective sources. Lenses L,, L2 and L3 preferably are adjusted to compensate for any chromaticity ofthe other lenses in the system. Mirrors M,, M2 and M3 are used to combine the illumination colors from sources Sn. The mirrors M2 and M, are partially transmitting, partially reflecting and preferentially dichroic. M2, for example, should preferentially transmit λ3, and preferentially reflect λ2. It is thus preferential that λ3 be greater than λ2.
Operation ofthe microscope in a confocal mode requires that the combined excitation beams from sources Sn be focused to a "line", or an highly eccentric ellipse, in the object plane OP. As discussed in connection to Fig. 6 above, a variety of configurations may be used to accomplish this. In the embodiment depicted in Fig. 8, the combined illumination beams are focused by cylindrical lens CL into an elongated ellipse that is coincident with the slit in the spatial filter SF,. As drawn in Figs. 8a and 8b, the slit mask SF, resides in an image plane ofthe system, aligned perpendicular to the propagation ofthe illumination light and with its long axis in the plane ofthe page of Fig. 8a. The lenses TL and OL relay the illumination line from the plane containing SF, to the object plane OP. A turning mirror, TM, is for convemence. In another embodiment, DM3 is between TL and OL and CL focuses the illumination light directly into the BFP. Other embodiments will be evident to one skilled in the art.
Referring to Fig. 8(b), the light emitted by the sample and collected by the objective lens, OL, is imaged by the tube lens, TL, onto the spatial filter, SF2. SF2 is preferentially a slit aligned so as to extend peφendicular to the plane ofthe page. Thus, the light passed by filter SF2 is substantially a line of illumination. SF2 may be placed in the primary image plane or any plane conjugate thereto. DM3 is partially reflecting, partially transmitting and preferably "multichroic". Multi-wavelength "dichroic" mirrors, or "multichroic" mirrors can be obtained that preferentially reflect certain wavelength bands and preferentially transmit others. δλ, will be defined to be the fluorescence emission excited by λ. This will, in general, be a distribution of wavelengths somewhat longer than λ,. δλ2 and δλ3 are defined analogously. DM3 preferentially reflects λn, and preferentially transmits δλn, n=l,2,3. The light transmitted by SF2 is imaged onto the detection devices, which reside in planes conjugate to the primary image plane. In Fig. 8(a), an image ofthe spatial filter SF2 is created by lens IL on all three detectors, Dn. This embodiment is preferred in applications requiring near-perfect registry between the images generated by the respective detectors. In another embodiment, individual lenses ILn are associated with the detection devices, the lens pairs IL and ILn serving to relay the image ofthe spatial filter SF2 onto the respective detectors Dn. The light is split among the detectors by mirrors DM, and DM2. The mirrors are partially transmitting, partially reflecting, and preferentially dichroic. DM, preferentially reflects δλ, and preferentially transmits δλ2 and δλ3. The blocking filter, BF„ preferentially transmits δλ, effectively blocking all other wavelengths present. DM2 preferentially reflects δλ2 and preferentially transmits δλ3. The blocking filters, BF2 and BF3, preferentially transmit δλ2 and δλ3 respectively, effectively blocking all other wavelengths present.
SCANNING MIRROR CONFIGURATION
In some embodiments of this invention, rapid data acquisition requires framing images at video rates. Video-rate imaging generally refers to 30 or 60 frames per second. In the present use, it is intended to connote frame rates with an order-of-magnitude of 30 Hz. In a preferred embodiment, video-rate imaging is achieved by illuminating along one dimension ofthe sample plane and scanning the illumination beam in the direction peφendicular thereto so as to effect a relative translation ofthe illumination and sample. The scanning stage is generally massive. Consequently, it cannot be moved sufficiently rapidly. Fig. 9 depicts an embodiment ofthe invention utilizing a scanning mirror, SM. The mirror is advantageously placed in a plane conjugate to the objective back focal plane (BFP): A rotation in the BFP (or a plane conjugate thereto) effects a translation in the object plane (OP) and its conjugate planes. The full scan range of SM need only be a few degrees for typical values ofthe focal lengths ofthe lenses RL, and RL2. As shown in Fig. 9, this lens pair images the BFP onto the SM at a magnification of one, but a variety of magnifications can be advantageously used. The limiting factors to the image acquisition rate are the camera read-rate and the signal strength. In the imaging mode described above, data can be acquired continuously at the camera read-rate, exemplarily 1 MHz. With a scanning mirror, it is preferable to acquire data uni-directionally. The idealized scanning motion allowing one to acquire data continuously is the sawtooth. In practice, the combination of turn-around and return scan times will constitute -1/3-2/3 ofthe scan period. Assuming 50% dead-time, a mirror oscillation frequency of 50 Hz and a pixel acquisition rate of 1 MHz, -10,000 pixels would be acquired per frame at 50 frames per second, which is sufficient to define and track individual objects, such as cells, from frame to frame. 104 pixels per image is, however, 102-times fewer than was generally considered above. Depending on the application, it is advantageous to acquire relatively smaller images at high resolution, e.g. 50-μm X 50-μm at 0.5-μm X 0.5-μm pixelation, or relatively larger images at lower resolution, e.g. 200-μm X 200-μm at 2-μm pixelation.
AUTOFOCUS
According to the present invention, the sample must lie in the object plane of an imaging system. Accordingly, the invention provides an autofocus mechanism that maintains the portion ofthe sample in the field-of-view ofthe imaging system within the object plane of that system. The precision of planarity is determined by the depth-of-field ofthe system. In a preferred embodiment, the depth-of-field is approximately 10 μm and the field-of-view is approximately 1 mm2.
The disclosed autofocus system operates with negligible delay, that is, the response time is short relative to the image acquisition-time, exemplarily 0.01-0.1 s. In addition, the autofocus light source is independent ofthe illumination light sources and the sample properties. Among other advantages, this configuration permits the position ofthe sample carrier along the optical axis ofthe imaging system to be determined independent of the position ofthe object plane.
One embodiment of a single-beam autofocus is provided in Figs. 8 and 9, where a separate light source, S4 of wavelength λ4, and detector D4 are shown. The wavelength λ4 is necessarily distinct from the sample fluorescence, and preferentially a wavelength that cannot excite appreciable fluorescence in the sample. Thus, λ4 is preferentially in the near infrared, exemplarily 800-1000 nm. The partially transmitting, partially reflecting mirror, DM4, is preferentially dichroic, reflecting λ4 and transmitting λn and δλn, n-1,2,3. Optically-based autofocus mechanisms suitable for the present application are known. For example, an astigmatic-lens-based system for the generation of a position error signal suitable for servo control is disclosed in Applied Optics 23 565-570 (1984). A focus error detection system utilizing a "skew beam" is disclosed in SPIE 200 73-78 (1979). The latter approach is readily implemented according to Figs. 8 and 9, where D4 is a split detector. For use with a microtiter plate having a sample residing on the well bottom, the servo loop must, however, be broken to move between wells. This can result in substantial time delays because ofthe need to refocus each time the illumination is moved to another well.
Continuous closed-loop control ofthe relative position ofthe sample plane and the object plane is provided in a preferred embodiment of the present invention, depicted in Fig. 10. This system utilizes two independent beams of electromagnetic radiation. One, originating from S5, is focused on the continuous surface, exemplarily the bottom of a microtiter plate. The other, originating from S4, is focused on the discontinuous surface, exemplarily the well bottom of a microtiter plate. In one embodiment, the beams originating from S 4 and S5 have wavelengths λ4 and λ5, respectively. λ4 is collimated by L4, apertured by iris I4, and focused onto the discontinuous surface by the objective lens OL. λ5 is collimated by L5, apertured by iris I5, and focused onto the continuous surface by the lens CFL in conjunction with the objective lens OL. The reflected light is focused onto the detectors D4 and D5 by the lenses IL4 and IL5, respectively. The partially transmitting, partially reflecting mirror, DM4, is preferentially dichroic, reflecting λ4 and λ5 and transmitting λn and δλn, n=l,2,3. The mirrors, M4, M5 and M6, are partially transmitting, partially reflecting. In the case that λ4 and λ5 are distinct, M6 is preferentially dichroic. According to the embodiment wherein the sample resides in a microtiter plate, λ4 is focused onto the well bottom. The object plane can be offset from the well bottom by a variable distance. This is accomplished by adjusting L4 or alternatively by an offset adjustment in the servo control loop. For convenience of description, it will be assumed that λ4 focuses in the object plane.
The operation ofthe autofocus system is as follows. If the bottom ofthe sample well is not in the focal plane of objective lens OL, detector D4 generates an error signal that is supplied through switch SW to the Z control. The Z control controls a motor (not shown) for moving the microtiter plate toward or away from the objective lens. Alternatively, the Z control could move the objective lens. If the bottom PB ofthe microtiter plate is not at the focal plane ofthe combination ofthe lens CFL and the objective lens OL, detector D5 generates an error signal that is applied through switch SW to the Z control. An XY control controls a motor (not shown) for moving the microtiter plate in the object plane OP of lens OL.
As indicated, the entire scan is under computer control. An exemplary scan follows: At the completion of an image in a particular well, the computer operates SW to switch control ofthe servo mechanism from the error signal generated by D4 to that generated by D5; the computer then directs the XY control to move the plate to the next well, after which the servo is switched back to D4.
The "coarse" focusing mechanism utilizing the signal from the bottom ofthe plate is used to maintain the position ofthe sample plane to within the well-to-well variations in the thickness ofthe plate bottom, so that the range over which the "fine" mechanism is required to search is minimized. If, for example, the diameter ofthe iris I5 is 2 mm and IL5 is 100 mm, then the image size on the detector will be - 100 μm. Similarly, if the diameter ofthe iris I4 is 0.5 mm and IL4 is 100 mm, then the image size on the detector will be - 400 μm. The latter is chosen to be less sensitive so as to function as a "coarse" focus.
As with the single-beam embodiment described above, the wavelengths λ4 and λ5 are necessarily distinct from the sample fluorescence, and preferentially wavelengths that cannot excite appreciable fluorescence in the sample. Thus, λ4 and λ5 are preferentially in the near infrared, such as 800-1000 nm. In addition, the two wavelengths are preferably distinct, for example λ4 = 830 nm, λ5 = 980 nm.
In an alternative embodiment of two-beam autofocus, λ4 = λ5 and the two beams may originate from the same source. Preferentially, the two beams are polarized peφendicular to one another and M6 is a polarizing beamsplitter.
Pseudo-closed loop control is provided in the preferred embodiment of single-beam autofocus which operates as follows. At the end of a scan the computer operates SW to switch control to a sample-and-hold device which maintains the Z control output at a constant level while the plate is moved on to the next well after which SW is switched back to D4
DETECTION DEVICES
An essential feature ofthe disclosed apparatus is the use of a detection device having manifold, independent detection elements in a plane conjugate to the object plane. As discussed above, line illumination is advantageous principally in applications requiring rapid imaging. The potential speed increase inherent in the parallelism of line illumination as compared to point illumination is, however, only realized if the imaging system is capable of detecting the light emitted from each point ofthe sample along the illumination line, simultaneously. It is possible to place a charge-coupled device (CCD), or other camera, at the output ofthe prior art imaging systems described above (White et al., US 5,452,125 and Brakenhoff and Visscher, J. Microscopy 171 17-26 (1993)). The resulting apparatus has three significant disadvantages compared to the present invention. One is the requirement of rescanning the image onto the two-dimensional detector, which adds unnecessary complexity to the apparatus. Another is the requirement of a full two-dimensional detector having sufficient quality over the 1000 pixel x 1000 pixel array that typically constitutes the camera. The third disadvantage is the additional time required to read the full image from the two-dimensional device.
The present invention is designed to avoid these disadvantages and optimize not only imaging speed, within the constraints of high-sensitivity and low-noise detection, but also throughput. One embodiment uses a continuous-read line-camera, and in a preferred embodiment a rectangular CCD is used as a line-camera. Both embodiments have no dead-time between lines within an image or between images. An additional advantage ofthe present invention is that a larger effective field-of-view is achievable in the stage- scanning embodiment, discussed below.
The properties required ofthe detection device can be further clarified by considering the following preferred embodiment. The resolution limit ofthe objective lens is < 1 μm, typically -0.5 μm, and the detector comprises an array of -1000 independent elements. Resolution, field-of-view (FOV) and image acquisition-rate are not independent variables, necessitating compromise among these performance parameters. In general, the magnification ofthe optical system is set so as to image as large a FOV as possible without sacrificing resolution. For example, a -1 mm field-of-view could be imaged onto a 1000- element array at 1-μm pixelation. If the detection elements are 20-μm square, then the system magnification would be set to 20X. Note that this will not result in 1-μm resolution. Pixelation is not equivalent to resolution. If, for example, the inherent resolution limit of the objective lens is 0.5 μm and each 0.5 μm X 0.5 μm region in the object plane is mapped onto a pixel, the true resolution ofthe resulting digital image is not 0.5 μm. To achieve true 0.5-μm resolution, the pixelation would need to correspond to a region -0.2 μm X 0.2 μm in the object plane. In one preferred embodiment, the magnification ofthe imaging system is set to achieve the true resolution ofthe optics. Presently, the highest detection efficiency, lowest noise detection devices having sufficient read-out speed for the present applications are CCD cameras. In Figure 11, a rectangular CCD camera is depicted having an m x n array of detector elements where m is substantially less than n. The image ofthe fluorescence emission covers one row that is preferably proximate to the read register. This minimizes transfer time and avoids accumulating spurious counts into the signal from the rows between the illuminated row and the read-register.
In principle, one could set the magnification ofthe optical system so that the height ofthe image ofthe slit SF2 on the CCD camera is one pixel, as depicted in Figure 11. In practice, it is difficult to maintain perfect alignment between the illumination line and the camera row-axis, and even more difficult to maintain alignment among three cameras and the illumination in the multi-wavelength embodiment as exemplified in Figs. 8 and 9. By binning together a few ofthe detector elements, exemplarily two to five, in each column of the camera the alignment condition can be relaxed while suffering a minimal penalty in read-noise or read-time.
An additional advantage ofthe preferred embodiment having one or more rectangular CCD cameras as detection devices in conjunction with a variable-width detection spatial filter, SF2 in Figs. 8 and 9 and 510 in Fig. 6, each disposed in a plane conjugate to the object plane, is elucidated by the following. As discussed above, in one embodiment ofthe present invention the detection spatial filter is omitted and a line-camera is used as a combined detection spatial filter and detection device. But as was also discussed above, a variable- width detection spatial filter permits the optimization ofthe detection volume so as to optimize the sample-dependent signal-to-noise ratio. The following preferred embodiment retains the advantage of a line-camera, namely speed, and the flexibility of a variable detection volume. The magnification is set so as to image a diffraction- limited line of height h onto one row ofthe camera. The width ofthe detection spatial filter d is preferably variable h < d < lOh. The detectors in the illuminated columns ofthe camera are binned, prior to reading, which is an operation that requires a negligible time compared to the exposure- and read-times. In one preferred embodiment, the cameras are Princeton Instruments
NTE/CCD-1340/100-EMD. The read-rate in a preferred embodiment is 1 MHz at a few electrons of read-noise. The pixel format is 1340x100, and the camera can be wired to shift the majority ofthe rows (80%) away from the region of interest, making the camera effectively 1340x20. In addition to the above mentioned advantage of a continuous read camera, namely the absence of dead-time between successive acquisitions, an additional advantage is that it permits the acquisition of rectangular images having a length limited only by the extent ofthe sample. The length is determined by the lesser ofthe camera width and the extent ofthe line illumination. In a preferred embodiment the sample is disposed on the bottom of a well in a 96-well microtiter plate, the diameter of which is 7 mm. A strip 1 μm X I mm is illuminated and the radiation emitted from the illuminated area is imaged onto the detection device. The optical train is designed such that the field-of-view is -lmm2. According to the present invention, an image ofthe well-bottom can be generated at 1-μm pixelation over a 1 X 7-mm field.
ENVIRONMENTAL CONTROL
In an embodiment ofthe present invention, assays are performed on live cells. Live-cell assays frequently require a reasonable approximation to physiological conditions to run properly. Among the important parameters is temperature. It is desirable to incoφorate a means to raise and lower the temperature, in particular, to maintain the temperature ofthe sample at 37C. In another embodiment, control over relative humidity, and/or CO2 and/or O2 is necessary to maintain the viability of live cells. In addition, controlling humidity to minimize evaporation is important for small sample volumes.
Three embodiments providing a microtiter plate at an elevated temperature, preferably 37C, compatible with the LCI system follow. The imaging system preferably resides within a light-proof enclosure. In a first embodiment, the sample plate is maintained at the desired temperature by maintaining the entire interior ofthe enclosure at that temperature. At 37C, however, unless elevated humidity is puφosefully maintained, evaporation cooling will reduce the sample volume limiting the assay duration. A second embodiment provides a heated cover for the microwell plate which allows the plate to move under the stationary cover. The cover has a single opening above the well aligned with the optical axis ofthe microscope. This opening permits dispensing into the active well while maintaining heating and limited circulation to the remainder of the plate. A space between the heated cover plate and microwell plate of approximately 0.5 mm allows free movement ofthe microwell plate and minimizes evaporation. As the contents ofthe interrogated well are exposed to ambient conditions though the dispenser opening for at most a few seconds, said contents suffer no significant temperature change during the measurement.
In a third embodiment, a thin, heated sapphire window is used as a plate bottom enclosure. A pattern of resistive heaters along the well separators maintain the window temperature at the desired level. In additional embodiments, the three disclosed methods can be variously combined.
INTEGRATED DISPENSER One embodiment ofthe video-rate configuration ofthe imaging system is further configured to initiate kinetic assays, in particular ion-channel assays, with a timed reagent dispense. Initiation of channel opening is accomplished by dispensing a solution into the micro well. For example, voltage-gated channels can be opened by addition of a solution of KC1 to depolarize the plasma membrane. The time-dependence ofthe channel opening and subsequent closing and the corresponding change in intracellular concentration is often sufficiently rapid to require video-rate imaging. The intrinsic speed ofthe imaging system is irrelevant, however, unless the channel response can be initiated rapidly.
One embodiment ofthe present invention provides an integrated dispenser. For assays run in 96- or 384-well plates, addition volumes in this range 20-100 μL are desirable. A single head dispenser, as is appropriate, for example, to the addition of an agonist of ion-channel activity, is the IVEK Dispense 2000. Comparable units are available from CAVRO. More generally, it is desirable to be able to dispense a unique compound into each well. One embodiment provides a single head dispenser on a robotic motion device that shuttles the dispense head between the analysis station, the source plate containing the unique compounds and the tip cleansing station. The latter is a wash station for a fixed tip dispenser and a tip changing station for a disposable tip dispenser. This system provides the desired functionality relatively inexpensively, but it is low throughput, requiring approximately 30 seconds per compound aspiration-dispense-cleanse cycle. An alternative embodiment is provided by integrating a multi-head dispenser such as the Hamilton Micro lab MPH-96 into the disclosed LCI system. The MPH-96 consists of 96 independent fixed tip dispensers mounted to a robotic motion device capable of executing the aspirate-dispense-wash cycle described above.
In an additional preferred embodiment ofthe invention, employed in automated screening assays, the imaging system is integrated with plate-handling robots, such as the Zymark Twister.
DARK FIELD CONFOCAL CONFIGURATION
In the case that the desired lateral resolution is less than the diffraction limit, the background fluorescence due to the supernatant liquid can be decreased by an inventive application ofthe dark-field imaging technique. Figs. 12(a) and 12(b) depict the ray paths in conventional dark-field. In Fig. 12(a), a sample 600 is illuminated by a hollow cone of light 610 from an objective lens 620. This cone of light is created, for example, by placing an opaque bar 630 at lens 440 in Fig. 10(a). In Fig. 12(b), the fluorescent emission from sample 600 is then collected through the center ofthe objective lens 620. Because ofthe differing angles of illumination and collection, the only plane which is both illuminated and detected is the plane containing sample 600.
Figs. 13(a) and 13(b) depict the ray paths in inverted dark-field. In Fig. 13(a), a sample 700 is illuminated with a beam of light 710 that passes through the center of an objective lens 720. In Fig. 13(b), fluorescent emissions are then collected only from around the outside of objective lens 720. Collection from around the outside ofthe objective may be achieved by placing, for example, an opaque bar 730 at lens 490 in Fig. 10(a). Like conventional dark-field, inverted dark-field involves illumination at one angle and collection at a different angle so that only the sample plane is both illuminated and detected.
Fig. 14 depicts the focal region in the case described above where it is advantageous to illuminate a larger than diffraction- limited area ofthe sample plane. The illumination and collection rays are the same as those in the inverted dark-field geometry of Fig. 13. If a stop is placed in a plane conjugate to the objective back focal plane having a width matched to the illumination beam, the dark-field configuration is achieved. That this configuration confers a decrease in the out-of-plane fluorescence impinging on the detector can be understood from Fig. 14. The fluorescence from the shaded regions above and below the object plane is not passed by the stop. In point-scan confocal, fluorescence from these out-of-plane regions is rejected efficiently by the detection aperture. In line-scan confocal, the out-of-plane fluorescence from one lateral position along the line contributes to the background signal at other points along the line: this is the origin ofthe degradation in signal-to-background in line-scan relative to point-scan confocal. The inverse dark-field configuration of line-scan confocal recovers a significant fraction ofthe background rejection attributes of point-scan confocal while retaining the speed advantage ofthe line- scan configuration.
REAL-TIME DATA ANALYSIS
The present invention is capable of generating megabytes of data per second, continuously. In one embodiment, the system is integrated with a fast high-density, high- volume storage device to which the data can be spooled in real time for subsequent analysis. In a preferred embodiment, data analysis is run essentially simultaneously with data acquisition. Thus, the data is processed prior to storage. In general, only the results ofthe analysis are archived, but it is advantageous to archive selected raw data, as well. Examples of real time analysis routines are provided below in conjunction with each ofthe assay groups. In all cases, procedures are used to optimize the software code for operation on the hardware platform of interest. In a presently preferred embodiment, the computer is a 32-bit processor such as the Pentium II. In this case, all data is accessed in 32-bit parcels.
In general the acquisition and analysis ofthe data comprises a number of discrete steps. First, the fluorescence is converted into one or more digital images in which the digital values are proportional to the intensity ofthe fluorescent radiation incident on each pixel ofthe detection device. Within this step a correction is made for the non- uniform response ofthe imaging system across the field of view wherein the background subtracted data are divided by a so-called flat-field file. Second, a binary bitmap is generated from one ofthe digital images in which all values meeting certain criteria are replaced by one, all values failing to meet the criteria are replaced by zero. In one embodiment, the criteria include a threshold value determined from the image itself. Third, the bitmap is searched for groups of contiguous value-one pixels. In one embodiment the groups are further tested against minimum- and/or maximum-size criteria. Fourth, for the qualified groups, the values ofthe corresponding pixels in the same image or in another image are summed and recorded, and the average and other statistical properties ofthe sums determined and recorded. Additions to and variations on this basic procedure appropriate to the various assays are disclosed below.
ASSAYS
Numerous variations ofthe assay methods described below can be practiced in accordance with the invention. In general, a characteristic spatial and/or temporal distribution of one or more fluorescently-labeled species is used to quantify the assay. Advantageously, the fluorescence is observed from an essentially planar surface using a line-scan confocal microscope. This section is organized by assay-type according generally to increasing degree of complexity in the associated data analysis routine. The organization is not strict, however, because the analysis algorithms are often applicable to more than one assay-type.
BINDING ASSAYS
A first assay-type that can be advantageously performed according to the methods ofthe present invention is a binding assay. In general, the degree of binding of a fluorescently-labeled ligand to the target of interest is quantified from the analysis of one or more fluorescence images of a sample containing at least the target and the labeled ligand and obtained with the disclosed line-scan confocal imaging system. The ligands utilized include, but are not limited to, fluorophore conjugated natural and synthetic peptides and proteins, sugars, lipids, nucleic acid sequences, viral particles, bacteriophage particles, natural and synthetic toxins, known pharmaceutical agents, small organic molecules or synthetic analogues of neuro-transmitters or intrinsically fluorescent small molecules, peptides or proteins, synthetic compounds from combinatorial libraries, random peptides, proteins from cDNA expression libraries, and peptidomimetics. (See Haugland R.P. Handbook of Fluorescent Probes and Research Chemicals 6th Ed. Chap. 18.) The targets include, but are not limited to cellular extracts or purified preparations of receptors, ligand- gated and ion-gated channel proteins, enzymes, transcription factors, cytoskeletal proteins, and antibodies and can be derived from viruses, bacteria, bacteriophages, invertebrate and vertebrate cells. Exemplary receptors include but are not limited to acetylcholine, adrenergic (α and β), muscarinic, dopamine, glycine, glutamine, serotonin, aspartate, gamma-amino butyric acid (GABA), purinergic, histamine, norepinephrine, Substance P, Neuropeptide Y, enkephaline, neurotensin, cholecystokinin (CCK), endoφhin (opiod), melanocrotin ACTH, somatostatin, parathyroid hormone, growth hormone, thyrotropin, thyroxin, cytokine, chemokine, insulin, insulin-like growth factor (IGF), stem cell factor, Luteinizing hormone-releasing hormone, gonadotropin, angiotensin, endothelin, neurotensin, interferon, bradykinin, vasopressin, oxytocin, vasoactive intestinal polypeptide (VTP), corticotropin releasing-hormone, neurotrophin, erythropoetin, prostaglandin, leukotriene, thromboxane A2, calcitonin, T-cell, LDL/HDL, Epidermal growth factor (EGF), Estrogen, and Galainan.
BEAD-BASED BINDING Figs. 15(a) - 15(f) depict the steps of an embodiment of a receptor-binding assay that can be performed according to the present invention. In Fig. 15(a), membranes 210 prepared from cells or tissues and containing the receptor target 212 are added to a well 220 containing a liquid 230. In Fig. 15(b), fluorescent-labeled ligands 214 are added to well 220; these ligands bind to the membrane receptors 212. In Fig. 15(c), beads 224 are added to the well 220. Alternatively, the order of 15(b) and 15(c) may be interchanged, and in a preferred embodiment, the membrane-coated beads are prepared separately, prior to addition to the well. Beads 224 have a diameter in the range of approximately 1-20 μm and are coated with a material, such as wheat germ agglutinin, to which the membranes 210 adhere or have a surface that allows for the direct covalent or non-covalent binding of membranes. The foregoing steps are the same as those ofthe corresponding steps in the prior art SSA depicted in Figs. 1(a) - 1(f) except that the labels are fluorescent rather than radioactive. However, in the present invention, beads 224 are not luminescent and they have a density such that they sink to, or can be spun down to, the bottom ofthe well or are magnetic so that they can be moved to the bottom ofthe well using an external magnet. In Fig. 15(d), the fluorescent labels are imaged using, for example, a line-scan confocal microscope schematically depicted as element 240. In Fig. 15(e), a test compound 218 is added to the well. As in the prior art assays, the puφose ofthe present assay is to determine the extent to which the test compound displaces the fluorescently-labeled ligands 214 from the membrane receptors 212. In Fig. 15(f), the fluorescent labels still bound to the membranes 210 are imaged. By comparing the two fluorescent images, the activity ofthe test compound can be determined.
In an alternative embodiment ofthe assay depicted in Figs. 15(a) - 15(f), the imaging step depicted in Fig. 15(d) can be eliminated and the activity ofthe test compound can be determined by comparing the image obtained in Fig. 15(f) to the image of a control well or the image expected from the known quantity ofthe fluorescent-labeled ligands added to the well and their known affinity to the receptors.
In a specific embodiment ofthe assay depicted in Figs. 15 (a) - 15 (f), the receptor is an antibody that recognizes the ligand, and the fluorescently-labeled ligand is added to the reaction along with a sample containing an unknown amount of unlabelled ligand. As in prior art radioimmunoassays, the puφose ofthe present assay is to determine the concentration of unlabelled ligand in the sample by measuring extent to which it displaces the fluorescently-labeled ligands 214 from the antibody receptor.
SURFACE BINDING
Figs. 16(a) - 16(f) depict the steps of a second embodiment of a receptor- binding assay according to the present invention. In Fig. 16(a), membranes 250 prepared from cells or tissues and containing the receptor target 252 are added to a well 260 containing a liquid 270. The well bottom 262 is coated with a material such as wheat germ agglutinin, to which the membranes adhere. In Fig. 16(b), membranes 250 are shown bound to this material. In Fig. 16(c), fluorescently-labeled ligands 254 are added to well 260 and bind to the membrane receptors 252. Alternatively, the order of Figs. 16(b) and 16(c) may be interchanged.
In Fig. 16(d), the fluorescence ofthe fluorescent labels is imaged using, for example, a line-scan confocal microscope schematically depicted by element 280. In Fig. 16(e), a test compound 258 is added to well 260. In Fig. 16(f), the fluorescent labels still attached to the membranes 250 are imaged and compared to the first image to determine the activity of test compound 258.
In an alternative embodiment ofthe assay depicted in Figs. 16(a) - 16(f), the imaging in Fig. 16(d) can be eliminated and the activity ofthe test compound can be determined by comparing the image obtained in Fig. 16(f) to the image of a control well or the image expected from the known quantity ofthe fluorescent-labeled ligands added to the well and their known affinity to the receptors.
CELL-BASED BINDING In an alternative embodiment, ligand-target binding is advantageously assayed on collections of cells expressing the target. In general, there are a number of advantages to cell-based assays for screening chemical compounds. In particular, the activity of interest is measured in the presence of both competing and complementary cellular processes affecting the biological activity ofthe compound. In cellular assays, cells prepared from cell lines or tissues are placed in tissue culture wells or on microscope slides. The cells can be live and intact or permeabilized with reagents such as digoxigenin, or, alternatively, fixed with reagents such as formaldehyde. One or more fluorescent- labelled ligands are added to the cells along with any non-fluorescent reagents required for the assay; the fluorescent-labelled ligands bind to one or more components ofthe cells. A test compound is then added to the cells. Alternatively, the order of addition of fluorescent ligands and chemical compounds may be interchanged. The fluorescent labels are imaged using, for example, a line-scan confocal microscope schematically depicted as element 240. The puφose ofthe present assay is to determine the extent to which the test compound displaces the fluorescently-labeled ligands from the receptors. The fluorescent labels still bound to the cells are imaged in the presence and the absence of test compound. By comparing the two fluorescent images, the activity ofthe test compound can be determined.
In an alternative embodiment of a cell-based receptor binding assay, the imaging step in the absence of compound can be eliminated and the activity ofthe test compound can be determined by comparing the image obtained in the presence of compound to the image of a control well or the image expected from the known quantity of the fluorescent-labeled ligands added to the well and their known affinity to the receptors.
ADVANTAGES OF LINESCAN CONFOCAL IMAGING IN BINDING ASSAYS
In a first embodiment, ligand-target binding is performed with one excitation wavelength and one emission wavelength. Data are provided in Fig. 27 exemplifying the speed and sensitivity ofthe present invention. A detailed analysis of its performance relative to the prior art wherein ligands are radiolabeled to allow for their detection, follows. The prior art for receptor-ligand assays includes SSA formats as well as formats in which bound and unbound ligand are physically separated and the amount of ligand bound to the receptor is measured by the addition of liquid scintillant. First, the present invention can be used in small-volume wells, exemplarily 1 μL. In a receptor-ligand binding assay employing radiolabeled ligand, each radio label, 3H for example, can decay only once, producing at most 90 photons per decay, at a decay rate of less than 10'8 per second. A single fluorescent molecule, will produce 104 - 107 photons in total, and it will emit between 103 and 106 photons per second. Thus, the count-rate for a fluorescent label is approximately 10" relative to 3H. The present invention, therefore, requires immensely fewer labels, membranes and beads per well. For example, while a tritium SSA requires 107 beads per well, the present invention requires less than 103 beads per well. As a result, the present invention can be performed in μL-volume wells and in far less time. In addition, in an SSA it is difficult to alter the imaging time, because radio labels decay at a fixed rate. In contrast, the excitation rate of fluorescent labels can be increased so as to increase the photon emission rate, thereby reducing the required imaging time. The excitation rate cannot, however, be increased without limit. In fact, it is the existence ofthe so-called saturation limit ofthe fluorophore emission rate that underlies the substantial advantage ofthe line-scan confocal over the point-scan confocal in the present application. Second, the present invention does not require the time and expense of handling radioactivity. Third, because the present invention can be performed in small-volume wells, the compound and reagent consumption is much lower than for SSAs resulting in further cost reductions. Finally, the present invention does not require scintillant-doped beads or well bottoms, reducing costs even further. The present invention uses a line-scan confocal microscope to image the fluorescence ofthe sample in the well. The confocal aspect ofthe microscope allows for optical sectioning, i.e., detection of fluorescence from the plane in which the sample is located while minimizing the detection of fluorescence from the bulk ofthe solution. This eliminates the need for wash steps to remove unbound fluorescent-labeled ligand; this step, while it is not required in an SSA, is still required in any receptor-ligand binding assay, including RIA, in which scintillant containing beads are not used. The confocal aspect ofthe microscope also eliminates any interference that may originate from intrinsic fluorescent test compounds. The line-scan aspect allows the sample to be imaged more rapidly than in traditional point-scanning without losing appreciable background rejection. The speed increase depends on the fluorophore density, the lateral resolution, the field of view, and parameters ofthe hardware including the objective NA, the detection sensitivity and camera read-rate. Theoretically, the speed increase can approach the number of pixels per line, which is 1000 in a preferred embodiment ofthe present invention. Practically, the increase is approximately 100X.
In order to quantify these advantages, an exemplary sample will be described. The assay is cell-based, wherein the location ofthe fluorescence is to be resolved to a precision of 1 μm. Thus the image of a 1-mm diameter sample area will consist of -103 lines of -103 pixels. The fluorescence signal of interest might originate from ligands on the cell surface or from a localized source within the cell, such as a receptor in the nucleus. In either case, the local concentration ofthe fluorophore is the important parameter. For an engineered cell line expressing -105 receptors per cell, the cell-averaged concentration is -1 μM. A few thousand receptors localized in the nucleus results in a comparable local concentration. Consistent with the desired lateral resolution of -1 μm, there are -2 x 103 fluorophores per pixel. It is assumed that the intrinsic cellular background fluorescence is less than, but on the order of, the label fluorescence, and that the desired signal-to-noise ratio is minimally 10. Then, the number of detected photons needs to be nearly 103, taking into account the shot noise ofthe signal and background and the read noise of a high quality solid state detector. The collection and detection efficiency ofthe present device, using an approximately 0.7 NA objective, blocking filters, and a solid state camera is -1%, requiring that ~105 photons be emitted per pixel, or -102 photons per molecule. It is desirable that the image be acquired in less than 1 second, preferably in a fraction of a second. If the pixels are acquired in a serial fashion, then the pixel dwell-time must be less than 1 μs, requiring a photon emission rate of greater than 108 per second per molecule. This is beyond the saturation value of most fluorophores, which is typically 106. Importantly, the flux required to achieve saturation, 105 - 106 W/cm2, is sufficient to drive non- linear photo-induced bleaching ofthe fluorophores, as well. Finally, the highest efficiency detection devices cannot be used at the data rates required in serial scanning. By contrast, the emission rate per fluorophore need only be ~105 if 103 pixels are illuminated simultaneously. The increased rejection of background fluorescence of point-scan confocal does not warrant the disadvantage of dramatically decreased scan speed. The exemplary data of Fig. 27 demonstrate that the disclosed system has sufficient sensitivity to quantify tens of fluorophores per bead, while clearly resolving hundreds of individual beads in less than 1 second. Comparable data can be acquired in cell-based binding experiments, as will be exemplified below.
DATA ANALYSIS The data analysis routines are closely related whether the binding be cell- based or bead-based and are presented together, below. The data can be analyzed by the following routines, the simplest of which is the Threshold Image Analysis algorithm. The puφose ofthe routine is to determine the amount of a fluorescently-labeled species that is localized in a contiguous or punctate manner so as to exceed a minimum fluorescence intensity, and optionally so as to not exceed a maximum fluorescence intensity. In one embodiment the analysis is used to assay the activity of a chemical compound. The steps ofthe algorithm are as follows: 1. Acquire a digitized image ofthe labeled species. 2. Open file row-by-row and i. Subtract camera offset value from image, ii. Multiply each row in the image by the inverse ofthe corresponding row in the flat-field image file. 3. Optionally, histogram the image to determine the background level. 4. Establish selection criteria including a minimum value and optionally a maximum value. The values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a predetermined value. 5. Compare each pixel in the image to the selection criteria. For each pixel in the image meeting the criteria, add the value to a running sum. The total number of qualified pixels and the average intensity are reported.
This routine is used advantageously to process data similar to that in Fig. 27, in which the individual beads are clearly distinguishable from the background and the artefacts due to clumped beads or cells are small. Such a routine is appropriate for the assay-type having membranes bound to the well bottom, as well.
A second routine applicable to analyzing binding data is the Localization
Analysis algorithm which entails an additional shape analysis protocol. As with the Threshold routine, the puφose is to determine the amount of a fluorescently-labeled species that is localized in a contiguous or punctate manner. In one embodiment the analysis is used to assay the activity of a chemical compound.
The steps ofthe algorithm are as follows:
1. Acquire image ofthe labeled species. 2. Open file row-by-row and i. Subtract camera offset value from the image, ii. Multiply each row in the image by the inverse ofthe corresponding row in the flat-field image file.
3. Optionally, histogram and sum the pixel values ofthe image.
4. Establish selection criteria including a minimum value and optionally a maximum value. The values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a predetermined value.
5. Compare each pixel in the image to the selection criteria. All qualified pixels are assigned a value of 1 and all others are assigned a value of 0, thereby effecting a 16- to 1 -bit compression.
6. "Clean" the edge ofthe image by setting to 0 all 1 -valued contiguous pixels in the binary mask having an edge-touching member.
7. Search the bitmap for objects, defined as groups of contiguous value-1 pixels, by: i. Searching the image in a line-by-line pattern to find a pixel of value 1. ii. Determining all value-1 pixels contiguous to the pixel identified in i). iii. Optionally, applying a minimum and maximum size filter to the object, the sizes having been previously determined, iv. If the object qualifies, proceed to step 8, otherwise change all 1-valued pixels in the object to 0 and continue searching for next object, v. If the end ofthe bitmap is reached, proceed to step 9.
8. For each object passing the filter criteria: i. Optionally, create a new rectangular bitmap with extended borders that contains the object plus n extra 0 pixels in each direction from the edge ofthe object, n is the number of dilation steps to be performed below and has been previously determined, ii. If step 8.i. was implemented, then dilate the object by applying a dilation step n times in which pixels of value 0 that touch 1-valued pixels are set to value 1. iϋ. For each collection of 1-valued pixels in either the dilated bitmap, or in the original bitmap if step 8.i. was not implemented, sum and average the corresponding pixel values from the image to calculate the average pixel intensities under the mask, iv. Change to 0 all pixels ofthe object in the original bitmap image and return to step 7 to search for more objects. 9. After all objects have been counted, the average intensity ofthe fluorescently-labeled species per object and optionally the fraction ofthe total intensity ofthe species localized is calculated for all objects in the image and reported together with statistical information such as the standard deviation.
The distinguishing operation in this routine, shared by all the following algorithms, is the creation ofthe binary mask in steps 4-6. Mask generation is depicted in Fig. 20. The selection criteria of objects for the mask can optionally include minimum and maximum values, size and shape. For example, in one embodiment, the analysis routine for the bead-based assays include a roundness filter in step 7.iii.
In a second embodiment, the emission of two or more fluorescently-labeled species is detected simultaneously, excited by one or more illumination wavelengths. As applied in a binding assay, the first fluorescently-labeled species is used to identify the object to which the second fluorescently-labeled species binds. Two examples of two-color cell-based binding assays are provided in Figs. 24 and 26. An exemplary procedure that can be used to analyze such images is the Co-localization Analysis routine which is designed to determine the amount of a first fluorescently-labeled species localized with respect to a second fluorescently-labeled species. In one embodiment the analysis is used to assay the activity of a chemical compound, for example, where activity depends on a subcellular localization of interest.
The steps ofthe algorithm are as follows:
1. Acquire digitized images ofthe first and second labeled species respectively.
2. Open files row-by-row and i. Subtract respective camera offset values from each image, ϋ. Multiply each row in each image by the inverse ofthe corresponding row in its respective flat field image file.
3. Optionally, histogram the image ofthe first species to determine the background level and sum the intensity ofthe image ofthe second species.
4. Establish selection criteria including a minimum value and optionally a maximum value. These values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a predetermined value.
5. Compare each pixel in the image ofthe first species to the selection criteria. All qualified pixels are assigned a value of 1 and all others are assigned a value of 0, thereby effecting a 16- to 1-bit compression. 6. "Clean" the edge ofthe image by setting to 0 all 1-valued contiguous pixels in the binary mask having an edge-touching member.
7. Search the bitmap for objects, defined as groups of contiguous value-1 pixels, by: i. Searching the image in a line-by-line pattern to find a pixel of value 1. ϋ. Determining all value-1 pixels contiguous to the pixel identified in i). iii. Optionally, applying a minimum and maximum size filter to the object, the sizes having been previously determined, iv. If the object qualifies, proceed to step 8, otherwise change all 1-valued pixels in the object to 0 and continue searching for next object. v. Ifthe end ofthe bitmap is reached, proceed to step 9.
8. For each object passing the filter criteria: i. Optionally, create a new rectangular bitmap with extended borders that contains the object plus n extra 0 pixels in each direction from the edge ofthe object, n is the number of dilation steps to be performed below and has been previously determined. ii. If step 8.i. was implemented, then dilate the object by applying a dilation step n times in which pixels of value 0 that touch 1-valued pixels are set to value 1. iii. For each collection of 1-valued pixels in either the dilated bitmap, or the original bitmap if step 8.i. was not executed, sum and average the corresponding pixel values from the image ofthe second species to calculate the average pixel intensities under the mask, iv. Change to 0 all pixels ofthe object in the original bitmap image and return to step 7 to search for more objects. 9. After all objects have been counted, the average intensity ofthe second fluorescently-labeled species per object and optionally the fraction ofthe total intensity ofthe second species co-localized with the first species is calculated for all objects in the image and reported together with statistical information such as the standard deviation.
The advantage of this more elaborate routine is that the object, whether it be a cell or a bead, can be independently identified. As exemplified in Fig. 24, not all cells respond. The independent identification of cells, enables, for example, the ratio of responding to non- responding cells to be tabulated along with the degree of response among those that respond. This algorithm, despite its additional complexity, can be implemented so as to analyze 1- Megapixel images in under 1 second on a Pentium II platform. TRANSLOCATION ASSAYS
An additional assay-type that can be performed advantageously according to the second embodiment, that is where the emission of two or more fluorescently-labeled species is detected simultaneously, excited by one or more illumination wavelengths, is the translocation assay. In these assays, the translocation of interest is of one or more species, which may be proteins, lipids or other molecular complexes or sub-cellular structures such as vesicles, from one well-defined region of a cell to another. These include but are not limited to: synaptin (vesicle membrane protein), transcription factors (NF-κB, NFAT, AP- 1), hormone receptors, LDL/HDL receptors, T-cell receptors, and PTH receptors. The prototypical translocation assay is a special case ofthe co-localization measurement. Exemplarily, the co-localization ofthe first and second species is quantified by the fraction ofthe second species co-localized with respect to the first, or the ratio ofthe second species co-localized with the first and that resident elsewhere in the cell. An expanded analysis routine preferentially used to process translocation image data is provided below.
Exemplary translocation images and analysis procedures are provided in Figs. 19-21. The labeled location is the cell nucleus, the label being a fluorophore specific for DNA, such as Hoechst 33342. Other nucleic acid specific stains are known in the art (e.g., see Haugland, R.P. Handbook of Fluorescent Probes and Research Chemicals, 6th Ed. Chapter 8). The second species is a transcription factor whose migration from the cytoplasm to the nucleus is the subject ofthe assay. This protein can be labeled by a variety of methods, including expression as a fusion with GFP, and contacting the sample with a fluorescently-labeled antibody specific to the transcription factor protein.
The following Translocation Data Analysis routine can be used to determine the amount of a first fluorescently-labeled species that is distributed in a correlated or anti- correlated manner with respect to a second fluorescently-labeled species. In one embodiment the analysis is used to assay the activity of a chemical compound. The steps ofthe algorithm are as follows: 1. Acquire images ofthe first and second labeled species respectively. 2. Open files row-by-row and i. Subtract respective camera offset values from each image, ii. Multiply each row in each image by the inverse ofthe corresponding row in its respective flat-field image file. 3. Optionally, histogram the image ofthe first species to determine the background level and sum the intensity ofthe image ofthe second species. 4. Establish selection criteria including a minimum value and optionally a maximum value. These values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a pre- determined value.
5. Compare each pixel in the image ofthe first species to the selection criteria. All qualified pixels are assigned a value of 1 and all others are assigned a value of 0, thereby effecting a 16- to 1-bit compression.
6. "Clean" the edge ofthe image by setting to 0 all 1-valued contiguous pixels in the binary mask having an edge-touching member.
7. Search the bitmap for objects, defined as groups of contiguous value-1 pixels, by: i. Searching the image in a line-by-line pattern to find a pixel of value 1. ii. Determining all value-1 pixels contiguous to the pixel identified in i). iii. Optionally, applying a minimum and maximum size filter to the object, the size having been previously determined. iv. If the object qualifies, proceed to step 8, otherwise change all 1-valued pixels in the object to 0 and continue searching for next object, v. If the end ofthe bitmap is reached, proceed to step 9.
8. For each object passing the filter criteria: i- Create a new rectangular bitmap with extended borders that contains the object plus n extra 0 pixels in each direction from the edge ofthe object, n is the number of dilation steps to be performed below and has been previously determined, ii. Dilate the object by applying a dilation step n times in which pixels of value 0 that touch 1-valued pixels are set to value 1. iii. Compare the dilated bitmap with the original full size bitmap. Set to 0 all pixels in the dilated bitmap that are 1-valued in the corresponding region of the original bitmap. This produces an annular mask and ensures only one object is captured when the bitmap borders were increased during dilation. iv. Create another bitmap from the original object, erode it m times by setting to
0 value-1 pixels touching value-0 pixels, m is typically equal to n and determined previously, v. For each collection of 1-valued pixels in the annular and eroded bitmaps, average the corresponding pixel values from the image ofthe second species to calculate the average pixel intensities under the eroded and annular masks. vi. Calculate the ratio of eroded to annular intensities for each object and save in a table, vii. . Change to 0 all pixels ofthe object in the original bitmap image and return to step 7 to search for more objects. 9. After all objects have been counted, the average intensity ratio of all objects in the image is calculated along with statistical information such as the standard deviation.
The new feature of this routine over those disclosed above is the creation in Step 8 of two daughter masks, one an annular extension ofthe primary mask, and one an eroded version ofthe primary mask. The latter is used to quantify the co-localization of species-two with species-one, the transcription factor and the cell nucleus (actually, DNA), respectively, in the present example. The former mask is used to quantify species-two not co-localized. In the present example, the ratio of these two quantities is formed on an cell- by-cell basis and the results tabulated. According to the methods ofthe present invention, the data acquisition and analysis can be performed in approximately one second. For comparison, two prior art examples are cited. In Ding et al. (J. Biol. Chem, 273, 28897-28905 (1998)), a comparable two-color translocation assay was performed. The advantages ofthe present invention include: 1) approximately 50X faster image acquisition per data channel, 2) simultaneous two-color image acquisition, 3) superior sensitivity of approximately 10X, permitting lower staining levels, 4) confocal detection, allowing elimination of a rinse step, 5) focus-time of approximately 0.1 s compared to approximately 30 s, 6) data analysis time of approximately 0.2 s/frame compared to 3-6 s/frame, and 7) continuous image acquisition. The second example of prior art is Deptala et al. (Cytometry, 33, 376-382, (1998)). The present invention provides 1) higher spatial resolution, approximately 4X, 2) approximately 16X higher pixel acquisition rates, 3) faster data analysis, 4) autofocus operable in microtiter plates, and 5) data analysis time of approximately 0.2 s/frame compared to 3-6 s/frame.
ENDOCYTOSIS,EXOCYTOSIS AND RECEPTORSEQUESTRATION Endocytosis and exocytosis, generally, and receptor sequestration and recycling, specifically, are additional processes that can be assayed according to the first or second embodiments and the associated image analysis protocols disclosed above. Fluorescence labeling can be accomplished according to a variety of known methods. For example, an elegant experiment comprising the labeling of both the receptor and ligand is disclosed by Tarasova et al. (J. Biol. Chem., 272, 14817-14824 (1997)). The present imaging system is approximately 5 OX faster per data channel and acquires the two images simultaneously. In addition, the present analysis protocols, the Co-localization algorithm for example, can be used to process sequestration image data in real-time. No such examples are known in the prior art.
Many other assays requiring similar imaging and analysis capabilities are known in the art. For example, assays involving phagocytosis and related cellular events, (e.g., J. Immunology, (1983) 130, 1910; J. Leukocyte Biol. (1988) 43, 304); additional assays involving both receptor-mediated and non-receptor-mediated endocytosis and exocytosis (e.g. Neuron 14, 983 (1995); J. Physiol. 460, 287 (1993) and Science 255, 200 (1992), including receptor-mediated endocytosis of Low-Density Lipoprotein Complexes (see J. Cell Biol. 121, 1257 (1993) and the delivery of Transferin to vertebrate cells (see Cell 49, 423 (1994)); imaging the endocytosis and lateral mobility of fluorescently-labeled epidermal growth factor (see Proc. Natl. Acad. Sci. USA 75, 2135 (1975); J. Cell Biol. 109, 2105 (1989)); monitoring the uptake and internal processing of exogenous materials by endocytosis of fluorescent dextrans (see J. Biol. Chem. 269, 12918 (1994)), and the imaging ofthe endocytosis-mediated recycling of synaptic vesicles in actively firing neurons by use of hydrophilic dyes (see Nature 314, 357 (1985)). In addition, the genetic engineering of cell lines expressing green fluorescent protein (GFP)fused to proteins that localize to exocytotic and secretory vesicles (such as chromogranin B, a secretory granule protein (see J. Cell Sci. 110,1453 (1997) or tPA which is localized to growth cones in differentiated neuronal cells (see Moi. Biol. Cell 9: 2463 (1998)) allow for the monitoring of exocytosis. A wide variety of fluorescent labels are available for such assays (See Haugland R.P. Handbook of Fluorescent Probes and Research chemicals, 6th Ed. Chap. 17).
ION CHANNELS A third embodiment ofthe present invention, one version of which is depicted in Fig. 9, can be used to image the time-dependent response of one or more fluorescently-labeled species at a rate of approximately 30 frames per second. This permits the capture of transient phenomenon, such as the opening and closing of ion channels. Exemplary ion channels include but are not limited to: K+-gated voltage, Na+-gated voltage, Ca^-gated voltage, Cl", Na7K+ ATPase, and P-glycoproteins.
The following Kinetic imaging Data Analysis algorithm defines and tracks individual cells from frame to frame, enabling simultaneous kinetic analysis on a sufficient number of cells to obtain statistically meaningful data.The steps ofthe algorithm are as follows: 1. Acquire one (indicator only), two (marker and indicator or two indicators) or more digitized images as a function of time. 2. Open files row-by-row and i. Subtract respective camera offset values from each image, ii. Multiply each row in each image by the inverse ofthe corresponding row in its respective flat-field image file. Subtract respective camera offset values from each image.
3. Optionally, histogram the image ofthe first species to determine the background level.
4. Establish selection criteria including a minimum value and optionally a maximum value. The values are determined, for example, as a fixed multiple ofthe mean background level, as a fixed number of counts above the mean background level, by statistical analysis on the background histogram peak width or by using a predetermined value.
5. Compare each pixel in the image ofthe first species to the selection criteria. All qualified pixels are assigned a value of 1 and all others are assigned a value of 0, thereby effecting a 16- to 1-bit compression.
6. "Clean" the edge ofthe image by setting to 0 all 1-valued contiguous pixels in the binary mask having an edge-touching member.
7. Search the bitmap for objects, defined as groups of contiguous value-1 pixels, by: i Searching the image in a line-by-line pattern to find a pixel of value 1. ϋ Determining all value-1 pixels contiguous to the pixel identified in i. iii. Optionally, applying a minimum and maximum size filter to the object, the size having been previously determined, iv. If the object qualifies, proceed to step 8, otherwise change to 0 all 1-valued pixels in the object and continue searching for next object. v. Ifthe end ofthe bitmap is reached, proceed to step 9.
8. For each object passing the filter criteria: average the corresponding pixels from each ofthe images in the time series. If a single indicator is used, record the intensities. If ratiometric indicators are used, divide the value of one image by the other for each image in the time series and record the results. 9. After all objects have been analyzed, the results ofthe analysis of step 8 are reported for each object. Kinetic parameters, including the rise time, fall time and amplitude are reported for each object as are statistical information derived from the set of kinetic analyses and from the set of all objects at fixed times.
Two examples ofthe use ofthe present invention to image and analyze transient events associated with ion channels are provided in Figs. 22 and 23. These assays used the Ca^-sensitive dye, Fluo-3 to indicate the changes in intra-cellular Ca"^ concentration. In the first ofthe experiments, the change was caused by a Ca ^ second signal initiated by the activation of acetylcholine receptors, and in the second experiment the change was due to activation of voltage-gated Ca^ channels. Ion channels have been an area of intense research activity in recent years.
The advantages ofthe present invention over the prior art will be made clear by the following comparisons.
In compound screening applications, a prior art standard, cited in the Background Section, is disclosed in U.S. Patent No. 5,355,215. This device, used primarily 0 for detecting induced changes in intracellular Ca2", includes a dispenser to initiate transient events. The principal advantages ofthe present invention over this prior art are the following: 1) imaging and analysis permitting the determination of individual cellular responses as compared to a response averaged over the well, 2) increased sensitivity, requiring lower reagent loading and lower illumination intensity, and enabling smaller 5 sample volumes, and 3) the acquisition of images at video rates compared to a maximum rate of 1 point per second.
In research applications, the system of Tsien and co-workers disclosed in the Handbook of Biological Confocal Microscopy, J. B. Pawley, ed., Plenum Press, New York, 1995, pp. 459-478, serves as a standard. It has a demonstrated capability to image at rates 0 beyond the present invention. This cannot be accomplished, however, on samples presently of interest. The prior art requires 102-103 greater fluorophores per pixel to achieve rates comparable to the present invention at a comparable signal-to-noise ratio. In addition, the present invention can acquire images at 12- or 16-bit resolution, giving it a 4-16X greater dynamic range. 5 A second example of a research system is disclosed in Sun et al., J.
Physiology, 509, 67-80, 1998. According to Sun, data is generated at rates up to 650 Hz per 600-pixel line with 5 microsecond per pixel integration time, using a conventional spot scanning confocal microscope. Only one-dimensional "imaging" is performed. Transients can be monitored for objects lying along the scanned line. In addition, this rate could only
30 be achieved with 1-μs pixel integration time, requiring a 102-103 greater concentration of fluorophores to achieve image quality comparable to the present invention.
The capabilities ofthe present invention to image and analyze changes in intra-cellular ion concentrations in response to external stimuli has multiple applications in compound screening and in general biological research applications. (See e.g. J. Cell Biol.
35 137(3), 633-648 (1997); J. Biol. Chem. 271(9), 4999-5006 (1996); Science 280, 69-76 (1998); Biochem, J., 324, 645-651 (1997)). A wide variety of fluorescent indicators are available sensitive to specific ions (see Haugland R.P. Handbook of Fluorescent Probes and Research Chemicals, 6th Ed. Chaps 18, 22 and 24). These indicators allow measurement of concentrations of Mg2+, Zn2+, Ca2+, Na\ Fe2+ Hg2+, Pb2+, Cd2+, Ni2+, Co2+ Al3', Ga2", Eu3+, Tb3+, Tb3+, Sm3+, and Dy3*. In addition, assays for Na+ and K+ can be performed even in the presence of physiological concentrations of other monovalent cations (see J. Biol. Chem. 264, 19449 (1989)), including assays of Na" levels or Na+ efflux in a variety of cells such as blood, brain and muscle cells (see J. biol. Chem. 268, 18640 (1993); J. Neurosci. 14, 2464 (1994); Am J. Physiol. 267, H568 (1994)), and changes in K+ in sperm cells, nerve terminals synaptosomes and lymphocytes. In addition, the present invention can be used to assay Cl' concentrations in vesicles, liposomes and live cells (see Am. J. Physiol. 259, c375 (1990). In addition, the present invention can be used to assay changes in membrane potential in cells and sub-cellular organelles. The ability to rapidly image changes in membrane potential is vital to assays for cell and organelle viability, nerve-impulse generation, muscle contraction, cell signaling and ion-channel gating (see Biophys J. 67, 208 (1994); Neuron 13, 1187 (1994); J. Membrane Biol. 130,1 (1992)). Fluorescent indicators are available that respond to fast (millisecond) potential changes in excitable cells such as neurons, cardiac cells and intact brain cells. (See Haugland R.P. Handbook of Fluorescent probes and Research Chemicals, 6th Ed. Chap. 25). The fluorescent probes that respond to fast fransmembrane potential changes typically show only a 2-10% change in fluorescence per lOOmv. The plasma membrane of a cell has a fransmembrane potential of approximately -70mv and some organelles such as mitochondria maintain fransmembrane potentials of - 150mV. Thus, assays involving such rapid changes require the high sensitivity, rapid data acquisition ability common to the various embodiments ofthe present invention.
FRET-BASED MEASUREMENTS
The present invention can be advantageously used to perform assays which involve fluorescence resonance energy transfer (FRET). FRET occurs when one fluorophore, the donor, absorbs a photon and transfers the absorbed energy non-radiatively to another fluorophore, the acceptor. The acceptor then emits the energy at its characteristic wavelength. The donor and acceptor molecules must be in close proximity, less than approximately 10 nm, for efficient energy transfer to occur (see Methods Enzymol. 211, 353 - 388 (1992); Methods Enzymol. 246, 300-334 (1995)). The proximity requirement can be used to construct assays sensitive to small separations between the donor-acceptor pair. FRET typically requires a single excitation wavelength and two emission wavelengths, and an analysis consisting ofthe ratio ofthe donor and acceptor emission intensities. FRET donor acceptor pairs can be constructed for both bead-based assays and cell-based assays. Several green fluorescent protein (GFP) mutants displaying enhanced fluorescence and altered emission wavelengths can be paired for FRET cell-based assays by fusing the GFP FRET donor to one protein and the GFP FRET acceptor to either the same protein or to another protein expressed within the same cell. Such FRET pairing can be used to measure intramolecular changes, such as Ca2+-calmodulin binding of Ca2+ or intermolecular interactions, such as receptor dimerization. The Kinetic Imaging algorithm disclosed above can be preferentially used.
TRANSIENT TRANSFECTION Among the significant advantages of an image-based measurement is the opportunity both to observe rare events, lost within the average, and to normalize the primary response on an object-by-object basis to a secondary, response. Both features can be important in assays using a cell line having a transiently transfected target. Gene expression and subsequent protein production following transfection is often inefficient and transient (see BioTechniques 24:478-482 (1998)). Methods to monitor the transfection efficiency that can be advantageously used with the present invention are known in the art. For example, the gene of interest can be transfected together with the gene for green fluorescent protein (GFP), so that the two proteins will be expressed either as a fusion or as separate entities. The present invention can be used to measure the amount of indicator present at one wavelength and the response associated with the target at another. The former signal can be used to normalize the response ofthe latter for the amount of target present. This allows the present invention to perform assays on targets too unstable to be used in currently available screening and to monitor transfection efficiencies of only a few percent. The Kinetic Imaging algorithm disclosed above can be used to analyze such data, where only one image frame is required. Viral infection of cells can be monitored, either directly through expression of viral proteins, or indirectly by acquisition of a new phenotype, even if only a few percent of cells are infected. Finally, this invention provides a method for detecting a rare event, such as the acquisition of a new phenotype by an individual cell or group of cells due to the transfection of a specific cDNA as a result ofthe transfection ofthe entire cell population with a library of diverse cDNAs.
ENZYME ASSAYS
The present invention can also be used to conduct general assays of enzyme activity. Exemplary intracellular enzymes include but are not limited to: carbonic anhydrase, guanine nucleotide-binding proteins (G proteins), adenyl cyclase, calmodulin, PI, PIP and PIP2 kinases, cAMP kinase and cAMP hydrolase, cytochrome P-450, serine/threonine protein kinases, tyrosine protein kinases, protein phosphatases, β-lactamase, β-galactosidase, dihydrofolate reductase, phosphodiesterases, caspases, proteosome proteases, nitric oxide synthase, thymidine kinase, nucleoside deaminase, glutathione-S- transferase, lipoxygenases, and phospholipases.
5 Figs. 17(a) - 17(d) depict the steps of a first embodiment of an enzyme assay according to the present invention. In Fig. 17(a), beads 310 with a known quantity of fluorescent-labeled peptides 312 attached thereto are added to a well 320 containing a liquid 330. Beads 310 have a density such that they sink to the bottom ofthe well. In Fig. 17(b), a test compound 314 is added to the well. In Fig. 17(c), enzymes 316 are added to the well.
10 The order ofthe steps depicted in Figs. 17(a), 17(b) and 17(c) is interchangeable except that at no time should the well contain the peptides and enzymes without the test compound. If not inhibited, enzymes 316 will cleave peptides 312, and the fluorescent labels will diffuse into the liquid. If, on the other hand, test compound 314 inhibits enzymes 316, typically by blocking the enzyme active sites, enzymes 316 will not cleave the fluorescent labels. In Fig.
15 17(d), the fluorescent labels still attached to the beads are imaged using, for example, a line- scan confocal microscope schematically depicted as element 340. From this image, the activity of test compound 314 can be determined.
In an alternative embodiment ofthe assay depicted in Figs. 17(a) - 17(d), the activity ofthe test compound can be determined by comparing the image obtained in Fig.
20 17(d) to the image obtained by imaging the fluorescence ofthe fluorescent labels in Figs. 17(a) or 17(b) or the image of a control well.
Figs. 18(a) - 18(d) depict the steps of a second embodiment of an enzyme assay according to the present invention. In Fig. 18(a), a known quantity of fluorescent- labeled peptides 352 are attached to the bottom 362 of a well 360. In Fig. 18(b), a test
25 compound 354 is added to the well. In Fig. 18(c), enzymes 356 are added to the well. In Fig. 18(d), the fluorescent labels still attached to the bottom ofthe well are imaged using, for example, a line-scan confocal microscope schematically depicted as element 380 to determine the activity of test compound 354.
In an alternative embodiment ofthe assay depicted in Figs. 18(a) - 18(d), the
30 activity ofthe test compound can be determined by comparing the image obtained in Fig. 18(d) to the image obtained by imaging the fluorescence ofthe fluorescent labels in Figs. 18(a) or 18(b) or the image of a control well.
Another example of an assay that may be performed according to the present invention is a tyrosine kinase assay. Tyrosine kinases phosphorylate tyrosine residues of
35 substrate peptides. The substrate peptide has both a tyrosine residue and a fluorescent tag. In this assay, an antibody that at one end is selective for phosphorylated tyrosine is bound at the other end to a surface such as a bead or the bottom of a well. Tyrosine kinase and a fluorescent-tagged peptide with a tyrosine residue are added to the well. If the tyrosine kinase phosphorylates the peptide, the phosphorylated tyrosine will bind to the antibody, thereby localizing the fluorescent tag on the surface to which the antibody is attached. If the tyrosine kinase does not phosphorylate the peptide, the fluorescent tags on the peptides will be dispersed throughout the well. The extent of phosphorylation ofthe peptide can be determined by measuring the fluorescence adjacent to the surface. Such an assay can also be conducted where an antibody is used that is specific to the fluorescent product produced by the action ofthe enzyme upon the fluorescent substrate. 0 In addition, live-cell enzyme assays can be performed according to the present invention. A number of techniques for investigating enzymatic activity in live cells are known in the art (See Biochem. Histochem 70,243 (1995), J. Fluorescence 3, 119 (1993)) as are substrates that yield fluorescent products when acted on by enzymes (See Haugland R.P. Handbook of Fluorescent Probes and Research Chemical 6th Ed. Chap. 10).
15 In general, these assays use probes that passively enter the cell and are subsequently processed by intracellular enzymes to generate products retained within the cell. Other substrates yield insoluble fluorescent products that precipitate at the site of enzymatic activity. The present invention can assay the degree of enzymatic activity and determine the precise spatial localization ofthe enzymatic activity using such probes. Probes are available 0 for assaying a wide variety of enzymes using the present invention including but not limited to phosphatases, ATPases, 5'-nucleotidase, DNA and RNA polymerases, peptidases, proteases, esterases and peroxidase.
Enzyme activity assays can be performed according either the first or second experimental embodiments and the associated image analysis protocols disclosed above. 5
MORPHOLOGY
The methods ofthe present invention can also be used to perform assays that require a determination of cellular or sub-cellular moφhology, including but not limited to axons and organelles. To perform such assays, a fluorescent probe is introduced into the
30 structure of interest, such as a cell or organelle, by direct micro-injection or by contacting cells with cell-permeant reagents that are metabolized or otherwise altered so as to be retained in the structure of interest. If it is to be used with live cells, the fluorescent label must be non-toxic and biologically inert. Many appropriate dyes are available commercially (See Haugland R.P. Handbook of Fluorescent Probes and Research Chemicals 6th Ed. Chap.
35 15) for use in assays, for example, involving flow in capillaries, neuronal cell connectivity, translocation of dye through gap junctions, cell division and cell lysis and liposome fusion. In addition, these tracers can be used to track movement of labeled cells in culture, tissues or intact organisms. Many techniques employing fluorescent tracers to assay cell or subcellular moφhology or movement are known in the art and may involve use of membrane tracers, biotinylated dextran conjugators, fluorescent microspheres or proteins and protein conjugates (See Meth. Cell Biol. 29, 153 (1989); Cytometry 21. 230 (1995); Cell 84, 381 (1996); Biochem. Biophys. Acta 988, 319 (1989); Cytometry 14, 747 (1993). The various embodiments ofthe present invention have significant advantages when used in these types of assays. The present invention allows rapid imaging of multiple parameters with very fine spatial resolution.
NUCLEIC ACIDS
The present invention can also be used to conduct assays of nucleic acids. A specific DNA assay that would benefit from the spatial resolution and multi-wavelength imaging capability ofthe present invention is fluorescence-in-situ hybridization (FISH). FISH is an important technique for localizing and determining the relative abundance of specific nucleic acid sequences in cells, tissue, inteφhase nuclei and metaphase chromosomes and is used in clinical diagnostics and gene mapping (see Histo-chem J. 27, 4 (1995); Science 247, 64 (1990); Trends Genet. 9, 71 (1993) and Science 250, 559 (1990)). A variety of fluorescent hybridization probes are available for multicolor fluorescent DNA and RNA hybridization techniques (see Haugland R.P. Handbook of Fluorescent Probes and Research Chemicals, 6th Ed. Chap. 8.4). An additional technique determines chromosome banding by the use of an AT or GC selective DNA-dyes with a nucleic acid counter stain. This technique is widely used for karotype analysis and chromosome structure studies (see Human Genet. 57,1 (1981)).
REACTIVE OXYGEN SPECIES
The present invention can also be used to assay levels of various reactive oxygen species such as singlet oxygen, superoxides and nitric oxide. The importance of these reactive oxygen species has only recently been realized (See Biochem Pharmacol 47,373 (1994), J. Cell Biol. 126, 901 (1994)). It is now known that singlet oxygen is responsible for much ofthe physiological damage caused by reactive oxygen species (See J. Photochem. Photobiol. 11,241 (1991)). Nitric Oxide (NO), in particular, is now known to play a critical role as a molecular mediator in a variety of physiological processes including neurotransmission and blood-pressure regulation (See Current Biology 2,437 (1995), J. Med. Chem. 38,4343 (1995), Cell 78, 919 (1994)). Techniques are known in the art to perform assays to measure NO indirectly. For example, under physiological conditions, NO is oxidized to nitrite and this can be detected by monitoring absorbance at 548 nm or by use of a probe which reacts with nitrite to form an identifiable fluorescent product. (See Haugland R. P., Handbook of Fluorescent Probes and Research Chemicals 6th Ed. Chap. 21).
pH
The present invention can also be used to perform assays involving measurements of pH changes within cells or in cell-free media. The importance ofthe role of intracellular pH has been recognized in many diverse physiological and pathological processes including cell proliferation, apoptosis, fertilization, malignancy, multi-drug resistance, ion transport, lysosomal storage disorders and Alzheimer's disease. (See Cell Physiol. Biochem. 2, 159 (1992); J. Biol. Chem. 270, 6235 (1995); Biophys. J. 68, 739 (1995); J. Biol. Chem. 270, 19599 (1995); Cancer Res, 54, 5670 (1994)). Fluorescent probes useful for assays of pH in the physiological range are available commercially (See Haugland R.P., Handbook of Fluorescent Probes and Research Chemicals 6th Ed. Chap. 23).
EXAMPLES
The invention described and claimed herein can be further appreciated by one skilled in the art through reference to the examples which follow. These examples are provided merely to illustrate several aspects ofthe invention and shall not be construed to limit the invention in any way.
Transcription Factor Translocation Cells were grown in 96-well plates, fixed, incubated with Texas-Red-labeled antibody to the transcription factor protein, rinsed, and then stained with 5 μM Hoechst
33342 in buffer.
The images in Fig. 19 are 0.5 x 0.5 mm2 square with 1.08 x 1.08 μm2 pixelation. Texas Red emission was excited at 568 nm and detected with a 600-nm long pass filter. Hoechst emission was excited at 364 nm and detected with a 420-480-nm bandpass filter. Image acquisition time was 0.9 sec. There are -150 cells per image
Fig. 19 a) is an image of a field of cells which were not activated before fixing. The Texas Red intensity in the nucleus is low compared to the cytoplasm. Fig. 19 b) is the composite ofthe images in Fig. 19 a) and that due to the Hoechst 33342 emission. Fig. 19 c) is an image of a field of cells which were activated prior to fixing.
Due to color scaling, the cytoplasm is difficult to see without saturating the nucleus. Fig. 19 d) is the composite ofthe images in Fig. 19 c) and that due to the Hoechst 33342 emission from the same sample.
The data analysis was performed according to the following method. The area highlighted in Fig. 19 b) is reproduced in Fig. 20 which depicts the mask generation steps. A binary representation ofthe Hoechst image was generated by applying an appropriate threshold, those values greater than the threshold were set to one, those less than the threshold were set to zero. This served as the primary mask. Two daughter masks were then generated, one by eroding the primary mask, the other by dilating the primary mask and subtracting the original mask to form an annular mask. The Texas-Red-emission image was multiplied by the eroded binary mask, as depicted in Fig. 21, and the pixels summed as a measure ofthe quantity of labeled transcription factor in the nucleus. Similarly, the Texas- Red-emission image was multiplied by the annular binary mask, as depicted in Fig. 21 , and the pixels summed as a measure ofthe quantity of labeled transcription factor in the cytoplasm. The degree of activation is assessed using the ratio of nuclear to cytoplasmic intensity.
This ratio is represented in the bar graph in Fig. 28a for cells with and without activation.
Transient Ca Imaging of Muscarinic Receptor and Voltage-gated Channel Stimulation The cells in Figs. 22 and 23 were from a neuroblastoma line. They were grown and imaged in standard media. These cells express a muscarinic acetylcholine receptor that can be stimulated with Carbachol generating a large intra-cellular Ca release as a second signal. In addition the cells express a voltage-gated "L" Ca channel which can be stimulated by depolarizing the cell membrane with a large change in the external K+ concentration and which can be inhibited with Verapamil.
In general, the image sequences were initiated by rapidly adding 100 μL of reagent in growth media to cells in 100 μL of growth media in a 96-well plate. The turbulence caused by the added volume generates a small distortion in cell shape. This distortion is visible as a transient alteration ofthe Ca fluorescence assigned to each cell in the first image frame after addition.
In Fig. 22 a movie with 1.2 seconds between frames is displayed. The image sequence was initiated by the rapid addition of 100 μM Carbachol. The final image is a binary mask, used to identify and enumerate fluorescent objects in the image, generated from the pre-injection frame. Even though the pre-injection image appears dim, it is quite bright. The mask is applied to each image in the series, and for each object, the integrated intensity, normalized to the pre-injection image, is plotted vs. time, as displayed in Fig. 28b. The mask was not processed for overlapping cells. For example, object 1 is likely more than one cell, but showed no response. Object 7 may be 2 overlapping cells, with one showing a delayed response.
Fig. 23a-h are selected frames of a movie showing the response ofthe neuroblastoma cells to a depolarization event initiated by the addition of 50 mM KCl which opens the voltage-gated "L" channels. The analysis procedure was as is described above in connection to Fig. 28b. The results are displayed in Fig. 28c. Note the increased sensitivity obtained by using the "cell average" rather than the "image average".
10 Live-cell G-Protein Coupled Receptor Binding
The images displayed in Figs. 24a-c to 25a-c were obtained on live cells in 96-well plates. The cells had been transfected with a G-protein coupled receptor, for which the natural peptide ligand is known. Prior to imaging, the cells were incubated with the native unlabeled ligand in normal growth media containing 10% serum for 20 minutes at 15 37 °C, followed by 20 minutes with 20 nM fluorescein-labeled ligand and 100 nM LDS 751, also at 37 °C. Samples were not rinsed.
These images are (0.5 x 0.5) mm2 are with (1.08 x 1.08) μm2 pixelation. Fluorescein emission was excited at 488 nm and detected with a 45-nm bandpass filter centered at 535 nm. LDS 751 emission also excited at 488 nm and was detected with a 40- 20 nm bandpass filter, centered at 690 nm. Image acquisition time was 0.9 sec. These cells have -100,000 receptors/cell or about 25 receptors/μm2 of membrane surface.
Fig. 24a is an image ofthe cells after incubation with the labeled ligand. No wash step was preformed prior to imaging. The substantial variation in reception activity is evident. Some cells bind so little ligand that they appear as depressions in the background. 25 A cell-by-cell analysis ofthe binding activity is facilitated by making a mask from an image of LDS 751 emission, a non-specific nucleic acid stain, shown in Fig. 25b. The staining is not entirely uniform, but the vast majority of cell volume is revealed. The overlay in Fig. 25c ofthe binary mask generated from thresholding the data in Fig. 25b with the receptor binding image yields a pseudo-color map of receptor activity. High activity is represented 30 as yellow, while low activity is shown as orange-red.
In Fig. 25 three images are displayed corresponding to points on the titration curve ofthe 20-nM labeled ligand with the unlabeled ligand. The curve is displayed in Fig. 28d. A KL; = 3±1 x 1010 M for the unlabeled ligand is calculated.
Images illustrating receptor binding on a different mammalian cell line are 35 shown in Fig. 26a-d. Fig. 26a is an image ofthe cells incubated with a 256 nM Cy3-labeled ligand. A range of binding activity is visible. Fig. 26b shows an overlay ofthe Cy3 data with a simultaneously acquired image ofthe 1-μM Hoechst 33342 stained nuclei. The latter serves as a reliable identifier ofthe individual cells. In Fig. 26c, the image is ofthe cells incubated with 256 nM Cy3-labeled ligand in the presence of 10 μM unlabeled ligand, and in Fig. 26d, this data is displayed with the image ofthe 1-μM Hoechst 33342 stained nuclei overlaid. The effect of displaced fluid by unlabeled cells is evident in Fig. 26c. In the high correlation between Figs. 26c and d exemplifies the effectiveness of identifying cells by their excluded volume.
Simulated Bead-Based Receptor-Binding
In Fig. 27a-d images of Cy5-labeled silica beads are presented. The experiment is a simulation of a receptor-binding assay in which fluorescently-labeled ligands bind to membrane-bound receptors supported on microspheres.
Silica microspheres, 4 μm in diameter, were coated with polyethylenimine and biotinylated with a biotin NHS-ester. The activity ofthe beads was assayed with a fluorimeter by quantifying the amount of Cy5-labeled streptavidin removed from solution by adsoφtion onto a known quantity of beads. Each bead was found to hold 1.3 x 106 streptavidin molecules. Beads were loaded with a known quantity of Cy5 molecules by pre- mixing an appropriate ratio of Cy5-labeled and non-labeled streptavidin and incubating with the beads. The loadings were equivalent to 0.16, 1.6 and 16 fmole/200 μg of polystyrene beads. Each bead had an average of 17, 170, or 1700 labels, respectively. The samples were placed in Costar 96-well plates for imaging. Cy5 was excited with 647nm laser light and the emitted fluorescence was detected through a 40-nm bandpass filter centered at 690 nm. The scanned images were acquired at 1-μm pixelation in approximately 0.7 seconds.
Beads loaded with 170 and 1700 molecules were readily detectable and the 17-fluor beads are discernable in images constituting Fig. 27. Beads loaded only with non-labeled streptavidin did not produce appreciable intensities.

Claims

CLAIMSWe claim:
1. A confocal imaging system comprising: a) means for forming an elongated beam of electromagnetic radiation extending transverse to an optical axis along which the radiation propagates; b) a confocal imaging system for directing the elongated beam onto a first elongated region in a first plane where an object is located and for directing electromagnetic radiation emitted from the object onto a second elongated region in a second plane; c) in the second plane, or in a third plane conjugate to the second plane, a detection device having a rectangular array of detector elements on which the electromagnetic radiation is coincident; and d) means for scanning the elongated beam relative to the object so as to produce on the detector elements electromagnetic radiation from the scanned object, said electromagnetic radiation being converted by the detection device into an electrical signal representative ofthe electromagnetic radiation synchronously with said scanning.
2. The confocal imaging system of claim 1 further comprising: in the second plane, an elongated spatial filter having a long axis on which is coincident the second elongated region, and means for forming in the third plane an image ofthe second plane.
3. The confocal imaging system of claim 2 wherein the spatial filter has a variable width.
4. The confocal imaging system of claim 1 wherein the detection device comprises an m x n array of closely spaced detector elements where m is the number of detector elements in a first dimension ofthe array and n is the number of detector elements in a second dimension ofthe array and n is substantially greater than m.
5. The confocal imaging system of claim 4 wherein the second elongated region has a long axis and the detection device is aligned with the second elongated region so that the long axis extends in the same direction as the second dimension.
6. The confocal imaging system of claim 4 wherein at least some detector elements in individual columns extending in the first dimension ofthe array are binned together.
7. The confocal imaging system of claim 4 wherein a plurality of detector elements ofthe array are binned together.
8. The confocal imaging system of claim 4 wherein the detection device is a CCD array.
9. The confocal imaging system of claim 1 wherein the detection device is a rectangular format CCD array.
10. The confocal imaging system of claim 1 wherein the radiation emitted from the object is fluorescent radiation.
AMENDED CLAIMS
[received by the International Bureau on 23 August 1999 (23.08.99); Original claims 1-10 replaced by amended claims 1-66 (19 pages)]
1. A confocal imaging system comprising: a) a means for forming an elongated beam of electromagnetic radiation extending transverse to an optical axis along which the radiation propagates; b) a means for directing and focusing the elongated beam onto a first elongated region in a first plane where an object is located and for directing electromagnetic radiation emitted from the object onto one or more second elongated regions, wherein each second elongated region is on a different second plane conjugate to the first plane; c) in at least one ofthe second conjugate planes, or in a third plane conjugate to at least one ofthe second conjugate planes, a detection device comprising a rectangular array of detection elements on which the electromagnetic radiation emitted from the object is coincident; and d) a means for scanning the object by moving the elongated beam relative to the object or by moving the object relative to the elongated beam such that the emitted electromagnetic radiation is delivered to the rectangular array of detection elements and is converted by the detection device into a plurality of electrical signals representative ofthe emitted electromagnetic radiation synchronously with said scanning.
2. The confocal imaging system according to claim 1 further comprising: a) an elongated spatial filter having a long axis which is aligned with the second elongated region; and b) a means for forming, on the detection device, an image ofthe second conjugate plane. 3 The confocal imaging system according to claim 1, wherein the elongated beam of electromagnetic radiation directed onto the object comprises two or more wavelengths
4 The confocal imaging system according to claim 2, wherein the spatial filter has a variable width
5. The confocal imaging system according to claim 1, wherein the detection device comprises an m x n array of detector elements wherein m is the number of detector elements in a first dimension ofthe array and n is the number of detector elements in a second dimension ofthe array and n is greater than m.
6 The confocal imaging system according to claim 5, wherein the elongated region on which the emitted electromagnetic radiation is directed has a long axis that is aligned with the array ofthe detection device, so that the long axis extends in the same direction as the second dimension.
7. The confocal imaging system according to claim 5, wherein at least two detector elements forming a column extending in the first dimension ofthe array are binned together.
8. The confocal imaging system according to claim 5, wherein a plurality of detector elements ofthe array are binned together.
9. The confocal imaging system according to claim 5, wherein the detection device is a CCD array.
10. The confocal imaging system according to claim 1, wherein the detection device is a rectangular format CCD array.
1 1. The confocal imaging system according to claim 1, wherein the radiation emitted from the object is fluorescent radiation
12. The confocal imaging system according to claim 1, wherein the object is located on a discontinuous surface of a substrate that has a continuous surface extending in the same direction as the discontinuous surface, said system further comprising a focus system comprising: a) a first focusing beam of electromagnetic radiation having a first wavelength, said first beam being directed through the objective lens to the discontinuous surface and reflected by said discontinuous surface back through the objective lens; b) a second focusing beam of electromagnetic radiation having a second wavelength, said second beam being directed through the objective lens to the continuous surface and reflected by said continuous surface back through the objective lens; c) a means for separating the radiation ofthe first wavelength from the radiation ofthe second wavelength that is reflected back through the objective lens; d) a first detector for detecting the first focusing beam reflected by the discontinuous surface back through the objective lens; e) a second detector for detecting the second focusing beam reflected by the continuous surface back through the objective lens; f) a moving means for moving the objective lens relative to the substrate or the substrate relative to the objective lens; and g) a controller connected to the first and second detectors and the moving means, wherein the controller operates the moving means in response to a signal from the first detector or the second detector according to the position ofthe first focusing beam or the second focusing beam on the substrate.
13. The confocal image system according to claim 1, wherein the scanning means comprises a rotating optical element for moving the elongated beam across the object.
14. The confocal image system according to claim 1, wherein the scanning means comprises a movable stage on which the object is located.
15. The confocal image system according to claim 1 further comprising a means for dispensing a reagent into the first plane where the object is located.
16. The confocal image system according to claim 1 further comprising a means for controlling the temperature ofthe object.
17. The confocal imaging system according to claim 2, wherein the elongated beam ofthe electromagnetic radiation directed onto the object comprises one or more wavelengths and wherein the second plane is singular.
18. The confocal imaging system according to any one of claims 1, 3 or
17 wherein two or more wavelengths of electromagnetic radiation are emitted from the object in the first elongated region in the first plane, said system further comprising a means for separating the emitted wavelengths to detect at least one of the separated wavelengths by one or more detection devices.
19. The confocal imaging system according to claim 1, wherein the object is located on a discontinuous surface of a substrate comprising a continuous surface extending in the same direction as the discontinuous surface, said system further comprising a focusing system comprising: a) a focusing beam of electromagnetic radiation directed through the objective lens to the discontinuous surface and reflected by said discontinuous surface back through the objective lens; b) a focus detector for detecting the focusing beam reflected by the discontinuous surface back through the objective lens; c) a moving means for moving the objective lens relative to the substrate or the substrate relative to the objective lens; and d) a controller connected to the focus detector and the moving means, wherein the controller adjusts the moving means in response to a signal from the focus detector according to the position ofthe focusing beam on the substrate.
20. The confocal imaging system according to claim 12, wherein the first and second wavelengths are the same.
21 The confocal imaging system according to claim 12 or 19, wherein the controller comprises a computer.
22. The confocal imaging system according to claim 12 or 19, wherein the substrate is a microtiter plate and the discontinuous surface is a bottom of a well in the microtiter plate.
23. The confocal imaging system according to claim 18, wherein the object is located on a discontinuous surface of a substrate comprising a continuous surface extending in the same direction as the discontinuous surface and wherein two or more wavelengths of electromagnetic radiation are emitted from the object, said system further comprising a focus system comprising: a) a first focusing beam of electromagnetic radiation having a first wavelength, said first beam being directed through the objective lens to the discontinuous surface and reflected by said discontinuous surface back through the objective lens; b) a second focusing beam of electromagnetic radiation having a second wavelength, said second beam being directed through the objective lens to the continuous surface and reflected by said continuous surface back through the objective lens; c) a means for separating the radiation ofthe first wavelength from the radiation ofthe second wavelength that is reflected back through the objective lens; d) a first detector for detecting the first focusing beam reflected by the discontinuous surface back through the objective lens; e) a second detector for detecting the second focusing beam reflected by the continuous surface back through the objective lens; f) a moving means for moving the objective lens relative to the substrate or the substrate relative to the objective lens; and g) a controller connected to the first and second detectors and the moving means, wherein the controller operates the moving means in response to a signal from the first detector or the second detector according to the position ofthe first focusing beam or the second focusing beam on the substrate.
24. The confocal imaging system according to claim 18, wherein the object is located on a discontinuous surface of a substrate comprising a continuous surface extending in the same direction as the discontinuous surface and wherein two or more wavelengths of electromagnetic radiation are emitted from the object, said system further comprising a focusing system comprising: a) a focusing beam of electromagnetic radiation directed through the objective lens to the discontinuous surface and reflected by said discontinuous surface back through the objective lens; b) a focus detector for detecting the focusing beam reflected by the discontinuous surface back through the objective lens; c) a moving means for moving the objective lens relative to the substrate or the substrate relative to the objective lens; and d) a controller connected to the focus detector and the moving means, wherein the controller adjusts the moving means in response to a signal from the focus detector according to the position ofthe focusing beam on the substrate.
25. A focusing system for use with a substrate comprising a discontinuous surface and a continuous surface extending in the same direction as the discontinuous surface, said system comprising. a) an objective lens through which is directed a first beam of electromagnetic radiation that is to be focused on the discontinuous surface or on an object located on the discontinuous surface; b) a second beam of electromagnetic radiation having a first wavelength, said second beam being directed through said objective lens to a focus on the discontinuous surface and reflected by said discontinuous surface back through the objective lens; c) a third beam of electromagnetic radiation having a second wavelength, said third beam being directed through said objective lens to a focus on the continuous surface and reflected by said continuous surface back through the objective lens; d) a means for separating the radiation ofthe first wavelength from the radiation ofthe second wavelength that is reflected back through the objective lens; e) a first detector for detecting the second beam reflected by the discontinuous surface back through the objective lens; f) a second detector for detecting the third beam reflected by the continuous surface back through the objective lens; g) a moving means for moving the objective lens relative to the substrate or the substrate relative to the objective lens so as to control the focus ofthe beams reflected back through the objective lens; and h) a controller connected to the first and second detectors and the moving means, wherein the controller operates the moving means in response to a signal from the first detector or the second detector according to the position ofthe first focusing beam or the second focusing beam on the substrate.
26. A focusing system for use with a substrate comprising a discontinuous surface and a continuous surface extending in the same direction as the discontinuous surface, said system comprising: a) an objective lens through which is directed a first beam of electromagnetic radiation that is to be focused on the discontinuous surface or on an object located on the discontinuous surface; b) a focusing beam of electromagnetic radiation directed through the objective lens to the discontinuous surface and reflected by said discontinuous surface back through the objective lens; c) a focus detector for detecting the focusing beam reflected by the discontinuous surface back through the objective lens; d) a moving means for moving the objective lens relative to the substrate or the substrate relative to the objective lens so as to control the focus ofthe focusing beam reflected back through the objective lens; and e) a controller connected to the focus detector and the moving means, wherein the controller operates the moving means in response to a signal from the focus detector according to the position ofthe focusing beam on the substrate.
27. The focusing system according to claim 25, wherein the first and second wavelengths are the same.
28. The focusing system according to claim 25 or 26, wherein the controller comprises a computer.
29. The focusing system according to claim 25 or 26, wherein the substrate is a microtiter plate and the discontinuous surface is a bottom of a well in the microtiter plate.
30 A method for monitoring a biological assay comprising the step of measuring electromagnetic radiation emitted from an object in the biological assay using a confocal imaging system according to claim 1
31 A method for monitoring a biological assay comprising the step of measuring electromagnetic radiation emitted from an object in the biological assay using a microscope with a focusing system according to claim 25 or 26.
32 A method for monitoring a biological assay comprising the step of measuring electromagnetic radiation emitted from an object in the biological assay using a confocal imaging system according to claim 12 or 19.
33 The method according to claim 30, wherein the biological assay is a transfection efficiency assay, an infection assay, a FRET assay, protein translocation assay, a protein localization assay, an ion localization assay, pH differential assay, a cellular movement assay, an organelle movement assay, a moφhology assay, a chemical compound screening assay, a ligand-protein binding assay, a protein-protein binding assay, a nucleic acid assay, an assay for reactive oxygen species, an enzyme activity assay, or a kinetic assay.
34 The method according to claim 31, wherein the biological assay is a transfection efficiency assay, an infection assay, a FRET assay, protein translocation assay, a protein localization assay, an ion localization assay, pH differential assay, a cellular movement assay, an organelle movement assay, a moφhology assay, a chemical compound screening assay, a ligand-protein binding assay, a protein-protein binding assay, a nucleic acid assay, an assay for reactive oxygen species, an enzyme activity assay, or a kinetic assay.
35 The method according to claim 32, wherein the biological assay is a transfection efficiency assay, an infection assay, a FRET assay, protein translocation assay, a protein localization assay, an ion localization assay, pH differential assay, a cellular movement assay, an organelle movement assay, a moφhology assay, a chemical compound screening assay, a ligand-protein binding assay, a protein-protein binding assay, a nucleic acid assay, an assay for reactive oxygen species, an enzyme activity assay, or a kinetic assay.
36. A method for examining an object comprising the steps of: a) measuring electromagnetic radiation emitted from the object using a confocal imaging system according to claim 1, and b) grouping a plurality ofthe electrical signals produced by the detection device, using a process which comprises: receiving the plurality of signals; comparing the plurality of signals to a threshold; creating a set of reduced data values corresponding to the plurality of signals based upon the comparing ofthe plurality of signals to the threshold; and grouping the set of reduced data values into at least two groups based upon a spatial relationship of a portion ofthe plurality of regions of the object corresponding to the set of reduced data values.
37. A method for examining an object comprising the steps of: a) measuring electromagnetic radiation emitted from the object using a microscope with the focusing system according to claim 25 or 26, wherein electromagnetic radiation emitted from the object is delivered to a detection device and converted into a plurality of electrical signals; and b) grouping a plurality ofthe electrical signals produced by the detection device, using a process which comprises: receiving the plurality of signals; comparing the plurality of signals to a threshold; creating a set of reduced data values corresponding to the plurality of signals based upon the comparing ofthe plurality of signals to the threshold; and grouping the set of reduced data values into at least two groups based upon a spatial relationship of a portion ofthe plurality of regions of the object corresponding to the set of reduced data values.
38. A method of examining an object comprising the steps of: a) forming an elongated beam of electromagnetic radiation extending transverse to an optical axis along which the radiation propagates; b) directing and focusing the elongated beam onto a first elongated region in a first plane where the object is located and directing electromagnetic radiation emitted from the object onto one or more second elongated regions, wherein each second elongated region is on a different second plane conjugate to the first plane; c) placing in at least one ofthe second conjugate planes, or in a third plane conjugate to at least one ofthe second conjugate planes, a detection device comprising a rectangular array of detection elements on which the electromagnetic radiation emitted from the object is coincident; and d) scanning the object by moving the elongated beam relative to the object or by moving the object relative to the elongated beam such that the emitted electromagnetic radiation is delivered to the rectangular array of detection elements and is converted by the detection device into a plurality of electrical signals representative ofthe emitted electromagnetic radiation synchronously with said scanning.
39. The method of examining an object according to claim 38 further comprising the steps of: a) spatially filtering the emitted electromagnetic radiation with an elongated spatial filter having a long axis which is aligned with the second elongated region; and b) forming, on the detection device, an image ofthe second conjugate plane.
40 The method of examining an object according to claim 38, wherein two or more wavelengths of electromagnetic radiation are directed onto the object.
41 The method of examining an object according to claim 39, wherein the spatial filter has a variable width
42 The method of examining an object according to claim 38, wherein the detection device comprises an m x n array of detector elements, wherein m is the number of detector elements in a first dimension ofthe array and n is the number of detector elements in a second dimension ofthe array and n is greater than m
43 The method of examining an object according to claim 42, wherein the elongated region on which the emitted electromagnetic radiation is directed has a long axis that is aligned with the array ofthe detection device, so that the long axis extends in the same direction as the second dimension.
44 The method of examining an object according to claim 42, wherein at least two detector elements forming a column extending in the first dimension of the array are binned together.
45 The method of examining an object according claim 42, wherein a plurality of detector elements ofthe array are binned together.
46 The method of examining an object according claim 42, wherein the detection device is a CCD array
47 The method of examining an object according to claim 38, wherein the detection device is a rectangular format CCD array.
48 The method of examining an object according claim 38, wherein the radiation emitted from the object is fluorescent radiation
49. The method of examining an object according to claim 38, wherein the object is located on a discontinuous surface of a substrate that has a continuous surface extending in the same direction as the discontinuous surface, said method further comprising a method of focusing comprising the steps of: a) directing a first focusing beam of electromagnetic radiation having a first wavelength through the objective lens to the discontinuous surface such that the first focusing beam is reflected by said discontinuous surface back through the objective lens; b) directing a second focusing beam of electromagnetic radiation having a second wavelength through the objective lens to the continuous surface such that the second focusing beam is reflected by said continuous surface back through the objective lens; c) separating the radiation ofthe first wavelength from the radiation ofthe second wavelength that is reflected back through the objective lens; d) detecting the first focusing beam reflected by the discontinuous surface back through the objective lens with a first detector; e) detecting the second focusing beam reflected by the continuous surface back through the objective lens with a second detector; and f) moving the objective lens relative to the substrate or the substrate relative to the objective lens in response to a signal from the first or second detector according to the position of the first focusing beam or the second focusing beam on the substrate.
50. The method of examining an object according to claim 38 further comprising the step of dispensing a reagent into the first plane where the object is located.
51. The method of examining an object according to claim 38 further comprising the step of controlling the temperature ofthe object.
52. The method of examining an object according to claim 39, wherein two or more wavelengths of electromagnetic radiation are directed onto the object and wherein the second plane is singular.
53. The method of examining an object according to any one of claims 38, 40 or 52 wherein two or more wavelengths of electromagnetic radiation are emitted from the object in the first elongated region in the first plane, said method further comprising the steps of: a) separating the emitted wavelengths; and b) detecting at least one ofthe separated wavelengths by one or more detection devices.
54. The method of examining an object according to claim 38, wherein the object is located on a discontinuous surface of a substrate comprising a continuous surface extending in the same direction as the discontinuous surface, said method further comprising a method of focusing comprising the steps of: a) directing a focusing beam of electromagnetic radiation through the objective lens to the discontinuous surface such that it is reflected by said discontinuous surface back through the objective lens; b) detecting the focusing beam reflected by the discontinuous surface back through the objective lens with a focus detector; and c) moving the objective lens relative to the substrate or the substrate relative to the objective lens in response to a signal from the focus detector according to the position ofthe focusing beam on the substrate.
55. The method of examining an object according to claim 49, wherein the first and second wavelengths are the same.
56. The method of examining an object according to claim 53, wherein the object is located on a discontinuous surface of a substrate comprising a continuous surface extending in the same direction as the discontinuous surface and wherein two or more wavelengths of electromagnetic radiation are emitted from the object, said method further comprising a method of focusing comprising the steps of: a) directing a first focusing beam of electromagnetic radiation, having a first wavelength, through the objective lens to the discontinuous surface such that it is reflected by said discontinuous surface back through the objective lens; b) directing a second focusing beam of electromagnetic radiation, having a second wavelength, through the objective lens to the continuous surface such that it is reflected by said continuous surface back through the objective lens; c) separating the radiation ofthe first wavelength from the radiation ofthe second wavelength that is reflected back through the objective lens; d) detecting the first focusing beam reflected by the discontinuous surface back through the objective lens with a first detector; e) detecting the second focusing beam reflected by the continuous surface back through the objective lens with a second detector; and f) moving the objective lens relative to the substrate or the substrate relative to the objective lens in response to a signal from the first detector or the second detector according to the position ofthe first focusing beam or the second focusing beam on the substrate.
57. The method of examining an object according to claim 53, wherein the object is located on a discontinuous surface of a substrate comprising a continuous surface extending in the same direction as the discontinuous surface and wherein two or more wavelengths of electromagnetic radiation are emitted from the object, said method further comprising a method of focusing comprising the steps of a) directing a focusing beam of electromagnetic radiation through the objective lens to the discontinuous surface such that it is reflected by said discontinuous surface back through the objective lens; b) detecting the focusing beam reflected by the discontinuous surface back through the objective lens with a focus detector; and c) moving the objective lens relative to the substrate or the substrate relative to the objective lens in response to a signal from the focus detector according to the position ofthe focusing beam on the substrate.
58. A method of focusing for use with a substrate comprising a discontinuous surface and a continuous surface extending in the same direction as the discontinuous surface, said method comprising the steps of: a) directing a first beam of electromagnetic radiation through an objective lens to be focused on the discontinuous surface or on an object located on the discontinuous surface; b) directing a second beam of electromagnetic radiation, having a first wavelength, through the objective lens to be focused on the discontinuous surface and reflected by said discontinuous surface back through the objective lens; c) directing a third beam of electromagnetic radiation, having a second wavelength, through the objective lens to be focused on the continuous surface and reflected by said continuous surface back through the objective lens; d) separating the radiation ofthe first wavelength from the radiation ofthe second wavelength that is reflected back through the objective lens; e) detecting the second beam reflected by the discontinuous surface back through the objective lens with a first detector, f) detecting the third beam reflected by the continuous surface back through the objective lens with a second detector, and g) moving the objective lens relative to the substrate or the substrate relative to the objective lens in response to a signal from the first detector or the second detector according to the position ofthe first focusing beam or the second focusing beam on the substrate so as to control the focus ofthe beams reflected back through the objective lens
59 A method of focusing for use with a substrate comprising a discontinuous surface and a continuous surface extending in the same direction as the discontinuous surface, said method comprising the steps of a) directing a first beam of electromagnetic radiation through an objective lens to be focused on the discontinuous surface or on an object located on the discontinuous surface, b) directing a focusing beam of electromagnetic radiation through the objective lens to the discontinuous surface such that it is reflected by said discontinuous surface back through the objective lens, c) detecting the focusing beam reflected by the discontinuous surface back through the objective lens with a focus detector, and d) moving the objective lens relative to the substrate or the substrate relative to the objective lens in response to a signal from the focus detector according to the position ofthe focusing beam on the substrate so as to control the focus of the focusing beam reflected back through the objective lens
60 The method of focusing according to claim 58, wherein the first and second wavelengths are the same
61. A method for examining an object according to claim 38 further comprising the step of grouping a plurality ofthe electrical signals produced by the detection device, using a process which comprises: a) receiving the plurality of signals; b) comparing the plurality of signals to a threshold; c) creating a set of reduced data values corresponding to the plurality of signals based upon the comparing ofthe plurality of signals to the threshold; and d) grouping the set of reduced data values into at least two groups based upon a spatial relationship of a portion ofthe plurality of regions ofthe object corresponding to the set of reduced data values.
62. A method for examining an object comprising the steps of: a) using a method of focusing according to claims 58 or 59; b) measuring electromagnetic radiation emitted from the object by delivering the emitted radiation to a detection device where it is converted into a plurality of electrical signals; c) grouping the plurality ofthe electrical signals produced by the detection device, using a process which comprises: receiving the plurality of signals; comparing the plurality of signals to a threshold; creating a set of reduced data values corresponding to the plurality of signals based upon the comparing ofthe plurality of signals to the threshold; and grouping the set of reduced data values into at least two groups based upon a spatial relationship of a portion ofthe plurality of regions ofthe object corresponding to the set of reduced data values.
63. A method of examining an object according to claims 38, 49 or 54 wherein the object is in a biological assay. 64 A method for monitoring a biological assay comprising the step of using a method of focusing according to claims 58 or 59.
65 The method according to claim 63, wherein the biological assay is a transfection efficiency assay, an infection assay, a FRET assay, protein translocation assay, a protein localization assay, an ion localization assay, pH differential assay, a cellular movement assay, an organelle movement assay, a moφhology assay, a chemical compound screening assay, a ligand-protein binding assay, a protein-protein binding assay, a nucleic acid assay, an assay for reactive oxygen species, an enzyme activity assay, or a kinetic assay.
66 The method according to claim 64, wherein the biological assay is a transfection efficiency assay, an infection assay, a FRET assay, protein translocation assay, a protein localization assay, an ion localization assay, pH differential assay, a cellular movement assay, an organelle movement assay, a moφhology assay, a chemical compound screening assay, a ligand-protein binding assay, a protein-protein binding assay, a nucleic acid assay, an assay for reactive oxygen species, an enzyme activity assay, or a kinetic assay.
PCT/US1999/005589 1998-03-16 1999-03-16 Confocal microscopy imaging system WO1999047963A1 (en)

Priority Applications (13)

Application Number Priority Date Filing Date Title
EP99914908A EP1064579A4 (en) 1998-03-16 1999-03-16 Confocal microscopy imaging system
IL13849699A IL138496A0 (en) 1998-03-16 1999-03-16 Confocal microscopy imaging system
JP2000537103A JP4812937B2 (en) 1998-03-16 1999-03-16 Confocal microscope imaging system
AU33547/99A AU758571B2 (en) 1998-03-16 1999-03-16 Confocal microscopy imaging system
BRPI9908767-7A BR9908767B1 (en) 1998-03-16 1999-03-16 confocal imaging system, focusing system for use with a substrate, and processes for examining an object, and focusing for use with a substrate.
CA2324262A CA2324262C (en) 1998-03-16 1999-03-16 Confocal microscopy imaging system
US09/333,749 US6388788B1 (en) 1998-03-16 1999-06-15 Method and apparatus for screening chemical compounds
NO20004601A NO20004601L (en) 1998-03-16 2000-09-15 A system for confocal microscopy imaging
US09/724,253 US6400487B1 (en) 1998-03-16 2000-11-28 Method and apparatus for screening chemical compounds
US10/227,552 US20030036855A1 (en) 1998-03-16 2002-08-16 Method and apparatus for screening chemical compounds
IL16431904A IL164319A0 (en) 1998-03-16 2004-09-28 Confocal microscopy imaging system
US12/028,345 US7957911B2 (en) 1998-03-16 2008-02-08 Method and apparatus for screening chemical compounds
US13/150,532 US20110255756A1 (en) 1998-03-16 2011-06-01 Method and apparatus for screening chemical compounds

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US4252798A 1998-03-16 1998-03-16
US09/042,527 1998-03-16

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US4252798A Continuation-In-Part 1998-03-16 1998-03-16

Related Child Applications (2)

Application Number Title Priority Date Filing Date
US4252798A Continuation 1998-03-16 1998-03-16
US30033599A Continuation 1998-03-16 1999-04-27

Publications (3)

Publication Number Publication Date
WO1999047963A1 true WO1999047963A1 (en) 1999-09-23
WO1999047963A8 WO1999047963A8 (en) 1999-11-18
WO1999047963A9 WO1999047963A9 (en) 1999-12-23

Family

ID=21922413

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1999/005589 WO1999047963A1 (en) 1998-03-16 1999-03-16 Confocal microscopy imaging system

Country Status (10)

Country Link
EP (1) EP1064579A4 (en)
JP (1) JP4812937B2 (en)
KR (2) KR100618502B1 (en)
CN (1) CN100380160C (en)
AU (1) AU758571B2 (en)
BR (1) BR9908767B1 (en)
CA (1) CA2324262C (en)
IL (2) IL138496A0 (en)
NO (1) NO20004601L (en)
WO (1) WO1999047963A1 (en)

Cited By (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1002233A1 (en) * 1997-06-03 2000-05-24 Pharmacopeia, Inc. High-throughput assay
GB2338568B (en) * 1998-06-19 2000-12-20 Optiscan Pty Ltd Two photon endoscope or microscope method and apparatus
WO2002035474A1 (en) * 2000-10-27 2002-05-02 Praelux Incorporated Method and apparatus for screening chemical compounds
DE10117723A1 (en) * 2001-04-09 2002-10-17 Evotec Ag Carrier for biological or synthetic samples has a sample holding plate with reservoirs and a dosing plate with projections, fitted with membranes, of an optically transparent material with trouble-free light beam transparency
DE10122607A1 (en) * 2001-05-10 2002-12-05 Leica Microsystems Direct Fourier imaging of specimens involves point- and line-wise illumination of specimen and point- and line-wise detection of light in light path defined by detector and optical arrangement
WO2003044495A2 (en) * 2001-11-23 2003-05-30 Evotec Oai Ag Method and device for correcting the size and/or shape of a measuring volume in a chemical and/or biological sample
JP2003177131A (en) * 2001-12-11 2003-06-27 Olympus Optical Co Ltd Method for detecting biological bonding affinity
WO2003095995A1 (en) * 2002-05-14 2003-11-20 Amersham Biosciences Uk Limited Method for assessing biofilms
WO2003098210A1 (en) * 2002-05-15 2003-11-27 Amersham Biosciences Uk Limited Method for the determination of changes in a cellular morphological parameter
JP2004530111A (en) * 2001-02-09 2004-09-30 コミツサリア タ レネルジー アトミーク Continuous sample observation device by fluorescence
EP1742036A1 (en) * 2005-07-04 2007-01-10 WEISS UMWELTTECHNIK GmbH System for testing pharmaceutical substances
WO2007062039A2 (en) 2005-11-23 2007-05-31 Illumina, Inc. Confocal imaging methods and apparatus
WO2008078083A1 (en) * 2006-12-22 2008-07-03 Isis Innovation Limited Focusing apparatus and method
AU2002311827B2 (en) * 2001-04-20 2008-08-14 Yale University Systems and methods for automated analysis of cells and tissues
US7709222B2 (en) 2006-07-13 2010-05-04 Yale University Methods for making cancer prognoses based on subcellular localization of biomarkers
US7957911B2 (en) 1998-03-16 2011-06-07 Ge Healthcare Bio-Sciences Corp. Method and apparatus for screening chemical compounds
JP4776854B2 (en) * 2000-02-10 2011-09-21 オリンパス株式会社 Method for characterizing a sample having fluorescent particles
US8367351B2 (en) 2006-05-05 2013-02-05 Historx, Inc. Methods for determining signal transduction activity in tumors
US8471220B2 (en) 2010-03-01 2013-06-25 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis
US8681332B2 (en) 2010-10-13 2014-03-25 Olympus Corporation Method of measuring a diffusion characteristic value of a particle
US8680485B2 (en) 2010-09-21 2014-03-25 Olympus Corporation Optical analysis method using the detection of a single light-emitting particle
US8785886B2 (en) 2010-09-10 2014-07-22 Olympus Corporation Optical analysis method using the light intensity of a single light-emitting particle
US8803106B2 (en) 2010-10-19 2014-08-12 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis for observing polarization characteristics of a single light-emitting particle
US8900812B2 (en) 2011-01-26 2014-12-02 Olympus Corporation Method for identifying polymorphism of nucleic acid molecules
US8911944B2 (en) 2011-01-26 2014-12-16 Olympus Corporation Method for identifying polymorphism of nucleic acid molecules
US8958066B2 (en) 2010-09-10 2015-02-17 Olympus Corporation Optical analysis method using measurement of light of two or more wavelength bands
US9068944B2 (en) 2011-04-13 2015-06-30 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9103718B2 (en) 2010-11-25 2015-08-11 Olympus Corporation Optical analysis device and optical analysis method using a wavelength characteristic of light of a single light-emitting particle
US9116127B2 (en) 2011-04-18 2015-08-25 Olympus Corporation Quantitative determination method for target particles, photometric analysis device, and computer program for photometric analysis
US9188535B2 (en) 2012-04-18 2015-11-17 Olympus Corporation Single particle detection device, single particle detection method, and computer program for single particle detection, using optical analysis
US9329117B2 (en) 2011-11-10 2016-05-03 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9354176B2 (en) 2011-08-11 2016-05-31 Olympus Corporation Method for detecting a target particle
US9395357B2 (en) 2010-07-26 2016-07-19 Olympus Corporation Method of detecting sparse particles in a solution using a light-emitting probe
US9423349B2 (en) 2011-08-15 2016-08-23 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9428796B2 (en) 2012-02-22 2016-08-30 Olympus Corporation Method for detecting a target particle
US9435727B2 (en) 2011-03-29 2016-09-06 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9488578B2 (en) 2011-08-26 2016-11-08 Olympus Corporation Single particle detection device, single particle detection method, and computer program for single particle detection, using optical analysis
US9494779B2 (en) 2012-02-17 2016-11-15 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single particle detection
US9528923B2 (en) 2011-08-30 2016-12-27 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9575060B2 (en) 2012-04-18 2017-02-21 Olympus Corporation Method for detecting a target particle
US9739698B2 (en) 2013-10-07 2017-08-22 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9771612B2 (en) 2012-03-21 2017-09-26 Olympus Corporation Method for detecting a target nucleic acid molecule
US9841418B2 (en) 2011-08-30 2017-12-12 Olympus Corporation Method for detecting target particle
US9863806B2 (en) 2011-01-20 2018-01-09 Olympus Corporation Optical analysis method and optical analysis device using the detection of light from a single light-emitting particle
US10310245B2 (en) 2013-07-31 2019-06-04 Olympus Corporation Optical microscope device, microscopic observation method and computer program for microscopic observation using single light-emitting particle detection technique
US10371631B2 (en) 2011-08-26 2019-08-06 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US10677734B2 (en) 2014-09-05 2020-06-09 Thermo Fisher Scientific Oy Method and apparatus for optical measurement of liquid sample
US11016026B2 (en) 2015-12-09 2021-05-25 Olympus Corporation Optical analysis method and optical analysis device using single light-emitting particle detection
WO2021152562A1 (en) * 2020-01-31 2021-08-05 Stellenbosch University Method for determining mitochondrial events
US11714271B2 (en) 2020-09-14 2023-08-01 Singular Genomics Systems, Inc. Methods and systems for multidimensional imaging

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6982166B2 (en) * 2002-05-16 2006-01-03 Applera Corporation Lens assembly for biological testing
US9157860B2 (en) 2002-05-16 2015-10-13 Applied Biosystems, Llc Achromatic lens array
DE102004014048B4 (en) * 2004-03-19 2008-10-30 Sirona Dental Systems Gmbh Measuring device and method according to the basic principle of confocal microscopy
US7170675B2 (en) 2004-05-19 2007-01-30 Celloptic, Inc. Method and system for wide-field multi-photon microscopy having a confocal excitation plane
DE102004034970A1 (en) * 2004-07-16 2006-02-02 Carl Zeiss Jena Gmbh Scanning microscope and use
CN101031837B (en) * 2004-07-23 2011-06-15 通用电气医疗集团尼亚加拉有限公司 Method and apparatus for fluorescent confocal microscopy
CN1310023C (en) * 2004-11-10 2007-04-11 哈尔滨工业大学 Three-differential focasing micro-three-dimensional super-resolution imaging method
GB0427050D0 (en) * 2004-12-10 2005-01-12 Amersham Biosciences Uk Ltd Method of,and apparatus and computer software for,imaging biological objects
KR100737170B1 (en) * 2006-01-20 2007-07-10 경북대학교 산학협력단 Portable quantum dot flurescent detector
US7567346B2 (en) * 2006-03-01 2009-07-28 General Electric Company System and method for multimode imaging
US7838302B2 (en) 2006-08-07 2010-11-23 President And Fellows Of Harvard College Sub-diffraction limit image resolution and other imaging techniques
JP4957458B2 (en) * 2007-08-27 2012-06-20 株式会社Jvcケンウッド Voice coil and speaker
US20100208340A1 (en) * 2007-10-11 2010-08-19 Nikon Corporation Observation device
EP4060327A1 (en) 2007-12-21 2022-09-21 President and Fellows of Harvard College Sub-diffraction limit image resolution in three dimensions
WO2009115108A1 (en) * 2008-03-19 2009-09-24 Ruprecht-Karls-Universität Heidelberg A method and an apparatus for localization of single dye molecules in the fluorescent microscopy
KR101532611B1 (en) * 2009-04-28 2015-07-01 삼성전자주식회사 Apparatus and method for processing digital image expressing zooming shot effect
US8692708B2 (en) * 2010-03-30 2014-04-08 Sony Corporation Radiometric imaging device and corresponding method
US8767069B2 (en) * 2010-06-30 2014-07-01 Luminex Corporation Apparatus, system, and method for increasing measurement accuracy in a particle imaging device using light distribution
JP5737704B2 (en) * 2010-09-27 2015-06-17 株式会社ライフテック Fluorescent single particle detection method and detection system
US9477072B2 (en) * 2011-03-01 2016-10-25 Ge Healthcare Bio-Sciences Corp. Systems and methods for illumination phase control in fluorescence microscopy
WO2013035009A1 (en) * 2011-09-06 2013-03-14 Koninklijke Philips Electronics N.V. Optical biosensor with a plurality of sensors regions
DE102011087196A1 (en) * 2011-11-28 2013-05-29 Leica Microsystems Cms Gmbh Microscope illumination system and method
CH706326A2 (en) * 2012-03-14 2013-09-30 Tecan Trading Ag Procedures and microplate readers for study of biological cells or cell cultures.
CN102841083B (en) * 2012-06-11 2014-08-20 北京大学 Method and system of laser scanning phase-microscope imaging
US8654352B1 (en) * 2012-08-08 2014-02-18 Asm Technology Singapore Pte Ltd Chromatic confocal scanning apparatus
CN104155279B (en) * 2013-05-13 2017-04-26 中国科学院大连化学物理研究所 Linear confocal ultraviolet Raman spectrometer
CN104296684B (en) * 2014-11-05 2016-11-30 哈尔滨工业大学 Film thickness error bearing calibration based on surface coating confocal microscopy topography measurement device
GB2534402A (en) * 2015-01-22 2016-07-27 Idea Biomedical Ltd Auto-focussing method and device
CN104677884B (en) * 2015-03-17 2017-07-11 北京理工大学 High-space resolution laser light splitting pupil differential confocal mass spectrum micro imaging method and device
CN104697452A (en) * 2015-03-24 2015-06-10 宁波高新区零零七工业设计有限公司 Laser imaging system
US9599807B2 (en) * 2015-06-30 2017-03-21 General Electric Company Optical microscope and method for detecting lens immersion
LU93022B1 (en) * 2016-04-08 2017-11-08 Leica Microsystems Method and microscope for examining a sample
CN108061964B (en) * 2017-10-25 2020-03-27 中国科学技术大学 High-speed three-dimensional microscopic imaging device and method for large sample
CN108319008B (en) * 2018-02-02 2019-11-12 华中科技大学 A kind of optical microscope imaging method and device
CN108680542B (en) * 2018-03-26 2020-01-10 华中科技大学 Array type line scanning fluorescence microscopic imaging device
CN108445619A (en) * 2018-05-11 2018-08-24 中国工程物理研究院流体物理研究所 Optical scanning system and method
CN111239047B (en) * 2020-03-09 2023-10-27 深圳中科飞测科技股份有限公司 Optical device and method for realizing automatic focusing
KR102447224B1 (en) * 2020-10-26 2022-09-27 한국생산기술연구원 apparatus for qualitative and quantitative analysis of fine particles
CN114813706B (en) * 2022-06-29 2022-12-13 国科大杭州高等研究院 Blood cell hyperspectral optical tweezers capture energy resonance transfer analyzer

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5760901A (en) * 1997-01-28 1998-06-02 Zetetic Institute Method and apparatus for confocal interference microscopy with background amplitude reduction and compensation
US5915048A (en) * 1996-06-05 1999-06-22 Zetetic Institute Method and apparatus for discriminating in-focus images from out-of-focus light signals from background and foreground light sources

Family Cites Families (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS63306413A (en) * 1987-06-09 1988-12-14 Olympus Optical Co Ltd Scanning type optical microscope
US4844617A (en) * 1988-01-20 1989-07-04 Tencor Instruments Confocal measuring microscope with automatic focusing
US5020891A (en) * 1988-09-14 1991-06-04 Washington University Single aperture confocal scanning biomicroscope and kit for converting single lamp biomicroscope thereto
US5034613A (en) * 1989-11-14 1991-07-23 Cornell Research Foundation, Inc. Two-photon laser microscopy
US5274240A (en) * 1990-01-12 1993-12-28 The Regents Of The University Of California Capillary array confocal fluorescence scanner and method
GB9015793D0 (en) * 1990-07-18 1990-09-05 Medical Res Council Confocal scanning optical microscope
JPH04221917A (en) * 1990-12-25 1992-08-12 Tamron Co Ltd Automatically focusing method and device for microscope
US5162641A (en) * 1991-02-19 1992-11-10 Phoenix Laser Systems, Inc. System and method for detecting, correcting and measuring depth movement of target tissue in a laser surgical system
US5784162A (en) * 1993-08-18 1998-07-21 Applied Spectral Imaging Ltd. Spectral bio-imaging methods for biological research, medical diagnostics and therapy
US5465147A (en) * 1991-04-29 1995-11-07 Massachusetts Institute Of Technology Method and apparatus for acquiring images using a ccd detector array and no transverse scanner
JPH05188301A (en) * 1991-09-09 1993-07-30 Sumitomo Electric Ind Ltd Laser microscope
JPH05332733A (en) * 1992-05-27 1993-12-14 Hitachi Ltd Detection optical system and method for detecting three-dimensional form
JPH07128596A (en) * 1993-09-08 1995-05-19 Nikon Corp Confocal microscope
US5587832A (en) * 1993-10-20 1996-12-24 Biophysica Technologies, Inc. Spatially light modulated confocal microscope and method
JP3450406B2 (en) * 1994-03-10 2003-09-22 オリンパス光学工業株式会社 Position adjustment device for observation image and scanning optical microscope
JPH07281100A (en) * 1994-04-05 1995-10-27 Nikon Corp Sandwiched sample body for automatic focusing microscope
US5515864A (en) * 1994-04-21 1996-05-14 Zuckerman; Ralph Method and apparatus for the in vivo measurement of oxygen concentration levels by the indirect determination of fluoescence lifetime
JP2000512744A (en) * 1996-05-16 2000-09-26 アフィメトリックス,インコーポレイテッド System and method for detecting label material
US5900949A (en) * 1996-05-23 1999-05-04 Hewlett-Packard Company CCD imager for confocal scanning microscopy
US5880465A (en) * 1996-05-31 1999-03-09 Kovex Corporation Scanning confocal microscope with oscillating objective lens
JPH09329749A (en) * 1996-06-11 1997-12-22 Nikon Corp Optical scanning type microscope
DE19627568A1 (en) * 1996-07-09 1998-01-15 Zeiss Carl Jena Gmbh Arrangement for confocal microscopy with top and lower carrier discs
DE19632594A1 (en) * 1996-08-13 1998-02-19 Johannes Prof Dr Schwider Confocal microscopy method using refractive microlens fields
JP3816632B2 (en) * 1997-05-14 2006-08-30 オリンパス株式会社 Scanning microscope

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5915048A (en) * 1996-06-05 1999-06-22 Zetetic Institute Method and apparatus for discriminating in-focus images from out-of-focus light signals from background and foreground light sources
US5760901A (en) * 1997-01-28 1998-06-02 Zetetic Institute Method and apparatus for confocal interference microscopy with background amplitude reduction and compensation

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1064579A4 *

Cited By (78)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1002233A4 (en) * 1997-06-03 2002-06-26 Pharmacopeia Inc High-throughput assay
EP1002233A1 (en) * 1997-06-03 2000-05-24 Pharmacopeia, Inc. High-throughput assay
US7957911B2 (en) 1998-03-16 2011-06-07 Ge Healthcare Bio-Sciences Corp. Method and apparatus for screening chemical compounds
GB2338568B (en) * 1998-06-19 2000-12-20 Optiscan Pty Ltd Two photon endoscope or microscope method and apparatus
JP4776854B2 (en) * 2000-02-10 2011-09-21 オリンパス株式会社 Method for characterizing a sample having fluorescent particles
WO2002035474A1 (en) * 2000-10-27 2002-05-02 Praelux Incorporated Method and apparatus for screening chemical compounds
JP2004530111A (en) * 2001-02-09 2004-09-30 コミツサリア タ レネルジー アトミーク Continuous sample observation device by fluorescence
DE10117723A1 (en) * 2001-04-09 2002-10-17 Evotec Ag Carrier for biological or synthetic samples has a sample holding plate with reservoirs and a dosing plate with projections, fitted with membranes, of an optically transparent material with trouble-free light beam transparency
US11315250B2 (en) 2001-04-20 2022-04-26 Yale University Systems and methods for automated analysis of cells and tissues
AU2002311827B2 (en) * 2001-04-20 2008-08-14 Yale University Systems and methods for automated analysis of cells and tissues
US8185320B2 (en) 2001-04-20 2012-05-22 Yale University Systems and methods for automated analysis of cells and tissues
US10217219B2 (en) 2001-04-20 2019-02-26 Yale University Systems and methods for automated analysis of cells and tissues
US8121794B2 (en) 2001-04-20 2012-02-21 Yale University Systems and methods for automated analysis of cells and tissues
US8036833B2 (en) 2001-04-20 2011-10-11 Yale University Systems and methods for automated analysis of cells and tissues
US7873480B2 (en) 2001-04-20 2011-01-18 Yale University Systems and methods for automated analysis of cells and tissues
AU2002311827B9 (en) * 2001-04-20 2009-03-12 Yale University Systems and methods for automated analysis of cells and tissues
US8639450B2 (en) 2001-04-20 2014-01-28 Yale University Systems and methods for automated analysis of cells and tissues
DE10122607A1 (en) * 2001-05-10 2002-12-05 Leica Microsystems Direct Fourier imaging of specimens involves point- and line-wise illumination of specimen and point- and line-wise detection of light in light path defined by detector and optical arrangement
DE10122607B4 (en) * 2001-05-10 2006-11-30 Leica Microsystems Cms Gmbh Method and arrangement for direct Fourier imaging of samples
US7262843B2 (en) 2001-11-23 2007-08-28 Evotec Ag Method and device for correcting for the size and/or shape of a measuring volume in a chemical and/or biological sample
WO2003044495A3 (en) * 2001-11-23 2004-04-08 Evotec Ag Method and device for correcting the size and/or shape of a measuring volume in a chemical and/or biological sample
WO2003044495A2 (en) * 2001-11-23 2003-05-30 Evotec Oai Ag Method and device for correcting the size and/or shape of a measuring volume in a chemical and/or biological sample
JP2003177131A (en) * 2001-12-11 2003-06-27 Olympus Optical Co Ltd Method for detecting biological bonding affinity
WO2003095995A1 (en) * 2002-05-14 2003-11-20 Amersham Biosciences Uk Limited Method for assessing biofilms
WO2003098210A1 (en) * 2002-05-15 2003-11-27 Amersham Biosciences Uk Limited Method for the determination of changes in a cellular morphological parameter
US7527940B2 (en) * 2002-05-15 2009-05-05 Ge Healthcare Uk Limited Method for the determination of changes in a cellular morphological parameter
EP1742036A1 (en) * 2005-07-04 2007-01-10 WEISS UMWELTTECHNIK GmbH System for testing pharmaceutical substances
US8158926B2 (en) 2005-11-23 2012-04-17 Illumina, Inc. Confocal imaging methods and apparatus
WO2007062039A3 (en) * 2005-11-23 2007-07-19 Illumina Inc Confocal imaging methods and apparatus
WO2007062039A2 (en) 2005-11-23 2007-05-31 Illumina, Inc. Confocal imaging methods and apparatus
US7329860B2 (en) 2005-11-23 2008-02-12 Illumina, Inc. Confocal imaging methods and apparatus
US7589315B2 (en) 2005-11-23 2009-09-15 Illumina, Inc. Confocal imaging methods and apparatus
EP2594981A3 (en) * 2005-11-23 2013-06-19 Illumina Inc. Confocal imaging methods and apparatus
US9816929B2 (en) 2005-11-23 2017-11-14 Illumina, Inc. Confocal imaging methods and apparatus
US7960685B2 (en) 2005-11-23 2011-06-14 Illumina, Inc. Confocal imaging methods and apparatus
US8884211B2 (en) 2005-11-23 2014-11-11 Illumina, Inc. Confocal imaging methods and apparatus
US8367351B2 (en) 2006-05-05 2013-02-05 Historx, Inc. Methods for determining signal transduction activity in tumors
US8497080B2 (en) 2006-05-05 2013-07-30 Historx, Inc. Methods for determining signal transduction activity in tumors
US7709222B2 (en) 2006-07-13 2010-05-04 Yale University Methods for making cancer prognoses based on subcellular localization of biomarkers
US8498048B2 (en) 2006-12-22 2013-07-30 Isis Innovations Limited Focusing apparatus and method
EP3125015A1 (en) * 2006-12-22 2017-02-01 Oxford University Innovation Limited Focusing apparatus and method
WO2008078083A1 (en) * 2006-12-22 2008-07-03 Isis Innovation Limited Focusing apparatus and method
US9638909B2 (en) 2006-12-22 2017-05-02 Isis Innovation Limited Focusing apparatus and method
US8144395B2 (en) 2006-12-22 2012-03-27 Isis Innovation Limited Focusing apparatus and method
US8471220B2 (en) 2010-03-01 2013-06-25 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis
US8710413B2 (en) 2010-03-01 2014-04-29 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis
US8541759B2 (en) 2010-03-01 2013-09-24 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis
US9395357B2 (en) 2010-07-26 2016-07-19 Olympus Corporation Method of detecting sparse particles in a solution using a light-emitting probe
US8785886B2 (en) 2010-09-10 2014-07-22 Olympus Corporation Optical analysis method using the light intensity of a single light-emitting particle
US8958066B2 (en) 2010-09-10 2015-02-17 Olympus Corporation Optical analysis method using measurement of light of two or more wavelength bands
US8680485B2 (en) 2010-09-21 2014-03-25 Olympus Corporation Optical analysis method using the detection of a single light-emitting particle
US8681332B2 (en) 2010-10-13 2014-03-25 Olympus Corporation Method of measuring a diffusion characteristic value of a particle
US8803106B2 (en) 2010-10-19 2014-08-12 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis for observing polarization characteristics of a single light-emitting particle
US9103718B2 (en) 2010-11-25 2015-08-11 Olympus Corporation Optical analysis device and optical analysis method using a wavelength characteristic of light of a single light-emitting particle
US9863806B2 (en) 2011-01-20 2018-01-09 Olympus Corporation Optical analysis method and optical analysis device using the detection of light from a single light-emitting particle
US8911944B2 (en) 2011-01-26 2014-12-16 Olympus Corporation Method for identifying polymorphism of nucleic acid molecules
US8900812B2 (en) 2011-01-26 2014-12-02 Olympus Corporation Method for identifying polymorphism of nucleic acid molecules
US9435727B2 (en) 2011-03-29 2016-09-06 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9068944B2 (en) 2011-04-13 2015-06-30 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9116127B2 (en) 2011-04-18 2015-08-25 Olympus Corporation Quantitative determination method for target particles, photometric analysis device, and computer program for photometric analysis
US9354176B2 (en) 2011-08-11 2016-05-31 Olympus Corporation Method for detecting a target particle
US9423349B2 (en) 2011-08-15 2016-08-23 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9488578B2 (en) 2011-08-26 2016-11-08 Olympus Corporation Single particle detection device, single particle detection method, and computer program for single particle detection, using optical analysis
US10371631B2 (en) 2011-08-26 2019-08-06 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9528923B2 (en) 2011-08-30 2016-12-27 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9841418B2 (en) 2011-08-30 2017-12-12 Olympus Corporation Method for detecting target particle
US9329117B2 (en) 2011-11-10 2016-05-03 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US9494779B2 (en) 2012-02-17 2016-11-15 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single particle detection
US9428796B2 (en) 2012-02-22 2016-08-30 Olympus Corporation Method for detecting a target particle
US9771612B2 (en) 2012-03-21 2017-09-26 Olympus Corporation Method for detecting a target nucleic acid molecule
US9575060B2 (en) 2012-04-18 2017-02-21 Olympus Corporation Method for detecting a target particle
US9188535B2 (en) 2012-04-18 2015-11-17 Olympus Corporation Single particle detection device, single particle detection method, and computer program for single particle detection, using optical analysis
US10310245B2 (en) 2013-07-31 2019-06-04 Olympus Corporation Optical microscope device, microscopic observation method and computer program for microscopic observation using single light-emitting particle detection technique
US9739698B2 (en) 2013-10-07 2017-08-22 Olympus Corporation Optical analysis device, optical analysis method and computer program for optical analysis using single light-emitting particle detection
US10677734B2 (en) 2014-09-05 2020-06-09 Thermo Fisher Scientific Oy Method and apparatus for optical measurement of liquid sample
US11016026B2 (en) 2015-12-09 2021-05-25 Olympus Corporation Optical analysis method and optical analysis device using single light-emitting particle detection
WO2021152562A1 (en) * 2020-01-31 2021-08-05 Stellenbosch University Method for determining mitochondrial events
US11714271B2 (en) 2020-09-14 2023-08-01 Singular Genomics Systems, Inc. Methods and systems for multidimensional imaging

Also Published As

Publication number Publication date
IL164319A0 (en) 2005-12-18
BR9908767B1 (en) 2011-09-06
AU3354799A (en) 1999-10-11
CA2324262C (en) 2010-05-25
JP2002507762A (en) 2002-03-12
KR20010041945A (en) 2001-05-25
NO20004601L (en) 2000-11-10
CA2324262A1 (en) 1999-09-23
KR100618502B1 (en) 2006-09-01
BR9908767A (en) 2001-10-16
AU758571B2 (en) 2003-03-27
EP1064579A1 (en) 2001-01-03
CN1301357A (en) 2001-06-27
WO1999047963A8 (en) 1999-11-18
EP1064579A4 (en) 2007-11-07
IL138496A0 (en) 2001-10-31
KR100560588B1 (en) 2006-03-16
KR20050088500A (en) 2005-09-06
NO20004601D0 (en) 2000-09-15
JP4812937B2 (en) 2011-11-09
WO1999047963A9 (en) 1999-12-23
CN100380160C (en) 2008-04-09

Similar Documents

Publication Publication Date Title
CA2324262C (en) Confocal microscopy imaging system
US6400487B1 (en) Method and apparatus for screening chemical compounds
US7957911B2 (en) Method and apparatus for screening chemical compounds
EP1330787B1 (en) Method for screening chemical compounds
EP2881728B1 (en) System and method for dense-stochastic-sampling imaging
Zemanová et al. Confocal optics microscopy for biochemical and cellular high-throughput screening
US7978885B2 (en) Analysing biological entities
US7881509B2 (en) Method of, and apparatus and computer software for, imaging biological objects
AU2003204937B2 (en) Confocal microscopy imaging system
AU2001215764B2 (en) Method and apparatus for screening chemical compounds
AU2007203332A1 (en) Method and apparatus for screening chemical compounds
AU2001215764A1 (en) Method and apparatus for screening chemical compounds
Gradl et al. High-Throughput/High-Content Automated Image Acquisition and Analysis
CASANO et al. Uses of High Content Screening in Chemical Optimization
GB2412803A (en) Image segmentation using local and remote pixel value comparison

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 99806221.9

Country of ref document: CN

AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
AK Designated states

Kind code of ref document: C1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: C1

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

CFP Corrected version of a pamphlet front page
CR1 Correction of entry in section i
AK Designated states

Kind code of ref document: C2

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: C2

Designated state(s): GH GM KE LS MW SD SL SZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

COP Corrected version of pamphlet

Free format text: PAGES 10-49, DESCRIPTION, REPLACED BY NEW PAGES 10-50; PAGES 50 AND 51, CLAIMS, RENUMBERED AS PAGES 51 AND 52; PAGES 52-70, AMENDED CLAIMS, RENUMBERED AS PAGES 53-71; PAGES 1/25-25/25, DRAWINGS, REPLACED BY NEW PAGES 1/23-23/23; DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
WWE Wipo information: entry into national phase

Ref document number: 1999914908

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2324262

Country of ref document: CA

Ref document number: 2324262

Country of ref document: CA

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 33547/99

Country of ref document: AU

Ref document number: PA/a/2000/009100

Country of ref document: MX

Ref document number: 138496

Country of ref document: IL

WWE Wipo information: entry into national phase

Ref document number: 1020007010258

Country of ref document: KR

ENP Entry into the national phase

Ref document number: 2000 537103

Country of ref document: JP

Kind code of ref document: A

WWP Wipo information: published in national office

Ref document number: 1999914908

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWP Wipo information: published in national office

Ref document number: 1020007010258

Country of ref document: KR

WWE Wipo information: entry into national phase

Ref document number: 10227552

Country of ref document: US

WWG Wipo information: grant in national office

Ref document number: 33547/99

Country of ref document: AU

WWG Wipo information: grant in national office

Ref document number: 1020007010258

Country of ref document: KR