WO2006091223A2 - Multimodal method for identifying hazardous agents - Google Patents

Multimodal method for identifying hazardous agents Download PDF

Info

Publication number
WO2006091223A2
WO2006091223A2 PCT/US2005/023705 US2005023705W WO2006091223A2 WO 2006091223 A2 WO2006091223 A2 WO 2006091223A2 US 2005023705 W US2005023705 W US 2005023705W WO 2006091223 A2 WO2006091223 A2 WO 2006091223A2
Authority
WO
WIPO (PCT)
Prior art keywords
raman
sample
entities
optical property
agent
Prior art date
Application number
PCT/US2005/023705
Other languages
French (fr)
Other versions
WO2006091223A3 (en
Inventor
Jason Neiss
Matthew P. Nelson
Patrick Treado
Robert Schweitzer
Original Assignee
Chemimage Corporation
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from US10/882,082 external-priority patent/US7046359B2/en
Priority claimed from US11/000,841 external-priority patent/US7532320B2/en
Application filed by Chemimage Corporation filed Critical Chemimage Corporation
Priority to CA002571932A priority Critical patent/CA2571932A1/en
Priority to EP05857503A priority patent/EP1766351A4/en
Publication of WO2006091223A2 publication Critical patent/WO2006091223A2/en
Publication of WO2006091223A3 publication Critical patent/WO2006091223A3/en

Links

Classifications

    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28—Investigating the spectrum
    • G01J3/44—Raman spectrometry; Scattering spectrometry ; Fluorescence spectrometry
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/02—Details
    • G01J3/10—Arrangements of light sources specially adapted for spectrometry or colorimetry
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
    • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
    • G01J3/28—Investigating the spectrum
    • G01J3/30—Measuring the intensity of spectral lines directly on the spectrum itself
    • G01J3/32—Investigating bands of a spectrum in sequence by a single detector
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
    • G01N21/21—Polarisation-affecting properties
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/645—Specially adapted constructive features of fluorimeters
    • G01N21/6456—Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458—Fluorescence microscopy
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/65—Raman scattering
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N2021/6417—Spectrofluorimetric devices
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64—Fluorescence; Phosphorescence
    • G01N21/645—Specially adapted constructive features of fluorimeters
    • G01N2021/6484—Optical fibres
    • G—PHYSICS
    • G01—MEASURING; TESTING
    • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/65—Raman scattering
    • G01N2021/653—Coherent methods [CARS]
    • G01N2021/656—Raman microprobe

Definitions

  • the invention relates generally to the field of Raman spectroscopy.
  • Deliberate and inadvertent deployments of harmful or weaponized chemical or biological agents pose significant threats to public welfare, as do explosives and radiological materials. Such agents threaten both human and economic health, and the threats posed by these agents are compounded by limited ability to detect deployment of the agents and to respond appropriately.
  • BWAs biological weapon agents
  • CWAs chemical weapon agents
  • the invention relates to a method of assessing occurrence of a hazardous agent in a sample, such as one that comprises multiple entities.
  • the method comprises assessing a first optical property of the entities to select an entity for which the first optical property (e.g., absorbance, fluorescence, diffraction, polarization, or microscopic morphology) is characteristic of the hazardous agent.
  • Raman-shifted radiation scattered by the selected entity is thereafter assessed.
  • Exhibition of a Raman scattering property characteristic of the hazardous agent by the selected entity is indicative that the hazardous agent occurs in the sample.
  • Raman-shifted radiation scattered by a selected entity is assessed only if the selected entity also exhibits a second optical property characteristic of the hazardous agent.
  • entities in a sample can be assessed to determine whether they exhibit a microscopic morphology and a fluorescent property characteristic of the hazardous agent.
  • fluorescent properties can be assessed only for those entities which exhibit microscopic morphology characteristic of the hazardous agent (e.g., only for entities which exhibit the characteristic shape of a pathogenic bacterium). Entities that exhibit both characteristic properties can be selected for Raman scattering analysis, thereby ⁇ educing the amount of time spent on the more definitive, but typically less sensitive, Raman analysis.
  • the methods described herein are useful for assessing occurrence of a wide variety of hazardous agents.
  • agents include synthetic organic chemicals, biological toxins, microorganisms (e.g., bacteria and protozoa), and viruses.
  • the method can be performed using a variety of Raman-shifted scattered radiation collection systems. Such systems can be based on devices such as macroscopes, microscopes, endoscopes, and fiber optic arrays. The invention includes such devices and systems.
  • FIG. 1 is a schematic diagram of an instrument (or multiple configured instruments) suitable for use in the multimodal sensing and detection systems described herein.
  • Figure 2 is a schematic diagram of an ambient air sensor suitable for use in multimodal sensing and detection of BWA and CWA in systems described herein.
  • Figure 3 is a flow chart which depicts one embodiment of the multimodal analytical methods described herein for identification of threat entities such as BWAs or CWAs.
  • Figure 4 consists of Figures 4A and 4B.
  • Figure 4 A is a graph of the Raman spectra of three Bacillus species and dipicolinic acid.
  • Figure 4B is a microscopic image of Bacillus anthracis.
  • Figure 5 consists of Figures 5A, 5B, 5C, and 5D.
  • Figure 5B is a color image of multiple entities in a microscopic field of view for a sample.
  • Figure 5 A depicts Raman spectra obtained by analysis of substances present in the sample imaged in the field of view depicted in Figure 5B.
  • Figure 6 consisting of Figures 6 A, 6B, and 6C, depicts fluorescence spectral differentiation and identification of different Bacillus species in a mixture of B. pumilus and B. subtilis.
  • Figures 6A and 6B depict images of the same field of view of the mixture, assessed at different fluorescent wavelengths.
  • Figure 6C depicts fluorescence spectra characteristic of B. pumilus (which fluoresces in Figure 6A) and B. subtilis (which fluoresces in Figure 6B).
  • Figure 7 depicts multimodal analysis of a single field of view of a mixture of B. anthracis with growth medium and formalin.
  • Figure 7A is a brightfield optical reflectance microscopic image.
  • Figure 7B is a
  • Figure 7C is a fluorescent image of the field of view. In color
  • Figure 8 consisting of Figures 8 A, 8B, 8C, and 8D, depicts use of fluorescence sensing performed on a commercial macro platform (CONDOR (TM) macro imaging system, Chemlmage Corp., Pittsburgh, PA) for detecting spores of B. globigii mixed with baking soda on the exterior of an envelope.
  • Figure 8 A depicts the configuration of the experiment.
  • Figures 8B and 8C depict fluorescent images of B. globigii spores alone
  • Figure 8D depicts fluorescent spectral characteristic of baking soda (PtI in Figures 8C and
  • Figure 9 is the absorbance and fluorescence emission spectra of goat anti -mouse
  • IgG labeled with FITC in pH 8.0 buffer IgG labeled with FITC in pH 8.0 buffer.
  • Figure 10 schematically represents an apparatus according to one embodiment of the disclosure.
  • Figure 11 schematically represent an apparatus according to another embodiment of the disclosure.
  • the invention relates to a method of assessing occurrence of a hazardous agent in a sample, particularly when the sample contains multiple entities (e.g., debris, soot, dust, non-pathogenic microorganisms, and animal dander) other than the hazardous agent.
  • entities e.g., debris, soot, dust, non-pathogenic microorganisms, and animal dander
  • Samples collected from various environments e.g., ambient indoor and outdoor air samples, soil samples, and unknown powders
  • identifying and/or quantifying the hazardous agents in the sample milieu can be significantly complicated and slowed by the apparent similarity of the entities in the sample.
  • traditional rapid microscopic and fluorescent analytical methods often exhibit insufficient sensitivity to positively identify hazardous agents and differentiate them from other entities.
  • Raman spectroscopy can be used to assess the Raman scattering properties of all entities in the sample to identify entities which exhibit Raman scattering properties that are characteristic of the hazardous agent. In view of the amount and type of information that can be discerned from Raman scattering properties, those properties can often be highly informative for identifying hazardous agents in a sample. However, owing to a number of factors (e.g., relatively weak signal strength, frequent occurrence of background fluorescence, and relatively slow operation of Raman scattering analytical equipment), the time required for obtaining informative Raman scattering information for all candidate entities in a sample can exceed the time available or convenient for sample analysis, particularly when rapid analysis is necessary.
  • factors e.g., relatively weak signal strength, frequent occurrence of background fluorescence, and relatively slow operation of Raman scattering analytical equipment
  • the methods described herein permit more rapid Raman scattering analysis of potential hazardous agents in a sample by using more rapid optical analytical methods (e.g., microscopic and/or fluorescent analysis) to exclude from Raman scattering analysis entities that do not exhibit optical characteristics characteristic of a hazardous agent.
  • the methods described herein comprise assessing a first optical property of the entities in the sample. Entities for which the first optical property is characteristic of the hazardous agent (i.e., consistent with the entity being the agent) can thereby be selected. Raman-shifted radiation scattered by one or more of those selected entities can thereafter be assessed.
  • Entities for which the first optical property is not characteristic of the hazardous agent can be excluded from the Raman scattering analysis, thereby avoiding spending the time and computing resources that would otherwise be spent performing Raman scattering analysis of those non-characteristic entities.
  • Occurrence in the sample of entities which exhibit both the first optical property and a Raman scattering property characteristic of the hazardous agent indicates that the sample comprises the hazardous agent.
  • at least two optical properties of entities in the sample are assessed prior to Raman scattering analysis, and that analysis is performed only for entities for which each of the optical properties is characteristic of the hazardous agent.
  • failure of an entity to exhibit any of the optical properties characteristic of the hazardous agent can exclude that entity from Raman scattering analysis.
  • failure of an entity to exhibit a first optical property characteristic of the hazardous agent makes it unnecessary to analyze that entity for a second or subsequent optical property.
  • the speed of the entire process can be increased by excluding entities which fail to exhibit even a single optical property of the hazardous agent from further analysis.
  • two or more optical properties of entities in a sample can be assessed, and Raman scattering analysis can be performed for each entity that exhibits at least one optical property characteristic of the hazardous agent.
  • Bitwidth means the range of wavelengths in a beam of radiation, as assessed using the full width at half maximum method.
  • Bandpass of a detector or other system means the range of wavelengths that the detector or system can distinguish, as assessed using the full width at half maximum intensity method.
  • the "full width at half maximum” (“FWHM”) method is a way of characterizing radiation including a range of wavelengths by identifying the range of contiguous wavelengths over which the magnitude of a property (e.g., intensity or detection capacity) is equal to at least half the maximum magnitude of that property in the radiation at a single wavelength.
  • a property e.g., intensity or detection capacity
  • a "hazardous agent” is a substance (e.g., a chemical, biological, radiological, or explosive material) that can cause disease, injury, discomfort, pain, or death to an animal such as a human.
  • Spectral resolution means the ability of a radiation detection system to resolve two spectral peaks.
  • optical and “spectroscopic” are used interchangeably herein to refer to properties of materials (and to methods of assessing such properties).
  • spectroscopic is generally understood to refer to the interaction of electromagnetic radiation, electrons, or neutrons with the materials.
  • optical typically refers to an interaction with electromagnetic radiation.
  • electron microscopy is not always commonly considered a “spectroscopic” or “optical” method, the two terms are used inclusively herein to encompass electron microscopy and other methods of assessing interaction of a material with visible, ultraviolet, or infrared light, with neutrons, or with other radiation.
  • the methods described herein comprise assessing a first optical property of the entities in a sample. Entities for which the first optical property is characteristic of a hazardous agent (i.e., consistent with the entity being the hazardous agent) are selected. Raman-shifted radiation scattered by one or more of those selected entities is thereafter assessed. Entities for which the first optical property is not characteristic of the hazardous agent can be excluded from the Raman scattering analysis, thereby avoiding spending the time that would otherwise be spent performing Raman scattering analysis of those non- characteristic entities. Occurrence in the sample of entities which exhibit both the first optical property and a Raman scattering property characteristic of the hazardous agent indicates that the sample comprises the agent.
  • At least a second optical property of the entities in the sample can be assessed.
  • Those entities which fail to exhibit either of the first and second optical properties characteristic of the hazardous agent need not be assessed for Raman scattering. Excluding entities that fail to exhibit a rapidly- assessed optical property of the hazardous agent can reduce the amount of time spent performing Raman scattering analysis of entities that are not hazardous agents, thereby increasing the overall rapidity (i.e., throughput) of the assay method.
  • Three, four, five, or more optical properties of entities in the sample can be assessed to select entities suitable for Raman scattering analysis, but such additional assessment can increase the complexity, cost, and computing power requirements of the system. One and two optical properties are considered sufficient discriminators for most purposes.
  • a microscopic method is used to assess the morphology (i.e., size, shape, arrangement, or some combination of these) of entities in the sample.
  • Entities having a morphology characteristic of the hazardous agent e.g., the shape or chain configuration of a pathogenic bacterium
  • Entities which exhibit a morphology consistent with the hazardous agent are assessed by fluorescence spectroscopy or fluorescence microscopy.
  • Entities which exhibit fluorescence characteristic i.e., exhibiting a characteristic wavelength(s), intensity, or delay of fluorescent or phosphorescent emission
  • Raman scattering analysis and those entities which do not exhibit fluorescence characteristic of the hazardous agent are not analyzed further.
  • Raman scattering analysis is thus performed only for entities which exhibit both the morphology and fluorescence characteristic of the hazardous agent.
  • Exhibition of a Raman scattering property characteristic of the hazardous agent e.g., one or both of a characteristic Raman shift and a characteristic Raman spectrum
  • occurrence of the hazardous agent in the sample can be detected in a rapid manner. This embodiment is depicted in a flow chart in Figure 3.
  • a fluorescent microscopic or spectroscopic method can be used to select candidate entities for further microscopic morphological analysis. Entities in a sample which exhibit both the fluorescent and morphological characteristics of a hazardous agent of interest can be selected for Raman scattering analysis.
  • the order in which the optical analytical methods described herein are performed is not critical. However, in order to reduce the time necessary for Raman scattering analysis, at least part of that analysis should occur after entities in the sample have been assessed by another, more rapid analytical method (e.g., microscopic morphological analysis and/or fluorescent analysis) and confirmed to exhibit an optical property consistent with the optical properties of the hazardous agent.
  • optical analytical methods can be performed sequentially (e.g., first assessing microscopic morphology of all entities in a microscopic field including the sample, thereafter assessing fluorescent emissions from all entities in the field, and thereafter assessing Raman scattering from the entities in the field that exhibit morphological and/or fluorescent characteristics of the hazardous agent).
  • two or more of the analytical methods can be performed in parallel (e.g., microscopic morphology and fluorescent emissions can be assessed simultaneously for entities in a microscopic field), and Raman scattering analysis of selected entities can be performed thereafter, for example using multiple detectors suitable for collecting information simultaneously from the sample.
  • Combined serial and parallel operations can be performed as well, in order to improve the speed of the method.
  • the methods described herein overcome shortcomings of single-mode analytical methods of the prior art. Techniques that rely on a single optical detection strategy can exhibit a high rate of false positive detection results. The frequency of such false positive results can vary widely depending on the material being analyzed. Attempts by others to overcome such shortcomings have tended to address individual shortcomings in the sensitivity of the individual methods used or specific limitations of particular optical methods. The methods described herein are less sensitive to the limitations of the optical analytical methods employed, since limitations of one detection method can be identified by and compensated for by the other optical detection method(s) employed. Using the detection methods described herein in parallel, the time required to definitively identify a target in a sample can be significantly reduced.
  • Raman spectroscopy provides information about the vibrational state of molecules. Many molecules have atomic bonds capable of existing in a number of vibrational states. Such molecules are able to absorb incident radiation that matches a transition between two of its allowed vibrational states and to subsequently emit the radiation. Most often, absorbed radiation is re-radiated at the same wavelength, a process designated Rayleigh or elastic scattering. In some instances, the re-radiated radiation can contain slightly more or slightly less energy than the absorbed radiation (depending on the allowable vibrational states and the initial and final vibrational states of the molecule).
  • the result of the energy difference between the incident and re-radiated radiation is manifested as a shift in the wavelength between the incident and re-radiated radiation, and the degree of difference is designated the Raman shift (RS), measured in units of wavenumber (inverse length).
  • RS Raman shift
  • the incident light is substantially monochromatic (single wavelength) as it is when using a laser source, the scattered light which differs in wavelength can be more easily distinguished from the Rayleigh scattered light.
  • Raman spectroscopy is based on irradiation of a sample and detection of scattered radiation, it can be employed non-invasively and non-destructively, such that it is suitable for analysis of biological samples in situ. Little or no sample preparation is required. In addition, water exhibits very little Raman scattering, and Raman spectroscopy techniques can be readily performed in aqueous environments. Illumination of a sample over time can result in photobleaching of molecules in the sample, which can result in time- dependent fluctuations in fluorescence intensity following cessation of illumination.
  • Low power, wide-field illumination of a sample over a period of more than a few seconds can substantially completely bleach the entire sample, allowing Raman and other measurements to be made against a non- fluctuating background, in contrast with scanning Raman spectroscopic measurements described in the art.
  • the Raman spectrum of a material can reveal the molecular composition of the material, including the specific functional groups present in organic and inorganic molecules.
  • Raman spectroscopy is useful for detection of hazardous agents because most, if not all, of these agents exhibit characteristic 'fingerprint' Raman spectra, subject to various selection rules, by which the agent can be identified.
  • a variety of Raman scattering properties, such as Raman peak position, peak shape, and adherence to selection rules, can be used to determine molecular identity and to determine conformational information (e.g., identity, viability, crystalline phase, degree of order, strain, grain size) for solid materials.
  • An illumination wavelength of 532 nanometers is suitable, for example.
  • the intensity of scattered light is known to be dependent on the fourth power of the frequency (i.e., inverse wavelength) of the irradiating light, and only proportional to the intensity of the irradiating light, lowering the wavelength of the irradiating light can have the effect of increasing scattering signal output even if the intensity of the irradiating light is decreased.
  • inverse wavelength the intensity of scattered light
  • Irradiation using shorter wavelengths can be performed without harming the illuminated cells if intermittent or very short duration irradiation methods are employed. If survival of a target (e.g., a cell, a virus, or a toxin particle) in a sample beyond the time of detection is not important and so long as the Raman signature is preserved, then the effect of irradiating light on the hazardous agent need not be considered. However, it will be preferable in many instances to preserve the integrity of a target in a sample by illuminating the sample with radiation at a wavelength and intensity below the damage threshold for the target. In addition, background fluorescence in biological samples can generally be reduced by increasing the wavelength of the illuminating radiation.
  • a target e.g., a cell, a virus, or a toxin particle
  • the sample In order to detect Raman scattered light and to accurately determine the Raman shift of that light, the sample should be irradiated with substantially monochromatic light, such as light having a bandwidth not greater than about 1.3 nanometers, and preferably not greater than 1.0, 0.50, or 0.25 nanometer.
  • substantially monochromatic light such as light having a bandwidth not greater than about 1.3 nanometers, and preferably not greater than 1.0, 0.50, or 0.25 nanometer.
  • Suitable sources include various lasers and polychromatic light source-monochromator combinations. It is recognized that the bandwidth of the irradiating light, the resolution of the wavelength resolving element(s), and the spectral range of the detector determine how well a spectral feature can be observed, detected, or distinguished from other spectral features.
  • the combined properties of these elements define the spectral resolution of the Raman signal detection system.
  • the known relationships of these elements enable the skilled artisan to select appropriate components in readily calculable ways.
  • Limitations in spectral resolution of the system e.g., limitations relating to the bandwidth of irradiating light
  • the skilled artisan understands that and how the separation and shape of Raman scattering signals can determine the acceptable limits of spectral resolution for the system for any of the Raman spectral features described herein.
  • a field of illumination can be divided into multiple adjacent, non-adjacent, or overlapping points, and Raman scattering analysis can be assessed at each of the points.
  • the points can be scanned serially (i.e., by scanning) or assessed in parallel (e.g., by assessing Raman scattering at each point at an RS value selected using a liquid crystal tunable filter and subsequently at a second RS value selected using the filter).
  • a scanning strategy there is an inherent trade off between acquisition time and the spatial resolution of the spectroscopic map or image that is generated. Each full spectrum takes a certain time to collect. The more spectra collected per unit area of a sample, the higher the apparent resolution of the spectroscopic map, but the longer the data acquisition takes.
  • Raman scattering can be assessed in parallel (i.e., simultaneously) for all points in an image field. This parallel processing of all points is designated Raman chemical imaging, and can require significant computing time and capacity.
  • Any of a variety of known methods can be used to correlate the Raman spectrum obtained at any particular point or averaged area with reference spectra.
  • standard spectral library comparison methods can be used to identify a component that occurs at a particular location in a sample.
  • portions of a sample in a field of view can be selected for Raman scattering analysis by first assessing the portions of the field that exhibit one or more optical properties characteristic of the hazardous agent. Sampling multiple points in an image allows variations in the Raman spectra to be observed and distinctions to be made as to components present in the various portions of the sample corresponding to the points, hi this way, the processing time and resources needed to assess occurrence of the hazardous agent in the sample can be reduced or minimized.
  • regions of the image shown in Figure 5B were assessed by Raman scattering analysis to identify the corresponding entities using the Raman spectra depicted in Figure 5A.
  • Raman spectroscopy can generally be applied to samples on a wide variety of surfaces, some substrate materials are preferred relative to others. Ideal substrates are optically flat, Raman inactive (i.e., exhibit little or no Raman scattering), non- fluorescent, and can sustain large laser powers without exhibiting thermal expansion. Glass-based substrates are inexpensive, commonly used, and readily available. However, some glasses exhibit significant fluorescence emission(s) that are superimposed on the Raman spectrum. Although the Raman signal can be subtracted out of the sample spectra, such subtraction contributes to noise in the resulting signal.
  • Fused silica i.e., optical grade quartz
  • Fused silica is an alternative often used by Raman spectroscopists, because it does not exhibit the significant fluorescence background of glass.
  • Fused silica is also colorless and clear, allowing traditional transmittance optical viewing.
  • Fused silica exhibits a limited Raman signal that must be subtracted from the final spectrum.
  • a preferred substrate is an aluminum oxide-based filter (e.g., ANODISC (RTM) brand aluminum oxide filtration membranes available from Whatman PLC, Brentford, Middlesex, UK).
  • the ANODISC (RTM) filter exhibits a relatively weak Raman signature, is non-fluorescent, and can sustain large laser power densities without undergoing thermal expansion.
  • Some residual spectroscopic properties of the substrate requires corrective steps to subtract its signature from the overall sample spectroscopic response, but this can be achieved using known methods.
  • MOUDI micro-orifice uniform deposit impactor
  • One or more of a variety of methods can be used to identify areas of a sample or entities in a sample for which Raman scattering analysis should be performed (or, conversely, need not be performed).
  • the optical or spectroscopic method(s) used for this purpose can be performed significantly more rapidly than Raman scattering analysis.
  • suitable methods include absorbance, fluorescence, diffraction, polarization, and microscopic methods, hi one embodiment, the sample (or at least a field of view of the sample) is illuminated with radiation that can be used in more than one optical and/or spectroscopic method (e.g., incident laser light useful for Raman scattering, fluorescence spectroscopy, and optical microscopy).
  • Suitable microscopic methods include scanning electron microscopy, differential interference contrast microscopy, brightfield reflectance microscopy, polarized light microscopy, and fluorescence microscopy.
  • Microscopic methods can be used for assessing the morphology of entities in a sample.
  • fluorescence spectroscopy photons are emitted from a material following an excitation step in which absorption of photons occurs.
  • Experiments typically include a polychromatic excitation source such as mercury (Hg) or xenon (Xe) lamps or a monochromatic source such as a light-emitting diode (LED) or laser for sample excitation.
  • a portion of the emitted radiation may then be directed into a dispersive monochromator to which a detector device such as a CCD is attached.
  • a detector device such as a CCD is attached.
  • fluorescence is inherently more sensitive. Detection limits in the parts-per-billion range are common.
  • fluorescence is less selective than Raman and there are a limited number of chemical systems that exhibit fluorescence. Nonetheless, fluorescence analysis can be performed much more rapidly than Raman scattering analysis.
  • Fluorescence analysis can distinguish biotic and non-biotic materials, which can be advantageous for identifying entities in a sample that are not living. If detection of a living hazardous agent (e.g., a pathogenic bacterium or eukaryote) or a viral agent is desired, fluorescence analysis is a suitable method for excluding sample entities from slower Raman scattering analysis. Suitable parameters for fluorescent analysis of biotic materials are known. By way of example, such parameters are described in Pinnick et al. (1999, Field Anal. Chem. Technol. 3:221-239).
  • UV/visible and NIR absorption spectroscopies involve the absorption of photons in the UV/visible (185-780 nanometer (54,054 to 12,800 cm “1 )) and NIR (780 nanometer to 2.5 micrometer (12,800 to 4,000 cm “1 )) spectral regions, respectively.
  • Typical instrumentation include a polychromatic source such as a deuterium or quartz tungsten halogen lamp, a dispersive element such as a monochromator or interferometer, and a detection device such as a Si CCD or InGaAs focal plane array detector.
  • the wavelength and intensity of illuminating radiation should be selected to avoid unacceptable sample or target degradation. Longer wavelengths, such as NIR radiation, can enhance penetration into a sample, permitting analysis of non-surface materials.
  • Absorption measurements based upon UV- visible or NIR radiation have many known applications for qualitative and quantitative determination of inorganic and organic chemical species. NIR spectra result from the overtone and combination bands of fundamental mid-infrared (MIR) bands. Like fluorescence, absorption spectroscopies are highly sensitive but only moderately selective. Absorption phenomena can also yield information about the chemical identities of the materials present in a sample. To the extent specific absorbance information about a target of interest is known, analysis of radiation absorbed by a sample can be informative regarding the occurrence of that target in the sample. Absorption spectroscopy is a useful method for identifying entities in a sample for which Raman scattering analysis need not be performed. Conversely, absorption spectroscopy can be used to identify areas of a sample or entities within a sample for which Raman analysis should be performed.
  • MIR fundamental mid-infrared
  • Spectroscopic methods can be extended to imaging techniques through the use of imaging spectrometers such as liquid crystal imaging spectrometers. The development of this technology in recent years has enabled spectroscopic imaging to develop and mature. [0063] Spectroscopic imaging is a versatile technique that is well suited to the analysis of complex heterogeneous materials. Applications of spectroscopic imaging range from the analysis of polymer blends, defect status analysis in semiconductor materials, inclusions in human breast tissue, characterization of corrosion samples and detection, and classification and identification of BWAs and CWAs.
  • Spectroscopic imaging provides a potential solution for obtaining both qualitative and quantitative image information about molecular composition and morphology of BWAs and CWAs, allowing a more accurate and more rapid analysis than traditional imaging or 'wet' chemical methods.
  • Optical and fluorescent microscopy techniques are well suited for identifying entities in a sample that are, or are not, characteristic of certain hazardous agents. For example, many bacteria, bacterial spores, eukaryotic cells, and viruses have a characteristic size, shape, or arrangement (e.g., chains, sheets, or groups). Microscopic methods can be performed rapidly and the results obtained thereby can be rapidly assessed using known methodologies to assess the size, shape, arrangement, or other morphological characteristics of entities in a field of view.
  • Microscopic methods are therefore suitable for assessing optical properties of entities in a sample in order to exclude from Raman scattering analysis entities that do not have morphological properties, fluorescent properties, or both, that are characteristic of the hazardous agent. The same methods can be used to identify entities for which Raman scattering analysis should be performed.
  • Figure 4B shows a typical magnified view of a sample containing Bacillus anthracis.
  • the spectra shown include a Raman spectrum corresponding to B. anthracis.
  • the differences which are evident between the spectrum of B. anthracis and the spectra of the other Bacillus species demonstrate that B. anthracis can be differentiated from those species in a sample containing all three samples.
  • the Raman spectroscopy step can be performed by assessing light scattered at a single pixel corresponding to the entity, by assessing light scattered from a group of pixels corresponding to the entity, or by assessing light scattered from one or more areas that include some or all of the entity.
  • a significant advantage of the methods described herein relative to previously described Raman spectral analytical methods is that the time required for Raman analysis can be significantly shortened by excluding from Raman analysis entities in a sample that do not exhibit one or more optical properties of a hazardous agent. Sampling multiple points in an image allows variations in the Raman spectra to be observed and distinctions to be made as to components present in the various portions of the sample corresponding to the points. Acquiring Raman scattering data at every position and analyzing the spectra at every point in an image would require significantly greater time. Instrument power and computing resources can thereby be concentrated on areas of a sample most likely to contain the hazardous agent.
  • the methods described herein are amenable to automation, in that the analysis of optical properties and Raman spectra can be performed using computer software as well as manually. Characterization of an optical field based on single optical properties corresponding to specific locations within the field (i.e., image analysis for absorbance at a selected wavelength) is routine in the art. For example, in one embodiment, if the presence or absence of bacterial spores are to be analyzed, then assessment of fluorescence should be performed by analyzing discrete areas of the optical field having a size not greater than 2, 3, 5, 10, or 25 times the cross-sectional area of a single spore.
  • bacteria and their spores have characteristic dimensions that are typically on the order of one to several micrometers
  • viruses have characteristic dimensions that are on the order of tens to hundreds of nanometers
  • eukaryotic cells have characteristic dimensions that are on the order often micrometers.
  • Any of a variety of known digital image processing techniques can be used to characterize the size, shape, and spatial distribution of entities in a visible or fluorescent microscopic field.
  • the characteristic dimensions of chemical agents, including biological toxins depend on their agglomeration, crystallization, or other associative characteristics.
  • the characteristic size of analytes can also depend on sample components other than the analyte itself.
  • Wide field Raman scattering analysis is also amenable as a method of identifying regions of an optical field that warrant higher definition Raman scattering analysis.
  • the methods described herein can still be employed. In that instance, the results obtained using the method will be indicative of the presence of the analyte in a region of the sample, rather than pinpointing the location of a discrete particle of the analyte.
  • Such regions of the sample can be subjected to further analysis once identified. A skilled artisan will understand how to select appropriate point sizes based on the desired analyte.
  • Multimodal spectral sensing can employ substantially any optical or spectroscopic method for identifying regions of a sample or entities within a sample that do not warrant more detailed and time-consuming Raman spectral analysis. Examples of such methods include fluorescence, UV/visible absorption/reflectance, NIR absorption/reflectance, and wide- field Raman spectroscopies. Contrast can be generated in the images by superimposing, adding, or otherwise combining spectral information obtained by these spectroscopic methods. The display and/or correlation of these different information sets is referred to herein as image fusion.
  • chemometric analysis tools such as correlation analysis, principal component analysis (PCA), and factor rotation, including multivariate curve resolution (MCR), can be applied to the image data to extract pertinent information that might be less obvious by analyzing ordinary univariate measures.
  • PCA principal component analysis
  • MCR multivariate curve resolution
  • depth-related information can also be obtained by using different excitation wavelengths or by capturing spectroscopic images at incremental planes of focus.
  • the contents of objects e.g., vials, envelopes, or suitcases
  • a spatial resolving power of approximately 250 nanometers has been demonstrated for Raman spectroscopic imaging using visible laser wavelengths with commercially available equipment. This is almost two orders of magnitude better than infrared imaging, which is typically limited to resolution not less than 20 micrometers, owing to diffraction for example.
  • NIR radiation in multimodal spectral sensing is that it penetrates more deeply than visible light so as to enable one to probe inside of paper or plastic envelopes or plastic or glass containers, for example to detect a hazardous agent in the container. Any container that does not totally absorb the incident radiation can be examined using the NIR multimodal spectral sensing approach.
  • Another way of discriminating potential hazardous agents from other entities in a sample is by assessing Raman scattered radiation at a single Raman shifted wavelength characteristic of the hazardous agent. Areas of the sample from which radiation having a Raman shift (relative to incident radiation) characteristic of the hazardous agent is scattered can be selected for more detailed Raman spectral analysis.
  • a sample is assessed by identifying one or more portions of a microscopic field from which Raman scattered radiation characteristic of a hazardous agent of interest emanates, and thereafter assessing a Raman scattering spectrum of those portions.
  • the portions can also be scanned using other optical methods (e.g., optical microscopy or fluorescence spectroscopy, as described above) to reduce the number of portions for which Raman spectra are collected and to thereby enhance the speed of the process.
  • Spectroscopic information obtained by two or more spectroscopic methods as described herein can be combined and stored, displayed, or both, as a single data set.
  • Raman-scattered light detected from a sample can be amplified (or falsely colored) and displayed together with a visible microscopic image of the sample.
  • fluorescent light emitted by the sample can be displayed in the same image.
  • Fusion of spectroscopic information obtained from a single field of view by two or more spectroscopic methods requires mapping of the information obtained by each method to identical or overlapping elements of a data set.
  • a visual image can be made by displaying numerous picture elements having a known relationship to one another.
  • the spectroscopic information obtained from a portion of a sample must be mapped to the picture element(s) corresponding to that portion.
  • Information from different spectroscopic methods can be displayed in a picture element corresponding to the same portion of the sample by representing each spectroscopic measurement by an independent variable of light displayed at the picture element.
  • a color image based on the Hunter color scale can be generated by (for each picture element of the image): i ⁇ representing brightness assessed by visible light microscopy as luminosity (L) on the Hunter color scale; ii ⁇ representing fluorescent intensity at a selected wavelength assessed by fluorescence spectroscopy as red-ness (a) on the Hunter color scale; and iii ⁇ representing the intensity of Raman-scattered light at a selected RS value as yellow-ness (b) on the Hunter color scale.
  • This display methodology is merely an example. Substantially any method of representing independent data sets in a single image or data structure can be used.
  • the spectroscopic information obtained from a discrete portion of the sample by multiple spectroscopic methods be mappable to the portion of the sample from which it was obtained, and that the method of storing or displaying that information preserve the mapping, so that different spectroscopic properties of the portion can be correlated.
  • a hazardous agent detection system having the configuration shown in Figure 1 can be constructed using ordinary skill in view of this disclosure. Such systems can be used or modified as described herein to meet the instrument requirements of the methods described herein for multimodal spectral analysis. Such configurations can include platforms based on a microscope, a macroscope, an endoscope, a fiber array spectral translator (FAST), or an environmental (e.g., air or water) sampler designs. Each of these is outlined in the following sections.
  • excitation sources 110, 120, 130, and 140 (corresponding to near infrared, infrared, visible, and ultraviolet sources, any combination of which can be present) provide incident radiation that is directed by input transfer optics 200 onto a sample that is situated in an sample cell 210.
  • the sample cell 210 can optionally be integrated with one or more other elements of the device, such as the input transfer optics 200.
  • integrated sample cells can be employed as single-use (i.e., disposable) sample containers, which can be discarded, incinerated, or archived.
  • the excitation sources can be substantially any known radiation source, including polychromatic sources such as tungsten or mercury arc lamps and substantially monochromatic sources such as lasers.
  • Radiation transmitted through, or reflected, refracted, emitted, or scattered by the sample is collected using output transfer optics 220 selected and situated to be appropriate for the radiation to be collected.
  • the collected radiation is directed to appropriate detectors, and the output of the detectors (informative of the collected radiation) is captured by a data recordation circuit or device, which can be physically and/or electronically integrated with the detectors (as in the integrated optical detectors and data capture subsystem 300 depicted in Figure 1).
  • Data collected from the detectors is preferably fed into a data analysis subsystem 400 within or linked to a computer 450.
  • the computer can be operated with software for controlling illumination, data collection, sample positioning, and the like, and such software is within the ordinary level of skill in this field and commercially available.
  • the computer preferably links input 410, display 420 (e.g., a visual display such as a video display terminal or printable image), and data storage 430 functions with the optical device(s), and also preferably is able to format output/results 500 in a way convenient for the user.
  • the computer 450 may conveniently provide output 500 that indicates the number of entities that are detected on the substrate as having Raman spectral characteristics of the hazardous agent of interest during a given period of time. Further, the output 500 may trigger an alarm circuit if the number of hazardous agent entities (e.g., pathogenic microorganisms or regions in which a chemical agent occurs) detected during a period of time (or during multiple consecutive periods of time) exceeds a pre-selected value.
  • hazardous agent entities e.g., pathogenic microorganisms or regions in which a chemical agent occurs
  • data collected from the detectors can be displayed for analysis by a user, and portions of the sample can be selected by the user for Raman scattering analysis.
  • An example of a commercially available device which is suitable for use in one or more of the platforms is a laboratory or transportable field Raman microscope such as the FALCON Raman microscope (TM; Chemlmage Corporation, Pittsburgh, PA), or a Chemlmage Corporation EAGLE (TM) field-hardened instrument, outfitted with the simultaneous imaging and spectroscopy apparatus offered by that supplier for use with the instrument.
  • TM FALCON Raman microscope
  • TM Chemlmage Corporation EAGLE
  • a suitable instrument upon which such systems can be based is an ultraviolet (UV) / visible (vis) /near infrared (NTR) fluorescence or Raman macroscope, or a UV/Vis/NIR/Mid-IR (mid-infrared) absorption/reflectance macroscope system such as the CONDOR Macroscope (TM; Chemlmage Corporation, Pittsburgh, PA).
  • UV ultraviolet
  • NIR near infrared
  • UV/Vis/NIR/Mid-IR (mid-infrared) absorption/reflectance macroscope system such as the CONDOR Macroscope (TM; Chemlmage Corporation, Pittsburgh, PA).
  • Another suitable device is a laboratory or field fiberscope such as the RAVEN endoscope (TM; Chemlmage Corporation, Pittsburgh, PA).
  • Other suitable devices are described in U.S. Patent 6,002,476. Any of these instruments can be used alone or with additional optics, such as a laboratory or field Fiber-Array Spectral Translator (
  • an air sampling biothreat detector can be constructed by combining several components.
  • a sampler or collector element can be used to gather particulates and/or aerosols from an air sample.
  • the collected particles can be deposited on a surface suitable as a substrate for Raman and other optical analysis.
  • the surface can be a continuous sheet of material which is advanced constantly, intermittently, or at will in front of the optical detection systems described herein.
  • the particles can be sorted (e.g., electrostatically) prior to deposition on the substrate.
  • optical detection systems e.g., optical microscopy to determine particle morphology, fluorescence imaging to determine biological or non-biological origin, and Raman spectroscopy or imaging to identify particular entities identified as suspicious by optical and/or fluorescent analysis
  • logic operations e.g., activating an alarm upon the detection of a target of interest.
  • These systems can be automated through the use of robotics or combined macro/micro instrumentation in order to target analytes of interest. Using laser ablation and/or chemical ablation, the system can be automated to eradicate hazardous agents post- targeting, for example.
  • Such a system should provide fast acquisition times (on the order of seconds), high spatial resolution (sub-micron), and good spectral resolution ( ⁇ 200 nanometers).
  • the multimodal spectroscopic imaging microscope combines in a single platform a solid state laser for sample excitation (e.g., for Raman and laser-induced fluorescence), a refractive optical microscope base, which is equipped with infinity- corrected microscope objectives, an automated XYZ translational microscope stage, and a quartz tungsten halogen (QTH) lamp and/or a mercury (Hg) lamp.
  • sample excitation e.g., for Raman and laser-induced fluorescence
  • a refractive optical microscope base which is equipped with infinity- corrected microscope objectives
  • an automated XYZ translational microscope stage an automated XYZ translational microscope stage
  • QTH quartz tungsten halogen
  • Hg mercury
  • microscope system is an analog color charge-coupled device (CCD) detector for ordinary optical image collection and digital image collection, a liquid crystal spectrometer or other multi-point spectrometer technology including AOTF, scanned linearly variable or rotated circularly variable dielectric filters, angle-rotated Fabry Perot dielectric or other bandpass filter, interferometers including Michelson and Zagnac types, or dispersive spectrometers.
  • CCD color charge-coupled device
  • thermoelectrically cooled (TE) silicon (Si) CCD i.e., TE Si CCD
  • CMOS complementary metal oxide semiconductor
  • UV, visible, or NIR illumination is directed to the sample in a reflected light configuration using a QTH source or other broadband white light source, including metal halide, Hg arc lamps, or Xe arc lamps or a transmitted light configuration using QTH or other suitable source of a refractive optical microscope platform.
  • a Raman or laser- induced fluorescence experiment laser radiation is introduced to the sample through use of a Raman illuminator. Light scattered, emitted, reflected, or transmitted is collected from the sample positioned on the automated XYZ translational microscope stage through an infinity-corrected microscope objective.
  • Ordinary optical imagery of the sample can be obtained using a mirror or using a beamsplitter or prism arrangement inserted into a turret wheel of the microscope by collecting an image with an analog or digital color or monochrome CCD or CMOS detector.
  • the magnified spectroscopic image is coupled through an imaging spectrometer and collected on a NIR or mid-IR focal plane array (FPA) detector (for IR spectroscopic imaging) or a Si CCD detector (for UV/visible absorption/reflectance, fluorescence, or Raman spectroscopic imaging).
  • FPA focal plane array
  • Si CCD detector for UV/visible absorption/reflectance, fluorescence, or Raman spectroscopic imaging.
  • the IR FPA is typically comprised of indium gallium arsenide (InGaAs), but may be comprised of other IR sensitive materials, including platinum suicide (PtSi), indium antimonide (InSb), or mercury cadmium telluride (HgCdTe). Suitable FPA detectors are known in the art.
  • a central processing unit such as a PENTIUM (RTM) processor-based computer, can be used for control of spectroscopic image collection and processing.
  • the analog color CCD, IR FPA, Si CCD, automated XYZ translational microscope stage, a liquid crystal tunable filter, an imaging spectrometer, other components of the instruments, or some combination of these can be controlled by the computer.
  • CHEMACQUIRE TM; Chemlmage Corporation, Pittsburgh, PA
  • CHEMANALYZE TM; Chemlmage Corporation, Pittsburgh, PA
  • CHEMIMAGE XPERT TM; Chemlmage Corporation, Pittsburgh, PA
  • a portion of the signal from the sample may be coupled to a remote dispersive spectrometer.
  • the spectrometers can include one or more of the following types: fixed filter spectrometers; grating based spectrometers; Fourier transform spectrometers; and acousto-optic spectrometers.
  • a polarization independent interferometer such as a Michelson interferometer, a Sagnac interferometer, a Twynam-Green Interferometer, or a Mach- Zehnder Interferometer can be used as a filter.
  • Liquid crystal (LC) sensing spectrometer technology is used for wavelength selection.
  • the LC sensing spectrometer may be of the following types: Lyot liquid crystal tunable filter (LCTF); Evans Split-Element LCTF; Sole LCTF; Ferroelectric LCTF; Liquid crystal Fabry Perot (LCFP); or a hybrid filter technology comprised of a combination of the above-mentioned LC filter types.
  • fixed bandpass and band rejection filters comprised of dielectric, rugate, holographic, color absorption, acousto-optic, or polarization types may also be used, either alone or in combination with one of the above LC spectrometers.
  • Novel tunable filter designs identified as bi-refi ⁇ ngent interference spectrally agile filter element (BISAFE) as well as micro-opto-electromechanical (MOEM) based spectrometers have characteristics that enable multi-point imaging with a smaller form factor than conventional filter designs and are suitable for use in handheld and portable devices.
  • Spectral diversity filters and a photonic crystal filters are also suitable for the purposes described herein.
  • New solid state multi-point detector designs can reduce the cost of the detector without compromising the ability to perform multi-point spectral sensing.
  • the BISAFE filter which is described in co-pending U.S. patent application no. 10/893,331, filed on 19 July 2004 and in U.S. provisional patent application no. 60/488,246, filed on 18 July 2003, is a linearly tunable filter that allows line imaging. Spectral data is obtained in different spectral ranges and at different locations (i.e., lines) of the sample simultaneously.
  • the MOEMS filter which is described in co-pending U.S. patent application no. 10/893,332, filed on 19 July 2004 and in U.S. provisional patent application no.
  • 60/488,246, filed on 18 July 2003 senses different spectral regions along strips of the silicon plates forming this MOEMS device. These strips define the regions selected on the sample by positioning plates using MEMS microactuators. Images can be reconstructed (if desired) by stepping the sample position.
  • This device can operate either in a transmission mode, in which the light travels parallel to the substrate and normal to the Si plates, or in a transmission-reflection mode, in which light travels normal to the substrate and normal to the silicon plates.
  • Such devices allow a trade-off between selection of spatial position or spectral resolution in a simple design.
  • Grating spectrometers can be used with FAST technology for wavelength and multi-point spectra collection. Such spectrometers allow a plurality (e.g., a group or line) of points along the sample to be sampled at each wavelength setting of the spectrometer during each measurement. This allows efficient data collection of many points at the same time, thereby providing many spatially distinct spectra to be obtained at once during one scan over the spectral regions of interest.
  • the multimodal spectral sensing microscope can also be used as a volumetric imaging instrument by moving the sample through the focus plane in the Z-axial dimension (i.e., in a direction normal to the 2-dimensional XfY plane of image analysis), collecting images in and out of focus, and reconstructing a volumetric data of the sample using appropriate software, which is commercially available and/or within the ordinary level of skill in this field.
  • volumetric spectroscopic reconstruction is useful for failure analysis, product development, and routine quality monitoring. Quantitative analysis can be performed simultaneously with volumetric analysis.
  • Microscope-based spectroscopic sensing systems have the advantage of being able to detect, classify, identify, and visualize entities such as BWAs at the level of a single bacterium, for instance. These systems exhibit a spectral resolution on the order of 8 cm and a spatial resolution of approximately 200 nanometers using numerical deconvolution methods.
  • the spectroscopic multimodal sensing macroscope combines in a single platform an illumination subassembly consisting of an illumination source (e.g., a QTH, Xe, Hg, or metal halide lamp), a barrier optical filter(s), and a light-directing module (e.g., direct beam, fiber optic, or liquid light guide illumination).
  • an illumination source e.g., a QTH, Xe, Hg, or metal halide lamp
  • a barrier optical filter(s) e.g., direct beam, fiber optic, or liquid light guide illumination
  • a radiation detector such as an analog color CCD detector is used for optical and digital image collection. Wavelength selection can be performed using a liquid crystal tunable filter or multi-point spectrometer.
  • the imaging detector can be a room temperature (or optionally cooled) NIR FPA (for NIR image capture) or a room temperature or thermoelectrically cooled Si CCD detector (for UV/visible and fluorescence image capture), for example.
  • UV, visible, or NIR illumination is directed to the sample in a reflected light configuration using a QTH source or other broadband white light source, including metal halide, Hg arc lamps, or Xe arc lamps or a in transmitted light configuration using QTH or other suitable source through direct illumination, fiber optics, or liquid light guides.
  • a QTH source or other broadband white light source including metal halide, Hg arc lamps, or Xe arc lamps or a in transmitted light configuration using QTH or other suitable source through direct illumination, fiber optics, or liquid light guides.
  • Light emitted, reflected, or transmitted is collected from the sample positioned on the macroscopic sample base through a macro lens.
  • Ordinary optical imagery of the sample may be obtained using a mirror or beamsplitter or prism arrangement inserted into the collection stack of the macroscope and collecting an image with an analog or digital color or monochrome CCD or CMOS detector.
  • the spectroscopic points sampled are coupled through a liquid crystal spectrometer and collected on a NIR FPA detector (for NIR spectroscopic imaging) or a Si CCD detector (for UV/visible absorption/reflectance, fluorescence, and Raman spectroscopic imaging).
  • a computer such as a PENTIUM (RTM) processor-based computer, can be used for multimodal spectroscopic data collection and processing as described herein.
  • Liquid crystal (LC) spectrometer technology can be used for wavelength selection.
  • the LC spectrometer can be of any of the types described herein.
  • fixed bandpass and bandreject filters of the types described herein can be used, either alone or in combination with an LC spectrometer. These filters can select an arbitrary or random set of points for sampling or a well defined set of points determined by the sampling approach and/or the requirements for high performance of the spectrometer.
  • a resistive anode array used as a photon detector favors selection of linear points along the sample.
  • a FAST array can be arranged in linear fashion or another collection geometry to facilitate data acquisition.
  • Grating spectrometers can be used in the FAST configuration for wavelength and multi-point spectra collection. Such spectrometers used with FAST technology allow an arbitrary arrangement of points on the sample to be sampled at each wavelength setting of the spectrometer. This permits efficient data collection of many points at the same time and collection of spatially distinct spectra during a single scan over the spectral regions of interest .
  • a macroscope-based system enables rapid detection of potential hazardous agents over a large area, such as the surfaces and contents of envelopes and packages received by mail and analysis of surfaces in remote locations.
  • rapid sample analysis strategies e.g., fluorescence imaging when analyzing the presence of hazardous agents
  • fluorescence imaging when analyzing the presence of hazardous agents
  • An example of this methodology is depicted in Figure 3.
  • the macroscope can be used to optically sight sample areas which appear suspect. Fluorescence screening of the selected area can indicate portions which do not fluoresce, and therefore do not appear to be of biological origin. Fluorescing portions of the selected area (or entities within that area) can be further analyzed by Raman chemical imaging to differentiate potential biological threats from non- threatening entities.
  • Spectroscopic sensing has traditionally been performed in laboratory settings using research-grade light microscope technology as an image-gathering platform for selection of specific points.
  • multimodal spectroscopic sensing is also applicable to in situ industrial process monitoring and in vivo clinical analysis.
  • the application of multimodal spectroscopic sensing outside the research laboratory has been limited by the lack of availability of stable spectroscopic and/or optical selection/detection platforms that are compatible with the physical demands of industrial process monitoring and clinical environments. Both industrial and clinical settings often require compact, lightweight instrumentation suitable for the examination of remote areas that are inaccessible to conventional spectroscopic instrumentation.
  • the liquid crystal endoscope is the first flexible multi-point endoscopic technology that provides real-time video inspection capability with spectral analysis.
  • the endoscope comprising from two to thousands of independent fibers arranged in a fiber bundle, couples to a video CCD for real-time video imaging of the analysis area. This allows for quick visual screening of the sample.
  • the endoscope tip is engineered to filter laser illumination and collect Raman scattered radiation and fluorescent emissions (for Raman and fluorescence applications).
  • the light from the laser delivery fiber is filtered so that substantially only the laser wavelength is presented to the sample.
  • the laser light is removed from the collected light so that Raman information is detectable to within 200 cm of the laser line.
  • the distal end of the liquid crystal Raman endoscope is environmentally resistant and can withstand continuous operation at high temperatures and has been demonstrated to operate from 0 to 315 degrees Celsius while maintaining high signal to background performance.
  • the distal end can be coupled to a microscope-based system enabling dispersive spectroscopy and multi-point spectroscopic sensing to be performed remotely.
  • An endoscope-based spectroscopic sensing system is useful for detecting the presence of a hazardous agent in a remote location, such as the interior of a box or envelope, for example.
  • Fiber optic arrays We have termed this technology Fiber Array Spectral Translators (FAST) but it is also accurately described as dimension reduction arrays. FAST technology can acquire a few to thousands of full spectral range, spatially resolved spectra simultaneously. For imaging this is done by focusing a spectroscopic image onto a two dimensional array of optical fibers that are drawn into a one-dimensional distal array with serpentine ordering. The one dimensional fiber stack is coupled to an imaging spectrograph. Software then extracts the spectral/spatial information that is embedded in a single CCD image frame. Fiber array spectroscopic imaging has been demonstrated in several applications including Raman chemical imaging analysis of micro-composites and biomaterials and time-resolved atomic emission chemical imaging of laser-induced plumes.
  • An advantage of this method over other current point spectroscopic detection methods is speed of analysis.
  • a complete spectroscopic data set can be acquired in the amount of time it takes to generate a single spectrum from a given material.
  • Even with limited pixel definition, comparing low-resolution spectral data with high-spatial resolution optical images can provide significant insight into the morphology and chemistry of the materials in the field of view.
  • the invention includes an ambient air sensor system comprising two parts, a sampling system and a spectroscopic imaging system.
  • the optics block of such a system is shown diagrammatically in Figure 2.
  • This block supports a section of a sample collection substrate such as a filter medium (e.g., a microporous filter medium having pores sufficiently small to substantially prevent passage of the hazardous agent of interest or a coated filter medium having pores large enough to permit passage of the hazardous agent of interest, but coated with an oil or other substance to which passing particles can adhere or into which passing molecules can be absorbed or dissolved) and provides an airtight seal around the periphery of the sampling area.
  • a filter medium e.g., a microporous filter medium having pores sufficiently small to substantially prevent passage of the hazardous agent of interest or a coated filter medium having pores large enough to permit passage of the hazardous agent of interest, but coated with an oil or other substance to which passing particles can adhere or into which passing molecules can be absorbed or dissolved
  • This block should be easily opened so that either a new filter (when the system uses discrete filters as the substrate) or a new section of filter (when the system uses a continuous filter substrate) can be placed in the sampling/optics path.
  • a drive e.g., a manual crank or a motor
  • the drive can be controlled by the same controller (or computer, if separate) used to control the optics.
  • the sampling system has an inlet, which is open to the atmosphere being tested. Its dimensions are optimized for the sampling flow rate and the anticipated range of particle sizes. For particulate or aerosol sampling, it is important that the inlet have no sharp bends or areas of low linear velocity, which can cause deposition of particulates prior to the collection filter.
  • the sampling system includes or is connected to a sampling pump, which provides negative pressure to pull ambient air through the filter. Operation using positive pressure to force ambient air against the substrate is also possible. Air flow rates are in the range from 0.5 to 2.0 liters per minute are considered suitable for sampling, and a vacuum of about 100 inches of water (180 millimeters of mercury) should suffice to collect particulates in such a volume in a reasonable sample substrate area.
  • the sampling system can be operated continuously or, preferably, during a series of discrete sampling periods. At the end of each period, the sample collection substrate can be replaced (or advanced if a continuous medium is used). This can be done either by the operator or automatically. For continuous or interrupted sampling, the substrate can be in a tape-like filter configuration and new samples of filter can be positioned in the optics block by a tape-drive mechanism, similar to that of an audiocassette.
  • a wide variety of appropriate sample collection medium are known, including filter media such as porous polypropylene media and aluminum media, in disk, sheet, and roll forms. Selection of an appropriate sample collection substrate is within the ken of a skilled artisan.
  • multimodal spectroscopy is used to detect and classify the hazardous agent(s) present.
  • the excitation source is a laser which is coupled to the optics block using conventional or fiber optics to distribute the laser output over the sampling area, Raman imaging can be used.
  • the laser illumination can be shaped and/or split to match the distribution of points being selected (e.g., based on other optical properties of particulates on the substrate) or sampled.
  • a light source comprised of a broadband UV/visible (UV/Vis), filtered UV/Vis, or a UV/Vis laser can be used to excite autofluorescence.
  • the detector can be of the liquid crystal tunable type or another multi-point spectrometer type as described herein, and a CCD or other array camera can be used to define the sampling area at multiple wavelengths. Coupling of the detector to the optics block can be through fiber- based or conventional optics.
  • the detector data is processed using chemometric and data analysis tools such as those in the CHEMANAL YZE (TM) and CHEMIMAGE XPERT (TM) software packages.
  • the ambient air monitor can be operated intermittently, for example as a series of sampling periods during which periodic spectroscopic measurements are taken.
  • the sampling periods can follow one another immediately (i.e., a subsequent sampling period begins immediately following the preceding sampling period) or be interrupted by a period of time (e.g., sampling periods interrupted by a 20 minute delay).
  • the results from the previous and current sampling periods can interpreted by a system computer which can display results and activate warning and danger alarms, or initiate some action such as turning off a building outside air intake.
  • the methods described in this section can be performed using a system or method for detecting dynamic changes that occur in a sample between a first time interval and a second time interval using a series of at least first and second sequential chemical images of the sample.
  • the first chemical image corresponds to an image of the sample during a first time interval.
  • the second chemical image corresponds to an image of the sample at a second time interval after the first time interval.
  • the sample is illuminated with a plurality of photons to thereby produce photons scattered or emitted by the sample;
  • a two- dimensional array of detection elements is then used to simultaneously detect scattered or emitted photons in a first predetermined wavelength band from different locations on or within the sample; and
  • the two-dimensional array of detection elements is thereafter used one or more further times to simultaneously detect scattered or emitted photons in one or more further predetermined wavelength band(s) from different locations on or within the sample.
  • the outputs of the two-dimensional array of detection elements during the first time interval are then combined to generate the first chemical image of the sample.
  • the sample is illuminated with a plurality of photons to thereby produce photons scattered or emitted by the sample; (ii) the two- dimensional array of detection elements is then used to simultaneously detect scattered or emitted photons in a first predetermined wavelength band from different locations on or within the sample; and (iii) the two-dimensional array of detection elements is thereafter used one or more further times to simultaneously detect scattered or emitted photons in one or more further predetermined wavelength band(s) from different locations on or within the sample.
  • the outputs of the two-dimensional array of detection elements during the second time interval are then combined to generate the second chemical image of the sample.
  • Dynamic changes occurring in the sample between the first time interval and the second time interval are detected based on one or more differences between the first and second chemical images.
  • the present invention permits rapid observation of the sample with full spatial information, and allows the monitoring of the evolution and changes in the sample that are naturally proceeding or occurring (i.e., under equilibrium conditions,) as well as those that are additionally forced or imposed by creating a non-equilibrium condition via an external means (e.g., one or more external fields or forces applied to the sample).
  • an external means e.g., one or more external fields or forces applied to the sample.
  • the external means may be applied to a specific location within the sample (rather than the whole sample).
  • Figure 10 schematically represents an apparatus according to one embodiment of the disclosure.
  • the apparatus shown in Figure 10 enables providing a high optical throughput for imaging low light levels at variable magnification.
  • sample 1000 is positioned on substrate 1050.
  • Substrate 1050 can be any conventional microscopic slide or other means for receiving and optionally securing sample 1000.
  • Light source 1100 is positioned to provide incident light to sample 1000.
  • Light source 1100 can include any conventional photon source, including laser, LED, and other IR or near IR devices.
  • Light source 1100 may also be selected to provide evanescence illumination of the sample. In one embodiment, the bandwidth of the source is in the range of about 15-25 cm " .
  • light source 1100 is positioned to provide incident light at an angle to sample 1000 as opposed to light shining orthogonal to sample 1000.
  • the radiation used to illuminate the sample need not pass through the optical train of a conventional microscope (or macroscope); rather, it can illuminate the sample at an oblique angle from above or below sample 1000.
  • Photon beam 1120 is received and deflected by mirror 1150 through lens 1200.
  • Lens 1200 may optionally be used to focus the light on sample 1000. Alternatively, the photon beam 1120 may be directed towards the sample 1000 without the need for the mirror 1150.
  • Optical lens 1250 is positioned to receive photon beams 1160 and l l80.
  • Optical lens 1250 may be used for gathering and focusing received photon beams. This includes gathering and focusing both polarized and non-polarized photons.
  • the sample size determines the choice of light gathering optical lens 1250.
  • a microscope lens may be employed for analysis of the sub-micron to micrometer specimens.
  • macro lenses can be used.
  • Optical lens 1250 (as well as lens 1200) may include a simple reduced resolution/aberration lens with a larger numerical aperture to thereby increase system's optical throughput and efficiency.
  • Mirror 1300 is positioned to direct emitted or scattered photon beams 1180 to tunable filter 1400.
  • Laser rejection filter 1350 may be positioned prior to tunable filter 1400 to filter out scattered illumination light represented by beam 1160 and to optimize the performance of the system. In other words, rejection filter 1350 enables spectrally filtering of the photons at the illuminating wavelength.
  • a conventional tunable filter can be used to further the principles of the disclosure.
  • suitable tunable filters include an liquid crystal tunable filter (“LCTF”) or an acousto-optical tunable filter (“AOTF”).
  • the electro-optical filters (or other tunable filters) allow specific wavelengths or ranges of wavelengths of light to pass through as an image, depending on the control signals placed on the device by a controller.
  • the wavelengths that can be passed through tunable filter 1400 may range from 200 nanometers (ultraviolet) to 2000 nanometers (i.e., the far infrared). The choice of wavelength depends on the desired optical region and/or the nature of the sample being analyzed.
  • Image sensor 1450 may be a digital device such as for example a two- dimensional, image focal plane array (“FPA”) or CCD or CMOS sensor.
  • FPA image focal plane array
  • the optical region employed to characterize the sample of interest governs the choice of FPA detector.
  • FPA detector For example, a two-dimensional array of silicon charge-coupled device (“CCD”) detection elements, can be employed with visible wavelength fluorescence and Raman spectroscopic, while gallium arsenide (GaAs) and gallium indium arsenide (GaInAs) FPA detectors can be employed for image analyses at near infrared wavelengths. The choice of such devices depends on the type of sample being analyzed.
  • CCD silicon charge-coupled device
  • each detection element in the two-dimensional array of detection elements used to form image sensor 1450 functions to detect photons scattered or emitted from a different spatial location on or within the sample.
  • image sensor 1450 produces digital images of the entire view of the sample as processed by tunable filter 1400.
  • Figure 11 schematically represents an apparatus according to another embodiment of the disclosure. More specifically, Figure 11 schematically shows a high optical throughput configuration for imaging low light levels at variable magnification. The collection of optics are similar to that illustrated in Figure 10 but with illumination from the underside of sample 1000.
  • sample 1000 is illuminated at an oblique angle.
  • photonic beam 1200 and the plane axis of sample 1000 define an oblique angle.
  • a so-called "Dark Field Raman Imaging” is developed.
  • the dark field Raman imaging decouples the image capture optics from the delivery of exciting radiation. Consequently, internal scattering and attenuation of the incident radiation has been minimized to improve the signal-to-noise (S/N) ratio.
  • the location of the optical source external to the optical train further allows the use of a lower cost, less powerful illumination source as well as enables a simpler, less expensive integration of several illumination sources into the system.
  • the application of this configuration is not limited to Raman and luminescence imaging and can be successfully used, for example, with conventional spectroscopy.
  • a computer or processor can be coupled to and used to control the optical devices including light source (1100), lenses (1200, 1250, 1350), mirrors (1150, 1300) and tunable filter (1400).
  • the computer is also coupled to image sensor 1450 and functions to generate "chemical images" from the output of the image sensor 1450.
  • each chemical image is a spatially accurate wavelength-resolved image of the sample that is formed from multiple "frames"; wherein each frame has plural spatial dimensions and is created from photons of a particular wavelength (or wave number) or from photons in a particular wavelength band (or wave number band) that are collected simultaneously by image sensor 1450 from different spatial locations on or within sample 1000.
  • each chemical image multiple frames may be combined to form a complete image across all wavelengths (wave numbers) of interest.
  • the chemical images generated by the computer may be further analyzed by the computer and/or displayed to a user.
  • the present invention uses an apparatus such as those shown in Figures 10 and 11 to detect dynamic changes that occur in sample 1000 between a first time interval and a second subsequent time interval using a series of at least first and second sequential chemical images of sample 1000.
  • sample 1000 is illuminated with photons from source 1100 to thereby produce photons scattered or emitted by sample 1000;
  • image sensor 1450 is then used to simultaneously detect scattered or emitted photons in a first predetermined wavelength band (selected by tunable filter 1400) from different locations on or within the sample; and
  • image sensor 1450 is thereafter used to simultaneously detect scattered or emitted photons from different locations on or within the sample.
  • the outputs of detector 1450 (for each of the wavelengths or wavelength bands selected by tunable filter 1400 during the first time interval) are then combined by a computer (not shown in the figures) to generate the first chemical image of the sample.
  • sample 1000 is illuminated with photons from source 1100 to thereby produce photons scattered or emitted by sample 1000;
  • image sensor 1450 is then used to simultaneously detect scattered or emitted photons in a first predetermined wavelength band (selected by tunable filter 1400) from different locations on or within the sample; and
  • image sensor 1450 is thereafter used to simultaneously detect scattered or emitted photons from different locations on or within the sample.
  • the outputs of detector 1450 (for each of the wavelengths or wavelength bands selected by tunable filter 1400 during the first time interval) are then combined by the computer to generate the second chemical image of the sample.
  • Dynamic changes occurring in the sample between the first time interval and the second time interval are detected based on one or more differences between the first and second chemical images.
  • Computer analysis of the chemical image with or without the physical image may be used to detect (or enhance detection of) the dynamic changes.
  • the dynamic changes may also be detected by a user viewing a display of the chemical images.
  • a series of many sequential chemical images are obtained rapidly in succession to generate a "movie" of the sample. For example, as many as 100 chemical images per second of the sample may be obtained in order to detect dynamic changes in the sample in substantially real-time.
  • the temporal resolution of the chemical images in the sequence maybe as fine a 1 millisecond, i.e., the system will generate a chemical image of the sample every millisecond.
  • Other temporal resolutions can also be selected including, for example, a temporal resolution that equates to chemical images spaced apart by as much as 15 minutes between adjacent images.
  • the temporal resolution selected should be sufficient to detect dynamic changes of interest that occur in the sample over time.
  • the present invention thus permits rapid observation of sample 1000 with full spatial information, and allows the monitoring of the evolution and changes in sample 1000 that are natural proceeding or occurring (i.e., under equilibrium conditions), as well as those that are additionally forced or imposed by creating a non-equilibrium condition via an external means (e.g., one or more external fields or forces applied to the sample).
  • the external means are applied to a specific location within sample 1000 (rather than to the whole sample).
  • Examples of samples that may be analyzed and observed used the dynamic chemical imaging techniques of the present invention includes biological samples or micro-fluidic circuits undergoing changes over time. These changes may include displacement, chemical interaction, a change in chemical state, phase change, growth, shrinkage, chemical decomposition, chemical metabolism, and physical strain. Numerous other examples of samples/changes applicable to the present invention will be recognized by the those skilled in the art and are considered within the scope of the present invention.
  • the present invention may be used to detect dynamic changes in the sample that result from application of an external condition to the sample.
  • external conditions include, for example, varying an electric or magnetic field applied to or within sample 1000 between the first and second time intervals; varying an external optical field applied to or within the sample between the first and second time intervals, wherein the external optical field is distinct from the optical field initially used to illuminate the sample; varying the optical field applied to or within the sample between the first and second time intervals, wherein the additional optical field is produced by pulsing the optical filed used to illuminate the sample; varying internally generated photons applied to or within the sample between the first and second time intervals; varying a polarization used to illuminate the sample between the first and second time intervals; varying a temperature of the sample between the first and second time intervals; varying a pressure applied to the sample between the first and second time intervals; or varying a stress applied to or within the sample between the first and second time intervals, m other embodiments, a chemical gradient associated
  • each chemical image in the sequence is made up of multiple separate spatially accurate wavelength-resolved images of the sample (each of which is formed from multiple "frames" as discussed above), wherein each of the multiple separate spatially accurate wavelength-resolved images corresponds to one of a plurality of different depths within the sample.
  • These embodiments are useful for detecting chemical changes occurring throughout the volume of sample 1000, rather than changes occurring on a single surface or plane of the sample.
  • differences between or among various chemical images in the sequence may be correlated (using, e.g., the computer discussed above or by a user) with orthogonal (i.e., complementary) measurements of the sample made during each of the time intervals associated with the sequence, in order to enhance detection or observation of dynamic changes in the sample.
  • orthogonal measurements include measurements made using the following modalities: Raman scattering, near infrared absorption (NIR), visual imagery, video or luminescence. Other orthogonal measurements may also be used and are considered to be within the scope of the present invention.
  • Figure 7 shows an optical image ( Figure 7A), a Raman chemical image ( Figure 7B), and a fluorescent image ( Figure 7C) obtained from a mixture of Bacillus anthracis in a mixture medium components and formalin.
  • Figures 7D and 7E are examples of image fusion of the optical image shown in Figure 7 A with the spectroscopic images shown in Figures 7B and 7C, respectively.
  • Figure 4A depicts dispersive Raman spectra take from three different samples, each comprising one bacterial spore type. This demonstrates that despite the genetic and morphological similarities, Raman spectroscopy can be used to sufficiently discriminate among the different bacteria spores. The ability to distinguish the different spectra of small objects during one spectral scan is important for picking out and discriminating entities such as BWAs or CWAs in a mixture.
  • Figure 6 depicts how spectral sensing and analysis using a fluorescence system can also be used to discriminate and distinguish different Bacillus species.
  • the fluorescence spectra in Figure 6C were obtained for the two Bacillus types. Based on differences in these fluorescence spectra, particularly the peaks, Bacillus subtilis spores (which exhibit a fluorescence peak maximum at 630 nanometers) can be distinguished from Bacillus pumilus spores (which exhibit a fluorescence peak maximum at 540 nanometers).
  • Images in Figures 6A and 6B depict the same microscopic field using different fluorescent spectral imaging wavelengths.
  • Figure 8 depicts how fluorescent and visible spectral analysis in a macroscope system allows one to detect B. globigii candidate entities in a mixture of B. globigii and baking soda on the outside of an envelope.
  • Raman spectral imaging of the sample areas (or one or more pixels within the areas) designated PtI, Pt2, and Pt3 can be used to confirm the identities of the compounds identified by fluorescent spectrum in Figure 8D by comparison with reference Raman spectra for those compounds.
  • Anthrax spores have been Raman imaged in a secure biohazard laboratory. Different strains of Anthrax spores have been differentiated by Raman spectroscopy and Raman imaging. Additionally, Raman spectral analysis of chemical images (i.e., Raman chemical imaging) has been used to differentiate same species and strain grown under different environmental conditions and/or growth medium. This ability can have useful investigatory applications. Similarly, Raman spectral analysis has been used to differentiate viable from non- viable endospores. Viability of suspect spores is a critical variable in determining the real threat posed.
  • Figure 5B depicts an image of a sample comprising at least three different materials.
  • Figure 5 A depicts Raman spectra of three components known to be present in the sample. Raman spectral analyses of the boxed portions of Figure 5B indicate the identity of the entities within the boxes.
  • the colors corresponding to selected RS values in composite images including Raman scattering and other spectroscopic data can be the actual colors of Raman shifted light or pseudocolors. Pseudocolors can be selected to maximize contrast with other image components, to be consistent with pseudocolors used in separate images, to yield visually appealing images, or arbitrarily selected, for example.
  • a wide variety of biological pathogens can be detected using the multimodal spectral sensing methods described herein (i.e., for detection, classification as to species or strain, determination of viability, or some combination of these).
  • eukaryotes such as protozoans and fungi (e.g., Giardia species, Candida albicans, or Cryptosporidium species in water or soil); bacteria (e.g., Escherichia coli, Yersinia pestis, Francisella tularensis, Brucella species, Clostridium perfringens and other species of Clostridium, Burkholderia mallei, Burkholderia pseudomallei, Chlamydia psittaci, Coxiella burnetii, Rickettsia prowazekii, Vibrio species, Enterococcus faecalis, Staphylococcus epidermidis, Staphylococcus aureus, Enterobacter aerogene
  • the methods can also be used to detect the causative agents of any viral, bacterial, parasitic, or prion disorder, including for example causative agents of disorders such as tularemia, brucellosis, glanders, melioidosis, psittacosis, Q fever, typhus, smallpox, and encephalitis.
  • causative agents of disorders such as tularemia, brucellosis, glanders, melioidosis, psittacosis, Q fever, typhus, smallpox, and encephalitis.
  • toxic components in a masking mixture can be detected, so can specific materials in other mixtures be similarly determined. These includes but is not limited to a wide range of mixtures such as hazardous agents in blood, impurities or active ingredients in drug tablets, and specific entities among airborne particulates.
  • a variety of data processing procedures can be used with these systems.
  • a weighted multi-point spectral data subtraction routine can be used to suppress contribution from the sample background or sample support (e.g., Raman light scattered by a microscope slide).
  • multivariate spectral analysis involving principal factor analysis and subsequent factor rotation can be used for differentiation of pure molecular features in hazardous agents, and other entities (e.g., non-threatening 'masking' compounds).
  • PCA principal component analysis
  • the devices, systems, and methods described herein are suitable for rapid (chemical and/or biological) detection of hazardous agents and other applications.
  • Configured in the macroscopic version of the technology multimodal spectroscopic sensing can be employed for rapid assessment of large areas for suspect hazardous agents based on their fluorescence, NIR, UV/visible properties, or on some combination of these properties.
  • Configured in the microscopic mode visualization, positive detection, classification, and identification of suspect hazardous agents can be made.
  • Configured in the endoscopic mode hazardous agents can be visualized, detected, classified, and identified remotely.
  • Configured in FAST mode hazardous agents can be detected, classified, identified, and visualized remotely or at the microscope in real-time.
  • unambiguous detection of airborne hazardous agents can be performed.
  • ALERT Tetracore Inc, Gaithersburg, MD; BTA test strips, DNA-based tests, DNA chip analyses, and mass spectrometry.
  • Inoculation methods involve the inoculation of suspect culture or specimen into an animal that is then observed for development of disease.
  • drawbacks with this approach including the extensive amount of time required to achieve detection.
  • ELISA tests involve antibody detection. This technique is also slow and suffers from a high rate of false positive results (e.g., unrelated antibody reacts with antigen nonspecifically) and false negative results (e.g., interfering compounds present in blood or antibodies not concentrated enough to be detected). Furthermore, a patient can test positive to antibodies long after the patient has recovered.
  • BTA test strips are small plastic devices that work very much like a home pregnancy test.
  • the test strips contain specific antibodies that change color on the strip indicating the presence of a bio-threat agent.
  • a negative result means the bio-threat agent is not present within the detection limit of the strip.
  • DNA-based tests detect biological agents by recognizing their genetic sequences.
  • DNA chip analysis involves the immobilization of DNA strands on a Si or glass wafer chip. DNA will bind to or hybridize complementary
  • PCR polymerase chain reaction
  • DNA-based methods are two-fold. First, DNA methods are designed to detect a specific bio-threat agent through its unique DNA sequences. Therefore, each DNA test is specific to one agent and if it is desired to detect additional agents, additional test reagents must be developed. A second limitation revolves to the problems of false negatives and false positives due to environmental contamination. DNA tests are well known to have problems yielding correct results in "real-world" samples.
  • Mass Spectrometry uses the pattern of mass fragments generated when a cell, spore, or chemical is subjected to an ionization process under high vacuum to characterize the organism(s) or chemical(s) present in a sample.
  • This technique has the advantage of very sensitive detection, but requires a sophisticated sampling system in order to deliver a representative sample to the ionizer.
  • the main limitation of MS is that it requires the use of high vacuum pumps that are inherently delicate and expensive. An additional limitation is that it is a destructive technique.
  • Alternative embodiments of the devices and systems described herein include probes or microscopes based on spectroscopic methods including Raman, fluorescence, NIR, and others for rapid, non-contact, and accurate detection of hazardous agents. Similar techniques have been previously applied in a time-consuming approach involving spectroscopically addressing individual points in a sample, one at a time.
  • the multimodal spectral sensing methods described herein rapidly provide data needed for automated spectral analytical methods. Partial component analysis approaches can be used in combination with these methods for chemical imaging analysis.
  • the multimodal spectral sensing methodology described herein can be implemented in a miniaturized, compact sensing platform.
  • the devices, systems, and methods described herein can be used to identify the distribution of individual hazardous agents in the presence of other hazardous agents, environmental contaminants, and/or non-threatening 'masking' agents, in either local and remote environments. These are characteristics that no traditional method provides.
  • the devices, systems, and methods described herein can exhibit a lower incidence of false positive and false negative results, and permit one to determine if a true threat exists in a time frame of minutes.
  • Trimodal chemical imaging of Fluorescein-5-isothiocyanate (FITC) [0186] Integrated fluorescence imaging of cells is a well-established technology in the field of fluorescence-based cell and molecular biochemical assays. In particular, this method is widely used for detection of drug-cell interactions as part of drug discovery and development.
  • This type of imaging is generally carried out using bandpass optical filters, and in so doing provides no information regarding changes in band shape or peak position related to the chemical environment or interactions of the molecular probes.
  • hyperspectral fluorescence imaging provides spectra associated with each pixel of the image, thereby revealing information about the chemical environment and molecular interactions at each spatial location in the field of view. Additional hyperspectral modalities that can be applied to that same field of view include visible absorption and Raman imaging. The probing of chemical interactions through the combination of electronic and vibrational modes of spectroscopic imaging from the same field of view provides a wealth of information regarding biological systems such as cells, tissues, and organisms.
  • Three-mode chemical imaging based on assessment of visible absorption, fluorescence emission, and Raman scattering, can be performed using a single instrument.
  • the instrument includes a liquid crystal tunable filter (LCTF) and a charge-coupled device (CCD) imaging camera as described herein.
  • LCTF liquid crystal tunable filter
  • CCD charge-coupled device
  • This instrument can be used to perform three modes of spectral imaging of solvated compounds, such as those commonly used as molecular probes for bioimaging applications.
  • FITC molecular formula: C 21 H 1 1 NO 5 S, molecular weight: 389.38.
  • FITC is an exogenous fluorophore - that is, a molecule that must be conjugated to a biomolecule to function as a fluorescent tag that achieves specificity with respect to certain biological sites.
  • a feature common to exogenous fluorophores is their highly conjugated chemical bonding from which arise the electronic transitions associated with strong absorptions of visible light and subsequent emissions, often at high quantum efficiency. Also, the highly conjugated pi- bonding contributes to the high polarizability of the molecule, which also contributes to strong Raman scattering attributable to vibrational transitions.
  • FITC absorption and fluorescence emission spectra of FITC are shown in Figure 9.
  • FITC absorbs light at wavelengths between 425 and 525 nanometers, and manifests an absorption maximum at approximately 490 nanometers.
  • the fluorescence emission manifests a modest Stokes shift (energy difference between the absorption and emission maxima) with an emission maximum at approximately 520 nanometers. Therefore, a hyperspectral fluorescence image can be produced by irradiating a sample containing FITC with light having a wavelength of 488 nanometers (e.g., the 488 nanometer line of an argon laser).
  • Hyperspectral Raman images can be generated by irradiating the sample with either a 632.8 nanometer line from a He-Ne laser or the 635 nanometer line from a semiconductor laser. Either red wavelength is significantly longer than either the absorption or emission maxima, and no fluorescence would be expected to interfere with Raman scattered radiation upon Raman imaging of a sample illuminated with these red wavelengths. Consequently, hyperspectral Raman and fluorescence images can be obtained from the same field of view of a sample containing FITC by proper selection of the illumination wavelengths.
  • Hyperspectral absorption images can be generated by transmitting white light through the sample and passing it through the LCTF and focusing the light on a CCD imaging camera. The light collection, wavelength selection, and imaging camera can be the same for hyperspectral absorption, fluorescence emission, and Raman imaging. Consequently, all three modes of hyperspectral imaging provide complementary chemical information about the exact same locations in a single field of view.

Landscapes

  • Physics & Mathematics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Immunology (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Biochemistry (AREA)
  • General Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Pathology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Optics & Photonics (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)

Abstract

The invention relates to apparatus and methods for assessing occurrence of a hazardous agent in a sample by performing multimodal spectral analysis of the sample. Methods of employing Raman spectroscopy for entities in a sample which exhibit one or more optical properties characteristic of a hazardous agent are disclosed. Devices and systems suitable for performing such methods are also disclosed.

Description

TITLE OF THE INVENTION [0001] Multimodal Method for Identifying Hazardous Agents
BACKGROUND OF THE INVENTION
[0002] The invention relates generally to the field of Raman spectroscopy. [0003] Deliberate and inadvertent deployments of harmful or weaponized chemical or biological agents pose significant threats to public welfare, as do explosives and radiological materials. Such agents threaten both human and economic health, and the threats posed by these agents are compounded by limited ability to detect deployment of the agents and to respond appropriately.
[0004] The mass destruction potential of biological weapon agents (BWAs) and chemical weapon agents (CWAs) is considered comparable to or even greater than that of nuclear weapons. Nuclear weapons have the potential to affect a finite area, albeit very large, and the use of such weapons is immediately obvious after the fact. The geographical site and boundaries of attacks using BWAs and CWAs are not readily apparent, and can be difficult to identify in a period of time relevant to permit effective response. Once unleashed, these agents can spread silently and unchecked through populations far from ground zero. Technology to rapidly detect and quantify radiation, even at very low levels, is widely available. Unfortunately, such technology for BWAs and CWAs at similar levels is not definitive, not widely available and in many cases, is not very rapid. A significant need exists for apparatus and methods useful for detecting and quantifying BWAs and CWAs in a timely manner.
[0005] Conventional means of identifying biological pathogens include methods and reagents such as specific antibodies, genetic markers, and propagation, in culture. Most of these methods are slow, labor-intensive, and dependent on detection of highly-specific molecular structures. Using modern biotechnology methods, it is possible to alter many human pathogens in ways that can limit traditional detection methods, increase their pathogenicity, increase their resistance to conventional therapy, or some combination of these. Engineered BWAs pose a greater threat as biotechnology information becomes more widely available. Conventional tools for detecting BWAs are likely to become less effective over time as such knowledge spreads. [0006] As unintended or deliberate use of BWAs and CWAs becomes a greater threat, there is an increased need for tools that can rapidly and accurately detect and classify these agents at a molecular level, preferably without coming into contact with them. These tools are also needed to help expand our understanding of the biological and chemical nature of such agents and their potential impact on the human body. The present invention satisfies these needs.
BRIEF SUMMARY OF THE INVENTION
[0007] The invention relates to a method of assessing occurrence of a hazardous agent in a sample, such as one that comprises multiple entities. The method comprises assessing a first optical property of the entities to select an entity for which the first optical property (e.g., absorbance, fluorescence, diffraction, polarization, or microscopic morphology) is characteristic of the hazardous agent. Raman-shifted radiation scattered by the selected entity is thereafter assessed. Exhibition of a Raman scattering property characteristic of the hazardous agent by the selected entity is indicative that the hazardous agent occurs in the sample. In one embodiment, Raman-shifted radiation scattered by a selected entity is assessed only if the selected entity also exhibits a second optical property characteristic of the hazardous agent.
[0008] By way of example, entities in a sample can be assessed to determine whether they exhibit a microscopic morphology and a fluorescent property characteristic of the hazardous agent. In order to speed the process, fluorescent properties can be assessed only for those entities which exhibit microscopic morphology characteristic of the hazardous agent (e.g., only for entities which exhibit the characteristic shape of a pathogenic bacterium). Entities that exhibit both characteristic properties can be selected for Raman scattering analysis, thereby ^educing the amount of time spent on the more definitive, but typically less sensitive, Raman analysis.
[0009] The methods described herein are useful for assessing occurrence of a wide variety of hazardous agents. Examples of such agents include synthetic organic chemicals, biological toxins, microorganisms (e.g., bacteria and protozoa), and viruses. [0010] The method can be performed using a variety of Raman-shifted scattered radiation collection systems. Such systems can be based on devices such as macroscopes, microscopes, endoscopes, and fiber optic arrays. The invention includes such devices and systems.
BRIEF SUMMARY OF THE SEVERAL VIEWS OF THE DRAWINGS [0011] The patent or application file contains at least one drawing executed in color. Copies of this patent or patent application publication with color drawing(s) will be provided by the Office upon request and payment of the necessary fee. [0012] Figure 1 is a schematic diagram of an instrument (or multiple configured instruments) suitable for use in the multimodal sensing and detection systems described herein.
[0013] Figure 2 is a schematic diagram of an ambient air sensor suitable for use in multimodal sensing and detection of BWA and CWA in systems described herein. [0014] Figure 3 is a flow chart which depicts one embodiment of the multimodal analytical methods described herein for identification of threat entities such as BWAs or CWAs.
[0015] Figure 4 consists of Figures 4A and 4B. Figure 4 A is a graph of the Raman spectra of three Bacillus species and dipicolinic acid. Figure 4B is a microscopic image of Bacillus anthracis.
[0016] Figure 5 consists of Figures 5A, 5B, 5C, and 5D. Figure 5B is a color image of multiple entities in a microscopic field of view for a sample. Figure 5 A depicts Raman spectra obtained by analysis of substances present in the sample imaged in the field of view depicted in Figure 5B. In Figure 5A, "Sl " is a Raman spectrum for Bacillus globigii, corresponding to entities designated "1" in Figures 5B and 5C; "S2" is a Raman spectrum for egg white, corresponding to entities designated "2" in Figure 5B; and "S3" is a Raman spectrum for Aspergillus terreus spores, corresponding to the entity designated "3" in Figures 5B and 5D. Figure 5 C is a monochrome image depicting Raman scattered radiation detected at an RS value of 2950 cm (± 15 cm ). Figure 5D is a monochrome image depicting Raman scattered radiation detected at an RS value of 3050 cm (± 15 cm ). [0017] Figure 6, consisting of Figures 6 A, 6B, and 6C, depicts fluorescence spectral differentiation and identification of different Bacillus species in a mixture of B. pumilus and B. subtilis. Figures 6A and 6B depict images of the same field of view of the mixture, assessed at different fluorescent wavelengths. Figure 6C depicts fluorescence spectra characteristic of B. pumilus (which fluoresces in Figure 6A) and B. subtilis (which fluoresces in Figure 6B).
[0018] Figure 7, consisting of Figures 7 A, 7B, 7C, 7D, and 7E, depicts multimodal analysis of a single field of view of a mixture of B. anthracis with growth medium and formalin. Figure 7A is a brightfield optical reflectance microscopic image. Figure 7B is a
Raman chemical image. Figure 7C is a fluorescent image of the field of view. In color
Figures 7D and 7E, the brightfield image of Figure 7A is combined with either (in Figure
7D) the Raman chemical image of Figure 7B or (in Figure 7E) the fluorescent image of
Figure 7C.
[0019] Figure 8, consisting of Figures 8 A, 8B, 8C, and 8D, depicts use of fluorescence sensing performed on a commercial macro platform (CONDOR (TM) macro imaging system, Chemlmage Corp., Pittsburgh, PA) for detecting spores of B. globigii mixed with baking soda on the exterior of an envelope. Figure 8 A depicts the configuration of the experiment. Figures 8B and 8C depict fluorescent images of B. globigii spores alone
(Figure 8B) and B. globigii mixed with baking soda (color Figure 8C) on an envelope.
Figure 8D depicts fluorescent spectral characteristic of baking soda (PtI in Figures 8C and
8D)5 B. globigii spores (Pt2 in Figures 8C and 8D), and the envelope (Pt3 in Figures 8C and
8D).
[0020] Figure 9 is the absorbance and fluorescence emission spectra of goat anti -mouse
IgG labeled with FITC in pH 8.0 buffer.
[0021] Figure 10 schematically represents an apparatus according to one embodiment of the disclosure.
[0022] Figure 11 schematically represent an apparatus according to another embodiment of the disclosure.
DETAILED DESCRIPTION OF THE INVENTION
[0023] The invention relates to a method of assessing occurrence of a hazardous agent in a sample, particularly when the sample contains multiple entities (e.g., debris, soot, dust, non-pathogenic microorganisms, and animal dander) other than the hazardous agent. Samples collected from various environments (e.g., ambient indoor and outdoor air samples, soil samples, and unknown powders) often include particulate entities which have certain properties in common with hazardous agents, and identifying and/or quantifying the hazardous agents in the sample milieu can be significantly complicated and slowed by the apparent similarity of the entities in the sample. In situations in which rapid detection of hazardous agents is desired, traditional rapid microscopic and fluorescent analytical methods often exhibit insufficient sensitivity to positively identify hazardous agents and differentiate them from other entities.
[0024] Raman spectroscopy can be used to assess the Raman scattering properties of all entities in the sample to identify entities which exhibit Raman scattering properties that are characteristic of the hazardous agent. In view of the amount and type of information that can be discerned from Raman scattering properties, those properties can often be highly informative for identifying hazardous agents in a sample. However, owing to a number of factors (e.g., relatively weak signal strength, frequent occurrence of background fluorescence, and relatively slow operation of Raman scattering analytical equipment), the time required for obtaining informative Raman scattering information for all candidate entities in a sample can exceed the time available or convenient for sample analysis, particularly when rapid analysis is necessary.
[0025] The methods described herein permit more rapid Raman scattering analysis of potential hazardous agents in a sample by using more rapid optical analytical methods (e.g., microscopic and/or fluorescent analysis) to exclude from Raman scattering analysis entities that do not exhibit optical characteristics characteristic of a hazardous agent. [0026] The methods described herein comprise assessing a first optical property of the entities in the sample. Entities for which the first optical property is characteristic of the hazardous agent (i.e., consistent with the entity being the agent) can thereby be selected. Raman-shifted radiation scattered by one or more of those selected entities can thereafter be assessed. Entities for which the first optical property is not characteristic of the hazardous agent can be excluded from the Raman scattering analysis, thereby avoiding spending the time and computing resources that would otherwise be spent performing Raman scattering analysis of those non-characteristic entities. Occurrence in the sample of entities which exhibit both the first optical property and a Raman scattering property characteristic of the hazardous agent indicates that the sample comprises the hazardous agent. [0027] In one embodiment, at least two optical properties of entities in the sample are assessed prior to Raman scattering analysis, and that analysis is performed only for entities for which each of the optical properties is characteristic of the hazardous agent. When two or more optical properties are assessed prior to Raman scattering analysis, failure of an entity to exhibit any of the optical properties characteristic of the hazardous agent can exclude that entity from Raman scattering analysis. Thus, failure of an entity to exhibit a first optical property characteristic of the hazardous agent makes it unnecessary to analyze that entity for a second or subsequent optical property. To the extent assessment of the second or subsequent optical property requires additional assay or processing time, the speed of the entire process can be increased by excluding entities which fail to exhibit even a single optical property of the hazardous agent from further analysis. Alternatively, two or more optical properties of entities in a sample can be assessed, and Raman scattering analysis can be performed for each entity that exhibits at least one optical property characteristic of the hazardous agent.
[0028] Definitions
[0029] As used herein, each of the following terms has the meaning associated with it in this section.
[0030] "Bandwidth" means the range of wavelengths in a beam of radiation, as assessed using the full width at half maximum method.
[0031] "Bandpass" of a detector or other system means the range of wavelengths that the detector or system can distinguish, as assessed using the full width at half maximum intensity method.
[0032] The "full width at half maximum" ("FWHM") method is a way of characterizing radiation including a range of wavelengths by identifying the range of contiguous wavelengths over which the magnitude of a property (e.g., intensity or detection capacity) is equal to at least half the maximum magnitude of that property in the radiation at a single wavelength.
[0033] A "hazardous agent" is a substance (e.g., a chemical, biological, radiological, or explosive material) that can cause disease, injury, discomfort, pain, or death to an animal such as a human.
[0034] "Spectral resolution" means the ability of a radiation detection system to resolve two spectral peaks.
[0035] The terms "optical" and "spectroscopic" are used interchangeably herein to refer to properties of materials (and to methods of assessing such properties). The term "spectroscopic" is generally understood to refer to the interaction of electromagnetic radiation, electrons, or neutrons with the materials. The term "optical" typically refers to an interaction with electromagnetic radiation. For example, although electron microscopy is not always commonly considered a "spectroscopic" or "optical" method, the two terms are used inclusively herein to encompass electron microscopy and other methods of assessing interaction of a material with visible, ultraviolet, or infrared light, with neutrons, or with other radiation.
[0036] Detailed Description
[0037] The methods described herein comprise assessing a first optical property of the entities in a sample. Entities for which the first optical property is characteristic of a hazardous agent (i.e., consistent with the entity being the hazardous agent) are selected. Raman-shifted radiation scattered by one or more of those selected entities is thereafter assessed. Entities for which the first optical property is not characteristic of the hazardous agent can be excluded from the Raman scattering analysis, thereby avoiding spending the time that would otherwise be spent performing Raman scattering analysis of those non- characteristic entities. Occurrence in the sample of entities which exhibit both the first optical property and a Raman scattering property characteristic of the hazardous agent indicates that the sample comprises the agent.
[0038] At least a second optical property of the entities in the sample can be assessed. Those entities which fail to exhibit either of the first and second optical properties characteristic of the hazardous agent need not be assessed for Raman scattering. Excluding entities that fail to exhibit a rapidly- assessed optical property of the hazardous agent can reduce the amount of time spent performing Raman scattering analysis of entities that are not hazardous agents, thereby increasing the overall rapidity (i.e., throughput) of the assay method. Three, four, five, or more optical properties of entities in the sample can be assessed to select entities suitable for Raman scattering analysis, but such additional assessment can increase the complexity, cost, and computing power requirements of the system. One and two optical properties are considered sufficient discriminators for most purposes.
[0039] In one embodiment, a microscopic method is used to assess the morphology (i.e., size, shape, arrangement, or some combination of these) of entities in the sample. Entities having a morphology characteristic of the hazardous agent (e.g., the shape or chain configuration of a pathogenic bacterium) are selected for further analysis. Entities which exhibit a morphology consistent with the hazardous agent are assessed by fluorescence spectroscopy or fluorescence microscopy. Entities which exhibit fluorescence characteristic (i.e., exhibiting a characteristic wavelength(s), intensity, or delay of fluorescent or phosphorescent emission) of the hazardous agent are selected for Raman scattering analysis, and those entities which do not exhibit fluorescence characteristic of the hazardous agent are not analyzed further. Raman scattering analysis is thus performed only for entities which exhibit both the morphology and fluorescence characteristic of the hazardous agent. Exhibition of a Raman scattering property characteristic of the hazardous agent (e.g., one or both of a characteristic Raman shift and a characteristic Raman spectrum) is an indication that the entity is or comprises the agent. Using this method, occurrence of the hazardous agent in the sample can be detected in a rapid manner. This embodiment is depicted in a flow chart in Figure 3.
[0040] In an alternative embodiment, a fluorescent microscopic or spectroscopic method can be used to select candidate entities for further microscopic morphological analysis. Entities in a sample which exhibit both the fluorescent and morphological characteristics of a hazardous agent of interest can be selected for Raman scattering analysis. [0041] The order in which the optical analytical methods described herein are performed is not critical. However, in order to reduce the time necessary for Raman scattering analysis, at least part of that analysis should occur after entities in the sample have been assessed by another, more rapid analytical method (e.g., microscopic morphological analysis and/or fluorescent analysis) and confirmed to exhibit an optical property consistent with the optical properties of the hazardous agent. For example, optical analytical methods can be performed sequentially (e.g., first assessing microscopic morphology of all entities in a microscopic field including the sample, thereafter assessing fluorescent emissions from all entities in the field, and thereafter assessing Raman scattering from the entities in the field that exhibit morphological and/or fluorescent characteristics of the hazardous agent). Optionally, two or more of the analytical methods can be performed in parallel (e.g., microscopic morphology and fluorescent emissions can be assessed simultaneously for entities in a microscopic field), and Raman scattering analysis of selected entities can be performed thereafter, for example using multiple detectors suitable for collecting information simultaneously from the sample. Combined serial and parallel operations can be performed as well, in order to improve the speed of the method.
[0042] The methods described herein overcome shortcomings of single-mode analytical methods of the prior art. Techniques that rely on a single optical detection strategy can exhibit a high rate of false positive detection results. The frequency of such false positive results can vary widely depending on the material being analyzed. Attempts by others to overcome such shortcomings have tended to address individual shortcomings in the sensitivity of the individual methods used or specific limitations of particular optical methods. The methods described herein are less sensitive to the limitations of the optical analytical methods employed, since limitations of one detection method can be identified by and compensated for by the other optical detection method(s) employed. Using the detection methods described herein in parallel, the time required to definitively identify a target in a sample can be significantly reduced. Furthermore, careful selection of one or more of detection methods, illumination wavelengths, polarization of illuminating radiation, wavelength-specific optics, and instrument layout can reduce or eliminate interference between the detection methods employed. Selection of appropriate parameters depends on the sample and target(s) being assessed, and is within the ken of the skilled artisan in this field.
[0043] Raman Spectroscopy
[0044] Raman spectroscopy provides information about the vibrational state of molecules. Many molecules have atomic bonds capable of existing in a number of vibrational states. Such molecules are able to absorb incident radiation that matches a transition between two of its allowed vibrational states and to subsequently emit the radiation. Most often, absorbed radiation is re-radiated at the same wavelength, a process designated Rayleigh or elastic scattering. In some instances, the re-radiated radiation can contain slightly more or slightly less energy than the absorbed radiation (depending on the allowable vibrational states and the initial and final vibrational states of the molecule). The result of the energy difference between the incident and re-radiated radiation is manifested as a shift in the wavelength between the incident and re-radiated radiation, and the degree of difference is designated the Raman shift (RS), measured in units of wavenumber (inverse length). If the incident light is substantially monochromatic (single wavelength) as it is when using a laser source, the scattered light which differs in wavelength can be more easily distinguished from the Rayleigh scattered light.
[0045] Because Raman spectroscopy is based on irradiation of a sample and detection of scattered radiation, it can be employed non-invasively and non-destructively, such that it is suitable for analysis of biological samples in situ. Little or no sample preparation is required. In addition, water exhibits very little Raman scattering, and Raman spectroscopy techniques can be readily performed in aqueous environments. Illumination of a sample over time can result in photobleaching of molecules in the sample, which can result in time- dependent fluctuations in fluorescence intensity following cessation of illumination. Low power, wide-field illumination of a sample over a period of more than a few seconds can substantially completely bleach the entire sample, allowing Raman and other measurements to be made against a non- fluctuating background, in contrast with scanning Raman spectroscopic measurements described in the art.
[0046] The Raman spectrum of a material can reveal the molecular composition of the material, including the specific functional groups present in organic and inorganic molecules. Raman spectroscopy is useful for detection of hazardous agents because most, if not all, of these agents exhibit characteristic 'fingerprint' Raman spectra, subject to various selection rules, by which the agent can be identified. A variety of Raman scattering properties, such as Raman peak position, peak shape, and adherence to selection rules, can be used to determine molecular identity and to determine conformational information (e.g., identity, viability, crystalline phase, degree of order, strain, grain size) for solid materials. [0047] In the past several years, a number of key technologies have been introduced into wide use that have enabled scientists to largely overcome the problems inherent to Raman spectroscopy. These technologies include high efficiency solid-state lasers, efficient laser rejection filters, and silicon CCD detectors. In general, the wavelength and bandwidth of light used to illuminate the sample is not critical, so long as the other optical elements of the system operate in the same spectral range as the light source. [0048] Because Raman scattering peaks are independent of the wavelength of the illumination source, the wavelength of light used to irradiate the cells is not critical. Illumination wavelengths less than 700 nanometers (e.g., from 350 to 695 nanometers), and likely as low as about 220 nanometers, can be used for Raman scattering analysis. An illumination wavelength of 532 nanometers is suitable, for example. [0049] Because the intensity of scattered light is known to be dependent on the fourth power of the frequency (i.e., inverse wavelength) of the irradiating light, and only proportional to the intensity of the irradiating light, lowering the wavelength of the irradiating light can have the effect of increasing scattering signal output even if the intensity of the irradiating light is decreased. Thus, even under constant illumination, cells can survive irradiation if the intensity of the irradiating light is carefully controlled. Irradiation using shorter wavelengths (e.g., < about 500 nanometers, such as a wavelength of 220-280 nanometers) can be performed without harming the illuminated cells if intermittent or very short duration irradiation methods are employed. If survival of a target (e.g., a cell, a virus, or a toxin particle) in a sample beyond the time of detection is not important and so long as the Raman signature is preserved, then the effect of irradiating light on the hazardous agent need not be considered. However, it will be preferable in many instances to preserve the integrity of a target in a sample by illuminating the sample with radiation at a wavelength and intensity below the damage threshold for the target. In addition, background fluorescence in biological samples can generally be reduced by increasing the wavelength of the illuminating radiation.
[0050] In order to detect Raman scattered light and to accurately determine the Raman shift of that light, the sample should be irradiated with substantially monochromatic light, such as light having a bandwidth not greater than about 1.3 nanometers, and preferably not greater than 1.0, 0.50, or 0.25 nanometer. Suitable sources include various lasers and polychromatic light source-monochromator combinations. It is recognized that the bandwidth of the irradiating light, the resolution of the wavelength resolving element(s), and the spectral range of the detector determine how well a spectral feature can be observed, detected, or distinguished from other spectral features. The combined properties of these elements (i.e., the light source, the filter, grating, or other mechanism used to distinguish Raman scattered light by wavelength) define the spectral resolution of the Raman signal detection system. The known relationships of these elements enable the skilled artisan to select appropriate components in readily calculable ways. Limitations in spectral resolution of the system (e.g., limitations relating to the bandwidth of irradiating light) can limit the ability to resolve, detect, or distinguish spectral features. The skilled artisan understands that and how the separation and shape of Raman scattering signals can determine the acceptable limits of spectral resolution for the system for any of the Raman spectral features described herein.
[0051] A field of illumination can be divided into multiple adjacent, non-adjacent, or overlapping points, and Raman scattering analysis can be assessed at each of the points. The points can be scanned serially (i.e., by scanning) or assessed in parallel (e.g., by assessing Raman scattering at each point at an RS value selected using a liquid crystal tunable filter and subsequently at a second RS value selected using the filter). To implement a scanning strategy, there is an inherent trade off between acquisition time and the spatial resolution of the spectroscopic map or image that is generated. Each full spectrum takes a certain time to collect. The more spectra collected per unit area of a sample, the higher the apparent resolution of the spectroscopic map, but the longer the data acquisition takes. Performing single point measurements on a grid over a field of view will also introduce sampling errors which makes a high definition image difficult or impossible to construct. Instead of scanning a sample, Raman scattering can be assessed in parallel (i.e., simultaneously) for all points in an image field. This parallel processing of all points is designated Raman chemical imaging, and can require significant computing time and capacity.
[0052] The computing and analysis resources required for Raman chemical imaging can be costly and bulky. An apparatus for Raman chemical imaging has been described by Treado in U.S. Patent number 6,002,476, and in U.S. patent application 09/619,371, filed 19 July 2000, which are incorporated herein by reference. Other descriptions of Raman chemical imaging are U.S. patent application 09/800,953, filed 7 March 2001; U.S. patent application 09/976,391, filed 21 October 2001; U.S. patent application 10/185,090, filed 27 June 2002; U.S. patent application 10/184,580 filed 27 June 2002; U.S. provisional patent application 60/144,518, filed 19 July 1999; U.S. provisional patent application 60/347,806, filed 10 January 2002; U.S. provisional patent application 60/144,518, filed 19 July 1999; U.S. provisional patent application 60/187,560, filed 28 March 2000; U.S. provisional patent application 60/239,969, filed 13 November 2000; U.S. provisional patent application 60/301,708 filed, 28 June 2001; and U.S. provisional patent application 60/422,604, filed 21 November 2002. Any of a variety of known methods can be used to correlate the Raman spectrum obtained at any particular point or averaged area with reference spectra. By way of example, standard spectral library comparison methods can be used to identify a component that occurs at a particular location in a sample. Alternatively, the spectral unmixing methods described in U.S. patent application number 10/812,233, filed 29 March 2004, can be used to identify multiple components present in an area of a sample. Each of the foregoing patents and applications is incorporated herein by reference. [0053] In the methods described herein, portions of a sample in a field of view can be selected for Raman scattering analysis by first assessing the portions of the field that exhibit one or more optical properties characteristic of the hazardous agent. Sampling multiple points in an image allows variations in the Raman spectra to be observed and distinctions to be made as to components present in the various portions of the sample corresponding to the points, hi this way, the processing time and resources needed to assess occurrence of the hazardous agent in the sample can be reduced or minimized. By way of example, regions of the image shown in Figure 5B were assessed by Raman scattering analysis to identify the corresponding entities using the Raman spectra depicted in Figure 5A. [0054] Although Raman spectroscopy can generally be applied to samples on a wide variety of surfaces, some substrate materials are preferred relative to others. Ideal substrates are optically flat, Raman inactive (i.e., exhibit little or no Raman scattering), non- fluorescent, and can sustain large laser powers without exhibiting thermal expansion. Glass-based substrates are inexpensive, commonly used, and readily available. However, some glasses exhibit significant fluorescence emission(s) that are superimposed on the Raman spectrum. Although the Raman signal can be subtracted out of the sample spectra, such subtraction contributes to noise in the resulting signal. Further, in the presence of samples with a low Raman scattering cross section (e.g., a small number of BG spores) a high background signal (e.g., that attributable to glass fluorescence) can overwhelm the Raman signal attributable to the sample. In such instances, it can be difficult to subtract out the background to reveal the sample signal. Fused silica (i.e., optical grade quartz) is an alternative often used by Raman spectroscopists, because it does not exhibit the significant fluorescence background of glass. Fused silica is also colorless and clear, allowing traditional transmittance optical viewing. Fused silica exhibits a limited Raman signal that must be subtracted from the final spectrum. Although this may present some signal-to-noise ratio problems (e.g., at very low Raman scattering cross sections), the lower background signal reduces the chance of the background signal overwhelming the sample signal, relative to glass-based substrates. [0055] A preferred substrate is an aluminum oxide-based filter (e.g., ANODISC (RTM) brand aluminum oxide filtration membranes available from Whatman PLC, Brentford, Middlesex, UK). The ANODISC (RTM) filter exhibits a relatively weak Raman signature, is non-fluorescent, and can sustain large laser power densities without undergoing thermal expansion. Some residual spectroscopic properties of the substrate requires corrective steps to subtract its signature from the overall sample spectroscopic response, but this can be achieved using known methods. Another preferred substrate, particularly for ambient air sampling, is the micro-orifice uniform deposit impactor (MOUDI (TM) available from MSP Corporation, Shoreview, MN). This device exhibits favorable background properties. The MOUDI (TM) sampler collects ambient particulate material and deposits the material onto a flat, smooth aluminum foil substrate satisfactory for both Raman and scanning electron microscopic and energy dispersive spectrometric measurements.
[0056] Other Optical and Spectroscopic Methods
[0057] One or more of a variety of methods can be used to identify areas of a sample or entities in a sample for which Raman scattering analysis should be performed (or, conversely, need not be performed). Preferably, the optical or spectroscopic method(s) used for this purpose can be performed significantly more rapidly than Raman scattering analysis. Examples of suitable methods include absorbance, fluorescence, diffraction, polarization, and microscopic methods, hi one embodiment, the sample (or at least a field of view of the sample) is illuminated with radiation that can be used in more than one optical and/or spectroscopic method (e.g., incident laser light useful for Raman scattering, fluorescence spectroscopy, and optical microscopy). Examples of suitable microscopic methods include scanning electron microscopy, differential interference contrast microscopy, brightfield reflectance microscopy, polarized light microscopy, and fluorescence microscopy. Microscopic methods can be used for assessing the morphology of entities in a sample, [0058] In fluorescence spectroscopy, photons are emitted from a material following an excitation step in which absorption of photons occurs. Experiments typically include a polychromatic excitation source such as mercury (Hg) or xenon (Xe) lamps or a monochromatic source such as a light-emitting diode (LED) or laser for sample excitation. A portion of the emitted radiation may then be directed into a dispersive monochromator to which a detector device such as a CCD is attached. By measuring the fluorescence spectrum from a material, one can deduce qualitative and quantitative information from inorganic and organic species. In comparison to Raman spectroscopy, fluorescence is inherently more sensitive. Detection limits in the parts-per-billion range are common. On the other hand, fluorescence is less selective than Raman and there are a limited number of chemical systems that exhibit fluorescence. Nonetheless, fluorescence analysis can be performed much more rapidly than Raman scattering analysis.
[0059] Fluorescence analysis can distinguish biotic and non-biotic materials, which can be advantageous for identifying entities in a sample that are not living. If detection of a living hazardous agent (e.g., a pathogenic bacterium or eukaryote) or a viral agent is desired, fluorescence analysis is a suitable method for excluding sample entities from slower Raman scattering analysis. Suitable parameters for fluorescent analysis of biotic materials are known. By way of example, such parameters are described in Pinnick et al. (1999, Field Anal. Chem. Technol. 3:221-239).
[0060] Molecular UV/visible and NIR absorption spectroscopies involve the absorption of photons in the UV/visible (185-780 nanometer (54,054 to 12,800 cm"1)) and NIR (780 nanometer to 2.5 micrometer (12,800 to 4,000 cm"1)) spectral regions, respectively. Typical instrumentation include a polychromatic source such as a deuterium or quartz tungsten halogen lamp, a dispersive element such as a monochromator or interferometer, and a detection device such as a Si CCD or InGaAs focal plane array detector. As with other optical methods described herein, the wavelength and intensity of illuminating radiation should be selected to avoid unacceptable sample or target degradation. Longer wavelengths, such as NIR radiation, can enhance penetration into a sample, permitting analysis of non-surface materials.
[0061] Absorption measurements based upon UV- visible or NIR radiation have many known applications for qualitative and quantitative determination of inorganic and organic chemical species. NIR spectra result from the overtone and combination bands of fundamental mid-infrared (MIR) bands. Like fluorescence, absorption spectroscopies are highly sensitive but only moderately selective. Absorption phenomena can also yield information about the chemical identities of the materials present in a sample. To the extent specific absorbance information about a target of interest is known, analysis of radiation absorbed by a sample can be informative regarding the occurrence of that target in the sample. Absorption spectroscopy is a useful method for identifying entities in a sample for which Raman scattering analysis need not be performed. Conversely, absorption spectroscopy can be used to identify areas of a sample or entities within a sample for which Raman analysis should be performed.
[0062] Spectroscopic methods can be extended to imaging techniques through the use of imaging spectrometers such as liquid crystal imaging spectrometers. The development of this technology in recent years has enabled spectroscopic imaging to develop and mature. [0063] Spectroscopic imaging is a versatile technique that is well suited to the analysis of complex heterogeneous materials. Applications of spectroscopic imaging range from the analysis of polymer blends, defect status analysis in semiconductor materials, inclusions in human breast tissue, characterization of corrosion samples and detection, and classification and identification of BWAs and CWAs. Spectroscopic imaging provides a potential solution for obtaining both qualitative and quantitative image information about molecular composition and morphology of BWAs and CWAs, allowing a more accurate and more rapid analysis than traditional imaging or 'wet' chemical methods. [0064] Optical and fluorescent microscopy techniques are well suited for identifying entities in a sample that are, or are not, characteristic of certain hazardous agents. For example, many bacteria, bacterial spores, eukaryotic cells, and viruses have a characteristic size, shape, or arrangement (e.g., chains, sheets, or groups). Microscopic methods can be performed rapidly and the results obtained thereby can be rapidly assessed using known methodologies to assess the size, shape, arrangement, or other morphological characteristics of entities in a field of view. Microscopic methods are therefore suitable for assessing optical properties of entities in a sample in order to exclude from Raman scattering analysis entities that do not have morphological properties, fluorescent properties, or both, that are characteristic of the hazardous agent. The same methods can be used to identify entities for which Raman scattering analysis should be performed.
[0065] Figure 4B shows a typical magnified view of a sample containing Bacillus anthracis. The spectra shown include a Raman spectrum corresponding to B. anthracis. The differences which are evident between the spectrum of B. anthracis and the spectra of the other Bacillus species demonstrate that B. anthracis can be differentiated from those species in a sample containing all three samples. This can performed by i) analyzing the sample in a microscopic field of view by visible light reflectance microscopy to identify entities that have the size, shape, or both, characteristic of a Bacillus (i.e., oblong shape with characteristic dimensions); ii) analyzing those entities to see which fluoresce (e.g., using excitation radiation having a wavelength of 365 nanometers and assessing visible fluorescence) and are therefore likely biotic; and iii) analyzing the Raman spectrum of individual fluorescent Bacillus-sized and/or -shaped entities to assign an identity to the entity, based on similarity to known Raman spectra such as those shown in Figure 4A. The Raman spectroscopy step can be performed by assessing light scattered at a single pixel corresponding to the entity, by assessing light scattered from a group of pixels corresponding to the entity, or by assessing light scattered from one or more areas that include some or all of the entity.
[0066] Discriminating Suspect Entities from Other Entities
[0067] A significant advantage of the methods described herein relative to previously described Raman spectral analytical methods is that the time required for Raman analysis can be significantly shortened by excluding from Raman analysis entities in a sample that do not exhibit one or more optical properties of a hazardous agent. Sampling multiple points in an image allows variations in the Raman spectra to be observed and distinctions to be made as to components present in the various portions of the sample corresponding to the points. Acquiring Raman scattering data at every position and analyzing the spectra at every point in an image would require significantly greater time. Instrument power and computing resources can thereby be concentrated on areas of a sample most likely to contain the hazardous agent.
[0068] The methods described herein are amenable to automation, in that the analysis of optical properties and Raman spectra can be performed using computer software as well as manually. Characterization of an optical field based on single optical properties corresponding to specific locations within the field (i.e., image analysis for absorbance at a selected wavelength) is routine in the art. For example, in one embodiment, if the presence or absence of bacterial spores are to be analyzed, then assessment of fluorescence should be performed by analyzing discrete areas of the optical field having a size not greater than 2, 3, 5, 10, or 25 times the cross-sectional area of a single spore. Further by way of examples, bacteria and their spores have characteristic dimensions that are typically on the order of one to several micrometers, viruses have characteristic dimensions that are on the order of tens to hundreds of nanometers, and eukaryotic cells have characteristic dimensions that are on the order often micrometers. Any of a variety of known digital image processing techniques can be used to characterize the size, shape, and spatial distribution of entities in a visible or fluorescent microscopic field. The characteristic dimensions of chemical agents, including biological toxins, depend on their agglomeration, crystallization, or other associative characteristics. The characteristic size of analytes can also depend on sample components other than the analyte itself.
[0069] Wide field Raman scattering analysis is also amenable as a method of identifying regions of an optical field that warrant higher definition Raman scattering analysis. When the area of a sample corresponding to a point at which a Raman spectrum is assessed is much larger than a characteristic dimension of an analyte or an analyte-containing particle, the methods described herein can still be employed. In that instance, the results obtained using the method will be indicative of the presence of the analyte in a region of the sample, rather than pinpointing the location of a discrete particle of the analyte. Such regions of the sample can be subjected to further analysis once identified. A skilled artisan will understand how to select appropriate point sizes based on the desired analyte. [0070] Multimodal spectral sensing can employ substantially any optical or spectroscopic method for identifying regions of a sample or entities within a sample that do not warrant more detailed and time-consuming Raman spectral analysis. Examples of such methods include fluorescence, UV/visible absorption/reflectance, NIR absorption/reflectance, and wide- field Raman spectroscopies. Contrast can be generated in the images by superimposing, adding, or otherwise combining spectral information obtained by these spectroscopic methods. The display and/or correlation of these different information sets is referred to herein as image fusion. Because a spectrum is generated for each location assessed, chemometric analysis tools such as correlation analysis, principal component analysis (PCA), and factor rotation, including multivariate curve resolution (MCR), can be applied to the image data to extract pertinent information that might be less obvious by analyzing ordinary univariate measures.
[0071] Depending on the materials and the spectroscopic method(s) used, depth-related information can also be obtained by using different excitation wavelengths or by capturing spectroscopic images at incremental planes of focus. Thus, depending on the penetrating ability of illumination and detected wavelengths, the contents of objects (e.g., vials, envelopes, or suitcases) can be assessed using these methods. [0072] A spatial resolving power of approximately 250 nanometers has been demonstrated for Raman spectroscopic imaging using visible laser wavelengths with commercially available equipment. This is almost two orders of magnitude better than infrared imaging, which is typically limited to resolution not less than 20 micrometers, owing to diffraction for example.
[0073] An advantage of using NIR radiation in multimodal spectral sensing is that it penetrates more deeply than visible light so as to enable one to probe inside of paper or plastic envelopes or plastic or glass containers, for example to detect a hazardous agent in the container. Any container that does not totally absorb the incident radiation can be examined using the NIR multimodal spectral sensing approach.
[0074] Another way of discriminating potential hazardous agents from other entities in a sample is by assessing Raman scattered radiation at a single Raman shifted wavelength characteristic of the hazardous agent. Areas of the sample from which radiation having a Raman shift (relative to incident radiation) characteristic of the hazardous agent is scattered can be selected for more detailed Raman spectral analysis. Thus, in one embodiment, a sample is assessed by identifying one or more portions of a microscopic field from which Raman scattered radiation characteristic of a hazardous agent of interest emanates, and thereafter assessing a Raman scattering spectrum of those portions. Of course, the portions can also be scanned using other optical methods (e.g., optical microscopy or fluorescence spectroscopy, as described above) to reduce the number of portions for which Raman spectra are collected and to thereby enhance the speed of the process.
[0075] Image Fusion
[0076] Spectroscopic information obtained by two or more spectroscopic methods as described herein can be combined and stored, displayed, or both, as a single data set. By way of example, Raman-scattered light detected from a sample can be amplified (or falsely colored) and displayed together with a visible microscopic image of the sample. In addition, fluorescent light emitted by the sample can be displayed in the same image. [0077] Fusion of spectroscopic information obtained from a single field of view by two or more spectroscopic methods requires mapping of the information obtained by each method to identical or overlapping elements of a data set. By way of example, a visual image can be made by displaying numerous picture elements having a known relationship to one another. For each spectroscopic method for which information is to be represented in the image, the spectroscopic information obtained from a portion of a sample must be mapped to the picture element(s) corresponding to that portion. Information from different spectroscopic methods can be displayed in a picture element corresponding to the same portion of the sample by representing each spectroscopic measurement by an independent variable of light displayed at the picture element. By way of example, a color image based on the Hunter color scale can be generated by (for each picture element of the image): i} representing brightness assessed by visible light microscopy as luminosity (L) on the Hunter color scale; ii} representing fluorescent intensity at a selected wavelength assessed by fluorescence spectroscopy as red-ness (a) on the Hunter color scale; and iii} representing the intensity of Raman-scattered light at a selected RS value as yellow-ness (b) on the Hunter color scale. This display methodology is merely an example. Substantially any method of representing independent data sets in a single image or data structure can be used. What is important is that the spectroscopic information obtained from a discrete portion of the sample by multiple spectroscopic methods be mappable to the portion of the sample from which it was obtained, and that the method of storing or displaying that information preserve the mapping, so that different spectroscopic properties of the portion can be correlated.
[0078] Examples
[0079] The invention is now described with reference to the following Examples. These Examples are provided for the purpose of illustration only, and the invention is not limited to these Examples, but rather encompasses all variations which are evident as a result of the teaching provided herein.
[0080] Rapid Hazardous Agent Detection System
[0081] A hazardous agent detection system having the configuration shown in Figure 1 can be constructed using ordinary skill in view of this disclosure. Such systems can be used or modified as described herein to meet the instrument requirements of the methods described herein for multimodal spectral analysis. Such configurations can include platforms based on a microscope, a macroscope, an endoscope, a fiber array spectral translator (FAST), or an environmental (e.g., air or water) sampler designs. Each of these is outlined in the following sections.
[0082] In Figure 1, excitation sources 110, 120, 130, and 140 (corresponding to near infrared, infrared, visible, and ultraviolet sources, any combination of which can be present) provide incident radiation that is directed by input transfer optics 200 onto a sample that is situated in an sample cell 210. The sample cell 210 can optionally be integrated with one or more other elements of the device, such as the input transfer optics 200. Such integrated sample cells can be employed as single-use (i.e., disposable) sample containers, which can be discarded, incinerated, or archived. The excitation sources can be substantially any known radiation source, including polychromatic sources such as tungsten or mercury arc lamps and substantially monochromatic sources such as lasers.
[0083] Radiation transmitted through, or reflected, refracted, emitted, or scattered by the sample is collected using output transfer optics 220 selected and situated to be appropriate for the radiation to be collected. The collected radiation is directed to appropriate detectors, and the output of the detectors (informative of the collected radiation) is captured by a data recordation circuit or device, which can be physically and/or electronically integrated with the detectors (as in the integrated optical detectors and data capture subsystem 300 depicted in Figure 1).
[0084] Data collected from the detectors is preferably fed into a data analysis subsystem 400 within or linked to a computer 450. The computer can be operated with software for controlling illumination, data collection, sample positioning, and the like, and such software is within the ordinary level of skill in this field and commercially available. The computer preferably links input 410, display 420 (e.g., a visual display such as a video display terminal or printable image), and data storage 430 functions with the optical device(s), and also preferably is able to format output/results 500 in a way convenient for the user. By way of example, in a system for hazardous agent detection on a sample collection substrate fed continuously into the sample cell 210, the computer 450 may conveniently provide output 500 that indicates the number of entities that are detected on the substrate as having Raman spectral characteristics of the hazardous agent of interest during a given period of time. Further, the output 500 may trigger an alarm circuit if the number of hazardous agent entities (e.g., pathogenic microorganisms or regions in which a chemical agent occurs) detected during a period of time (or during multiple consecutive periods of time) exceeds a pre-selected value. Alternatively, data collected from the detectors can be displayed for analysis by a user, and portions of the sample can be selected by the user for Raman scattering analysis.
[0085] An example of a commercially available device which is suitable for use in one or more of the platforms is a laboratory or transportable field Raman microscope such as the FALCON Raman microscope (TM; Chemlmage Corporation, Pittsburgh, PA), or a Chemlmage Corporation EAGLE (TM) field-hardened instrument, outfitted with the simultaneous imaging and spectroscopy apparatus offered by that supplier for use with the instrument. Another example of a suitable instrument upon which such systems can be based is an ultraviolet (UV) / visible (vis) /near infrared (NTR) fluorescence or Raman macroscope, or a UV/Vis/NIR/Mid-IR (mid-infrared) absorption/reflectance macroscope system such as the CONDOR Macroscope (TM; Chemlmage Corporation, Pittsburgh, PA). Another suitable device is a laboratory or field fiberscope such as the RAVEN endoscope (TM; Chemlmage Corporation, Pittsburgh, PA). Other suitable devices are described in U.S. Patent 6,002,476. Any of these instruments can be used alone or with additional optics, such as a laboratory or field Fiber-Array Spectral Translator (FAST) probe. Each of the modes of application can be used separately or in combination with one another to achieve the desired speed and results.
[0086] By way of example, an air sampling biothreat detector can be constructed by combining several components. A sampler or collector element can be used to gather particulates and/or aerosols from an air sample. The collected particles can be deposited on a surface suitable as a substrate for Raman and other optical analysis. The surface can be a continuous sheet of material which is advanced constantly, intermittently, or at will in front of the optical detection systems described herein. Optionally, the particles can be sorted (e.g., electrostatically) prior to deposition on the substrate. The results obtained using the optical detection systems (e.g., optical microscopy to determine particle morphology, fluorescence imaging to determine biological or non-biological origin, and Raman spectroscopy or imaging to identify particular entities identified as suspicious by optical and/or fluorescent analysis), can be recorded, transmitted, or used to perform logic operations (e.g., activating an alarm upon the detection of a target of interest). [0087] These systems can be automated through the use of robotics or combined macro/micro instrumentation in order to target analytes of interest. Using laser ablation and/or chemical ablation, the system can be automated to eradicate hazardous agents post- targeting, for example. Such a system should provide fast acquisition times (on the order of seconds), high spatial resolution (sub-micron), and good spectral resolution (<200 nanometers).
[0088] Microscope-Based System
[0089] The multimodal spectroscopic imaging microscope combines in a single platform a solid state laser for sample excitation (e.g., for Raman and laser-induced fluorescence), a refractive optical microscope base, which is equipped with infinity- corrected microscope objectives, an automated XYZ translational microscope stage, and a quartz tungsten halogen (QTH) lamp and/or a mercury (Hg) lamp. Also a part of the microscope system is an analog color charge-coupled device (CCD) detector for ordinary optical image collection and digital image collection, a liquid crystal spectrometer or other multi-point spectrometer technology including AOTF, scanned linearly variable or rotated circularly variable dielectric filters, angle-rotated Fabry Perot dielectric or other bandpass filter, interferometers including Michelson and Zagnac types, or dispersive spectrometers. Also included is either a room temperature or optionally cooled photomultiplier, IR FPA for IR image capture, or a thermoelectrically cooled (TE) silicon (Si) CCD (i.e., TE Si CCD) or complementary metal oxide semiconductor (CMOS) detector for UV/visible, Raman and fluorescence data capture, and a remote, dispersive monochromator equipped with a CCD or CMOS detector for single point or multi-point dispersive spectral collection. [0090] UV, visible, or NIR illumination is directed to the sample in a reflected light configuration using a QTH source or other broadband white light source, including metal halide, Hg arc lamps, or Xe arc lamps or a transmitted light configuration using QTH or other suitable source of a refractive optical microscope platform. In a Raman or laser- induced fluorescence experiment, laser radiation is introduced to the sample through use of a Raman illuminator. Light scattered, emitted, reflected, or transmitted is collected from the sample positioned on the automated XYZ translational microscope stage through an infinity-corrected microscope objective.
[0091] Ordinary optical imagery of the sample can be obtained using a mirror or using a beamsplitter or prism arrangement inserted into a turret wheel of the microscope by collecting an image with an analog or digital color or monochrome CCD or CMOS detector. In spectroscopic imaging mode, the magnified spectroscopic image is coupled through an imaging spectrometer and collected on a NIR or mid-IR focal plane array (FPA) detector (for IR spectroscopic imaging) or a Si CCD detector (for UV/visible absorption/reflectance, fluorescence, or Raman spectroscopic imaging). The IR FPA is typically comprised of indium gallium arsenide (InGaAs), but may be comprised of other IR sensitive materials, including platinum suicide (PtSi), indium antimonide (InSb), or mercury cadmium telluride (HgCdTe). Suitable FPA detectors are known in the art.
[0092] A central processing unit, such a PENTIUM (RTM) processor-based computer, can be used for control of spectroscopic image collection and processing. The analog color CCD, IR FPA, Si CCD, automated XYZ translational microscope stage, a liquid crystal tunable filter, an imaging spectrometer, other components of the instruments, or some combination of these can be controlled by the computer. Commercial software packages, such as CHEMACQUIRE (TM; Chemlmage Corporation, Pittsburgh, PA), CHEMANALYZE (TM; Chemlmage Corporation, Pittsburgh, PA), and CHEMIMAGE XPERT (TM; Chemlmage Corporation, Pittsburgh, PA) are available for such control, and it is within the ordinary level of skill in this field to modify existing software or generate new software for control of the instruments described herein.
[0093] By including a polarization sensitive beam splitting element in the optical path prior to the liquid crystal imaging spectrometer, a portion of the signal from the sample may be coupled to a remote dispersive spectrometer. This allows conventional spectroscopic tools to be used to gather spectra for traditional, high-speed spectral analysis. The spectrometers can include one or more of the following types: fixed filter spectrometers; grating based spectrometers; Fourier transform spectrometers; and acousto-optic spectrometers. A polarization independent interferometer such as a Michelson interferometer, a Sagnac interferometer, a Twynam-Green Interferometer, or a Mach- Zehnder Interferometer can be used as a filter.
[0094] Liquid crystal (LC) sensing spectrometer technology is used for wavelength selection. The LC sensing spectrometer may be of the following types: Lyot liquid crystal tunable filter (LCTF); Evans Split-Element LCTF; Sole LCTF; Ferroelectric LCTF; Liquid crystal Fabry Perot (LCFP); or a hybrid filter technology comprised of a combination of the above-mentioned LC filter types. Additionally, fixed bandpass and band rejection filters comprised of dielectric, rugate, holographic, color absorption, acousto-optic, or polarization types may also be used, either alone or in combination with one of the above LC spectrometers. Novel tunable filter designs identified as bi-refiϊngent interference spectrally agile filter element (BISAFE) as well as micro-opto-electromechanical (MOEM) based spectrometers have characteristics that enable multi-point imaging with a smaller form factor than conventional filter designs and are suitable for use in handheld and portable devices. Spectral diversity filters and a photonic crystal filters are also suitable for the purposes described herein.
[0095] New solid state multi-point detector designs can reduce the cost of the detector without compromising the ability to perform multi-point spectral sensing. The BISAFE filter, which is described in co-pending U.S. patent application no. 10/893,331, filed on 19 July 2004 and in U.S. provisional patent application no. 60/488,246, filed on 18 July 2003, is a linearly tunable filter that allows line imaging. Spectral data is obtained in different spectral ranges and at different locations (i.e., lines) of the sample simultaneously. Similarly, the MOEMS filter, which is described in co-pending U.S. patent application no. 10/893,332, filed on 19 July 2004 and in U.S. provisional patent application no. 60/488,246, filed on 18 July 2003, senses different spectral regions along strips of the silicon plates forming this MOEMS device. These strips define the regions selected on the sample by positioning plates using MEMS microactuators. Images can be reconstructed (if desired) by stepping the sample position. This device can operate either in a transmission mode, in which the light travels parallel to the substrate and normal to the Si plates, or in a transmission-reflection mode, in which light travels normal to the substrate and normal to the silicon plates. Such devices allow a trade-off between selection of spatial position or spectral resolution in a simple design.
[0096] Grating spectrometers can be used with FAST technology for wavelength and multi-point spectra collection. Such spectrometers allow a plurality (e.g., a group or line) of points along the sample to be sampled at each wavelength setting of the spectrometer during each measurement. This allows efficient data collection of many points at the same time, thereby providing many spatially distinct spectra to be obtained at once during one scan over the spectral regions of interest.
[0097] The multimodal spectral sensing microscope can also be used as a volumetric imaging instrument by moving the sample through the focus plane in the Z-axial dimension (i.e., in a direction normal to the 2-dimensional XfY plane of image analysis), collecting images in and out of focus, and reconstructing a volumetric data of the sample using appropriate software, which is commercially available and/or within the ordinary level of skill in this field. For samples having significant volume (e.g., bulk materials, surfaces, interfaces, and phase contact regions), volumetric spectroscopic reconstruction is useful for failure analysis, product development, and routine quality monitoring. Quantitative analysis can be performed simultaneously with volumetric analysis. Volumetric analysis can be performed in a non-contact mode without modifying the sample by using numerical confocal techniques, which require that the sample be sensed at discrete focal planes. Computational optical sectioning reconstruction techniques based on a variety of strategies have been demonstrated, including nearest neighbors and iterative deconvolution, and such computational methods are suitable for use with the devices and methods described herein. [0098] Microscope-based spectroscopic sensing systems have the advantage of being able to detect, classify, identify, and visualize entities such as BWAs at the level of a single bacterium, for instance. These systems exhibit a spectral resolution on the order of 8 cm and a spatial resolution of approximately 200 nanometers using numerical deconvolution methods.
[0099] Macroscope-Based System
[0100] The spectroscopic multimodal sensing macroscope combines in a single platform an illumination subassembly consisting of an illumination source (e.g., a QTH, Xe, Hg, or metal halide lamp), a barrier optical filter(s), and a light-directing module (e.g., direct beam, fiber optic, or liquid light guide illumination). A radiation detector such as an analog color CCD detector is used for optical and digital image collection. Wavelength selection can be performed using a liquid crystal tunable filter or multi-point spectrometer. The imaging detector can be a room temperature (or optionally cooled) NIR FPA (for NIR image capture) or a room temperature or thermoelectrically cooled Si CCD detector (for UV/visible and fluorescence image capture), for example.
[0101] UV, visible, or NIR illumination is directed to the sample in a reflected light configuration using a QTH source or other broadband white light source, including metal halide, Hg arc lamps, or Xe arc lamps or a in transmitted light configuration using QTH or other suitable source through direct illumination, fiber optics, or liquid light guides. Light emitted, reflected, or transmitted is collected from the sample positioned on the macroscopic sample base through a macro lens.
[0102] Ordinary optical imagery of the sample may be obtained using a mirror or beamsplitter or prism arrangement inserted into the collection stack of the macroscope and collecting an image with an analog or digital color or monochrome CCD or CMOS detector. In spectroscopic mode, the spectroscopic points sampled are coupled through a liquid crystal spectrometer and collected on a NIR FPA detector (for NIR spectroscopic imaging) or a Si CCD detector (for UV/visible absorption/reflectance, fluorescence, and Raman spectroscopic imaging). A computer, such as a PENTIUM (RTM) processor-based computer, can be used for multimodal spectroscopic data collection and processing as described herein.
[0103] Liquid crystal (LC) spectrometer technology can be used for wavelength selection. The LC spectrometer can be of any of the types described herein. Additionally, fixed bandpass and bandreject filters of the types described herein can be used, either alone or in combination with an LC spectrometer. These filters can select an arbitrary or random set of points for sampling or a well defined set of points determined by the sampling approach and/or the requirements for high performance of the spectrometer. For example, a resistive anode array used as a photon detector favors selection of linear points along the sample. Similarly, a FAST array can be arranged in linear fashion or another collection geometry to facilitate data acquisition.
[0104] Grating spectrometers can be used in the FAST configuration for wavelength and multi-point spectra collection. Such spectrometers used with FAST technology allow an arbitrary arrangement of points on the sample to be sampled at each wavelength setting of the spectrometer. This permits efficient data collection of many points at the same time and collection of spatially distinct spectra during a single scan over the spectral regions of interest .
[0105] A macroscope-based system enables rapid detection of potential hazardous agents over a large area, such as the surfaces and contents of envelopes and packages received by mail and analysis of surfaces in remote locations. In multimodal detection, rapid sample analysis strategies (e.g., fluorescence imaging when analyzing the presence of hazardous agents) are preferably performed early in the analytical process to more rapidly isolate the points of highest interest for subsequent detailed analysis. An example of this methodology is depicted in Figure 3. The macroscope can be used to optically sight sample areas which appear suspect. Fluorescence screening of the selected area can indicate portions which do not fluoresce, and therefore do not appear to be of biological origin. Fluorescing portions of the selected area (or entities within that area) can be further analyzed by Raman chemical imaging to differentiate potential biological threats from non- threatening entities.
[0106] Endoscope-Based System
[0107] Spectroscopic sensing has traditionally been performed in laboratory settings using research-grade light microscope technology as an image-gathering platform for selection of specific points. However, multimodal spectroscopic sensing is also applicable to in situ industrial process monitoring and in vivo clinical analysis. The application of multimodal spectroscopic sensing outside the research laboratory has been limited by the lack of availability of stable spectroscopic and/or optical selection/detection platforms that are compatible with the physical demands of industrial process monitoring and clinical environments. Both industrial and clinical settings often require compact, lightweight instrumentation suitable for the examination of remote areas that are inaccessible to conventional spectroscopic instrumentation.
[0108] A robust spectroscopic multimodal design employing liquid crystal technology has been described herein, and the equipment, systems, and methods described herein can be employed using fiber optic technology suitable for fashioning into a flexible probe such as an endoscope. The liquid crystal endoscope is the first flexible multi-point endoscopic technology that provides real-time video inspection capability with spectral analysis. The endoscope, comprising from two to thousands of independent fibers arranged in a fiber bundle, couples to a video CCD for real-time video imaging of the analysis area. This allows for quick visual screening of the sample. The endoscope tip is engineered to filter laser illumination and collect Raman scattered radiation and fluorescent emissions (for Raman and fluorescence applications). The light from the laser delivery fiber is filtered so that substantially only the laser wavelength is presented to the sample. The laser light is removed from the collected light so that Raman information is detectable to within 200 cm of the laser line. [0109] The distal end of the liquid crystal Raman endoscope is environmentally resistant and can withstand continuous operation at high temperatures and has been demonstrated to operate from 0 to 315 degrees Celsius while maintaining high signal to background performance. The distal end can be coupled to a microscope-based system enabling dispersive spectroscopy and multi-point spectroscopic sensing to be performed remotely. [0110] An endoscope-based spectroscopic sensing system is useful for detecting the presence of a hazardous agent in a remote location, such as the interior of a box or envelope, for example.
[0111] F AST-Based System
[0112] An emerging technology in the field of spectroscopic imaging is the use of fiber optic arrays. We have termed this technology Fiber Array Spectral Translators (FAST) but it is also accurately described as dimension reduction arrays. FAST technology can acquire a few to thousands of full spectral range, spatially resolved spectra simultaneously. For imaging this is done by focusing a spectroscopic image onto a two dimensional array of optical fibers that are drawn into a one-dimensional distal array with serpentine ordering. The one dimensional fiber stack is coupled to an imaging spectrograph. Software then extracts the spectral/spatial information that is embedded in a single CCD image frame. Fiber array spectroscopic imaging has been demonstrated in several applications including Raman chemical imaging analysis of micro-composites and biomaterials and time-resolved atomic emission chemical imaging of laser-induced plumes.
[0113] An advantage of this method over other current point spectroscopic detection methods is speed of analysis. A complete spectroscopic data set can be acquired in the amount of time it takes to generate a single spectrum from a given material. Even with limited pixel definition, comparing low-resolution spectral data with high-spatial resolution optical images can provide significant insight into the morphology and chemistry of the materials in the field of view.
[0114] Ambient Air Sensor System
[0115] The invention includes an ambient air sensor system comprising two parts, a sampling system and a spectroscopic imaging system. The optics block of such a system is shown diagrammatically in Figure 2. This block supports a section of a sample collection substrate such as a filter medium (e.g., a microporous filter medium having pores sufficiently small to substantially prevent passage of the hazardous agent of interest or a coated filter medium having pores large enough to permit passage of the hazardous agent of interest, but coated with an oil or other substance to which passing particles can adhere or into which passing molecules can be absorbed or dissolved) and provides an airtight seal around the periphery of the sampling area. This block should be easily opened so that either a new filter (when the system uses discrete filters as the substrate) or a new section of filter (when the system uses a continuous filter substrate) can be placed in the sampling/optics path. When a continuous substrate is used, a drive (e.g., a manual crank or a motor) can be included to advance the substrate between measurements, so that a fresh piece of the substrate is used for each measurement. The drive can be controlled by the same controller (or computer, if separate) used to control the optics.
[0116] The sampling system has an inlet, which is open to the atmosphere being tested. Its dimensions are optimized for the sampling flow rate and the anticipated range of particle sizes. For particulate or aerosol sampling, it is important that the inlet have no sharp bends or areas of low linear velocity, which can cause deposition of particulates prior to the collection filter. The sampling system includes or is connected to a sampling pump, which provides negative pressure to pull ambient air through the filter. Operation using positive pressure to force ambient air against the substrate is also possible. Air flow rates are in the range from 0.5 to 2.0 liters per minute are considered suitable for sampling, and a vacuum of about 100 inches of water (180 millimeters of mercury) should suffice to collect particulates in such a volume in a reasonable sample substrate area. [0117] The sampling system can be operated continuously or, preferably, during a series of discrete sampling periods. At the end of each period, the sample collection substrate can be replaced (or advanced if a continuous medium is used). This can be done either by the operator or automatically. For continuous or interrupted sampling, the substrate can be in a tape-like filter configuration and new samples of filter can be positioned in the optics block by a tape-drive mechanism, similar to that of an audiocassette. A wide variety of appropriate sample collection medium are known, including filter media such as porous polypropylene media and aluminum media, in disk, sheet, and roll forms. Selection of an appropriate sample collection substrate is within the ken of a skilled artisan. [0118] Once the particulates have been trapped on the sample collection substrate, multimodal spectroscopy is used to detect and classify the hazardous agent(s) present. If the excitation source is a laser which is coupled to the optics block using conventional or fiber optics to distribute the laser output over the sampling area, Raman imaging can be used. Alternately, the laser illumination can be shaped and/or split to match the distribution of points being selected (e.g., based on other optical properties of particulates on the substrate) or sampled. In another configuration, a light source comprised of a broadband UV/visible (UV/Vis), filtered UV/Vis, or a UV/Vis laser can be used to excite autofluorescence. The detector can be of the liquid crystal tunable type or another multi-point spectrometer type as described herein, and a CCD or other array camera can be used to define the sampling area at multiple wavelengths. Coupling of the detector to the optics block can be through fiber- based or conventional optics. The detector data is processed using chemometric and data analysis tools such as those in the CHEMANAL YZE (TM) and CHEMIMAGE XPERT (TM) software packages.
[0119] The ambient air monitor can be operated intermittently, for example as a series of sampling periods during which periodic spectroscopic measurements are taken. The sampling periods can follow one another immediately (i.e., a subsequent sampling period begins immediately following the preceding sampling period) or be interrupted by a period of time (e.g., sampling periods interrupted by a 20 minute delay). The results from the previous and current sampling periods can interpreted by a system computer which can display results and activate warning and danger alarms, or initiate some action such as turning off a building outside air intake.
[0120] System and Method for Dynamic Chemical Imaging
[0121] The methods described in this section can be performed using a system or method for detecting dynamic changes that occur in a sample between a first time interval and a second time interval using a series of at least first and second sequential chemical images of the sample. The first chemical image corresponds to an image of the sample during a first time interval. The second chemical image corresponds to an image of the sample at a second time interval after the first time interval.
[0122] During the first time interval: (i) the sample is illuminated with a plurality of photons to thereby produce photons scattered or emitted by the sample; (ii) a two- dimensional array of detection elements is then used to simultaneously detect scattered or emitted photons in a first predetermined wavelength band from different locations on or within the sample; and (iii) the two-dimensional array of detection elements is thereafter used one or more further times to simultaneously detect scattered or emitted photons in one or more further predetermined wavelength band(s) from different locations on or within the sample. The outputs of the two-dimensional array of detection elements during the first time interval are then combined to generate the first chemical image of the sample. [0123] During the second time interval: (i) the sample is illuminated with a plurality of photons to thereby produce photons scattered or emitted by the sample; (ii) the two- dimensional array of detection elements is then used to simultaneously detect scattered or emitted photons in a first predetermined wavelength band from different locations on or within the sample; and (iii) the two-dimensional array of detection elements is thereafter used one or more further times to simultaneously detect scattered or emitted photons in one or more further predetermined wavelength band(s) from different locations on or within the sample. The outputs of the two-dimensional array of detection elements during the second time interval are then combined to generate the second chemical image of the sample. [0124] Dynamic changes occurring in the sample between the first time interval and the second time interval are detected based on one or more differences between the first and second chemical images.
[0125] The present invention permits rapid observation of the sample with full spatial information, and allows the monitoring of the evolution and changes in the sample that are naturally proceeding or occurring (i.e., under equilibrium conditions,) as well as those that are additionally forced or imposed by creating a non-equilibrium condition via an external means (e.g., one or more external fields or forces applied to the sample). In certain embodiments, the external means may be applied to a specific location within the sample (rather than the whole sample).
[0126] Figure 10 schematically represents an apparatus according to one embodiment of the disclosure. The apparatus shown in Figure 10 enables providing a high optical throughput for imaging low light levels at variable magnification. Referring to Figure 10, sample 1000 is positioned on substrate 1050. Substrate 1050 can be any conventional microscopic slide or other means for receiving and optionally securing sample 1000. Light source 1100 is positioned to provide incident light to sample 1000. Light source 1100 can include any conventional photon source, including laser, LED, and other IR or near IR devices. Light source 1100 may also be selected to provide evanescence illumination of the sample. In one embodiment, the bandwidth of the source is in the range of about 15-25 cm" .
[0127] Referring still to Figure 10, it should be noted that light source 1100 is positioned to provide incident light at an angle to sample 1000 as opposed to light shining orthogonal to sample 1000. hi other words, the radiation used to illuminate the sample need not pass through the optical train of a conventional microscope (or macroscope); rather, it can illuminate the sample at an oblique angle from above or below sample 1000. Photon beam 1120 is received and deflected by mirror 1150 through lens 1200. Lens 1200 may optionally be used to focus the light on sample 1000. Alternatively, the photon beam 1120 may be directed towards the sample 1000 without the need for the mirror 1150. [0128] The multitude of photons in beam 1120 reaching sample 1000 illuminate the sample and are either scattered or absorbed by the sample, which can result in subsequent emission (luminescence) at different wavelengths. As known to those skilled in the art, the term "luminescence" includes a wide range of optical processes described using other names. These include: fluorescence, phosphorescence, photoluminescence, electroluminescence, chemiluminescence, sonoluminescence, thermoluminescence and even up-conversion. Scattered photons are schematically represented as beams 1160 and 1180 while specularly reflected photons are represented schematically as beam 1140. Luminescently-emitted photons are also represented as beam 1180. Optical lens 1250 is positioned to receive photon beams 1160 and l l80. Optical lens 1250 may be used for gathering and focusing received photon beams. This includes gathering and focusing both polarized and non-polarized photons. In general, the sample size determines the choice of light gathering optical lens 1250. For example, a microscope lens may be employed for analysis of the sub-micron to micrometer specimens. For larger samples, macro lenses can be used. Optical lens 1250 (as well as lens 1200) may include a simple reduced resolution/aberration lens with a larger numerical aperture to thereby increase system's optical throughput and efficiency. Mirror 1300 is positioned to direct emitted or scattered photon beams 1180 to tunable filter 1400. It should be noted that placement of mirror 1300 is optional and may be unnecessary in configurations where tunable filter is positioned above sample 1000. [0129] Laser rejection filter 1350 may be positioned prior to tunable filter 1400 to filter out scattered illumination light represented by beam 1160 and to optimize the performance of the system. In other words, rejection filter 1350 enables spectrally filtering of the photons at the illuminating wavelength.
[0130] A conventional tunable filter (including electro-optical, mechanical, or other tunable filter) can be used to further the principles of the disclosure. Examples of suitable tunable filters include an liquid crystal tunable filter ("LCTF") or an acousto-optical tunable filter ("AOTF"). The electro-optical filters (or other tunable filters) allow specific wavelengths or ranges of wavelengths of light to pass through as an image, depending on the control signals placed on the device by a controller. The wavelengths that can be passed through tunable filter 1400 may range from 200 nanometers (ultraviolet) to 2000 nanometers (i.e., the far infrared). The choice of wavelength depends on the desired optical region and/or the nature of the sample being analyzed.
[0131] Image sensor 1450 may be a digital device such as for example a two- dimensional, image focal plane array ("FPA") or CCD or CMOS sensor. The optical region employed to characterize the sample of interest governs the choice of FPA detector. For example, a two-dimensional array of silicon charge-coupled device ("CCD") detection elements, can be employed with visible wavelength fluorescence and Raman spectroscopic, while gallium arsenide (GaAs) and gallium indium arsenide (GaInAs) FPA detectors can be employed for image analyses at near infrared wavelengths. The choice of such devices depends on the type of sample being analyzed. In one embodiment, each detection element in the two-dimensional array of detection elements used to form image sensor 1450 functions to detect photons scattered or emitted from a different spatial location on or within the sample. In one embodiment, image sensor 1450 produces digital images of the entire view of the sample as processed by tunable filter 1400.
[0132] Figure 11 schematically represents an apparatus according to another embodiment of the disclosure. More specifically, Figure 11 schematically shows a high optical throughput configuration for imaging low light levels at variable magnification. The collection of optics are similar to that illustrated in Figure 10 but with illumination from the underside of sample 1000.
[0133] It is noted that in both Figures 10 and 11, sample 1000 is illuminated at an oblique angle. Specifically referring to Figure 11, photonic beam 1200 and the plane axis of sample 1000 define an oblique angle. It has been found that through oblique illumination, a so-called "Dark Field Raman Imaging" is developed. As opposed to the conventional bright field Raman configuration, the dark field Raman imaging decouples the image capture optics from the delivery of exciting radiation. Consequently, internal scattering and attenuation of the incident radiation has been minimized to improve the signal-to-noise (S/N) ratio. Also, the location of the optical source external to the optical train further allows the use of a lower cost, less powerful illumination source as well as enables a simpler, less expensive integration of several illumination sources into the system. The application of this configuration is not limited to Raman and luminescence imaging and can be successfully used, for example, with conventional spectroscopy.
[0134] In each of the embodiments shown in Figures 10 and 11, a computer or processor (not shown in the figures) can be coupled to and used to control the optical devices including light source (1100), lenses (1200, 1250, 1350), mirrors (1150, 1300) and tunable filter (1400). The computer is also coupled to image sensor 1450 and functions to generate "chemical images" from the output of the image sensor 1450. In one embodiment, each chemical image is a spatially accurate wavelength-resolved image of the sample that is formed from multiple "frames"; wherein each frame has plural spatial dimensions and is created from photons of a particular wavelength (or wave number) or from photons in a particular wavelength band (or wave number band) that are collected simultaneously by image sensor 1450 from different spatial locations on or within sample 1000. In each chemical image, multiple frames may be combined to form a complete image across all wavelengths (wave numbers) of interest. The chemical images generated by the computer may be further analyzed by the computer and/or displayed to a user. [0135] The present invention uses an apparatus such as those shown in Figures 10 and 11 to detect dynamic changes that occur in sample 1000 between a first time interval and a second subsequent time interval using a series of at least first and second sequential chemical images of sample 1000.
[0136] During the first time interval: (i) sample 1000 is illuminated with photons from source 1100 to thereby produce photons scattered or emitted by sample 1000; (ii) image sensor 1450 is then used to simultaneously detect scattered or emitted photons in a first predetermined wavelength band (selected by tunable filter 1400) from different locations on or within the sample; and (iii) for each of one or more further predetermined wavelength band(s) (each of which is sequentially selected using tunable filter 1400), image sensor 1450 is thereafter used to simultaneously detect scattered or emitted photons from different locations on or within the sample. The outputs of detector 1450 (for each of the wavelengths or wavelength bands selected by tunable filter 1400 during the first time interval) are then combined by a computer (not shown in the figures) to generate the first chemical image of the sample.
[0137] During the second subsequent time interval: (i) sample 1000 is illuminated with photons from source 1100 to thereby produce photons scattered or emitted by sample 1000; (ii) image sensor 1450 is then used to simultaneously detect scattered or emitted photons in a first predetermined wavelength band (selected by tunable filter 1400) from different locations on or within the sample; and (iii) for each of one or more further predetermined wavelength band(s) (each of which is sequentially selected using tunable filter 1400), image sensor 1450 is thereafter used to simultaneously detect scattered or emitted photons from different locations on or within the sample. The outputs of detector 1450 (for each of the wavelengths or wavelength bands selected by tunable filter 1400 during the first time interval) are then combined by the computer to generate the second chemical image of the sample.
[0138] Dynamic changes occurring in the sample between the first time interval and the second time interval are detected based on one or more differences between the first and second chemical images. Computer analysis of the chemical image with or without the physical image may be used to detect (or enhance detection of) the dynamic changes. The dynamic changes may also be detected by a user viewing a display of the chemical images. [0139] In various embodiments, a series of many sequential chemical images are obtained rapidly in succession to generate a "movie" of the sample. For example, as many as 100 chemical images per second of the sample may be obtained in order to detect dynamic changes in the sample in substantially real-time. In some embodiments, the temporal resolution of the chemical images in the sequence maybe as fine a 1 millisecond, i.e., the system will generate a chemical image of the sample every millisecond. Other temporal resolutions can also be selected including, for example, a temporal resolution that equates to chemical images spaced apart by as much as 15 minutes between adjacent images. When using the present invention to monitor a particular process or reaction, the temporal resolution selected should be sufficient to detect dynamic changes of interest that occur in the sample over time.
[0140] The present invention thus permits rapid observation of sample 1000 with full spatial information, and allows the monitoring of the evolution and changes in sample 1000 that are natural proceeding or occurring (i.e., under equilibrium conditions), as well as those that are additionally forced or imposed by creating a non-equilibrium condition via an external means (e.g., one or more external fields or forces applied to the sample). In certain embodiments, the external means are applied to a specific location within sample 1000 (rather than to the whole sample). Examples of samples that may be analyzed and observed used the dynamic chemical imaging techniques of the present invention includes biological samples or micro-fluidic circuits undergoing changes over time. These changes may include displacement, chemical interaction, a change in chemical state, phase change, growth, shrinkage, chemical decomposition, chemical metabolism, and physical strain. Numerous other examples of samples/changes applicable to the present invention will be recognized by the those skilled in the art and are considered within the scope of the present invention.
[0141] As noted above, the present invention may be used to detect dynamic changes in the sample that result from application of an external condition to the sample. Such external conditions include, for example, varying an electric or magnetic field applied to or within sample 1000 between the first and second time intervals; varying an external optical field applied to or within the sample between the first and second time intervals, wherein the external optical field is distinct from the optical field initially used to illuminate the sample; varying the optical field applied to or within the sample between the first and second time intervals, wherein the additional optical field is produced by pulsing the optical filed used to illuminate the sample; varying internally generated photons applied to or within the sample between the first and second time intervals; varying a polarization used to illuminate the sample between the first and second time intervals; varying a temperature of the sample between the first and second time intervals; varying a pressure applied to the sample between the first and second time intervals; or varying a stress applied to or within the sample between the first and second time intervals, m other embodiments, a chemical gradient associated with the sample (e.g., a chemical gradient imposed on the sample) varies between the first and second time intervals, hi still further embodiments, a physiological or biological stress is induced in the sample between the first and second time intervals, hi another important embodiment, the dynamic effect of adding one or more chemical species (e.g., a pharmaceutically active agent, an antibody, or a nucleic acid) to a sample is observed at multiple times.
[0142] In some embodiments, each chemical image in the sequence is made up of multiple separate spatially accurate wavelength-resolved images of the sample (each of which is formed from multiple "frames" as discussed above), wherein each of the multiple separate spatially accurate wavelength-resolved images corresponds to one of a plurality of different depths within the sample. These embodiments are useful for detecting chemical changes occurring throughout the volume of sample 1000, rather than changes occurring on a single surface or plane of the sample.
[0143] In still further embodiments, differences between or among various chemical images in the sequence may be correlated (using, e.g., the computer discussed above or by a user) with orthogonal (i.e., complementary) measurements of the sample made during each of the time intervals associated with the sequence, in order to enhance detection or observation of dynamic changes in the sample. Examples of orthogonal measurements that may be used include measurements made using the following modalities: Raman scattering, near infrared absorption (NIR), visual imagery, video or luminescence. Other orthogonal measurements may also be used and are considered to be within the scope of the present invention.
[0144] Experimental Results
[0145] Spectra generated using traditional spectroscopic methods can potentially reveal a wealth of information about molecular properties of hazardous agents. Spectroscopic imaging compounds this information by allowing variations in the composition of these materials to be probed downed to arbitrarily small levels (e.g., a single bacterium) if desired. Figure 7, for example, shows an optical image (Figure 7A), a Raman chemical image (Figure 7B), and a fluorescent image (Figure 7C) obtained from a mixture of Bacillus anthracis in a mixture medium components and formalin. Figures 7D and 7E are examples of image fusion of the optical image shown in Figure 7 A with the spectroscopic images shown in Figures 7B and 7C, respectively. [0146] Figure 4A depicts dispersive Raman spectra take from three different samples, each comprising one bacterial spore type. This demonstrates that despite the genetic and morphological similarities, Raman spectroscopy can be used to sufficiently discriminate among the different bacteria spores. The ability to distinguish the different spectra of small objects during one spectral scan is important for picking out and discriminating entities such as BWAs or CWAs in a mixture.
[0147] Figure 6 depicts how spectral sensing and analysis using a fluorescence system can also be used to discriminate and distinguish different Bacillus species. The fluorescence spectra in Figure 6C were obtained for the two Bacillus types. Based on differences in these fluorescence spectra, particularly the peaks, Bacillus subtilis spores (which exhibit a fluorescence peak maximum at 630 nanometers) can be distinguished from Bacillus pumilus spores (which exhibit a fluorescence peak maximum at 540 nanometers). Images in Figures 6A and 6B depict the same microscopic field using different fluorescent spectral imaging wavelengths.
[0148] Figure 8 depicts how fluorescent and visible spectral analysis in a macroscope system allows one to detect B. globigii candidate entities in a mixture of B. globigii and baking soda on the outside of an envelope. Raman spectral imaging of the sample areas (or one or more pixels within the areas) designated PtI, Pt2, and Pt3 can be used to confirm the identities of the compounds identified by fluorescent spectrum in Figure 8D by comparison with reference Raman spectra for those compounds.
[0149] Anthrax spores have been Raman imaged in a secure biohazard laboratory. Different strains of Anthrax spores have been differentiated by Raman spectroscopy and Raman imaging. Additionally, Raman spectral analysis of chemical images (i.e., Raman chemical imaging) has been used to differentiate same species and strain grown under different environmental conditions and/or growth medium. This ability can have useful investigatory applications. Similarly, Raman spectral analysis has been used to differentiate viable from non- viable endospores. Viability of suspect spores is a critical variable in determining the real threat posed.
[0150] The devices and methods described herein can be used to differentiate between multiple entities that may be present in a sample. Figure 5B depicts an image of a sample comprising at least three different materials. Figure 5 A depicts Raman spectra of three components known to be present in the sample. Raman spectral analyses of the boxed portions of Figure 5B indicate the identity of the entities within the boxes. These results demonstrate the capacity of the systems described herein for differentiating entities in a sample that are as diverse as Bacillus globigii (a bacterium), egg white (a protein agglomerate), and Aspergillus terreus spores (fungal spores). In Figure 5B, B. globigii cells appear greenish, egg white appears reddish, and A. terreus spores appear bluish. In Figure 5C, Raman scattered light having an RS value of about 2950 cm appears light-colored and corresponds with greenish areas in Figure 5B, confirming occurrence of B. globigii cells in those portions of the field of view. In Figure 5D, Raman scattered light having an RS value of about 3050 cm appears light-colored and corresponds with bluish areas in Figure 5B, confirming occurrence of A. terreus spores in those portions of the field of view. The colors corresponding to selected RS values in composite images including Raman scattering and other spectroscopic data (e.g., composite images including Raman spectral data and visible light images, with or without fluorescent image data) can be the actual colors of Raman shifted light or pseudocolors. Pseudocolors can be selected to maximize contrast with other image components, to be consistent with pseudocolors used in separate images, to yield visually appealing images, or arbitrarily selected, for example.
[0151] A wide variety of biological pathogens can be detected using the multimodal spectral sensing methods described herein (i.e., for detection, classification as to species or strain, determination of viability, or some combination of these). These include eukaryotes such as protozoans and fungi (e.g., Giardia species, Candida albicans, or Cryptosporidium species in water or soil); bacteria (e.g., Escherichia coli, Yersinia pestis, Francisella tularensis, Brucella species, Clostridium perfringens and other species of Clostridium, Burkholderia mallei, Burkholderia pseudomallei, Chlamydia psittaci, Coxiella burnetii, Rickettsia prowazekii, Vibrio species, Enterococcus faecalis, Staphylococcus epidermidis, Staphylococcus aureus, Enterobacter aerogenes, Corynebacterium diphtheriae, Pseudomonas aeruginosa, Acinetobacter calcoaceticus, Klebsiella pneumoniae, Serratia marcescens); and viruses (variola, vaccinia, filoviruses such as Ebola and Marburg viruses, naviruses such as Lassa fever and Machupo viruses, and alphaviruses such as Venezuelan equine encephalitis, eastern equine encephalitis, and western equine encephalitis viruses). The methods can also be used to detect the causative agents of any viral, bacterial, parasitic, or prion disorder, including for example causative agents of disorders such as tularemia, brucellosis, glanders, melioidosis, psittacosis, Q fever, typhus, smallpox, and encephalitis. [0152] In addition, just as toxic components in a masking mixture can be detected, so can specific materials in other mixtures be similarly determined. These includes but is not limited to a wide range of mixtures such as hazardous agents in blood, impurities or active ingredients in drug tablets, and specific entities among airborne particulates.
[0153] Data Analysis
[0154] Data analysis and chemometric tools examine the differences in fluorescence or
Raman spectra found for each of the spectra and perform a separation into principal components to distinguish the pure components and identify the respective component, for example by comparison with a reference database of spectra stored in data storage entity
430 of Figure 1. Methods of comparing a Raman spectrum with one or more reference spectra are known in the art.
[0155] A variety of data processing procedures can be used with these systems. For example, a weighted multi-point spectral data subtraction routine can be used to suppress contribution from the sample background or sample support (e.g., Raman light scattered by a microscope slide). Alternatively, multivariate spectral analysis involving principal factor analysis and subsequent factor rotation can be used for differentiation of pure molecular features in hazardous agents, and other entities (e.g., non-threatening 'masking' compounds).
[0156] The following is an example of an algorithm that can be used to perform this multi-point analysis, and uses a mixture of Bacillus subtilis and B. pumilus spores as a sample:
[0157] 1. Load a fluorescence image from stored values or from an instrument output.
[0158] 2. Load a brightfield microscope image of the same field of view from stored values or from an instrument output.
[0159] 3. Perform instrument response correction by dividing each image by a calibration image.
[0160] 4. Pre-process both images to remove outliers and noise, for example using
[0161] 4a. A cosmic filter to achieve median filtering for points whose values differ significantly from the local neighborhood mean and
[0162] 4b. A Wiener filter to achieve spatial image smoothing to remove additive noise.
[0163] 5. Using the brightfield image, obtain a binary mask of the spores using one of several possible methods, two of which are: [0164] 5a. Watershed segmentation, which marks each spore and segments each spore based on the gradient of its intensity profile, and
[0165] 5b. Otsu thresholding method to determine an optimum intensity threshold (See
Otsu, 1979, "A Threshold Selection Method from Gray-Level Histograms," IEEE
Transactions on Systems, Man, and Cybernetics 9(l):62-66)
[0166] 6. Perform particle analysis on the binary objects to obtain spatial features such as area, length, width, shape factor, eccentricity, and the like.
[0167] 7. Multiply the fluorescence image by the binary mask.
[0168] 8. Perform principal component analysis (PCA) on this masked fluorescence image to obtain the most significant principal components and corresponding score images that comprise a certain majority percentage of the variance. For instance, if two principal components comprise 99% of the variance, and 99% is the specified threshold, two score images are retained.
[0169] 9. Create "spectral" features from the average of the score images over the pixels comprising the masked objects.
[0170] 10. Combine the spectral and spatial feature vectors.
[0171] 11. Perform PCA on the combined feature vectors.
[0172] 12. Cluster the PCs with multidimensional k-means clustering, with the number of clusters specified by the number of PCs retained in Step 8.
[0173] 13. Assign each cluster a color, and assign the corresponding color to the objects in the mask. This color image shows the detected threats.
[0174] 14. Perform image fusion to correlate features with the optical or other image features which have been characterized by other methods.
[0175] Applications
[0176] The devices, systems, and methods described herein are suitable for rapid (chemical and/or biological) detection of hazardous agents and other applications. Configured in the macroscopic version of the technology, multimodal spectroscopic sensing can be employed for rapid assessment of large areas for suspect hazardous agents based on their fluorescence, NIR, UV/visible properties, or on some combination of these properties. Configured in the microscopic mode, visualization, positive detection, classification, and identification of suspect hazardous agents can be made. Configured in the endoscopic mode, hazardous agents can be visualized, detected, classified, and identified remotely. Configured in FAST mode, hazardous agents can be detected, classified, identified, and visualized remotely or at the microscope in real-time. When configured as an air sampler, unambiguous detection of airborne hazardous agents can be performed.
[0177] Advantages Over Currently Available Technology
[0178] Traditional approaches to detection of hazardous biological agents include inoculation methods, enzyme-linked immunosorbent assay (ELISA) methods, BIOTHREAT
ALERT (TM, Tetracore Inc, Gaithersburg, MD; BTA) test strips, DNA-based tests, DNA chip analyses, and mass spectrometry.
[0179] Inoculation methods involve the inoculation of suspect culture or specimen into an animal that is then observed for development of disease. In addition to animal cruelty issues, there are drawbacks with this approach including the extensive amount of time required to achieve detection.
[0180] ELISA tests involve antibody detection. This technique is also slow and suffers from a high rate of false positive results (e.g., unrelated antibody reacts with antigen nonspecifically) and false negative results (e.g., interfering compounds present in blood or antibodies not concentrated enough to be detected). Furthermore, a patient can test positive to antibodies long after the patient has recovered.
[0181] BTA test strips are small plastic devices that work very much like a home pregnancy test. The test strips contain specific antibodies that change color on the strip indicating the presence of a bio-threat agent. A negative result means the bio-threat agent is not present within the detection limit of the strip. Although results can be obtained in a relatively short period (e.g., 15 minutes), the incidence of false negatives and false positives is high.
[0182] DNA-based tests detect biological agents by recognizing their genetic sequences.
While more sensitive than BTA test strips, DNA-based tests are susceptible to masking agents and involve a lengthy analysis time. DNA chip analysis involves the immobilization of DNA strands on a Si or glass wafer chip. DNA will bind to or hybridize complementary
DNA strands in the sample being tested. A specially designed microscope detects where the
DNA hybridizes. Amplification is achieved by polymerase chain reaction (PCR).
Detection of bio-threat agent is reported to be possible within minutes. The limitations of DNA-based methods are two-fold. First, DNA methods are designed to detect a specific bio-threat agent through its unique DNA sequences. Therefore, each DNA test is specific to one agent and if it is desired to detect additional agents, additional test reagents must be developed. A second limitation revolves to the problems of false negatives and false positives due to environmental contamination. DNA tests are well known to have problems yielding correct results in "real-world" samples.
[0183] Mass Spectrometry (MS) uses the pattern of mass fragments generated when a cell, spore, or chemical is subjected to an ionization process under high vacuum to characterize the organism(s) or chemical(s) present in a sample. This technique has the advantage of very sensitive detection, but requires a sophisticated sampling system in order to deliver a representative sample to the ionizer. The main limitation of MS is that it requires the use of high vacuum pumps that are inherently delicate and expensive. An additional limitation is that it is a destructive technique.
[0184] Alternative embodiments of the devices and systems described herein include probes or microscopes based on spectroscopic methods including Raman, fluorescence, NIR, and others for rapid, non-contact, and accurate detection of hazardous agents. Similar techniques have been previously applied in a time-consuming approach involving spectroscopically addressing individual points in a sample, one at a time. The multimodal spectral sensing methods described herein rapidly provide data needed for automated spectral analytical methods. Partial component analysis approaches can be used in combination with these methods for chemical imaging analysis. The multimodal spectral sensing methodology described herein can be implemented in a miniaturized, compact sensing platform. The devices, systems, and methods described herein can be used to identify the distribution of individual hazardous agents in the presence of other hazardous agents, environmental contaminants, and/or non-threatening 'masking' agents, in either local and remote environments. These are characteristics that no traditional method provides. The devices, systems, and methods described herein can exhibit a lower incidence of false positive and false negative results, and permit one to determine if a true threat exists in a time frame of minutes. [0185] Trimodal chemical imaging of Fluorescein-5-isothiocyanate (FITC) [0186] Integrated fluorescence imaging of cells is a well-established technology in the field of fluorescence-based cell and molecular biochemical assays. In particular, this method is widely used for detection of drug-cell interactions as part of drug discovery and development. This type of imaging is generally carried out using bandpass optical filters, and in so doing provides no information regarding changes in band shape or peak position related to the chemical environment or interactions of the molecular probes. Pn contrast, hyperspectral fluorescence imaging provides spectra associated with each pixel of the image, thereby revealing information about the chemical environment and molecular interactions at each spatial location in the field of view. Additional hyperspectral modalities that can be applied to that same field of view include visible absorption and Raman imaging. The probing of chemical interactions through the combination of electronic and vibrational modes of spectroscopic imaging from the same field of view provides a wealth of information regarding biological systems such as cells, tissues, and organisms. [0187] Three-mode chemical imaging, based on assessment of visible absorption, fluorescence emission, and Raman scattering, can be performed using a single instrument. The instrument includes a liquid crystal tunable filter (LCTF) and a charge-coupled device (CCD) imaging camera as described herein. This instrument can be used to perform three modes of spectral imaging of solvated compounds, such as those commonly used as molecular probes for bioimaging applications.
[0188] To understand the chemical basis, consider the widely used molecular probe, FITC (molecular formula: C21H1 1NO5S, molecular weight: 389.38). FITC is an exogenous fluorophore - that is, a molecule that must be conjugated to a biomolecule to function as a fluorescent tag that achieves specificity with respect to certain biological sites. A feature common to exogenous fluorophores is their highly conjugated chemical bonding from which arise the electronic transitions associated with strong absorptions of visible light and subsequent emissions, often at high quantum efficiency. Also, the highly conjugated pi- bonding contributes to the high polarizability of the molecule, which also contributes to strong Raman scattering attributable to vibrational transitions. Consequently, the molecular structure of exogenous fluorophores is ideal for the development of multimode hyperspectral imaging. [0189] The absorption and fluorescence emission spectra of FITC are shown in Figure 9. FITC absorbs light at wavelengths between 425 and 525 nanometers, and manifests an absorption maximum at approximately 490 nanometers. The fluorescence emission manifests a modest Stokes shift (energy difference between the absorption and emission maxima) with an emission maximum at approximately 520 nanometers. Therefore, a hyperspectral fluorescence image can be produced by irradiating a sample containing FITC with light having a wavelength of 488 nanometers (e.g., the 488 nanometer line of an argon laser). Hyperspectral Raman images can be generated by irradiating the sample with either a 632.8 nanometer line from a He-Ne laser or the 635 nanometer line from a semiconductor laser. Either red wavelength is significantly longer than either the absorption or emission maxima, and no fluorescence would be expected to interfere with Raman scattered radiation upon Raman imaging of a sample illuminated with these red wavelengths. Consequently, hyperspectral Raman and fluorescence images can be obtained from the same field of view of a sample containing FITC by proper selection of the illumination wavelengths. [0190] Hyperspectral absorption images can be generated by transmitting white light through the sample and passing it through the LCTF and focusing the light on a CCD imaging camera. The light collection, wavelength selection, and imaging camera can be the same for hyperspectral absorption, fluorescence emission, and Raman imaging. Consequently, all three modes of hyperspectral imaging provide complementary chemical information about the exact same locations in a single field of view.
[0191] The disclosure of every patent, patent application, and publication cited herein is hereby incorporated herein by reference in its entirety.
[0192] While this invention has been disclosed with reference to specific embodiments, it is apparent that other embodiments and variations of this invention can be devised by others skilled in the art without departing from the true spirit and scope of the invention. The appended claims include all such embodiments and equivalent variations.

Claims

CLAIMS What is claimed is:
1. A method of assessing occurrence of a hazardous agent in a sample that comprises multiple entities, the method comprising assessing a first optical property of the entities to select an entity for which the first optical property is characteristic of the agent, and thereafter assessing Raman-shifted radiation scattered by the selected entity, wherein exhibition of a Raman scattering property characteristic of the agent by the selected entity is indicative of occurrence of the agent in the sample.
2. The method of claim 1, wherein the first optical property is selected from the group consisting of absorbance, fluorescence, diffraction, polarization, microscopic morphology, and an optical property associated with particle motion.
3. The method of either of claims 1 and 2, wherein Raman-shifted scattered radiation is assessed only for entities for which the first optical property is characteristic of the agent.
4. The method of claim 3, wherein the first optical property is microscopic morphology.
5. The method of claim 4, wherein the morphology is assessed by a method selected from the group consisting of scanning electron microscopy, visible light reflectance microscopy, ultraviolet light reflectance microscopy, light reflectance microscopy, visible light transmission microscopy, ultraviolet light transmission microscopy, infrared light transmission microscopy, and fluorescence microscopy.
6. The method of claim 5, wherein the morphology is assessed by visible light reflectance microscopy.
7. The method of any of claims 1-6, comprising assessing Raman-shifted radiation scattered by a selected entity that also exhibits a second optical property characteristic of the agent.
8. The method of claim 7, wherein the second optical property is selected from the group consisting of absorbance, fluorescence, diffraction, polarization, and microscopic morphology.
9. The method of claim 7, wherein Raman-shifted scattered radiation is assessed only for entities for which the first and second optical properties are characteristic of the agent.
10. The method of claim 7, wherein the first optical property is microscopic morphology.
11. The method of claim 10, wherein the second optical property is fluorescence.
12. The method of claim 11, wherein the first and second optical properties are both assessed by fluorescence microscopy.
13. The method of claim 11, wherein the morphology is assessed by visible light reflectance microscopy.
14. The method of claim 11, wherein fluorescence is assessed only for entities that exhibit microscopic morphology characteristic of the agent.
15. The method of any of claims 1-14, wherein the agent is a synthetic organic chemical.
16. The method of any of claims 1-14, wherein the agent is an inorganic chemical.
17. The method of any of claims 1-14, wherein the agent is a biological toxin.
18. The method of any of claims 1-14, wherein the agent is a microorganism.
19. The method of claim 18, wherein the microorganism is a bacterium.
20. The method of claim 18, wherein the microorganism is a protozoan.
21. The method of any of claims 1-14, wherein the agent is a virus.
22. The method of any of claims 1-21, wherein the Raman-shifted scattered radiation is transmitted through a filter prior to assessing the Raman-shifted scattered radiation.
23. The method of claim 22, wherein the filter is selected from the group consisting of a Fabry Perot angle tuned filter, an acousto-optic tunable filter, a liquid crystal tunable filter, a Lyot filter, an Evans split element liquid crystal tunable filter, a Sole liquid crystal tunable filter, a spectral diversity filter, a photonic crystal filter, a fixed wavelength Fabry Perot tunable filter, an air-tuned Fabry Perot tunable filter, a mechanically-tuned Fabry Perot tunable filter, and a liquid crystal Fabry Perot tunable filter.
24. The method of any of claims 1-21, wherein the Raman-shifted scattered radiation is transmitted through an interferometer prior to assessing the Raman-shifted scattered radiation.
25. The method of claim 24, wherein the interferometer is selected from the group consisting of a polarization-independent imaging interferometer, a Michelson interferometer, a Sagnac interferometer, a Twynam-Green interferometer, a Mach-Zehnder interferometer, and a tunable Fabry Perot Interferometer.
26. The method of any of claims 1-25, wherein the Raman-shifted scattered radiation is collected using a device selected from the group consisting of a macroscope, a microscope, an endoscope, and a fiber optic array.
27. The method of any of claims 1-26, comprising assessing a Raman scattering spectrum of the selected entity.
28. The method of claim 27, wherein the spectrum includes Raman shift values in the range 20-2000 Cm" 1.
29. The method of claim 27, wherein the spectrum includes Raman shift values in the range 2700-3200 Cm"1.
30. The method of claim 27, wherein the spectrum includes Raman shift values in the range 1000-2000 Cm" 1.
31. The method of claim 27, wherein the spectrum includes Raman shift values in the range 500-3000 Cm'1.
32. A device for assessing occurrence of a hazardous agent in a sample that comprises multiple entities, the device comprising a radiation source for irradiating the sample, a first detector for detecting a first optical property of the entities, a Raman detector for detecting Raman-shifted radiation scattered by the entities, and a controller operably linked to the Raman detector for restricting detection of Raman-shifted radiation to entities for which the first optical property is characteristic of the agent.
33. The device of claim 32, wherein the controller is a computer operating software for analyzing the response of the first detector.
34. The device of either of claims 32 and 33, wherein the radiation source is a visible light source.
35. The device of claim 34, wherein the first optical property is microscopic morphology.
36. The device of either of claims 32 and 33, wherein the first optical property is fluorescence intensity.
37. The device of any of claims 32-36, further comprising an output for reporting the first optical property of the entities, wherein the controller is operable by a user.
38. The device of claim 37, wherein the output is a visual display on which an image of the first optical property is displayed.
39. The device of any of claims 32-28, further comprising a second detector for detecting a second optical property of the entities, wherein the controller restricts detection of Raman- shifted radiation to entities for which both the first and second optical properties are characteristic of the agent.
40. The device of claim 39, wherein the first optical property is microscopic morphology and the second optical property is fluorescence.
41. The device of any of claims 32-40, wherein the radiation source is substantially monochromatic.
42. The device of any of claims 32-41, comprising both a polychromatic radiation source and a substantially monochromatic radiation source.
43. The device of any of claims 32-42, wherein radiation from the sample is coupled to the first and Raman detectors by way of a plurality of optical fibers.
44. The device of claim 43, wherein the optical fibers are arranged in a one-dimensional array with serpentine ordering at their ends nearest the sample.
45. A device for assessing occurrence of a hazardous agent in an ambient sample, the device comprising an air handling system for depositing particles in the ambient air on a substrate, a radiation source for irradiating the substrate, a first detector for detecting a first optical property of the particles deposited on the substrate, a Raman detector for detecting Raman-shifted radiation scattered by the particles deposited on the substrate, and a controller operably linked to the Raman detector for restricting detection of Raman-shifted radiation to particles for which the first optical property is characteristic of the agent.
46. The device of claim 45, wherein the substrate is a microporous filter medium.
47. The device of claim 46, wherein the air handling system comprises a vacuum pump for drawing the ambient air through the filter medium.
48. The device of claim 46, wherein the filter medium is in the form of a strip having a long axis and the device further comprises a drive for advancing the strip in the direction of its long axis.
49. The device of claim 48, wherein the controller coordinates assessment of the first optical property, assessment of Raman-scattered radiation, and subsequent advancement of the strip.
50. The device of any of claims 45-49, further comprising a second detector for detecting a second optical property of the particles deposited on the substrate, wherein the controller restricts detection of Raman-shifted radiation to particles for which both the first and second optical properties are characteristic of the agent.
51. The device of claim 50, wherein the first optical property is microscopic morphology and the second optical property is fluorescence.
PCT/US2005/023705 2004-06-30 2005-06-30 Multimodal method for identifying hazardous agents WO2006091223A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
CA002571932A CA2571932A1 (en) 2004-06-30 2005-06-30 Multimodal method for identifying hazardous agents
EP05857503A EP1766351A4 (en) 2004-06-30 2005-06-30 Multimodal method for identifying hazardous agents

Applications Claiming Priority (6)

Application Number Priority Date Filing Date Title
US58471904P 2004-06-30 2004-06-30
US10/882,082 US7046359B2 (en) 2004-06-30 2004-06-30 System and method for dynamic chemical imaging
US10/882,082 2004-06-30
US60/584,719 2004-06-30
US11/000,841 US7532320B2 (en) 2004-06-30 2004-11-30 Multimodal method for identifying hazardous agents
US11/000,841 2004-11-30

Publications (2)

Publication Number Publication Date
WO2006091223A2 true WO2006091223A2 (en) 2006-08-31
WO2006091223A3 WO2006091223A3 (en) 2007-03-22

Family

ID=36927863

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2005/023705 WO2006091223A2 (en) 2004-06-30 2005-06-30 Multimodal method for identifying hazardous agents

Country Status (3)

Country Link
EP (1) EP1766351A4 (en)
CA (1) CA2571932A1 (en)
WO (1) WO2006091223A2 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2432661A (en) * 2005-11-25 2007-05-30 Council Cent Lab Res Councils Security screening using Raman analysis
DE102006053540B3 (en) * 2006-11-14 2008-01-31 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Optospectroscopic analysis of biological sample in fluid, comprises: fixing the biological sample in a sample holding unit, categorizing particles in biological sample based on an analysis of the image data and analyzing biological sample
WO2008147227A1 (en) * 2007-05-31 2008-12-04 Veritide Limited Method for spore detection
DE102007062067A1 (en) * 2007-12-21 2009-07-02 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method for characterizing particles, involves irradiating particles with visible light, detecting light reflected or radiated by particles, and irradiating particles with ultraviolet light
EP2405256A1 (en) * 2010-07-09 2012-01-11 SoftScan HealthCare Group Quantitative in vivo lifetime imaging using a time-domain platform with a supercontinuum tunable laser for extended spectral coverage
WO2013005061A3 (en) * 2011-07-06 2013-06-27 Micromass Uk Limited Photo-dissociation of proteins and peptides in a mass spectrometer
US8734536B2 (en) 2010-07-21 2014-05-27 First Solar, Inc Temperature-adjusted spectrometer
FR2998967A1 (en) * 2012-12-03 2014-06-06 Univ Lorraine Spectroscopy apparatus i.e. spectroscope, for spectroscopy of door sample for study of e.g. Raman diffusion, has adjusting unit regulating position of sample support according to three translation axes and fulcrum pin
EP2896957A1 (en) * 2014-01-21 2015-07-22 Molecular Devices, LLC Monochromator-based and filter-based detection system
WO2024100252A1 (en) * 2022-11-10 2024-05-16 The European Union, Represented By The European Commission A system for the detection of airborne viruses
US12055494B2 (en) * 2020-01-21 2024-08-06 Samsung Electronics Co., Ltd. Object recognition apparatus and operation method thereof

Families Citing this family (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102015001033A1 (en) 2015-01-27 2016-07-28 Leibniz-Institut für Photonische Technologien e. V. High-throughput screening system for performing optical measurements

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5442438A (en) * 1988-12-22 1995-08-15 Renishaw Plc Spectroscopic apparatus and methods
US5638166A (en) * 1995-05-18 1997-06-10 The Regents Of The University Of California Apparatus and method for rapid detection of explosives residue from the deflagration signature thereof
US5866430A (en) * 1996-06-13 1999-02-02 Grow; Ann E. Raman optrode processes and devices for detection of chemicals and microorganisms
US5759859A (en) * 1996-07-15 1998-06-02 United States Of America As Represented By The Secretary Of The Army Sensor and method for detecting trace underground energetic materials
EP1463926A4 (en) * 2002-01-10 2010-09-08 Chemimage Corp Method for detection of pathogenic microorganisms
US20040068193A1 (en) * 2002-08-02 2004-04-08 Barnes Russell H. Optical devices for medical diagnostics

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of EP1766351A4 *

Cited By (20)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2432661A (en) * 2005-11-25 2007-05-30 Council Cent Lab Res Councils Security screening using Raman analysis
US7911604B2 (en) 2005-11-25 2011-03-22 The Science And Technology Facilities Council Security screening using raman analysis
US8085396B2 (en) 2006-04-05 2011-12-27 The Science And Technology Facilities Council Raman analysis
US8259902B2 (en) 2006-04-05 2012-09-04 The Science And Technology Facilities Council Raman analysis of tissue and/or calcifications
US8279434B2 (en) 2006-11-14 2012-10-02 Fraunhofer-Gesellschaft zur Förderung der angwandten Forschung, e.V. Arrangement and method for analysis of biological samples
DE102006053540B3 (en) * 2006-11-14 2008-01-31 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Optospectroscopic analysis of biological sample in fluid, comprises: fixing the biological sample in a sample holding unit, categorizing particles in biological sample based on an analysis of the image data and analyzing biological sample
WO2008058683A2 (en) * 2006-11-14 2008-05-22 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Arrangement and method for the analysis of biological samples
WO2008058683A3 (en) * 2006-11-14 2008-08-14 Fraunhofer Ges Forschung Arrangement and method for the analysis of biological samples
WO2008147227A1 (en) * 2007-05-31 2008-12-04 Veritide Limited Method for spore detection
US8711354B2 (en) * 2007-05-31 2014-04-29 Veritide Limited Method for spore detection
DE102007062067A1 (en) * 2007-12-21 2009-07-02 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Method for characterizing particles, involves irradiating particles with visible light, detecting light reflected or radiated by particles, and irradiating particles with ultraviolet light
EP2405256A1 (en) * 2010-07-09 2012-01-11 SoftScan HealthCare Group Quantitative in vivo lifetime imaging using a time-domain platform with a supercontinuum tunable laser for extended spectral coverage
US8734536B2 (en) 2010-07-21 2014-05-27 First Solar, Inc Temperature-adjusted spectrometer
US9177877B2 (en) 2010-07-21 2015-11-03 First Solar, Inc. Temperature-adjusted spectrometer
WO2013005061A3 (en) * 2011-07-06 2013-06-27 Micromass Uk Limited Photo-dissociation of proteins and peptides in a mass spectrometer
FR2998967A1 (en) * 2012-12-03 2014-06-06 Univ Lorraine Spectroscopy apparatus i.e. spectroscope, for spectroscopy of door sample for study of e.g. Raman diffusion, has adjusting unit regulating position of sample support according to three translation axes and fulcrum pin
EP2896957A1 (en) * 2014-01-21 2015-07-22 Molecular Devices, LLC Monochromator-based and filter-based detection system
EP3293510A1 (en) * 2014-01-21 2018-03-14 Molecular Devices, LLC Fluorescent microscopy system
US12055494B2 (en) * 2020-01-21 2024-08-06 Samsung Electronics Co., Ltd. Object recognition apparatus and operation method thereof
WO2024100252A1 (en) * 2022-11-10 2024-05-16 The European Union, Represented By The European Commission A system for the detection of airborne viruses

Also Published As

Publication number Publication date
EP1766351A4 (en) 2009-12-02
CA2571932A1 (en) 2006-08-31
EP1766351A2 (en) 2007-03-28
WO2006091223A3 (en) 2007-03-22

Similar Documents

Publication Publication Date Title
US7532320B2 (en) Multimodal method for identifying hazardous agents
US6917423B2 (en) Method for detection of pathogenic microorganisms
US8094294B2 (en) Multipoint method for identifying hazardous agents
US7057721B2 (en) Wide field method for detecting pathogenic microorganisms
WO2006091223A2 (en) Multimodal method for identifying hazardous agents
US10267734B2 (en) Wavelength dispersive microscope spectrofluorometer for characterizing multiple particles simultaneously
US7286222B2 (en) Sample container and system for a handheld spectrometer and method for using therefor
US6707548B2 (en) Systems and methods for filter based spectrographic analysis
US7436510B2 (en) Method and apparatus for identifying a substance using a spectral library database
US7542138B2 (en) Sample container and system for a handheld spectrometer and method for using therefor
CN101036038A (en) Multimodal method for identifying hazardous agents
US20070081156A1 (en) System and method for a chemical imaging threat assessor with a probe
WO2006083316A2 (en) Multipoint method for identifying hazardous agents
US20130082180A1 (en) Multipoint Method for Assessing a Biological Sample
US20120252058A1 (en) System and Method for the Assessment of Biological Particles in Exhaled Air
US20120057743A1 (en) System and method for fluorescence guided ingredient specific particle sizing
US6552794B2 (en) Optical detection method for improved sensitivity
US20240053200A1 (en) Detection and identification of body fluid traces with stand-off raman spectroscopy
WO2005121726A2 (en) Method and apparatus for identifying a substance

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2571932

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 7893/DELNP/2006

Country of ref document: IN

NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Ref document number: DE

WWE Wipo information: entry into national phase

Ref document number: 2005857503

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 200580029238.6

Country of ref document: CN

DPE2 Request for preliminary examination filed before expiration of 19th month from priority date (pct application filed from 20040101)
WWP Wipo information: published in national office

Ref document number: 2005857503

Country of ref document: EP