EP1190372A1 - Method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples - Google Patents

Method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples

Info

Publication number
EP1190372A1
EP1190372A1 EP00936267A EP00936267A EP1190372A1 EP 1190372 A1 EP1190372 A1 EP 1190372A1 EP 00936267 A EP00936267 A EP 00936267A EP 00936267 A EP00936267 A EP 00936267A EP 1190372 A1 EP1190372 A1 EP 1190372A1
Authority
EP
European Patent Office
Prior art keywords
blob
sample
biological
particles
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP00936267A
Other languages
German (de)
French (fr)
Inventor
Danny S. Moshe
Michael Khazanski
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
GreenVision Systems Ltd
Original Assignee
GreenVision Systems Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by GreenVision Systems Ltd filed Critical GreenVision Systems Ltd
Publication of EP1190372A1 publication Critical patent/EP1190372A1/en
Withdrawn legal-status Critical Current

Links

Classifications

    • G01N15/1433

Definitions

  • the present invention relates to methods of imaging and analysis of particles and, in particular, to a method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples.
  • an image of the sample exhibits a layer dependent or spatially varying degree of sharpness.
  • This is referred to as a defocused image of the sample or scene, where some of the objects of the scene are in focus, while other objects of the scene are out of focus.
  • Defocused images contain information potentially useful for scene analysis.
  • the analysis of scenes from defocused images is of general interest in machine vision applications, for example, in active vision or robot vision where a camera actively explores a scene by continuously changing its position, i.e., field of view, relative to scene features.
  • scene analysis is of significant practical importance in chemical, pharmaceutical, biomedical, and biological imaging, and general microscopy image analysis, where layer or depth variations of imaged samples of chemicals, powders, frozen suspensions of powders, biological specimens, or other multi-layered particulate samples are typically large compared to imaging distances.
  • Scene analysis is of particular applicability to depth dependent particulate samples, where, tor instance, one or more layers ot microorganisms such as bacterial or fungal growth, exhibiting fluorescent emission properties in addition to the fluorescent emission properties of the particles themselves, is present on the particles, and there is a need for separation of imaging and analysis of the microorganisms from imaging and analysis of the host particles.
  • an auto-focus module is coupled with a computer controlled mechanism that automatically changes the focal position, by moving along an axis parallel to the optical axis of the imaging or focusing sensor, thereby enabling identification of a good focal position.
  • a good focal position is not guaranteed to exist and further image processing via focus-fusion is required.
  • a focused representation of the scene can be constructed by combining or fusing several defocused images of the same scene. This process is referred to as focus-fusion imaging, and the resulting image of such processing is referred to as a focus-fusion image.
  • Defocused images for example, those acquired during auto-focusing, are fused together such that each target in a given scene is in correct focus.
  • Scene targets are detected by analyzing either the focused image, if it exists, or the focus-fusion image.
  • a current technique of imaging particles, for example, featuring chemical and/or biological species is based on spectral imaging.
  • spectral imaging a particulate sample is affected in a way, for example, excitation by incident ultraviolet light upon the sample, which causes the sample to emit light featuring an emission spectra. Emitted light is recorded by an instrument such as a scanning interferometer that generates a set of interferogram images, which in turn are used to produce a spectral image, or image cube, of the sample.
  • a spectral image, or image cube is a three dimensional data set (a volume) of voxels in which two dimensions are the spatial dimensions of the sample and the third dimension is the wavelength of the imaged light, such that coordinates of a voxel in a spectral image or image cube may be represented as (x,y, ⁇ ).
  • a particulate sample is imaged in two dimensions, so that voxels corresponding to that wavelength constitute the pixels of a monochromatic image of the sample at that wavelength.
  • the spectral image is analyzed to produce a two dimensional map of the chemical or biological composition, or of some other physicochemical property of the sample, for example, particle size distribution.
  • An example of a method and system for real-time, on-line chemical analysis of particulate samples, for example, polycyclic aromatic hydrocarbon (PAH) particles in aerosols, in which the PAH sample is excited to emit light, for example fluorescence, is that of U.S. Patent No. 5,880,830, issued to Schechter, and manufactured by GreenNision Systems Ltd. of Tel Aviv, Israel, and is incorporated by reference for all purposes as if fully set forth herein.
  • spectral imaging techniques are implemented to acquire an image and analyze the properties of fixed position PAH particles.
  • PAH particles are first collected by drawing a large volume of air containing PAHs through a filter, followed by on-line scene analysis of the stationary particles.
  • a method of calibration and real-time analysis of particles is described in U.S.
  • Patent Application No. 09/146,361 filed September 03, 1998, and is incorporated by reference for all purposes as if fully set forth herein.
  • the method described is based on using essentially the same system of U.S. Pat. No. 5,880,830, for acquiring spectral images of static particles on a filter.
  • Targets are identified in static particle images and are classified according to morphology type and spectrum type. Each target is assigned a value of an extensive property.
  • a descriptor vector is formed, where each element of the descriptor vector is the sum of the extensive property values for one target class.
  • the descriptor vector is transformed, for example, to a vector of mass concentrations of chemical species of interest, or of number concentrations of biological species of interest, using a relationship determined in a calibration procedure.
  • spectral images of calibration samples of static particles having known composition are acquired, and empirical morphology types and spectrum types are inferred from the spectral images.
  • Targets are identified in the calibration spectral images, classified according to morphology type and spectrum type, and assigned values of an extensive property.
  • a calibration descriptor vector and a calibration concentration vector is formed. A collective relationship between the calibration descriptor vectors and the calibration concentration vectors is found using chemometric methods.
  • Spectral imaging of spatially varying, depth dependent, or multi-layered samples of particles is not described in the above referenced methods and systems. Imaging and image analysis of a random single layer of a sample including particles are ordinarily straightforward. However, multi-layer imaging and image analysis of depth dependent particulate samples, for example, multi-layered dry particles, or particles in a frozen or immobilized suspension, are substantially more complex, for the reasons stated above. More often than not, images obtained of such particulate samples are defocused, and require special image processing techniques, such as focus-fusion, for obtaining useful information about the samples. Nevertheless, there are instances where it is necessary to obtain property and classification information of depth dependent particulate samples, in-situ, for example, as part of sampling an industrial process.
  • a sample of dispersed or multi-layered particles is amenable to three-dimensional imaging and scene analysis.
  • spectral imaging as presently practiced would involve tedious methodologies and system manipulations, making acquisition of high resolution images impossible or at best impracticable.
  • Scene analysis via focus-fusion of defocused images, acquired by multi-layer spectral imaging of depth dependent particulate samples would be quite useful for detecting and classifying in-situ physicochemical information of the particles, such as particle size distribution, morphological features, including structure, form, and shape characteristics, and, chemical and biological composition, which ideally involve multi-layer three-dimensional image analysis.
  • in-situ physicochemical information of the particles such as particle size distribution, morphological features, including structure, form, and shape characteristics, and, chemical and biological composition, which ideally involve multi-layer three-dimensional image analysis.
  • current focus-fusion procedures and algorithms typically involve information and parameters relating only to the extent to which acquired images are either focused or defocused, without inclusion of additional information and parameters relating to particular properties or characteristics of the imaged object or sample.
  • Characteristic sample physicochemical and spectral information and parameters can be quite relevant to imaging particulate samples, and ought to be included in a method of focus-fusion of acquired images of such samples. This is especially the case for images of chemical and/or biological particulate samples featuring layer dependent or spatially varying degree of sharpness.
  • the present invention relates to a method for in-situ focus-fusion multi-layer spectral imaging and analysis of depth dependent particulate samples, where a given sample features chemical and/or biological species.
  • a unique method of focus-fusion is applied to focused and defocused images acquired from multi-layer spectral imaging of a depth dependent particulate sample, in order to construct focused fused cube spectral image representations of the imaged particles, thereby generating a focused image of essentially each particle in the sample.
  • the method of the present invention features the use of a uniquely defined and calculated focus-fusion factor parameter which combines empirically determined particle morphological characteristics with empirically determined particle spectral characteristics, and is used in critical steps of image detection and image analysis classification.
  • the method includes collecting and analyzing physicochemical and multi-layer spectral data relating to the particles in the sample, including mapping of three-dimensional positions of particles, particle sizes, and characteristics of particle emission spectra.
  • Scene information, in the form of spectral fingerprints, derived from analysis of focus-fusion of the multi-layer spectral images is further processed in order to generate usable in-situ physicochemical information of the particles, such as particle size distribution, mo ⁇ hological features, including structure, form, and shape characteristics, and, chemical and biological composition.
  • the focus-fusion multi-layer spectral image analysis includes a sophisticated classification procedure for extracting, on-line, useful information relating to particle properties and characteristics needed for generating a report applicable to monitoring or controlling an industrial process.
  • the method of the present invention enables multi-layer spectral imaging, multi-layer scene analysis, and multi-layer physicochemical characterization of particulate samples featuring depth dependency, which until now has not been described.
  • the present invention is of significant practical importance in chemical, pharmaceutical, biomedical, and biological imaging, and general microscopy image analysis, where layer or depth variations of imaged samples of chemicals, powders, frozen suspensions of powders, biological specimens, or other multi-layered particulate samples are typically large compared to imaging distances.
  • a method for multi-layer imaging and analyzing a sample featuring particles, imaged particles exhibiting a spatially varying degree of sha ⁇ ness the method composing the steps of: (a) providing a spectroscopic imaging system, including a sample holder movable by a three dimensional translation stage; (b) defining imaging scenario parameters; (c) adjusting and setting the imaging system for imaging at a selected field of view, FONrada having central x, y coordinates; (d) focusing the imaging system by moving the translation stage an increment ⁇ z, until receiving a sha ⁇ gray level image of the sample at a selected focal distance ⁇ z,; (e) at the selected FON, and at the selected ⁇ z consumer acquiring a cube image of the sample, the cube image featuring a plurality of pixels, each of the plurality of pixels having at least one common visual property, each of the plurality of pixels having a location in the cube image; (f) detecting a plurality of targets for each of the
  • a method for multi-layer imaging and analyzing a sample featuring particles, imaged particles exhibiting a spatially varying degree of sha ⁇ ness comprising the steps of: (a) at a selected field of view, FON strictly and at a selected focal distance, ⁇ ztron acquiring a cube image of the sample, the cube image featuring a plurality of pixels, each of the plurality of pixels having at least one common visual property, each of the plurality of pixels having a location in the cube image; (b) detecting a plurality of targets for each of the plurality of pixels, each of the plurality of targets created by a plurality of pixels having a pre-defined measured intensity above the imaged background intensity, each target defined as a Blob k ; (c) calculating a set of empirically determined mo ⁇ hological and biological parameters and a set of spectral parameters for each Blob k ; (d) calculating a focus-fusion factor parameter, F, from the set of mo ⁇ hological
  • FIG. 1 is a flow diagram of an exemplary preferred embodiment of the method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples, in accordance with the present invention.
  • FIG. 2 is a schematic diagram illustrating implementation of selected steps of the preferred embodiment of the method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples, in accordance with the present invention.
  • the present invention is of a method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples. Steps and implementation of the method according to the present invention are better understood with reference to the drawings and the accompanying description. It is to be noted that illustrations of the present invention shown here are for illustrative pu ⁇ oses only and are not meant to be limiting.
  • FIG. 1 is a flow diagram of an exemplary preferred embodiment of the method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples.
  • each generally applicable, principle step of the method of the present invention is numbered and enclosed inside a frame.
  • a sub-step representing further of an indicated principle step of the method are indicated by a letter in parentheses.
  • FIG. 2 is a schematic diagram illustrating implementation of selected steps of the preferred embodiment of the method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples. Referenced items shown in FIG. 2 relevant to understanding the method of FIG. 1 are referred to and described in the description of FIG. 1.
  • a sample 10 (FIG. 2) featuring particles is provided, and prepared for multi-layer spectral imaging and analysis.
  • Sample 10 could be, for example, a pure powder or a powder mixture, a frozen suspension of a powder, a biological specimen, or some other multi-layered particulate sample, and features a three dimensional topography using coordinate system 12 as a reference, whereby there are layer or depth variations along sample height 14 which are relatively large compared to imaging distances.
  • Sample 10 is placed on a sample holder 16, where sample 10 and sample holder 16 are either exposed to ambient conditions, for example, a powdered sample resting on a glass slide without controlled environmental containment, or, are contained in a controlled environment, for example, a frozen suspension maintained at or below the freezing point temperature of such a frozen suspension.
  • a spectroscopic imaging system 18, including a three dimensional translation stage 20 is provided. Examples of a spectroscopic imaging system 18, including peripheral apparatus, and control / data links, appropriate for implementation of the method of the present invention are fully described in U.S. Patent No. 5,880,830, issued to Schechter, and references cited therein, which are inco ⁇ orated by reference for all pu ⁇ oses as if fully set forth herein.
  • Spectroscopic imaging system 18 includes, among other components, an ultraviolet light illumination source, an optical system, a spectroscopic imaging device, a CCD camera having suitable sensitivity and dynamic range, a central control system, and control / data links.
  • the light source illuminates particles of sample 10 homogeneously via the optical system, or by directly without inclusion of the optical system.
  • the control system is based on a personal computer, and includes a frame grabber, for acquiring images from the CCD camera, as well as other hardware interface boards for controlling translation stage 20 and the other components of spectroscopic imaging system 18.
  • the software of the control system includes a database of empirically determined mo ⁇ hology types and spectrum types and codes for implementing the image processing and quantification algorithms described below.
  • Spectroscopic imaging system 18 includes a three dimensional translation stage 20 used for synchronized electronic three dimensional movement and positioning of sample holder 16, and therefore, sample 10.
  • Translation stage 20 is in electronic communication with spectroscopic imaging system control devices via control / data links 22. Usage of translation stage 20 enables spectroscopic imaging system 18 to automatically focus and image sample 10 in a plurality of pre-selected fields of view 24, FONconstru and along a plurality of pre-selected focal planes or focal distances, ⁇ z,, potentially spanning entire sample height 14.
  • sub-step (a) of Step (2) imaging scenario parameters to be used for image acquisition and analysis are defined.
  • sample physicochemical and biological parameters relating to particle chemical composition and biological composition such as microorganism count per particle, and related chemistry, and particle mo ⁇ hology relating to particle sizes and shapes
  • imaging system scanning parameters including selected viewing or imaging range of the sample relating to fields of view 24, FONnell and depth dimension or focal distances, ⁇ z )J5 pixel threshold intensity, Blob neighborhood distance, ⁇ D, and imaging time interval, ⁇ t.
  • Step (2) calibrations are performed on standard samples with known physicochemical, biological, and spectral imaging characteristics, according to methodology described in pending U.S. Patent Application No. 09/146,361, cited above, which is inco ⁇ orated by reference for all pu ⁇ oses as if fully set forth herein.
  • Step (3) sample 10 is scanned by adjusting and setting spectroscopic imaging system 18 for spectral imaging at a selected field of view 24, FOVallow over sample 10, having central x, y coordinates, by moving translation stage 20 an increment of ⁇ x and ⁇ y.
  • Step (4) imaging system 18 is focused by moving translation stage 20 an increment ⁇ z, until receiving a sha ⁇ gray level image of sample 10, at a selected focal distance ⁇ z, r
  • Step (5) a plurality of cube (spectral) images, featuring pixels, of sample 10 and particles therein, are acquired.
  • the pixels have at least one common visual property, and each pixel has a location.
  • Blobs if present in sample 10, are detected, where a Blob k 26 or 28 is defined as a detected target created by a plurality of pixels having a pre-defined intensity above the imaged background or threshold intensity (defined in Step (2), sub-step (a)). Ordinarily, it is desired that detection of a Blob k 26 or 28 be indicative of either a focused or defocused image of a particle of sample 10.
  • One of the primary tasks of the unique image acquisition procedure of the present invention is to distinguish meaningful or high content Blobs featuring useful information relating to particle characteristics from Blobs featuring non-particle information, such as sample or imaging system contamination.
  • sub-step (b) there is calculating a set of mo ⁇ hological and biological parameters, and a set of spectral parameters, for each Blob k 26 or 28, empirically determined from the Blob image data.
  • Mo ⁇ hological and biological parameters relate to, for example, the size, area, shape, microorganism count per particle, and x, y position coordinates of central gravity point of a given Blob k , which in turn, relate to particle characteristics in sample 10.
  • Spectral parameters relate to emission characteristics of an imaged particle in sample 10.
  • sub-step (c) there is calculating a focus-fusion factor parameter, F exclude from the set of mo ⁇ hological and biological, and set of spectral parameters, for each Blob k 26 or 28.
  • the focus-fusion factor parameter uniquely combines particle mo ⁇ hological and biological information with spectral information, to be used in a decision step for discriminating Blobs from each other. This uniquely determined parameter enables achievement of high levels of accuracy and precision in detection and classification of the sample, in general, and of the featured particles, in particular.
  • sub-step (d) all detected Blobs are grouped into a single Blob neighborhood, according to the neighborhood distance parameter, ⁇ D, defined in Step (2), sub-step (a).
  • sub-step (e) there is calculating a set of inter-Blob distances 30, ⁇ d kb for all the detected Blobs in the Blob neighborhood, where ⁇ d k] is measured between each grouped Blob k and its neighboring grouped Blobs, in the Blob neighborhood.
  • sub-step (f) there is selecting high content Blobs 28 from all the Blobs k 26 and 28 in the Blob neighborhood, according to decisions made by using the focus-fusion factor parameter, F Cincinnati ⁇ D, and the set of ⁇ d k] .
  • These high content Blobs are to be used in construction of a fused cube image of sample 10, ultimately, providing useful image content relating to particle characteristics.
  • sub-step (g) cube image data is saved in a cube image database, for use in construction of a fused cube image of sample 10.
  • Step (6) Step (4) through Step (5) are repeated, in the same field of view,
  • This step enables the acquisition of multi-layer spectral image data of sample 10.
  • multi-layer spectral image data of sample 10 For example, in FIG. 2, three cube images 30, 32, and 34, all in same FON, 24, are separately acquired using focal distances ⁇ z,, 36, ⁇ z, 2 38, and ⁇ z, 3 40, respectively.
  • This procedure illustrates the multi-layer spectral imaging of sample
  • Step (7) a single fused cube image 42, is constructed, using the cube image database of Step (5), sub-step (g), and using empirically determined background parameters, B median for selecting the background of fused cube image 42.
  • fused cube image 42 preferably, only high content Blobs 28 are retained and featured.
  • fused cube image data is saved in a fused cube image database, for use in image analysis algorithms (Step (9)).
  • Step (8) there is acquiring and constructing additional fused cube (spectral) images of sample 10 in other fields of view, FON j , by repeating Step (3) through Step (7), until the selected sample viewing / imaging range is imaged. This is, in part, accomplished by programmed movement of translation stage 20 to other fields of view over sample 10, and in each field of view, incremental movement of translation stage
  • Step (9) one or more image analysis algorithms are applied to the database of fused cube images.
  • the plurality of fused cube images are analyzed for spectral fmge ⁇ rints, whereby spectral data is related to applicable physicochemical and biological characteristics of sample 10.
  • detection, classification, and/or decision algorithms are used for image analysis of the fused cube image data.
  • Examples of specific detection, classification, and/or decision algorithms suitable for image analysis in the method of the present invention are fully described in U.S. Patent No. 5,880,830, issued to Schechter, and in pending U.S. Patent Application No. 09/146,361 , and references cited therein, which are inco ⁇ orated by reference for all pu ⁇ oses as if fully set forth herein.
  • Calibration data of standard samples with known physicochemical, biological, and spectral imaging characteristics are used as part of the image analysis.
  • image analysis is based on uniquely combining physicochemical, for example, mo ⁇ hological, and, chemical and biological composition data, with multi-layer spectral imaging data of sample 10 featuring particles. This unique combination enables achievement of high levels of accuracy and precision in detection and classification of the sample, in general, and of the featured particles, in particular.
  • sub-step (b) a statistical analysis report of the image analysis results is generated.
  • Step (10) Step (3) through Step (9) are repeated for each pre-defined time interval, ⁇ t.
  • Step (a) a report relating to time variation of the physicochemical, biological, and spectral imaging characteristics of sample 10 featuring particles is generated. This step further enables achievement of high levels of accuracy and precision in detection and classification of the sample.

Abstract

A method for in-situ focus-fusion multi-layer spectral imaging (2) and analysis of depth dependent particulate samples. A unique method of focus-fusion is applied to focused and defocused images acquired from multi-layer spectral imaging (2) of a depth dependent particulate sample, in order to construct focused fused cube spectral image (5) representations of the imaged particles, thereby generating a focused image of essentially each particle in the sample. The method features the use of a uniquely defined and calculated focus-fusion factor parameter (5(c)) which combines empirically determined particle morphological and biological characteristics (5(b)) with empirically determined particle spectral characteristics, and is used in critical steps of image detection and image analysis classification (9). This uniquely determined parameter enables achievement of high levels of accuracy and precision in detection and classification of the sample, in general, and of the featured particles, in particular.

Description

METHOD FOR IN-SITU FOCUS-FUSION MULTI-LAYER SPECTRAL IMAGING
AND ANALYSIS OF PARTICULATE SAMPLES
This is a Continuation-in-Part of U.S. Patent Application No. 09/146,361, filed on
September 03, 1998.
FIELD AND BACKGROUND OF THE INVENTION
The present invention relates to methods of imaging and analysis of particles and, in particular, to a method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples.
When a sample featuring, for example, a particle, an aggregate of particles, or a dispersion of particles, has large layer or depth variations relative to changes in the distance from which it is viewed, an image of the sample exhibits a layer dependent or spatially varying degree of sharpness. This is referred to as a defocused image of the sample or scene, where some of the objects of the scene are in focus, while other objects of the scene are out of focus. Defocused images contain information potentially useful for scene analysis. The analysis of scenes from defocused images is of general interest in machine vision applications, for example, in active vision or robot vision where a camera actively explores a scene by continuously changing its position, i.e., field of view, relative to scene features. Additionally, scene analysis is of significant practical importance in chemical, pharmaceutical, biomedical, and biological imaging, and general microscopy image analysis, where layer or depth variations of imaged samples of chemicals, powders, frozen suspensions of powders, biological specimens, or other multi-layered particulate samples are typically large compared to imaging distances. Scene analysis is of particular applicability to depth dependent particulate samples, where, tor instance, one or more layers ot microorganisms such as bacterial or fungal growth, exhibiting fluorescent emission properties in addition to the fluorescent emission properties of the particles themselves, is present on the particles, and there is a need for separation of imaging and analysis of the microorganisms from imaging and analysis of the host particles.
In conventional scene analysis using methods and systems for imaging particles, for example, for each scene, there is auto-focusing, where a best focal position is determined for use in analyzing or classifying particle properties. For some scenes, this is possible, and a focused image may be obtained in an automatic manner. Typically, an auto-focus module is coupled with a computer controlled mechanism that automatically changes the focal position, by moving along an axis parallel to the optical axis of the imaging or focusing sensor, thereby enabling identification of a good focal position. For other scenes, a good focal position is not guaranteed to exist and further image processing via focus-fusion is required. When a focused image of a spatially varying or depth dependent scene can not be generated by using such electro-mechanical microscopy means, whereby a single focal position can not be identified, a focused representation of the scene can be constructed by combining or fusing several defocused images of the same scene. This process is referred to as focus-fusion imaging, and the resulting image of such processing is referred to as a focus-fusion image. Defocused images, for example, those acquired during auto-focusing, are fused together such that each target in a given scene is in correct focus. Scene targets are detected by analyzing either the focused image, if it exists, or the focus-fusion image.
A current technique of imaging particles, for example, featuring chemical and/or biological species, is based on spectral imaging. In spectral imaging, a particulate sample is affected in a way, for example, excitation by incident ultraviolet light upon the sample, which causes the sample to emit light featuring an emission spectra. Emitted light is recorded by an instrument such as a scanning interferometer that generates a set of interferogram images, which in turn are used to produce a spectral image, or image cube, of the sample. A spectral image, or image cube, is a three dimensional data set (a volume) of voxels in which two dimensions are the spatial dimensions of the sample and the third dimension is the wavelength of the imaged light, such that coordinates of a voxel in a spectral image or image cube may be represented as (x,y,λ). At any particular wavelength, a particulate sample is imaged in two dimensions, so that voxels corresponding to that wavelength constitute the pixels of a monochromatic image of the sample at that wavelength. The spectral image is analyzed to produce a two dimensional map of the chemical or biological composition, or of some other physicochemical property of the sample, for example, particle size distribution. An example of a method and system for real-time, on-line chemical analysis of particulate samples, for example, polycyclic aromatic hydrocarbon (PAH) particles in aerosols, in which the PAH sample is excited to emit light, for example fluorescence, is that of U.S. Patent No. 5,880,830, issued to Schechter, and manufactured by GreenNision Systems Ltd. of Tel Aviv, Israel, and is incorporated by reference for all purposes as if fully set forth herein. In the disclosed method, spectral imaging techniques are implemented to acquire an image and analyze the properties of fixed position PAH particles. As part of this method, PAH particles are first collected by drawing a large volume of air containing PAHs through a filter, followed by on-line scene analysis of the stationary particles. A method of calibration and real-time analysis of particles is described in U.S.
Patent Application No. 09/146,361 , filed September 03, 1998, and is incorporated by reference for all purposes as if fully set forth herein. The method described, is based on using essentially the same system of U.S. Pat. No. 5,880,830, for acquiring spectral images of static particles on a filter. Targets are identified in static particle images and are classified according to morphology type and spectrum type. Each target is assigned a value of an extensive property. A descriptor vector is formed, where each element of the descriptor vector is the sum of the extensive property values for one target class. The descriptor vector is transformed, for example, to a vector of mass concentrations of chemical species of interest, or of number concentrations of biological species of interest, using a relationship determined in a calibration procedure. In the calibration procedure, spectral images of calibration samples of static particles having known composition are acquired, and empirical morphology types and spectrum types are inferred from the spectral images. Targets are identified in the calibration spectral images, classified according to morphology type and spectrum type, and assigned values of an extensive property. For each calibration sample, a calibration descriptor vector and a calibration concentration vector is formed. A collective relationship between the calibration descriptor vectors and the calibration concentration vectors is found using chemometric methods.
In the method of U.S. Patent Application No. 09/146,361 , standard spectra are determined empirically in the calibration procedure. In such analytical procedures, empirical calibration is quite important for leading to highly accurate results based on image analysis and classification, because spectra of adsorbed chemical species in general, and, of PAHs in particular, are known to be altered by the surfaces on which they are adsorbed, and by the presence of contaminants during sample preparation and image acquisition. Moreover, in the described method, the relationship between the descriptor vector and the concentration vector accounts explicitly and simultaneously for both morphologies and empirically determined spectra. This is particularly important in cases where fluorescence spectra of crystal particles are known to depend on crystal morphology, in general, and crystal size, in particular. Spectral imaging of spatially varying, depth dependent, or multi-layered samples of particles is not described in the above referenced methods and systems. Imaging and image analysis of a random single layer of a sample including particles are ordinarily straightforward. However, multi-layer imaging and image analysis of depth dependent particulate samples, for example, multi-layered dry particles, or particles in a frozen or immobilized suspension, are substantially more complex, for the reasons stated above. More often than not, images obtained of such particulate samples are defocused, and require special image processing techniques, such as focus-fusion, for obtaining useful information about the samples. Nevertheless, there are instances where it is necessary to obtain property and classification information of depth dependent particulate samples, in-situ, for example, as part of sampling an industrial process. In principle, a sample of dispersed or multi-layered particles is amenable to three-dimensional imaging and scene analysis. In practice, however, for depth dependent samples of particles, spectral imaging as presently practiced would involve tedious methodologies and system manipulations, making acquisition of high resolution images impossible or at best impracticable.
Scene analysis via focus-fusion of defocused images, acquired by multi-layer spectral imaging of depth dependent particulate samples would be quite useful for detecting and classifying in-situ physicochemical information of the particles, such as particle size distribution, morphological features, including structure, form, and shape characteristics, and, chemical and biological composition, which ideally involve multi-layer three-dimensional image analysis. For fusing defocused images, current focus-fusion procedures and algorithms typically involve information and parameters relating only to the extent to which acquired images are either focused or defocused, without inclusion of additional information and parameters relating to particular properties or characteristics of the imaged object or sample. Characteristic sample physicochemical and spectral information and parameters can be quite relevant to imaging particulate samples, and ought to be included in a method of focus-fusion of acquired images of such samples. This is especially the case for images of chemical and/or biological particulate samples featuring layer dependent or spatially varying degree of sharpness.
There is thus a recognized need for, and it would be highly advantageous to have, a method for in-situ focus-fusion multi-layer spectral imaging and analysis of depth dependent particulate samples.
SUMMARY OF THE INVENTION
The present invention relates to a method for in-situ focus-fusion multi-layer spectral imaging and analysis of depth dependent particulate samples, where a given sample features chemical and/or biological species. A unique method of focus-fusion is applied to focused and defocused images acquired from multi-layer spectral imaging of a depth dependent particulate sample, in order to construct focused fused cube spectral image representations of the imaged particles, thereby generating a focused image of essentially each particle in the sample. The method of the present invention features the use of a uniquely defined and calculated focus-fusion factor parameter which combines empirically determined particle morphological characteristics with empirically determined particle spectral characteristics, and is used in critical steps of image detection and image analysis classification. This uniquely determined parameter enables achievement of high levels of accuracy and precision in detection and classification of the sample, in general, and of the featured particles, in particular. The method includes collecting and analyzing physicochemical and multi-layer spectral data relating to the particles in the sample, including mapping of three-dimensional positions of particles, particle sizes, and characteristics of particle emission spectra. Scene information, in the form of spectral fingerprints, derived from analysis of focus-fusion of the multi-layer spectral images is further processed in order to generate usable in-situ physicochemical information of the particles, such as particle size distribution, moφhological features, including structure, form, and shape characteristics, and, chemical and biological composition. The focus-fusion multi-layer spectral image analysis includes a sophisticated classification procedure for extracting, on-line, useful information relating to particle properties and characteristics needed for generating a report applicable to monitoring or controlling an industrial process.
The method of the present invention enables multi-layer spectral imaging, multi-layer scene analysis, and multi-layer physicochemical characterization of particulate samples featuring depth dependency, which until now has not been described. The present invention is of significant practical importance in chemical, pharmaceutical, biomedical, and biological imaging, and general microscopy image analysis, where layer or depth variations of imaged samples of chemicals, powders, frozen suspensions of powders, biological specimens, or other multi-layered particulate samples are typically large compared to imaging distances.
According to the present invention, there is provided a method for multi-layer imaging and analyzing a sample featuring particles, imaged particles exhibiting a spatially varying degree of shaφness, the method composing the steps of: (a) providing a spectroscopic imaging system, including a sample holder movable by a three dimensional translation stage; (b) defining imaging scenario parameters; (c) adjusting and setting the imaging system for imaging at a selected field of view, FON„ having central x, y coordinates; (d) focusing the imaging system by moving the translation stage an increment Δz, until receiving a shaφ gray level image of the sample at a selected focal distance Δz,; (e) at the selected FON, and at the selected Δz„ acquiring a cube image of the sample, the cube image featuring a plurality of pixels, each of the plurality of pixels having at least one common visual property, each of the plurality of pixels having a location in the cube image; (f) detecting a plurality of targets for each of the plurality of pixels, each of the plurality of targets created by a plurality of pixels having a pre-defined measured intensity above the imaged background intensity, each target defined as a Blob ; (g) calculating a set of empirically determined moφhological and biological parameters and a set of spectral parameters for each Blobk; (h) calculating a focus-fusion factor parameter, F„ from the set of moφhological and biological parameters and from the set of spectral parameters for each Blobk; (i) grouping all the Blobs into a single Blob neighborhood, according to a neighborhood distance parameter, ΔD; (j) calculating a set of inter-Blob distances, Δd.., for all the Blobs in the Blob neighborhood, each inter-Blob distance measured between each grouped Blobk and a neighboring grouped Blob) to the grouped Blob ; (k) selecting a set of high content Blobs from the Blob neighborhood, according to decisions made by using the focus-fusion parameter, the neighborhood distance parameter, and the set of the inter-Blob distances; (1) saving data of the cube image in a cube image database; (m) repeating step (d) through step (1) in same FON„ at another Δz, until a selected depth of the sample is incrementally imaged; (n) constructing a fused cube image from the cube image database and empirically determined background parameters, B,, and locate the position of each high content Blob with x, y coordinates of central gravity point; and (o) saving data of the fused cube image in a fused cube image database to be used for image analysis of the sample. According to the present invention, there is provided a method for multi-layer imaging and analyzing a sample featuring particles, imaged particles exhibiting a spatially varying degree of shaφness, the method comprising the steps of: (a) at a selected field of view, FON„ and at a selected focal distance, Δz„ acquiring a cube image of the sample, the cube image featuring a plurality of pixels, each of the plurality of pixels having at least one common visual property, each of the plurality of pixels having a location in the cube image; (b) detecting a plurality of targets for each of the plurality of pixels, each of the plurality of targets created by a plurality of pixels having a pre-defined measured intensity above the imaged background intensity, each target defined as a Blobk; (c) calculating a set of empirically determined moφhological and biological parameters and a set of spectral parameters for each Blobk; (d) calculating a focus-fusion factor parameter, F,, from the set of moφhological and biological parameters and from the set of spectral parameters for each Blob; (e) grouping all the Blobs into a single Blob neighborhood, according to a neighborhood distance parameter, ΔD; (f) calculating a set of inter-Blob distances, Δd,., for all the Blobs in the Blob neighborhood, each inter-Blob distance measured between each grouped Blobk and a neighboring grouped Blob! to the grouped Blobk; (g) selecting a set of high content Blobs from the Blob neighborhood, according to decisions made by using the focus-fusion parameter, the neighborhood distance parameter, and the set of the inter-Blob distances; (h) saving data of the cube image in a cube image database; (i) repeating step (a) through step (h) in same FON„ at another Δz, until a selected depth of the sample is incrementally imaged; (j) constructing a fused cube image from the cube image database and empirically determined background parameters, B„ and locate the position of each high content Blob with x, y coordinates of central gravity point; and (k) saving data of the fused cube image in a fused cube image database to be used for image analysis of the sample. BRIEF DESCRIPTION OF THE DRAWINGS
The invention is herein described, by way of example only, with reference to the accompanying drawings, wherein: FIG. 1 is a flow diagram of an exemplary preferred embodiment of the method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples, in accordance with the present invention; and
FIG. 2 is a schematic diagram illustrating implementation of selected steps of the preferred embodiment of the method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples, in accordance with the present invention.
DESCRIPTION OF THE PREFERRED EMBODIMENTS
The present invention is of a method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples. Steps and implementation of the method according to the present invention are better understood with reference to the drawings and the accompanying description. It is to be noted that illustrations of the present invention shown here are for illustrative puφoses only and are not meant to be limiting.
Referring now to the drawings, FIG. 1 is a flow diagram of an exemplary preferred embodiment of the method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples. In FIG. 1 , each generally applicable, principle step of the method of the present invention is numbered and enclosed inside a frame. A sub-step representing further of an indicated principle step of the method are indicated by a letter in parentheses. FIG. 2 is a schematic diagram illustrating implementation of selected steps of the preferred embodiment of the method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples. Referenced items shown in FIG. 2 relevant to understanding the method of FIG. 1 are referred to and described in the description of FIG. 1.
In Step (1), a sample 10 (FIG. 2) featuring particles is provided, and prepared for multi-layer spectral imaging and analysis. Sample 10, could be, for example, a pure powder or a powder mixture, a frozen suspension of a powder, a biological specimen, or some other multi-layered particulate sample, and features a three dimensional topography using coordinate system 12 as a reference, whereby there are layer or depth variations along sample height 14 which are relatively large compared to imaging distances. Sample 10 is placed on a sample holder 16, where sample 10 and sample holder 16 are either exposed to ambient conditions, for example, a powdered sample resting on a glass slide without controlled environmental containment, or, are contained in a controlled environment, for example, a frozen suspension maintained at or below the freezing point temperature of such a frozen suspension. In Step (2), a spectroscopic imaging system 18, including a three dimensional translation stage 20 is provided. Examples of a spectroscopic imaging system 18, including peripheral apparatus, and control / data links, appropriate for implementation of the method of the present invention are fully described in U.S. Patent No. 5,880,830, issued to Schechter, and references cited therein, which are incoφorated by reference for all puφoses as if fully set forth herein. Spectroscopic imaging system 18 includes, among other components, an ultraviolet light illumination source, an optical system, a spectroscopic imaging device, a CCD camera having suitable sensitivity and dynamic range, a central control system, and control / data links. In spectroscopic imaging system 18, the light source illuminates particles of sample 10 homogeneously via the optical system, or by directly without inclusion of the optical system. The control system is based on a personal computer, and includes a frame grabber, for acquiring images from the CCD camera, as well as other hardware interface boards for controlling translation stage 20 and the other components of spectroscopic imaging system 18. The software of the control system includes a database of empirically determined moφhology types and spectrum types and codes for implementing the image processing and quantification algorithms described below.
Spectroscopic imaging system 18 includes a three dimensional translation stage 20 used for synchronized electronic three dimensional movement and positioning of sample holder 16, and therefore, sample 10. Translation stage 20 is in electronic communication with spectroscopic imaging system control devices via control / data links 22. Usage of translation stage 20 enables spectroscopic imaging system 18 to automatically focus and image sample 10 in a plurality of pre-selected fields of view 24, FON„ and along a plurality of pre-selected focal planes or focal distances, Δz,, potentially spanning entire sample height 14. In sub-step (a) of Step (2), imaging scenario parameters to be used for image acquisition and analysis are defined. These include (i) sample physicochemical and biological parameters relating to particle chemical composition and biological composition, such as microorganism count per particle, and related chemistry, and particle moφhology relating to particle sizes and shapes, and, (ii) imaging system scanning parameters, including selected viewing or imaging range of the sample relating to fields of view 24, FON„ and depth dimension or focal distances, Δz)J5 pixel threshold intensity, Blob neighborhood distance, ΔD, and imaging time interval, Δt.
In sub-step (b) of Step (2), calibrations are performed on standard samples with known physicochemical, biological, and spectral imaging characteristics, according to methodology described in pending U.S. Patent Application No. 09/146,361, cited above, which is incoφorated by reference for all puφoses as if fully set forth herein.
Results of the calibrations are used as part of image analysis of test sample 10.
In Step (3), sample 10 is scanned by adjusting and setting spectroscopic imaging system 18 for spectral imaging at a selected field of view 24, FOV„ over sample 10, having central x, y coordinates, by moving translation stage 20 an increment of Δx and Δy.
In Step (4), imaging system 18 is focused by moving translation stage 20 an increment Δz, until receiving a shaφ gray level image of sample 10, at a selected focal distance Δz,r In Step (5), a plurality of cube (spectral) images, featuring pixels, of sample 10 and particles therein, are acquired. In each cube image, the pixels have at least one common visual property, and each pixel has a location. For acquisition of each cube image, in FON„ at Δzy, the following sub-steps are performed:
In sub-step (a), Blobs, if present in sample 10, are detected, where a Blobk 26 or 28 is defined as a detected target created by a plurality of pixels having a pre-defined intensity above the imaged background or threshold intensity (defined in Step (2), sub-step (a)). Ordinarily, it is desired that detection of a Blobk 26 or 28 be indicative of either a focused or defocused image of a particle of sample 10. One of the primary tasks of the unique image acquisition procedure of the present invention is to distinguish meaningful or high content Blobs featuring useful information relating to particle characteristics from Blobs featuring non-particle information, such as sample or imaging system contamination.
In sub-step (b), there is calculating a set of moφhological and biological parameters, and a set of spectral parameters, for each Blobk 26 or 28, empirically determined from the Blob image data. Moφhological and biological parameters relate to, for example, the size, area, shape, microorganism count per particle, and x, y position coordinates of central gravity point of a given Blobk, which in turn, relate to particle characteristics in sample 10. Spectral parameters relate to emission characteristics of an imaged particle in sample 10. In sub-step (c), there is calculating a focus-fusion factor parameter, F„ from the set of moφhological and biological, and set of spectral parameters, for each Blobk 26 or 28. The focus-fusion factor parameter uniquely combines particle moφhological and biological information with spectral information, to be used in a decision step for discriminating Blobs from each other. This uniquely determined parameter enables achievement of high levels of accuracy and precision in detection and classification of the sample, in general, and of the featured particles, in particular.
In sub-step (d), all detected Blobs are grouped into a single Blob neighborhood, according to the neighborhood distance parameter, ΔD, defined in Step (2), sub-step (a). In sub-step (e), there is calculating a set of inter-Blob distances 30, Δdkb for all the detected Blobs in the Blob neighborhood, where Δdk] is measured between each grouped Blobk and its neighboring grouped Blobs, in the Blob neighborhood.
In sub-step (f), there is selecting high content Blobs 28 from all the Blobsk 26 and 28 in the Blob neighborhood, according to decisions made by using the focus-fusion factor parameter, F„ ΔD, and the set of Δdk]. These high content Blobs are to be used in construction of a fused cube image of sample 10, ultimately, providing useful image content relating to particle characteristics.
In sub-step (g), cube image data is saved in a cube image database, for use in construction of a fused cube image of sample 10. In Step (6), Step (4) through Step (5) are repeated, in the same field of view,
FON,, for the selected range of focal distances, Δz,r, by movement of translation stage
20 in increments of Δz. This step enables the acquisition of multi-layer spectral image data of sample 10. For example, in FIG. 2, three cube images 30, 32, and 34, all in same FON, 24, are separately acquired using focal distances Δz,, 36, Δz,2 38, and Δz,3 40, respectively. This procedure illustrates the multi-layer spectral imaging of sample
10 featuring large layer or depth variations relative to changes in the imaging distance. In Step (7), a single fused cube image 42, is constructed, using the cube image database of Step (5), sub-step (g), and using empirically determined background parameters, B„ for selecting the background of fused cube image 42. In fused cube image 42, preferably, only high content Blobs 28 are retained and featured. In sub-step
(a), fused cube image data is saved in a fused cube image database, for use in image analysis algorithms (Step (9)).
In Step (8), there is acquiring and constructing additional fused cube (spectral) images of sample 10 in other fields of view, FONj, by repeating Step (3) through Step (7), until the selected sample viewing / imaging range is imaged. This is, in part, accomplished by programmed movement of translation stage 20 to other fields of view over sample 10, and in each field of view, incremental movement of translation stage
20 to different selected focal distances, Δzir
In Step (9), one or more image analysis algorithms are applied to the database of fused cube images. The plurality of fused cube images are analyzed for spectral fmgeφrints, whereby spectral data is related to applicable physicochemical and biological characteristics of sample 10.
In sub-step (a), detection, classification, and/or decision algorithms are used for image analysis of the fused cube image data. Examples of specific detection, classification, and/or decision algorithms suitable for image analysis in the method of the present invention are fully described in U.S. Patent No. 5,880,830, issued to Schechter, and in pending U.S. Patent Application No. 09/146,361 , and references cited therein, which are incoφorated by reference for all puφoses as if fully set forth herein. Calibration data of standard samples with known physicochemical, biological, and spectral imaging characteristics are used as part of the image analysis. In the present invention, image analysis is based on uniquely combining physicochemical, for example, moφhological, and, chemical and biological composition data, with multi-layer spectral imaging data of sample 10 featuring particles. This unique combination enables achievement of high levels of accuracy and precision in detection and classification of the sample, in general, and of the featured particles, in particular. In sub-step (b), a statistical analysis report of the image analysis results is generated.
In Step (10), Step (3) through Step (9) are repeated for each pre-defined time interval, Δt. In sub-step (a), a report relating to time variation of the physicochemical, biological, and spectral imaging characteristics of sample 10 featuring particles is generated. This step further enables achievement of high levels of accuracy and precision in detection and classification of the sample.
While the invention has been described in conjunction with a specific embodiment thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, it is intended to embrace all such alternatives, modifications and variations that fall within the spirit and broad scope of the appended claims.

Claims

WHAT IS CLAIMED IS:
1. A method for multi-layer imaging and analyzing a sample featuring particles, imaged particles exhibiting a spatially varying degree of shaφness, the method comprising the steps of:
(a) providing a spectroscopic imaging system, including a sample holder movable by a three dimensional translation stage;
(b) defining imaging scenario parameters; (c) adjusting and setting said imaging system for imaging at a selected field of view, FON,, having central x, y coordinates; (d) focusing said imaging system by moving said translation stage an increment Δz, until receiving a shaφ gray level image of the sample at a selected focal distance Δz,; (e) at said selected FON, and at said selected Δz,, acquiring a cube image of the sample, said cube image featuring a plurality of pixels, each of said plurality of pixels having at least one common visual property, each of said plurality of pixels having a location in said cube image;
(f) detecting a plurality of targets for each of said plurality of pixels, each of said plurality of targets created by a plurality of pixels having a pre-defined measured intensity above the imaged background intensity, each said target defined as a Blobk;
(g) calculating a set of empirically determined moφhological and biological parameters and a set of spectral parameters for each said Blobk; (h) calculating a focus-fusion factor parameter, F,, from said set of moφhological and biological parameters and from said set of spectral parameters for each said Blob ; (i) grouping all said Blobs into a single Blob neighborhood, according to a neighborhood distance parameter, ΔD; (j) calculating a set of mter-Blob distances, Δd„, for said all said Blobs in said Blob neighborhood, each said inter-Blob distance measured between each said grouped Blobk and a neighboring said grouped Blob, to said grouped Blobk; (k) selecting a set of high content Blobs from said Blob neighborhood, according to decisions made by using said focus-fusion parameter, said neighborhood distance parameter, and said set of said inter-Blob distances;
(1) saving data of said cube image in a cube image database; (m) repeating step (d) through step (1) in same said FON,, at another said Δz, until a selected depth of the sample is incrementally imaged;
(n) constructing a fused cube image from said cube image database and empirically determined background parameters, B„ and locate the position of each said high content Blob with x, y coordinates of central gravity point; and
(o) saving data of said fused cube image in a fused cube image database to be used for image analysis of the sample.
2. The method of claim 1, further comprising the step of constructing additional said fused cube images of the sample in other said fields of view, by repeating step (c) through step (o) until a selected imaging area of the sample is imaged.
3. The method of claim 2, further comprising the steps of: (p) applying one or more of image analysis algorithms selected from the group consisting of particles detection algorithm, particles classification algorithm, and decision algorithm; and
(q) generating a report including statistical analyses of spectral absoφtion and fluorescence, moφhological, chemical, and biological characteristics of the particulate sample.
4. The method of claim 3, wherein said image analysis algorithms include imaging data obtained from calibrations of standard samples with known characteristics selected from the group consisting of physicochemical characteristics, biological characteristics, and spectral characteristics.
5. The method of claim 3, further comprising the steps of:
(r) repeating the steps of method 3 according to a pre-defined time interval, Δt, for a pre-defined time duration; and (s) generating a report on the time varying characteristics of the particulate sample.
6. The method of claim 1, wherein said imaging scenario parameters include physicochemical and biological parameters of the sample and scanning parameters of said imaging system.
7. The method of claim 6, wherein said physicochemical and biological parameters of the sample are selected from the group consisting of composition profile, compound chemistry, moφhological characteristics, and microorganism count.
8. The method of claim 1, wherein said high content of a said Blob is defined by said imaging data relating to physicochemical, biological, and spectral characteristics of the particles.
9. The method of claim 1, wherein said decisions made for said selection of a set of said high content Blobs from said Blob neighborhood involve distinguishing said high content Blobs featuring physicochemical and spectral information relating to the particles from said Blobs featuring non-particle information, said non-particle information including sample and imaging system contamination.
10. The method of claim 1 , wherein said imaged particles feature species of chemical origin and chemical characteristics.
1 1. The method of claim 1 , wherein said imaged particles feature species of biological origin and biological characteristics, said species of said biological origin and said biological characteristics includes microorganisms.
12. A method for multi-layer imaging and analyzing a sample featuring particles, imaged particles exhibiting a spatially varying degree of shaφness, the method comprising the steps of:
(a) at a selected field of view, FON,, and at a selected focal distance, Δz„ acquiring a cube image of the sample, said cube image featuring a plurality of pixels, each of said plurality of pixels having at least one common visual property, each of said plurality of pixels having a location in said cube image;
(b) detecting a plurality of targets for each of said plurality of pixels, each of said plurality of targets created by a plurality of pixels having a pre-defined measured intensity above the imaged background intensity, each said target defined as a Blobk;
(c) calculating a set of empirically determined moφhological and biological parameters and a set of spectral parameters for each said Blobk; (d) calculating a focus-fusion factor parameter, F„ from said set of moφhological and biological parameters and from said set of spectral parameters for each said Blob; (e) grouping all said Blobs into a single Blob neighborhood, according to a neighborhood distance parameter, ΔD; (f) calculating a set of inter-Blob distances, Δd, for said all said Blobs in said Blob neighborhood, each said inter-Blob distance measured between each said grouped Blobk and a neighboring said grouped Blob, to said grouped Blobk;
(g) selecting a set of high content Blobs from said Blob neighborhood, according to decisions made by using said focus-fusion parameter, said neighborhood distance parameter, and said set of said inter-Blob distances; (h) saving data of said cube image in a cube image database;
(i) repeating step (a) through step (h) in same said FON,, at another said Δz until a selected depth of the sample is incrementally imaged; (j) constructing a fused cube image from said cube image database and empirically determined background parameters, B„ and locate the position of each said high content Blob with x, y coordinates of central gravity point; and (k) saving data of said fused cube image in a fused cube image database to be used for image analysis of the sample.
13. The method of claim 12, further comprising the step of constructing additional said fused cube images of the sample in other said fields of view, by repeating step (a) through step (k) until a selected imaging area of the sample is imaged.
14. The method of claim 13, further comprising the steps of:
(1) applying one or more of image analysis algorithms selected from the group consisting of particles detection algorithm, particles classification algorithm, and decision algorithm; and (m) generating a report including statistical analyses of spectral absoφtion and fluorescence, moφhological, chemical, and biological characteristics of the particulate sample.
15. The method of claim 14, wherein said image analysis algorithms include imaging data obtained from calibrations of standard samples with known characteristics selected from the group consisting of physicochemical characteristics, biological characteristics, and spectral characteristics.
16. The method of claim 15, further comprising the steps of:
(n) repeating the steps of method 15 according to a pre-defined time interval,
Δt, for a pre-defined time duration; and (o) generating a report on the time varying characteristics of the particulate sample.
17. The method of claim 12, wherein said high content of a said Blob is defined by said imaging data relating to physicochemical, biological, and spectral characteristics of the particles.
18. The method of claim 12, wherein said decisions made for said selection of a set of said high content Blobs from said Blob neighborhood involve distinguishing said high content Blobs featuring physicochemical and spectral information relating to the particles from said Blobs featuring non-particle information, said non-particle information including sample and imaging system contamination.
19. The method of claim 12, wherein said imaged particles feature species of chemical origin and chemical characteristics. 20 The method of claim 12, wherein said imaged particles feature species of biological oπgm and biological characteπstics, said species of said biological oπgm and said biological characteπstics includes microorganisms
EP00936267A 1999-06-01 2000-05-25 Method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples Withdrawn EP1190372A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US32297599A 1999-06-01 1999-06-01
US322975 1999-06-01
PCT/US2000/014312 WO2000073977A1 (en) 1999-06-01 2000-05-25 Method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples

Publications (1)

Publication Number Publication Date
EP1190372A1 true EP1190372A1 (en) 2002-03-27

Family

ID=23257262

Family Applications (1)

Application Number Title Priority Date Filing Date
EP00936267A Withdrawn EP1190372A1 (en) 1999-06-01 2000-05-25 Method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples

Country Status (3)

Country Link
EP (1) EP1190372A1 (en)
AU (1) AU5160800A (en)
WO (1) WO2000073977A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN103632160B (en) * 2012-08-24 2017-01-18 孙琤 Combination-kernel-function RVM (Relevance Vector Machine) hyperspectral classification method integrated with multi-scale morphological characteristics
US9816940B2 (en) 2015-01-21 2017-11-14 Kla-Tencor Corporation Wafer inspection with focus volumetric method
CN114166700B (en) * 2021-11-26 2023-07-21 哈尔滨工程大学 Device and method for observing fusion phenomenon of liquid bridges among particle swarms

Family Cites Families (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5371690A (en) * 1992-01-17 1994-12-06 Cognex Corporation Method and apparatus for inspection of surface mounted devices
US5544256A (en) * 1993-10-22 1996-08-06 International Business Machines Corporation Automated defect classification system
US5537491A (en) * 1993-11-24 1996-07-16 Xerox Corporation Analyzing an image or other data to obtain a stable number of groups

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See references of WO0073977A1 *

Also Published As

Publication number Publication date
AU5160800A (en) 2000-12-18
WO2000073977A1 (en) 2000-12-07

Similar Documents

Publication Publication Date Title
US6438261B1 (en) Method of in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples
US7379578B2 (en) Imaging apparatus associated with an image database
US8119997B2 (en) Optical system and method for inspecting fluorescently labeled biological specimens
EP1500035A1 (en) Ray-based image analysis for biological specimens
US6694048B2 (en) Method for generating intra-particle morphological concentration/density maps and histograms of a chemically pure particulate substance
CN108931536A (en) Method and apparatus for assessing coating surface quality
US7586599B2 (en) Method and system for detecting defects
WO2000073977A1 (en) Method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples
US6697510B2 (en) Method for generating intra-particle crystallographic parameter maps and histograms of a chemically pure crystalline particulate substance
JP2022533623A (en) METAL POWDER ANALYZING METHOD AND APPARATUS
CN114363481A (en) Microscope with device for detecting displacement of sample relative to objective lens and detection method thereof
WO2007054804A2 (en) Digital inspection of the physical quality of plain surfaces
Cole et al. Recent advances in automatic image analysis using a television system
IL156325A (en) Method for in-situ focus-fusion multi-layer spectral imaging and analysis of particulate samples
JP2001272328A (en) Particle measurement apparatus by means of image
US10969338B1 (en) UV Raman microscope analysis system
EP3654277B1 (en) Screening method and apparatus for detecting an object of interest
US20230258918A1 (en) Digital microscope with artificial intelligence based imaging
JP3107740B2 (en) Object identification device
Reske et al. Automated particle analysis by Raman microscopy–a method development
JP2017122591A (en) Measurement method
CN115602515A (en) Particle beam microscope, method for operating a particle beam microscope and computer program product
Crompton The industrial value of high sensitivity particle image analysis
Neilly et al. Pharmaceutical compliance applications of scanning electron microscopy and energy dispersive X-ray spectroscopy
Melton et al. Application of FPA test system technology to commercial inspection/measurement systems

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20011227

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE CH CY DE DK ES FI FR GB GR IE IT LI LU MC NL PT SE

AX Request for extension of the european patent

Free format text: AL;LT;LV;MK;RO;SI

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20081202