Classifications

• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/00163—Optical arrangements
  • A61B1/00186—Optical arrangements with imaging filters
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/00002—Operational features of endoscopes
  • A61B1/00004—Operational features of endoscopes characterised by electronic signal processing
  • A61B1/00009—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope
  • A61B1/000096—Operational features of endoscopes characterised by electronic signal processing of image signals during a use of endoscope using artificial intelligence
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/00002—Operational features of endoscopes
  • A61B1/00057—Operational features of endoscopes provided with means for testing or calibration
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
  • A61B1/043—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances for fluorescence imaging
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/04—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances
  • A61B1/05—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor combined with photographic or television appliances characterised by the image sensor, e.g. camera, being in the distal end portion
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
  • A61B1/0607—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for annular illumination
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
  • A61B1/063—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements for monochromatic or narrow-band illumination
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
  • A61B1/0638—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements providing two or more wavelengths
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
  • A61B1/0646—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements with illumination filters
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
  • A61B1/0655—Control therefor
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
  • A61B1/0661—Endoscope light sources
  • A61B1/0676—Endoscope light sources at distal tip of an endoscope
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B1/00—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor
  • A61B1/06—Instruments for performing medical examinations of the interior of cavities or tubes of the body by visual or photographical inspection, e.g. endoscopes; Illuminating arrangements therefor with illuminating arrangements
  • A61B1/0661—Endoscope light sources
  • A61B1/0684—Endoscope light sources using light emitting diodes [LED]
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
  • A61B5/0071—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence by measuring fluorescence emission
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
  • A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
  • A61B5/0084—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
  • A61B5/0086—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters using infrared radiation
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
  • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
  • G01J3/02—Details
  • G01J3/10—Arrangements of light sources specially adapted for spectrometry or colorimetry
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
  • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
  • G01J3/28—Investigating the spectrum
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
  • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
  • G01J3/28—Investigating the spectrum
  • G01J3/30—Measuring the intensity of spectral lines directly on the spectrum itself
  • G01J3/36—Investigating two or more bands of a spectrum by separate detectors
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
  • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
  • G01N21/17—Systems in which incident light is modified in accordance with the properties of the material investigated
  • G01N21/25—Colour; Spectral properties, i.e. comparison of effect of material on the light at two or more different wavelengths or wavelength bands
  • G01N21/31—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry
  • G01N21/35—Investigating relative effect of material at wavelengths characteristic of specific elements or molecules, e.g. atomic absorption spectrometry using infrared light
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
  • H04N23/11—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths for generating image signals from visible and infrared light wavelengths
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/10—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from different wavelengths
  • H04N23/125—Colour sequential image capture, e.g. using a colour wheel
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N9/00—Details of colour television systems
  • H04N9/64—Circuits for processing colour signals
  • H04N9/646—Circuits for processing colour signals for image enhancement, e.g. vertical detail restoration, cross-colour elimination, contour correction, chrominance trapping filters
• • A—HUMAN NECESSITIES
  • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
  • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
  • A61B5/00—Measuring for diagnostic purposes; Identification of persons
  • A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01J—MEASUREMENT OF INTENSITY, VELOCITY, SPECTRAL CONTENT, POLARISATION, PHASE OR PULSE CHARACTERISTICS OF INFRARED, VISIBLE OR ULTRAVIOLET LIGHT; COLORIMETRY; RADIATION PYROMETRY
  • G01J3/00—Spectrometry; Spectrophotometry; Monochromators; Measuring colours
  • G01J3/28—Investigating the spectrum
  • G01J2003/2866—Markers; Calibrating of scan
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/50—Constructional details
  • H04N23/555—Constructional details for picking-up images in sites, inaccessible due to their dimensions or hazardous conditions, e.g. endoscopes or borescopes

Definitions

• the present invention relates to methods and apparatus for multi-spectral imaging.
• the methods and apparatus may be applied, for example, in cancer detection and localization.
• Some embodiments can perform rapid multispectral imaging in the visible/NIR spectrum suitable for quantitative image-based determination of tissue physiological and morphological properties.
• Real-time monitoring and imaging of tissue physiological and morphological changes provides very useful information for diagnosis and therapy.
• tissue physiological and morphological changes could be of prime importance for detecting different pathologies, especially in the early stages, such as cancer and ischemia.
• Spectral images obtained during endoscopy could be used to derive information about tissue physiological and morphological properties.
• Conventional endoscopy uses white light reflectance images to view surface morphology and assess internal organs based on appearance such as, tissue color and surface morphology. While changes in physical appearance (e.g.
• point spectroscopy modalities such as reflectance, fluorescence, and Raman spectroscopy
• point microscopic imaging modalities such as confocal microscopy, optical coherence tomography, and multi-photon excitation imaging, as additional techniques to be combined with white light and fluorescence imaging.
• United States Patent 6,898,458 to Zeng at al. discloses an apparatus and method for simultaneous imaging and non-contact point spectroscopy measurements in both the white light reflectance and fluorescence modes.
• the noncontact spectral measurement and imaging may be performed by placing a specially designed spectral attachment between the endoscope eyepiece and the camera.
• the image and the spectrum are simultaneously displayed on a monitor for observing by an operator.
• United States Patent Application Publication 2009/0270702 to Fawzy et al. describes a method for analyzing reflectance spectra to obtain quantitative information about cancer-related changes such as micro-vascular blood volume fraction in tissue, tissue blood oxygen saturation (physiological parameters) as well as tissue scattering micro-particle volume fraction and size distribution (morphological parameters). Both of the above references describe conducting spectral measurements though the eyepiece of a fiber endoscope. The spectral measurements involved point spectroscopy as opposed to spectral imaging.
• Absorption characteristics and scattering characteristics of light differ according to the wavelength of the light. These differences are due to a distribution of different absorbent material such as blood vessels in the depth direction. Longer wavelengths of illumination light, such as infrared light, provide information from deeper parts of the tissue while shorter wavelengths of illumination light give information from the tissue near the surface. Detection of changes that occur near the tissue surface is essential for early cancer detection. Several groups have reported intrinsic differences in optical absorption and scattering properties between malignant and benign lesions/normal tissues and have related these changes directly to tissue physiological and morphological changes that occur during cancer transformations. See M.P.L. Bard, A. Amelink, V. N. Hegt, W. J. Graveland, H. J. CM. Sterenborg, H.
• G. N. Stamatas, M. Southall and N. Kollias "In vivo monitoring of cutaneous edema using spectral imaging in the visible and near infrared", J. Invest. Dermatol. 126, 1753-1760, 2006; and G N. Stamatas, N. Kollias, "Noninvasive quantitative documentation of cutaneous inflammation in vivo using spectral imaging", SPIE Proceedings 6078, 60780P, 2006, describe use of spectral imaging to obtain in vivo 2-D maps of various skin chromophores including oxy- and deoxy- hemoglobins. They use 18 narrow band filters to obtain images in the 400-970 nm range. A phase correction algorithm was then used to align the individual images at different wavebands to fight motion artifacts.
• a 2.0 mm size catheter comprising an illumination fiber and two imaging fiber bundles was passed through the instrument channel to perform the hyperspectral imaging.
• This group used algorithms developed for fiber-probe point reflectance spectral analysis to analyze the imaging spectral data to derive a scatter size parameter image.
• the system encountered problems from specular reflection interference and motion artifacts due to movement from either endoscope or patient.
• the invention has a number of aspects. Some of these may be applied independently as well as in combination with other aspects.
• a multi-spectral imaging system is provided with parallel multi-band illumination and parallel multi-channel imaging detection to achieve video rate rapid multi-spectral imaging overcoming the motion artifacts. Specular reflection is automatically corrected by applying a data analysis algorithm.
• the object may, for example, comprise living tissue.
• the apparatus comprises a light source configurable to emit light having a first spectrum characterized by a first plurality of narrow bands.
• the apparatus is arranged to direct the light from the light source onto an area of the object.
• the apparatus comprises a multichannel imaging light detector arranged to image the area of the object and configured to provide multi-channel image data.
• Image processing apparatus is configured to extract a plurality of spectral images from the image data.
• the plurality of spectral images comprise a spectral image corresponding to each of the plurality of narrow bands.
• Another aspect provides a system for multispectral imaging providing simultaneous images indicative of two or more of tissue blood volume, tissue oxygenation, tissue scatter volume and tissue scatter size parameter.
• the present invention provides an apparatus for multispectral imaging of an object comprising a light source for illuminating the object, the light source being adapted to generate simultaneously illumination in at least two narrow wavelength bands, each of the narrow bands being within different wavelengths for producing spectral images in a visible/NIR range.
• a multichannel or multi-detector camera works in accordance with the simultaneous multi-band illumination to capture multiple images at these multiple wavelength bands simultaneously.
• the present invention provides a light source that produces 18+ wavebands of illumination light and an image detecting device to capture corresponding 18+ spectral images at these wavebands.
• the light source is configured to produce 12 to 52 narrow wavelength bands.
• the obtained spectral images are processed and analysed to produce absorption and scattering spectral images.
• An intensity calibration algorithm uses measured reflectance spectra from a pixel of an image and in-vitro optical absorption coefficients to correct for intensity of the spectral images from a light coupling variation/error between a light source, a tissue (subject being imaged), and the image detecting device.
• the present invention provides a method for
• quantification of tissue physiological and morphological information comprising the steps of illuminating an object simultaneously with light in at least two narrow bands, simultaneously acquiring multiple images corresponding to these wavelength bands, each of the narrow bands being within different wavelengths for producing spectral images in a visible/NIR range, producing a plurality of spectral images, correcting an intensity of the spectral images using measured reflectance spectra from a pixel of the image and in-vitro optical absorption coefficients, producing separately absorption and scattering spectral images along a full spectral range, and quantifying at least one physiological parameter and/or at least one morphological parameter from the obtained absorption and scattering images.
• the present invention provides an apparatus for noninvasive rapid multi-spectral imaging for cancer detection and localization by an endoscopy system.
• the present invention provides a system for non-invasive rapid multi-spectral imaging for cancer detection by an optical probe.
• the present invention provides a programmable
• multifunctional system which can perform white light reflectance imaging, fluorescence imaging and multi-spectral reflectance imaging.
• Some embodiments apply image detectors having three imaging channels.
• the imaging detectors are commercially available color cameras in some embodiments.
• the present invention provides an image detector with four imaging channels.
• the light source is programmed to generate 4 narrow bands of illumination simultaneously.
• Each of the narrow bands is within the B, G, R, and NIR bands respectively and they shift simultaneously with time to different wavelength sets.
• the light source comprises a programmable light source, such as a digital micromirror device.
• the light source comprises a filter wheel based light source which provides simultaneous multiple narrow band illumination.
• an acousto-optic tunable filter is used with a fiber laser based supercontinuum light source or a laser-driven light source for producing multiple narrow band illumination profiles.
• white light images are synthesized from spectral images.
• a modeling approach is used to determine optimized wavelength bands for rapid multi-spectral imaging.
• the present invention provides a real-time imaging of tissue blood volume distribution, tissue oxygenation, tissue scatter volume distribution and scatter size parameter spatial distribution.
• multi-spectral images are captured by an image detector located at a tip of an endoscope. The image detector is coated with a special pattern of filters to facilitate at least three and preferably four channel imaging (B, G, R, NIR).
• multi-spectral images are captured by a color camera having three (R, G, B) channels with spectral overlaps.
• the camera may have a CCD, CMOS or APS light sensor comprising a pattern of filter elements which pass light in different overlapping bands.
• the filter elements may be arranged in a Bayer mosaic pattern.
• a calibration method is used to decompose images from a standard color camera (such as a commercial camera) to provide narrow-band images.
• a light source for producing a plurality of illumination profiles comprises a plurality of solid-state light emitters such as LEDs located at a tip of an endoscope.
• the present invention provides a method for optimizing wavelength bands for spectral imaging.
• the optimizing method is based on an optimized light transport model.
• apparatus and methods for rapid multispectral imaging in which spectral images are generated from a plurality of simultaneous narrow band images.
• apparatus and method obtains a plurality of spectral images simultaneously in video rate real time.
• the images may indicate physiological properties such as, e.g. tissue blood volume, tissue oxygenation, tissue scatter volume and tissue scatter size parameters.
• the apparatus and methods additionally obtain white light and/or fluorescence images.
• Act provides a multi-spectral imaging method.
• the method comprises exposing an area of an object to light having a spectrum comprising a plurality of narrow wavelength bands, acquiring image data comprising an image of the exposed object using a multi-channel imaging detector, and extracting a plurality of spectral images from the image data, the plurality of spectral images comprising a spectral image corresponding to each of the plurality of narrow bands.
• Another aspect provides a multi-spectral imaging method comprising exposing an area of an object to light in N narrow wavelength bands and obtaining images of the object while it is exposed to the light. The exposing is performed in a sequence of steps.
• Each step comprises simultaneously exposing the object to light having a spectrum consisting essentially of a set of n of the N narrow wavelength bands at a time and obtaining an image of the object using a multichannel imaging detector.
• the method includes processing multi-channel image data from the multi-channel imaging detector to obtain spectral images corresponding to the N narrow wavelength bands.
• the processing may comprise multiplying vectors of pixel values by a calibration matrix.
• FIG. 1 is a schematic illustration of an endoscopy system according to an embodiment of the present invention
• FIG. 2 is a schematic illustration of a rotating filter wheel useful for generating simultaneous illumination in multiple narrow-bands of different spectral profiles at different times;
• FIG. 2a is a graph illustrating spectral properties of a custom-made filter passing multiple wavelength bands of light;
• FIG. 3 is a schematic illustration of a light source located at a distal end of an endoscope
• FIG. 4 is a block diagram of example programmable image acquisition and processing electronics
• FIG. 5 is a graph illustrating overlapping spectral responses for a three (red (R), green (G) and blue (B)) channels of a CCD;
• FIG. 6 is a graph illustrating CCD output readings in response to three wavelengths due to their overlapping spectral responses
• FIG. 7 is a schematic illustration of a light source according to another which combines a fluorescence light source for providing illumination for fluorescence imaging and a programmable digital light source for providing illumination for white light reflectance and multi-spectral imaging;
• Fig. 8 is a graph of a ROC curve for 52 data points/wavebands spectral data (top triangle symbol curve) and the ROC curve for a reduced number of data points of 18 wavebands (lower circular symbol curve);
• FIG. 9 is a flow chart illustrating an optimization procedure according to an example embodiment
• FIG. 10 is a graph showing an accuracy of three approaches of an optimization procedure of the present invention
• FIG. 1 1 is a graph showing the effect of band width on the accuracy of an optimization procedure of the present invention
• FIG. 1 2 is a flow chart illustrating a mapping algorithm according to an example embodiment
• FIG. 13 is a flow chart illustrating an intensity calibration algorithm according to an example embodiment which may be used to correct spectral images for measurement geometry variations
• FIG. 14 is a flow chart illustrating a rapid inversion algorithm according to an example embodiment which may be used for quantifying tissue physiological and morphological properties
• FIG. 14a is a flow chart illustrating a rapid inversion algorithm according to another embodiment of the present invention.
• FIG. 1 5 is an illustration of resultant images such as may be obtained with an embodiment of a method and apparatus of the present invention.
• a multi-spectral imaging system provides parallel multi-band illumination and parallel multi-channel imaging detection to achieve high rate multi-spectral imaging.
• the imaging rate may be high enough to avoid motion artifacts.
• imaging is performed at video rates (e.g. 24 frames per second or more). Specular reflection may be automatically corrected for by a data analysis algorithm as described below.
• Such methods and apparatus may be used in combination with a multi- spectral imaging system or in other applications.
• the methods and apparatus may be employed, for example, in generating video rate or near video rate quantified images of the physical, physiological, and morphological properties of tissue.
• such methods and apparatus may be provided in a system that provides images indicating one or more of: tissue blood volume, tissue oxygenation, tissue scatter volume and tissue scatter size parameter.
• White light and/or fluorescence images may also be provided.
• Some embodiments provide a programmable multifunctional endoscopy system that can perform white light reflectance imaging (WLR), fluorescence imaging (FL) and multi-spectral reflectance imaging.
• WLR white light reflectance imaging
• FL fluorescence imaging
• multi-spectral reflectance imaging multi-spectral reflectance imaging
• Figure 1 is a block diagram showing functional elements of a
• System 1 1 comprises a light source 12 for generating illumination light comprising light in a plurality of narrow spectral bands and an optical camera/detector 7 for acquiring and generating spectral images corresponding to the spectral bands.
• the light emitted by light source 12 may consist essentially of light in the plurality of spectral bands. In some embodiments, at least 50% or at least 80% of the light energy in the illumination light emitted by light source 12 is in the plurality of spectral bands.
• light source 12 comprises a broadband light emitter 1 and an illumination light filter 2 for generating plurality of narrow spectral bands.
• Light filter 2 may, for example comprise a filter on a rotating filter wheel.
• Light emitter 1 may comprise, for example, a Xenon lamp which provides broad spectral illumination light in the wavelength range of 400-800 nm.
• light source 12 comprises a plurality of narrow-band light sources that each emit light in one of the plurality of spectral bands.
• light source 12 may comprise a plurality of light-emitting semiconductor devices (such as, for example light-emitting diodes LEDs).
• light source 12 is adapted to permit the spectral make up of the illumination light to be changed. For example, during a first period, light source 12 may emit light in a first set of narrow spectral bands, during a second period the light source 12 may emit light in a second set of narrow spectral bands different from the first set. This may be continued for a number of periods.
• light source 12 is configured to repeatedly cycle through a plurality of periods and, in each period, to emit illumination light in a plurality of spectral bands such that the spectrum of the illumination light (e.g. the specific spectral bands which make up the illumination light in that period) changes from period-to period.
• the illumination light emitted by light source 1 passes through filter 2 which filters out light that is outside of the plurality of narrow spectral bands to leave illumination light that is concentrated in the plurality of narrow spectral bands.
• Such illumination light is focused by a lens 3 into an illumination light guide 4 to irradiate a tissue 5 (an object being imaged).
• Light reflected by the tissue is captured by an imaging means which, in this example, comprises a collecting lens (not shown), an imaging light guide 6 and a detector 7.
• Detector 7 may
• Detector 7 may comprise, for example, three charge-coupled devices
• Detector 7 may further comprise a plurality of dichroic mirrors.
• a light beam from image guide 6 enters detector 7 and impinges onto a first dichroic mirror which reflects light having wavelengths smaller than 500 nm toward the blue CCD while transmitting light having wavelengths >500 nm.
• a second dichroic mirror reflects light having wavelengths smaller than 600 nm toward the green CCD and transmits light having
• detector 7 may comprise band pass filters in optical paths upstream from the CCDs (for example, one bandpass filter may be disposed in close proximity in front of each of the CCDs to further optically process the incident light.
• the CCDs may have exposure times shorter than video rate to accommodate fast image acquisition for multi-spectral imaging. Images obtained by the CCDs are processed by a processing unit 8 into plurality of spectral images. The obtained spectral images are then analyzed by the analyzing unit 9 and the resulted physiological and morphological images of the tissue are displayed on a desired output means such as a monitor 1 0.
• Analyzing unit 9 may, for example, apply a modeling algorithm as described below.
• Light source 1 2 may provide visible and/or near infrared (NIR) radiation.
• NIR near infrared
• light source 1 2 may provide illumination light in the visible / NIR band extending from about 400 nm to at least about 800 nm.
• light source 12 has a mode of operation in which it emits broadband illumination in at least the visible range. Such a mode may be useful for generating images to guide an operator during an endoscopy procedure.
• detector 7 may capture an image that is similar to a conventional RGB image with the exception that the red channel covers e.g. 600-800nm instead of a narrower range such as 600-700nm.
• light source 1 2 can provide simultaneous multiple narrow band (NB) illumination (e.g.
• each multi-NB set has the same number of narrow band components as detector 7 has channels.
• each multi- NB set may comprise three narrow bands.
• filter wheel 2 may be used to generate illumination light in a sequence of periods such that in different periods the illumination light has a spectral make up that comprises different sets of three narrow bands.
• Filter wheel 2 may include more than one filter. When each of these filters is in the optical path between light emitter 1 and the object being imaged, the illumination light is made essentially of three narrow bands that are delivered simultaneously to the object.
• the bands may, for example, comprise one band in the blue part of the spectrum, one band in the green part of the spectrum and one band in the red or infrared part of the spectrum.
• filter 21 may generate illumination spectrum 26 during time period T1 ; filter 22 generates illumination spectrum 27 during time period Ti; and filter 23 generates illumination spectrum 28 during time period Tn.
• the individual filters in filter wheel 2 can generate simultaneously more or fewer than three narrow wavebands.
• the filter wheel includes filters that provide a total of 12 to 52 different bands of illumination light with each filter providing two or three different bands.
• the number of narrow passbands for each filter is equal to or less than the number of channels provided by the detector in some embodiments.
• filter wheel 2 includes six filters providing a total of 18 bands of illumination light, three bands at a time.
• each filter provides a different spectral illumination profile comprised of a different set of three narrow bands of light.
• a table below shows one example of possible wavelengths of the 1 8 selected bands.
• the narrow bands have bandwidths of 20 nm or less.
• the 10nm columns represent wavelength selections optimized for narrow bands having bandwidths of 10 nm.
• the 15nm columns are wavelength selections optimized for the case where the narrow bands have bandwidths of 15 nm.
• the wavelengths of the narrow bands may be evenly or unevenly spaced apart.
• a first filter may provide simultaneously a light in a blue band (415nm), green band (51 Onm or 515nm) and red band (61 Onm or 615nm).
• a second filter may provide illumination profile of 435nm, 525nm and 625nm;
• a third filter may provide 445nm or 450nm, 540nm or 545nm and 640nm or 645nm;
• a forth filter may provide 460nm or 465nm, 560nm and 665nm;
• a fifth filter may provide 475nm, 575nm and 690nm; and
• a sixth filter may provide 490nm, 590nm or 595 nm and 760nm illumination light.
• FIG 2a An example transmission characteristic of a custom-made filter on filter wheel 2 is shown in FIG 2a. As shown this particular filter on the filter wheel 2 can pass simultaneously multiple bands of light in different wavelengths. In addition, a short wave pass filter can be used to remove the transmitted light above 800 nm.
• a filter wheel 2 switching between different spectral profiles is achieved by rotating the filter wheel 2.
• the filter wheel 2 is rotated at a speed of about 30 r/s.
• Light from light emitter 1 may be used without narrow band filtering to provide white light illumination (e.g. 400-700 nm) for use in white light reflectance imaging. This may be achieved by providing one or more segments of filter wheel 2 which do not have narrow-band filters and/or providing a selectable optical path that bypasses filter wheel 2.
• the light source 12 shown in Figure 1 is only one example from among a large number of suitable light sources that may be applied for generating illumination having a spectrum comprising a plurality of narrow bands that can be imaged in the same exposure of detector 7.
• an acousto-optic tunable filter (AOTF) based light source or a liquid crystal tunable filter (LCTF) based light source is used.
• a digital micromirror device (DMD) based spectrally programmable light source is used for providing effectively simultaneous multiple NB illumination.
• a light source comprises one or more acousto-optic tunable filters (AOTFs) for essentially simultaneous generation of multiple NB illumination.
• AOTFs acousto-optic tunable filters
• a model SC450-AOTF light source from Fianium, UK can generate light in which the spectrum has up to eight NB components.
• the AOTF can be used with a fiber laser based supercontinuum light source.
• light source 1 2 comprises a plurality of separate light emitters which each emit narrow band light in one or more specific wavelength bands.
• the light emitters may comprise light-emitting semiconductor devices such as light-emitting diodes (LEDs) for example.
• the light source comprises LEDs of several types with a plurality of LEDs of each type.
• a light source 12 is located at a distal end of an endoscope.
• a plurality of LEDs or LDs may be located at the distal end of the endoscope. This arrangement does not require a light guide 4 for carrying illumination light.
• the plurality of LEDs may be electronically switched at high rates to provide a plurality of illumination segments with specific spectral properties.
• the LEDs can be switched on and off electrically to conveniently achieve simultaneous multi-band illumination and be synchronized with the camera for corresponding image acquisition.
• the many LEDs may be arranged in a circle to achieve uniform illumination light at the tissue surface.
• FIG. 3 shows a distal end 30 of an endoscopy system with a plurality of LEDs 31 to generate light in a plurality of desired wavelength bands.
• the LEDs 31 may be mounted at the distal end of the endoscope surrounding a lens 32, which can form an image at the imaging light guide 6 that in turn carries the image to detector 7.
• a miniature camera 7 may be placed directly behind lens 32, eliminating the need of imaging light guide 6. This later set-up can also be used for open-field imaging applications, such as imaging of the human skin.
• a bandpass filter may optionally be deposited on the light-emitting face of each LED to help narrow down the spectral bandwidth to the desired
• the set of three LEDs 31 a may provide illumination light in three corresponding narrow bands (b a , g a , r a ), the LEDs 31 b may provide illumination light in three corresponding narrow bands (b b , gt > , i b ) at the same or different wavelength of LEDs 31 a, and LEDs 31 c may provide light in three narrow bands (b c , g c , r c ) at the same or different wavelength of LEDs 31 a and/or 31 b.
• FIG. 4 shows details of example image acquisition and processing electronics 8.
• First image modes are selected and then the imaging signals are digitized by an A/D converter and sent to an Input FPGA (field programmable gate array) for processing.
• the digitized images are directed to an Input FIFO (first in first out) image buffer and then into a Programmable Logic and Processing Unit which can direct the images into either a WLR/FL (white light reflection / fluorescence) Frame buffer or a multi-spectral imaging buffer for further processing.
• the WLR images and the FL images may share the same buffer because these two imaging modalities are typically not performed
• Various image processing functions may be implemented within the Input FPGA such as alignment of the three images taken by the red/near infrared (R/NIR), green (G) and blue (B) CCDs.
• R/NIR red/near infrared
• G green
• B blue
• tissue physiological and morphological parameters for each pixel producing at least four images, such as, e.g., tissue blood volume image, tissue oxygenation image, tissue scatter volume image, and tissue scatter size parameter image.
• additional images such as, e.g., an oxyhemoglobin image, a deoxyhemoglobin image, a tissue water volume image and/or an image of other chromophore distributions can be produced. Based on these images, a tissue diagnostic image may be generated that classifies each pixel as benign/normal or malignant.
• the processed digital images are output by an Output FIFO to an Output FPGA which exports various images into different Video Encoders (DACs) to transform the digital image signals into standard analog videos to be displayed on standard analog monitors.
• the two image frame buffers can be connected to a PC computer, so that at any stage of the above mentioned process the digital images can be transferred into the PC for further processing and analyses and displaying the results on the computer monitors.
• the PC can be equipped with a GPU (Graphics Processing Unit) video processing card to speed up the image processing and data analysis.
• detector 7 has four imaging CCDs such as B
• light source 12 may be adapted to generate illumination light in which the spectrum is made up of four narrow bands of light.
• the narrow bands may be within the B, G, R, and NIR bands respectively.
• the pass wavelength for the narrow bands may be controlled to change with time. This permits faster multi- spectral imaging to be performed.
• a white light reflectance image is synthesized from the acquired narrow-band spectral images.
• a reflectance spectrum can be generated so that a RGB color for the pixel can be obtained by multiplying the reflectance spectrum by an CIE (International Commission on Illumination) standard illumination spectrum to generate the radiance spectrum and convoluting the radiance spectrum with eye cone sensitivity spectra to generate the final R,G,B color quantities for display on a monitor for observing by the operator.
• CIE International Commission on Illumination
• a video endoscope has a detector (e.g. a CCD) installed at the tip of the endoscope.
• a detector e.g. a CCD
• an image light guide 6 is not required.
• the detector chip is coated with a I pattern of filters to facilitate three- or four channel imaging (B, G, R, NIR). A possible pattern is illustrated in the following table.
• a commercial color imaging detector e.g. CCD, CMOS or APS detector
• the detector may have filters applied in a Bayer filter mosaic to obtain R, G, B images.
• the filters in many commercially available imaging detectors can have spectral responses that overlap with one another f
• FIG. 5 shows example filter characteristics for filters of an example CCD image detector. The advantage of using this type of detector is reduced cost.
• a calibration procedure may be performed to obtain accurate reflectance signals corresponding to the individual narrow band illumination wavelengths.
• CCD output readings for each of the three image channels will have contributions from all the three wavelengths due to their overlapping spectral responses.
• the CCD blue channel reading can have contributions from the blue light as determined by the sensitivity T 1 from the green light as determined by the sensitivity T 12 , and from the red light as determined by the sensitivity T 13 .
• the CCD blue channel reading Ci equals:
• Ci T
• the calibration matrix T is a square matrix.
• snap-shot multi-spectral images of suspicious areas (which may be found, for example, by WLR imaging and/or FL imaging) can be captured for off-line analysis (or online but not fast enough to display the results in video rate) to derive snap-shot physiological and morphological images for diagnosis.
• FL imaging illumination may be generated by a light source as shown in FIG.7.
• the FL imaging light source can provide illumination for FL imaging, while a programmable digital light source or a combination of a light emitter with a set of interchangeable filters (such as filters on a filter wheel) can provide illumination for WLR imaging and multi-spectral imaging.
• a programmable digital light source or a combination of a light emitter with a set of interchangeable filters can provide illumination for WLR imaging and multi-spectral imaging.
• a programmable digital light source or a combination of a light emitter with a set of interchangeable filters such as filters on a filter wheel
• both the light source and the image acquisition and processing electronics are fully programmable.
• various ways of acquiring multi-spectral images e.g. different number of wavebands or different positions of these bands or different bandwidth
• WLR imaging as well as various image analysis algorithms
• different numbers of wavebands can be used for multi-spectral imaging. Either evenly or non-evenly spaced wavebands may be selected. These wavebands can be programmed into the system to realize multi- spectral reflectance imaging.
• FIG. 8 shows a ROC curve for spectral data obtained from 52 data points/wavebands, (top triangle symbol curve) and an ROC curve when a reduced number of data points for 18 wavebands (lower circular symbol curve) is used.
• reducing the data points on each spectrum to 18 wavebands slightly reduces diagnostic accuracy but detection sensitivity and specificity remain reasonably good (80% and 77% respectively).
• a multi-spectral reflectance imaging system covering a reasonable number (e.g. 18+) wavebands, can provide superior accuracy comparing to the existing imaging endoscopy modalities, namely WLR mode and FL mode.
• Modeling and statistical approaches may be applied to determine the optimized wavelength bands for spectral imaging.
• a spectral analysis algorithm based on an optimized light-transport model is implemented in programmable image acquisition and processing electronics and a PC computer equipped with GPU for both real-time data processing and offline analysis.
• the minimum number of wavelengths and the optimum wavelength positions and band width are determined from empirical and/or simulated spectral measurements using optimization functions.
• One approach is based on numerical optimization (least- square) of an error function between an estimate obtained using the full spectrum and an estimate obtained using a spectrum that has been optimized for a reduced number of bands.
• three different optimization functions are used for selecting the optimum number of wavelength bands and their band width and central wavelength positions:
• FIG. 9 A flowchart illustrating an optimization procedure for obtaining optimum wavelength positions, Rn, for each given band number and given band width is shown in FIG. 9.
• a selection of a number of wavelength bands (n), width, and position (Wt) are used to generate a corresponding spectrum.
• the generated spectrum is compared to full spectral measurements (Rref) using the optimization function.
• the process is repeated for another selection of number of wavelength and band width, the output of the optimization function is recorded and compared to determine the final selection.
• the analysis may be done assuming that the total number of bands and band width, for each of the three spectral detection channel of interest (Blue 400-500 nm, Green 500-600 nm, and Red/NIR 600-800nm), are equal.
• the results of the above analysis may be used to generate graphs showing the relations between the number of wavelength bands, the band width, and the wavelength positions on the accuracies of the approximations.
• the generated graphs may be used for selecting the optimum design parameters (number of bands, their central wavelengths, and the band width) of the optical filters used in our spectral imaging device.
• FIG.10 shows an example accuracy comparison of the three approaches of optimization procedure and
• FIG. 1 1 shows the effect of the band width on the accuracy.
• a mapping algorithm is used for obtaining a plurality of tissue physiological (absorption) properties related images and a plurality of tissue morphological
• the mapping algorithm may comprise two components: an intensity calibration algorithm and a rapid inversion algorithm.
• FIG. 12 shows a block diagram of an example mapping algorithm that may be applied for generating tissue physiological and morphological images at video- rate.
• the intensity calibration algorithm 200 can produce a corrected albedo spectral image 1 1 0, a scattering spectral image 1 60 and an absorption spectral image 162 from the obtained spectral images 100.
• the scattering spectral image 162 and the absorption spectral image 160 are then fed into the rapid inversion algorithm 300 to quantify the related tissue physiological and morphological properties 1 70 and 1 72.
• the in-vitro absorption spectra 150 of the tissue is used together with the corrected albedo spectral image 1 1 0 to obtain corrected absorption and scattering images 160, 162.
• the intensity calibration algorithm 200 first generates the corrected albedo spectral images 1 10, which are actually ratio of the absorption to the reduced scattering coefficients along the full spectral range.
• the corrected albedo spectral images 1 1 0 are then fed into the rapid inversion algorithm 300 to produce tissue physiological and morphological images 130, 132.
• the physiological and morphological parameters 130, 132 will have different accuracies from the physiological and morphological parameters 170, 172 since they are generated with different modeling approaches.
• Intensity calibration algorithm 200 may be used to correct the intensity of the spectral images to account for measurement geometry variations such as, e.g., the variation in the coupling of reflected light from the tissue into the camera relative to the coupling of reflected light from a reflectance standard into the camera.
• two intensity calibration constants are defined and formulated: (1 ) a measurement geometry constant (Ka), which can correct for the coupling angle and measurement distance variation between the tissue and the camera during the measurements; and (2) an albedo correction constant (Ks), which corrects for the relative intensity nature of the measurements and allows for deducing both the absorption image and the scattering image from the albedo image using the in-vitro absorption spectra of the tissue being imaged as a priori known input to the calibration algorithm.
• Ka measurement geometry constant
• Ks an albedo correction constant
• X[ ] is an inverse light transport model/function that relates the corrected c albedo to the measured reflectance R m
• Y[ ] is a function that relates the absorption amplitude to the scattering amplitude.
• the exact shape or mathematical formulation of X and Y functions depend on the light transport model used in the analysis. A number of known light transport models such as, e.g., Monte Carlo, diffusion approximation model, etc., can be used with the intensity calibration algorithm described herein.
• the intensity calibration algorithm is applied along three wavelengths to produce corrected albedo spectral image or absorption spectral image and scattering spectral image in the full spectral imaging range.
• the physical meaning of the corrected absorption and/or scattering images means an image that is corrected from the reflectance intensity-related distortion/effect that resulted from the variation in the coupling of reflected light from tissue into camera relative to coupling of reflected light from reflectance standard into camera and relative to any movement of the light-camera probe (endoscope tip) orientation to tissue during measurements, which typically occurs during non-contact spectral reflectance measurements such as non-contact reflectance imaging.
• the algorithm can use in-vitro absorption spectra of the tissue being investigated as an a priori known parameter in order to generate the corrected absorption and scattering images along the full spectral imaging range.
• the fixed in-vitro absorption coefficient used in the intensity calibration algorithm acts as an internal tissue standard to allow for specifying and separating the scattering amplitude and the absorption amplitude. Consequently, it provides more robust quantitative data about tissue physiological and morphological properties.
• intensity calibration algorithm 200 uses three spectral images at wavelength ⁇ 1 , ⁇ 2, ⁇ 3 (101 ), in-vitro absorption coefficients at ⁇ 1 , ⁇ 2, ⁇ 3 (250) of the tissue being imaged, and randomly chosen initial values for measurement geometry constant Kai and albedo correction constant Ksi (201 ), as input parameters.
• the algorithm proceeds iteratively (240 and 242) until the calculated geometry constant Kac and the calculated albedo correction constant Ksc converge.
• the calculated albedo correction constant (Ksc) and geometry constant (Kac) can be used for producing in real time absorption spectral images 160 and scattering spectral images 162, or corrected albedo spectral images 1 10, respectively.
• the intensity calibration algorithm can be used with any light transport model such as diffusion approximation, a Monte Carlo generated look up table, or other light transport models.
• the calculated albedo correction constant (Ksc) and geometry constant (Kac) are used for producing in real time corrected absorption spectral images 162 and scattering spectral images 160 (arrowhead dash lined path 255 of FIG. 1 3).
• the intensity calibration algorithm generates only corrected albedo spectral images 1 1 0, along the full spectral range without the use of any priori information.
• Rapid inversion algorithm 300 quantifies the related physiological and morphological properties 170, 172 from the absorption and scattering spectral images 160, 162 using linear matrix inversion scheme 350, and intrinsic spectra of tissue absorption
• FIG 14a illustrates an alternative rapid inversion algorithm 300.
• Rapid inversion algorithm 300 quantifies the related physiological and morphological properties 1 30, 132 from the corrected albedo spectral images 1 10 using linear matrix inversion scheme 350 and intrinsic spectra of tissue absorption
• the physiological images/maps that are generated can include an oxygenated hemoglobin concentration image, a de-oxygenation hemoglobin image, a total hemoglobin concentration, and/or a tissue water volume image for example.
• the morphological images that can be generated can include a scattering volume image, a mucosa layer thickness image, and a specific scattering particles volume fraction (such as nucleus volume fraction).
• linear matrix inversion implementation can allow use of a parallel processing (such as GPU) more efficiently.
• parallel processing such as GPU
• Cm is the m quantified physiological property
• l C m ( A n ) is the intrinsic spectra of the chromophore m at h n
• [iac(x n ) is the corrected absorption coefficient at ⁇ ⁇ .
• the rapid inverse algorithm can take the absorption and/or scattering spectral images as inputs, and using the linear matrix inversion scheme and the intrinsic spectra of certain tissue chromophores and scattering particles, can generate a rapid mapping of certain physiological and/or
• FIG. 15 shows only one example of the resultant images such as, (a) oxygenation Image, (b) blood volume fraction image, (c) total scattering particles volume fraction image, and (d) detailed scattering particle volume fraction images (e.g. nucleus volume fraction), obtained during the rapid multispectral imaging.
• the obtained multiple physiological and morphological images can be used for cancer detection and localization and tumor margin delineation, which in turn will benefit to therapy planning and monitoring.

Landscapes

• Health & Medical Sciences (AREA)
• Life Sciences & Earth Sciences (AREA)
• Physics & Mathematics (AREA)
• Surgery (AREA)
• Engineering & Computer Science (AREA)
• General Health & Medical Sciences (AREA)
• Pathology (AREA)
• Medical Informatics (AREA)
• Heart & Thoracic Surgery (AREA)
• Veterinary Medicine (AREA)
• Public Health (AREA)
• Biophysics (AREA)
• Animal Behavior & Ethology (AREA)
• Optics & Photonics (AREA)
• Molecular Biology (AREA)
• Biomedical Technology (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Radiology & Medical Imaging (AREA)
• Spectroscopy & Molecular Physics (AREA)
• General Physics & Mathematics (AREA)
• Signal Processing (AREA)
• Multimedia (AREA)
• Microelectronics & Electronic Packaging (AREA)
• Chemical & Material Sciences (AREA)
• Analytical Chemistry (AREA)
• Biochemistry (AREA)
• Immunology (AREA)
• Evolutionary Computation (AREA)
• Artificial Intelligence (AREA)
• Endoscopes (AREA)
• Investigating Or Analysing Materials By Optical Means (AREA)

Priority Applications (9)

Applications Claiming Priority (2)

Related Child Applications (2)

Publications (1)

Family

ID=44648397

Family Applications (1)

Country Status (9)

Cited By (23)

Families Citing this family (126)

Citations (4)

Family Cites Families (29)

• 2011
  • 2011-03-17 BR BR112012023287A patent/BR112012023287A2/pt not_active IP Right Cessation
  • 2011-03-17 WO PCT/CA2011/050148 patent/WO2011113162A1/en not_active Ceased
  • 2011-03-17 EP EP11755609.2A patent/EP2547992A4/en not_active Ceased
  • 2011-03-17 JP JP2012557365A patent/JP2013521900A/ja active Pending
  • 2011-03-17 US US13/635,682 patent/US9654745B2/en active Active
  • 2011-03-17 AU AU2011229113A patent/AU2011229113A1/en not_active Abandoned
  • 2011-03-17 CA CA2793449A patent/CA2793449A1/en not_active Abandoned
  • 2011-03-17 RU RU2012143821/28A patent/RU2012143821A/ru not_active Application Discontinuation
  • 2011-03-17 CN CN201180024411.9A patent/CN102893137B/zh active Active
• 2017
  • 2017-04-11 US US15/485,132 patent/US20170223316A1/en not_active Abandoned

Patent Citations (4)

Non-Patent Citations (3)

Also Published As

Similar Documents

Legal Events