CA2453585A1 - Multi-wavelength imaging of highly turbid media - Google Patents
Multi-wavelength imaging of highly turbid media Download PDFInfo
- Publication number
- CA2453585A1 CA2453585A1 CA002453585A CA2453585A CA2453585A1 CA 2453585 A1 CA2453585 A1 CA 2453585A1 CA 002453585 A CA002453585 A CA 002453585A CA 2453585 A CA2453585 A CA 2453585A CA 2453585 A1 CA2453585 A1 CA 2453585A1
- Authority
- CA
- Canada
- Prior art keywords
- images
- image
- generate
- wavelengths
- color
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 29
- 238000000034 method Methods 0.000 claims abstract description 55
- 230000003287 optical effect Effects 0.000 claims description 22
- 238000010521 absorption reaction Methods 0.000 claims description 16
- 210000000481 breast Anatomy 0.000 claims description 12
- 238000009877 rendering Methods 0.000 claims description 9
- 238000012634 optical imaging Methods 0.000 claims description 7
- 238000012935 Averaging Methods 0.000 claims description 4
- 230000002123 temporal effect Effects 0.000 claims description 4
- 238000012545 processing Methods 0.000 claims description 2
- 238000001514 detection method Methods 0.000 claims 2
- 210000001519 tissue Anatomy 0.000 description 50
- 230000000762 glandular Effects 0.000 description 12
- 238000004040 coloring Methods 0.000 description 11
- 230000004927 fusion Effects 0.000 description 11
- 210000000577 adipose tissue Anatomy 0.000 description 10
- 210000004369 blood Anatomy 0.000 description 9
- 239000008280 blood Substances 0.000 description 9
- 241000270295 Serpentes Species 0.000 description 6
- 230000001419 dependent effect Effects 0.000 description 6
- 238000001228 spectrum Methods 0.000 description 6
- 206010028980 Neoplasm Diseases 0.000 description 5
- 230000000694 effects Effects 0.000 description 5
- 230000003211 malignant effect Effects 0.000 description 5
- 238000009607 mammography Methods 0.000 description 5
- 239000003086 colorant Substances 0.000 description 4
- 238000002474 experimental method Methods 0.000 description 4
- 238000001727 in vivo Methods 0.000 description 4
- 238000002834 transmittance Methods 0.000 description 4
- XLYOFNOQVPJJNP-UHFFFAOYSA-N water Substances O XLYOFNOQVPJJNP-UHFFFAOYSA-N 0.000 description 4
- 201000009030 Carcinoma Diseases 0.000 description 3
- 230000008901 benefit Effects 0.000 description 3
- 230000008859 change Effects 0.000 description 3
- 230000004069 differentiation Effects 0.000 description 3
- 239000000203 mixture Substances 0.000 description 3
- 230000002159 abnormal effect Effects 0.000 description 2
- 230000033115 angiogenesis Effects 0.000 description 2
- 230000007423 decrease Effects 0.000 description 2
- 238000012631 diagnostic technique Methods 0.000 description 2
- 210000003743 erythrocyte Anatomy 0.000 description 2
- 238000011156 evaluation Methods 0.000 description 2
- 150000002632 lipids Chemical class 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 238000005259 measurement Methods 0.000 description 2
- 230000008569 process Effects 0.000 description 2
- 230000001902 propagating effect Effects 0.000 description 2
- 206010001233 Adenoma benign Diseases 0.000 description 1
- 208000007659 Fibroadenoma Diseases 0.000 description 1
- 230000005856 abnormality Effects 0.000 description 1
- 239000002870 angiogenesis inducing agent Substances 0.000 description 1
- 201000003149 breast fibroadenoma Diseases 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 239000002131 composite material Substances 0.000 description 1
- 239000000470 constituent Substances 0.000 description 1
- 238000007796 conventional method Methods 0.000 description 1
- 230000001934 delay Effects 0.000 description 1
- 238000011161 development Methods 0.000 description 1
- 230000018109 developmental process Effects 0.000 description 1
- 238000007435 diagnostic evaluation Methods 0.000 description 1
- 235000014113 dietary fatty acids Nutrition 0.000 description 1
- 230000009977 dual effect Effects 0.000 description 1
- 229930195729 fatty acid Natural products 0.000 description 1
- 239000000194 fatty acid Substances 0.000 description 1
- 150000004665 fatty acids Chemical class 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 108010036302 hemoglobin AS Proteins 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 230000010354 integration Effects 0.000 description 1
- 238000011835 investigation Methods 0.000 description 1
- 238000013507 mapping Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000004660 morphological change Effects 0.000 description 1
- 238000006213 oxygenation reaction Methods 0.000 description 1
- 230000008447 perception Effects 0.000 description 1
- 230000002093 peripheral effect Effects 0.000 description 1
- 230000010287 polarization Effects 0.000 description 1
- 230000000644 propagated effect Effects 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 230000007480 spreading Effects 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
- 238000003325 tomography Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
- 238000000411 transmission spectrum Methods 0.000 description 1
- 230000005747 tumor angiogenesis Effects 0.000 description 1
- 230000007998 vessel formation Effects 0.000 description 1
- 238000012800 visualization Methods 0.000 description 1
Classifications
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/0059—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
- A61B5/0082—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
- A61B5/0091—Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for mammography
-
- A—HUMAN NECESSITIES
- A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
- A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
- A61B5/00—Measuring for diagnostic purposes; Identification of persons
- A61B5/43—Detecting, measuring or recording for evaluating the reproductive systems
- A61B5/4306—Detecting, measuring or recording for evaluating the reproductive systems for evaluating the female reproductive systems, e.g. gynaecological evaluations
- A61B5/4312—Breast evaluation or disorder diagnosis
Landscapes
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- Medical Informatics (AREA)
- Molecular Biology (AREA)
- Veterinary Medicine (AREA)
- Biophysics (AREA)
- Pathology (AREA)
- Engineering & Computer Science (AREA)
- Biomedical Technology (AREA)
- Heart & Thoracic Surgery (AREA)
- Public Health (AREA)
- Physics & Mathematics (AREA)
- Surgery (AREA)
- Animal Behavior & Ethology (AREA)
- General Health & Medical Sciences (AREA)
- Gynecology & Obstetrics (AREA)
- Reproductive Health (AREA)
- Investigating Or Analysing Materials By Optical Means (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Spectrometry And Color Measurement (AREA)
- Image Processing (AREA)
Abstract
In a method of multi-wavelength imaging internal structures of a highly turbid medium, the internal structures are imaged at each one of a set of at least two predetermined wavelengths, to generate a corresponding set of respective images. The set of images are then merged to generate a corresponding fused image.
Description
MULTI-WAVELENGTH IMAGING OF HIGHLY TURBID MEDIA
TECHNICAL FIELD
The present invention relates to imaging of turbid media, and in particular to mufti-wavelength imaging of turbid media.
BACKGROUND OF THE INVENTION
Optical imaging of turbid media typically involves launching light into the media: detecting light emerging from the media; and analysing the detected light to infer the presence and/or properties of internal physical structures within the media. Current interest in optical imaging of turbid media stems from the need for biomedical diagnostic techniques that are safe and non-invasive. The optical properties of biological tissues are at the heart of optically based biomedical diagnostic techniques. As in the general case of any turbid medium, the manner in which light propagates through biological tissue depends on its absorption and scattering properties. In general, when the absorption and/or scattering of light traversing abnormal tissue differs from that in normal tissue (e.g. due to physiological or morphological changes resulting from the abnormality), it may be possible to optically differentiate between normal and abnormal conditions. A specific application of this concept is optical mammography, in which tumors may be differentiated from normal breast tissue on the basis of optical properties.
Biomedical optical imaging is based on the fact that the propagation of light in a turbid medium (such as biological tissue) depends on the absorption and scattering properties of the medium. Absorption results from energy level SUBSTITUTE SHEET (RULE 26) - z -transitions of the constituent atoms and molecules in the medium. It is dependent on the material as well as the probing wavelength. Scattering results from variations in the index of refraction of the different structures present in the medium. It is dependent on the index of refraction of the structures at the probing wavelength, as well as the relative size of the structures with respect to the probing wavelength. Characteristics such as intensity, coherence and polarization of the incident light change as it is absorbed and scattered by the medium resulting in diffuse transmittance of the light. In particular, scattering causes a collimated laser beam to spread over a sizeable volume element, which complicates the imaging of a turbid medium.
The trajectory of a photon propagating inside a scattering medium can be predicted only on a statistical basis. In addition to the probability of being absorbed, the photons are subject to numerous scattering events, as shown in Fig.
1. In a slab medium that is highly scattering and weakly absorbing, such as the human breast, most photons are reflected back toward to the entrance surface after traveling only a few millimeters in the tissue. Other photons are absorbed by the medium or transmitted to the output surface where they can be detected. In the case of a typical breast thickness and optical parameters, 0.01 to to of incident photons are transmitted to the output surface.
The transmitted photons can be separated into three categories: ballistic photons that reach the output surface without being scattered; snake photons that are scattered slightly, but maintain an approximately rectilinear trajectory; and diffuse photons that are widely scattered SUBSTITUTE SHEET (RULE 26) and cover a considerable volume element before emerging.
Exemplary trajectories followed by each of these three categories of photons are illustrated in Fig. 1.
Ballistic photons do not experience any scattering and therefore have the potential to produce a very clear image of the interior of highly turbid media such as biological tissues. Unfortunately, in many cases (e. g. for typical breast thickness and optical parameters), insufficient ballistic photons are transmitted for imaging purposes.
Snake photons have an approximately rectilinear trajectory, and are sufficient in number to produce a relatively clear image. Snake photons can be differentiated from diffuse photons by.their arrival time at the output surface. When a light pulse is injected into the turbid medium at the entrance surface, its component photons separate and propagate along different trajectories. The photons traveling the shortest distance (i.e. the snake photons) arrive at the output surface with the shortest propagation delay, and are thus detected before the diffuse photons, whose trajectories are longer. Thus the snake photons can be isolated by their shorter arrival time at the detector and used to construct an image. The development of this technique, known as "time gating", caused resurgence in interest in optical mammography in the early 1990s.
As will be appreciated, time-gating involves a time-domain analysis of light received by a detector. For the purposes of biomedical imaging, such time-domain analysis and imaging is preferably based on the Temporal Point Spread Function (TPSF) of light propagating through a tissue sample (or any other turbid medium). As is known in the art, the TPSF describes the temporal divergence experienced by an ultra-short pulse of light as it propagates through a SUBSTITUTE SHEET (RULE 26) scattering medium. Thus, as shown in FIG.I~ 1, photons of the light pulse follow different paths through the medium, and consequently experience differing propagation delays.
The result is a spreading of the light pulse, in the time domain, as the pulse propagates through the medium.
Evaluation of the TPSF of the pulse arriving at a detector facilitates evaluation of the absorption and scattering optical parameters of the medium, as well as attenuation.
Additionally, snake-photons can be detected and used for imaging physical structures within the medium.
Typically, three parameters are defined to describe the optical properties of scattering media such as biological tissues: an absorption coefficient (~a); a scattering coefficient (~,s); and an anisotropy factor (g). The absorption coefficient (~,a) represents the probability of a photon being absorbed per unit of length. The scattering coefficient (~.s) represents the probability of the photon being scattered per unit of length. Finally, the anisotropy factor (g) describes the average change in propagation direction associated with the scattering process.
In addition to the above three parameters, it is often useful to define a "reduced scattering coefficient" (~.s' -~s(1-g)) which represents the average distance over which a photon sustains a sufficient number of scattering events to randomize its direction of propagation. The reduced scattering coefficient (~.s') is the isotropic equivalent of the scattering coefficient (~.s), and is particularly suitable in the case of thick tissue. The quantities (~.a) and (~s') are the two optical parameters generally used in highly turbid media.
SUBSTITUTE SHEET (RULE 26) In biomedical optical imaging, two types of images can be generated: 3D reconstructed images and 2D projection images. 3D reconstructed images are produced using tomography, which is typically based on a multi-point geometry involving a large number of detectors. Its advantage is that 3D images are generated. However, measurements and reconstructions are potentially time-consuming. 2D projection images are generated by scanning a small cross-section laser beam across an input surface, and detecting light emerging from a small area of the output surface as shown in Fig. 2. This scanning technique has the advantage that it is fast and compatible with time-resolved measurements (e.g. the use of time gating to detect snake photons). However, information is limited to two dimensions, the detected light giving information about a volume extending over the whole line-of-sight joining the input point of the laser beam and the detector. This is illustrated in Fig. 2, where the shaded region within the dotted lines represents the volume through which detected photons have most likely propagated. The shape of this volume can be understood by considering that all photons enter the scattering medium -at the same point and all detected photons leave it through a small area facing the detector. On the other hand, scattering allows detected photons to wander away from the direct line-of-sight joining the laser source and the detector, this wandering being maximum at the half-distance between the two.
Longitudinal information may be obtained in such a configuration by scanning the detector position or virtually by using method such as Dual Spatial Integration (DST) or Multiple Field-Of-View (MFOV) techniques.
SUBSTITUTE SHEET (RULE 26) As mentioned above, both scattering and absorption of photons are highly wavelength-dependent. In addition, time-gating imaging techniques require a short input optical pulse having a very sharp leading edge. As a result, conventional techniques for imaging highly turbid media utilize a laser to generate the input pulse. Such a laser generates light characterized by a very narrow range of wavelengths, all of which experience substantially identical scattering and absorption within the turbid media. A disadvantage of this arrangement is that the optical properties of most turbid media (and biological tissues in particular) are highly wavelength-dependent.
Normally, the laser is tuned such that the input optical pulse will experience minimum scattering within the media, and therefore maximize the amount of light available to the detector. However, in so doing, at least some information about the internal structure of the media is lost.
Accordingly, a technique for maximizing the quality of an image of a highly turbid medium, by utilizing multiple wavelengths, remains highly desirable.
SUNa~ARY OF THE INVENTION
An object of the present invention is to provide a method of multi-wavelength imaging of highly turbid media.
Thus the present invention provides a method of multi-wavelength imaging internal structures of a highly turbid medium. According to the invention, the internal structures are imaged at each one of a set of at least two predetermined wavelengths, to generate a corresponding set of respective images. The set of images are then merged to generate a corresponding fused image.
SUBSTITUTE SHEET (RULE 26) _7_ Multi-wavelength imaging in accordance with the present invention provides a tool to improve inclusion differentiation in a highly turbid medium. Specifically, several wavelengths can be used to produce a corresponding number of images of the highly turbid media, and the images subsequently combined. For optical mammography, two strategies may usefully be employed; the first strategy uses two wavelengths (e.g. 755 and 800 nm); while the second strategy uses four wavelengths (e.g. 755, 800, 930 and 975 nm). A conventional KL transform may be used to obtain the three main components of the set of images, and then pseudo-color techniques can be used to combine all the of the information in a single composite image.
BRIEF DESCRIPTION OF THE DRAWINGS
l5 Further features and advantages of the present invention will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
Fig. 1 illustrates typical trajectories for three categories of photons transmitted through a scattering medium;
Fig. 2 illustrates a scanning system for imaging through turbid media;
Fig. 3 illustrates the transmission spectra of adipose tissue (blue), glandular tissue (green);
Fig. 4 illustrates the transmittance (o) of cancerous (black) and glandular (green) breast tissue;
SUBSTITUTE SHEET (RULE 26) _ g _ Fig. 5 illustrates the image difference technique that combines two images acquired at distinct wavelengths to enhance features that are only visible in one image;
Fig. 6 illustrates the pseudo-coloring technique that combines three images into one color image where features are colored according to their intensity in the input images;
Figs. 7A-F illustrates the image fusion results of three scans of a tissue phantom simulating different wavelengths (Figs. 7A-C), using image difference (Fig. 7D), pseudo-coloring (Fig. 7E) and the KL transform (Fig. 7F); and Figs. 8 illustrates the image fusion results of two in vivo scans of a human breast acquired at different wavelengths (Figs. 8A-B), using image difference (Fig. 8C), pseudo-coloring (Fig. 8D) and the KL transform (Fig. 8E).
It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
The present invention provides a method for multi wavelength imaging of highly turbid media. For the purposes of description, the present invention is described in detail by way of an example that is optimized for mammography. It will be appreciated, however, that the present invention can equally be applied for imaging of any turbid media. Thus it will be understood that the examples described below are in no way limitative of the scope of the present invention.
As mentioned above, the optical properties of turbid media, and in particular biological tissues, vary differently with SUBSTITUTE SHEET (RULE 26) _ g _ wavelength, depending on their composition. By suitable selection of two or more wavelengths, this differing wavelength dependency can be exploited to enhance contrast between different tissue types and improve tissue recognition. By combining the images produced at each wavelength, internal features can be accentuated, resulting in improved optical contrast, tissue differentiation, and better tissue identification. As may be appreciated, the specific wavelengths used in a particular application will preferably be selected based on the optical characteristics of the turbid media under investigation, and any particular inclusions (i.e. internal structures) that are of particular interest.
For example, in optical mammography, it is desirable to distinguish the two major breast tissue types (glandular and adipose), and distinguish healthy and cancerous tissue.
Glandular and adipose tissues are easily distinguished spectroscopically. In particular, glandular tissue has a large water component and its spectrum largely mimics that of water, while adipose tissue is composed largely of lipids, which are derived from fatty acids, with a smaller water component.
Spectra of adipose and glandular tissues are shown in Fig.
3. It should be emphasized that Fig. 3 serves only to illustrate relative peak positions with respect to wavelength. The level of attenuation cannot be used, even qualitatively, as its value for a given sample at any wavelength is dependent on sample thickness and scattering property. Two main features can be observed by examination of the tissue spectra. One is the constancy of the transmittance between 610-925 nm in the adipose tissue compared to the gradual decrease in transmittance observed SUBSTITUTE SHEET (RULE 26) over the same range in glandular tissue. Another is that a peak at 930 nm is observed in adipose tissue due to C-H
bonding in lipids that is not observed in glandular tissue, whereas a water peak at 975 nm is seen with the glandular tissue but not the adipose tissue.
Thus it will be seen that imaging breast tissues at 975nm will emphasize glandular tissues, while adipose tissues will be detected at an imaging wavelength of 930nm.
Alternatively, the invariance of the optical properties of adipose tissue between 925 nm and 610 nm could also be exploited. In this case, multi-wavelength or subtraction imaging (as described below) would be used to differentiate adipose from other tissue types.
As is known in the art, the growth of cancerous tissues are associated with a number of effects in the host tissue.
One such effect is angiogenesis, which refers to new blood vessel formation and growth induced in the host tissue by release of Tumor Angiogenesis Factor (TAF) by the tumor.
This hypervascularity is especially pronounced in the zone immediately surrounding the tumor, as may be seen in Table 1 below.
Tissue Normal 4,2 Fibroadenoma 5.4 Carcinoma (tumor) 4.9 ,Carcinoma (edge) 16.0 Peripheral (tissue immediately 9.2 surrounding carcinoma) Table 1: Average red blood cell concentration (RBC) in various tissues SUBSTITUTE SHEET (RULE 26) This effect can be exploited in optical imaging by using an absorption peak of haemoglobin as an imaging wavelength.
The isobestic point of haemoglobin, 800nm, is the wavelength at which the absorption coefficients of oxygenated haemoglobin (Hb02) and deoxygenated haemoglobin (Hb) and are equal, and thus gives an indication of overall haemoglobin (and thus blood) content in the tissue.
Deoxygenated haemoglobin (Hb) has a weak absorption band at 755 nm. Additionally, a slightly lower degree of oxygenation has been observed (in vivo) in tumors than in healthy tissue. In fact, it is possible to define a 2-dimentional space in which HbO~/Hb and total blood are plotted on orthogonal axes. Malignant tissues have been found to occupy a very specific area in this oxy/deoxy-total blood volume space. Accordingly, combining images - produced at 755 nm and 800 nm wavelengths, respectively, can be used to exploit the effect of angiogenesis and the elevated concentration of Hb to accentuate the contrast between cancerous and normal tissue.
Fig. 4 shows spectra for two tissue samples with oxygenated and deoxygenated haemoglobin, respectively. As with the spectra of FIG. 3, these spectra have not been corrected for thickness and serve only to illustrate peak positioning along the wavelength axis.
It should be noted that, in all cases, it is the absorption properties that are used to differentiate tissue types.
This is because the magnitude of the scattering coefficient slowly decreases with increasing wavelength, independently of tissue type, whereas the absorption coefficient is dependent on tissue composition.
SUBSTITUTE SHEET (RULE 26) In accordance with the present invention, images generated using different wavelengths are combined into a single color image that enhances the available information. This type of data processing may also be referred to as "image fusion". Three alternative techniques of image fusion may be used, namely: image difference; pseudo-coloring; and KL
transform.
Image difference refers to a technique in 'which one image is subtracted from another, on a pixel-by-pixel basis, to obtain a final image. Any features that are visible at only one wavelength, that is, they only appear in one image, will also be seen in the final fused image.
Conversely, any features that are common to both images are subtracted out, and thus will not be seen in the fused image. The image difference technique is therefore particularly useful for identifying differences between the two images.
In practice, each image is rendered as a variable-intensity mono-chromatic (e. g. 8-bit grey-scale) image. A simple pixel-by-pixel difference calculation can then be performed, and the resultant values corrected to fit a desired range (e.g. 256 grey levels) for display on a monitor. If desired, a color map, which correlates the numbered grey levels to a given set of colors, can be used to convert the result to a color image.
A simple variation of the image-difference technique is to use image averaging, in which the intensity of each pixel of the fused image is calculated as an average of the intensities of corresponding pixels in each of the (two or more) source images, while the image differences are color coded.
SUBSTITUTE SHEET (RULE 26) The pseudo-coloring technique can be used to combine three images into a single fused color image. With this technique, each image is rendered as a variable intensity mono-chromatic image in a respective one of the three primary display colors (i.e. Red, Green and Blue). For example, the image corresponding to wavelength 1 can be rendered in variable-intensity mono-chromatic red, with each pixel being assigned an (e. g. 8-bit) intensity level.
In the same manner, the images from wavelengths 2 and 3 may be rendered in mono-chromatic green and blue respectively, with their features assigned appropriate intensities. With this arrangement, the three images provide the Red, Green and Blue components of a conventional 24-bit/pixel RGB
color display image. As such, the images may readily be combined, or fused, into one color image on-screen, in which features are colored according to the resultant mix of the three primary colors. For example, a feature apparent in the red and green images, but not apparent in the blue image would appear as a shade of yellow in the fused image. Note that if only two wavelengths are being considered, two primary colors are used and every pixel of the third color is set to zero (or black), so as not to interfere with the generation of the fused image.
As mentioned above, malignant tissues have been found to occupy a very specific area in an oxy/deoxy-total blood volume space. Accordingly, the pseudo-coloring technique can be used to closely identify the presence and location of malignant tissues. In particular, by generating a set of images at 755 nm (deoxygenated haemoglobin - Hb), 800 nm (total blood) , each pixel of the fused image will map to a specific location in the oxy/deoxy-total blood volume space. Pixels that map into the region known to be SUBSTITUTE SHEET (RULE 26) associated with malignant tissues can then be highlighted on the display monitor.
The final image fusion technique uses the KL transform, which was originally introduced as a series expansion for continuous random processes by Karhunun and Loeve. It is also known as the method of principal components and is ideal for treating a number of images as an ensemble.
The KL transform works as follows. Assume there are N
images of P pixels each, acquired at respective different wavelengths, which are written as vector components v1...
vN. The NxN auto-correlation matrix of the images, R, is computed by the following equation:
R~i~~.7~= l, ~,va~*~°;~~
where i, j E [1,N].
The Jacobi algorithm is used to compute the N eigenvalues and eigenvectors of the auto-correlation matrix R. Then, the eigenvectors V1...VN are sorted according to the corresponding eigenvalues Dl...DN.
The KL transformation consist of a cross-product of the sorted eigenvectors V1...VN with the original images v1...
vN such that a new set of images kl...kN of P pixels each is obtained:
Y » ~i ~ * ~°a~
255 ;., where n e,[1,N] and pE [1,p]
The N transformed images are uncorrelated. Moreover, the set of transformed images is arranged in descending order SUBSTITUTE SHEET (RULE 26) of energy. Typically, the first three images k1, k2, k3 describe over 950 of the N original images. This property makes the first three images obtained from the KL transform suitable candidates for image fusion with the pseudo coloring technique.
The final step therefore consists of rendering each of the three images k1, k2, k3 in a respective primary color, and then combining the three colored images on-screen to produce the final fused image. If desired, the conventional LUV color system can be used (rather than RGB) to optimize the average human perception sensitivity to small color differences. Furthermore, image enhancement by histogram equalization in a manner known in the art can also be carried out.
Results from two sets of experiments are presented here, they compare the three image fusion techniques presented previously with synthetic phantoms and in a in vivo situation.
The first experiment was based on three scans of a tissue phantom containing three inclusions of different optical properties. Between each scan, the positions of the inclusions were inverted to simulate the effect of a change in wavelength. The image difference, the pseudo-coloring and the KL transform techniques were applied to the images obtained. Results of these tests, presented in Fig. 7, clearly demonstrate the improvement in inclusion differentiation and efficient data reduction technique. We notice that KL transform is particularly well adapted to mufti-wavelength imaging.
The second experiment started with the acquisition of in vivo scans from a human breast at two wavelengths (753 and SUBSTITUTE SHEET (RULE 26) 800 nm). Images were then processed using the image difference, the pseudo-coloring and the KL transform techniques. Fig. 8 presents the image fusion results obtained from the two scans. A color map has been applied to the difference images (pixel difference increases from blue to green, to yellow, then orange and finally red). As in the previous experiment, the fusion provides highlights of the image's specificity, bringing more information in a single image.
The KL transform method for image fusion, used as described previously, gives the most useful results for global visualization of mufti-wavelength images. The fused color image obtained with this technique improves the contrast between the features of the input images. However, the color image obtained with the KL transform is generally less natural to the human eye that the one obtained with the pseudo-coloring technique.
As may be appreciated, the above-noted image fusion techniques may be used in combination, in order to highlight certain aspects of an image and/or as an aid to diagnostic evaluation. For example, if desired, fused images generated by the image difference and image averaging techniques may themselves be combined using the pseudo-coloring technique. In this example, a breast may be imaged at 930nm and 975nm, and these images combined using the image difference technique to highlight glandular and adipose tissue structures. The breast may then be imaged at 755 nm and 800 nm to determine a pixel location in the oxy/deoxy-total blood volume space. These results can then be combined into a single image by assigning, for example, Red to. the average image highlighting total blood;
Green to the difference image highlighting glandular and SUBSTITUTE SHEET (RULE 26) adipose tissue; and Blue to the result of mapping to the oxy/deoxy-total blood volume space, and highlighting malignant tissue.
The embodiments) of the invention described above is(are) intended to be exemplary only. The scope of the invention is therefore intended to be limited solely by the scope of the appended claims.
SUBSTITUTE SHEET (RULE 26)
TECHNICAL FIELD
The present invention relates to imaging of turbid media, and in particular to mufti-wavelength imaging of turbid media.
BACKGROUND OF THE INVENTION
Optical imaging of turbid media typically involves launching light into the media: detecting light emerging from the media; and analysing the detected light to infer the presence and/or properties of internal physical structures within the media. Current interest in optical imaging of turbid media stems from the need for biomedical diagnostic techniques that are safe and non-invasive. The optical properties of biological tissues are at the heart of optically based biomedical diagnostic techniques. As in the general case of any turbid medium, the manner in which light propagates through biological tissue depends on its absorption and scattering properties. In general, when the absorption and/or scattering of light traversing abnormal tissue differs from that in normal tissue (e.g. due to physiological or morphological changes resulting from the abnormality), it may be possible to optically differentiate between normal and abnormal conditions. A specific application of this concept is optical mammography, in which tumors may be differentiated from normal breast tissue on the basis of optical properties.
Biomedical optical imaging is based on the fact that the propagation of light in a turbid medium (such as biological tissue) depends on the absorption and scattering properties of the medium. Absorption results from energy level SUBSTITUTE SHEET (RULE 26) - z -transitions of the constituent atoms and molecules in the medium. It is dependent on the material as well as the probing wavelength. Scattering results from variations in the index of refraction of the different structures present in the medium. It is dependent on the index of refraction of the structures at the probing wavelength, as well as the relative size of the structures with respect to the probing wavelength. Characteristics such as intensity, coherence and polarization of the incident light change as it is absorbed and scattered by the medium resulting in diffuse transmittance of the light. In particular, scattering causes a collimated laser beam to spread over a sizeable volume element, which complicates the imaging of a turbid medium.
The trajectory of a photon propagating inside a scattering medium can be predicted only on a statistical basis. In addition to the probability of being absorbed, the photons are subject to numerous scattering events, as shown in Fig.
1. In a slab medium that is highly scattering and weakly absorbing, such as the human breast, most photons are reflected back toward to the entrance surface after traveling only a few millimeters in the tissue. Other photons are absorbed by the medium or transmitted to the output surface where they can be detected. In the case of a typical breast thickness and optical parameters, 0.01 to to of incident photons are transmitted to the output surface.
The transmitted photons can be separated into three categories: ballistic photons that reach the output surface without being scattered; snake photons that are scattered slightly, but maintain an approximately rectilinear trajectory; and diffuse photons that are widely scattered SUBSTITUTE SHEET (RULE 26) and cover a considerable volume element before emerging.
Exemplary trajectories followed by each of these three categories of photons are illustrated in Fig. 1.
Ballistic photons do not experience any scattering and therefore have the potential to produce a very clear image of the interior of highly turbid media such as biological tissues. Unfortunately, in many cases (e. g. for typical breast thickness and optical parameters), insufficient ballistic photons are transmitted for imaging purposes.
Snake photons have an approximately rectilinear trajectory, and are sufficient in number to produce a relatively clear image. Snake photons can be differentiated from diffuse photons by.their arrival time at the output surface. When a light pulse is injected into the turbid medium at the entrance surface, its component photons separate and propagate along different trajectories. The photons traveling the shortest distance (i.e. the snake photons) arrive at the output surface with the shortest propagation delay, and are thus detected before the diffuse photons, whose trajectories are longer. Thus the snake photons can be isolated by their shorter arrival time at the detector and used to construct an image. The development of this technique, known as "time gating", caused resurgence in interest in optical mammography in the early 1990s.
As will be appreciated, time-gating involves a time-domain analysis of light received by a detector. For the purposes of biomedical imaging, such time-domain analysis and imaging is preferably based on the Temporal Point Spread Function (TPSF) of light propagating through a tissue sample (or any other turbid medium). As is known in the art, the TPSF describes the temporal divergence experienced by an ultra-short pulse of light as it propagates through a SUBSTITUTE SHEET (RULE 26) scattering medium. Thus, as shown in FIG.I~ 1, photons of the light pulse follow different paths through the medium, and consequently experience differing propagation delays.
The result is a spreading of the light pulse, in the time domain, as the pulse propagates through the medium.
Evaluation of the TPSF of the pulse arriving at a detector facilitates evaluation of the absorption and scattering optical parameters of the medium, as well as attenuation.
Additionally, snake-photons can be detected and used for imaging physical structures within the medium.
Typically, three parameters are defined to describe the optical properties of scattering media such as biological tissues: an absorption coefficient (~a); a scattering coefficient (~,s); and an anisotropy factor (g). The absorption coefficient (~,a) represents the probability of a photon being absorbed per unit of length. The scattering coefficient (~.s) represents the probability of the photon being scattered per unit of length. Finally, the anisotropy factor (g) describes the average change in propagation direction associated with the scattering process.
In addition to the above three parameters, it is often useful to define a "reduced scattering coefficient" (~.s' -~s(1-g)) which represents the average distance over which a photon sustains a sufficient number of scattering events to randomize its direction of propagation. The reduced scattering coefficient (~.s') is the isotropic equivalent of the scattering coefficient (~.s), and is particularly suitable in the case of thick tissue. The quantities (~.a) and (~s') are the two optical parameters generally used in highly turbid media.
SUBSTITUTE SHEET (RULE 26) In biomedical optical imaging, two types of images can be generated: 3D reconstructed images and 2D projection images. 3D reconstructed images are produced using tomography, which is typically based on a multi-point geometry involving a large number of detectors. Its advantage is that 3D images are generated. However, measurements and reconstructions are potentially time-consuming. 2D projection images are generated by scanning a small cross-section laser beam across an input surface, and detecting light emerging from a small area of the output surface as shown in Fig. 2. This scanning technique has the advantage that it is fast and compatible with time-resolved measurements (e.g. the use of time gating to detect snake photons). However, information is limited to two dimensions, the detected light giving information about a volume extending over the whole line-of-sight joining the input point of the laser beam and the detector. This is illustrated in Fig. 2, where the shaded region within the dotted lines represents the volume through which detected photons have most likely propagated. The shape of this volume can be understood by considering that all photons enter the scattering medium -at the same point and all detected photons leave it through a small area facing the detector. On the other hand, scattering allows detected photons to wander away from the direct line-of-sight joining the laser source and the detector, this wandering being maximum at the half-distance between the two.
Longitudinal information may be obtained in such a configuration by scanning the detector position or virtually by using method such as Dual Spatial Integration (DST) or Multiple Field-Of-View (MFOV) techniques.
SUBSTITUTE SHEET (RULE 26) As mentioned above, both scattering and absorption of photons are highly wavelength-dependent. In addition, time-gating imaging techniques require a short input optical pulse having a very sharp leading edge. As a result, conventional techniques for imaging highly turbid media utilize a laser to generate the input pulse. Such a laser generates light characterized by a very narrow range of wavelengths, all of which experience substantially identical scattering and absorption within the turbid media. A disadvantage of this arrangement is that the optical properties of most turbid media (and biological tissues in particular) are highly wavelength-dependent.
Normally, the laser is tuned such that the input optical pulse will experience minimum scattering within the media, and therefore maximize the amount of light available to the detector. However, in so doing, at least some information about the internal structure of the media is lost.
Accordingly, a technique for maximizing the quality of an image of a highly turbid medium, by utilizing multiple wavelengths, remains highly desirable.
SUNa~ARY OF THE INVENTION
An object of the present invention is to provide a method of multi-wavelength imaging of highly turbid media.
Thus the present invention provides a method of multi-wavelength imaging internal structures of a highly turbid medium. According to the invention, the internal structures are imaged at each one of a set of at least two predetermined wavelengths, to generate a corresponding set of respective images. The set of images are then merged to generate a corresponding fused image.
SUBSTITUTE SHEET (RULE 26) _7_ Multi-wavelength imaging in accordance with the present invention provides a tool to improve inclusion differentiation in a highly turbid medium. Specifically, several wavelengths can be used to produce a corresponding number of images of the highly turbid media, and the images subsequently combined. For optical mammography, two strategies may usefully be employed; the first strategy uses two wavelengths (e.g. 755 and 800 nm); while the second strategy uses four wavelengths (e.g. 755, 800, 930 and 975 nm). A conventional KL transform may be used to obtain the three main components of the set of images, and then pseudo-color techniques can be used to combine all the of the information in a single composite image.
BRIEF DESCRIPTION OF THE DRAWINGS
l5 Further features and advantages of the present invention will become apparent from the following detailed description, taken in combination with the appended drawings, in which:
Fig. 1 illustrates typical trajectories for three categories of photons transmitted through a scattering medium;
Fig. 2 illustrates a scanning system for imaging through turbid media;
Fig. 3 illustrates the transmission spectra of adipose tissue (blue), glandular tissue (green);
Fig. 4 illustrates the transmittance (o) of cancerous (black) and glandular (green) breast tissue;
SUBSTITUTE SHEET (RULE 26) _ g _ Fig. 5 illustrates the image difference technique that combines two images acquired at distinct wavelengths to enhance features that are only visible in one image;
Fig. 6 illustrates the pseudo-coloring technique that combines three images into one color image where features are colored according to their intensity in the input images;
Figs. 7A-F illustrates the image fusion results of three scans of a tissue phantom simulating different wavelengths (Figs. 7A-C), using image difference (Fig. 7D), pseudo-coloring (Fig. 7E) and the KL transform (Fig. 7F); and Figs. 8 illustrates the image fusion results of two in vivo scans of a human breast acquired at different wavelengths (Figs. 8A-B), using image difference (Fig. 8C), pseudo-coloring (Fig. 8D) and the KL transform (Fig. 8E).
It will be noted that throughout the appended drawings, like features are identified by like reference numerals.
DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENT
The present invention provides a method for multi wavelength imaging of highly turbid media. For the purposes of description, the present invention is described in detail by way of an example that is optimized for mammography. It will be appreciated, however, that the present invention can equally be applied for imaging of any turbid media. Thus it will be understood that the examples described below are in no way limitative of the scope of the present invention.
As mentioned above, the optical properties of turbid media, and in particular biological tissues, vary differently with SUBSTITUTE SHEET (RULE 26) _ g _ wavelength, depending on their composition. By suitable selection of two or more wavelengths, this differing wavelength dependency can be exploited to enhance contrast between different tissue types and improve tissue recognition. By combining the images produced at each wavelength, internal features can be accentuated, resulting in improved optical contrast, tissue differentiation, and better tissue identification. As may be appreciated, the specific wavelengths used in a particular application will preferably be selected based on the optical characteristics of the turbid media under investigation, and any particular inclusions (i.e. internal structures) that are of particular interest.
For example, in optical mammography, it is desirable to distinguish the two major breast tissue types (glandular and adipose), and distinguish healthy and cancerous tissue.
Glandular and adipose tissues are easily distinguished spectroscopically. In particular, glandular tissue has a large water component and its spectrum largely mimics that of water, while adipose tissue is composed largely of lipids, which are derived from fatty acids, with a smaller water component.
Spectra of adipose and glandular tissues are shown in Fig.
3. It should be emphasized that Fig. 3 serves only to illustrate relative peak positions with respect to wavelength. The level of attenuation cannot be used, even qualitatively, as its value for a given sample at any wavelength is dependent on sample thickness and scattering property. Two main features can be observed by examination of the tissue spectra. One is the constancy of the transmittance between 610-925 nm in the adipose tissue compared to the gradual decrease in transmittance observed SUBSTITUTE SHEET (RULE 26) over the same range in glandular tissue. Another is that a peak at 930 nm is observed in adipose tissue due to C-H
bonding in lipids that is not observed in glandular tissue, whereas a water peak at 975 nm is seen with the glandular tissue but not the adipose tissue.
Thus it will be seen that imaging breast tissues at 975nm will emphasize glandular tissues, while adipose tissues will be detected at an imaging wavelength of 930nm.
Alternatively, the invariance of the optical properties of adipose tissue between 925 nm and 610 nm could also be exploited. In this case, multi-wavelength or subtraction imaging (as described below) would be used to differentiate adipose from other tissue types.
As is known in the art, the growth of cancerous tissues are associated with a number of effects in the host tissue.
One such effect is angiogenesis, which refers to new blood vessel formation and growth induced in the host tissue by release of Tumor Angiogenesis Factor (TAF) by the tumor.
This hypervascularity is especially pronounced in the zone immediately surrounding the tumor, as may be seen in Table 1 below.
Tissue Normal 4,2 Fibroadenoma 5.4 Carcinoma (tumor) 4.9 ,Carcinoma (edge) 16.0 Peripheral (tissue immediately 9.2 surrounding carcinoma) Table 1: Average red blood cell concentration (RBC) in various tissues SUBSTITUTE SHEET (RULE 26) This effect can be exploited in optical imaging by using an absorption peak of haemoglobin as an imaging wavelength.
The isobestic point of haemoglobin, 800nm, is the wavelength at which the absorption coefficients of oxygenated haemoglobin (Hb02) and deoxygenated haemoglobin (Hb) and are equal, and thus gives an indication of overall haemoglobin (and thus blood) content in the tissue.
Deoxygenated haemoglobin (Hb) has a weak absorption band at 755 nm. Additionally, a slightly lower degree of oxygenation has been observed (in vivo) in tumors than in healthy tissue. In fact, it is possible to define a 2-dimentional space in which HbO~/Hb and total blood are plotted on orthogonal axes. Malignant tissues have been found to occupy a very specific area in this oxy/deoxy-total blood volume space. Accordingly, combining images - produced at 755 nm and 800 nm wavelengths, respectively, can be used to exploit the effect of angiogenesis and the elevated concentration of Hb to accentuate the contrast between cancerous and normal tissue.
Fig. 4 shows spectra for two tissue samples with oxygenated and deoxygenated haemoglobin, respectively. As with the spectra of FIG. 3, these spectra have not been corrected for thickness and serve only to illustrate peak positioning along the wavelength axis.
It should be noted that, in all cases, it is the absorption properties that are used to differentiate tissue types.
This is because the magnitude of the scattering coefficient slowly decreases with increasing wavelength, independently of tissue type, whereas the absorption coefficient is dependent on tissue composition.
SUBSTITUTE SHEET (RULE 26) In accordance with the present invention, images generated using different wavelengths are combined into a single color image that enhances the available information. This type of data processing may also be referred to as "image fusion". Three alternative techniques of image fusion may be used, namely: image difference; pseudo-coloring; and KL
transform.
Image difference refers to a technique in 'which one image is subtracted from another, on a pixel-by-pixel basis, to obtain a final image. Any features that are visible at only one wavelength, that is, they only appear in one image, will also be seen in the final fused image.
Conversely, any features that are common to both images are subtracted out, and thus will not be seen in the fused image. The image difference technique is therefore particularly useful for identifying differences between the two images.
In practice, each image is rendered as a variable-intensity mono-chromatic (e. g. 8-bit grey-scale) image. A simple pixel-by-pixel difference calculation can then be performed, and the resultant values corrected to fit a desired range (e.g. 256 grey levels) for display on a monitor. If desired, a color map, which correlates the numbered grey levels to a given set of colors, can be used to convert the result to a color image.
A simple variation of the image-difference technique is to use image averaging, in which the intensity of each pixel of the fused image is calculated as an average of the intensities of corresponding pixels in each of the (two or more) source images, while the image differences are color coded.
SUBSTITUTE SHEET (RULE 26) The pseudo-coloring technique can be used to combine three images into a single fused color image. With this technique, each image is rendered as a variable intensity mono-chromatic image in a respective one of the three primary display colors (i.e. Red, Green and Blue). For example, the image corresponding to wavelength 1 can be rendered in variable-intensity mono-chromatic red, with each pixel being assigned an (e. g. 8-bit) intensity level.
In the same manner, the images from wavelengths 2 and 3 may be rendered in mono-chromatic green and blue respectively, with their features assigned appropriate intensities. With this arrangement, the three images provide the Red, Green and Blue components of a conventional 24-bit/pixel RGB
color display image. As such, the images may readily be combined, or fused, into one color image on-screen, in which features are colored according to the resultant mix of the three primary colors. For example, a feature apparent in the red and green images, but not apparent in the blue image would appear as a shade of yellow in the fused image. Note that if only two wavelengths are being considered, two primary colors are used and every pixel of the third color is set to zero (or black), so as not to interfere with the generation of the fused image.
As mentioned above, malignant tissues have been found to occupy a very specific area in an oxy/deoxy-total blood volume space. Accordingly, the pseudo-coloring technique can be used to closely identify the presence and location of malignant tissues. In particular, by generating a set of images at 755 nm (deoxygenated haemoglobin - Hb), 800 nm (total blood) , each pixel of the fused image will map to a specific location in the oxy/deoxy-total blood volume space. Pixels that map into the region known to be SUBSTITUTE SHEET (RULE 26) associated with malignant tissues can then be highlighted on the display monitor.
The final image fusion technique uses the KL transform, which was originally introduced as a series expansion for continuous random processes by Karhunun and Loeve. It is also known as the method of principal components and is ideal for treating a number of images as an ensemble.
The KL transform works as follows. Assume there are N
images of P pixels each, acquired at respective different wavelengths, which are written as vector components v1...
vN. The NxN auto-correlation matrix of the images, R, is computed by the following equation:
R~i~~.7~= l, ~,va~*~°;~~
where i, j E [1,N].
The Jacobi algorithm is used to compute the N eigenvalues and eigenvectors of the auto-correlation matrix R. Then, the eigenvectors V1...VN are sorted according to the corresponding eigenvalues Dl...DN.
The KL transformation consist of a cross-product of the sorted eigenvectors V1...VN with the original images v1...
vN such that a new set of images kl...kN of P pixels each is obtained:
Y » ~i ~ * ~°a~
255 ;., where n e,[1,N] and pE [1,p]
The N transformed images are uncorrelated. Moreover, the set of transformed images is arranged in descending order SUBSTITUTE SHEET (RULE 26) of energy. Typically, the first three images k1, k2, k3 describe over 950 of the N original images. This property makes the first three images obtained from the KL transform suitable candidates for image fusion with the pseudo coloring technique.
The final step therefore consists of rendering each of the three images k1, k2, k3 in a respective primary color, and then combining the three colored images on-screen to produce the final fused image. If desired, the conventional LUV color system can be used (rather than RGB) to optimize the average human perception sensitivity to small color differences. Furthermore, image enhancement by histogram equalization in a manner known in the art can also be carried out.
Results from two sets of experiments are presented here, they compare the three image fusion techniques presented previously with synthetic phantoms and in a in vivo situation.
The first experiment was based on three scans of a tissue phantom containing three inclusions of different optical properties. Between each scan, the positions of the inclusions were inverted to simulate the effect of a change in wavelength. The image difference, the pseudo-coloring and the KL transform techniques were applied to the images obtained. Results of these tests, presented in Fig. 7, clearly demonstrate the improvement in inclusion differentiation and efficient data reduction technique. We notice that KL transform is particularly well adapted to mufti-wavelength imaging.
The second experiment started with the acquisition of in vivo scans from a human breast at two wavelengths (753 and SUBSTITUTE SHEET (RULE 26) 800 nm). Images were then processed using the image difference, the pseudo-coloring and the KL transform techniques. Fig. 8 presents the image fusion results obtained from the two scans. A color map has been applied to the difference images (pixel difference increases from blue to green, to yellow, then orange and finally red). As in the previous experiment, the fusion provides highlights of the image's specificity, bringing more information in a single image.
The KL transform method for image fusion, used as described previously, gives the most useful results for global visualization of mufti-wavelength images. The fused color image obtained with this technique improves the contrast between the features of the input images. However, the color image obtained with the KL transform is generally less natural to the human eye that the one obtained with the pseudo-coloring technique.
As may be appreciated, the above-noted image fusion techniques may be used in combination, in order to highlight certain aspects of an image and/or as an aid to diagnostic evaluation. For example, if desired, fused images generated by the image difference and image averaging techniques may themselves be combined using the pseudo-coloring technique. In this example, a breast may be imaged at 930nm and 975nm, and these images combined using the image difference technique to highlight glandular and adipose tissue structures. The breast may then be imaged at 755 nm and 800 nm to determine a pixel location in the oxy/deoxy-total blood volume space. These results can then be combined into a single image by assigning, for example, Red to. the average image highlighting total blood;
Green to the difference image highlighting glandular and SUBSTITUTE SHEET (RULE 26) adipose tissue; and Blue to the result of mapping to the oxy/deoxy-total blood volume space, and highlighting malignant tissue.
The embodiments) of the invention described above is(are) intended to be exemplary only. The scope of the invention is therefore intended to be limited solely by the scope of the appended claims.
SUBSTITUTE SHEET (RULE 26)
Claims (18)
1. A method of imaging internal structures of a highly turbid medium, the method comprising steps of:
imaging the internal structures at each one of a set of at least two predetermined wavelengths, to generate a corresponding set of respective images;
and merging the set of images to generate a corresponding fused image.
imaging the internal structures at each one of a set of at least two predetermined wavelengths, to generate a corresponding set of respective images;
and merging the set of images to generate a corresponding fused image.
2. A method as claimed in claim 1, wherein the step of imaging the internal structures is based on temporal point spread function (TPSF) analysis of light emerging from the turbid medium.
3. A method as claimed in claim 2, wherein each of the predetermined wavelengths is selected based on optical absorption properties of at least one internal structure of turbid media.
4. A method as claimed in claim 1, wherein, when the number of wavelengths is at most three, the step of merging the set of images comprises steps of:
rendering each image in a respective different primary display color of a color display monitor;
and simultaneously displaying the rendered images on the color display monitor to generate the fused image.
rendering each image in a respective different primary display color of a color display monitor;
and simultaneously displaying the rendered images on the color display monitor to generate the fused image.
5. A method as claimed in claim 1, wherein, when the number of wavelengths is at most two, the step of merging the set of images comprises steps of:
rendering each image in a predetermined common primary display color of a color display monitor to generate respective rendered images; and subtracting the rendered images to generate the fused image.
rendering each image in a predetermined common primary display color of a color display monitor to generate respective rendered images; and subtracting the rendered images to generate the fused image.
6. A method as claimed in claim 1, wherein, when the number of wavelengths is at most two, the step of merging the set of images comprises steps of:
rendering each image in a predetermined common primary display color of a color display monitor to generate respective rendered images; and averaging the rendered images to generate the fused image.
rendering each image in a predetermined common primary display color of a color display monitor to generate respective rendered images; and averaging the rendered images to generate the fused image.
7. A method as claimed in claim 1, wherein, when the number of wavelengths is two or more, the step of merging the set of images comprises steps of:
calculating a KL transform of each image to generate respective transformed images;
selecting at most three of the transformed images based on a respective energy of each image;
rendering each selected transformed image in a respective different primary display color of a color display monitory and simultaneously displaying the rendered images on the color display monitor to generate the fused image.
calculating a KL transform of each image to generate respective transformed images;
selecting at most three of the transformed images based on a respective energy of each image;
rendering each selected transformed image in a respective different primary display color of a color display monitory and simultaneously displaying the rendered images on the color display monitor to generate the fused image.
8. A method as claimed in claim 7, wherein the step of selecting at most three of the transformed images comprises a step of selecting transformed images having a highest energy level.
9. A method of biomedical optical imaging, the method comprising steps of:
imaging internal structures of a tissue sample at each one of a set of at least two predetermined wavelengths, to generate a corresponding set of respective images; and merging the set of images to generate a corresponding fused image.
imaging internal structures of a tissue sample at each one of a set of at least two predetermined wavelengths, to generate a corresponding set of respective images; and merging the set of images to generate a corresponding fused image.
10. A method as claimed in claim 9, wherein the step of imaging the internal structures is based on temporal point spread function (TPSF) analysis of light emerging from the tissue sample.
11. A method as claimed in claim 9, wherein each of the predetermined wavelengths is selected based on optical absorption properties of at least one internal structure of turbid media.
12. A method as claimed in claim 11, wherein the tissue sample is breast tissue, and the set of predetermined wavelengths comprises any one or more of: 755, 800, 930 and 975 nm.
13. A method as claimed in claim 9, wherein, when the number of wavelengths is at most three, the step of merging the set of images comprises steps of:
rendering each image in a respective different primary display color of a color display monitor;
and simultaneously displaying the rendered images on the color display monitor to generate the fused image.
rendering each image in a respective different primary display color of a color display monitor;
and simultaneously displaying the rendered images on the color display monitor to generate the fused image.
14. A method as claimed in claim 9, wherein, when the number of wavelengths is at most two, the step of merging the set of images comprises steps of:
rendering each image in a predetermined common primary display color of a color display monitor to generate respective rendered images;
subtracting the rendered images to generate the fused image.
rendering each image in a predetermined common primary display color of a color display monitor to generate respective rendered images;
subtracting the rendered images to generate the fused image.
15. A method as claimed in claim 9, wherein, when the number of wavelengths is at most two, the step of merging the set of images comprises steps of:
rendering each image in a predetermined common primary display color of a color display monitor to generate respective rendered images;
averaging the rendered images to generate the fused image.
rendering each image in a predetermined common primary display color of a color display monitor to generate respective rendered images;
averaging the rendered images to generate the fused image.
16. A method as claimed in claim 9, wherein, when the number of wavelengths is two or more, the step of merging the set of images comprises steps of:
calculating a KL transform of each image to generate respective transformed images;
selecting at most three of the transformed images based on a respective energy of each image;
rendering each selected transformed image in a respective different primary display color of a color display monitor; and simultaneously displaying the rendered images on the color display monitor to generate the fused image.
calculating a KL transform of each image to generate respective transformed images;
selecting at most three of the transformed images based on a respective energy of each image;
rendering each selected transformed image in a respective different primary display color of a color display monitor; and simultaneously displaying the rendered images on the color display monitor to generate the fused image.
17. A method as claimed in claim 16, wherein the step of selecting at most three of the transformed images comprises a step of selecting transformed images having a highest energy level.
18. An optical imaging apparatus for imaging internal structures of a highly turbid medium, the apparatus comprising:
an optical source providing light at a plurality of wavelengths;
means for injecting said light into said medium and for recovering detection light from said medium;
means for detecting said detection light to generate raw data corresponding to said plurality of wavelengths; and means for processing said raw data to generate an image benefiting from information gained from said plurality of wavelengths, wherein said apparatus performs the method according to any one of claims 1 to 17.
an optical source providing light at a plurality of wavelengths;
means for injecting said light into said medium and for recovering detection light from said medium;
means for detecting said detection light to generate raw data corresponding to said plurality of wavelengths; and means for processing said raw data to generate an image benefiting from information gained from said plurality of wavelengths, wherein said apparatus performs the method according to any one of claims 1 to 17.
Applications Claiming Priority (3)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US30507801P | 2001-07-16 | 2001-07-16 | |
| US60/305,078 | 2001-07-16 | ||
| PCT/CA2002/001066 WO2003007808A2 (en) | 2001-07-16 | 2002-07-16 | Multi-wavelength imaging of highly turbid media |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| CA2453585A1 true CA2453585A1 (en) | 2003-01-30 |
Family
ID=23179229
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA002453585A Abandoned CA2453585A1 (en) | 2001-07-16 | 2002-07-16 | Multi-wavelength imaging of highly turbid media |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US20050187478A1 (en) |
| EP (1) | EP1411824A2 (en) |
| JP (1) | JP2004534607A (en) |
| CN (1) | CN1543325A (en) |
| CA (1) | CA2453585A1 (en) |
| WO (1) | WO2003007808A2 (en) |
Families Citing this family (27)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US8494616B2 (en) * | 2000-01-19 | 2013-07-23 | Christie Medical Holdings, Inc. | Method and apparatus for projection of subsurface structure onto an object's surface |
| US7720525B2 (en) * | 2003-03-12 | 2010-05-18 | New Art Advanced Research Technologies Inc. | Method and apparatus for combining continuous wave and time domain optical imaging |
| JP2006320380A (en) * | 2005-05-17 | 2006-11-30 | Spectratech Inc | Optical interference tomograph meter |
| US8017927B2 (en) * | 2005-12-16 | 2011-09-13 | Honeywell International Inc. | Apparatus, system, and method for print quality measurements using multiple adjustable sensors |
| US7688447B2 (en) * | 2005-12-29 | 2010-03-30 | Honeywell International Inc. | Color sensor |
| US7589869B2 (en) * | 2006-04-28 | 2009-09-15 | Electro Scientific Industries, Inc. | Adjusting image quality using multi-wavelength light |
| WO2008015604A2 (en) * | 2006-07-31 | 2008-02-07 | Koninklijke Philips Electronics N.V. | Measurement with multiplexed detection |
| US7880156B2 (en) * | 2006-12-27 | 2011-02-01 | Honeywell International Inc. | System and method for z-structure measurements using simultaneous multi-band tomography |
| WO2009053920A1 (en) * | 2007-10-25 | 2009-04-30 | Koninklijke Philips Electronics N.V. | Monitoring the degree of hydration of the human body |
| US20090245594A1 (en) * | 2008-03-31 | 2009-10-01 | General Electric Company | Iris imaging and iris-based identification |
| US8401809B2 (en) | 2010-07-12 | 2013-03-19 | Honeywell International Inc. | System and method for adjusting an on-line appearance sensor system |
| KR101689866B1 (en) * | 2010-07-29 | 2016-12-27 | 삼성전자주식회사 | Method and apparatus of processing image and medical image system employing the same |
| CN101996396A (en) * | 2010-09-16 | 2011-03-30 | 湖南大学 | Compressive sensing theory-based satellite remote sensing image fusion method |
| KR101747300B1 (en) * | 2010-10-21 | 2017-06-15 | 삼성전자주식회사 | Method for processing image, image processing apparatus and medical image system for performing the same |
| US8618929B2 (en) | 2011-05-09 | 2013-12-31 | Honeywell International Inc. | Wireless conveyor belt condition monitoring system and related apparatus and method |
| WO2016069788A1 (en) | 2014-10-29 | 2016-05-06 | Spectral Md, Inc. | Reflective mode multi-spectral time-resolved optical imaging methods and apparatuses for tissue classification |
| DE102016107595B4 (en) * | 2016-04-25 | 2018-12-13 | Precitec Gmbh & Co. Kg | Beam shaping optics for material processing by means of a laser beam and device with the same |
| US10827915B2 (en) | 2016-08-07 | 2020-11-10 | Ramot At Tel-Aviv University Ltd. | Method and system for imaging internal medium |
| EP3296960B1 (en) * | 2016-09-15 | 2018-08-22 | Axis AB | A method and an arrangement for pseudo coloring of a digital image |
| US10131133B2 (en) * | 2016-10-17 | 2018-11-20 | Purdue Research Foundation | Methods for forming optically heterogeneous phantom structures and phantom structures formed thereby |
| WO2018160963A1 (en) | 2017-03-02 | 2018-09-07 | Spectral Md, Inc. | Machine learning systems and techniques for multispectral amputation site analysis |
| WO2020049567A1 (en) * | 2018-09-06 | 2020-03-12 | Carmel Haifa University Economic Corporation Ltd. | Model-free physics-based reconstruction of images acquired in scattering media |
| CN113260303B (en) | 2018-12-14 | 2024-07-05 | 光谱Md公司 | Machine learning system and method for assessing, healing predicting and treating wounds |
| US10783632B2 (en) | 2018-12-14 | 2020-09-22 | Spectral Md, Inc. | Machine learning systems and method for assessment, healing prediction, and treatment of wounds |
| EP3899463A4 (en) | 2018-12-14 | 2022-12-21 | Spectral MD, Inc. | System and method for high precision multi-aperture spectral imaging |
| US10740884B2 (en) | 2018-12-14 | 2020-08-11 | Spectral Md, Inc. | System and method for high precision multi-aperture spectral imaging |
| CA3190062A1 (en) * | 2019-01-17 | 2020-07-23 | University Health Network | Tissue phantoms |
Family Cites Families (18)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US4515165A (en) * | 1980-02-04 | 1985-05-07 | Energy Conversion Devices, Inc. | Apparatus and method for detecting tumors |
| US4945239A (en) * | 1989-03-29 | 1990-07-31 | Center For Innovative Technology | Early detection of breast cancer using transillumination |
| IL98613A (en) * | 1991-06-25 | 1996-01-31 | Technion Res & Dev Foundation | Method and apparatus for analyzing the electrical activity of the heart |
| US5371368A (en) * | 1992-07-23 | 1994-12-06 | Alfano; Robert R. | Ultrafast optical imaging of objects in a scattering medium |
| US5983251A (en) * | 1993-09-08 | 1999-11-09 | Idt, Inc. | Method and apparatus for data analysis |
| US5825830A (en) * | 1995-08-17 | 1998-10-20 | Kopf; David A. | Method and apparatus for the compression of audio, video or other data |
| US7194117B2 (en) * | 1999-06-29 | 2007-03-20 | The Research Foundation Of State University Of New York | System and method for performing a three-dimensional virtual examination of objects, such as internal organs |
| US7486811B2 (en) * | 1996-09-16 | 2009-02-03 | The Research Foundation Of State University Of New York | System and method for performing a three-dimensional virtual examination of objects, such as internal organs |
| WO1999027343A2 (en) * | 1997-11-26 | 1999-06-03 | Imaging Diagnostic Systems, Inc. | Time-resolved breast imaging device |
| CA2259900A1 (en) * | 1999-01-22 | 2000-07-22 | Art Aerospace Research Technologies Inc. | Depth discrimination |
| WO2000046736A1 (en) * | 1999-02-05 | 2000-08-10 | Yoav Smith | Similarity measurement method for the classification of medical images into predetermined categories |
| US7107116B2 (en) * | 1999-03-29 | 2006-09-12 | Genex Technologies, Inc. | Diffuse optical tomography system and method of use |
| AU2001245767A1 (en) * | 2000-03-15 | 2001-09-24 | Cardiac Focus, Inc. | Continuous localization and guided treatment of cardiac arrhythmias |
| US20030065268A1 (en) * | 2000-05-05 | 2003-04-03 | Massachusetts Institute Of Technology | Optical computed tomography in a turbid media |
| US6615063B1 (en) * | 2000-11-27 | 2003-09-02 | The General Hospital Corporation | Fluorescence-mediated molecular tomography |
| US7383076B2 (en) * | 2000-11-27 | 2008-06-03 | The General Hospital Corporation | Fluorescence-mediated molecular tomography |
| US6992762B2 (en) * | 2002-11-11 | 2006-01-31 | Art Advanced Research Technologies Inc. | Method and apparatus for time resolved optical imaging of biological tissues as part of animals |
| US7155274B1 (en) * | 2003-11-21 | 2006-12-26 | Imaging Diagnostic Systems, Inc. | Optical computed tomography scanner for small laboratory animals |
-
2002
- 2002-07-16 CA CA002453585A patent/CA2453585A1/en not_active Abandoned
- 2002-07-16 JP JP2003513421A patent/JP2004534607A/en active Pending
- 2002-07-16 EP EP02748513A patent/EP1411824A2/en not_active Withdrawn
- 2002-07-16 US US10/509,869 patent/US20050187478A1/en not_active Abandoned
- 2002-07-16 CN CNA028160878A patent/CN1543325A/en active Pending
- 2002-07-16 WO PCT/CA2002/001066 patent/WO2003007808A2/en active Application Filing
Also Published As
| Publication number | Publication date |
|---|---|
| JP2004534607A (en) | 2004-11-18 |
| WO2003007808A3 (en) | 2003-04-03 |
| WO2003007808A2 (en) | 2003-01-30 |
| CN1543325A (en) | 2004-11-03 |
| US20050187478A1 (en) | 2005-08-25 |
| EP1411824A2 (en) | 2004-04-28 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US20050187478A1 (en) | Multi-wavelength imaging of highly turbid media | |
| US11656448B2 (en) | Method and apparatus for quantitative hyperspectral fluorescence and reflectance imaging for surgical guidance | |
| US7706862B2 (en) | Detecting human cancer through spectral optical imaging using key water absorption wavelengths | |
| US10123705B2 (en) | Deep optical imaging of tissue with less scattering in the second, third and fourth NIR spectral windows using supercontinuum and other laser coherent light sources | |
| Wilson et al. | Review of short-wave infrared spectroscopy and imaging methods for biological tissue characterization | |
| US7962187B2 (en) | Optical imaging and oximetry of tissue | |
| EP3534147B1 (en) | Optical coherence tomographic imaging device and measuring method | |
| KR20160089355A (en) | Device for non-invasive detection of predetermined biological structures | |
| US10390805B2 (en) | Biopsy needle with large fiber distance at the tip | |
| US12061328B2 (en) | Method and apparatus for quantitative hyperspectral fluorescence and reflectance imaging for surgical guidance | |
| US20060173355A1 (en) | Detecting human cancer through spectral optical imaging using key water absorption wavelengths | |
| EP3383245A1 (en) | Hemoglobin measurement from a single vessel | |
| Anwar et al. | Optical diagnostic of breast cancer using Raman, polarimetric and fluorescence spectroscopy | |
| KR20240039441A (en) | OCT System for Analyzing Brain Tumor Margin using Near Infrared Light Source | |
| Al-Ibadi et al. | THz spectroscopy and imaging for breast cancer detection in the 300–500 GHz range | |
| RU2437617C1 (en) | Method of non-invasive determination of oxygen tissue status | |
| CN112004464A (en) | Tumor margin assessment | |
| Gandjbakhche et al. | Expected resolution and detectability of adenocarcinoma tumors within human breast in time-resolved images | |
| Savelieva et al. | Combined Video Analysis of ICG and 5-ALA Induced Protoporphyrin IX and Hemoglobin Oxygen Saturation in near Infrared. | |
| Gareau et al. | Imaging melanoma in a murine model using reflectance-mode confocal scanning laser microscopy and polarized light imaging | |
| Ohmae et al. | Time-domain Diffuse Optical Spectroscopy and Dual-energy Computed Tomography in Breast | |
| Matsui et al. | Quantitative evaluation of lipid concentration in atherosclerotic plaque phantom by near-infrared multispectral angioscope at wavelengths around 1200 nm | |
| Katrašnik et al. | Contrast enhancement of subcutaneous blood vessel images by means of visible and near-infrared hyper-spectral imaging | |
| Mora-Núñez et al. | Diffuse reflectance spectroscopy and Optical polarization imaging of in-vivo biological tissue | |
| Liang | Multispectral imaging methods for the diagnosis of skin cancer lesions |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| FZDE | Discontinued | ||
| FZDE | Discontinued |
Effective date: 20120716 |