CA2428628A1 - Method and apparatus for imaging using polarimetry and matrix based image reconstruction - Google Patents
Method and apparatus for imaging using polarimetry and matrix based image reconstruction Download PDFInfo
- Publication number
- CA2428628A1 CA2428628A1 CA002428628A CA2428628A CA2428628A1 CA 2428628 A1 CA2428628 A1 CA 2428628A1 CA 002428628 A CA002428628 A CA 002428628A CA 2428628 A CA2428628 A CA 2428628A CA 2428628 A1 CA2428628 A1 CA 2428628A1
- Authority
- CA
- Canada
- Prior art keywords
- light
- polarization
- point
- interest
- region
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Abstract
The present invention provides a method and apparatus for improving the signal to noise ratio, the contrast and the resolution in images recorded using an optical imaging system which produces a spatially resolved image. The method is based on the incorporation of a polarimeter into the setup and polarization calculations to produce better images. After calculating the spatially resolved Mueller matrix of a sample, images for incident light with different states of polarization were reconstructed. In a shorter method, only a polarization generator is used and the first row of the Mueller matrix is calculated. In each method, both the best and the worst images were computed. In both reflection and transmission microscope and Macroscope and ophthalmoscope modes, the best images are better than any of the original images recorded. In contrast, the worst images are poorer. This technique is useful in different fields such as confocal microscopy, Macroscopy and retinal imaging.
Description
METHOD AND APPARATUS FOR IMAGING USING POLARIMETRI~ AND
MATRIX BASED IMAGE REOONSTRUCTION
CROSS REFERENCE TO RELATED UNITED STATES PATENT
APPLICATIONS
This patent application relates to United States Provisional patent application Serial No. 601379,417 filed on May 13, 2002, entitled CONFOCAL
SCANNING LASER OPHTHALMOSCOPY IMPROVEMENT BY USING
MUELLER-MATRIX POLARIMETRY, and United States Provisional patent application Serial No. 60/417,t~41 filed on October 11, 2002, entitled ME'~HOD
AND APPARATUS FOR IMAGING USING POLARIMETRY AND MATRIX
BASED IMAGE RECONSTRUCTION.
FIELD OF THE INVENTION
~;~ This invention relates generally to a method of obtaining images c~f objects with optical systems using polarimetry and matrix based image reconstruction of the object, and more particularly the invention relates to obtaining images with a scanning laser optical system using Mueller-matrix polarimetry. This invE~ntion also relates to a method of obtaining images of the eye using scanning I<~ser a ophthalmoscopy, fundus photography or optical coherence tomography in combination with Mueller-matrix polarimetry.
BACKGROUND OF THE INVENTION
Image quality in any imaging system can often be limited by noise including speckle noise in coherent illumination, or by lower resolution or a lack of contrast due to scattered light or light from secondary light sources.
For more than four decades, confocal scanning laser microscopy has s been used successfully to analyze samples in many diverse fields, ranging from biology to the characterization of materials2. One type of scanning laser microscope with a large field of view is known as a Macroscope. This is an example of an instrument in which, for 1 scan direction, the sample is scanned relative to the beam. Webb and co-workers3 presented the confocai scanning to laser ophthalmoscope for viewing the ocular fundus, using the ocular optics as a microscope objective. Optical coherence tomography is also used generally to analyze samples and to image the ocular fundus. Images can be in 2 dimensions perpendicular to the optical beam incident on the sample, in a section with 1 dimension along the incident beam or in line scans in either of is these two sections, and each of these modalities can be used to build up a dimensional image of the object or the eye in depth. Since the optics of the eye degrade the image, additional improvements have been made to fundus imaging, such as adaptative optics4, deconvolution techniques5 or changes in the beam diameter and its entry position in the pupil of the eyes. The methodology outlined 2v here can also be combined with a microscope (without beam scanning) with either confocal or non-confocal imaging.
The polarization properties of light have been used in conjunction with imaging techniques in target detection', optical coherence tomographys~9, ophthalmologic diagnosis'°, remote sensing" and microscopy'2. In general, optical imaging with polarization has been reported to improve contrast, reduce noise and provide useful information about scenes (not available with polarization-blind imaging). Structural information (for example nerve fiber layer thickness'°) obtained from the polarization properties is also useful.
Confocal scanning laser ophthalmoscopy, scanning laser ophthalmoscopy and ocular optical coherence tomography are used for the diagnosis of eye diseases and disorders that affect structures at the rear of the eye and for basic scientific and biomedical investigations of these structures. Confocal scanning to laser microscopy is used to characterize many materials and for biomedical investigations, including the diagnosis of disorders and diseases of the cornea of the eye. Major limitations to the recognition of features limit diagnosis and evaluation of structures viewed in confocal scanning laser ophthalmoscopy, in confocal scanning laser microscopy and in optical coherence tomography.
is These limitations include pixel to pixel noise, lowered contrast and a lack of resolution. A lowering of contrast and an increase in the size of the features resolved is partly due to the imperfect optical quality of the objective that in the case of ophthalmoscopy and ocular optical coherence tomography is the eye itself. Noise can be increased due to imperfect optics or due to a lower signal 2o reflected from the structures being observed, reducing the signal to noise ratio.
However, these reductions in contrast, resolution and signal to noise ratio are a function of the polarization properties of the features being imaged.
Therefore, it would be very advantageous to provide a method which provides improved image contrast, image resolution and/or the signal to noise ratio of a given image.
s SUMMARY OF THE INVENTION
This is achieved in part by providing a method of obtaining images of an object where the object is illuminated by incident beams) of selectively polarized light and the images reflected (or transmitted) for each different incident beam polarization is recorded using methods which resolve individual image points to from the object. Matrix methods are used to reconstruct multiple images from the recorded image signals and the best image selected.
In one aspect of the present invention there is provided a method for producing images of an object or region of interest of the object, comprising the steps of:
is a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across and/or along an object or region of interest of the object;
b) detecting light intensity signals corresponding to beams of light in a pre-selected number of polarization states reflected or transmitted point by point from 2o the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved matrix constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting ~o a best image of said object or region of said object; and f) visually displaying said best image.
In this context, by object, we mean the part of the object between the input beam and the detector- if the light is being reflected from a plane that is within Is the object, this would be the effect of the light passing through the object in front of the reflecting plane twice. If we are measuring transmitted light, this is would be the full thickness of the object, whose polarisation matrix might depend on the focal plane of the light, In the case of a confocal or optical coherence tomography system in reflection, where we will image as a function of depth 20 location, the matrix of the object could either represent the full thickness to the current image plane or we could calculate out the matrix of the tissue in front of the current imaging plane (in the case where we take 16 samples).
The present invention also provides a method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region or along an object or a region of interest of the object;
b) detecting light intensity signals corresponding to beams of light reflected or transmitted point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
io c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved vector of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the Is object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said vector comprised of independent elements of a matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an zo effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
In another aspect of this invention there is provided a method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and illuminating an object or region of interest of the object with the selectively polarized beam of light;
b) detecting an array of light intensity signals reflected or transmitted from spatially distinct points of the object or region of interest of the object and storing electronic signals corresponding to said detected array of light signals;
~o c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a vector comprised of independent elements of a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved is images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an 2o effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
The present invention also provides a method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region s or along an object or a region of interest of the object by moving the object with respect to the incident beam or by moving the object in 1 dimension with respect to the incident beam and scanning the beam in a perpendicular direction with respect to the object;
b) detecting light intensity signals corresponding to beams of light to reflected or transmitted point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
is d) constructing a spatially resolved vector of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said vector 2o comprised of independent elements of a matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
In another aspect of the invention there is provided a method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state to and illuminating an object or region of interest of the object with the selectively polarized beam of light;
b) detecting an array of light intensity signals corresponding to beams of light in a pre-selected number of polarization states reflected from spatially distinct points of the object or region of interest of the abject and storing Is electronic signals corresponding to said detected array of light signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object from the detected light intensity signals and from said spatially resolved matrix constructing Zo spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
The present invention also provides a method for producing images of an object using confocal scanning laser microscopy or nonconfocal or non-scanning, comprising the steps of:
a) calibrating a confocal scanning laser microscope or non-confocal scanning laser microscope modified to include a polarization generator and a io polarization analyzer to obtain a Mueller matrix Ms'~'.N , of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating '/ wave plate located in said generator positioned in each of four positions including 45 degrees, 0 degrees, 30 degrees and 60 degrees, while a'/ wave plate located in said analyzer is placed in each of the is same four positions;
b) calibrating said modified confocal scanning instrument to obtain a Mueller matrix MscN , of the instrument in the outgoing direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating'/
wave plate located in said generator positioned in each of four positions including Zo degrees, 0 degrees, 30 degrees and 60 degrees, while a'/ wave plate located in said analyzer is placed in each of the same four positions;
c) placing said object in said modified confocal scanning apparatus and focusing light onto said object and recording sixteen gray scale images with the to object in place for each of four generator states with a'/ wave plate at 45, 0, 30 and 60 degrees combined with each of the four analyzer states 1/4 wave plate at 45, 0, 30 and 60 degrees;
d) placing said sixteen grey scale values for each pixel into a spatially s resolved matrix, I~"'n~, which is a first element of a Stokes vector, SD "~
reaching the photodetector;
e) from I~'""~ calculate Mo"t from equation 2;
f) from equation 3, calculate M, the spatially resolved Mueller matrix of the object;
Io g) choosing values of an incident Stokes vector, S,N, around a Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
h) applying equation 4 to reconstruct images, I~~"t>, pixel by pixel for each incident Stokes vector;
is i) for each image, calculate the image quality measure of choice, for example SNR as defined in equation 5; and j) display the image with best value of the image quality measure.
The present invention also provides a method for producing images of an 20 object using scanning laser microscopy (or macroscopy), in transmission mode comprising the steps of:
a) calibrating a scanning laser microscope or macroscope modified to include a polarization generator and a polarization analyzer to obtain a Mueller m matrix Ms~,'.N , of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating'/ wave plate located in said generator positioned in each of four positions including 45 degrees, 0 degrees, 30 degrees and 60 degrees, while a'/ wave plate located in s said analyzer is placed in each of the same four positions;
b) placing said object in said modified confocal scanning apparatus and focusing light onto said object and recording sixteen gray scale images with the object in place for each of four generator states with a'/ wave plate at 45, 0, 30 and 60 degrees combined with each of the four analyzer states 1/4 wave plate at l0 45, 0, 30 and 60 degrees;
c) placing said sixteen grey scale values for each pixel into a spatially resolved matrix, I~"'"~, which is a first element of a Stokes vector, So "~
reaching the photodetector;
d) from I~mn~ calculate Mot from equation (equation 2);
is e) from equation 5, calculate M, the spatially resolved Mueller matrix of the object;
f) choosing values of an incident Stokes vector, SiN, around a Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
2o g) applying equation 6 to reconstruct images, IO"t~, pixel by pixel for each incident Stokes vector;
h) for each image, calculate the image quality measure of choice, for example SNR as defined in equation 7; and i2 i) display the image with best value of the image quality measure.
The present invention also provides an optical scanning apparatus for producing images of an object, comprising:
a) a light source for producing a light beam;
b) polarization generator means for producing selected polarization states in the light beam upon passage of the light beam through said polarization generator means to produce a selectively polarized light beam;
c) scanning means for receiving the selectively polarized light beam and to spatially scanning the selectively polarized light beam in two dimensions across an object point by point or alternately scanning the sample with respect to the laser beam or scanning the beam in 1 or 2 dimensions and the sample in the perpendicular direction;
d) polarization analyzer means for transmitting light beams of selected is polarization, including directing and focusing optics for directing the reflected light beams reflected point by point from the object to said polarization analyzer means;
e) detection means and light shaping and focusing means for directing and focusing the reflected light beams of selected polarization onto said 2o detection means;
f) computer processing means connected to said detection means, said computer processing means including image analysis means for processing signals from said detector due to the reflected light beams of selected polarization detected by said detection means and producing therefrom images of the object; and g) display means for displaying an image of the object produced by said processing means.
BRIEF DESCRIPTION OF THE DRAWINGS
Preferred embodiments of the invention will now be described, by way of example only, with reference to the drawings, in which:
Figure 1 shows a block diagram of an apparatus used to perform the to method of the present invention in which P1 and P2, linear horizontal polarizers;
QWP1 and QWP2, rotating quarter-wave plates wherein both microscope configuration (viewing the object) and ophthalmoscope configuration (viewing a person's eyeball) are shown;
Figure 2 shows elements of the first row of the spatially resolved Mueller is matrix for a U.S.A.F. chart (4.4 mm square);
Figure 3 shows elements of the first row of the spatially resolved Mueller matrix for a retinal region (2 degrees) for one sample subject's fundus, with the gray level code being shown at the right;
Figure 4 shows results for the target in Figure 2, Figure 4(a) shows the 2o worst reconstructed image, Figure 4(b) shows the best original image, Figure 4(c) shows the best reconstructed image;
Figure 5(a) shows the worst reconstructed image, Figure 5(b) shows the best original images, and Figure 5(c) shows the best reconstructed images for the fundus image in Figure 2 and an second sample subject (a 3 degree field);
Figure 6 shows the block diagram of a commercially available Macroscope, used to perform the method of the present invention in which the generator consists of a linear horizontal polarizer and a rotating quarter-wave plate and the analiser consists of a linear horizontal polarizer and a rotating quarter-wave plate;
Figure 7 shows elements of the first row of the spatially resolved Mueller to matrix for a tissue sample measured in the modified Macroscope; and Figures 8(a), (b) and (c) show results for the sample in Figure 7, Figure 8(a) shows the best original image, Figure 8(b) shows the best reconstructed image with maximum contrast; Figure 8(c) shows the best reconstructed image with maximum signal to noise ratio.
is DETAILED DESCRIPTION OF THE INVENTION
Broadly, the present invention provides a method of obtaining images of an object where the object is illuminated by incident beams) of selectively polarized light or nonpolarized light and the images reflected or transmitted by Zo the object. for each different incident beam polarization is analised with respect to its polarization and then recorded using methods which resolve individual image points from the object. Matrix methods are used to reconstruct multiple images from the recorded image signals and the best image selected.
is The method may be implemented using an optical scanning system or a scanning stage on which the object is placed such as for example a scanning laser system. The scans may be 2 dimensioinal in any combination of 2 perpendicular axes or 3 dimensional. In one embodiment the method and apparatus use Mueller-matrix polarimetry to reduce noise and improve images of light reflected from the sample recorded with the optical scanning system. In a second embodiment the method and apparatus use Mueller-matrix polarimetry to reduce improve image resolution and contrast of images of light transmitted by the sample recorded by a combination of optical scanning and sample scanning.
to The image improvement includes improvements in the signal-to-noise ratio, an improvement in contrast across local features and an improvement in the resolution of features (visibility of small details).
Since different objects or different regions of interest of an object have different polarization properties, the analysis gives an improved image Is corresponding to a different incoming polarization state on the Poincare sphere dependent on these properties.
Improvements have been shown for both specularly and diffusely reflecting objects, for light transmitted by objects and for an object (the fundus) which produces a combination of diffuse, specular and directional reflections.
ao The analysis disclosed hereinafter is spatially resolved, that is, it is performed on a pixel by pixel basis, so that the improvements in images of different areas of the object depend on the local polarization properties of the object, and the calculation described herein may produce a different best image of each object area of interest.
The analysis depends on the measure of best image quality used, so that the best image produced may depend on the measure used. However, in some s of the examples given below, a signal to noise (SNR) maximum measure across a large area of the image gives the best image defined by the signal to noise ratio measure used. It also produced images with higher contrast of local features and higher resolution of fine detail. So initially, a SNR measure appears to be the best image quality measure for example when laser speckle is present.
io When small details need to be resolved, a contrast measure appears to be the best image quality measure.
The method can be used to give the best image quality for other image quality measures including those that combine contrast, SNR and resolution measures if necessary.
Is One embodiment of the method is based on the incorporation of a polarimeter into a laser scanning system combined with a specialized spatially resolved calculation and image display. After calculating the spatially resolved Mueller matrix of a sample, images for incident light with different states of polarization are reconstructed with increments chosen of 1 degree for azimuth 2o and ellipticity over the Poincare sphere. The increments over the Poincare sphere chosen in the calculation could be varied. The calculation generates images for incoming polarization states that could not be generated in the experimental imaging system. The best computed image in both reflected light m microscope and ophthalmoscope modes as well as in transmission Macroscope mode, are better than any of the original images recorded with polarimetry. In contrast, the worst computed images are poorer.
Referring to Figure 1, a schematic diagram of a confocal scanning s microscope modified to include a polarimeter'3 is shown generally at 10 with the polarimeter comprising a generator unit 12 which includes a fixed linear polarizer P1 and a rotating 1l4-wave plate QWP1. The apparatus includes an analyzer 14 in a symmetric configuration with respect to the generator 12 which comprises a fixed linear polarizer P2 and a rotating 1I4-wave plate QWP2 in the analyzer unit.
to The system 10 may be used in both microscope and ophthalmoscope modes. In the microscope mode, the focal length and the numerical aperture for the objective lens 16 was 90 mm and 0.11 respectively but it will be understood that different objective lenses may be used. In the ophthalmoscope mode, the patient's eye itself acted as a microscope objective. A 633-nm He-Ne laser 18 is ~s used as the light source and a photo-multiplier tube as the detector but those skilled in the art will appreciate that other light sources or photodetectors may be used, either in a modified commercial microscope or commercial ophthalmoscope or in a customized design.
An X-Y scanning system 30 permits the light beam to be scanned across 2o the sample or inside or outside of the eyeball of the patient in a raster.
Any commercially available raster scan system, or application specific system or any novel system may be used including resonance scanners, galvonometer scanners, oscillating mirrors, acosto-optic deflectors, solid state deflectors, single is facet or polygon rotating mirrors, holographic scanners or micro-electro mechanical scanners. The beam splitter BS directs information bearing light beam reflected from the sample or eyeball through the collector lens 28 through confocal pinhole 26 onto the detector 22.
s The laser beam is scanned in two dimensions and focused on the sample (a target or the retina) by the objective or the ocular optics. The light reflected back from the sample at each point of the scan is recorded by the detector 22. In studies conducted by the inventors the size of the light beam entering the objective 16 (and the eye) was 2.5 mm and the confocal pinhole 26 io was 600 microns in diameter. The focal length of the collector lens 28 was mm. The system records images at a rate of 28.5 Hz. However it will be appreciated that these variables are exemplary only and may be varied by those skilled in the art.
Referring to Figure 6, a schematic diagram of a scanning Macroscope in Is transmission mode modified to include a polarimeter'3 is shown generally at with the polarimeter comprising a generator unit 41 which includes a fixed linear polarizer and a rotating'/4 wave plate. The apparatus includes an analyzer 42 in a symmetric configuration with respect to the generator which comprises a fixed linear polarizer and a rotating'/ wave plate in the analyzer unit. A wide angle ao telecentric lens 45 is used in the Macroscope but it will be understood that different objective lenses may be used in a Macroscope or microscope configuration. A 633-nm He-Ne laser is used as the light source 43 and a photo-multiplier tube as the detector 44 but those skilled in the art will appreciate that i9 other light sources or photodetectors may be used, either in a modified commercial microscope or in a customized design.
A linear scanning system 46 permits the light beam to be scanned across the sample and is combined with a stage moving in a perpendicular direction to s create a raster scan of the object. Any commercially available raster scan system, or application specific system or any novel system may be used including resonance scanners, galvonometer scanners, oscillating mirrors, acosto-optic deflectors, solid state deflectors, single facet or polygon rotating mirrors, holographic scanners or micro-elctro mechanical scanners or any io mechanical means of scanning the beam and or stage in 1 or 2 dimensions.
The information bearing light beam transmitted by the sample goes through the collector lens 45 onto the detector.
The laser beam is focused on the sample by the objective. The light transmitted by the sample at each point of the scan is recorded by the detector.
Is However it will be appreciated that the variables used here are exemplary only and may be varied by those skilled in the art.
The sixteen (16) combinations of polarization states required to calculate the Mueller matrix for each point of the scanned sample correspond to different angles of the fast axes of the two rotating quarter-wave plates QWP1 and QWP2 2o as previously described'4. The generator 12 and analyzer 14 in Figure 1 and in Figure 6 may be connected to computer controlled mechanical actuator system (not shown) for moving the 1/4 wave plates QWP1 and QWP2 into the four different positions. Alternately, fast electro-optical devices (including but not limited to liquid-crystals, photoelastic modulators) could be used to vary the polarization states of the generator and analyser'5 The system is calibrated by taking a measurement in the incoming pathway. This will give the Mueller matrix , Ms~N , of the instrument in the s incoming direction. A matrix of 16 intensity values results from intensity measurements with the generator's rotating '/ wave plate in each of four positions -45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/e wave plate is placed in each of the same four positions.
The outgoing direction of the instrument in figure 1 is also calibrated. This Io will give the Mueller matrix, Ms~N , of the instrument in the outgoing direction. A
matrix of 16 intensity values results from intensity measurements with the generator 1/4 wave plate QWP1 in each of four positions described previously while the analyzer 1 /4 wave plate QWP2 is placed in each of the same four positions.
rs Sixteen (16) gray scale images are taken with the object in place for each of the four generator states (1/4 wave plate QWP1 at 45, 0, 30 and 60 degrees) combined with each of the same four analyzer states (1/4 wave plate QWP2 set at 45, 0, 30 and 60 degrees while QWP1 is in each of its fours states). The generator produces polarized light at a particular orientation, set by a linear 2o polarizer P1 and the QWP1. The analyser composed of QWP2 and the linear polarizer P2 turns light of a particular polarization into linearly polarized light.
The 16 grey scale values for each pixel are placed into a spatially resolved matrix, I~"'"~ which is the first element of the Stokes vector, So ") reaching the photodetector.
For every Stokes vector S~ ) (m=1, 2, 3, 4) produced by the generator, the s intensity reaching the detector for each point of the sample (I~"'"~), is the first element of the Stokes vector SDmn) (n=1, 2, 3, 4) given by:
(mn) ~ (n) (z) (~) (m) Sn - M ,9 ~ MS('N ~ M ~ MSl'N ~ SG 1 where M=M;~ (i, j=0, 1, 2, 3) is the Mueller matrix of the sample under study, M An) is one of the four Mueller matrices of the analyzer unit (each corresponding to an to independent state), and MseN and NIs~N are the Mueller matrices of the experimental system itself (lenses, scanning unit and beam splitter) for first and second passages respectively, previously measured in the calibration process.
For each generator-analyzer combination, the image is spatially resolved, giving a spatially resolved M. Let MA be the 4x4 auxiliary matrix with each row being the is first row of every M'a ) and Mp~r=[So~T , Sour , SoUT , So~T ] be another auxiliary matrix with So~T each Stokes vector going into the analyzer unit. These matrices are then related:
l(1_1) 1(2I) I1~3_I) I(4_I) J(1_2) I(22) 1(3_2) I(4_2) j() 3) I(23) 1(3 _3) I(4_3) - MA ~ Mour I(14) I(2-4) 1(3._4) 1(4_4) l If M~=[ S~ ) , S~ ) , S~ ) , S~ ) ], then M is computed by means of:
~,~ l ~,~ t M=~MS~N~ 'Mour'~c~ '~scN~ (3) where MpuT is obtained by inversion of equation (2).
The system in Figure 6 (an example of a measurement of transmitted light) is calibrated by taking a measurement in the incoming pathway. This will s give the Mueller matrix , MscN , of the instrument in the incoming direction. A
matrix of 16 intensity values results from intensity measurements with the generator's rotating'/ wave plate in each of four positions --45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/ wave plate is placed in each of the same four positians.
~o Sixteen (16) gray scale images are taken with the object in place for each of the four generator states (1/4 wave plate QWP1 at 45, 0, 30 and 60 degrees) combined with each of the same four analyzer states (1/4 wave plate QWP2 set at 45, 0, 30 and 60 degrees while QWP1 is in each of its fours states). The generator produces polarized light at a particular orientation, set by a linear is polarizer P1 and the QWP1 and. The analyser composed of QWP2 and the linear polarizer P2 turns light of a particular polarization into linearly polarized light.
The 16 grey scale values for each pixel are placed into a spatially resolved matrix, I~"'~a which is the first element of the Stokes vector, So "' reaching the 2o photodetector.
For every Stokes vector S~'' (m=1, 2, 3, 4) produced by the generator, the intensity reaching the detector for each point of the sample (I~"'"~), is the first element of the Stokes vector So "' (n=1, 2, 3, 4) given by:
Scn,n> = MA~~ . M , Mca , S~m>
D SCN G
s where M=M;~ (i, j=0, 1, 2, 3) is the Mueller matrix of the sample under study, M a"' is one of the four Mueller matrices of the analyzer unit (each corresponding to an independent state), and MscN is the Mueller matrices of the experimental system itself (lenses, scanning unit and beam splitter), previously measured in the calibration process. For each generator-analyzer combination, to the image is spatially resolved, giving a spatially resolved M. Let MA be the 4x4 auxiliary matrix with each row being the first row of every M A"' and Mo~T=['Sour . Sour . Sour ~ "SOUT l be another auxiliary matrix with Sour each Stokes vector going into the analyzer unit. These matrices are then related by equation 2: If M~=[ 5~,." , S~2' , S~3' , S~' ], then M is computed by means of:
15 M = Mour ' ~MC, ~~ ~ \MSCN ~1 where MpuT is obtained by inversion of equation (2).
From the spatially resolved Mueller matrix calculated for the apparatus in either Figure 1 or in Figure 6, images of the sample I ~o"T' for any in-coming polarization state SiN can be obtained by:
(OUT
) M~ Mo, Mo2 Mo3 I
S~~our) M1o Mn M12 M13 cos(2x~~ cos(2~p~
__ S~"T M M M M sin(2,~)~ cos(2~p)M ~ 5,~
) 20 21 22 23 Sr30UT) M30 M.31 M32 M33 Sln(ZCp) 6) ( where x and cp represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere's. Using equation 6, we can determine the Stokes vectors that produce images with both best and worst quality. This quality s is defined below. This equation gives all output polarization properties.
Here we consider only the image intensity, I~°"T ) , to which only the four elements of the first row of the Mueller matrix contribute.
One parameter that may be used to characterize image quality is the speckle noise (SN) or the inverse of the signal-to-noise ratio (SNR) (often used to to describe speckle") defined as the ratio between the standard deviation and the mean intensity across the whole image:
_ stdv(I ~°'") ) SN = (SNR ~ --mean(I ~°"') ) (7) Other measures of image quality are possible including contrast across a local feature of the image, the size of the smallest features resolved in the image, is or measures which are combinations of SN, contrast and resolution including Fisher's linear discriminant.
The detailed steps followed to obtain improved images according to the present invention using the preferred Mueller matrix methodology are as follows.
First the methodology for reflection images is given.
20 1 ) Calibrate system 10 in Figure 1 by taking a measurement in the incoming pathway. This will give the Mueller matrix , MSCN , of the instrument in the incoming direction. For this measurement the analyzer is moved to the usual position of a sample. An intensity detector is placed behind the analyzer. Any scanning optics are turned off. A matrix of 16 intensity values results from s intensity measurements with the generator's rotating'/ wave plate in each of four positions -45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/ wave plate is placed in each of the same four positions.
2) Continue calibration. A mirror is placed at the plane of the sample. The analyzer and the intensity detector are moved behind the last optical element of to the system. This will give the Mueller matrix , MS~N , of the instrument in the outgoing direction. Any scanning optics are turned off. A matrix of 16 intensity values results from intensity measurements with the generator's'/ wave plate in each of four positions -45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/ wave plate is placed in each of the same four positions.
is 3) Take the intensity detector out of the system and turn the scanners on.
Record the 16 gray scale images with the object in place for each of the four generator states ('/ wave plate at 45, 0, 30 and 60 degrees) combined with each of the 4 analyzer states (1/4 wave plate at 45, 0, 30 and 60 degrees). The 16 grey scale values for each pixel are placed into a spatially resolved matrix, I~m"~ which is the 2o first element of the Stokes vector, So "' reaching the photodetector.
4) From I~"'"~ calculate Mo"t from equation 2.
5) From equation 3, calculate M, the spatially resolved Mueller matrix of the object.
6) Choose values of the incident Stokes vector, SIN, around the Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere'6 Applying equation 6, reconstruct images, IOut~, pixel by pixel for each incident s Stokes vector.
7) For each image, calculate the image quality measure of choice, for example SNR as defined in equation 7.
8) Display the image with best quality.
It is noted that the calibration in 1 ) and 2) just above may reduce the effect to of the instrument on the final polarization properties of the image.
However, it is possible to perform the method without calibration. In this case, the steps following b) are identical. The Mueller matrix derived is the matrix corresponding to the object plus the instrument. When taking images in depth, a more complex calibration process may be undertaken. Beginning at the top of a sample, the is Mueller matrix corresponding to a small thickness may be calculated. The calibration matrix MscN for the next layer below becomes M~,yERI ' Ms~N and MscN becomes MscN ~ MLAYERI . The Mueller matrix of the current layer M~qYER2 IS
then calculated as previously described. This method can be followed for all subsequent layers, incorporating the Mueller matrices for all layers above the 20 one currently being measured into the calibration matrices.
When system 10 is operated in microscope mode, spatially resolved Mueller matrices were calculated for two different samples: a U.S.A.F.
resolution chart (primarily specular reflections) and a grey scale image on white paper (primarily diffuse reflections, not shown here). Figure 2a shows the spatially resolved elements of the first row for the Mueller matrix corresponding to the USAF target. The averaged degrees of polarization were 0.87 (nearly specular) and 0.18 (highly depolarizing) for this target and the diffuse reflection s respectively. In the ophthalmoscope mode we applied the procedure to retinal images recorded in a living human eye. In Figure 3 we show the first row of the Mueller matrix for a retinal fundus region (with blood vessels).
Using these matrices, images were reconstructed for incident light with Stokes vectors with increments of 1 degree for azimuth and ellipticity over the to Poincare sphere. Images were obtained for incoming polarization states that could not be generated in an experimental system. For each matrix, both the best and the worst images were reconstructed using SNR as the measure of quality and the associated Stokes vectors calculated. The higher SNR shows that the best image calculated is better than the best measured with or without is the polarizer in place.
Figure 4 shows the results obtained for the specular reflection in microscope mode. The best (c) and the worst reconstructed images (a) as well as one of the original images are shown (b). Results for the retinal fundus image of figure 3 are presented on the left in Figure 5. On the right in Figure 5 results 2o for the retinal image of a second subject are shown. The original images presented are the best (lowest speckle noise or highest signal-to-noise ratio) of the images experimentally recorded (b). The worst reconstructed images are shown in (a). The improvement in the images obtained using this method was noticeable in all cases. Lower noise as well as higher contrast across features and higher resolution are seen in the best reconstructed image (c). Resolution improvement is demonstrated by the fact that more structural details and small features which are not discernible in the original images can be also observed.
s The improvement seen is better than that for frame averaging. Differences in the signal to noise as defined in equation 5 between the original and the best images were 48% for the specular target (70% for the diffuse target) in microscope mode and 45% for the retinal fundus image of Figure 4. The Stokes vectors for the best specular image in figure 4 was [1, -0.5fi5, -0.099, -0.819]T ([1, 0.220, 0.604, -to 0.766]T for the diffuse reflection) and those corresponding to the optimal retinal image were [1, 0.719, 0.262, 0.643]T for a subject measured in Figure 3 and [1, -0.969, 0.171, 0.174]T for the second subject with results in Figure 5.
Moreover, an increase of up to 30% was found in the contrast across the blood vessels of the subjects presented here.
~s Improvements in image quality using the present invention have been obtained for two different confocal scanning laser imaging systems, both indicated in Figure 1. These include a confocal scanning laser microscope and a confocal scanning laser ophthalmoscope (where the optics of the eye is the final imaging element before the object of interest (the fundus)). Improvements are 20 obtained whether or not a confocal pinhole 26 is used in front of the hotodetector and regardless of what size of confocal pinhole is used. Improvements are also obtained for any wavelength used.
Thus, it will be appreciated by those skilled in the art that the confocal imaging system shown in Figure 1 is meant to be a non-limiting example of an apparatus constructed in accordance with the present invention. The confocal imaging system shown in Figure 1 is one that has pinhole 26 conjugate to the object plane of interest so that apparatus 10 excludes light reflected from the object which is not in-focus on the detector 22. This leads to improved contrast because of the exclusion of scattered light in addition to the ability to resolve structures in depth and to reconstruct three-dimensional images is enhanced.
If depth resolution is important, then system 10 preferably should be used with io confocal pinhole 26. However, scanning laser ophthalmoscopy and microscopy is performed with a larger pinhole in place of the confocal pinhole or with other specialty apertures or without a pinhole and the present invention may be implement using an apparatus absent the confocal pinhole using the methodology described herein which also gives improved image quality.
is Similarly, the light source may be an incoherent light source or it may be a laser producing coherent light beams as light beams with the different polarization states can be produced. Diode lasers producing partially coherent light beams may also be used. Also, instead of using the fixed linear polarizes P1 in the generator 12 in apparatus 10 of Figure 1, a light source with intrinsic linear 2o polarization may be used.
In this description, scanning the beam illuminating the object which is then descanned allows a point detector to be used and the image to be recreated pixel by pixel using timing signals. If the beam is scanned and the light transmitted by an object is recorded, a stationary single detector cannot be used.
In this situation, a moving single detector or moving linear array synchronized to the scanning beam or an area array of detectors with an exposure equivalent to frame of the scan (e.g. a CCD array) may be used to record the image. An area s of the object may be illuminated with a scanning beam and reflected images without descanning could be recorded using a moving single detector or a moving linear array of detectors synchronized to the scanning beam or an area array of detectors with an exposure equivalent to 1 frame of the scan (eg a CCD
array) could be used to record the image. If a stationary beam were used to to illuminate the object, any detector which allowed spatial resolution of the image could be used including a single moving detector, a moving linear array of detectors or an area array of detectors (e.g. a CCD array). The pixelated image that results from any of the above configurations could then be analyzed as described herein.
is Secondly the methodology for transmission images is given.
1 ) Calibrate system in Figure 6 by taking a measurement in the incoming pathway. This will give the Mueller matrix , Ms~N , of the instrument in the incoming direction. For this the sample is removed. The intensity detector is behind the analyzer. Any scanning optics are turned off. A matrix of 16 intensity 2o values results from intensity measurements with the generator's rotating'/
wave plate in each of four positions -45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/ wave plate is placed in each of the same four positions.
2) tlf using a supplementary detector for calibration, remove it. Turn the scanners (if any) on. Record the 16 gray scale images with the object in place for each of the four generator states ('/ wave plate at 45, 0, 30 and 60 degrees) combined with each of the 4 analyzer states (1/4 wave plate at 45, 0, 30 and s degrees). The 16 grey scale values for each pixel are placed into a spatially resolved matrix, I~'""~ which is the first element of the Stokes vector, SD "' reaching the photodetector.
MATRIX BASED IMAGE REOONSTRUCTION
CROSS REFERENCE TO RELATED UNITED STATES PATENT
APPLICATIONS
This patent application relates to United States Provisional patent application Serial No. 601379,417 filed on May 13, 2002, entitled CONFOCAL
SCANNING LASER OPHTHALMOSCOPY IMPROVEMENT BY USING
MUELLER-MATRIX POLARIMETRY, and United States Provisional patent application Serial No. 60/417,t~41 filed on October 11, 2002, entitled ME'~HOD
AND APPARATUS FOR IMAGING USING POLARIMETRY AND MATRIX
BASED IMAGE RECONSTRUCTION.
FIELD OF THE INVENTION
~;~ This invention relates generally to a method of obtaining images c~f objects with optical systems using polarimetry and matrix based image reconstruction of the object, and more particularly the invention relates to obtaining images with a scanning laser optical system using Mueller-matrix polarimetry. This invE~ntion also relates to a method of obtaining images of the eye using scanning I<~ser a ophthalmoscopy, fundus photography or optical coherence tomography in combination with Mueller-matrix polarimetry.
BACKGROUND OF THE INVENTION
Image quality in any imaging system can often be limited by noise including speckle noise in coherent illumination, or by lower resolution or a lack of contrast due to scattered light or light from secondary light sources.
For more than four decades, confocal scanning laser microscopy has s been used successfully to analyze samples in many diverse fields, ranging from biology to the characterization of materials2. One type of scanning laser microscope with a large field of view is known as a Macroscope. This is an example of an instrument in which, for 1 scan direction, the sample is scanned relative to the beam. Webb and co-workers3 presented the confocai scanning to laser ophthalmoscope for viewing the ocular fundus, using the ocular optics as a microscope objective. Optical coherence tomography is also used generally to analyze samples and to image the ocular fundus. Images can be in 2 dimensions perpendicular to the optical beam incident on the sample, in a section with 1 dimension along the incident beam or in line scans in either of is these two sections, and each of these modalities can be used to build up a dimensional image of the object or the eye in depth. Since the optics of the eye degrade the image, additional improvements have been made to fundus imaging, such as adaptative optics4, deconvolution techniques5 or changes in the beam diameter and its entry position in the pupil of the eyes. The methodology outlined 2v here can also be combined with a microscope (without beam scanning) with either confocal or non-confocal imaging.
The polarization properties of light have been used in conjunction with imaging techniques in target detection', optical coherence tomographys~9, ophthalmologic diagnosis'°, remote sensing" and microscopy'2. In general, optical imaging with polarization has been reported to improve contrast, reduce noise and provide useful information about scenes (not available with polarization-blind imaging). Structural information (for example nerve fiber layer thickness'°) obtained from the polarization properties is also useful.
Confocal scanning laser ophthalmoscopy, scanning laser ophthalmoscopy and ocular optical coherence tomography are used for the diagnosis of eye diseases and disorders that affect structures at the rear of the eye and for basic scientific and biomedical investigations of these structures. Confocal scanning to laser microscopy is used to characterize many materials and for biomedical investigations, including the diagnosis of disorders and diseases of the cornea of the eye. Major limitations to the recognition of features limit diagnosis and evaluation of structures viewed in confocal scanning laser ophthalmoscopy, in confocal scanning laser microscopy and in optical coherence tomography.
is These limitations include pixel to pixel noise, lowered contrast and a lack of resolution. A lowering of contrast and an increase in the size of the features resolved is partly due to the imperfect optical quality of the objective that in the case of ophthalmoscopy and ocular optical coherence tomography is the eye itself. Noise can be increased due to imperfect optics or due to a lower signal 2o reflected from the structures being observed, reducing the signal to noise ratio.
However, these reductions in contrast, resolution and signal to noise ratio are a function of the polarization properties of the features being imaged.
Therefore, it would be very advantageous to provide a method which provides improved image contrast, image resolution and/or the signal to noise ratio of a given image.
s SUMMARY OF THE INVENTION
This is achieved in part by providing a method of obtaining images of an object where the object is illuminated by incident beams) of selectively polarized light and the images reflected (or transmitted) for each different incident beam polarization is recorded using methods which resolve individual image points to from the object. Matrix methods are used to reconstruct multiple images from the recorded image signals and the best image selected.
In one aspect of the present invention there is provided a method for producing images of an object or region of interest of the object, comprising the steps of:
is a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across and/or along an object or region of interest of the object;
b) detecting light intensity signals corresponding to beams of light in a pre-selected number of polarization states reflected or transmitted point by point from 2o the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved matrix constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting ~o a best image of said object or region of said object; and f) visually displaying said best image.
In this context, by object, we mean the part of the object between the input beam and the detector- if the light is being reflected from a plane that is within Is the object, this would be the effect of the light passing through the object in front of the reflecting plane twice. If we are measuring transmitted light, this is would be the full thickness of the object, whose polarisation matrix might depend on the focal plane of the light, In the case of a confocal or optical coherence tomography system in reflection, where we will image as a function of depth 20 location, the matrix of the object could either represent the full thickness to the current image plane or we could calculate out the matrix of the tissue in front of the current imaging plane (in the case where we take 16 samples).
The present invention also provides a method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region or along an object or a region of interest of the object;
b) detecting light intensity signals corresponding to beams of light reflected or transmitted point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
io c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved vector of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the Is object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said vector comprised of independent elements of a matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an zo effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
In another aspect of this invention there is provided a method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and illuminating an object or region of interest of the object with the selectively polarized beam of light;
b) detecting an array of light intensity signals reflected or transmitted from spatially distinct points of the object or region of interest of the object and storing electronic signals corresponding to said detected array of light signals;
~o c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a vector comprised of independent elements of a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved is images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an 2o effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
The present invention also provides a method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region s or along an object or a region of interest of the object by moving the object with respect to the incident beam or by moving the object in 1 dimension with respect to the incident beam and scanning the beam in a perpendicular direction with respect to the object;
b) detecting light intensity signals corresponding to beams of light to reflected or transmitted point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
is d) constructing a spatially resolved vector of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said vector 2o comprised of independent elements of a matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
In another aspect of the invention there is provided a method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state to and illuminating an object or region of interest of the object with the selectively polarized beam of light;
b) detecting an array of light intensity signals corresponding to beams of light in a pre-selected number of polarization states reflected from spatially distinct points of the object or region of interest of the abject and storing Is electronic signals corresponding to said detected array of light signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object from the detected light intensity signals and from said spatially resolved matrix constructing Zo spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
The present invention also provides a method for producing images of an object using confocal scanning laser microscopy or nonconfocal or non-scanning, comprising the steps of:
a) calibrating a confocal scanning laser microscope or non-confocal scanning laser microscope modified to include a polarization generator and a io polarization analyzer to obtain a Mueller matrix Ms'~'.N , of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating '/ wave plate located in said generator positioned in each of four positions including 45 degrees, 0 degrees, 30 degrees and 60 degrees, while a'/ wave plate located in said analyzer is placed in each of the is same four positions;
b) calibrating said modified confocal scanning instrument to obtain a Mueller matrix MscN , of the instrument in the outgoing direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating'/
wave plate located in said generator positioned in each of four positions including Zo degrees, 0 degrees, 30 degrees and 60 degrees, while a'/ wave plate located in said analyzer is placed in each of the same four positions;
c) placing said object in said modified confocal scanning apparatus and focusing light onto said object and recording sixteen gray scale images with the to object in place for each of four generator states with a'/ wave plate at 45, 0, 30 and 60 degrees combined with each of the four analyzer states 1/4 wave plate at 45, 0, 30 and 60 degrees;
d) placing said sixteen grey scale values for each pixel into a spatially s resolved matrix, I~"'n~, which is a first element of a Stokes vector, SD "~
reaching the photodetector;
e) from I~'""~ calculate Mo"t from equation 2;
f) from equation 3, calculate M, the spatially resolved Mueller matrix of the object;
Io g) choosing values of an incident Stokes vector, S,N, around a Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
h) applying equation 4 to reconstruct images, I~~"t>, pixel by pixel for each incident Stokes vector;
is i) for each image, calculate the image quality measure of choice, for example SNR as defined in equation 5; and j) display the image with best value of the image quality measure.
The present invention also provides a method for producing images of an 20 object using scanning laser microscopy (or macroscopy), in transmission mode comprising the steps of:
a) calibrating a scanning laser microscope or macroscope modified to include a polarization generator and a polarization analyzer to obtain a Mueller m matrix Ms~,'.N , of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating'/ wave plate located in said generator positioned in each of four positions including 45 degrees, 0 degrees, 30 degrees and 60 degrees, while a'/ wave plate located in s said analyzer is placed in each of the same four positions;
b) placing said object in said modified confocal scanning apparatus and focusing light onto said object and recording sixteen gray scale images with the object in place for each of four generator states with a'/ wave plate at 45, 0, 30 and 60 degrees combined with each of the four analyzer states 1/4 wave plate at l0 45, 0, 30 and 60 degrees;
c) placing said sixteen grey scale values for each pixel into a spatially resolved matrix, I~"'"~, which is a first element of a Stokes vector, So "~
reaching the photodetector;
d) from I~mn~ calculate Mot from equation (equation 2);
is e) from equation 5, calculate M, the spatially resolved Mueller matrix of the object;
f) choosing values of an incident Stokes vector, SiN, around a Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
2o g) applying equation 6 to reconstruct images, IO"t~, pixel by pixel for each incident Stokes vector;
h) for each image, calculate the image quality measure of choice, for example SNR as defined in equation 7; and i2 i) display the image with best value of the image quality measure.
The present invention also provides an optical scanning apparatus for producing images of an object, comprising:
a) a light source for producing a light beam;
b) polarization generator means for producing selected polarization states in the light beam upon passage of the light beam through said polarization generator means to produce a selectively polarized light beam;
c) scanning means for receiving the selectively polarized light beam and to spatially scanning the selectively polarized light beam in two dimensions across an object point by point or alternately scanning the sample with respect to the laser beam or scanning the beam in 1 or 2 dimensions and the sample in the perpendicular direction;
d) polarization analyzer means for transmitting light beams of selected is polarization, including directing and focusing optics for directing the reflected light beams reflected point by point from the object to said polarization analyzer means;
e) detection means and light shaping and focusing means for directing and focusing the reflected light beams of selected polarization onto said 2o detection means;
f) computer processing means connected to said detection means, said computer processing means including image analysis means for processing signals from said detector due to the reflected light beams of selected polarization detected by said detection means and producing therefrom images of the object; and g) display means for displaying an image of the object produced by said processing means.
BRIEF DESCRIPTION OF THE DRAWINGS
Preferred embodiments of the invention will now be described, by way of example only, with reference to the drawings, in which:
Figure 1 shows a block diagram of an apparatus used to perform the to method of the present invention in which P1 and P2, linear horizontal polarizers;
QWP1 and QWP2, rotating quarter-wave plates wherein both microscope configuration (viewing the object) and ophthalmoscope configuration (viewing a person's eyeball) are shown;
Figure 2 shows elements of the first row of the spatially resolved Mueller is matrix for a U.S.A.F. chart (4.4 mm square);
Figure 3 shows elements of the first row of the spatially resolved Mueller matrix for a retinal region (2 degrees) for one sample subject's fundus, with the gray level code being shown at the right;
Figure 4 shows results for the target in Figure 2, Figure 4(a) shows the 2o worst reconstructed image, Figure 4(b) shows the best original image, Figure 4(c) shows the best reconstructed image;
Figure 5(a) shows the worst reconstructed image, Figure 5(b) shows the best original images, and Figure 5(c) shows the best reconstructed images for the fundus image in Figure 2 and an second sample subject (a 3 degree field);
Figure 6 shows the block diagram of a commercially available Macroscope, used to perform the method of the present invention in which the generator consists of a linear horizontal polarizer and a rotating quarter-wave plate and the analiser consists of a linear horizontal polarizer and a rotating quarter-wave plate;
Figure 7 shows elements of the first row of the spatially resolved Mueller to matrix for a tissue sample measured in the modified Macroscope; and Figures 8(a), (b) and (c) show results for the sample in Figure 7, Figure 8(a) shows the best original image, Figure 8(b) shows the best reconstructed image with maximum contrast; Figure 8(c) shows the best reconstructed image with maximum signal to noise ratio.
is DETAILED DESCRIPTION OF THE INVENTION
Broadly, the present invention provides a method of obtaining images of an object where the object is illuminated by incident beams) of selectively polarized light or nonpolarized light and the images reflected or transmitted by Zo the object. for each different incident beam polarization is analised with respect to its polarization and then recorded using methods which resolve individual image points from the object. Matrix methods are used to reconstruct multiple images from the recorded image signals and the best image selected.
is The method may be implemented using an optical scanning system or a scanning stage on which the object is placed such as for example a scanning laser system. The scans may be 2 dimensioinal in any combination of 2 perpendicular axes or 3 dimensional. In one embodiment the method and apparatus use Mueller-matrix polarimetry to reduce noise and improve images of light reflected from the sample recorded with the optical scanning system. In a second embodiment the method and apparatus use Mueller-matrix polarimetry to reduce improve image resolution and contrast of images of light transmitted by the sample recorded by a combination of optical scanning and sample scanning.
to The image improvement includes improvements in the signal-to-noise ratio, an improvement in contrast across local features and an improvement in the resolution of features (visibility of small details).
Since different objects or different regions of interest of an object have different polarization properties, the analysis gives an improved image Is corresponding to a different incoming polarization state on the Poincare sphere dependent on these properties.
Improvements have been shown for both specularly and diffusely reflecting objects, for light transmitted by objects and for an object (the fundus) which produces a combination of diffuse, specular and directional reflections.
ao The analysis disclosed hereinafter is spatially resolved, that is, it is performed on a pixel by pixel basis, so that the improvements in images of different areas of the object depend on the local polarization properties of the object, and the calculation described herein may produce a different best image of each object area of interest.
The analysis depends on the measure of best image quality used, so that the best image produced may depend on the measure used. However, in some s of the examples given below, a signal to noise (SNR) maximum measure across a large area of the image gives the best image defined by the signal to noise ratio measure used. It also produced images with higher contrast of local features and higher resolution of fine detail. So initially, a SNR measure appears to be the best image quality measure for example when laser speckle is present.
io When small details need to be resolved, a contrast measure appears to be the best image quality measure.
The method can be used to give the best image quality for other image quality measures including those that combine contrast, SNR and resolution measures if necessary.
Is One embodiment of the method is based on the incorporation of a polarimeter into a laser scanning system combined with a specialized spatially resolved calculation and image display. After calculating the spatially resolved Mueller matrix of a sample, images for incident light with different states of polarization are reconstructed with increments chosen of 1 degree for azimuth 2o and ellipticity over the Poincare sphere. The increments over the Poincare sphere chosen in the calculation could be varied. The calculation generates images for incoming polarization states that could not be generated in the experimental imaging system. The best computed image in both reflected light m microscope and ophthalmoscope modes as well as in transmission Macroscope mode, are better than any of the original images recorded with polarimetry. In contrast, the worst computed images are poorer.
Referring to Figure 1, a schematic diagram of a confocal scanning s microscope modified to include a polarimeter'3 is shown generally at 10 with the polarimeter comprising a generator unit 12 which includes a fixed linear polarizer P1 and a rotating 1l4-wave plate QWP1. The apparatus includes an analyzer 14 in a symmetric configuration with respect to the generator 12 which comprises a fixed linear polarizer P2 and a rotating 1I4-wave plate QWP2 in the analyzer unit.
to The system 10 may be used in both microscope and ophthalmoscope modes. In the microscope mode, the focal length and the numerical aperture for the objective lens 16 was 90 mm and 0.11 respectively but it will be understood that different objective lenses may be used. In the ophthalmoscope mode, the patient's eye itself acted as a microscope objective. A 633-nm He-Ne laser 18 is ~s used as the light source and a photo-multiplier tube as the detector but those skilled in the art will appreciate that other light sources or photodetectors may be used, either in a modified commercial microscope or commercial ophthalmoscope or in a customized design.
An X-Y scanning system 30 permits the light beam to be scanned across 2o the sample or inside or outside of the eyeball of the patient in a raster.
Any commercially available raster scan system, or application specific system or any novel system may be used including resonance scanners, galvonometer scanners, oscillating mirrors, acosto-optic deflectors, solid state deflectors, single is facet or polygon rotating mirrors, holographic scanners or micro-electro mechanical scanners. The beam splitter BS directs information bearing light beam reflected from the sample or eyeball through the collector lens 28 through confocal pinhole 26 onto the detector 22.
s The laser beam is scanned in two dimensions and focused on the sample (a target or the retina) by the objective or the ocular optics. The light reflected back from the sample at each point of the scan is recorded by the detector 22. In studies conducted by the inventors the size of the light beam entering the objective 16 (and the eye) was 2.5 mm and the confocal pinhole 26 io was 600 microns in diameter. The focal length of the collector lens 28 was mm. The system records images at a rate of 28.5 Hz. However it will be appreciated that these variables are exemplary only and may be varied by those skilled in the art.
Referring to Figure 6, a schematic diagram of a scanning Macroscope in Is transmission mode modified to include a polarimeter'3 is shown generally at with the polarimeter comprising a generator unit 41 which includes a fixed linear polarizer and a rotating'/4 wave plate. The apparatus includes an analyzer 42 in a symmetric configuration with respect to the generator which comprises a fixed linear polarizer and a rotating'/ wave plate in the analyzer unit. A wide angle ao telecentric lens 45 is used in the Macroscope but it will be understood that different objective lenses may be used in a Macroscope or microscope configuration. A 633-nm He-Ne laser is used as the light source 43 and a photo-multiplier tube as the detector 44 but those skilled in the art will appreciate that i9 other light sources or photodetectors may be used, either in a modified commercial microscope or in a customized design.
A linear scanning system 46 permits the light beam to be scanned across the sample and is combined with a stage moving in a perpendicular direction to s create a raster scan of the object. Any commercially available raster scan system, or application specific system or any novel system may be used including resonance scanners, galvonometer scanners, oscillating mirrors, acosto-optic deflectors, solid state deflectors, single facet or polygon rotating mirrors, holographic scanners or micro-elctro mechanical scanners or any io mechanical means of scanning the beam and or stage in 1 or 2 dimensions.
The information bearing light beam transmitted by the sample goes through the collector lens 45 onto the detector.
The laser beam is focused on the sample by the objective. The light transmitted by the sample at each point of the scan is recorded by the detector.
Is However it will be appreciated that the variables used here are exemplary only and may be varied by those skilled in the art.
The sixteen (16) combinations of polarization states required to calculate the Mueller matrix for each point of the scanned sample correspond to different angles of the fast axes of the two rotating quarter-wave plates QWP1 and QWP2 2o as previously described'4. The generator 12 and analyzer 14 in Figure 1 and in Figure 6 may be connected to computer controlled mechanical actuator system (not shown) for moving the 1/4 wave plates QWP1 and QWP2 into the four different positions. Alternately, fast electro-optical devices (including but not limited to liquid-crystals, photoelastic modulators) could be used to vary the polarization states of the generator and analyser'5 The system is calibrated by taking a measurement in the incoming pathway. This will give the Mueller matrix , Ms~N , of the instrument in the s incoming direction. A matrix of 16 intensity values results from intensity measurements with the generator's rotating '/ wave plate in each of four positions -45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/e wave plate is placed in each of the same four positions.
The outgoing direction of the instrument in figure 1 is also calibrated. This Io will give the Mueller matrix, Ms~N , of the instrument in the outgoing direction. A
matrix of 16 intensity values results from intensity measurements with the generator 1/4 wave plate QWP1 in each of four positions described previously while the analyzer 1 /4 wave plate QWP2 is placed in each of the same four positions.
rs Sixteen (16) gray scale images are taken with the object in place for each of the four generator states (1/4 wave plate QWP1 at 45, 0, 30 and 60 degrees) combined with each of the same four analyzer states (1/4 wave plate QWP2 set at 45, 0, 30 and 60 degrees while QWP1 is in each of its fours states). The generator produces polarized light at a particular orientation, set by a linear 2o polarizer P1 and the QWP1. The analyser composed of QWP2 and the linear polarizer P2 turns light of a particular polarization into linearly polarized light.
The 16 grey scale values for each pixel are placed into a spatially resolved matrix, I~"'"~ which is the first element of the Stokes vector, So ") reaching the photodetector.
For every Stokes vector S~ ) (m=1, 2, 3, 4) produced by the generator, the s intensity reaching the detector for each point of the sample (I~"'"~), is the first element of the Stokes vector SDmn) (n=1, 2, 3, 4) given by:
(mn) ~ (n) (z) (~) (m) Sn - M ,9 ~ MS('N ~ M ~ MSl'N ~ SG 1 where M=M;~ (i, j=0, 1, 2, 3) is the Mueller matrix of the sample under study, M An) is one of the four Mueller matrices of the analyzer unit (each corresponding to an to independent state), and MseN and NIs~N are the Mueller matrices of the experimental system itself (lenses, scanning unit and beam splitter) for first and second passages respectively, previously measured in the calibration process.
For each generator-analyzer combination, the image is spatially resolved, giving a spatially resolved M. Let MA be the 4x4 auxiliary matrix with each row being the is first row of every M'a ) and Mp~r=[So~T , Sour , SoUT , So~T ] be another auxiliary matrix with So~T each Stokes vector going into the analyzer unit. These matrices are then related:
l(1_1) 1(2I) I1~3_I) I(4_I) J(1_2) I(22) 1(3_2) I(4_2) j() 3) I(23) 1(3 _3) I(4_3) - MA ~ Mour I(14) I(2-4) 1(3._4) 1(4_4) l If M~=[ S~ ) , S~ ) , S~ ) , S~ ) ], then M is computed by means of:
~,~ l ~,~ t M=~MS~N~ 'Mour'~c~ '~scN~ (3) where MpuT is obtained by inversion of equation (2).
The system in Figure 6 (an example of a measurement of transmitted light) is calibrated by taking a measurement in the incoming pathway. This will s give the Mueller matrix , MscN , of the instrument in the incoming direction. A
matrix of 16 intensity values results from intensity measurements with the generator's rotating'/ wave plate in each of four positions --45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/ wave plate is placed in each of the same four positians.
~o Sixteen (16) gray scale images are taken with the object in place for each of the four generator states (1/4 wave plate QWP1 at 45, 0, 30 and 60 degrees) combined with each of the same four analyzer states (1/4 wave plate QWP2 set at 45, 0, 30 and 60 degrees while QWP1 is in each of its fours states). The generator produces polarized light at a particular orientation, set by a linear is polarizer P1 and the QWP1 and. The analyser composed of QWP2 and the linear polarizer P2 turns light of a particular polarization into linearly polarized light.
The 16 grey scale values for each pixel are placed into a spatially resolved matrix, I~"'~a which is the first element of the Stokes vector, So "' reaching the 2o photodetector.
For every Stokes vector S~'' (m=1, 2, 3, 4) produced by the generator, the intensity reaching the detector for each point of the sample (I~"'"~), is the first element of the Stokes vector So "' (n=1, 2, 3, 4) given by:
Scn,n> = MA~~ . M , Mca , S~m>
D SCN G
s where M=M;~ (i, j=0, 1, 2, 3) is the Mueller matrix of the sample under study, M a"' is one of the four Mueller matrices of the analyzer unit (each corresponding to an independent state), and MscN is the Mueller matrices of the experimental system itself (lenses, scanning unit and beam splitter), previously measured in the calibration process. For each generator-analyzer combination, to the image is spatially resolved, giving a spatially resolved M. Let MA be the 4x4 auxiliary matrix with each row being the first row of every M A"' and Mo~T=['Sour . Sour . Sour ~ "SOUT l be another auxiliary matrix with Sour each Stokes vector going into the analyzer unit. These matrices are then related by equation 2: If M~=[ 5~,." , S~2' , S~3' , S~' ], then M is computed by means of:
15 M = Mour ' ~MC, ~~ ~ \MSCN ~1 where MpuT is obtained by inversion of equation (2).
From the spatially resolved Mueller matrix calculated for the apparatus in either Figure 1 or in Figure 6, images of the sample I ~o"T' for any in-coming polarization state SiN can be obtained by:
(OUT
) M~ Mo, Mo2 Mo3 I
S~~our) M1o Mn M12 M13 cos(2x~~ cos(2~p~
__ S~"T M M M M sin(2,~)~ cos(2~p)M ~ 5,~
) 20 21 22 23 Sr30UT) M30 M.31 M32 M33 Sln(ZCp) 6) ( where x and cp represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere's. Using equation 6, we can determine the Stokes vectors that produce images with both best and worst quality. This quality s is defined below. This equation gives all output polarization properties.
Here we consider only the image intensity, I~°"T ) , to which only the four elements of the first row of the Mueller matrix contribute.
One parameter that may be used to characterize image quality is the speckle noise (SN) or the inverse of the signal-to-noise ratio (SNR) (often used to to describe speckle") defined as the ratio between the standard deviation and the mean intensity across the whole image:
_ stdv(I ~°'") ) SN = (SNR ~ --mean(I ~°"') ) (7) Other measures of image quality are possible including contrast across a local feature of the image, the size of the smallest features resolved in the image, is or measures which are combinations of SN, contrast and resolution including Fisher's linear discriminant.
The detailed steps followed to obtain improved images according to the present invention using the preferred Mueller matrix methodology are as follows.
First the methodology for reflection images is given.
20 1 ) Calibrate system 10 in Figure 1 by taking a measurement in the incoming pathway. This will give the Mueller matrix , MSCN , of the instrument in the incoming direction. For this measurement the analyzer is moved to the usual position of a sample. An intensity detector is placed behind the analyzer. Any scanning optics are turned off. A matrix of 16 intensity values results from s intensity measurements with the generator's rotating'/ wave plate in each of four positions -45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/ wave plate is placed in each of the same four positions.
2) Continue calibration. A mirror is placed at the plane of the sample. The analyzer and the intensity detector are moved behind the last optical element of to the system. This will give the Mueller matrix , MS~N , of the instrument in the outgoing direction. Any scanning optics are turned off. A matrix of 16 intensity values results from intensity measurements with the generator's'/ wave plate in each of four positions -45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/ wave plate is placed in each of the same four positions.
is 3) Take the intensity detector out of the system and turn the scanners on.
Record the 16 gray scale images with the object in place for each of the four generator states ('/ wave plate at 45, 0, 30 and 60 degrees) combined with each of the 4 analyzer states (1/4 wave plate at 45, 0, 30 and 60 degrees). The 16 grey scale values for each pixel are placed into a spatially resolved matrix, I~m"~ which is the 2o first element of the Stokes vector, So "' reaching the photodetector.
4) From I~"'"~ calculate Mo"t from equation 2.
5) From equation 3, calculate M, the spatially resolved Mueller matrix of the object.
6) Choose values of the incident Stokes vector, SIN, around the Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere'6 Applying equation 6, reconstruct images, IOut~, pixel by pixel for each incident s Stokes vector.
7) For each image, calculate the image quality measure of choice, for example SNR as defined in equation 7.
8) Display the image with best quality.
It is noted that the calibration in 1 ) and 2) just above may reduce the effect to of the instrument on the final polarization properties of the image.
However, it is possible to perform the method without calibration. In this case, the steps following b) are identical. The Mueller matrix derived is the matrix corresponding to the object plus the instrument. When taking images in depth, a more complex calibration process may be undertaken. Beginning at the top of a sample, the is Mueller matrix corresponding to a small thickness may be calculated. The calibration matrix MscN for the next layer below becomes M~,yERI ' Ms~N and MscN becomes MscN ~ MLAYERI . The Mueller matrix of the current layer M~qYER2 IS
then calculated as previously described. This method can be followed for all subsequent layers, incorporating the Mueller matrices for all layers above the 20 one currently being measured into the calibration matrices.
When system 10 is operated in microscope mode, spatially resolved Mueller matrices were calculated for two different samples: a U.S.A.F.
resolution chart (primarily specular reflections) and a grey scale image on white paper (primarily diffuse reflections, not shown here). Figure 2a shows the spatially resolved elements of the first row for the Mueller matrix corresponding to the USAF target. The averaged degrees of polarization were 0.87 (nearly specular) and 0.18 (highly depolarizing) for this target and the diffuse reflection s respectively. In the ophthalmoscope mode we applied the procedure to retinal images recorded in a living human eye. In Figure 3 we show the first row of the Mueller matrix for a retinal fundus region (with blood vessels).
Using these matrices, images were reconstructed for incident light with Stokes vectors with increments of 1 degree for azimuth and ellipticity over the to Poincare sphere. Images were obtained for incoming polarization states that could not be generated in an experimental system. For each matrix, both the best and the worst images were reconstructed using SNR as the measure of quality and the associated Stokes vectors calculated. The higher SNR shows that the best image calculated is better than the best measured with or without is the polarizer in place.
Figure 4 shows the results obtained for the specular reflection in microscope mode. The best (c) and the worst reconstructed images (a) as well as one of the original images are shown (b). Results for the retinal fundus image of figure 3 are presented on the left in Figure 5. On the right in Figure 5 results 2o for the retinal image of a second subject are shown. The original images presented are the best (lowest speckle noise or highest signal-to-noise ratio) of the images experimentally recorded (b). The worst reconstructed images are shown in (a). The improvement in the images obtained using this method was noticeable in all cases. Lower noise as well as higher contrast across features and higher resolution are seen in the best reconstructed image (c). Resolution improvement is demonstrated by the fact that more structural details and small features which are not discernible in the original images can be also observed.
s The improvement seen is better than that for frame averaging. Differences in the signal to noise as defined in equation 5 between the original and the best images were 48% for the specular target (70% for the diffuse target) in microscope mode and 45% for the retinal fundus image of Figure 4. The Stokes vectors for the best specular image in figure 4 was [1, -0.5fi5, -0.099, -0.819]T ([1, 0.220, 0.604, -to 0.766]T for the diffuse reflection) and those corresponding to the optimal retinal image were [1, 0.719, 0.262, 0.643]T for a subject measured in Figure 3 and [1, -0.969, 0.171, 0.174]T for the second subject with results in Figure 5.
Moreover, an increase of up to 30% was found in the contrast across the blood vessels of the subjects presented here.
~s Improvements in image quality using the present invention have been obtained for two different confocal scanning laser imaging systems, both indicated in Figure 1. These include a confocal scanning laser microscope and a confocal scanning laser ophthalmoscope (where the optics of the eye is the final imaging element before the object of interest (the fundus)). Improvements are 20 obtained whether or not a confocal pinhole 26 is used in front of the hotodetector and regardless of what size of confocal pinhole is used. Improvements are also obtained for any wavelength used.
Thus, it will be appreciated by those skilled in the art that the confocal imaging system shown in Figure 1 is meant to be a non-limiting example of an apparatus constructed in accordance with the present invention. The confocal imaging system shown in Figure 1 is one that has pinhole 26 conjugate to the object plane of interest so that apparatus 10 excludes light reflected from the object which is not in-focus on the detector 22. This leads to improved contrast because of the exclusion of scattered light in addition to the ability to resolve structures in depth and to reconstruct three-dimensional images is enhanced.
If depth resolution is important, then system 10 preferably should be used with io confocal pinhole 26. However, scanning laser ophthalmoscopy and microscopy is performed with a larger pinhole in place of the confocal pinhole or with other specialty apertures or without a pinhole and the present invention may be implement using an apparatus absent the confocal pinhole using the methodology described herein which also gives improved image quality.
is Similarly, the light source may be an incoherent light source or it may be a laser producing coherent light beams as light beams with the different polarization states can be produced. Diode lasers producing partially coherent light beams may also be used. Also, instead of using the fixed linear polarizes P1 in the generator 12 in apparatus 10 of Figure 1, a light source with intrinsic linear 2o polarization may be used.
In this description, scanning the beam illuminating the object which is then descanned allows a point detector to be used and the image to be recreated pixel by pixel using timing signals. If the beam is scanned and the light transmitted by an object is recorded, a stationary single detector cannot be used.
In this situation, a moving single detector or moving linear array synchronized to the scanning beam or an area array of detectors with an exposure equivalent to frame of the scan (e.g. a CCD array) may be used to record the image. An area s of the object may be illuminated with a scanning beam and reflected images without descanning could be recorded using a moving single detector or a moving linear array of detectors synchronized to the scanning beam or an area array of detectors with an exposure equivalent to 1 frame of the scan (eg a CCD
array) could be used to record the image. If a stationary beam were used to to illuminate the object, any detector which allowed spatial resolution of the image could be used including a single moving detector, a moving linear array of detectors or an area array of detectors (e.g. a CCD array). The pixelated image that results from any of the above configurations could then be analyzed as described herein.
is Secondly the methodology for transmission images is given.
1 ) Calibrate system in Figure 6 by taking a measurement in the incoming pathway. This will give the Mueller matrix , Ms~N , of the instrument in the incoming direction. For this the sample is removed. The intensity detector is behind the analyzer. Any scanning optics are turned off. A matrix of 16 intensity 2o values results from intensity measurements with the generator's rotating'/
wave plate in each of four positions -45 degrees, 0 degrees, 30 degrees and 60 degrees, while the analyzer's'/ wave plate is placed in each of the same four positions.
2) tlf using a supplementary detector for calibration, remove it. Turn the scanners (if any) on. Record the 16 gray scale images with the object in place for each of the four generator states ('/ wave plate at 45, 0, 30 and 60 degrees) combined with each of the 4 analyzer states (1/4 wave plate at 45, 0, 30 and s degrees). The 16 grey scale values for each pixel are placed into a spatially resolved matrix, I~'""~ which is the first element of the Stokes vector, SD "' reaching the photodetector.
3) From I~"'~~ calculate Mout from equation 2.
4) From equation 5, calculate M, the spatially resolved Mueller matrix of the to object.
5) Choose values of the incident Stokes vector, S,N, around the Poincare sphere in predetermined increments of x and ~p which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere's.
Applying equation 6, reconstruct images, IO"t>, pixel by pixel for each incident is Stokes vector.
Applying equation 6, reconstruct images, IO"t>, pixel by pixel for each incident is Stokes vector.
6) For each image, calculate the image quality measure of choice, for example SNR as defined in equation 7.
7) Display the image with best quality.
It is noted that the calibration in 1 ) just above may reduce the effect of the 2o instrument on the final polarization properties of the image. However, it is possible to perform the method without calibration. In this case, the steps following 1 ) are identical. The Mueller matrix derived is the matrix corresponding to the object plus the instrument. following b) are identical. The Mueller matrix derived is the matrix corresponding to the object plus the instrument.
When the system in Figure 6 is operated in transmisssion mode, spatially resolved Mueller matrices were calculated for a tissue sample. Figure 7 shows s the spatially resolved elements of the first row for the Mueller matrix corresponding to the tissue target.
Using this matrix, images were reconstructed for incident light with Stokes vectors with increments of 1 degree for azimuth and ellipticity over the Poincare sphere. Images were obtained for incoming polarization states that could not be to generated in an experimental system. For each matrix, both the best and the worst images were reconstructed using best SNR and best contrast as the measures of quality and the associated Stokes vectors calculated. The highest SNR measure shows improvement of some features and the highest contrast shows improvement of other figures.
is Figure 8 shows the best (b) reconstructed image using contrast as the quality measure, as well as the best reconstructed image (c) using the best SNR
(highest signal-to-noise ratio) as the quality measure as well as the best original image (a). The original image presented is an image experimentally recorded (a). The improvement in the images obtained using this method was noticeable 2o in all cases.
Improvements in image quality using the present invention have been obtained for three different confocal scanning laser imaging systems, indicated in Figures 1 and 6. These include a confocal scanning laser microscope, a confocal scanning laser ophthalmoscope (where the optics of the eye is the final imaging element before the object of interest (the fundus)) and a Macroscope.
Improvements are obtained in reflection and transmission modes, whether or not a confocal pinhole 26 is used in front of the hotodetector and regardless of what s size of confocal pinhole is used. Improvements are also obtained for any wavelength used.
Thus, it will be appreciated by those skilled in the art that the confocal imaging system shown in Figure 1 and the nonconfocal system in Figure 6 (one measuring reflected light and the other transmitted light) are meant to be a non-to limiting examples of an apparatus constructed in accordance with the present invention. The confocal imaging system shown in Figure 1 is one that has pinhole 26 conjugate to the object plane of interest so that apparatus 10 excludes light reflected from the object which is not in-focus on the detector 22. This leads to improved contrast because of the exclusion of scattered light in addition to the is ability to resolve structures in depth and to reconstruct three-dimensional images is enhanced. If depth resolution is important, then system 10 preferably should be used with confocal pinhole 26. However, scanning laser ophthalmoscopy and microscopy is performed with a larger pinhole in place of the confocal pinhole or with other specialty apertures or without a pinhole and the present invention may 2o be implement using an apparatus absent the confocal pinhole using the methodology described herein which also gives improved image quality. This instrument could also be combined with an optical coherent tomography measurement or could be an optical coherent tomography instrument.
Similarly, the light source in Figure 1 or Figure 6 may be an incoherent light source or it may be a laser producing coherent light beams as fight beams with the different polarization states can be produced. Diode lasers producing partially coherent light beams may also be used. Also, instead of using the fixed s linear polarizer P1 in the generator 12 in apparatus 10 of Figure 1 or in Figure 6, a light source with intrinsic linear polarization may be used.
In the description in Figure 1, scanning the beam illuminating the object which is then descanned allows a point detector to be used and the image to be recreated pixel by pixel using timing signals. In Figure 6, the laser beam is io scanned in one direction and the stage is scanned in the perpendicular direction and a detector with an array of light sensitive elements is used. If the beam is scanned and the light transmitted by an object is recorded, a stationary single detector cannot be used. In this situation, a moving single detector or moving linear array synchronized to the scanning beam or an area array of detectors with is an exposure equivalent to 1 frame of the scan (e.g. a CCD array as in Figure 6) may be used to record the image. An area of the object may be illuminated with a scanning beam and reflected images without descanning could be recorded using a moving single detector or a moving linear array of detectors synchronized to the scanning beam or an area array of detectors with an exposure equivalent Zo to 1 frame of the scan (eg a CCD array) could be used to record the image.
If a stationary beam were used to illuminate the object, any detector which allowed spatial resolution of the image could be used including a single moving detector, a moving linear array of detectors or an area array of detectors (e.g. a CCD
array). In any of the above descriptions, the object stage may be scanned and this would replace the scanning of the light beam. The pixelated image that results from any of the above configurations could then be analyzed as described herein.
s Although in the invention disclosed herein the inventors have calculated the 16 elements of the Mueller matrix, just 4 of them (first row) are used to calculate the final improved image. Therefore, an additional methodology based on the calculation of just these 4 elements instead of 16 may result in the same improved images.
io Therefore, for each independent polarization state emerging from the generator unit S~' (i=1, 2, 3, 4), the Stokes vector associated with the light reaching the recording state, SF' , when no analizer is included in the system is given by:
~~co = M . Sc~> __ Mc2~ , M , Mm , Sco (1 b) F T G - SYST SYST G
or when transmitted light is measured S~~' = MT ' Sc' = M ' Msys~T ' Sc' (4b) 2o where MT= m kr' (I, m = 0, 1, 2, 3), is the Mueller matrix of the complete system and M is the Mueller matrix of the sample under study. Ms sT and MSYST are the Mueller matrices obtained from the calibration procedure.
Let MO be the 4 x 1 column vector which elements are the first row of the Mueller matrix MT in a transposed position. When four independent polarization 2s states, S~' (i = 1, 2, 3, 4) are incident, then it is verified:
1~G SZG 'S3G m~00~ (SGI~~ m00T
12 'SOG 'S10 'S2Gmol (S~2)~ m01 '~3G ) ) 13 'SAG .~I( ~ m o2 (5~3~~ yn~2 G 0 Zb ~52~ S3G ) ~
14 '~ m (sr4,~~ m '~ ) ) "S
) '~
) OG
where Ii (i = 1, 2, 3, 4) corresponds to the recorded images for each independent polarization states S~' .
s Finally Mp is obtained by inversion of equation (2b):
Mo - ~MG l l .1~. (3b) From the spatially resolved vector Mo, images of the sample lout for any in-coming polarization state SAN can be obtained by:
( ~r> ~r~ ~r> ~T~ ), cos(2x~~ cos(2rp~
I FnN,ac = moo mol moz mo3 = Mo ~ SIN
sin(2x)~ cos(2~p) sin (2~p ) to (6b) where x and cp represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere and Mo~ is the transposed vector of Mo. Using equation 6b, we can determine the Stokes vectors that produce images with both best and worst quality using the chosen measure of image is quality.
The detailed steps followed to obtain improved images according to the present invention using apparatus 10 in Figure 1 are as follows. The optical scanning system (shown in Figure 10) is calibrated as described above a) calibrating the confocal scanning laser system (microscope or 20 ophthalmoscope) modified to include a polarization generator and a polarization analyzer to obtain a Mueller matrix MS~N , of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a fixed linear polarizer and a rotating'/4 wave plate located in said generator positioned in each of four positions including -45 degrees, 0 s degrees, 30 degrees and 60 degrees, while a fixed linear polarizer and a'/
wave plate (symmetric configuration with respect to the generator) located in the analyzer is placed in each of the same four positions; in order to measure the above cited matrix, the analyzer and an intensity detector are placed in the place of the sample;
to b) calibrating the confocal scanning instrument to obtain a Mueller matrix Ms~N , of the instrument in the outgoing direction, wherein a matrix of 16 intensity values results from intensity measurements with a fixed linear polarizer and a rotating'/ wave plate located in said generator positioned in each of four positions including -45 degrees, 0 degrees, 30 degrees and 60 degrees, while a is fixed linear polarizer and a'/ wave plate (symmetric configuration with respect to said generator) located in said analyzer is placed in each of the same four positions; in this case a mirror is placed in place of the sample and the analyzer unit and the intensity detector are placed in the confocal detection arm;
c) analyzer and detector are removed from the recording pathway and just 2o the generator is used for the new method.
d) placing the object in the confocal scanning apparatus and focusing light onto the object and recording four gray scale images with the object in place for each of four generator states with a'/ wave plate at 45, 0, 30 and 60 degrees;
e) placing the four grey scale values for each pixel into a spatially resolved vector, IF, which elements are the first element of the four S~'' reaching the photodetector;
f) from equation 3b calculate Mo, the spatially resolved auxiliary which s elements are the first row of the total Mueller matrix, MT;
g) choosing values of an incident Stokes vector, S,N, around a Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
h) applying equation 4b to reconstruct images, IouT, pixel by pixel for each to incident Stokes vector;
i) for each image, calculate the image quality measure of choice; and j) display the image with best value of the image quality measure.
It is noted that the calibration in a) and b) just above may reduce the effect is of the instrument on the final polarization properties of the image.
However, it is possible to perform the method without calibration. In this case, the steps following b) are identical. The first row derived is the first row of the Mueller matrix of the object +instrument).
The detailed steps followed to obtain improved images according to the 2o present invention using the apparatus in Figure 6 are as follows. The optical scanning system (shown in Figure 6) is calibrated as described above a) calibrating the Macroscope modified to include a polarization generator and a polarization analyzer to obtain a Mueller matrix MscN , of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a fixed linear polarizer and a rotating '/ wave plate located in said generator positioned in each of four positions including -45 degrees, 0 degrees, 30 degrees and 60 degrees, while a fixed linear polarizer s and a'/ wave plate (symmetric configuration with respect to the generator) located in the analyzer is placed in each of the same four positions; in order to measure the above cited matrix, the analyzer is placed in the place of the sample;
b) analyzer is removed from the recording pathway and just the generator to is used for the new method.
c) placing the object in the Macroscope and focusing light onto the object and recording four gray scale images with the object in place for each of four generator states with a'/4 wave plate at 45, 0, 30 and 60 degrees;
e) placing the four grey scale values for each pixel into a spatially resolved Is vector, IF, which elements are the first element of the four S~'~ reaching the photodetector;
SFi~ =Mr'ScW M'MsYSr'sc~ (1C) f) from equation 3b calculate Ma, the spatially resolved auxiliary which elements are the first row of the total Mueller matrix, MT;
ao g) choosing values of an incident Stokes vector, S,N, around a Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
h) applying equation 4b to reconstruct images, lour, pixel by pixel for each incident Stokes vector;
i) for each image, calculate the image quality measure of choice; and j) display the image with best value of the image quality measure.
In situations where the state of polarization of the input beam cannot be controlled (e.g. astronomical observations), or in situations where the output illumination is intrinsic to the sample (e.g. fluorescence microscopy), this shortened method just described may be modified to use a single input to polarization state and to sample the spatially resolved image for 4 output polarization states. The 4 elements of the Stokes vector associated with uncontrolled light, Sin, can be calculated from equations 2, where the matrix on the left containing the intensities now is a column vector 4x1 and the matrix Mo~T
is the unknown Stokes vector, S,N.This is shown in equation 1 d I«~
( l_ I(2~
\MAl ~ I(3) \M,4/ ~IF -'SIN (1d) Ica~
i Images corresponding to any output polarization state, I°"T> , are then obtained from equation 2c as:
I(oUT~
a n~a UT ~ -a ,(OUT) ~ A ~ "SIN
2a 2Q S3a UT ) (2c) where M A is the Mueller matrix for each theoretical orientation of the fast axis of the ~~ wave plate of the analyzer unit.
The detailed methodology is as follows:
a) generator and detector are removed from the recording pathway and s just the analyzer is used for this method;
b) passing the light coming from the object trough the analyzer unit.
c) recording one gray scale image for each of four analyser states with a '/ wave plate at 45, 0, 30 and 60 degrees;
e) placing said four grey scale values for each pixel into a spatially ~o resolved vector, IF, which elements are the first element of the four Stokes vectors reaching the photodetector;
f) from equation 1 d calculate S,N, the spatially resolved Stokes vector corresponding to the sample light beam;
g) predetermined increments for the orientation of the fast axis of the ~~
as wave plate of the analyzer unit, a;
h) applying equation 2c to reconstruct images, I° "T > , pixel by pixel for each orientation if the'/ wave plate;
i) for each image, calculate the image quality measure of choice; and j) display the image with best value of the image quality measure.
It will be understood that the present methodology is not restricted to the calculation of 4 x 4 Mueller matrices from combinations of 4 incoming and 4 outgoing polarization states in the first method discussed above or to the first row of the Mueller matrix in the second method or to one input and four output beams in the third method disclosed above. It is noted that any other matrix which describes the effect of the object on the polarization properties of light may also be used. Thus, while Mueller matrices are always 4 x 4 it is possible to use more combinations of beam in- and beam out- polarization states.
s When Mueller matrices are used, once the spatially resolved 4 x 4 Mueller matrix of the object is constructed from the detected light signals one constructs spatially resolved images of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states actually generated in the incident light beams. The images are calculated point by point for a large to number of polarization states (sampled all around the Poincare sphere in 1 degree steps in one example implementation). These polarization states can each be described by a Stokes vector where the Stokes vector characterizes the polarization of the input light beam. The first element of the vector gives the intensity of the beam, the second element gives the degree of vertical or Is horizontal polarization, the third element of the Stokes vector gives the degree of +45 or -45 linear polarization and the fourth element of the Stokes vector gives the degree and direction of circular polarization. So for each image constructed, one uses the Mueller matrix which has been calculated point by point and a Stokes vector to generate an image point by point. Once the calculation has 2o been done for a chosen number of polarization states, then the best image is chosen. The calculation would normally include four independent polarization states that the generator unit is designed to produce as well as a set of theoretical input polarization states that are not easily produced experimentally.
In conclusion, the present invention demonstrates the use of Mueller-matrix polarimetry for improving the quality of confocal scanning microscopy, confocal scanning ophthalmoscopy and optical coherence tomography images.
In another embodiment of the invention the optical system may use fast electro-s optical modulators such as liquid-crystal variable retarders or photo-elastic modulators. The polarization state which gives the best improvement in image quality differs for the specular and diffuse reflections in microscope mode and for the two analyzed subjects in ophthalmoscopic mode. In general as in imaging with polarized light'$, the Stokes vector corresponding to the best image may io vary with the characteristics of the object being measured. To implement the technique, the improvement in the image may be rapidly calculated and displayed in software. The best image may be calculated with respect to a region of the image of interest. An implementation of this technique in commercially available microscopy, macroscopy, optical coherence tomography Is and ophthalmologic instruments'°''9 or in a specialized instrument enhances fundus imaging and improves diagnosis techniques.
As used herein, the terms "comprises" and "comprising" are to be construed as being inclusive and open ended, and not exclusive. Specifically, when used in this specification including claims, the terms "comprises" and 20 "comprising" and variations thereof mean the specified features, steps or components are included. These terms are not to be interpreted to exclude the presence of other features, steps or components.
The foregoing description of the preferred embodiments of the invention has been presented to illustrate the principles of the invention and not to limit the invention to the particular embodiment illustrated. It is intended that the scope of the invention be defined by all of the embodiments encompassed within the s following claims and their equivalents.
REFERENCES
1. J. B. Pawley (Editor), Handbook of Biological Confocal Microscopy, 2"d ed.
Plenum, New York (1995).
io 2. A. C. Ribes, S. Damaskinos, A. E. Dixon, K. A. Kellis, S. P. Duttagupta, and P. M. Fauchet, Progress in Surface Science, 50, 295 (1995).
3. R. H. Webb, G. W. Hughes, and F. C. Delori, Appl. Opt. 26, 1492 (1987).
4. J. Liang, D. R. Williams, and D. T. Miller, J. Opt. Soc. Am. A 14, 2884 (1997).
5. I. Iglesias and P. Artal. Opt. Lett. 2a, 1804 (2000).
Is 6. K. Muth, M.C.W. Campbell, A. J. Roorda, and C. Cui, OSA Technical Digest Series 1, 56-59 (1997).
7. M. P. Rowe, E. N. Pugh, Jr., J. S. Tyo, and N. Engheta, Opt. Lett. 20, 608 (1995).
It is noted that the calibration in 1 ) just above may reduce the effect of the 2o instrument on the final polarization properties of the image. However, it is possible to perform the method without calibration. In this case, the steps following 1 ) are identical. The Mueller matrix derived is the matrix corresponding to the object plus the instrument. following b) are identical. The Mueller matrix derived is the matrix corresponding to the object plus the instrument.
When the system in Figure 6 is operated in transmisssion mode, spatially resolved Mueller matrices were calculated for a tissue sample. Figure 7 shows s the spatially resolved elements of the first row for the Mueller matrix corresponding to the tissue target.
Using this matrix, images were reconstructed for incident light with Stokes vectors with increments of 1 degree for azimuth and ellipticity over the Poincare sphere. Images were obtained for incoming polarization states that could not be to generated in an experimental system. For each matrix, both the best and the worst images were reconstructed using best SNR and best contrast as the measures of quality and the associated Stokes vectors calculated. The highest SNR measure shows improvement of some features and the highest contrast shows improvement of other figures.
is Figure 8 shows the best (b) reconstructed image using contrast as the quality measure, as well as the best reconstructed image (c) using the best SNR
(highest signal-to-noise ratio) as the quality measure as well as the best original image (a). The original image presented is an image experimentally recorded (a). The improvement in the images obtained using this method was noticeable 2o in all cases.
Improvements in image quality using the present invention have been obtained for three different confocal scanning laser imaging systems, indicated in Figures 1 and 6. These include a confocal scanning laser microscope, a confocal scanning laser ophthalmoscope (where the optics of the eye is the final imaging element before the object of interest (the fundus)) and a Macroscope.
Improvements are obtained in reflection and transmission modes, whether or not a confocal pinhole 26 is used in front of the hotodetector and regardless of what s size of confocal pinhole is used. Improvements are also obtained for any wavelength used.
Thus, it will be appreciated by those skilled in the art that the confocal imaging system shown in Figure 1 and the nonconfocal system in Figure 6 (one measuring reflected light and the other transmitted light) are meant to be a non-to limiting examples of an apparatus constructed in accordance with the present invention. The confocal imaging system shown in Figure 1 is one that has pinhole 26 conjugate to the object plane of interest so that apparatus 10 excludes light reflected from the object which is not in-focus on the detector 22. This leads to improved contrast because of the exclusion of scattered light in addition to the is ability to resolve structures in depth and to reconstruct three-dimensional images is enhanced. If depth resolution is important, then system 10 preferably should be used with confocal pinhole 26. However, scanning laser ophthalmoscopy and microscopy is performed with a larger pinhole in place of the confocal pinhole or with other specialty apertures or without a pinhole and the present invention may 2o be implement using an apparatus absent the confocal pinhole using the methodology described herein which also gives improved image quality. This instrument could also be combined with an optical coherent tomography measurement or could be an optical coherent tomography instrument.
Similarly, the light source in Figure 1 or Figure 6 may be an incoherent light source or it may be a laser producing coherent light beams as fight beams with the different polarization states can be produced. Diode lasers producing partially coherent light beams may also be used. Also, instead of using the fixed s linear polarizer P1 in the generator 12 in apparatus 10 of Figure 1 or in Figure 6, a light source with intrinsic linear polarization may be used.
In the description in Figure 1, scanning the beam illuminating the object which is then descanned allows a point detector to be used and the image to be recreated pixel by pixel using timing signals. In Figure 6, the laser beam is io scanned in one direction and the stage is scanned in the perpendicular direction and a detector with an array of light sensitive elements is used. If the beam is scanned and the light transmitted by an object is recorded, a stationary single detector cannot be used. In this situation, a moving single detector or moving linear array synchronized to the scanning beam or an area array of detectors with is an exposure equivalent to 1 frame of the scan (e.g. a CCD array as in Figure 6) may be used to record the image. An area of the object may be illuminated with a scanning beam and reflected images without descanning could be recorded using a moving single detector or a moving linear array of detectors synchronized to the scanning beam or an area array of detectors with an exposure equivalent Zo to 1 frame of the scan (eg a CCD array) could be used to record the image.
If a stationary beam were used to illuminate the object, any detector which allowed spatial resolution of the image could be used including a single moving detector, a moving linear array of detectors or an area array of detectors (e.g. a CCD
array). In any of the above descriptions, the object stage may be scanned and this would replace the scanning of the light beam. The pixelated image that results from any of the above configurations could then be analyzed as described herein.
s Although in the invention disclosed herein the inventors have calculated the 16 elements of the Mueller matrix, just 4 of them (first row) are used to calculate the final improved image. Therefore, an additional methodology based on the calculation of just these 4 elements instead of 16 may result in the same improved images.
io Therefore, for each independent polarization state emerging from the generator unit S~' (i=1, 2, 3, 4), the Stokes vector associated with the light reaching the recording state, SF' , when no analizer is included in the system is given by:
~~co = M . Sc~> __ Mc2~ , M , Mm , Sco (1 b) F T G - SYST SYST G
or when transmitted light is measured S~~' = MT ' Sc' = M ' Msys~T ' Sc' (4b) 2o where MT= m kr' (I, m = 0, 1, 2, 3), is the Mueller matrix of the complete system and M is the Mueller matrix of the sample under study. Ms sT and MSYST are the Mueller matrices obtained from the calibration procedure.
Let MO be the 4 x 1 column vector which elements are the first row of the Mueller matrix MT in a transposed position. When four independent polarization 2s states, S~' (i = 1, 2, 3, 4) are incident, then it is verified:
1~G SZG 'S3G m~00~ (SGI~~ m00T
12 'SOG 'S10 'S2Gmol (S~2)~ m01 '~3G ) ) 13 'SAG .~I( ~ m o2 (5~3~~ yn~2 G 0 Zb ~52~ S3G ) ~
14 '~ m (sr4,~~ m '~ ) ) "S
) '~
) OG
where Ii (i = 1, 2, 3, 4) corresponds to the recorded images for each independent polarization states S~' .
s Finally Mp is obtained by inversion of equation (2b):
Mo - ~MG l l .1~. (3b) From the spatially resolved vector Mo, images of the sample lout for any in-coming polarization state SAN can be obtained by:
( ~r> ~r~ ~r> ~T~ ), cos(2x~~ cos(2rp~
I FnN,ac = moo mol moz mo3 = Mo ~ SIN
sin(2x)~ cos(2~p) sin (2~p ) to (6b) where x and cp represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere and Mo~ is the transposed vector of Mo. Using equation 6b, we can determine the Stokes vectors that produce images with both best and worst quality using the chosen measure of image is quality.
The detailed steps followed to obtain improved images according to the present invention using apparatus 10 in Figure 1 are as follows. The optical scanning system (shown in Figure 10) is calibrated as described above a) calibrating the confocal scanning laser system (microscope or 20 ophthalmoscope) modified to include a polarization generator and a polarization analyzer to obtain a Mueller matrix MS~N , of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a fixed linear polarizer and a rotating'/4 wave plate located in said generator positioned in each of four positions including -45 degrees, 0 s degrees, 30 degrees and 60 degrees, while a fixed linear polarizer and a'/
wave plate (symmetric configuration with respect to the generator) located in the analyzer is placed in each of the same four positions; in order to measure the above cited matrix, the analyzer and an intensity detector are placed in the place of the sample;
to b) calibrating the confocal scanning instrument to obtain a Mueller matrix Ms~N , of the instrument in the outgoing direction, wherein a matrix of 16 intensity values results from intensity measurements with a fixed linear polarizer and a rotating'/ wave plate located in said generator positioned in each of four positions including -45 degrees, 0 degrees, 30 degrees and 60 degrees, while a is fixed linear polarizer and a'/ wave plate (symmetric configuration with respect to said generator) located in said analyzer is placed in each of the same four positions; in this case a mirror is placed in place of the sample and the analyzer unit and the intensity detector are placed in the confocal detection arm;
c) analyzer and detector are removed from the recording pathway and just 2o the generator is used for the new method.
d) placing the object in the confocal scanning apparatus and focusing light onto the object and recording four gray scale images with the object in place for each of four generator states with a'/ wave plate at 45, 0, 30 and 60 degrees;
e) placing the four grey scale values for each pixel into a spatially resolved vector, IF, which elements are the first element of the four S~'' reaching the photodetector;
f) from equation 3b calculate Mo, the spatially resolved auxiliary which s elements are the first row of the total Mueller matrix, MT;
g) choosing values of an incident Stokes vector, S,N, around a Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
h) applying equation 4b to reconstruct images, IouT, pixel by pixel for each to incident Stokes vector;
i) for each image, calculate the image quality measure of choice; and j) display the image with best value of the image quality measure.
It is noted that the calibration in a) and b) just above may reduce the effect is of the instrument on the final polarization properties of the image.
However, it is possible to perform the method without calibration. In this case, the steps following b) are identical. The first row derived is the first row of the Mueller matrix of the object +instrument).
The detailed steps followed to obtain improved images according to the 2o present invention using the apparatus in Figure 6 are as follows. The optical scanning system (shown in Figure 6) is calibrated as described above a) calibrating the Macroscope modified to include a polarization generator and a polarization analyzer to obtain a Mueller matrix MscN , of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a fixed linear polarizer and a rotating '/ wave plate located in said generator positioned in each of four positions including -45 degrees, 0 degrees, 30 degrees and 60 degrees, while a fixed linear polarizer s and a'/ wave plate (symmetric configuration with respect to the generator) located in the analyzer is placed in each of the same four positions; in order to measure the above cited matrix, the analyzer is placed in the place of the sample;
b) analyzer is removed from the recording pathway and just the generator to is used for the new method.
c) placing the object in the Macroscope and focusing light onto the object and recording four gray scale images with the object in place for each of four generator states with a'/4 wave plate at 45, 0, 30 and 60 degrees;
e) placing the four grey scale values for each pixel into a spatially resolved Is vector, IF, which elements are the first element of the four S~'~ reaching the photodetector;
SFi~ =Mr'ScW M'MsYSr'sc~ (1C) f) from equation 3b calculate Ma, the spatially resolved auxiliary which elements are the first row of the total Mueller matrix, MT;
ao g) choosing values of an incident Stokes vector, S,N, around a Poincare sphere in predetermined increments of x and cp which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
h) applying equation 4b to reconstruct images, lour, pixel by pixel for each incident Stokes vector;
i) for each image, calculate the image quality measure of choice; and j) display the image with best value of the image quality measure.
In situations where the state of polarization of the input beam cannot be controlled (e.g. astronomical observations), or in situations where the output illumination is intrinsic to the sample (e.g. fluorescence microscopy), this shortened method just described may be modified to use a single input to polarization state and to sample the spatially resolved image for 4 output polarization states. The 4 elements of the Stokes vector associated with uncontrolled light, Sin, can be calculated from equations 2, where the matrix on the left containing the intensities now is a column vector 4x1 and the matrix Mo~T
is the unknown Stokes vector, S,N.This is shown in equation 1 d I«~
( l_ I(2~
\MAl ~ I(3) \M,4/ ~IF -'SIN (1d) Ica~
i Images corresponding to any output polarization state, I°"T> , are then obtained from equation 2c as:
I(oUT~
a n~a UT ~ -a ,(OUT) ~ A ~ "SIN
2a 2Q S3a UT ) (2c) where M A is the Mueller matrix for each theoretical orientation of the fast axis of the ~~ wave plate of the analyzer unit.
The detailed methodology is as follows:
a) generator and detector are removed from the recording pathway and s just the analyzer is used for this method;
b) passing the light coming from the object trough the analyzer unit.
c) recording one gray scale image for each of four analyser states with a '/ wave plate at 45, 0, 30 and 60 degrees;
e) placing said four grey scale values for each pixel into a spatially ~o resolved vector, IF, which elements are the first element of the four Stokes vectors reaching the photodetector;
f) from equation 1 d calculate S,N, the spatially resolved Stokes vector corresponding to the sample light beam;
g) predetermined increments for the orientation of the fast axis of the ~~
as wave plate of the analyzer unit, a;
h) applying equation 2c to reconstruct images, I° "T > , pixel by pixel for each orientation if the'/ wave plate;
i) for each image, calculate the image quality measure of choice; and j) display the image with best value of the image quality measure.
It will be understood that the present methodology is not restricted to the calculation of 4 x 4 Mueller matrices from combinations of 4 incoming and 4 outgoing polarization states in the first method discussed above or to the first row of the Mueller matrix in the second method or to one input and four output beams in the third method disclosed above. It is noted that any other matrix which describes the effect of the object on the polarization properties of light may also be used. Thus, while Mueller matrices are always 4 x 4 it is possible to use more combinations of beam in- and beam out- polarization states.
s When Mueller matrices are used, once the spatially resolved 4 x 4 Mueller matrix of the object is constructed from the detected light signals one constructs spatially resolved images of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states actually generated in the incident light beams. The images are calculated point by point for a large to number of polarization states (sampled all around the Poincare sphere in 1 degree steps in one example implementation). These polarization states can each be described by a Stokes vector where the Stokes vector characterizes the polarization of the input light beam. The first element of the vector gives the intensity of the beam, the second element gives the degree of vertical or Is horizontal polarization, the third element of the Stokes vector gives the degree of +45 or -45 linear polarization and the fourth element of the Stokes vector gives the degree and direction of circular polarization. So for each image constructed, one uses the Mueller matrix which has been calculated point by point and a Stokes vector to generate an image point by point. Once the calculation has 2o been done for a chosen number of polarization states, then the best image is chosen. The calculation would normally include four independent polarization states that the generator unit is designed to produce as well as a set of theoretical input polarization states that are not easily produced experimentally.
In conclusion, the present invention demonstrates the use of Mueller-matrix polarimetry for improving the quality of confocal scanning microscopy, confocal scanning ophthalmoscopy and optical coherence tomography images.
In another embodiment of the invention the optical system may use fast electro-s optical modulators such as liquid-crystal variable retarders or photo-elastic modulators. The polarization state which gives the best improvement in image quality differs for the specular and diffuse reflections in microscope mode and for the two analyzed subjects in ophthalmoscopic mode. In general as in imaging with polarized light'$, the Stokes vector corresponding to the best image may io vary with the characteristics of the object being measured. To implement the technique, the improvement in the image may be rapidly calculated and displayed in software. The best image may be calculated with respect to a region of the image of interest. An implementation of this technique in commercially available microscopy, macroscopy, optical coherence tomography Is and ophthalmologic instruments'°''9 or in a specialized instrument enhances fundus imaging and improves diagnosis techniques.
As used herein, the terms "comprises" and "comprising" are to be construed as being inclusive and open ended, and not exclusive. Specifically, when used in this specification including claims, the terms "comprises" and 20 "comprising" and variations thereof mean the specified features, steps or components are included. These terms are not to be interpreted to exclude the presence of other features, steps or components.
The foregoing description of the preferred embodiments of the invention has been presented to illustrate the principles of the invention and not to limit the invention to the particular embodiment illustrated. It is intended that the scope of the invention be defined by all of the embodiments encompassed within the s following claims and their equivalents.
REFERENCES
1. J. B. Pawley (Editor), Handbook of Biological Confocal Microscopy, 2"d ed.
Plenum, New York (1995).
io 2. A. C. Ribes, S. Damaskinos, A. E. Dixon, K. A. Kellis, S. P. Duttagupta, and P. M. Fauchet, Progress in Surface Science, 50, 295 (1995).
3. R. H. Webb, G. W. Hughes, and F. C. Delori, Appl. Opt. 26, 1492 (1987).
4. J. Liang, D. R. Williams, and D. T. Miller, J. Opt. Soc. Am. A 14, 2884 (1997).
5. I. Iglesias and P. Artal. Opt. Lett. 2a, 1804 (2000).
Is 6. K. Muth, M.C.W. Campbell, A. J. Roorda, and C. Cui, OSA Technical Digest Series 1, 56-59 (1997).
7. M. P. Rowe, E. N. Pugh, Jr., J. S. Tyo, and N. Engheta, Opt. Lett. 20, 608 (1995).
8. Y. Gang and L. V. Wang, Opt. Lett. 24, 537 (1999).
20 9. S. Jiao Y. Gang and L. V. Wang, Appl. Opt. 39, 6318 (2000).
10.A. W. Dreher, K. Reiter, and R. N. Weinred, Appl. Opt. 31, 3730 (1992).
11. W. G. Egan, W. R. Johnson, and V. S. Whitehead, Appl. Opt. 30, 435 (1991 ) 12. W. Mickols, I Tinoco, J. E. Katz, M. F. Maestre, and C. Bustamente, Rev.
Sci.
Instrum. 12, 2228 (1985).
2s 13. R. A. Chipman, in Handbook of Optics, 2nd ed., M. Bass, ed. (McGraw-Hill, New York, 1995) Sec. 22.1.
14. J. M. Bueno and J. Jaronski, Opthal. Physiol. Opt. 21, 384 (2001 ).
15. J. M. Bueno and P. Artal, Opt. Lett. 24, 64 (1999).
16. H. G. Jerrard, J. Opt. Soc. Am. 44, 634 (1954).
17. J. W. Goodman, in Laser Speckle and Related Phenomena, 2nd ed., J.C.
Dainty, ed., Vol. 9 of Topics in Applied Physics (Springer-Verlag,1984), 9-75.
18. J. M. Bueno and P. Artal, J. Opt. Soc. Am A 18, 489 (2001 ).
19. B. Pelz, C. Weschenmoser, S. Goelz, J. P. Fischer, R. O. W. Burk, and J.
F.
s Bille, Proc. SPIE 2930, 92 (1996).
20 9. S. Jiao Y. Gang and L. V. Wang, Appl. Opt. 39, 6318 (2000).
10.A. W. Dreher, K. Reiter, and R. N. Weinred, Appl. Opt. 31, 3730 (1992).
11. W. G. Egan, W. R. Johnson, and V. S. Whitehead, Appl. Opt. 30, 435 (1991 ) 12. W. Mickols, I Tinoco, J. E. Katz, M. F. Maestre, and C. Bustamente, Rev.
Sci.
Instrum. 12, 2228 (1985).
2s 13. R. A. Chipman, in Handbook of Optics, 2nd ed., M. Bass, ed. (McGraw-Hill, New York, 1995) Sec. 22.1.
14. J. M. Bueno and J. Jaronski, Opthal. Physiol. Opt. 21, 384 (2001 ).
15. J. M. Bueno and P. Artal, Opt. Lett. 24, 64 (1999).
16. H. G. Jerrard, J. Opt. Soc. Am. 44, 634 (1954).
17. J. W. Goodman, in Laser Speckle and Related Phenomena, 2nd ed., J.C.
Dainty, ed., Vol. 9 of Topics in Applied Physics (Springer-Verlag,1984), 9-75.
18. J. M. Bueno and P. Artal, J. Opt. Soc. Am A 18, 489 (2001 ).
19. B. Pelz, C. Weschenmoser, S. Goelz, J. P. Fischer, R. O. W. Burk, and J.
F.
s Bille, Proc. SPIE 2930, 92 (1996).
Claims (40)
1. A method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region of interest of the object;
b) detecting light intensity signals corresponding to beams of light in a pre-selected number of polarization states reflected point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved matrix constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object or region of said object; and f) visually displaying said best image.
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region of interest of the object;
b) detecting light intensity signals corresponding to beams of light in a pre-selected number of polarization states reflected point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved matrix constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object or region of said object; and f) visually displaying said best image.
2. The method according to claim 1 wherein the matrix is a 4 x 4 Mueller matrix, and wherein said effective number of pre-selected polarization states of the incident beam of light is four, and wherein said pre-selected number of polarization states in the pathway which records the reflected point by point signal from the object is four.
3. The method according to claim 1 wherein the effective image quality parameter is the signal-to-noise ratio.
4. The method according to claim 1 wherein the step of detecting an array of light signals reflected from the object or region of interest of the object includes detecting light reflected from multiple locations on the object or region of interest of the object point by point using a movable detector.
5. A method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region of interest of the object;
b) detecting light intensity signals corresponding to beams of light reflected point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved vector of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said vector comprised of independent elements of a matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region of interest of the object;
b) detecting light intensity signals corresponding to beams of light reflected point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved vector of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said vector comprised of independent elements of a matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
6. The method according to claim 5 wherein the vector is the first row of the matrix and the matrix is a 4 x 4 Mueller matrix, and wherein said effective number of pre-selected polarization states of the incident beam of light is four.
7. The method according to claim 5 wherein the effective image quality parameter is the signal-to-noise ratio.
8. The method according to claim 5 wherein the step of detecting light signals reflected from the object or region of interest of the object includes detecting light reflected from multiple locations on the object or region of interest of the object point by point using a movable detector.
9. A method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and illuminating an object or region of interest of the object with the selectively polarized beam of light;
b) detecting an array of light intensity signals reflected from spatially distinct points of the object or region of interest of the object and storing electronic signals corresponding to said detected array of light signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a vector comprised of independent elements of a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
a) producing an incident beam of light in a pre-selected polarization state and illuminating an object or region of interest of the object with the selectively polarized beam of light;
b) detecting an array of light intensity signals reflected from spatially distinct points of the object or region of interest of the object and storing electronic signals corresponding to said detected array of light signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a vector comprised of independent elements of a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
10. The method according to claim 9 wherein the step of detecting an array of light signals reflected from the object or region of interest of the object includes simultaneously detecting light reflected from multiple locations on the object or region of interest of the object using an array detector.
11. The method according to claim 10 wherein the array detector is a charge coupled detector.
12. The method according to claim 9 wherein the step of detecting an array of light signals reflected from the object or region of interest of the object includes detecting light reflected from multiple locations on the object or region of interest of the object point by point using a movable detector.
13. The method according to claim 9 wherein the effective image quality parameter is signal-to-noise ratio.
14. A method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and illuminating an object or region of interest of the object with the selectively polarized beam of light;
b) detecting an array of light intensity signals reflected from spatially distinct points of the object or region of interest of the object and storing electronic signals corresponding to said detected array of light signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object from the detected light intensity signals and from said spatially resolved matrix constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said bet image.
a) producing an incident beam of light in a pre-selected polarization state and illuminating an object or region of interest of the object with the selectively polarized beam of light;
b) detecting an array of light intensity signals reflected from spatially distinct points of the object or region of interest of the object and storing electronic signals corresponding to said detected array of light signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object from the detected light intensity signals and from said spatially resolved matrix constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said bet image.
15. The method according to claim 14 wherein the step of detecting an array of light signals reflected from the object or region of interest of the object includes simultaneously detecting light reflected from multiple locations on the object or region of interest of the object using an array detector.
16. The method according to claim 15 wherein the array detector is a charge coupled detector.
17. The method according to claim 14 wherein the step of detecting an array of light signals reflected from the object or region of interest of the object includes detecting light reflected from multiple locations on the object or region of interest of the object point by point using a movable detector.
18. The method according to claim 14 wherein the effective image quality parameter is signal-to-noise ratio.
19. A method for producing images of an object using confocal scanning laser microscopy, comprising the steps of:
a) calibrating a confocal scanning laser microscope modified to include a polarization generator and a polarization analyzer to obtain a Mueller matrix M~, of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating 1/4 wave plate located in said generator positioned in each of four positions including 45 degrees, 0 degrees, 30 degrees and 60 degrees, while a 1/4 wave plate located in said analyzer is placed in each of the same four positions;
b) calibrating said modified confocal scanning instrument to obtain a Mueller matrix M~, of the instrument in the outgoing direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating 1/4 wave plate located in said generator positioned in each of four positions including degrees, 0 degrees, 30 degrees and 60 degrees, while a 1/4 wave plate located in said analyzer is placed in each of the same four positions;
c) placing said object in said modified confocal scanning apparatus and focusing light onto said object and recording sixteen gray scale images with the object in place for each of four generator states with a 1/4 wave plate at 45, 0, 30 and 60 degrees combined with each of the four analyzer states 1/4 waves plate at 45, 0, 30 and 60 degrees;
d) placing said sixteen grey scale values for each pixel into a spatially resolved matrix, I(mn), which is a first element of a Stokes vector, S~
reaching the photodetector;
e) from I(mn) calculate M out from equation 2;
f) from equation 3, calculate M, the spatially resolved Mueller matrix of the object;
g) choosing values of an incident Stokes vector, S IN, around a Poincaré
sphere in predetermined increments of .CHI. and .phi. which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincaré sphere;
h) applying equation 4 to reconstruct images, I out, pixel by pixel for each incident Stokes vector;
i) for each image, calculate the image quality measure of choice, for example SNR as defined in equation 5; and j) display the image with best value of the image quality measure.
a) calibrating a confocal scanning laser microscope modified to include a polarization generator and a polarization analyzer to obtain a Mueller matrix M~, of the instrument in the incoming direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating 1/4 wave plate located in said generator positioned in each of four positions including 45 degrees, 0 degrees, 30 degrees and 60 degrees, while a 1/4 wave plate located in said analyzer is placed in each of the same four positions;
b) calibrating said modified confocal scanning instrument to obtain a Mueller matrix M~, of the instrument in the outgoing direction, wherein a matrix of 16 intensity values results from intensity measurements with a rotating 1/4 wave plate located in said generator positioned in each of four positions including degrees, 0 degrees, 30 degrees and 60 degrees, while a 1/4 wave plate located in said analyzer is placed in each of the same four positions;
c) placing said object in said modified confocal scanning apparatus and focusing light onto said object and recording sixteen gray scale images with the object in place for each of four generator states with a 1/4 wave plate at 45, 0, 30 and 60 degrees combined with each of the four analyzer states 1/4 waves plate at 45, 0, 30 and 60 degrees;
d) placing said sixteen grey scale values for each pixel into a spatially resolved matrix, I(mn), which is a first element of a Stokes vector, S~
reaching the photodetector;
e) from I(mn) calculate M out from equation 2;
f) from equation 3, calculate M, the spatially resolved Mueller matrix of the object;
g) choosing values of an incident Stokes vector, S IN, around a Poincaré
sphere in predetermined increments of .CHI. and .phi. which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincaré sphere;
h) applying equation 4 to reconstruct images, I out, pixel by pixel for each incident Stokes vector;
i) for each image, calculate the image quality measure of choice, for example SNR as defined in equation 5; and j) display the image with best value of the image quality measure.
20. The method according to claim 19 wherein said object is an inanimate object, and wherein said step of focusing light onto said object includes directing light through a focussing lens onto said object and capturing and processing images propagating back through said focussing lens reflected from said object.
21. The method according to claim 20 wherein said object is an animate object, and wherein said step of focusing light onto said object includes directing light through a focussing lens onto said object and capturing and processing images propagating back through said focussing lens reflected from said object.
22. The method according to claim 19 wherein said object is a patients eye, and wherein said confocal scanning laser microscope is a confocal scanning laser ophthalmoscope (in this case the objective of the scanning laser microscope is replaced by the optics of the eye), and wherein the step of focusing light onto said eye includes directing light into the eyeball and capturing and processing images propagating back through said eyeball.
23. An optical scanning apparatus for producing images of an object, comprising:
a) a light source for producing a light beam;
b) polarization generator for producing selected polarization states in the light beam upon passage of the light beam through said polarization generator to produce a selectively polarized light beam;
c) scanning mechanism for receiving the selectively polarized light beam and spatially scanning the selectively polarized light beam in two dimensions across an object point by point;
d) polarization analyzer for transmitting light beams of selected polarization, including directing and focusing optics for directing the reflected light beams reflected point by point from the object to said polarization analyzer;
e) detector and light shaping and focusing optics for directing and focusing the reflected or transmitted light beams of selected polarization onto said detector;
f) computer processor connected to said detector, said computer processor including image analysis means for processing signals from said detector due to the reflected light beams of selected polarization detected by said detector and producing therefrom images of the object; and g) display means for displaying an image of the object produced by said processing means.
a) a light source for producing a light beam;
b) polarization generator for producing selected polarization states in the light beam upon passage of the light beam through said polarization generator to produce a selectively polarized light beam;
c) scanning mechanism for receiving the selectively polarized light beam and spatially scanning the selectively polarized light beam in two dimensions across an object point by point;
d) polarization analyzer for transmitting light beams of selected polarization, including directing and focusing optics for directing the reflected light beams reflected point by point from the object to said polarization analyzer;
e) detector and light shaping and focusing optics for directing and focusing the reflected or transmitted light beams of selected polarization onto said detector;
f) computer processor connected to said detector, said computer processor including image analysis means for processing signals from said detector due to the reflected light beams of selected polarization detected by said detector and producing therefrom images of the object; and g) display means for displaying an image of the object produced by said processing means.
24. The apparatus according to claim 23 wherein said light source is a laser for producing coherent or partially coherent light beams.
25. The apparatus according to claim 23 wherein said light shaping and focusing means includes a beam splitter positioned to transmit the selectively polarized light beam from said polarization generation means to said scanning means and to direct the light beams reflected point by point from the object to the polarization analyzer means, and wherein said light shaping and focusing means includes a confocal pinhole and focusing lens positioned between said detection means and said polarization analyzer means for focusing light beams reflected point by point from the object and having the selected polarization onto said detection means.
26. The apparatus according to claim 23 wherein said polarization generator means includes a linear polarizer and a rotatable quarter wave plate, and wherein said polarization analyzer means includes a linear polarizer and a rotatable quarter wave plate.
27. The apparatus according to claim 23 wherein said polarization generator includes an electro-optical device for polarizing the incident light beam, and wherein said polarization analyzer includes an electro-optical device.
28. The apparatus according to claim 27 wherein said electro-optical devices are one of a liquid crystal modulator and a photoelastic modulator.
29. The apparatus according to claim 23 wherein the object is a person's eye and said apparatus is a scanning laser ophthalmoscope or confocal scanning laser ophthalmoscope, and including positioning means for holding a person's head in position with the person's eye positioned so the light beam having selected polarization is scanned across the eye.
30. The apparatus according to claim 23 including focusing optics for receiving the selectively polarized light beams from said scanning means and focussing the selectively polarized light beams onto the object, and wherein said apparatus is a confocal scanning laser microscope or a scanning laser microscope.
31. An optical scanning apparatus for producing images of an object, comprising:
a) a light source for producing a light beam;
b) polarization generator means for producing selected polarization states in the light beam upon passage of the light beam through said polarization generator means to produce a selectively polarized light beam;
c) a beam splitter for transmitting the selectively polarized light beam;
d) scanning means for receiving the selectively polarized light beam from said beam splitter and spatially scanning the selectively polarized light beam in two dimensions across an object point by point and receiving light beams reflected back from different positions on the object and directing the reflected light beams to said beam splitter;
e) polarization analyzer means positioned to receive reflected light beams reflected from said beam splitter for transmitting reflected light beams of selected polarization;
f) detection means and light shaping and focusing means for directing and focusing the reflected light beams of selected polarization onto said detection means;
g) computer processing means connected to said detection means, said computer processing means including image analysis means for processing signals from the detector due to the reflected light beams of selected polarization detected by said detection means and producing therefrom images of the object;
and h) display means for displaying an image of the object produced by said processing means.
a) a light source for producing a light beam;
b) polarization generator means for producing selected polarization states in the light beam upon passage of the light beam through said polarization generator means to produce a selectively polarized light beam;
c) a beam splitter for transmitting the selectively polarized light beam;
d) scanning means for receiving the selectively polarized light beam from said beam splitter and spatially scanning the selectively polarized light beam in two dimensions across an object point by point and receiving light beams reflected back from different positions on the object and directing the reflected light beams to said beam splitter;
e) polarization analyzer means positioned to receive reflected light beams reflected from said beam splitter for transmitting reflected light beams of selected polarization;
f) detection means and light shaping and focusing means for directing and focusing the reflected light beams of selected polarization onto said detection means;
g) computer processing means connected to said detection means, said computer processing means including image analysis means for processing signals from the detector due to the reflected light beams of selected polarization detected by said detection means and producing therefrom images of the object;
and h) display means for displaying an image of the object produced by said processing means.
32. The apparatus according to claim 31 wherein said light source is a laser for producing coherent or partially coherent light beams.
33. The apparatus according to claim 31 wherein said polarization generator means includes a linear polarizes and a rotatable quarter wave plate, and wherein said polarization analyzer means includes a linear polarizes and a rotatable quarter wave plate.
34. The apparatus according to claim 31 wherein said light shaping and focusing means for directing and focusing the reflected light beams of selected polarization onto said detection means includes a confocal pinhole and focusing lens positioned between said detection means and said polarization analyzer means for focusing light beams reflected point by point from the object and having the selected polarization onto said detection means.
35. The apparatus according to claim 32 wherein the object is a person's eye and said apparatus is a confocal scanning laser ophthalmoscope, and including positioning means for holding a person's head in position with the person's eye positioned so said laser beam is scanned across the eye.
36. The apparatus according to claim 34 including light beam directing and focusing optics for receiving said selectively polarized light beam from said scanning means and directing and focussing said selectively polarized coherent light beam onto the object, and wherein said apparatus is a confocal scanning laser microscope.
37. A method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across and/or along an object or region of interest of the object;
b) detecting light intensity signals corresponding to beams of light in a pre-selected number of polarization states reflected or transmitted point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved matrix constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object or region of said object; and f) visually displaying said best image.
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across and/or along an object or region of interest of the object;
b) detecting light intensity signals corresponding to beams of light in a pre-selected number of polarization states reflected or transmitted point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved matrix of the object point by point from the detected light intensity signals and from said spatially resolved matrix constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object or region of said object; and f) visually displaying said best image.
38. A method for producing images of an object or region of interest of the object, comprising the steps of:
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region or along an object or a region of interest of the object by moving the object with respect to the incident beam or by moving the object in 1 dimension with respect to the incident beam and scanning the beam in a perpendicular direction with respect to the object;
b) detecting light intensity signals corresponding to beams of light reflected or transmitted point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved vector of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said vector comprised of independent elements of a matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
a) producing an incident beam of light in a pre-selected polarization state and scanning said incident beam of light point by point across an object or region or along an object or a region of interest of the object by moving the object with respect to the incident beam or by moving the object in 1 dimension with respect to the incident beam and scanning the beam in a perpendicular direction with respect to the object;
b) detecting light intensity signals corresponding to beams of light reflected or transmitted point by point from the object or region of interest of the object and storing electronic signals corresponding to the detected light intensity signals;
c) repeating steps a) and b) for an effective number of pre-selected polarization states of the incident beam of light;
d) constructing a spatially resolved vector of the object point by point from the detected light intensity signals and from said spatially resolved vector constructing spatially resolved images of the object or region of interest of the object for a set of theoretical polarization states of the incident beam of light in addition to those input states generated in the incident beam of light, said vector comprised of independent elements of a matrix being selected to describe the effect of the object on the polarization properties of light;
e) characterizing image quality of each image in accordance with an effective image quality parameter and based upon said characterization selecting a best image of said object; and f) visually displaying said best image.
39. A method for producing images of an object using scanning laser microscopy or microscopy, in transmission mode, comprising the steps of:
a) calibrating a scanning laser microscope or microscope modified to include a polarization generator and a polarization analyzer to obtain a Mueller matrix , of the instrument in the incoming direction, wherein a matrix of intensity values results from intensity measurements with a rotating 1/4 wave plate located in said generator positioned in each of four positions including 45 degrees, 0 degrees, 30 degrees and 60 degrees, while a 1/4 wave plate located in said analyzer is placed in each of the same four positions;
b) placing said object in said modified confocal scanning apparatus and focusing light onto said object and recording sixteen gray scale images with the object in place for each of four generator states with a 1/4 wave plate at 45, 0, 30 and 60 degrees combined with each of the four analyzer states 1/4 wave plate at 45, 0, 30 and 60 degrees;
c) placing said sixteen grey scale values for each pixel into a spatially resolved matrix, I(mn), which is a first element of a Stokes vector, S~
reaching the photodetector;
d) from I(mn) calculate M out from equation (equation 2);
e) from equation 5, calculate M, the spatially resolved Mueller matrix of the object;
f) choosing values of an incident Stokes vector, S IN, around a Poincare sphere in predetermined increments of x and .phi. which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
g) applying equation 6 to reconstruct images, I (out), pixel by pixel for each incident Stokes vector;
h) for each image, calculating the image quality measure of choice, for example SNR as defined in equation 7; and i) displaying the image with best value of the image quality measure.
a) calibrating a scanning laser microscope or microscope modified to include a polarization generator and a polarization analyzer to obtain a Mueller matrix , of the instrument in the incoming direction, wherein a matrix of intensity values results from intensity measurements with a rotating 1/4 wave plate located in said generator positioned in each of four positions including 45 degrees, 0 degrees, 30 degrees and 60 degrees, while a 1/4 wave plate located in said analyzer is placed in each of the same four positions;
b) placing said object in said modified confocal scanning apparatus and focusing light onto said object and recording sixteen gray scale images with the object in place for each of four generator states with a 1/4 wave plate at 45, 0, 30 and 60 degrees combined with each of the four analyzer states 1/4 wave plate at 45, 0, 30 and 60 degrees;
c) placing said sixteen grey scale values for each pixel into a spatially resolved matrix, I(mn), which is a first element of a Stokes vector, S~
reaching the photodetector;
d) from I(mn) calculate M out from equation (equation 2);
e) from equation 5, calculate M, the spatially resolved Mueller matrix of the object;
f) choosing values of an incident Stokes vector, S IN, around a Poincare sphere in predetermined increments of x and .phi. which represent, respectively, the azimuth and ellipticity of the incident Stokes vector on the Poincare sphere;
g) applying equation 6 to reconstruct images, I (out), pixel by pixel for each incident Stokes vector;
h) for each image, calculating the image quality measure of choice, for example SNR as defined in equation 7; and i) displaying the image with best value of the image quality measure.
40. An optical scanning apparatus for producing images of an object, comprising;
a) a light source for producing a light beam;
b) polarization generator means for producing selected polarization states in the light beam upon passage of the light beam through said polarization generator means to produce a selectively polarized light beam;
c) scanning means for receiving the selectively polarized light beam and spatially scanning the selectively polarized light beam in two dimensions across an object point by point scanning the sample with respect to the laser beam or scanning the beam in 1 or 2 dimensions and the sample in the perpendicular direction;
d) polarization analyzer means for transmitting light beams of selected polarization, including directing and focusing optics for directing the reflected light beams reflected point by point from the object to said polarization analyzer means;
e) detection means and light shaping and focusing means for directing and focusing the reflected light beams of selected polarization onto said detection means;
f) computer processing means connected to said detection means, said computer processing means including image analysis means for processing signals from said detector due to the reflected light beams of selected polarization detected by said detection means and producing therefrom images of the object; and g) display means for displaying an image of the object produced by said processing means.
a) a light source for producing a light beam;
b) polarization generator means for producing selected polarization states in the light beam upon passage of the light beam through said polarization generator means to produce a selectively polarized light beam;
c) scanning means for receiving the selectively polarized light beam and spatially scanning the selectively polarized light beam in two dimensions across an object point by point scanning the sample with respect to the laser beam or scanning the beam in 1 or 2 dimensions and the sample in the perpendicular direction;
d) polarization analyzer means for transmitting light beams of selected polarization, including directing and focusing optics for directing the reflected light beams reflected point by point from the object to said polarization analyzer means;
e) detection means and light shaping and focusing means for directing and focusing the reflected light beams of selected polarization onto said detection means;
f) computer processing means connected to said detection means, said computer processing means including image analysis means for processing signals from said detector due to the reflected light beams of selected polarization detected by said detection means and producing therefrom images of the object; and g) display means for displaying an image of the object produced by said processing means.
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CA2428628A CA2428628C (en) | 2002-05-13 | 2003-05-13 | Method and apparatus for imaging using polarimetry and matrix based image reconstruction |
| US10/756,839 US20050278533A1 (en) | 2003-01-12 | 2004-01-11 | System and method for secure communications |
| US10/907,274 US20050240756A1 (en) | 2003-01-12 | 2005-03-28 | System and method for improving the efficiency, comfort, and/or reliability in Operating Systems, such as for example Windows. |
| US11/382,698 US20070128899A1 (en) | 2003-01-12 | 2006-05-10 | System and method for improving the efficiency, comfort, and/or reliability in Operating Systems, such as for example Windows |
| US11/846,591 US20080177994A1 (en) | 2003-01-12 | 2007-08-29 | System and method for improving the efficiency, comfort, and/or reliability in Operating Systems, such as for example Windows |
Applications Claiming Priority (7)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US37941702P | 2002-05-13 | 2002-05-13 | |
| US60/379,417 | 2002-05-13 | ||
| US41764102P | 2002-10-11 | 2002-10-11 | |
| CA2407918A CA2407918C (en) | 2002-05-13 | 2002-10-11 | Method and apparatus for imaging using polarimetry and matrix based image reconstruction |
| CA2,407,918 | 2002-10-11 | ||
| US60/417,641 | 2002-10-11 | ||
| CA2428628A CA2428628C (en) | 2002-05-13 | 2003-05-13 | Method and apparatus for imaging using polarimetry and matrix based image reconstruction |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CA2428628A1 true CA2428628A1 (en) | 2003-11-13 |
| CA2428628C CA2428628C (en) | 2014-05-13 |
Family
ID=29554288
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CA2428628A Expired - Lifetime CA2428628C (en) | 2002-05-13 | 2003-05-13 | Method and apparatus for imaging using polarimetry and matrix based image reconstruction |
Country Status (1)
| Country | Link |
|---|---|
| CA (1) | CA2428628C (en) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111562223A (en) * | 2019-03-25 | 2020-08-21 | 上海昊量光电设备有限公司 | Polarizing imaging device and method based on micro-polarizer array |
-
2003
- 2003-05-13 CA CA2428628A patent/CA2428628C/en not_active Expired - Lifetime
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN111562223A (en) * | 2019-03-25 | 2020-08-21 | 上海昊量光电设备有限公司 | Polarizing imaging device and method based on micro-polarizer array |
Also Published As
| Publication number | Publication date |
|---|---|
| CA2428628C (en) | 2014-05-13 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US6927888B2 (en) | Method and apparatus for imaging using polarimetry and matrix based image reconstruction | |
| US7284859B2 (en) | Line-scan laser ophthalmoscope | |
| RU2439539C1 (en) | Optical tomographic imaging apparatus | |
| US5787890A (en) | Eye examination apparatus employing polarized light probe | |
| US4838679A (en) | Apparatus for, and method of, examining eyes | |
| US8282211B2 (en) | Method and apparatus for improved fundus imaging through choice of light polarisation | |
| US6112114A (en) | Eye examination apparatus employing polarized light probe | |
| JP5627321B2 (en) | Optical tomographic imaging apparatus and imaging method thereof | |
| JP5641744B2 (en) | Imaging apparatus and control method thereof | |
| RU2533976C2 (en) | Optic tomographic image former and method for forming image for above device | |
| US8651662B2 (en) | Optical tomographic imaging apparatus and imaging method for optical tomographic image | |
| AU766296B2 (en) | High resolution device for observing a body | |
| US7287855B2 (en) | Method and system for removing the effects of corneal birefringence from a polarimetric image of the retina | |
| WO1999027843A1 (en) | Stereo scanning laser ophthalmoscope | |
| CA2407918C (en) | Method and apparatus for imaging using polarimetry and matrix based image reconstruction | |
| CA2428628C (en) | Method and apparatus for imaging using polarimetry and matrix based image reconstruction | |
| Pelz et al. | In-vivo measurement of the retinal birefringence with regard to corneal effects using an electro-optical ellipsometer | |
| KR101919416B1 (en) | Device for polarization sensitive optical coherence tomography on one-unit detector | |
| Bueno et al. | Polarimetric high-resolution confocal scanning laser ophthalmoscope | |
| Bueno et al. | Enhancement of confocal microscopy images using Mueller‐matrix polarimetry | |
| Gonzalez et al. | Confocal Laser Scanning Polarimetry | |
| Campbell et al. | Enhanced confocal microscopy and ophthalmoscopy with polarization imaging | |
| Han et al. | High speed slit-scanning confocal laser microscopy with an acousto-optic beam deflector and a line scan camera | |
| AU1551999A (en) | Stereo scanning laser ophthalmoscope |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| EEER | Examination request | ||
| MKEX | Expiry |
Effective date: 20230515 |