US20180347960A1 - Optical sectioning apparatus using advanced optical interference microscopy - Google Patents

Optical sectioning apparatus using advanced optical interference microscopy Download PDF

Info

Publication number
US20180347960A1
US20180347960A1 US15/679,478 US201715679478A US2018347960A1 US 20180347960 A1 US20180347960 A1 US 20180347960A1 US 201715679478 A US201715679478 A US 201715679478A US 2018347960 A1 US2018347960 A1 US 2018347960A1
Authority
US
United States
Prior art keywords
light beam
optical
splitter
light source
disposed
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
US15/679,478
Other versions
US10151572B1 (en
Inventor
Chien-Chung Tsai
Kuang-Yu Hsu
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Acusolutions Inc
Original Assignee
Acusolutions Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Acusolutions Inc filed Critical Acusolutions Inc
Assigned to AcuSolutions Inc. reassignment AcuSolutions Inc. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: HSU, KUANG-YU, TSAI, CHIEN-CHUNG
Publication of US20180347960A1 publication Critical patent/US20180347960A1/en
Application granted granted Critical
Publication of US10151572B1 publication Critical patent/US10151572B1/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B9/00Measuring instruments characterised by the use of optical techniques
    • G01B9/02Interferometers
    • G01B9/02015Interferometers characterised by the beam path configuration
    • G01B9/02029Combination with non-interferometric systems, i.e. for measuring the object
    • G01B9/0203With imaging systems
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0062Arrangements for scanning
    • A61B5/0066Optical coherence imaging
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B9/00Measuring instruments characterised by the use of optical techniques
    • G01B9/02Interferometers
    • G01B9/02041Interferometers characterised by particular imaging or detection techniques
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B9/00Measuring instruments characterised by the use of optical techniques
    • G01B9/02Interferometers
    • G01B9/02055Reduction or prevention of errors; Testing; Calibration
    • G01B9/02056Passive reduction of errors
    • G01B9/02057Passive reduction of errors by using common path configuration, i.e. reference and object path almost entirely overlapping
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B9/00Measuring instruments characterised by the use of optical techniques
    • G01B9/02Interferometers
    • G01B9/02055Reduction or prevention of errors; Testing; Calibration
    • G01B9/02062Active error reduction, i.e. varying with time
    • G01B9/02064Active error reduction, i.e. varying with time by particular adjustment of coherence gate, i.e. adjusting position of zero path difference in low coherence interferometry
    • G01B9/02065Active error reduction, i.e. varying with time by particular adjustment of coherence gate, i.e. adjusting position of zero path difference in low coherence interferometry using a second interferometer before or after measuring interferometer
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B9/00Measuring instruments characterised by the use of optical techniques
    • G01B9/02Interferometers
    • G01B9/0209Low-coherence interferometers
    • G01B9/02091Tomographic interferometers, e.g. based on optical coherence
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0056Optical details of the image generation based on optical coherence, e.g. phase-contrast arrangements, interference arrangements
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0076Optical details of the image generation arrangements using fluorescence or luminescence
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/06Means for illuminating specimens
    • G02B21/08Condensers
    • G02B21/14Condensers affording illumination for phase-contrast observation
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/16Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365Control or image processing arrangements for digital or video microscopes
    • G02B21/367Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N7/00Television systems
    • H04N7/18Closed-circuit television [CCTV] systems, i.e. systems in which the video signal is not broadcast
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B2290/00Aspects of interferometers not specifically covered by any group under G01B9/02
    • G01B2290/60Reference interferometer, i.e. additional interferometer not interacting with object
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01BMEASURING LENGTH, THICKNESS OR SIMILAR LINEAR DIMENSIONS; MEASURING ANGLES; MEASURING AREAS; MEASURING IRREGULARITIES OF SURFACES OR CONTOURS
    • G01B2290/00Aspects of interferometers not specifically covered by any group under G01B9/02
    • G01B2290/70Using polarization in the interferometer

Definitions

  • the present invention relates to an optical sectioning apparatus, especially to an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy.
  • a formed crystal ice structure will cause a damage to the tissue structure of the sample; and if the sample contains much fat, the fat will still be not frozen at temperatures around ⁇ 20° C. where the other tissues are already frozen, and is therefore easy to slip off from the frozen section to cause an artifact to the frozen section.
  • OCT optical coherence tomography
  • OCT optical coherence tomography
  • OCT optical coherence tomography
  • OCT mainly utilizes the phenomena that different tissues of a sample have different responses with regard to light reflection, light absorption, and light scattering and makes use of an optical interference methodology to form an image of the sample for diagnosis.
  • OCT can be performed by directly scanning a sample at room temperature without the need of including a freezing procedure and a slicing procedure
  • morphological artifacts induced by slicing a frozen sample containing much water or fat can be prevented, the completeness of the sample can be maintained to ensure the accuracy of a pathological assessment, the surgery time can be shortened, and surgery effect can be improved.
  • traditional optical microscopy usually has a wide depth of focus, a sample needs to undergo a real sectioning procedure to provide sections of a depth of 4-5 ⁇ m, so as to avoid overlapping of tissue images of different depths, and thereby to derive a clear image.
  • the U.S. Pat. No. 9,185,357 B2 discloses an optical tissue sectioning apparatus using full-field optical coherence tomography, which includes a full-field imaging interferometer and an optical sectioning imaging system.
  • This optical tissue sectioning apparatus uses the interferometer to solve the problem resulting from the wide depth of focus by directly deriving the image from the sample, which has a resolution as precise as less than 1 ⁇ m both laterally and vertically, getting rid of the need of a fixation process, which includes a freezing procedure, a paraffin-embadded procedure, and a real sectioning procedure.
  • a short-wavelength light beam (such as UV light beam) will be attenuated by a beam-splitting film of the beam splitter by 60-90%;
  • the antireflection film of the beam splitter generally has a low transmission rate for a UV band of wavelengths shorter than 400 nm. Due to these two disadvantages, a fluorescent signal out of a sample will very weak. To ensure the strength of a fluorescent signal, shorten exposure time, and speed up an image taking process, a novel optical sectioning apparatus is needed.
  • One objective of the present invention is to disclose an optical sectioning apparatus, in which a first dichroic splitter is disposed between a beam splitter and a first objective lens to block a short-wavelength light beam and thereby increase a relative strength of a fluorescent signal, shorten an exposure time, and speed up taking images.
  • Another objective of the present invention is to disclose an optical sectioning apparatus, in which a first dichroic splitter will filter out a short-wavelength light beam so that when a fluorescent light beam emitted from a sample passes through the first dichroic splitter, the fluorescent light beam will have a good relative strength to shorten an exposure time and speed up taking images.
  • Still another objective of the present invention is to disclose an optical sectioning apparatus, in which a sensor unit has a long-wavelength-pass filter to further filter out a short-wavelength light beam to increase the relative strength of a fluorescent signal, and thereby shorten an exposure time and speed up taking images.
  • an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy including:
  • a beam splitter having a first side, a second side, a third side, and a fourth side, and being capable of splitting an incident light beam entering received from the first side into a reflected light beam traveling out the second side and a transmitted light beam traveling out the third side;
  • a wide band light source apparatus for generating a wide band light beam to be incident on the first side of the beam splitter
  • a reference arm unit used to make the transmitted light beam travel a round trip along an adjustable optical path and then return to the beam splitter
  • a short wavelength light source apparatus for generating a short wavelength light beam
  • a first dichroic splitter having a first side, a second side, and a third side, with the first side facing the short wavelength light source apparatus, the third side facing the second side of the beam splitter, and being capable of providing a light-blocking effect on a band of wavelengths shorter than a preset wavelength, and the short wavelength light beam having a wavelength shorter than the preset wavelength;
  • a first objective lens having a collimated side and a focal side, with the collimated side facing the second side of the first dichroic splitter;
  • a sample carrier unit facing the focal side of the first objective lens and being used for carrying a sample stained with a fluorescent dye
  • a projection lens having a light entrance side and a light exit side, with the light entrance side facing the fourth side of the beam splitter; and a sensor unit facing the light exit side of the projection lens.
  • the reference arm unit includes: an optical path delay unit, having a first side and a second side, with the first side facing the third side of the beam splitter; a second objective lens, having a collimated side and a focal side, with the collimated side facing the second side of the optical path delay unit; and a reflective mirror, facing the focal side of the second objective lens and used for reflecting the transmitted light beam, wherein the optical path delay unit is used for adjusting the adjustable optical path so that the adjustable optical path and a sample arm optical path have an optical path difference less than a coherent length, with the sample arm optical path being formed by the sample carrier unit, the first objective lens, and the first dichroic splitter.
  • both the wide band light source apparatus and the short wavelength light source apparatus are implemented with a light source, or a combination of a light source and a grating, or a combination of a light source, a grating, and an tilt-adjustable reflective mirror, or a plurality of parallel LED stripes.
  • the sample carrier unit further includes a white light source to provide a proper intensity of white light to pass through the first objective lens, the white light source including a white-light LED, a laser-diode-pumped crystal rod, a laser-diode-pumped crystal fiber, a white-light halogen lamp, or a tungsten lamp.
  • a white light source including a white-light LED, a laser-diode-pumped crystal rod, a laser-diode-pumped crystal fiber, a white-light halogen lamp, or a tungsten lamp.
  • the sensor unit includes a second dichroic splitter, a two-dimensional color sensing device, a long wavelength pass filter, and a two-dimensional monochrome sensing device, in which the second dichroic splitter has a first side, a second side, and a third side, with the first side facing the projection lens, and the second dichroic splitter is used to reflect a fluorescent light beam and a white light beam to and through the third side to form an image on the two-dimensional color sensing device, and to transmit a wide band light beam through the second side to form an image on the two-dimensional monochrome sensing device.
  • the sensor unit includes a flip-type reflective mirror, a two-dimensional color sensing device, a long wavelength pass filter, and a two-dimensional monochrome sensing device, in which the flip-type reflective mirror has a flip-on state to allow a white light beam to form an image on the two-dimensional color sensing device, and has a flip-off state to allow a wide band light beam and a fluorescent light beam to form an image on the two-dimensional monochrome sensing device, and the long wavelength pass filter can be disposed between the projection lens and the flip-type reflective mirror, or be disposed between the projection lens and the second dichroic splitter, or be disposed between the flip-type reflective mirror and the two-dimensional monochrome sensing device, or be disposed between the second dichroic splitter and the two-dimensional monochrome sensing device.
  • the wide band light beam has a wavelength range of 470 nm-800 nm
  • the short wavelength light beam has a wavelength range of 365 nm-460 nm
  • the beam splitter has an operating wavelength range of 400 nm-800 nm
  • both the first dichroic splitter and the long wavelength pass filter have a cut-off wavelength range of 400 nm-470 nm.
  • the wide band light beam has a wavelength range of 650 nm-1000 nm
  • the short wavelength light beam has a wavelength range of 365 nm-630 nm
  • the beam splitter has an operating wavelength range of 400 nm-1000 nm
  • all the first dichroic splitter, the second dichroic splitter, and the long wavelength pass filter have a cut-off wavelength range of 400 nm-650 nm.
  • a first polarizer is disposed between the wide band light source apparatus and the beam splitter, a second polarizer is disposed in front of the two-dimensional monochrome sensing device, a first quarter-wave plate is disposed between the first objective lens and the first dichroic splitter, and a second quarter-wave plate is disposed between the optical path delay unit and the second objective lens, wherein the first polarizer has a first polarization direction, the second polarizer has a second polarization direction orthogonal to the first polarization direction, the first quarter-wave plate has a first optical axis direction, the second quarter-wave plate has a second optical axis direction, and both the first optical axis direction and the second optical axis direction are disposed within a range formed by the first polarization direction and the second polarization direction to enhance an interference effect and promote an imaging quality.
  • an information processing apparatus is used to perform an image processing process.
  • the reference arm unit further includes an axial motion platform
  • the sample carrier unit further includes a 3-D motion platform, so that by using the axial motion platform to move the second objective lens and the reflective mirror of the reference arm unit, using the 3-D motion platform to move the sample stained with a fluorescent dye, and adjusting the optical path delay unit, the information processing apparatus can derive a 3-D image of the sample accordingly.
  • FIG. 1 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to one embodiment of the present invention.
  • FIG. 2 illustrates a beam splitting operation and a focusing operation of the optical sectioning apparatus of FIG. 1 .
  • FIG. 3 illustrates a block diagram of a reference arm unit of FIG. 1 according to one embodiment of the present invention.
  • FIG. 4 illustrates a beam combining operation and an image projecting operation of the optical sectioning apparatus of FIG. 1 .
  • FIG. 5 a illustrates a block diagram of a sensor unit of FIG. 1 according to one embodiment of the present invention.
  • FIG. 5 b illustrates a block diagram of a sensor unit of FIG. 1 according to another embodiment of the present invention.
  • FIG. 5 c illustrates a block diagram of a sensor unit of FIG. 1 according to another embodiment of the present invention.
  • FIG. 5 d illustrates a block diagram of a sensor unit of FIG. 1 according to still another embodiment of the present invention.
  • FIG. 6 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to another embodiment of the present invention.
  • FIG. 7 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to still another embodiment of the present invention.
  • FIG. 1 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to one embodiment of the present invention
  • FIG. 2 illustrates a beam splitting operation and a focusing operation of the optical sectioning apparatus in FIG. 1 .
  • the optical sectioning apparatus using optical interference microscopy and fluorescence microscopy includes: a wide band light source apparatus 100 , a short wavelength light source apparatus 200 , a beam splitter 300 , a first dichroic splitter 400 , a first objective lens 500 , a sample carrier unit 600 , a projection lens 700 , a reference arm unit 800 , and a sensor unit 900 .
  • the wide band light source apparatus 100 is used to generate a wide band light beam 10 (indicated by a hollow arrow); the short wavelength light source apparatus 200 is used to generate a short wavelength light beam 20 (indicated by a solid arrow); the sample carrier unit 600 is used to carry a sample 610 stained with a fluorescent dye, which will emit a fluorescent light beam 30 (indicated by a dashed line arrow) when the short wavelength light beam 20 is incident on it; and the sample carrier unit 600 further includes a white light source 620 to provide a white light beam 40 (indicated by a hollow arrowhead) having a proper intensity to pass through the first objective lens 500 .
  • the beam splitter 300 has a first side S 301 , a second side S 302 , a third side S 303 , and a fourth side S 304 .
  • the wide band light source apparatus 100 is used for generating the wide band light beam 10 to be incident on the first side S 301 of the beam splitter 300 and divided by the beam splitter 300 into a reflected wide band light beam traveling out the second side S 302 , and a transmitted wide band light beam traveling out the third side S 303 .
  • the short wavelength light source apparatus 200 is used to generate the short wavelength light beam 20 .
  • the first dichroic splitter 400 has a first side S 401 , a second side S 402 , and a third side S 403 , with the first side S 401 facing the short wavelength light source apparatus 200 and reflecting the short wavelength light beam 20 , and with the third side S 403 facing the second side S 302 of the beam splitter 300 to transmit a branch of the wide band light beam 10 from the beam splitter 300 through the second side S 402 .
  • the first objective lens 500 has a collimated side S 501 and a focal side S 502 , wherein, the collimated side S 501 facing the second side S 402 of the first dichroic splitter 400 .
  • the sample carrier unit 600 faces the focusing side S 502 of the first objective lens 500 and is used to carry the sample 610 stained with a fluorescent dye. Besides, the sample carrier unit 600 , the first objective lens 500 , and the first dichroic splitter 400 together form a sample arm optical path.
  • the projection lens 700 has a light entrance side S 701 and a light exit side S 702 , with the light entrance side S 701 facing the fourth side S 304 of the beam splitter 300 .
  • the sensor unit 900 faces the light exit side S 702 of the projection lens 700 .
  • the white light source 620 includes a white-light LED, a white-light halogen lamp, or a tungsten lamp, etc.; the first objective lens 500 has an operating wavelength range of 350 nm-1000 nm; and both the wide band light source apparatus 100 and the short wavelength light source apparatus 200 can be implemented with a light source, or a combination of a light source and a grating, or a combination of a light source, a grating, and a tilt-adjustable reflective mirror, or a plurality of parallel LED stripes (all not shown in the figure).
  • the light source, the grating, the tilt-adjustable reflective mirror, and the parallel LED stripes are already known in prior art, they will not be further addressed.
  • FIG. 3 illustrates a block diagram of a reference arm unit of FIG. 1 according to one embodiment of the present invention.
  • the reference arm unit 800 includes: an optical path delay unit 810 , a second objective lens 820 , and a reflective mirror 830 .
  • the optical path delay unit 810 , the second objective lens 820 , and the reflective mirror 830 together form an adjustable optical path, and the reference arm unit 800 is used to make a branch of the wide band light beam 10 travel a round trip along the adjustable optical path and then return to the beam splitter 300 (not shown in this figure).
  • the optical path delay unit 810 has a first side S 811 and a second side S 812 , with the first side S 811 facing the third side S 303 of the beam splitter 300 (not shown in this figure);
  • the second objective lens 820 has a collimated side S 821 and a focal side S 822 , with the collimated side S 821 facing the second side S 812 of the optical path delay unit 810 ;
  • the reflective mirror 830 faces the focusing side S 822 of the second objective lens 820 for reflecting the branch of the wide band light beam 10 .
  • the second objective lens 820 can have an operating wavelength range of 350-1000 nm.
  • the optical path delay unit 810 can use a reflective mirror to help make the adjustable optical path and the sample arm optical path have an optical path difference less than a coherent length by changing a displacement of the reflective mirror.
  • One or more continuous interference carrier waves can be continuously recorded by a two-dimensional monochrome sensing device 940 , and a plurality of recorded intensity values then undergo a root-mean-square calculation and an averaging calculation to produce an en-face interference intensity image, wherein the continuous interference carrier wave can also be generated by a 3-D motion platform 630 , of which the principle is known in prior art, so it will not further addressed.
  • FIG. 4 illustrates a beam combining operation and an image projecting operation of the optical sectioning apparatus of FIG. 1 .
  • the first dichroic splitter 400 is used to block a band of wavelengths shorter than a preset wavelength, and the short wavelength light beam 20 has a wavelength shorter than the preset wavelength, so the short wavelength light beam 20 will be blocked by the first dichroic splitter 400 , while the branch of the wide band light beam 10 , the fluorescent light beam 30 , and the white light beam 40 will pass through the first dichroic splitter 400 .
  • the third side S 303 of the beam splitter 300 faces the reference arm unit 800 and is used to reflect the branch of the wide band light beam 10 from the reference arm unit 800 to the fourth side S 304
  • the second side S 302 faces the first dichroic splitter 400 and is used to transmit another branch of the wide band light beam 10 , the fluorescent light beam 30 , and the white light beam 40 to the fourth side S 304 .
  • the adjustable optical path and the sample optical path have an optical path difference less than a coherent length
  • the wideband light beam traveling a round trip along the adjustable optical path will have an optical interference with the wideband light beam traveling a round trip along the sample optical path when they meet each other. Since the interference principle is known in prior art, it will not be addressed further.
  • the projection lens 700 has a light entrance side S 701 and a light exit side S 702 , with the light entrance side S 701 facing the fourth side S 304 of the beam splitter 300 , and the light exit side S 702 being used to transmit a coherent-interference resultant light beam of the wide band light beam 10 , the fluorescent light beam 30 , and the white light beam 40 to the sensor unit 900 .
  • FIG. 5 a illustrates a block diagram of a sensor unit of FIG. 1 according to one embodiment of the present invention
  • FIG. 5 b illustrates a block diagram of a sensor unit of FIG. 1 according to another embodiment of the present invention.
  • the sensor unit 900 includes a flip-type reflective mirror 915 , a two-dimensional color sensing device 920 , a long wavelength pass filter 930 and a two-dimensional monochrome sensing device 940 .
  • the long wavelength pass filter 930 is used to further filter out the short wavelength light beam 20 (not shown in the figure), and the flip-type reflective mirror 915 has a flip mount (not shown in the figure) for presenting a flip-on state or a flip-off state. Since the flip-type reflective mirror is known in prior art, it will not be addressed further.
  • the long wavelength pass filter 930 is disposed between the projection lens 700 and the flip-type reflective mirror 915 .
  • the white light beam 40 will form an image on the two-dimensional color sensing device 920 ;
  • the flip-type reflective mirror 915 is in the flip-off state, the fluorescent light beam 30 and a coherent-interference resultant light beam of the wide band light beam 10 will form an image on the two-dimensional monochrome sensing device 940 , respectively.
  • the long wavelength pass filter 930 is disposed between the flip-type reflective mirror 915 and the two-dimensional monochrome sensing device 940 .
  • the white light beam 40 will form an image on the two-dimensional color sensing device 920 ;
  • the flip-type reflective mirror 915 is in the flip-off state, the fluorescent light beam 30 and a coherent-interference resultant light beam of the wide band light beam 10 will form an image on the two-dimensional monochrome sensing device 940 respectively.
  • FIG. 5 c -5 d illustrates a block diagram of a sensor unit of FIG. 1 according to another embodiment of the present invention
  • FIG. 5 d illustrates a block diagram of a sensor unit of FIG. 1 according to still another embodiment of the present invention.
  • the sensor unit 900 includes a second dichroic splitter 910 , a two-dimensional color sensing device 920 , a long wavelength pass filter 930 and a two-dimensional monochrome sensing device 940 , in which the long wavelength pass filter 930 is used to further filter out the short wavelength light beam 20 (not shown in the figure).
  • the long wavelength pass filter 930 is disposed between the projection lens 700 and the second dichroic splitter 910 .
  • the second dichroic splitter 910 reflects the fluorescent light beam 30 and the white light beam 40 to the third side S 903 to form an image on the two-dimensional color sensing device 920 , and transmits a coherent-interference resultant light beam of the wide band light beam 10 through the second side S 902 to form an image on the two-dimensional monochrome sensing device 940 .
  • the long wavelength pass filter 930 is disposed between the second dichroic splitter 910 and the two-dimensional monochrome sensing device 940 .
  • the second dichroic splitter 910 reflects the fluorescent light beam 30 and the white light beam 40 to the third side S 903 to form an image on the two-dimensional color sensing device 920 , and transmits a coherent-interference resultant light beam of the wide band light beam 10 through the second side S 902 to form an image on the two-dimensional monochrome sensing device 940 .
  • the flip-type reflective mirror 915 is required, the short wavelength light beam 20 (not shown in this figure) has a wavelength range of 365 nm-460 nm, the beam splitter 300 (not shown in this figure) has an operating wavelength range of 400 nm-800 nm, and the first dichroic splitter 400 has a cut-off wavelength range of 400 nm-470 nm.
  • the flip-type reflective mirror 915 or the second dichroic splitter 910 can be adopted, the short wavelength light beam 20 has a wavelength range of 365 nm-630 nm, the beam splitter 300 has an operating wavelength range of 400 nm-1000 nm, and all the first dichroic splitter 400 , the second dichroic splitter 910 , and the long wavelength pass filter 930 have a cut-off wavelength range of 400 nm-650 nm.
  • FIG. 6 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to another embodiment of the present invention.
  • a first polarizer 950 is disposed between the wide band light source apparatus 100 and the beam splitter 300
  • a second polarizer 960 is disposed in front of the two-dimensional monochrome sensing device 940
  • a first quarter-wave plate 970 is disposed between the first objective lens 500 and the first dichroic splitter 400
  • a second quarter-wave plate 980 is disposed between the optical path delay unit 810 and the second objective lens 820 .
  • the first polarizer 950 has a first polarization direction
  • the second polarizer 960 has a second polarization direction orthogonal to the first polarization direction
  • the first quarter-wave plate 970 has a first optical axis direction
  • the second quarter-wave plate 980 has a second optical axis direction
  • both the first optical axis direction and the second optical axis direction are disposed within a range formed by the first polarization direction and the second polarization direction.
  • the first polarization direction is along a vertical direction
  • the second polarization direction is along a horizontal direction
  • both the first optical axis direction and the second optical axis direction are along a 45 degrees direction in-between the first polarization direction and the second polarization direction.
  • the first branch will pass through the second quarter-wave plate 980 of the reference arm unit 800 to become a first clockwise circularly polarized light beam, which then becomes a first counter clockwise circularly polarized light beam after reflected by the reflective mirror 830 , and the first counter clockwise circularly polarized light beam will become polarized in the horizontal direction after it passes through the second quarter-wave plate 980 .
  • the second branch will pass through the first quarter-wave plate 970 disposed between the first objective lens 500 and the first dichroic splitter 400 to become a second clockwise circularly polarized light beam, which then becomes a second counter clockwise circularly polarized light beam after reflected by the sample carrier unit 600 , and the second counter clockwise circularly polarized light beam will become polarized in the horizontal direction after it passes through the first quarter-wave plate 970 .
  • the second polarizer 960 in front of the two-dimensional monochrome sensing device 940 will only allow horizontally polarized light of the wide band light beam 10 to pass through, therefore, reflect light due to an antireflection film of the beam splitter 300 can be effectively blocked to further enhance an optical interference effect and promote an imaging performance.
  • FIG. 7 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to still another embodiment of the present invention.
  • the reference arm unit 800 further includes an axial motion platform 840 and the sample carrier unit 600 further includes a 3-D motion platform 630 .
  • an information processing apparatus (not shown in this figure) can be used to perform an image processing process.
  • the information processing apparatus can derive a 3-D image (not shown in this figure) of the sample accordingly. Since the formation process of a 3-D image is known in prior art, it will not be addressed further.
  • the present invention possesses the advantages as follows:
  • the optical sectioning apparatus of the present invention has a first dichroic splitter disposed between a beam splitter and a first objective lens to block a short-wavelength light beam and thereby increase a relative strength of a fluorescent signal, shorten an exposure time, and speed up taking images.
  • the optical sectioning apparatus of the present invention ensures that when a fluorescent light beam emitted from a sample passes through a first dichroic splitter, since the first dichroic splitter will filter out a short-wavelength light beam, the fluorescent light beam will have a good relative strength when it passes through the first dichroic splitter, thereby shortening an exposure time and speeding up taking images.
  • the optical sectioning apparatus of the present invention has a long wavelength pass filter installed in a sensor unit to further filter out a short-wavelength light beam to increase the relative strength of a fluorescent signal, and thereby shortening an exposure time and speeding up taking images.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Health & Medical Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • General Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biophysics (AREA)
  • Pathology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Medical Informatics (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Animal Behavior & Ethology (AREA)
  • Biomedical Technology (AREA)
  • Public Health (AREA)
  • Veterinary Medicine (AREA)
  • Signal Processing (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Microscoopes, Condenser (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

An optical sectioning apparatus using optical interference microscopy and fluorescence microscopy, including: a beam splitter capable of splitting an incident light beam into a reflected light beam and a transmitted light beam; a wide band light source for providing the incident light beam; a reference arm unit for making the transmitted light beam travel a round trip along an adjustable optical path; a short wavelength light source; a first dichroic splitter, with a first side facing the short wavelength light source and a third side facing the beam splitter, being capable of providing a light-blocking effect on wavelengths shorter than a preset wavelength; an objective lens, with a collimated side facing a second side of the first dichroic splitter; a sample carrier unit facing a focal side of the objective lens; and a projection lens and a sensor units for receiving an output light beam.

Description

    BACKGROUND OF THE INVENTION Field of the Invention
  • The present invention relates to an optical sectioning apparatus, especially to an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy.
  • Description of the Related Art
  • In conventional tumor surgery, it takes a lot of time for a pathologist to examine a frozen section to determine if a tumor is cleanly removed. As a result, when the time allowed for the surgery is shorter than the time needed for the pathologist to complete the assessment of intraoperative pathological margin, the tumor cannot be guaranteed to be cleanly removed.
  • During the process of preparing a frozen section of a sample, if the sample contains much water, a formed crystal ice structure will cause a damage to the tissue structure of the sample; and if the sample contains much fat, the fat will still be not frozen at temperatures around −20° C. where the other tissues are already frozen, and is therefore easy to slip off from the frozen section to cause an artifact to the frozen section.
  • OCT (optical coherence tomography) is a newly developed optical imaging technology, which utilizes an operational principle similar to that of the supersonic imaging technology but has a higher resolution than the supersonic imaging technology. OCT mainly utilizes the phenomena that different tissues of a sample have different responses with regard to light reflection, light absorption, and light scattering and makes use of an optical interference methodology to form an image of the sample for diagnosis. Since OCT can be performed by directly scanning a sample at room temperature without the need of including a freezing procedure and a slicing procedure, morphological artifacts induced by slicing a frozen sample containing much water or fat can be prevented, the completeness of the sample can be maintained to ensure the accuracy of a pathological assessment, the surgery time can be shortened, and surgery effect can be improved. However, since traditional optical microscopy usually has a wide depth of focus, a sample needs to undergo a real sectioning procedure to provide sections of a depth of 4-5 μm, so as to avoid overlapping of tissue images of different depths, and thereby to derive a clear image.
  • To solve the foregoing problems, the U.S. Pat. No. 9,185,357 B2 discloses an optical tissue sectioning apparatus using full-field optical coherence tomography, which includes a full-field imaging interferometer and an optical sectioning imaging system. This optical tissue sectioning apparatus uses the interferometer to solve the problem resulting from the wide depth of focus by directly deriving the image from the sample, which has a resolution as precise as less than 1 μm both laterally and vertically, getting rid of the need of a fixation process, which includes a freezing procedure, a paraffin-embadded procedure, and a real sectioning procedure.
  • Besides, as a conventional H&E stain section uses hematoxylin to color the nuclei bluish violet and uses eosin to color cytoplasm pink, the nuclei will also be represented in bluish violet in a derived image, and the details (such as the nucleolus or heterochromatin) of each of the nuclei will be undistinguishable in the derived image. Therefore, U.S. Pat. No. 9,185,357 B2 adopts a fluorescent staining approach to exhibit an image of the details of nuclei to fulfill the need of pathology inspection.
  • However, there is still room for improvement in the performance of U.S. Pat. No. 9,185,357 B2, for example: (1) a short-wavelength light beam (such as UV light beam) will be attenuated by a beam-splitting film of the beam splitter by 60-90%; (2) the antireflection film of the beam splitter generally has a low transmission rate for a UV band of wavelengths shorter than 400 nm. Due to these two disadvantages, a fluorescent signal out of a sample will very weak. To ensure the strength of a fluorescent signal, shorten exposure time, and speed up an image taking process, a novel optical sectioning apparatus is needed.
  • SUMMARY OF THE INVENTION
  • One objective of the present invention is to disclose an optical sectioning apparatus, in which a first dichroic splitter is disposed between a beam splitter and a first objective lens to block a short-wavelength light beam and thereby increase a relative strength of a fluorescent signal, shorten an exposure time, and speed up taking images.
  • Another objective of the present invention is to disclose an optical sectioning apparatus, in which a first dichroic splitter will filter out a short-wavelength light beam so that when a fluorescent light beam emitted from a sample passes through the first dichroic splitter, the fluorescent light beam will have a good relative strength to shorten an exposure time and speed up taking images.
  • Still another objective of the present invention is to disclose an optical sectioning apparatus, in which a sensor unit has a long-wavelength-pass filter to further filter out a short-wavelength light beam to increase the relative strength of a fluorescent signal, and thereby shorten an exposure time and speed up taking images.
  • To attain the foregoing objectives, an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy is proposed, including:
  • a beam splitter, having a first side, a second side, a third side, and a fourth side, and being capable of splitting an incident light beam entering received from the first side into a reflected light beam traveling out the second side and a transmitted light beam traveling out the third side;
  • a wide band light source apparatus for generating a wide band light beam to be incident on the first side of the beam splitter;
  • a reference arm unit, used to make the transmitted light beam travel a round trip along an adjustable optical path and then return to the beam splitter;
  • a short wavelength light source apparatus for generating a short wavelength light beam;
  • a first dichroic splitter, having a first side, a second side, and a third side, with the first side facing the short wavelength light source apparatus, the third side facing the second side of the beam splitter, and being capable of providing a light-blocking effect on a band of wavelengths shorter than a preset wavelength, and the short wavelength light beam having a wavelength shorter than the preset wavelength;
  • a first objective lens, having a collimated side and a focal side, with the collimated side facing the second side of the first dichroic splitter;
  • a sample carrier unit facing the focal side of the first objective lens and being used for carrying a sample stained with a fluorescent dye;
  • a projection lens, having a light entrance side and a light exit side, with the light entrance side facing the fourth side of the beam splitter; and a sensor unit facing the light exit side of the projection lens.
  • In one embodiment, the reference arm unit includes: an optical path delay unit, having a first side and a second side, with the first side facing the third side of the beam splitter; a second objective lens, having a collimated side and a focal side, with the collimated side facing the second side of the optical path delay unit; and a reflective mirror, facing the focal side of the second objective lens and used for reflecting the transmitted light beam, wherein the optical path delay unit is used for adjusting the adjustable optical path so that the adjustable optical path and a sample arm optical path have an optical path difference less than a coherent length, with the sample arm optical path being formed by the sample carrier unit, the first objective lens, and the first dichroic splitter.
  • In one embodiment, both the wide band light source apparatus and the short wavelength light source apparatus are implemented with a light source, or a combination of a light source and a grating, or a combination of a light source, a grating, and an tilt-adjustable reflective mirror, or a plurality of parallel LED stripes.
  • In one embodiment, the sample carrier unit further includes a white light source to provide a proper intensity of white light to pass through the first objective lens, the white light source including a white-light LED, a laser-diode-pumped crystal rod, a laser-diode-pumped crystal fiber, a white-light halogen lamp, or a tungsten lamp.
  • In one embodiment, the sensor unit includes a second dichroic splitter, a two-dimensional color sensing device, a long wavelength pass filter, and a two-dimensional monochrome sensing device, in which the second dichroic splitter has a first side, a second side, and a third side, with the first side facing the projection lens, and the second dichroic splitter is used to reflect a fluorescent light beam and a white light beam to and through the third side to form an image on the two-dimensional color sensing device, and to transmit a wide band light beam through the second side to form an image on the two-dimensional monochrome sensing device.
  • In one embodiment, the sensor unit includes a flip-type reflective mirror, a two-dimensional color sensing device, a long wavelength pass filter, and a two-dimensional monochrome sensing device, in which the flip-type reflective mirror has a flip-on state to allow a white light beam to form an image on the two-dimensional color sensing device, and has a flip-off state to allow a wide band light beam and a fluorescent light beam to form an image on the two-dimensional monochrome sensing device, and the long wavelength pass filter can be disposed between the projection lens and the flip-type reflective mirror, or be disposed between the projection lens and the second dichroic splitter, or be disposed between the flip-type reflective mirror and the two-dimensional monochrome sensing device, or be disposed between the second dichroic splitter and the two-dimensional monochrome sensing device.
  • In one embodiment, the wide band light beam has a wavelength range of 470 nm-800 nm, the short wavelength light beam has a wavelength range of 365 nm-460 nm, the beam splitter has an operating wavelength range of 400 nm-800 nm, and both the first dichroic splitter and the long wavelength pass filter have a cut-off wavelength range of 400 nm-470 nm.
  • In one embodiment, the wide band light beam has a wavelength range of 650 nm-1000 nm, the short wavelength light beam has a wavelength range of 365 nm-630 nm, the beam splitter has an operating wavelength range of 400 nm-1000 nm, and all the first dichroic splitter, the second dichroic splitter, and the long wavelength pass filter have a cut-off wavelength range of 400 nm-650 nm.
  • In one embodiment, a first polarizer is disposed between the wide band light source apparatus and the beam splitter, a second polarizer is disposed in front of the two-dimensional monochrome sensing device, a first quarter-wave plate is disposed between the first objective lens and the first dichroic splitter, and a second quarter-wave plate is disposed between the optical path delay unit and the second objective lens, wherein the first polarizer has a first polarization direction, the second polarizer has a second polarization direction orthogonal to the first polarization direction, the first quarter-wave plate has a first optical axis direction, the second quarter-wave plate has a second optical axis direction, and both the first optical axis direction and the second optical axis direction are disposed within a range formed by the first polarization direction and the second polarization direction to enhance an interference effect and promote an imaging quality.
  • In one embodiment, an information processing apparatus is used to perform an image processing process.
  • In one embodiment, the reference arm unit further includes an axial motion platform, and the sample carrier unit further includes a 3-D motion platform, so that by using the axial motion platform to move the second objective lens and the reflective mirror of the reference arm unit, using the 3-D motion platform to move the sample stained with a fluorescent dye, and adjusting the optical path delay unit, the information processing apparatus can derive a 3-D image of the sample accordingly.
  • To make it easier for our examiner to understand the objective of the invention, its structure, innovative features, and performance, we use preferred embodiments together with the accompanying drawings for the detailed description of the invention.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to one embodiment of the present invention.
  • FIG. 2 illustrates a beam splitting operation and a focusing operation of the optical sectioning apparatus of FIG. 1.
  • FIG. 3 illustrates a block diagram of a reference arm unit of FIG. 1 according to one embodiment of the present invention.
  • FIG. 4 illustrates a beam combining operation and an image projecting operation of the optical sectioning apparatus of FIG. 1.
  • FIG. 5a illustrates a block diagram of a sensor unit of FIG. 1 according to one embodiment of the present invention.
  • FIG. 5b illustrates a block diagram of a sensor unit of FIG. 1 according to another embodiment of the present invention.
  • FIG. 5c illustrates a block diagram of a sensor unit of FIG. 1 according to another embodiment of the present invention.
  • FIG. 5d illustrates a block diagram of a sensor unit of FIG. 1 according to still another embodiment of the present invention.
  • FIG. 6 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to another embodiment of the present invention.
  • FIG. 7 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to still another embodiment of the present invention.
  • DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS
  • Please refer to FIG. 1-2, in which, FIG. 1 illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to one embodiment of the present invention, and FIG. 2 illustrates a beam splitting operation and a focusing operation of the optical sectioning apparatus in FIG. 1.
  • As illustrated in the figures, the optical sectioning apparatus using optical interference microscopy and fluorescence microscopy includes: a wide band light source apparatus 100, a short wavelength light source apparatus 200, a beam splitter 300, a first dichroic splitter 400, a first objective lens 500, a sample carrier unit 600, a projection lens 700, a reference arm unit 800, and a sensor unit 900.
  • The wide band light source apparatus 100 is used to generate a wide band light beam 10 (indicated by a hollow arrow); the short wavelength light source apparatus 200 is used to generate a short wavelength light beam 20 (indicated by a solid arrow); the sample carrier unit 600 is used to carry a sample 610 stained with a fluorescent dye, which will emit a fluorescent light beam 30 (indicated by a dashed line arrow) when the short wavelength light beam 20 is incident on it; and the sample carrier unit 600 further includes a white light source 620 to provide a white light beam 40 (indicated by a hollow arrowhead) having a proper intensity to pass through the first objective lens 500.
  • The beam splitter 300 has a first side S301, a second side S302, a third side S303, and a fourth side S304. The wide band light source apparatus 100 is used for generating the wide band light beam 10 to be incident on the first side S301 of the beam splitter 300 and divided by the beam splitter 300 into a reflected wide band light beam traveling out the second side S302, and a transmitted wide band light beam traveling out the third side S303.
  • The short wavelength light source apparatus 200 is used to generate the short wavelength light beam 20. The first dichroic splitter 400 has a first side S401, a second side S402, and a third side S403, with the first side S401 facing the short wavelength light source apparatus 200 and reflecting the short wavelength light beam 20, and with the third side S403 facing the second side S302 of the beam splitter 300 to transmit a branch of the wide band light beam 10 from the beam splitter 300 through the second side S402.
  • The first objective lens 500 has a collimated side S501 and a focal side S502, wherein, the collimated side S501 facing the second side S402 of the first dichroic splitter 400. The sample carrier unit 600 faces the focusing side S502 of the first objective lens 500 and is used to carry the sample 610 stained with a fluorescent dye. Besides, the sample carrier unit 600, the first objective lens 500, and the first dichroic splitter 400 together form a sample arm optical path.
  • The projection lens 700 has a light entrance side S701 and a light exit side S702, with the light entrance side S701 facing the fourth side S304 of the beam splitter 300. The sensor unit 900 faces the light exit side S702 of the projection lens 700.
  • Besides, the white light source 620 includes a white-light LED, a white-light halogen lamp, or a tungsten lamp, etc.; the first objective lens 500 has an operating wavelength range of 350 nm-1000 nm; and both the wide band light source apparatus 100 and the short wavelength light source apparatus 200 can be implemented with a light source, or a combination of a light source and a grating, or a combination of a light source, a grating, and a tilt-adjustable reflective mirror, or a plurality of parallel LED stripes (all not shown in the figure). As the light source, the grating, the tilt-adjustable reflective mirror, and the parallel LED stripes are already known in prior art, they will not be further addressed.
  • Please refer to FIG. 3, which illustrates a block diagram of a reference arm unit of FIG. 1 according to one embodiment of the present invention.
  • As illustrated in FIG. 3, the reference arm unit 800 includes: an optical path delay unit 810, a second objective lens 820, and a reflective mirror 830.
  • The optical path delay unit 810, the second objective lens 820, and the reflective mirror 830 together form an adjustable optical path, and the reference arm unit 800 is used to make a branch of the wide band light beam 10 travel a round trip along the adjustable optical path and then return to the beam splitter 300 (not shown in this figure).
  • The optical path delay unit 810 has a first side S811 and a second side S812, with the first side S811 facing the third side S303 of the beam splitter 300 (not shown in this figure); the second objective lens 820 has a collimated side S821 and a focal side S822, with the collimated side S821 facing the second side S812 of the optical path delay unit 810; and the reflective mirror 830 faces the focusing side S822 of the second objective lens 820 for reflecting the branch of the wide band light beam 10. In addition, the second objective lens 820 can have an operating wavelength range of 350-1000 nm.
  • The optical path delay unit 810 can use a reflective mirror to help make the adjustable optical path and the sample arm optical path have an optical path difference less than a coherent length by changing a displacement of the reflective mirror. One or more continuous interference carrier waves can be continuously recorded by a two-dimensional monochrome sensing device 940, and a plurality of recorded intensity values then undergo a root-mean-square calculation and an averaging calculation to produce an en-face interference intensity image, wherein the continuous interference carrier wave can also be generated by a 3-D motion platform 630, of which the principle is known in prior art, so it will not further addressed.
  • Please refer to FIG. 4, which illustrates a beam combining operation and an image projecting operation of the optical sectioning apparatus of FIG. 1.
  • As illustrated in FIG. 4, the sample carrier unit 600 is capable of reflecting the short wavelength light beam 20 and a branch of the wide band light beam 10, and the sample 610 stained with a fluorescent dye (not shown in this figure) will emit the fluorescent light beam 30 when hit by the short wavelength light beam 20. In addition, the white light source 620 (not shown in this figure) of the sample carrier unit 600 will emit the white light beam 40.
  • The first dichroic splitter 400 is used to block a band of wavelengths shorter than a preset wavelength, and the short wavelength light beam 20 has a wavelength shorter than the preset wavelength, so the short wavelength light beam 20 will be blocked by the first dichroic splitter 400, while the branch of the wide band light beam 10, the fluorescent light beam 30, and the white light beam 40 will pass through the first dichroic splitter 400.
  • The third side S303 of the beam splitter 300 faces the reference arm unit 800 and is used to reflect the branch of the wide band light beam 10 from the reference arm unit 800 to the fourth side S304, and the second side S302 faces the first dichroic splitter 400 and is used to transmit another branch of the wide band light beam 10, the fluorescent light beam 30, and the white light beam 40 to the fourth side S304.
  • Since the adjustable optical path and the sample optical path have an optical path difference less than a coherent length, the wideband light beam traveling a round trip along the adjustable optical path will have an optical interference with the wideband light beam traveling a round trip along the sample optical path when they meet each other. Since the interference principle is known in prior art, it will not be addressed further.
  • The projection lens 700 has a light entrance side S701 and a light exit side S702, with the light entrance side S701 facing the fourth side S304 of the beam splitter 300, and the light exit side S702 being used to transmit a coherent-interference resultant light beam of the wide band light beam 10, the fluorescent light beam 30, and the white light beam 40 to the sensor unit 900.
  • Please refer to FIG. 5a-5b , in which, FIG. 5a illustrates a block diagram of a sensor unit of FIG. 1 according to one embodiment of the present invention and FIG. 5b illustrates a block diagram of a sensor unit of FIG. 1 according to another embodiment of the present invention.
  • The sensor unit 900 includes a flip-type reflective mirror 915, a two-dimensional color sensing device 920, a long wavelength pass filter 930 and a two-dimensional monochrome sensing device 940.
  • The long wavelength pass filter 930 is used to further filter out the short wavelength light beam 20 (not shown in the figure), and the flip-type reflective mirror 915 has a flip mount (not shown in the figure) for presenting a flip-on state or a flip-off state. Since the flip-type reflective mirror is known in prior art, it will not be addressed further.
  • As illustrated in FIG. 5a , the long wavelength pass filter 930 is disposed between the projection lens 700 and the flip-type reflective mirror 915. When the flip-type reflective mirror 915 is in the flip-on state, the white light beam 40 will form an image on the two-dimensional color sensing device 920; when the flip-type reflective mirror 915 is in the flip-off state, the fluorescent light beam 30 and a coherent-interference resultant light beam of the wide band light beam 10 will form an image on the two-dimensional monochrome sensing device 940, respectively.
  • As illustrated in FIG. 5b , the long wavelength pass filter 930 is disposed between the flip-type reflective mirror 915 and the two-dimensional monochrome sensing device 940. When the flip-type reflective mirror 915 is in the flip-on state, the white light beam 40 will form an image on the two-dimensional color sensing device 920; when the flip-type reflective mirror 915 is in the flip-off state, the fluorescent light beam 30 and a coherent-interference resultant light beam of the wide band light beam 10 will form an image on the two-dimensional monochrome sensing device 940 respectively.
  • Please refer to FIG. 5c-5d , in which FIG. 5c illustrates a block diagram of a sensor unit of FIG. 1 according to another embodiment of the present invention, and FIG. 5d illustrates a block diagram of a sensor unit of FIG. 1 according to still another embodiment of the present invention.
  • The sensor unit 900 includes a second dichroic splitter 910, a two-dimensional color sensing device 920, a long wavelength pass filter 930 and a two-dimensional monochrome sensing device 940, in which the long wavelength pass filter 930 is used to further filter out the short wavelength light beam 20 (not shown in the figure).
  • As illustrated in FIG. 5c , the long wavelength pass filter 930 is disposed between the projection lens 700 and the second dichroic splitter 910. The second dichroic splitter 910 reflects the fluorescent light beam 30 and the white light beam 40 to the third side S903 to form an image on the two-dimensional color sensing device 920, and transmits a coherent-interference resultant light beam of the wide band light beam 10 through the second side S902 to form an image on the two-dimensional monochrome sensing device 940.
  • As illustrated in FIG. 5d , the long wavelength pass filter 930 is disposed between the second dichroic splitter 910 and the two-dimensional monochrome sensing device 940. The second dichroic splitter 910 reflects the fluorescent light beam 30 and the white light beam 40 to the third side S903 to form an image on the two-dimensional color sensing device 920, and transmits a coherent-interference resultant light beam of the wide band light beam 10 through the second side S902 to form an image on the two-dimensional monochrome sensing device 940.
  • When the wide band light beam 10 has a wavelength range of 470 nm-800 nm, the flip-type reflective mirror 915 is required, the short wavelength light beam 20 (not shown in this figure) has a wavelength range of 365 nm-460 nm, the beam splitter 300 (not shown in this figure) has an operating wavelength range of 400 nm-800 nm, and the first dichroic splitter 400 has a cut-off wavelength range of 400 nm-470 nm.
  • When the wide band light beam 10 has a wavelength range of 650 nm-1000 nm, the flip-type reflective mirror 915 or the second dichroic splitter 910 can be adopted, the short wavelength light beam 20 has a wavelength range of 365 nm-630 nm, the beam splitter 300 has an operating wavelength range of 400 nm-1000 nm, and all the first dichroic splitter 400, the second dichroic splitter 910, and the long wavelength pass filter 930 have a cut-off wavelength range of 400 nm-650 nm.
  • Please refer to FIG. 6, which illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to another embodiment of the present invention.
  • As illustrated in FIG. 6, a first polarizer 950 is disposed between the wide band light source apparatus 100 and the beam splitter 300, a second polarizer 960 is disposed in front of the two-dimensional monochrome sensing device 940, a first quarter-wave plate 970 is disposed between the first objective lens 500 and the first dichroic splitter 400, and a second quarter-wave plate 980 is disposed between the optical path delay unit 810 and the second objective lens 820.
  • The first polarizer 950 has a first polarization direction, the second polarizer 960 has a second polarization direction orthogonal to the first polarization direction, the first quarter-wave plate 970 has a first optical axis direction, the second quarter-wave plate 980 has a second optical axis direction, and both the first optical axis direction and the second optical axis direction are disposed within a range formed by the first polarization direction and the second polarization direction.
  • In one embodiment, the first polarization direction is along a vertical direction, the second polarization direction is along a horizontal direction, and both the first optical axis direction and the second optical axis direction are along a 45 degrees direction in-between the first polarization direction and the second polarization direction. When in operation, the wide band light beam 10 of the wide band light source apparatus 100 will be polarized in a vertical direction after passing through the first polarizer 950, and then split by the beam splitter 300 into a first branch and a second branch. The first branch will pass through the second quarter-wave plate 980 of the reference arm unit 800 to become a first clockwise circularly polarized light beam, which then becomes a first counter clockwise circularly polarized light beam after reflected by the reflective mirror 830, and the first counter clockwise circularly polarized light beam will become polarized in the horizontal direction after it passes through the second quarter-wave plate 980. The second branch will pass through the first quarter-wave plate 970 disposed between the first objective lens 500 and the first dichroic splitter 400 to become a second clockwise circularly polarized light beam, which then becomes a second counter clockwise circularly polarized light beam after reflected by the sample carrier unit 600, and the second counter clockwise circularly polarized light beam will become polarized in the horizontal direction after it passes through the first quarter-wave plate 970. As the second polarizer 960 in front of the two-dimensional monochrome sensing device 940 will only allow horizontally polarized light of the wide band light beam 10 to pass through, therefore, reflect light due to an antireflection film of the beam splitter 300 can be effectively blocked to further enhance an optical interference effect and promote an imaging performance.
  • Please refer to FIG. 7, which illustrates a block diagram of an optical sectioning apparatus using optical interference microscopy and fluorescence microscopy according to still another embodiment of the present invention.
  • As illustrated in FIG. 7, the reference arm unit 800 further includes an axial motion platform 840 and the sample carrier unit 600 further includes a 3-D motion platform 630. In addition, an information processing apparatus (not shown in this figure) can be used to perform an image processing process.
  • By using the axial motion platform 840 to move the second objective lens 820 and the reflective mirror 830, adjusting the optical path delay unit 500, and using the 3-D motion platform 630 to move the sample 610 stained with a fluorescent dye, the information processing apparatus (not shown in this figure) can derive a 3-D image (not shown in this figure) of the sample accordingly. Since the formation process of a 3-D image is known in prior art, it will not be addressed further.
  • Due to the novel schemes disclosed above, the present invention possesses the advantages as follows:
  • 1. The optical sectioning apparatus of the present invention has a first dichroic splitter disposed between a beam splitter and a first objective lens to block a short-wavelength light beam and thereby increase a relative strength of a fluorescent signal, shorten an exposure time, and speed up taking images.
  • 2. The optical sectioning apparatus of the present invention ensures that when a fluorescent light beam emitted from a sample passes through a first dichroic splitter, since the first dichroic splitter will filter out a short-wavelength light beam, the fluorescent light beam will have a good relative strength when it passes through the first dichroic splitter, thereby shortening an exposure time and speeding up taking images.
  • 3. The optical sectioning apparatus of the present invention has a long wavelength pass filter installed in a sensor unit to further filter out a short-wavelength light beam to increase the relative strength of a fluorescent signal, and thereby shortening an exposure time and speeding up taking images.
  • While the invention has been described by way of example and in terms of preferred embodiments, it is to be understood that the invention is not limited thereto. On the contrary, it is intended to cover various modifications and similar arrangements and procedures, and the scope of the appended claims therefore should be accorded the broadest interpretation so as to encompass all such modifications and similar arrangements and procedures.
  • In summation of the above description, the present invention herein enhances the performance over the conventional structure and further complies with the patent application requirements and is submitted to the Patent and Trademark Office for review and granting of the commensurate patent rights.

Claims (11)

What is claimed is:
1. An optical sectioning apparatus using optical interference microscopy and fluorescence microscopy, including:
a beam splitter, having a first side, a second side, a third side, and a fourth side, and being capable of splitting an incident light beam received from the first side into a reflected light beam traveling out the second side and a transmitted light beam traveling out the third side;
a wide band light source apparatus for generating a wide band light beam to be incident on the first side of the beam splitter;
a reference arm unit, used to make the transmitted light beam travel a round trip along an adjustable optical path and then return to the beam splitter;
a short wavelength light source apparatus for generating a short wavelength light beam;
a first dichroic splitter, having a first side, a second side, and a third side, with the first side facing the short wavelength light source apparatus, the third side facing the second side of the beam splitter, and being capable of providing a light-blocking effect on a band of wavelengths shorter than a preset wavelength, and the short wavelength light beam having a wavelength shorter than the preset wavelength;
a first objective lens, having a collimated side and a focal side, with the collimated side facing the second side of the first dichroic splitter;
a sample carrier unit facing the focal side of the first objective lens and being used for carrying a sample stained with a fluorescent dye;
a projection lens, having a light entrance side and a light exit side, with the light entrance side facing the fourth side of the beam splitter; and
a sensor unit facing the light exit side of the projection lens.
2. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 1, wherein the reference arm unit includes:
an optical path delay unit, having a first side and a second side, with the first side facing the third side of the beam splitter;
a second objective lens, having a collimated side and a focal side, with the collimated side facing the second side of the optical path delay unit; and
a reflective mirror, facing the focal side of the second objective lens and used for reflecting the transmitted light beam, wherein the optical path delay unit is used for adjusting the adjustable optical path so that the adjustable optical path and a sample arm optical path have an optical path difference less than a coherent length, with the sample arm optical path being formed by the sample carrier unit, the first objective lens, and the first dichroic splitter.
3. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 1, wherein both the wide band light source apparatus and the short wavelength light source apparatus are implemented with a light source, or a combination of a light source and a grating, or a combination of a light source, a grating, and a tilt-adjustable reflective mirror, or a plurality of parallel LED stripes.
4. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 1, wherein the sample carrier unit further includes a white light source to provide a proper intensity of white light to pass through the first objective lens, the white light source including a white-light LED, a white-light halogen lamp, or a tungsten lamp.
5. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 1, wherein the sensor unit includes a second dichroic splitter, a two-dimensional color sensing device, a long wavelength pass filter, and a two-dimensional monochrome sensing device, in which the second dichroic splitter has a first side, a second side, and a third side, with the first side facing the projection lens, and the second dichroic splitter is used to reflect a fluorescent light beam and a white light beam to and through the third side to form an image on the two-dimensional color sensing device, and to transmit a wide band light beam through the second side to form an image on the two-dimensional monochrome sensing device; or the sensor unit includes a flip-type reflective mirror, a two-dimensional color sensing device, a long wavelength pass filter, and a two-dimensional monochrome sensing device, in which the flip-type reflective mirror has a flip-on state to allow a white light beam to form an image on the two-dimensional color sensing device, and has a flip-off state to allow a wide band light beam and a fluorescent light beam to form an image on the two-dimensional monochrome sensing device, and the long wavelength pass filter can be disposed between the projection lens and the flip-type reflective mirror, or be disposed between the projection lens and the second dichroic splitter, or be disposed between the flip-type reflective mirror and the two-dimensional monochrome sensing device, or be disposed between the second dichroic splitter and the two-dimensional monochrome sensing device.
6. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 5, wherein the wide band light beam has a wavelength range of 470 nm-800 nm, the short wavelength light beam has a wavelength range of 365 nm-460 nm, the beam splitter has an operating wavelength range of 400 nm-800 nm, and both the first dichroic splitter and the long wavelength pass filter have a cut-off wavelength range of 400 nm-470 nm.
7. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 5, wherein the wide band light beam has a wavelength range of 650 nm-1000 nm, the short wavelength light beam has a wavelength range of 365 nm-630 nm, the beam splitter has an operating wavelength range of 400 nm-1000 nm, and all the first dichroic splitter, the second dichroic splitter, and the long wavelength pass filter have a cut-off wavelength range of 400 nm-650 nm.
8. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 2, wherein a first polarizer is disposed between the wide band light source apparatus and the beam splitter, a second polarizer is disposed in front of the two-dimensional monochrome sensing device, a first quarter-wave plate is disposed between the first objective lens and the first dichroic splitter, and a second quarter-wave plate is disposed between the optical path delay unit and the second objective lens, wherein the first polarizer has a first polarization direction, the second polarizer has a second polarization direction orthogonal to the first polarization direction, the first quarter-wave plate has a first optical axis direction, the second quarter-wave plate has a second optical axis direction, and both the first optical axis direction and the second optical axis direction are disposed within a range formed by the first polarization direction and the second polarization direction to enhance an interference effect and promote an imaging quality.
9. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 5, wherein a first polarizer is disposed between the wide band light source apparatus and the beam splitter, a second polarizer is disposed in front of the two-dimensional monochrome sensing device, a first quarter-wave plate is disposed between the first objective lens and the first dichroic splitter, and a second quarter-wave plate is disposed between the optical path delay unit and the second objective lens, wherein the first polarizer has a first polarization direction, the second polarizer has a second polarization direction orthogonal to the first polarization direction, the first quarter-wave plate has a first optical axis direction, the second quarter-wave plate has a second optical axis direction, and both the first optical axis direction and the second optical axis direction are disposed within a range formed by the first polarization direction and the second polarization direction to enhance an interference effect and promote an imaging quality.
10. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 2, further including an information processing apparatus to perform an image processing process.
11. The optical sectioning apparatus using optical interference microscopy and fluorescence microscopy as disclosed in claim 10, wherein the reference arm unit further includes an axial motion platform, and the sample carrier unit further includes a 3-D motion platform, so that by using the axial motion platform to move the second objective lens and the reflective mirror, by adjusting the optical path delay unit, and by using the 3-D motion platform to move the sample stained with the fluorescent dye, the information processing apparatus can derive a 3-D image of the sample accordingly.
US15/679,478 2017-06-05 2017-08-17 Optical sectioning apparatus using advanced optical interference microscopy Active US10151572B1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
TW106118559 2017-06-05
TW106118559A TWI654443B (en) 2017-06-05 2017-06-05 Optical slitting device using advanced optical interference microscopy
TW106118559A 2017-06-05

Publications (2)

Publication Number Publication Date
US20180347960A1 true US20180347960A1 (en) 2018-12-06
US10151572B1 US10151572B1 (en) 2018-12-11

Family

ID=61163581

Family Applications (1)

Application Number Title Priority Date Filing Date
US15/679,478 Active US10151572B1 (en) 2017-06-05 2017-08-17 Optical sectioning apparatus using advanced optical interference microscopy

Country Status (4)

Country Link
US (1) US10151572B1 (en)
EP (1) EP3413113A1 (en)
JP (1) JP6633685B2 (en)
TW (1) TWI654443B (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021184924A1 (en) * 2020-03-19 2021-09-23 深圳光峰科技股份有限公司 Light source system and projection equipment
US20210382318A1 (en) * 2020-06-08 2021-12-09 The Regents Of The University Of California White dwarf: cross-polarized white light slide-free imaging

Families Citing this family (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
TWI674089B (en) * 2017-10-31 2019-10-11 銳準醫光股份有限公司 Optical slitting device integrating Mirau optical interference microscopy
CN110726702A (en) * 2018-07-17 2020-01-24 锐准医光股份有限公司 Optical layer cutting device adopting advanced optical interference microscopy

Family Cites Families (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4900934A (en) * 1987-07-15 1990-02-13 University Of Utah Apparatus for simultaneous visualization and measurement of fluorescence from fluorescent dye-treated cell preparations and solutions
USRE36529E (en) * 1992-03-06 2000-01-25 The United States Of America As Represented By The Department Of Health And Human Services Spectroscopic imaging device employing imaging quality spectral filters
JPH0914911A (en) * 1995-06-26 1997-01-17 Fuji Photo Optical Co Ltd Interferometer
JP2000292705A (en) * 1999-04-05 2000-10-20 Olympus Optical Co Ltd Scanning microscope
WO2007030741A2 (en) * 2005-09-09 2007-03-15 Trustees Of Boston University Imaging system using dynamic speckle illumination
DE102006021557B3 (en) * 2006-05-08 2007-07-12 Carl Mahr Holding Gmbh Device under test reproducing and/or measuring arrangement for micro system technology, has illumination device illuminating device under test whose light is kept away from reference path
US7838302B2 (en) * 2006-08-07 2010-11-23 President And Fellows Of Harvard College Sub-diffraction limit image resolution and other imaging techniques
US7498551B2 (en) * 2006-10-06 2009-03-03 Los Alamos National Security, Llc Apparatus and method for tracking a molecule or particle in three dimensions
WO2010088418A1 (en) * 2009-01-29 2010-08-05 The Regents Of The University Of California High resolution structured illumination microscopy
US7978336B2 (en) * 2009-03-16 2011-07-12 Ut-Battelle, Llc Three wavelength quantitative imaging systems
US8248614B2 (en) * 2009-03-16 2012-08-21 Ut-Battelle, Llc Quantitative phase-imaging systems
US20110261367A1 (en) * 2009-04-27 2011-10-27 Gmitro Arthur F Integrated Confocal and Spectral-Domain Optical Coherence Tomography Microscope
CA2774422C (en) * 2009-10-12 2017-08-29 Ventana Medical Systems, Inc. Multi-modality contrast and brightfield context rendering for enhanced pathology determination and multi-analyte detection in tissue
EP2615967B1 (en) * 2010-09-17 2017-08-16 LLtech Management Optical tissue sectioning using full field optical coherence tomography
EP2972068B1 (en) * 2013-03-14 2020-09-23 Research Development Foundation Apparatus and methods for optical coherence tomography and two-photon luminescence imaging
US9633277B2 (en) * 2014-09-12 2017-04-25 Research Development Foundation Apparatus and methods for identifying and evaluating bright spot indications observed through optical coherence tomography
JP6413076B2 (en) * 2014-10-01 2018-10-31 パナソニックIpマネジメント株式会社 Inner layer measurement method and apparatus

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2021184924A1 (en) * 2020-03-19 2021-09-23 深圳光峰科技股份有限公司 Light source system and projection equipment
US20210382318A1 (en) * 2020-06-08 2021-12-09 The Regents Of The University Of California White dwarf: cross-polarized white light slide-free imaging
US12019250B2 (en) * 2020-06-08 2024-06-25 The Regents Of The University Of California White dwarf: cross-polarized white light slide-free imaging

Also Published As

Publication number Publication date
US10151572B1 (en) 2018-12-11
TWI654443B (en) 2019-03-21
EP3413113A1 (en) 2018-12-12
JP6633685B2 (en) 2020-01-22
TW201903463A (en) 2019-01-16
JP2018205708A (en) 2018-12-27

Similar Documents

Publication Publication Date Title
US10151572B1 (en) Optical sectioning apparatus using advanced optical interference microscopy
CN102264279B (en) Optical tomographic imaging apparatus
CN105147241B (en) Method and system based on double space carrier frequency technique extension OCT image depth
CN103499431B (en) A kind of dynamic thermal focal distance of solid laser crystal measuring method and device
US9566001B2 (en) Ophthalmologic apparatus
US10337995B2 (en) Systems and methods for oblique laser scanning
US8836951B2 (en) Imaging device for optical coherence tomographic image and imaging method
US9072460B2 (en) Optical coherence tomography device and optical coherence tomography method
US9955866B2 (en) Optical tomographic imaging apparatus
WO2015050827A1 (en) Incoherent fluorescence digital holographic microscopy using transmission liquid crystal lens
US20200025744A1 (en) Optical sectioning apparatus using advanced optical interference microscopy
US10646114B2 (en) Ophthalmic imaging apparatus and method of controlling the same
Bo et al. Cellular-resolution in vivo tomography in turbid tissue through digital aberration correction
US20190353883A1 (en) Optical sectioning apparatus using advanced mirau optical interference microscopy
US9427149B2 (en) Optical tomographic imaging apparatus
CN108982433B (en) Optical layer cutting device adopting advanced optical interference microscopy
US9835436B2 (en) Wavelength encoded multi-beam optical coherence tomography
JP7389487B2 (en) Interferometric imaging device and its applications
JP2006242571A (en) Apparatus for measuring three-dimensional shape
JP2011215003A (en) Wavefront measurement method, wavefront measurement device, and microscope
Hu et al. Reliability of wavefront shaping based on coherent optical adaptive technique in deep tissue focusing
JP6723835B2 (en) Optical coherence tomography device
WO2023066415A1 (en) Composite optical fiber for holographic endoscopy
JP5336964B2 (en) Wavefront measuring device

Legal Events

Date Code Title Description
AS Assignment

Owner name: ACUSOLUTIONS INC., SAMOA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:TSAI, CHIEN-CHUNG;HSU, KUANG-YU;REEL/FRAME:043320/0086

Effective date: 20170516

STCF Information on status: patent grant

Free format text: PATENTED CASE

MAFP Maintenance fee payment

Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY

Year of fee payment: 4