US20190317306A1 - Method for three-dimensional imaging using upconverting nanoparticles - Google Patents

Method for three-dimensional imaging using upconverting nanoparticles Download PDF

Info

Publication number
US20190317306A1
US20190317306A1 US16/457,104 US201916457104A US2019317306A1 US 20190317306 A1 US20190317306 A1 US 20190317306A1 US 201916457104 A US201916457104 A US 201916457104A US 2019317306 A1 US2019317306 A1 US 2019317306A1
Authority
US
United States
Prior art keywords
sample
dimensional
upconverting nanoparticles
image
images
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US16/457,104
Inventor
Kang Taek Lee
Yo Han SONG
Jin Ho Park
Hong Li JO
Yeong Chang GOH
Kyu Jin SHIN
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Gwangju Institute of Science and Technology
Original Assignee
Gwangju Institute of Science and Technology
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Gwangju Institute of Science and Technology filed Critical Gwangju Institute of Science and Technology
Priority to US16/457,104 priority Critical patent/US20190317306A1/en
Assigned to GWANGJU INSTITUTE OF SCIENCE AND TECHNOLOGY reassignment GWANGJU INSTITUTE OF SCIENCE AND TECHNOLOGY ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: GOH, YEONG CHANG, JO, HONG LI, LEE, KANG TAEK, PARK, JIN HO, SHIN, KYU JIN, SONG, YO HAN
Publication of US20190317306A1 publication Critical patent/US20190317306A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0076Optical details of the image generation arrangements using fluorescence or luminescence
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/6428Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
    • GPHYSICS
    • G01MEASURING; TESTING
    • G01NINVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
    • G01N21/00Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
    • G01N21/62Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
    • G01N21/63Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
    • G01N21/64Fluorescence; Phosphorescence
    • G01N21/645Specially adapted constructive features of fluorimeters
    • G01N21/6456Spatial resolved fluorescence measurements; Imaging
    • G01N21/6458Fluorescence microscopy
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0032Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/16Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/361Optical details, e.g. image relay to the camera or image sensor
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/36Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
    • G02B21/365Control or image processing arrangements for digital or video microscopes
    • G02B21/367Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/50Depth or shape recovery
    • G06T7/521Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N13/00Stereoscopic video systems; Multi-view video systems; Details thereof
    • H04N13/20Image signal generators
    • H04N13/204Image signal generators using stereoscopic image cameras
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00Details of television systems
    • H04N5/30Transforming light or analogous information into electric information
    • H04N5/33Transforming infrared radiation
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B2207/00Coding scheme for general features or characteristics of optical elements and systems of subclass G02B, but not including elements and systems which would be classified in G02B6/00 and subgroups
    • G02B2207/114Two photon or multiphoton effect
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10028Range image; Depth image; 3D point clouds
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10056Microscopic image
    • G06T2207/10061Microscopic image from scanning electron microscope

Definitions

  • the present disclosure relates to an imaging method, and more particularly, to an imaging method for acquiring a three-dimensional image of a sample such as a cell using upconverting nanoparticles.
  • the fluorescence microscope is an optical system that is most widely used to observe biological cells.
  • the fluorescence microscope acquires an image of a cell by making an enlarged cell image formed on an image sensor with fluorescent light emitted from a cell dyed with a fluorescent dye through an objective lens.
  • a charge coupled device (CCD) is an implementation of the image sensor.
  • the optical system of the fluorescence microscope has a conventional wide field microscope as a basic structure thereof. Thereby, not only fluorescent light emitted from the cell and light of the image formed on the CCD but also light which is unfocused and thus fails to form an image enters the image capturing device. Thus, it is difficult to acquire an accurate three-dimensional image of the cell. Due to this issue, contrast and resolution of the acquired three-dimensional image of the cell are degraded.
  • the aforementioned issue is more serious than for a typical optical microscope, and it is difficult to correctly observe a fine structure of the cell.
  • a confocal laser scanning microscope overcomes the above issue by filtering out light fails to form an image, using a pin-hole as a spatial filter. Accordingly, the confocal laser scanning microscope has higher contrast and higher resolution than a typical wide field microscope. Further, the confocal laser scanning microscope can obtain an optically sectioned image of a cell. Such features of the confocal laser scanning microscope are essential conditions for constructing a three-dimensional image of a cell. Presently, the confocal laser scanning microscope implements a three-dimensional image of a cell with high contrast and high resolution, and thus has become an important indispensable cell imaging system in bioengineering research.
  • a laser beam scanning apparatus for scanning a sample with a laser beam is needed, and a system for regenerating an image from an optical signal reaching an optical detector through the pin-hole is also needed.
  • the confocal laser scanning microscope inevitably uses x-y scanning technique in obtaining a sectioned image, and thus it takes a long time for the confocal laser scanning microscope to measure the three-dimensional image due to the limited speed of data acquisition. Thereby, it is difficult to observe change of the sample in real time using the confocal laser scanning microscope.
  • UCNPs upconverting nanoparticles
  • a method for three-dimensional imaging includes introducing upconverting nanoparticles into a sample, illuminating near-infrared laser so that the upconverting nanoparticles introduced into the sample are excited, detecting a visible ray emitted from the excited upconverting nanoparticles and capturing and acquiring two-dimensional images by scanning the sample in a depth direction of the sample, and generating a three-dimensional image of the sample using the two-dimensional images.
  • a wavelength of the near-infrared laser may be between 900 nm and 1000 nm.
  • the near-infrared laser may be 980 nm continuous wave (CW) diode laser.
  • the acquiring of the two-dimensional images may include capturing images of the sample by moving an objective lens in the depth direction of the sample.
  • the generating of the three-dimensional image may include obtaining coordinates on x, y and z axes according to a peak point of a light emission signal of the upconverting nanoparticles.
  • the generating of the three-dimensional image may include measuring the peak point on a Gaussian distribution curve according to an intensity of the light emission signal of the upconverting nanoparticles for the two-dimensional images on the z axis, obtaining a coordinate on the z axis, measuring a peak point of a two-dimensional Gaussian distribution curve for the intensity of light emission signal for an image at the obtained coordinate on the z axis, and obtaining coordinates on the x and y axes and rendering the same.
  • the upconverting nanoparticles may be one selected from among (NaYF 4 :Yb 3+ , Er 3+ ), (NaYF 4 :Yb 3+ , Tm 3+ ), (NaGdF 4 :Yb 3+ , Er 3+ ), (NaYF 4 :Yb 3+ , Er 3+ /NaGdF 4 ) and (NaGdF 4 :Yb 3+ , Er 3+ /NaGdF 4 ).
  • a surface of the upconverting nanoparticles may be coated with a mixture of phospholipid-PEG and phospholipid PEG-amine
  • a method for three-dimensional imaging has the following effects.
  • the imaging speed of a wide-field fluorescence microscope may be maintained, while temporal and spatial resolutions that the conventional confocal laser scanning microscope exhibits are maintained.
  • upconverting nanoparticles are used as imaging probes, and a source of light in the range of near-infrared rays is used for scanning, the efficiency of absorption of light by a biological tissue is relatively low, and thus high-resolution images may be obtained.
  • the present disclosure may be effectively used in research on cell kinetics including nuclear absorption and single particle tracking.
  • FIG. 1 illustrates paths of upconversion emission of NaYF4:Yb3+, Er3+ and an emission spectrum of upconverting nanoparticles whose surface is coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine.
  • FIG. 2 is a schematic diagram illustrating a fluorescence microscope used for a method for three-dimensional imaging according to an embodiment of the present disclosure.
  • FIG. 3 is a graphic depicting the z-axis scanning position over time.
  • FIG. 4 schematically illustrates a procedure of obtaining two-dimensional images by performing scanning in the depth direction using a method for three-dimensional imaging according to an embodiment of the present disclosure.
  • FIG. 5 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles along the z-axis.
  • FIG. 6 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles in an x-y plane closest to a determined z-axis coordinate.
  • FIG. 7 shows images obtained by illuminating 980 nm laser and 532 nm laser onto a cell which does not contain a fluorophore.
  • FIG. 8 illustrates comparison of images before and after determination of the position of upconverting nanoparticles.
  • FIG. 9 shows and a three-dimensional image generated by injecting upconverting nanoparticles into a Ma cell and photographing the cell.
  • FIG. 10 shows a three-dimensional trajectory of a single upconverting nanoparticles, which is arbitrarily selected.
  • the fluorescence image may be blurred during scanning of the image. It is possible to obtain a clear image through complex mathematical reconstruction. However, optical stability may be lowered due to photoblinking of the imaging probe and photoleaching, and the image may be contaminated by autofluorescence.
  • the core configuration of the present disclosure for addressing the aforementioned issues is upconverting nanoparticles, which are used as a imaging probe.
  • the upconverting nanoparticles absorb near-infrared (NIR) photons through optical upconversion, and emit visible photons or near-IN photons by nature.
  • NIR near-infrared
  • a wavelength of a beam illuminated onto the sample is within the range of wavelength of NIR light, but the wavelength for imaging is within the range of wavelength of visible light.
  • the nanocrystal NaYF4:Yb3+, Er3+
  • FIG. 1 illustrates paths of upconversion emission of NaYF4:Yb3+, Er3+and an emission spectrum of upconverting nanoparticles whose surface is coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine. As shown in the figure, NIR light is absorbed, and visible light is emitted through upconversion.
  • the upconverting nanoparticles are excited by NIR light, which is biologically friendly, and emit visible light. Accordingly, if the upconverting nanoparticles are used for cell imaging, they may rarely damage a cell specimen and autofluorescence may be prevented. Further, the converting nanoparticles may significantly increase transmittance through a biological body, and images may be obtained through a typical CCD for visible light, rather than through a CCD for NIR light. Accordingly, with the upconverting nanoparticles, consecutive images may be obtained for a long time since the upconverting nanoparticles do not cause photoblinking or photobleaching. Further, since the upconverting nanoparticles are a multipurpose nanomaterial capable of performing various biological functions through surface improvement, it may have universal and general biological applications.
  • a method for three-dimensional imaging includes introducing upconverting nanoparticles into a sample, illuminating NIR laser to excite the upconverting nanoparticles introduced into the sample, detecting visible light emitted from the excited upconverting nanoparticles and acquiring two-dimensional images captured by performing scanning in the depth direction of the sample, and generating a three-dimensional image of the sample using the two-dimensional images.
  • a sample for three-dimensional imaging is prepared.
  • various animal cells or vegetable cells may be used as the sample.
  • the nanoparticles are introduced into the cell as an imaging probe.
  • the upconverting nanoparticles used in the present disclosure are applicable to various embodiments in which the upconverting nanoparticles are excited by NIR light and emit visible light.
  • the surfaces of these nanoparticles may be coated with a mixture of phospholipid-PEG and phospholipid-PEG-amine
  • FIG. 2 is a schematic diagram illustrating a fluorescence microscope used for a method for three-dimensional imaging according to an embodiment of the present disclosure.
  • the NIR laser serves to excite upconverting nanoparticles introduced into the sample, such that light having a wavelength in the range of visible light is emitted.
  • the wavelength of the NIR light used for the separation ranges from 900 nm to 1000 nm.
  • any laser whether it is Q-switching laser or femtosecond laser, may be used.
  • Relatively low-cost continuous wave (CW) laser may be used.
  • a fluorescence image is acquired by detecting visible rays emitted from the upconverting nanoparticles excited by the NIR laser.
  • the acquired image should be in the range of visible light rather than in the range of infrared light, and have a high signal sensitivity.
  • an electron multiplying CCD EMC CCD
  • a plurality of two-dimensional images of the sample ares acquired by scanning the sample in the depth direction (“z-direction”).
  • the scanning refers to dividing the sample into parts in the depth direction and moving the sample or the objective lens such that the camera can capture multiple images of the sample.
  • two-dimensional images are captured, while the position of the objective lens is shifted in the depth direction of the sample through a motor controller attached to the microscope.
  • the number and interval between the captured images are set by a computer connected to the motor controller.
  • the number of captured two-dimensional images may be 15, and the distance between the images may be set to 500 nm.
  • the range of scanning in the z-axis direction is about 7 ⁇ m, which corresponds to a range which allows measurement of sizes of almost all Hela cells.
  • the exposure time of the EMCCD may be about 70 ms. Accordingly, it is possible to obtain two-dimensional images for building a three-dimensional image along the z-axis in about one second.
  • FIG. 3 is a graphic depicting the z-axis scanning position over time.
  • the images may be consecutively obtained according to movement of the objective lens.
  • the time interval between the images may be about one second.
  • FIG. 4 schematically illustrates a procedure of obtaining two-dimensional images by performing scanning in the depth direction using a method for three-dimensional imaging according to an embodiment of the present disclosure.
  • Multiple two-dimensional images may be obtained by scanning the sample in the z-axis direction by moving the objective lens.
  • a plane in focus has a light emission point having the highest intensity, and the intensity gradually decreases in planes out of focus.
  • FIG. 5 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles along the z-axis.
  • variation of the emission intensity of upconverting nanoparticles along the z-axis fits a Gaussian distribution. Accordingly, the peak point on the Gaussian distribution curve may be interpreted as the z-axis coordinate of a single upconverting nanoparticles.
  • FIG. 6 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles in an x-y plane closest to a determined z-axis coordinate.
  • s denotes a standard deviation of the Gaussian distribution.
  • the x and y coordinates of the peak point of emission intensity are determined by the coordinates of the center in relation to the Gaussian distribution.
  • a three-dimensional image may be generated by rendering point markers at the respective x, y, and z coordinates.
  • the three-dimensional image may be generated by determining the three-dimensional center and repeating the rendering operation.
  • a z-axis coordinate is estimated first, and then two-dimensional coordinates on the x and y axes are estimated. Then, three-dimensional coordinates are estimated, and then a point is marked at the corresponding position to reconstruct the image.
  • one set of 3-D imaging is possible at a time, and thus the change in position of the nanoparticle may be three-dimensionally tracked every one second.
  • An error for the position determined according to correction performed using the Gaussian distribution curve depends on the number of photons and the pixel size of the camera.
  • the error range given by Equation 1, which was proposed by Thomson, is about 4 nm in the x-y plane and about 15 nm on the z axis. Accordingly, to more accurately determine the position, high-power laser is preferably used.
  • 980 nm laser and 532 nm laser were illuminated onto a cell which did not contain a fluorophore (see FIG. 7 ).
  • the powers used for the illumination were 386 W/cm 2 and 44 W/cm 2 , respectively.
  • 980 nm laser did not cause autofluorescence even though the power thereof was 9 times greater than the power of 532 nm laser.
  • 532 nm laser caused autofluorescence.
  • the diameter of the upconverting nanoparticles was less than or equal to about 27,6 nm.
  • the diameter obtained after coating was less than or equal to about 32.6 nm.
  • a three-dimensional image of a fixed Hela cell was acquired before the upconverting nanoparticles were introduced into the cell. The cell was fixed in capturing the image thereof in order to check the effect of determination of a single three-dimensional particle (see FIG. 8 ). As expected, autofluorescence was not created, and it was seen that the blurring effect of the upconverting nanoparticles were eliminated by the position determination.
  • the method for three-dimensional imaging using upconverting nanoparticles according to the present disclosure may be the most appropriate model for visualizing the effect of introduction into the nucleus. To check if this is true, images of a live Hela cell are shown in FIG. 9 .
  • FIG. 10 shows a three-dimensional trajectory of a single upconverting nanoparticles, which is arbitrarily selected. It is apparent that the trajectory is created by a few different transports. The area marked by blue indicates an active transport according to the cytoskeleton, and the area marked by red indicates limited diffusion.

Landscapes

  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Analytical Chemistry (AREA)
  • Optics & Photonics (AREA)
  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Multimedia (AREA)
  • Immunology (AREA)
  • Biochemistry (AREA)
  • Pathology (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Signal Processing (AREA)
  • Chemical Kinetics & Catalysis (AREA)
  • Theoretical Computer Science (AREA)
  • Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Computer Graphics (AREA)
  • Geometry (AREA)
  • Software Systems (AREA)

Abstract

The present disclosure relates to a method for three-dimensional imaging, including introducing upconverting nanoparticles into a sample, illuminating near-infrared laser such that upconverting nanoparticles introduced into a sample is excited, detecting a visible ray emitted from the excited upconverting nanoparticles and capturing and acquiring two-dimensional images by scanning the sample in a depth direction of the sample, and generating a three-dimensional image of the sample using the two-dimensional images.

Description

    CROSS REFERENCE TO RELATED APPLICATION
  • This application is a continuation application of U.S. Ser. No. 15/360,917, filed on Nov. 23, 2016, which claims priority to Korean Patent Application No. 10-2016-0025389, filed on Mar. 3, 2016. The entire disclosures of each of the above applications are incorporated herein by reference.
  • BACKGROUND 1. Technical Field
  • The present disclosure relates to an imaging method, and more particularly, to an imaging method for acquiring a three-dimensional image of a sample such as a cell using upconverting nanoparticles.
  • 2. Description of the Related Art
  • The fluorescence microscope is an optical system that is most widely used to observe biological cells. The fluorescence microscope acquires an image of a cell by making an enlarged cell image formed on an image sensor with fluorescent light emitted from a cell dyed with a fluorescent dye through an objective lens. A charge coupled device (CCD) is an implementation of the image sensor. The optical system of the fluorescence microscope has a conventional wide field microscope as a basic structure thereof. Thereby, not only fluorescent light emitted from the cell and light of the image formed on the CCD but also light which is unfocused and thus fails to form an image enters the image capturing device. Thus, it is difficult to acquire an accurate three-dimensional image of the cell. Due to this issue, contrast and resolution of the acquired three-dimensional image of the cell are degraded. In particular, for a fluorescence microscope employing a cell dyed with a fluorescent dye as a sample, the aforementioned issue is more serious than for a typical optical microscope, and it is difficult to correctly observe a fine structure of the cell.
  • To address this issue, a confocal laser scanning microscope has been introduced. The confocal laser scanning microscope overcomes the above issue by filtering out light fails to form an image, using a pin-hole as a spatial filter. Accordingly, the confocal laser scanning microscope has higher contrast and higher resolution than a typical wide field microscope. Further, the confocal laser scanning microscope can obtain an optically sectioned image of a cell. Such features of the confocal laser scanning microscope are essential conditions for constructing a three-dimensional image of a cell. Presently, the confocal laser scanning microscope implements a three-dimensional image of a cell with high contrast and high resolution, and thus has become an important indispensable cell imaging system in bioengineering research.
  • However, to create an image using a confocal laser scanning microscope, a laser beam scanning apparatus for scanning a sample with a laser beam is needed, and a system for regenerating an image from an optical signal reaching an optical detector through the pin-hole is also needed. Accordingly, the confocal laser scanning microscope inevitably uses x-y scanning technique in obtaining a sectioned image, and thus it takes a long time for the confocal laser scanning microscope to measure the three-dimensional image due to the limited speed of data acquisition. Thereby, it is difficult to observe change of the sample in real time using the confocal laser scanning microscope.
  • The description provided above is merely intended to provide further understanding of the present disclosure, and should not be understood as meaning that the present disclosure corresponds to a prior art technology which is well known to those skilled in the art..
  • SUMMARY
  • It is an aspect of the present disclosure to provide a method for three-dimensional imaging which provides the quality of an image captured by a confocal laser scanning microscope using upconverting nanoparticles (UCNPs), which are fluorescent particles, as probes and the imaging speed of the fluorescence microscope technology.
  • In accordance with one aspect of the present disclosure, a method for three-dimensional imaging includes introducing upconverting nanoparticles into a sample, illuminating near-infrared laser so that the upconverting nanoparticles introduced into the sample are excited, detecting a visible ray emitted from the excited upconverting nanoparticles and capturing and acquiring two-dimensional images by scanning the sample in a depth direction of the sample, and generating a three-dimensional image of the sample using the two-dimensional images.
  • A wavelength of the near-infrared laser may be between 900 nm and 1000 nm.
  • The near-infrared laser may be 980 nm continuous wave (CW) diode laser.
  • The acquiring of the two-dimensional images may include capturing images of the sample by moving an objective lens in the depth direction of the sample.
  • The generating of the three-dimensional image may include obtaining coordinates on x, y and z axes according to a peak point of a light emission signal of the upconverting nanoparticles.
  • The generating of the three-dimensional image may include measuring the peak point on a Gaussian distribution curve according to an intensity of the light emission signal of the upconverting nanoparticles for the two-dimensional images on the z axis, obtaining a coordinate on the z axis, measuring a peak point of a two-dimensional Gaussian distribution curve for the intensity of light emission signal for an image at the obtained coordinate on the z axis, and obtaining coordinates on the x and y axes and rendering the same.
  • The upconverting nanoparticles may be one selected from among (NaYF4:Yb3+, Er3+), (NaYF4:Yb3+, Tm3+), (NaGdF4:Yb3+, Er3+), (NaYF4:Yb3+, Er3+/NaGdF4) and (NaGdF4:Yb3+, Er3+/NaGdF4).
  • A surface of the upconverting nanoparticles may be coated with a mixture of phospholipid-PEG and phospholipid PEG-amine
  • According to embodiments of the present disclosure, a method for three-dimensional imaging has the following effects.
  • First, the imaging speed of a wide-field fluorescence microscope may be maintained, while temporal and spatial resolutions that the conventional confocal laser scanning microscope exhibits are maintained.
  • Second, since upconverting nanoparticles are used as imaging probes, and a source of light in the range of near-infrared rays is used for scanning, the efficiency of absorption of light by a biological tissue is relatively low, and thus high-resolution images may be obtained.
  • Third, since three-dimensional images may be provided in real time, the present disclosure may be effectively used in research on cell kinetics including nuclear absorption and single particle tracking.
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 illustrates paths of upconversion emission of NaYF4:Yb3+, Er3+ and an emission spectrum of upconverting nanoparticles whose surface is coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine.
  • FIG. 2 is a schematic diagram illustrating a fluorescence microscope used for a method for three-dimensional imaging according to an embodiment of the present disclosure.
  • FIG. 3 is a graphic depicting the z-axis scanning position over time.
  • FIG. 4 schematically illustrates a procedure of obtaining two-dimensional images by performing scanning in the depth direction using a method for three-dimensional imaging according to an embodiment of the present disclosure.
  • FIG. 5 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles along the z-axis.
  • FIG. 6 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles in an x-y plane closest to a determined z-axis coordinate.
  • FIG. 7 shows images obtained by illuminating 980 nm laser and 532 nm laser onto a cell which does not contain a fluorophore.
  • FIG. 8 illustrates comparison of images before and after determination of the position of upconverting nanoparticles.
  • FIG. 9 shows and a three-dimensional image generated by injecting upconverting nanoparticles into a Ma cell and photographing the cell.
  • FIG. 10 shows a three-dimensional trajectory of a single upconverting nanoparticles, which is arbitrarily selected.
  • DETAILED DESCRIPTION
  • Terms used in this specification are merely adopted to explain specific embodiments, and are not intended to limit the present disclosure. A singular expression includes a plural expression unless the two expressions are contextually different from each other. In this specification, a term “include” is intended to specify characteristics, regions, integers, steps, operations, constituents and/or components, and should be understood as not pre-excluding existence or addition of one or more other characteristics, regions, integers, steps, operations, constituents and/or groups.
  • Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of this specification and the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
  • Hereinafter, a method for three-dimensional imaging according to preferred embodiments of the present disclosure will be described with reference to the accompanying drawings.
  • If a two-dimensional image of a sample is acquired by scanning the sample in the depth direction using a wide-field fluorescence microscope, the fluorescence image may be blurred during scanning of the image. It is possible to obtain a clear image through complex mathematical reconstruction. However, optical stability may be lowered due to photoblinking of the imaging probe and photoleaching, and the image may be contaminated by autofluorescence.
  • In addition, in the conventional nanoparticle imaging, a source of visible light or infrared light is used. Accordingly, when a cell is imaged using nanoparticles, there is a high risk of damaging the cell, and autofluorescence of the cell may function as a significantly large background noise. In addition, in in vivo imaging, transmittance of visible light or infrared light through a biological body is very low.
  • The core configuration of the present disclosure for addressing the aforementioned issues is upconverting nanoparticles, which are used as a imaging probe. The upconverting nanoparticles absorb near-infrared (NIR) photons through optical upconversion, and emit visible photons or near-IN photons by nature. Thereby, a wavelength of a beam illuminated onto the sample is within the range of wavelength of NIR light, but the wavelength for imaging is within the range of wavelength of visible light. For example, the nanocrystal (NaYF4:Yb3+, Er3+), which is a material that is most widely used in research on upconverting nanoparticles, absorbs 980 nm photons, and emits visible photons through optical upconversion. FIG. 1 illustrates paths of upconversion emission of NaYF4:Yb3+, Er3+and an emission spectrum of upconverting nanoparticles whose surface is coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine. As shown in the figure, NIR light is absorbed, and visible light is emitted through upconversion.
  • Since the upconverting nanoparticles are excited by NIR light, which is biologically friendly, and emit visible light. Accordingly, if the upconverting nanoparticles are used for cell imaging, they may rarely damage a cell specimen and autofluorescence may be prevented. Further, the converting nanoparticles may significantly increase transmittance through a biological body, and images may be obtained through a typical CCD for visible light, rather than through a CCD for NIR light. Accordingly, with the upconverting nanoparticles, consecutive images may be obtained for a long time since the upconverting nanoparticles do not cause photoblinking or photobleaching. Further, since the upconverting nanoparticles are a multipurpose nanomaterial capable of performing various biological functions through surface improvement, it may have universal and general biological applications.
  • The present disclosure employing the upconverting nanoparticles as a probe has the following features. According to an embodiment of the present disclosure, a method for three-dimensional imaging includes introducing upconverting nanoparticles into a sample, illuminating NIR laser to excite the upconverting nanoparticles introduced into the sample, detecting visible light emitted from the excited upconverting nanoparticles and acquiring two-dimensional images captured by performing scanning in the depth direction of the sample, and generating a three-dimensional image of the sample using the two-dimensional images.
  • First, a sample for three-dimensional imaging is prepared. Typically, various animal cells or vegetable cells may be used as the sample. The nanoparticles are introduced into the cell as an imaging probe. The upconverting nanoparticles used in the present disclosure are applicable to various embodiments in which the upconverting nanoparticles are excited by NIR light and emit visible light. For example, (NaYF4:Yb3+, Er3+), (NaYF4:Yb3+, Tm3+), (NaGdF4:Yb3+, Er3+), (NaYF4:Yb3+, Er3+/NaGdF4) and (NaGdF4:Yb3+, Er3+/NaGdF4) may be used. The surfaces of these nanoparticles may be coated with a mixture of phospholipid-PEG and phospholipid-PEG-amine
  • FIG. 2 is a schematic diagram illustrating a fluorescence microscope used for a method for three-dimensional imaging according to an embodiment of the present disclosure. Hereinafter, the procedure of capturing two-dimensional images will be described in detail with reference to FIG. 2. A prepared sample is positioned on a fluorescence microscope, MR laser is illuminated onto the sample. The NIR laser serves to excite upconverting nanoparticles introduced into the sample, such that light having a wavelength in the range of visible light is emitted. The wavelength of the NIR light used for the separation ranges from 900 nm to 1000 nm. In particular, it is preferable to use laser of 980nm wavelength in terms of absorption of the upconverting nanoparticles. In this case, any laser, whether it is Q-switching laser or femtosecond laser, may be used. Relatively low-cost continuous wave (CW) laser may be used.
  • A fluorescence image is acquired by detecting visible rays emitted from the upconverting nanoparticles excited by the NIR laser. Herein, the acquired image should be in the range of visible light rather than in the range of infrared light, and have a high signal sensitivity. Accordingly, an electron multiplying CCD (EMC CCD) may be used. In order to obtain the a three-dimensional image, a plurality of two-dimensional images of the sample ares acquired by scanning the sample in the depth direction (“z-direction”). Herein, the scanning refers to dividing the sample into parts in the depth direction and moving the sample or the objective lens such that the camera can capture multiple images of the sample. In this embodiment, two-dimensional images are captured, while the position of the objective lens is shifted in the depth direction of the sample through a motor controller attached to the microscope. Herein, the number and interval between the captured images are set by a computer connected to the motor controller. Typically, the number of captured two-dimensional images may be 15, and the distance between the images may be set to 500 nm. In this case, the range of scanning in the z-axis direction is about 7 μm, which corresponds to a range which allows measurement of sizes of almost all Hela cells. Herein, the exposure time of the EMCCD may be about 70 ms. Accordingly, it is possible to obtain two-dimensional images for building a three-dimensional image along the z-axis in about one second.
  • FIG. 3 is a graphic depicting the z-axis scanning position over time. As shown in FIG. 3, the images may be consecutively obtained according to movement of the objective lens. In this case, the time interval between the images may be about one second.. FIG. 4 schematically illustrates a procedure of obtaining two-dimensional images by performing scanning in the depth direction using a method for three-dimensional imaging according to an embodiment of the present disclosure. Multiple two-dimensional images (an image stack) may be obtained by scanning the sample in the z-axis direction by moving the objective lens. In the image stack, a plane in focus has a light emission point having the highest intensity, and the intensity gradually decreases in planes out of focus.
  • Using the two-dimensional images obtained in this way, a three-dimensional image of the sample is generated. First, to correct the image stack along the z-axis, the position of a light emitting particle needs to be specified. FIG. 5 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles along the z-axis. As shown in FIG. 5, variation of the emission intensity of upconverting nanoparticles along the z-axis fits a Gaussian distribution. Accordingly, the peak point on the Gaussian distribution curve may be interpreted as the z-axis coordinate of a single upconverting nanoparticles.
  • In addition, accurate coordinates in the x-y plane are needed to acquire a three-dimensional image. FIG. 6 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles in an x-y plane closest to a determined z-axis coordinate. Herein, “s” denotes a standard deviation of the Gaussian distribution. The x and y coordinates of the peak point of emission intensity are determined by the coordinates of the center in relation to the Gaussian distribution. Accordingly, a three-dimensional image may be generated by rendering point markers at the respective x, y, and z coordinates. The three-dimensional image may be generated by determining the three-dimensional center and repeating the rendering operation.
  • To obtain a three-dimensional image of a nanoparticle, accurate three-dimensional coordinates of the particle is needed. According to an embodiment of the present disclosure, in the Cartesian coordinate system, a z-axis coordinate is estimated first, and then two-dimensional coordinates on the x and y axes are estimated. Then, three-dimensional coordinates are estimated, and then a point is marked at the corresponding position to reconstruct the image. In this case, one set of 3-D imaging is possible at a time, and thus the change in position of the nanoparticle may be three-dimensionally tracked every one second.
  • An error for the position determined according to correction performed using the Gaussian distribution curve depends on the number of photons and the pixel size of the camera. The error range given by Equation 1, which was proposed by Thomson, is about 4 nm in the x-y plane and about 15 nm on the z axis. Accordingly, to more accurately determine the position, high-power laser is preferably used.
  • Δ x s 2 + a 2 / 12 N Equation 1 N : the number of detected photons ( = 3000 ) , s : the standard deviation of the Gaussian distribution ( = 200 nm ) , a : the pixel size ( = 500 nm )
  • A more detailed description of the present disclosure will be given below, based on an experimental example.
  • To check if autofluorescence is created, 980 nm laser and 532 nm laser were illuminated onto a cell which did not contain a fluorophore (see FIG. 7). The powers used for the illumination were 386 W/cm2 and 44 W/cm2, respectively. As shown in FIG. 7, 980 nm laser did not cause autofluorescence even though the power thereof was 9 times greater than the power of 532 nm laser. On the other hand, 532 nm laser caused autofluorescence.
  • The surface of hexagonal-(NaYF4:Yb3+, Er3+), employed as upconverting nanoparticles, was coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine. The diameter of the upconverting nanoparticles was less than or equal to about 27,6 nm. The diameter obtained after coating was less than or equal to about 32.6 nm. A three-dimensional image of a fixed Hela cell was acquired before the upconverting nanoparticles were introduced into the cell. The cell was fixed in capturing the image thereof in order to check the effect of determination of a single three-dimensional particle (see FIG. 8). As expected, autofluorescence was not created, and it was seen that the blurring effect of the upconverting nanoparticles were eliminated by the position determination.
  • The method for three-dimensional imaging using upconverting nanoparticles according to the present disclosure may be the most appropriate model for visualizing the effect of introduction into the nucleus. To check if this is true, images of a live Hela cell are shown in FIG. 9.
  • It is also possible to implement a three-dimensional image containing information about positions of all particles, including tracking of multiplexed single particles. FIG. 10 shows a three-dimensional trajectory of a single upconverting nanoparticles, which is arbitrarily selected. It is apparent that the trajectory is created by a few different transports. The area marked by blue indicates an active transport according to the cytoskeleton, and the area marked by red indicates limited diffusion.
  • Although the preferred embodiments of the present disclosure have been disclosed with reference to the accompanying drawings, those skilled in the art will appreciate that other embodiments may also be practiced without changing the spirit or essential features of the present disclosure.
  • Accordingly, the exemplary embodiments of the disclosure, as set forth above, should be construed in all aspects as illustrative and not limiting. It will be apparent to those skilled in the art that various modifications and variations can be made in the present disclosure without departing from the spirit or scope of the present disclosure. Thus, it is intended that the present disclosure covers the modifications and variations of this disclosure provided they come within the scope of the appended claims and their equivalents.

Claims (4)

What is claimed is:
1. A method for three-dimensional imaging, comprising:
introducing upconverting nanoparticles into a sample;
illuminating near-infrared laser so that the upconverting nanoparticles introduced into the sample are excited;
detecting a visible ray emitted from the excited upconverting nanoparticles while capturing and acquiring two-dimensional images by scanning the sample in a depth direction thereof; and
generating a three-dimensional image of the sample using the to-dimensional images,
wherein the generating of the three-dimensional image comprises:
obtaining coordinates on x, y and z axes according to a peak point of a light emission signal of the upconverting nanoparticles, and
wherein the generating of the three-dimensional image comprises:
measuring the peak point on a Gaussian distribution curve according to an intensity of the light emission signal of the upconverting nanoparticles for the two-dimensional images on the z axis;
obtaining a coordinate on the z axis;
measuring a peak point of a two-dimensional Gaussian distribution curve for the intensity of light emission signal for an image at the obtained coordinate on the z axis; and
obtaining coordinates on the x and y axes and rendering the same.
2. The method according to claim 1, wherein a wavelength of the near-infrared laser is between 900 nm and 1000 nm.
3. The method according to claim 1, wherein the near-infrared laser is 980 nm continuous wave (CW) diode laser.
4. The method according to claim 1, wherein the acquiring of the two-dimensional images comprises:
capturing images of the sample by moving an objective lens in the depth direction of the sample.
US16/457,104 2016-03-03 2019-06-28 Method for three-dimensional imaging using upconverting nanoparticles Abandoned US20190317306A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US16/457,104 US20190317306A1 (en) 2016-03-03 2019-06-28 Method for three-dimensional imaging using upconverting nanoparticles

Applications Claiming Priority (4)

Application Number Priority Date Filing Date Title
KR1020160025389A KR101754146B1 (en) 2016-03-03 2016-03-03 Method for three-dimensional imaging using upconverting nanoparticles
KR10-2016-0025389 2016-03-03
US15/360,917 US10444483B2 (en) 2016-03-03 2016-11-23 Method for three-dimensional imaging using upconverting nanoparticles
US16/457,104 US20190317306A1 (en) 2016-03-03 2019-06-28 Method for three-dimensional imaging using upconverting nanoparticles

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US15/360,917 Continuation US10444483B2 (en) 2016-03-03 2016-11-23 Method for three-dimensional imaging using upconverting nanoparticles

Publications (1)

Publication Number Publication Date
US20190317306A1 true US20190317306A1 (en) 2019-10-17

Family

ID=59354302

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/360,917 Expired - Fee Related US10444483B2 (en) 2016-03-03 2016-11-23 Method for three-dimensional imaging using upconverting nanoparticles
US16/457,104 Abandoned US20190317306A1 (en) 2016-03-03 2019-06-28 Method for three-dimensional imaging using upconverting nanoparticles

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US15/360,917 Expired - Fee Related US10444483B2 (en) 2016-03-03 2016-11-23 Method for three-dimensional imaging using upconverting nanoparticles

Country Status (2)

Country Link
US (2) US10444483B2 (en)
KR (1) KR101754146B1 (en)

Families Citing this family (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10976532B2 (en) * 2016-06-10 2021-04-13 Tomocube, Inc. Structured illumination microscopy system using digital micromirror device and time-complex structured illumination, and operation method therefor
KR101967994B1 (en) * 2017-08-21 2019-04-10 울산과학기술원 Tactile sensor, method for manufacturing the same, three-dimensional mapping method
CN110314714B (en) * 2019-07-09 2021-06-25 大连海事大学 Cell activity state characterization monitoring device and method based on three-dimensional image characteristics
RU2716861C1 (en) * 2019-07-09 2020-03-17 Федеральное государственное бюджетное образовательное учреждение высшего образования "Рязанский государственный радиотехнический университет имени В.Ф. Уткина" Scanning probe of atomic-force microscope with detachable remote-controlled nanocomposite radiating element doped with upconverting and magnetic nanoparticles of core-shell structure
RU193569U1 (en) * 2019-07-09 2019-11-05 Федеральное государственное бюджетное образовательное учреждение высшего образования "Рязанский государственный радиотехнический университет имени В.Ф. Уткина" A SCANNING PROBE OF AN ATOMICALLY POWER MICROSCOPE WITH SEPARABLE TELEO-CONTROLLED NANOCOMPOSITE RADIATING ELEMENT BASED ON APCONVERTING AND MAGNETIC STRUCTURE NANOPARTICLES
CN112198133A (en) * 2020-10-20 2021-01-08 上海洞舟实业有限公司 Preparation method of infrared laser visual detector

Family Cites Families (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE102004017956B4 (en) * 2004-04-14 2022-07-07 Leica Microsystems Cms Gmbh Method for studying the lifetime of excited states in a sample
US9335027B2 (en) * 2013-01-02 2016-05-10 Massachusetts Institute Of Technology Methods and apparatus for transparent display using scattering nanoparticles

Also Published As

Publication number Publication date
US20170254996A1 (en) 2017-09-07
KR101754146B1 (en) 2017-07-06
US10444483B2 (en) 2019-10-15

Similar Documents

Publication Publication Date Title
US10444483B2 (en) Method for three-dimensional imaging using upconverting nanoparticles
Straub et al. Fluorescence lifetime three-dimensional microscopy with picosecond precision using a multifocal multiphoton microscope
CN102023148B (en) Fluorescent nanoscopy method
CN101653355B (en) Living small animal imaging system and imaging method
CN104198458B (en) Femtosecond laser two-photon fluorescent biological microimaging system and imaging method thereof
US7675045B1 (en) 3-dimensional imaging at nanometer resolutions
CN103105382B (en) Microscope equipment and method for carrying out three-dimensional localization to the point target in sample
CN107091825A (en) Fluorescent sample chromatography micro imaging method based on microlens array
CN108414442A (en) Confocal microscope system suitable for near-infrared 2nd area fluorescent vital imaging
SG175923A1 (en) A system, method, and luminescent marker for improved diffuse luminescent imaging or tomography in scattering media
Jo et al. Fast and background-free three-dimensional (3D) live-cell imaging with lanthanide-doped upconverting nanoparticles
JP2009264752A (en) Three-dimensional image acquisition apparatus
CN112161946B (en) Frequency domain luminous life imaging system
US7453567B2 (en) Fluorescence lifetime distribution image measuring system and its measuring method
EP4288821B1 (en) Method and light microscope for a high-resolution examination of a sample
WO2016156092A1 (en) Method for locating at least one emitter using a localization microscope
EP3768153B1 (en) Multimodal imaging system and method for non-invasive examination of an object
Fang et al. Development of fast and three-dimensional focused X-ray luminescence tomography system
CN106885795A (en) A kind of fluorescence lifetime information acquisition method and system for moving single-particle
Gong et al. A fully water coupled oblique light-sheet microscope
CN110646385A (en) Single-particle imaging device and method based on up-conversion luminescence total internal reflection
CN110638426A (en) Laser scanning living body fluorescence imaging signal acquisition device
CN219320091U (en) Micro-nano robot system
Vanga et al. Development of a new light collection and detection system optimized for ion beam induced fluorescence microscopy
Fang et al. Pencil Beam Based X-ray Luminescence Computed Tomography Imaging of Deep Targets Three-dimensionally and Quantitatively

Legal Events

Date Code Title Description
AS Assignment

Owner name: GWANGJU INSTITUTE OF SCIENCE AND TECHNOLOGY, KOREA

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEE, KANG TAEK;SONG, YO HAN;PARK, JIN HO;AND OTHERS;REEL/FRAME:049626/0249

Effective date: 20161104

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION