US20190317306A1 - Method for three-dimensional imaging using upconverting nanoparticles - Google Patents
Method for three-dimensional imaging using upconverting nanoparticles Download PDFInfo
- Publication number
- US20190317306A1 US20190317306A1 US16/457,104 US201916457104A US2019317306A1 US 20190317306 A1 US20190317306 A1 US 20190317306A1 US 201916457104 A US201916457104 A US 201916457104A US 2019317306 A1 US2019317306 A1 US 2019317306A1
- Authority
- US
- United States
- Prior art keywords
- sample
- dimensional
- upconverting nanoparticles
- image
- images
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 239000002105 nanoparticle Substances 0.000 title claims abstract description 60
- 238000003384 imaging method Methods 0.000 title claims abstract description 27
- 238000000034 method Methods 0.000 title claims abstract description 20
- 238000009877 rendering Methods 0.000 claims description 4
- 239000000523 sample Substances 0.000 description 37
- 210000004027 cell Anatomy 0.000 description 31
- 230000003287 optical effect Effects 0.000 description 8
- 239000002245 particle Substances 0.000 description 7
- 239000000203 mixture Substances 0.000 description 5
- 230000000694 effects Effects 0.000 description 4
- 150000003904 phospholipids Chemical class 0.000 description 4
- 230000014509 gene expression Effects 0.000 description 3
- 238000011160 research Methods 0.000 description 3
- PVVTWNMXEHROIA-UHFFFAOYSA-N 2-(3-hydroxypropyl)-1h-quinazolin-4-one Chemical compound C1=CC=C2NC(CCCO)=NC(=O)C2=C1 PVVTWNMXEHROIA-UHFFFAOYSA-N 0.000 description 2
- 238000010521 absorption reaction Methods 0.000 description 2
- 230000008859 change Effects 0.000 description 2
- 239000000470 constituent Substances 0.000 description 2
- 238000010586 diagram Methods 0.000 description 2
- 238000000295 emission spectrum Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000002073 fluorescence micrograph Methods 0.000 description 2
- 239000007850 fluorescent dye Substances 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 238000002834 transmittance Methods 0.000 description 2
- 230000009056 active transport Effects 0.000 description 1
- 210000004102 animal cell Anatomy 0.000 description 1
- 230000008827 biological function Effects 0.000 description 1
- 239000011248 coating agent Substances 0.000 description 1
- 238000000576 coating method Methods 0.000 description 1
- 238000012937 correction Methods 0.000 description 1
- 210000004292 cytoskeleton Anatomy 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000009792 diffusion process Methods 0.000 description 1
- 238000001914 filtration Methods 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 230000006872 improvement Effects 0.000 description 1
- 238000011503 in vivo imaging Methods 0.000 description 1
- 230000031700 light absorption Effects 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 239000002159 nanocrystal Substances 0.000 description 1
- 239000002086 nanomaterial Substances 0.000 description 1
- 230000001172 regenerating effect Effects 0.000 description 1
- 230000035945 sensitivity Effects 0.000 description 1
- 238000000926 separation method Methods 0.000 description 1
- 230000002123 temporal effect Effects 0.000 description 1
- 210000001519 tissue Anatomy 0.000 description 1
- 230000032258 transport Effects 0.000 description 1
- 235000013311 vegetables Nutrition 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0032—Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/16—Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/361—Optical details, e.g. image relay to the camera or image sensor
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/50—Depth or shape recovery
- G06T7/521—Depth or shape recovery from laser ranging, e.g. using interferometry; from the projection of structured light
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N13/00—Stereoscopic video systems; Multi-view video systems; Details thereof
- H04N13/20—Image signal generators
- H04N13/204—Image signal generators using stereoscopic image cameras
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/30—Transforming light or analogous information into electric information
- H04N5/33—Transforming infrared radiation
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B2207/00—Coding scheme for general features or characteristics of optical elements and systems of subclass G02B, but not including elements and systems which would be classified in G02B6/00 and subgroups
- G02B2207/114—Two photon or multiphoton effect
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10028—Range image; Depth image; 3D point clouds
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
- G06T2207/10061—Microscopic image from scanning electron microscope
Definitions
- the present disclosure relates to an imaging method, and more particularly, to an imaging method for acquiring a three-dimensional image of a sample such as a cell using upconverting nanoparticles.
- the fluorescence microscope is an optical system that is most widely used to observe biological cells.
- the fluorescence microscope acquires an image of a cell by making an enlarged cell image formed on an image sensor with fluorescent light emitted from a cell dyed with a fluorescent dye through an objective lens.
- a charge coupled device (CCD) is an implementation of the image sensor.
- the optical system of the fluorescence microscope has a conventional wide field microscope as a basic structure thereof. Thereby, not only fluorescent light emitted from the cell and light of the image formed on the CCD but also light which is unfocused and thus fails to form an image enters the image capturing device. Thus, it is difficult to acquire an accurate three-dimensional image of the cell. Due to this issue, contrast and resolution of the acquired three-dimensional image of the cell are degraded.
- the aforementioned issue is more serious than for a typical optical microscope, and it is difficult to correctly observe a fine structure of the cell.
- a confocal laser scanning microscope overcomes the above issue by filtering out light fails to form an image, using a pin-hole as a spatial filter. Accordingly, the confocal laser scanning microscope has higher contrast and higher resolution than a typical wide field microscope. Further, the confocal laser scanning microscope can obtain an optically sectioned image of a cell. Such features of the confocal laser scanning microscope are essential conditions for constructing a three-dimensional image of a cell. Presently, the confocal laser scanning microscope implements a three-dimensional image of a cell with high contrast and high resolution, and thus has become an important indispensable cell imaging system in bioengineering research.
- a laser beam scanning apparatus for scanning a sample with a laser beam is needed, and a system for regenerating an image from an optical signal reaching an optical detector through the pin-hole is also needed.
- the confocal laser scanning microscope inevitably uses x-y scanning technique in obtaining a sectioned image, and thus it takes a long time for the confocal laser scanning microscope to measure the three-dimensional image due to the limited speed of data acquisition. Thereby, it is difficult to observe change of the sample in real time using the confocal laser scanning microscope.
- UCNPs upconverting nanoparticles
- a method for three-dimensional imaging includes introducing upconverting nanoparticles into a sample, illuminating near-infrared laser so that the upconverting nanoparticles introduced into the sample are excited, detecting a visible ray emitted from the excited upconverting nanoparticles and capturing and acquiring two-dimensional images by scanning the sample in a depth direction of the sample, and generating a three-dimensional image of the sample using the two-dimensional images.
- a wavelength of the near-infrared laser may be between 900 nm and 1000 nm.
- the near-infrared laser may be 980 nm continuous wave (CW) diode laser.
- the acquiring of the two-dimensional images may include capturing images of the sample by moving an objective lens in the depth direction of the sample.
- the generating of the three-dimensional image may include obtaining coordinates on x, y and z axes according to a peak point of a light emission signal of the upconverting nanoparticles.
- the generating of the three-dimensional image may include measuring the peak point on a Gaussian distribution curve according to an intensity of the light emission signal of the upconverting nanoparticles for the two-dimensional images on the z axis, obtaining a coordinate on the z axis, measuring a peak point of a two-dimensional Gaussian distribution curve for the intensity of light emission signal for an image at the obtained coordinate on the z axis, and obtaining coordinates on the x and y axes and rendering the same.
- the upconverting nanoparticles may be one selected from among (NaYF 4 :Yb 3+ , Er 3+ ), (NaYF 4 :Yb 3+ , Tm 3+ ), (NaGdF 4 :Yb 3+ , Er 3+ ), (NaYF 4 :Yb 3+ , Er 3+ /NaGdF 4 ) and (NaGdF 4 :Yb 3+ , Er 3+ /NaGdF 4 ).
- a surface of the upconverting nanoparticles may be coated with a mixture of phospholipid-PEG and phospholipid PEG-amine
- a method for three-dimensional imaging has the following effects.
- the imaging speed of a wide-field fluorescence microscope may be maintained, while temporal and spatial resolutions that the conventional confocal laser scanning microscope exhibits are maintained.
- upconverting nanoparticles are used as imaging probes, and a source of light in the range of near-infrared rays is used for scanning, the efficiency of absorption of light by a biological tissue is relatively low, and thus high-resolution images may be obtained.
- the present disclosure may be effectively used in research on cell kinetics including nuclear absorption and single particle tracking.
- FIG. 1 illustrates paths of upconversion emission of NaYF4:Yb3+, Er3+ and an emission spectrum of upconverting nanoparticles whose surface is coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine.
- FIG. 2 is a schematic diagram illustrating a fluorescence microscope used for a method for three-dimensional imaging according to an embodiment of the present disclosure.
- FIG. 3 is a graphic depicting the z-axis scanning position over time.
- FIG. 4 schematically illustrates a procedure of obtaining two-dimensional images by performing scanning in the depth direction using a method for three-dimensional imaging according to an embodiment of the present disclosure.
- FIG. 5 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles along the z-axis.
- FIG. 6 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles in an x-y plane closest to a determined z-axis coordinate.
- FIG. 7 shows images obtained by illuminating 980 nm laser and 532 nm laser onto a cell which does not contain a fluorophore.
- FIG. 8 illustrates comparison of images before and after determination of the position of upconverting nanoparticles.
- FIG. 9 shows and a three-dimensional image generated by injecting upconverting nanoparticles into a Ma cell and photographing the cell.
- FIG. 10 shows a three-dimensional trajectory of a single upconverting nanoparticles, which is arbitrarily selected.
- the fluorescence image may be blurred during scanning of the image. It is possible to obtain a clear image through complex mathematical reconstruction. However, optical stability may be lowered due to photoblinking of the imaging probe and photoleaching, and the image may be contaminated by autofluorescence.
- the core configuration of the present disclosure for addressing the aforementioned issues is upconverting nanoparticles, which are used as a imaging probe.
- the upconverting nanoparticles absorb near-infrared (NIR) photons through optical upconversion, and emit visible photons or near-IN photons by nature.
- NIR near-infrared
- a wavelength of a beam illuminated onto the sample is within the range of wavelength of NIR light, but the wavelength for imaging is within the range of wavelength of visible light.
- the nanocrystal NaYF4:Yb3+, Er3+
- FIG. 1 illustrates paths of upconversion emission of NaYF4:Yb3+, Er3+and an emission spectrum of upconverting nanoparticles whose surface is coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine. As shown in the figure, NIR light is absorbed, and visible light is emitted through upconversion.
- the upconverting nanoparticles are excited by NIR light, which is biologically friendly, and emit visible light. Accordingly, if the upconverting nanoparticles are used for cell imaging, they may rarely damage a cell specimen and autofluorescence may be prevented. Further, the converting nanoparticles may significantly increase transmittance through a biological body, and images may be obtained through a typical CCD for visible light, rather than through a CCD for NIR light. Accordingly, with the upconverting nanoparticles, consecutive images may be obtained for a long time since the upconverting nanoparticles do not cause photoblinking or photobleaching. Further, since the upconverting nanoparticles are a multipurpose nanomaterial capable of performing various biological functions through surface improvement, it may have universal and general biological applications.
- a method for three-dimensional imaging includes introducing upconverting nanoparticles into a sample, illuminating NIR laser to excite the upconverting nanoparticles introduced into the sample, detecting visible light emitted from the excited upconverting nanoparticles and acquiring two-dimensional images captured by performing scanning in the depth direction of the sample, and generating a three-dimensional image of the sample using the two-dimensional images.
- a sample for three-dimensional imaging is prepared.
- various animal cells or vegetable cells may be used as the sample.
- the nanoparticles are introduced into the cell as an imaging probe.
- the upconverting nanoparticles used in the present disclosure are applicable to various embodiments in which the upconverting nanoparticles are excited by NIR light and emit visible light.
- the surfaces of these nanoparticles may be coated with a mixture of phospholipid-PEG and phospholipid-PEG-amine
- FIG. 2 is a schematic diagram illustrating a fluorescence microscope used for a method for three-dimensional imaging according to an embodiment of the present disclosure.
- the NIR laser serves to excite upconverting nanoparticles introduced into the sample, such that light having a wavelength in the range of visible light is emitted.
- the wavelength of the NIR light used for the separation ranges from 900 nm to 1000 nm.
- any laser whether it is Q-switching laser or femtosecond laser, may be used.
- Relatively low-cost continuous wave (CW) laser may be used.
- a fluorescence image is acquired by detecting visible rays emitted from the upconverting nanoparticles excited by the NIR laser.
- the acquired image should be in the range of visible light rather than in the range of infrared light, and have a high signal sensitivity.
- an electron multiplying CCD EMC CCD
- a plurality of two-dimensional images of the sample ares acquired by scanning the sample in the depth direction (“z-direction”).
- the scanning refers to dividing the sample into parts in the depth direction and moving the sample or the objective lens such that the camera can capture multiple images of the sample.
- two-dimensional images are captured, while the position of the objective lens is shifted in the depth direction of the sample through a motor controller attached to the microscope.
- the number and interval between the captured images are set by a computer connected to the motor controller.
- the number of captured two-dimensional images may be 15, and the distance between the images may be set to 500 nm.
- the range of scanning in the z-axis direction is about 7 ⁇ m, which corresponds to a range which allows measurement of sizes of almost all Hela cells.
- the exposure time of the EMCCD may be about 70 ms. Accordingly, it is possible to obtain two-dimensional images for building a three-dimensional image along the z-axis in about one second.
- FIG. 3 is a graphic depicting the z-axis scanning position over time.
- the images may be consecutively obtained according to movement of the objective lens.
- the time interval between the images may be about one second.
- FIG. 4 schematically illustrates a procedure of obtaining two-dimensional images by performing scanning in the depth direction using a method for three-dimensional imaging according to an embodiment of the present disclosure.
- Multiple two-dimensional images may be obtained by scanning the sample in the z-axis direction by moving the objective lens.
- a plane in focus has a light emission point having the highest intensity, and the intensity gradually decreases in planes out of focus.
- FIG. 5 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles along the z-axis.
- variation of the emission intensity of upconverting nanoparticles along the z-axis fits a Gaussian distribution. Accordingly, the peak point on the Gaussian distribution curve may be interpreted as the z-axis coordinate of a single upconverting nanoparticles.
- FIG. 6 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles in an x-y plane closest to a determined z-axis coordinate.
- s denotes a standard deviation of the Gaussian distribution.
- the x and y coordinates of the peak point of emission intensity are determined by the coordinates of the center in relation to the Gaussian distribution.
- a three-dimensional image may be generated by rendering point markers at the respective x, y, and z coordinates.
- the three-dimensional image may be generated by determining the three-dimensional center and repeating the rendering operation.
- a z-axis coordinate is estimated first, and then two-dimensional coordinates on the x and y axes are estimated. Then, three-dimensional coordinates are estimated, and then a point is marked at the corresponding position to reconstruct the image.
- one set of 3-D imaging is possible at a time, and thus the change in position of the nanoparticle may be three-dimensionally tracked every one second.
- An error for the position determined according to correction performed using the Gaussian distribution curve depends on the number of photons and the pixel size of the camera.
- the error range given by Equation 1, which was proposed by Thomson, is about 4 nm in the x-y plane and about 15 nm on the z axis. Accordingly, to more accurately determine the position, high-power laser is preferably used.
- 980 nm laser and 532 nm laser were illuminated onto a cell which did not contain a fluorophore (see FIG. 7 ).
- the powers used for the illumination were 386 W/cm 2 and 44 W/cm 2 , respectively.
- 980 nm laser did not cause autofluorescence even though the power thereof was 9 times greater than the power of 532 nm laser.
- 532 nm laser caused autofluorescence.
- the diameter of the upconverting nanoparticles was less than or equal to about 27,6 nm.
- the diameter obtained after coating was less than or equal to about 32.6 nm.
- a three-dimensional image of a fixed Hela cell was acquired before the upconverting nanoparticles were introduced into the cell. The cell was fixed in capturing the image thereof in order to check the effect of determination of a single three-dimensional particle (see FIG. 8 ). As expected, autofluorescence was not created, and it was seen that the blurring effect of the upconverting nanoparticles were eliminated by the position determination.
- the method for three-dimensional imaging using upconverting nanoparticles according to the present disclosure may be the most appropriate model for visualizing the effect of introduction into the nucleus. To check if this is true, images of a live Hela cell are shown in FIG. 9 .
- FIG. 10 shows a three-dimensional trajectory of a single upconverting nanoparticles, which is arbitrarily selected. It is apparent that the trajectory is created by a few different transports. The area marked by blue indicates an active transport according to the cytoskeleton, and the area marked by red indicates limited diffusion.
Landscapes
- Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- General Physics & Mathematics (AREA)
- Analytical Chemistry (AREA)
- Optics & Photonics (AREA)
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Multimedia (AREA)
- Immunology (AREA)
- Biochemistry (AREA)
- Pathology (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Signal Processing (AREA)
- Chemical Kinetics & Catalysis (AREA)
- Theoretical Computer Science (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Spectroscopy & Molecular Physics (AREA)
- Computer Graphics (AREA)
- Geometry (AREA)
- Software Systems (AREA)
Abstract
Description
- This application is a continuation application of U.S. Ser. No. 15/360,917, filed on Nov. 23, 2016, which claims priority to Korean Patent Application No. 10-2016-0025389, filed on Mar. 3, 2016. The entire disclosures of each of the above applications are incorporated herein by reference.
- The present disclosure relates to an imaging method, and more particularly, to an imaging method for acquiring a three-dimensional image of a sample such as a cell using upconverting nanoparticles.
- The fluorescence microscope is an optical system that is most widely used to observe biological cells. The fluorescence microscope acquires an image of a cell by making an enlarged cell image formed on an image sensor with fluorescent light emitted from a cell dyed with a fluorescent dye through an objective lens. A charge coupled device (CCD) is an implementation of the image sensor. The optical system of the fluorescence microscope has a conventional wide field microscope as a basic structure thereof. Thereby, not only fluorescent light emitted from the cell and light of the image formed on the CCD but also light which is unfocused and thus fails to form an image enters the image capturing device. Thus, it is difficult to acquire an accurate three-dimensional image of the cell. Due to this issue, contrast and resolution of the acquired three-dimensional image of the cell are degraded. In particular, for a fluorescence microscope employing a cell dyed with a fluorescent dye as a sample, the aforementioned issue is more serious than for a typical optical microscope, and it is difficult to correctly observe a fine structure of the cell.
- To address this issue, a confocal laser scanning microscope has been introduced. The confocal laser scanning microscope overcomes the above issue by filtering out light fails to form an image, using a pin-hole as a spatial filter. Accordingly, the confocal laser scanning microscope has higher contrast and higher resolution than a typical wide field microscope. Further, the confocal laser scanning microscope can obtain an optically sectioned image of a cell. Such features of the confocal laser scanning microscope are essential conditions for constructing a three-dimensional image of a cell. Presently, the confocal laser scanning microscope implements a three-dimensional image of a cell with high contrast and high resolution, and thus has become an important indispensable cell imaging system in bioengineering research.
- However, to create an image using a confocal laser scanning microscope, a laser beam scanning apparatus for scanning a sample with a laser beam is needed, and a system for regenerating an image from an optical signal reaching an optical detector through the pin-hole is also needed. Accordingly, the confocal laser scanning microscope inevitably uses x-y scanning technique in obtaining a sectioned image, and thus it takes a long time for the confocal laser scanning microscope to measure the three-dimensional image due to the limited speed of data acquisition. Thereby, it is difficult to observe change of the sample in real time using the confocal laser scanning microscope.
- The description provided above is merely intended to provide further understanding of the present disclosure, and should not be understood as meaning that the present disclosure corresponds to a prior art technology which is well known to those skilled in the art..
- It is an aspect of the present disclosure to provide a method for three-dimensional imaging which provides the quality of an image captured by a confocal laser scanning microscope using upconverting nanoparticles (UCNPs), which are fluorescent particles, as probes and the imaging speed of the fluorescence microscope technology.
- In accordance with one aspect of the present disclosure, a method for three-dimensional imaging includes introducing upconverting nanoparticles into a sample, illuminating near-infrared laser so that the upconverting nanoparticles introduced into the sample are excited, detecting a visible ray emitted from the excited upconverting nanoparticles and capturing and acquiring two-dimensional images by scanning the sample in a depth direction of the sample, and generating a three-dimensional image of the sample using the two-dimensional images.
- A wavelength of the near-infrared laser may be between 900 nm and 1000 nm.
- The near-infrared laser may be 980 nm continuous wave (CW) diode laser.
- The acquiring of the two-dimensional images may include capturing images of the sample by moving an objective lens in the depth direction of the sample.
- The generating of the three-dimensional image may include obtaining coordinates on x, y and z axes according to a peak point of a light emission signal of the upconverting nanoparticles.
- The generating of the three-dimensional image may include measuring the peak point on a Gaussian distribution curve according to an intensity of the light emission signal of the upconverting nanoparticles for the two-dimensional images on the z axis, obtaining a coordinate on the z axis, measuring a peak point of a two-dimensional Gaussian distribution curve for the intensity of light emission signal for an image at the obtained coordinate on the z axis, and obtaining coordinates on the x and y axes and rendering the same.
- The upconverting nanoparticles may be one selected from among (NaYF4:Yb3+, Er3+), (NaYF4:Yb3+, Tm3+), (NaGdF4:Yb3+, Er3+), (NaYF4:Yb3+, Er3+/NaGdF4) and (NaGdF4:Yb3+, Er3+/NaGdF4).
- A surface of the upconverting nanoparticles may be coated with a mixture of phospholipid-PEG and phospholipid PEG-amine
- According to embodiments of the present disclosure, a method for three-dimensional imaging has the following effects.
- First, the imaging speed of a wide-field fluorescence microscope may be maintained, while temporal and spatial resolutions that the conventional confocal laser scanning microscope exhibits are maintained.
- Second, since upconverting nanoparticles are used as imaging probes, and a source of light in the range of near-infrared rays is used for scanning, the efficiency of absorption of light by a biological tissue is relatively low, and thus high-resolution images may be obtained.
- Third, since three-dimensional images may be provided in real time, the present disclosure may be effectively used in research on cell kinetics including nuclear absorption and single particle tracking.
-
FIG. 1 illustrates paths of upconversion emission of NaYF4:Yb3+, Er3+ and an emission spectrum of upconverting nanoparticles whose surface is coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine. -
FIG. 2 is a schematic diagram illustrating a fluorescence microscope used for a method for three-dimensional imaging according to an embodiment of the present disclosure. -
FIG. 3 is a graphic depicting the z-axis scanning position over time. -
FIG. 4 schematically illustrates a procedure of obtaining two-dimensional images by performing scanning in the depth direction using a method for three-dimensional imaging according to an embodiment of the present disclosure. -
FIG. 5 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles along the z-axis. -
FIG. 6 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles in an x-y plane closest to a determined z-axis coordinate. -
FIG. 7 shows images obtained by illuminating 980 nm laser and 532 nm laser onto a cell which does not contain a fluorophore. -
FIG. 8 illustrates comparison of images before and after determination of the position of upconverting nanoparticles. -
FIG. 9 shows and a three-dimensional image generated by injecting upconverting nanoparticles into a Ma cell and photographing the cell. -
FIG. 10 shows a three-dimensional trajectory of a single upconverting nanoparticles, which is arbitrarily selected. - Terms used in this specification are merely adopted to explain specific embodiments, and are not intended to limit the present disclosure. A singular expression includes a plural expression unless the two expressions are contextually different from each other. In this specification, a term “include” is intended to specify characteristics, regions, integers, steps, operations, constituents and/or components, and should be understood as not pre-excluding existence or addition of one or more other characteristics, regions, integers, steps, operations, constituents and/or groups.
- Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure belongs. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of this specification and the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
- Hereinafter, a method for three-dimensional imaging according to preferred embodiments of the present disclosure will be described with reference to the accompanying drawings.
- If a two-dimensional image of a sample is acquired by scanning the sample in the depth direction using a wide-field fluorescence microscope, the fluorescence image may be blurred during scanning of the image. It is possible to obtain a clear image through complex mathematical reconstruction. However, optical stability may be lowered due to photoblinking of the imaging probe and photoleaching, and the image may be contaminated by autofluorescence.
- In addition, in the conventional nanoparticle imaging, a source of visible light or infrared light is used. Accordingly, when a cell is imaged using nanoparticles, there is a high risk of damaging the cell, and autofluorescence of the cell may function as a significantly large background noise. In addition, in in vivo imaging, transmittance of visible light or infrared light through a biological body is very low.
- The core configuration of the present disclosure for addressing the aforementioned issues is upconverting nanoparticles, which are used as a imaging probe. The upconverting nanoparticles absorb near-infrared (NIR) photons through optical upconversion, and emit visible photons or near-IN photons by nature. Thereby, a wavelength of a beam illuminated onto the sample is within the range of wavelength of NIR light, but the wavelength for imaging is within the range of wavelength of visible light. For example, the nanocrystal (NaYF4:Yb3+, Er3+), which is a material that is most widely used in research on upconverting nanoparticles, absorbs 980 nm photons, and emits visible photons through optical upconversion.
FIG. 1 illustrates paths of upconversion emission of NaYF4:Yb3+, Er3+and an emission spectrum of upconverting nanoparticles whose surface is coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine. As shown in the figure, NIR light is absorbed, and visible light is emitted through upconversion. - Since the upconverting nanoparticles are excited by NIR light, which is biologically friendly, and emit visible light. Accordingly, if the upconverting nanoparticles are used for cell imaging, they may rarely damage a cell specimen and autofluorescence may be prevented. Further, the converting nanoparticles may significantly increase transmittance through a biological body, and images may be obtained through a typical CCD for visible light, rather than through a CCD for NIR light. Accordingly, with the upconverting nanoparticles, consecutive images may be obtained for a long time since the upconverting nanoparticles do not cause photoblinking or photobleaching. Further, since the upconverting nanoparticles are a multipurpose nanomaterial capable of performing various biological functions through surface improvement, it may have universal and general biological applications.
- The present disclosure employing the upconverting nanoparticles as a probe has the following features. According to an embodiment of the present disclosure, a method for three-dimensional imaging includes introducing upconverting nanoparticles into a sample, illuminating NIR laser to excite the upconverting nanoparticles introduced into the sample, detecting visible light emitted from the excited upconverting nanoparticles and acquiring two-dimensional images captured by performing scanning in the depth direction of the sample, and generating a three-dimensional image of the sample using the two-dimensional images.
- First, a sample for three-dimensional imaging is prepared. Typically, various animal cells or vegetable cells may be used as the sample. The nanoparticles are introduced into the cell as an imaging probe. The upconverting nanoparticles used in the present disclosure are applicable to various embodiments in which the upconverting nanoparticles are excited by NIR light and emit visible light. For example, (NaYF4:Yb3+, Er3+), (NaYF4:Yb3+, Tm3+), (NaGdF4:Yb3+, Er3+), (NaYF4:Yb3+, Er3+/NaGdF4) and (NaGdF4:Yb3+, Er3+/NaGdF4) may be used. The surfaces of these nanoparticles may be coated with a mixture of phospholipid-PEG and phospholipid-PEG-amine
-
FIG. 2 is a schematic diagram illustrating a fluorescence microscope used for a method for three-dimensional imaging according to an embodiment of the present disclosure. Hereinafter, the procedure of capturing two-dimensional images will be described in detail with reference toFIG. 2 . A prepared sample is positioned on a fluorescence microscope, MR laser is illuminated onto the sample. The NIR laser serves to excite upconverting nanoparticles introduced into the sample, such that light having a wavelength in the range of visible light is emitted. The wavelength of the NIR light used for the separation ranges from 900 nm to 1000 nm. In particular, it is preferable to use laser of 980nm wavelength in terms of absorption of the upconverting nanoparticles. In this case, any laser, whether it is Q-switching laser or femtosecond laser, may be used. Relatively low-cost continuous wave (CW) laser may be used. - A fluorescence image is acquired by detecting visible rays emitted from the upconverting nanoparticles excited by the NIR laser. Herein, the acquired image should be in the range of visible light rather than in the range of infrared light, and have a high signal sensitivity. Accordingly, an electron multiplying CCD (EMC CCD) may be used. In order to obtain the a three-dimensional image, a plurality of two-dimensional images of the sample ares acquired by scanning the sample in the depth direction (“z-direction”). Herein, the scanning refers to dividing the sample into parts in the depth direction and moving the sample or the objective lens such that the camera can capture multiple images of the sample. In this embodiment, two-dimensional images are captured, while the position of the objective lens is shifted in the depth direction of the sample through a motor controller attached to the microscope. Herein, the number and interval between the captured images are set by a computer connected to the motor controller. Typically, the number of captured two-dimensional images may be 15, and the distance between the images may be set to 500 nm. In this case, the range of scanning in the z-axis direction is about 7 μm, which corresponds to a range which allows measurement of sizes of almost all Hela cells. Herein, the exposure time of the EMCCD may be about 70 ms. Accordingly, it is possible to obtain two-dimensional images for building a three-dimensional image along the z-axis in about one second.
-
FIG. 3 is a graphic depicting the z-axis scanning position over time. As shown inFIG. 3 , the images may be consecutively obtained according to movement of the objective lens. In this case, the time interval between the images may be about one second..FIG. 4 schematically illustrates a procedure of obtaining two-dimensional images by performing scanning in the depth direction using a method for three-dimensional imaging according to an embodiment of the present disclosure. Multiple two-dimensional images (an image stack) may be obtained by scanning the sample in the z-axis direction by moving the objective lens. In the image stack, a plane in focus has a light emission point having the highest intensity, and the intensity gradually decreases in planes out of focus. - Using the two-dimensional images obtained in this way, a three-dimensional image of the sample is generated. First, to correct the image stack along the z-axis, the position of a light emitting particle needs to be specified.
FIG. 5 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles along the z-axis. As shown inFIG. 5 , variation of the emission intensity of upconverting nanoparticles along the z-axis fits a Gaussian distribution. Accordingly, the peak point on the Gaussian distribution curve may be interpreted as the z-axis coordinate of a single upconverting nanoparticles. - In addition, accurate coordinates in the x-y plane are needed to acquire a three-dimensional image.
FIG. 6 illustrates the emission intensities and Gaussian distribution of upconverting nanoparticles in an x-y plane closest to a determined z-axis coordinate. Herein, “s” denotes a standard deviation of the Gaussian distribution. The x and y coordinates of the peak point of emission intensity are determined by the coordinates of the center in relation to the Gaussian distribution. Accordingly, a three-dimensional image may be generated by rendering point markers at the respective x, y, and z coordinates. The three-dimensional image may be generated by determining the three-dimensional center and repeating the rendering operation. - To obtain a three-dimensional image of a nanoparticle, accurate three-dimensional coordinates of the particle is needed. According to an embodiment of the present disclosure, in the Cartesian coordinate system, a z-axis coordinate is estimated first, and then two-dimensional coordinates on the x and y axes are estimated. Then, three-dimensional coordinates are estimated, and then a point is marked at the corresponding position to reconstruct the image. In this case, one set of 3-D imaging is possible at a time, and thus the change in position of the nanoparticle may be three-dimensionally tracked every one second.
- An error for the position determined according to correction performed using the Gaussian distribution curve depends on the number of photons and the pixel size of the camera. The error range given by
Equation 1, which was proposed by Thomson, is about 4 nm in the x-y plane and about 15 nm on the z axis. Accordingly, to more accurately determine the position, high-power laser is preferably used. -
- A more detailed description of the present disclosure will be given below, based on an experimental example.
- To check if autofluorescence is created, 980 nm laser and 532 nm laser were illuminated onto a cell which did not contain a fluorophore (see
FIG. 7 ). The powers used for the illumination were 386 W/cm2 and 44 W/cm2, respectively. As shown inFIG. 7, 980 nm laser did not cause autofluorescence even though the power thereof was 9 times greater than the power of 532 nm laser. On the other hand, 532 nm laser caused autofluorescence. - The surface of hexagonal-(NaYF4:Yb3+, Er3+), employed as upconverting nanoparticles, was coated with a mixture of phospholipid-PEG and phospholipid of-PEG-amine. The diameter of the upconverting nanoparticles was less than or equal to about 27,6 nm. The diameter obtained after coating was less than or equal to about 32.6 nm. A three-dimensional image of a fixed Hela cell was acquired before the upconverting nanoparticles were introduced into the cell. The cell was fixed in capturing the image thereof in order to check the effect of determination of a single three-dimensional particle (see
FIG. 8 ). As expected, autofluorescence was not created, and it was seen that the blurring effect of the upconverting nanoparticles were eliminated by the position determination. - The method for three-dimensional imaging using upconverting nanoparticles according to the present disclosure may be the most appropriate model for visualizing the effect of introduction into the nucleus. To check if this is true, images of a live Hela cell are shown in
FIG. 9 . - It is also possible to implement a three-dimensional image containing information about positions of all particles, including tracking of multiplexed single particles.
FIG. 10 shows a three-dimensional trajectory of a single upconverting nanoparticles, which is arbitrarily selected. It is apparent that the trajectory is created by a few different transports. The area marked by blue indicates an active transport according to the cytoskeleton, and the area marked by red indicates limited diffusion. - Although the preferred embodiments of the present disclosure have been disclosed with reference to the accompanying drawings, those skilled in the art will appreciate that other embodiments may also be practiced without changing the spirit or essential features of the present disclosure.
- Accordingly, the exemplary embodiments of the disclosure, as set forth above, should be construed in all aspects as illustrative and not limiting. It will be apparent to those skilled in the art that various modifications and variations can be made in the present disclosure without departing from the spirit or scope of the present disclosure. Thus, it is intended that the present disclosure covers the modifications and variations of this disclosure provided they come within the scope of the appended claims and their equivalents.
Claims (4)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/457,104 US20190317306A1 (en) | 2016-03-03 | 2019-06-28 | Method for three-dimensional imaging using upconverting nanoparticles |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
KR1020160025389A KR101754146B1 (en) | 2016-03-03 | 2016-03-03 | Method for three-dimensional imaging using upconverting nanoparticles |
KR10-2016-0025389 | 2016-03-03 | ||
US15/360,917 US10444483B2 (en) | 2016-03-03 | 2016-11-23 | Method for three-dimensional imaging using upconverting nanoparticles |
US16/457,104 US20190317306A1 (en) | 2016-03-03 | 2019-06-28 | Method for three-dimensional imaging using upconverting nanoparticles |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/360,917 Continuation US10444483B2 (en) | 2016-03-03 | 2016-11-23 | Method for three-dimensional imaging using upconverting nanoparticles |
Publications (1)
Publication Number | Publication Date |
---|---|
US20190317306A1 true US20190317306A1 (en) | 2019-10-17 |
Family
ID=59354302
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/360,917 Expired - Fee Related US10444483B2 (en) | 2016-03-03 | 2016-11-23 | Method for three-dimensional imaging using upconverting nanoparticles |
US16/457,104 Abandoned US20190317306A1 (en) | 2016-03-03 | 2019-06-28 | Method for three-dimensional imaging using upconverting nanoparticles |
Family Applications Before (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/360,917 Expired - Fee Related US10444483B2 (en) | 2016-03-03 | 2016-11-23 | Method for three-dimensional imaging using upconverting nanoparticles |
Country Status (2)
Country | Link |
---|---|
US (2) | US10444483B2 (en) |
KR (1) | KR101754146B1 (en) |
Families Citing this family (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10976532B2 (en) * | 2016-06-10 | 2021-04-13 | Tomocube, Inc. | Structured illumination microscopy system using digital micromirror device and time-complex structured illumination, and operation method therefor |
KR101967994B1 (en) * | 2017-08-21 | 2019-04-10 | 울산과학기술원 | Tactile sensor, method for manufacturing the same, three-dimensional mapping method |
CN110314714B (en) * | 2019-07-09 | 2021-06-25 | 大连海事大学 | Cell activity state characterization monitoring device and method based on three-dimensional image characteristics |
RU2716861C1 (en) * | 2019-07-09 | 2020-03-17 | Федеральное государственное бюджетное образовательное учреждение высшего образования "Рязанский государственный радиотехнический университет имени В.Ф. Уткина" | Scanning probe of atomic-force microscope with detachable remote-controlled nanocomposite radiating element doped with upconverting and magnetic nanoparticles of core-shell structure |
RU193569U1 (en) * | 2019-07-09 | 2019-11-05 | Федеральное государственное бюджетное образовательное учреждение высшего образования "Рязанский государственный радиотехнический университет имени В.Ф. Уткина" | A SCANNING PROBE OF AN ATOMICALLY POWER MICROSCOPE WITH SEPARABLE TELEO-CONTROLLED NANOCOMPOSITE RADIATING ELEMENT BASED ON APCONVERTING AND MAGNETIC STRUCTURE NANOPARTICLES |
CN112198133A (en) * | 2020-10-20 | 2021-01-08 | 上海洞舟实业有限公司 | Preparation method of infrared laser visual detector |
Family Cites Families (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE102004017956B4 (en) * | 2004-04-14 | 2022-07-07 | Leica Microsystems Cms Gmbh | Method for studying the lifetime of excited states in a sample |
US9335027B2 (en) * | 2013-01-02 | 2016-05-10 | Massachusetts Institute Of Technology | Methods and apparatus for transparent display using scattering nanoparticles |
-
2016
- 2016-03-03 KR KR1020160025389A patent/KR101754146B1/en active IP Right Grant
- 2016-11-23 US US15/360,917 patent/US10444483B2/en not_active Expired - Fee Related
-
2019
- 2019-06-28 US US16/457,104 patent/US20190317306A1/en not_active Abandoned
Also Published As
Publication number | Publication date |
---|---|
US20170254996A1 (en) | 2017-09-07 |
KR101754146B1 (en) | 2017-07-06 |
US10444483B2 (en) | 2019-10-15 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10444483B2 (en) | Method for three-dimensional imaging using upconverting nanoparticles | |
Straub et al. | Fluorescence lifetime three-dimensional microscopy with picosecond precision using a multifocal multiphoton microscope | |
CN102023148B (en) | Fluorescent nanoscopy method | |
CN101653355B (en) | Living small animal imaging system and imaging method | |
CN104198458B (en) | Femtosecond laser two-photon fluorescent biological microimaging system and imaging method thereof | |
US7675045B1 (en) | 3-dimensional imaging at nanometer resolutions | |
CN103105382B (en) | Microscope equipment and method for carrying out three-dimensional localization to the point target in sample | |
CN107091825A (en) | Fluorescent sample chromatography micro imaging method based on microlens array | |
CN108414442A (en) | Confocal microscope system suitable for near-infrared 2nd area fluorescent vital imaging | |
SG175923A1 (en) | A system, method, and luminescent marker for improved diffuse luminescent imaging or tomography in scattering media | |
Jo et al. | Fast and background-free three-dimensional (3D) live-cell imaging with lanthanide-doped upconverting nanoparticles | |
JP2009264752A (en) | Three-dimensional image acquisition apparatus | |
CN112161946B (en) | Frequency domain luminous life imaging system | |
US7453567B2 (en) | Fluorescence lifetime distribution image measuring system and its measuring method | |
EP4288821B1 (en) | Method and light microscope for a high-resolution examination of a sample | |
WO2016156092A1 (en) | Method for locating at least one emitter using a localization microscope | |
EP3768153B1 (en) | Multimodal imaging system and method for non-invasive examination of an object | |
Fang et al. | Development of fast and three-dimensional focused X-ray luminescence tomography system | |
CN106885795A (en) | A kind of fluorescence lifetime information acquisition method and system for moving single-particle | |
Gong et al. | A fully water coupled oblique light-sheet microscope | |
CN110646385A (en) | Single-particle imaging device and method based on up-conversion luminescence total internal reflection | |
CN110638426A (en) | Laser scanning living body fluorescence imaging signal acquisition device | |
CN219320091U (en) | Micro-nano robot system | |
Vanga et al. | Development of a new light collection and detection system optimized for ion beam induced fluorescence microscopy | |
Fang et al. | Pencil Beam Based X-ray Luminescence Computed Tomography Imaging of Deep Targets Three-dimensionally and Quantitatively |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: GWANGJU INSTITUTE OF SCIENCE AND TECHNOLOGY, KOREA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LEE, KANG TAEK;SONG, YO HAN;PARK, JIN HO;AND OTHERS;REEL/FRAME:049626/0249 Effective date: 20161104 |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: NON FINAL ACTION MAILED |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER |
|
STPP | Information on status: patent application and granting procedure in general |
Free format text: FINAL REJECTION MAILED |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |