US20170160197A1 - Method and device for single molecule imaging - Google Patents
Method and device for single molecule imaging Download PDFInfo
- Publication number
- US20170160197A1 US20170160197A1 US15/368,420 US201615368420A US2017160197A1 US 20170160197 A1 US20170160197 A1 US 20170160197A1 US 201615368420 A US201615368420 A US 201615368420A US 2017160197 A1 US2017160197 A1 US 2017160197A1
- Authority
- US
- United States
- Prior art keywords
- mobile phone
- nucleic acid
- sample
- acid molecules
- image
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
- G06V20/693—Acquisition
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
-
- G06K9/00134—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/60—Rotation of a whole image or part thereof
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/001—Image restoration
- G06T5/002—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/6428—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes"
- G01N2021/6439—Measuring fluorescence of fluorescent products of reactions or of fluorochrome labelled reactive substances, e.g. measuring quenching effects, using measuring "optrodes" with indicators, stains, dyes, tags, labels, marks
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N2021/6463—Optics
- G01N2021/6471—Special filters, filter wheel
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/06—Illumination; Optics
- G01N2201/061—Sources
- G01N2201/06113—Coherent sources; lasers
- G01N2201/0612—Laser diodes
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/06—Illumination; Optics
- G01N2201/062—LED's
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/06—Illumination; Optics
- G01N2201/063—Illuminating optical parts
- G01N2201/0638—Refractive parts
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N2201/00—Features of devices classified in G01N21/00
- G01N2201/12—Circuits of general importance; Signal processing
-
- G06K9/6212—
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10024—Color image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10064—Fluorescence image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30072—Microarray; Biochip, DNA array; Well plate
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
- G06V20/695—Preprocessing, e.g. image segmentation
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/12—Details of telephonic subscriber devices including a sensor for measuring a physical value, e.g. temperature or motion
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04M—TELEPHONIC COMMUNICATION
- H04M2250/00—Details of telephonic subscriber devices
- H04M2250/52—Details of telephonic subscriber devices including functional features of a camera
Definitions
- the technical field generally relates to imaging methods and devices and more specifically to methods and devices for imaging and measuring single molecules and in particular nucleic acids (e.g., DNA).
- nucleic acids e.g., DNA
- Imaging single biomolecules allow for exploration of their individual behavior and properties at the nanoscale level, which not only significantly advances knowledge of molecular biology and biophysics but also provide various diagnostics opportunities for biomedical applications.
- Imaging of single DNA molecules has been of particular interest as various diseases including cancer and neurological disorders such as Alzheimer's disease are associated with genomic alterations, including for example copy-number variations (CNVs).
- CNVs copy-number variations
- High spatial resolution and nondestructive nature of optical imaging methods are especially attractive for probing DNA-protein interactions or mapping genetic information from individual DNA molecules.
- a mobile phone-based device for the imaging and length quantification of individual nucleic acid molecules (e.g., DNA) is demonstrated.
- the device uses a field-portable and cost-effective modular attachment device that is mountable on the housing or body of the mobile phone device.
- the modular attachment device is mounted to align or integrate with the existing camera of the mobile phone.
- This modular attachment device which in some embodiments weighs less than 190 grams (including three AAA batteries), utilizes a compact laser-diode (e.g., 450 nm, 75 mW) to excite fluorescently labeled molecules at a high-incidence angle of ⁇ 75°.
- the optical path in the modular attachment device includes a thin-film based interference filter located therein to create a very strong dark-field performance; significantly suppressing the background noise created by the high-power excitation beam.
- the modular attachment device in one embodiment, contains a miniature dovetail stage for depth-of-focus adjustment and a lens (or set of lenses) that is used to form a magnified image of the fluorescent specimen onto the imaging sensor or imaging chip of the mobile phone.
- the mobile phone includes software or an application “app” that is has a user interface that guides a user through the process operations needed to image single molecules.
- the user interface also provides a communication platform to transfer the raw images with a custom-designed back-end server that runs software thereon for digital processing of the acquired fluorescent images to rapidly quantify the length of each single molecule or specific sub-regions of the nucleic acid molecules.
- the measured fluorescent signatures of the stretched nucleic acid strand is fitted to the mobile phone microscope's two-dimensional (2D) point-spread-function (PSF).
- PSF two-dimensional point-spread-function
- a method for imaging and sizing fluorescently labeled nucleic acid molecules using a mobile phone includes securing a modular attachment device to the mobile phone with a sample containing stretched, fluorescently labeled nucleic acid molecules.
- the sample is illuminated with excitation light to cause the fluorescently labeled nucleic acids to emit fluorescent light.
- One or more images of the fluorescently labeled nucleic acids in the sample are captured using a camera of the mobile phone.
- the one or more images from the mobile phone are transmitted to a remote computer having at least one processor for image processing and analysis.
- the one or more images are processed with the at least one processor of the remote computer to generate analysis data of sample, wherein the analysis data includes the lengths of individual nucleic acid molecules or the lengths of specific sub-regions of nucleic acid molecules contained in the sample.
- the analysis data is received from the remote computer and at least some of the analysis data is displayed on a display of the mobile phone, a laptop, personal computer, or tablet computing device.
- a method for imaging and sizing fluorescently labeled nucleic acid molecules using a mobile phone includes securing a modular attachment device to the mobile phone with a sample containing stretched, fluorescently labeled nucleic acid molecules.
- the sample is illuminated with excitation light to cause the fluorescently labeled nucleic acid molecules to emit fluorescent light.
- One or more images of the fluorescently labeled nucleic acid molecules in the sample are captured using a camera of the mobile phone.
- the one or more images are processed with at least one processor of the mobile phone to generate analysis data of sample, wherein the analysis data includes the length of nucleic acid molecules or specific sub-regions of nucleic acid molecules contained in the sample.
- the analysis data is displayed on a display of the mobile phone.
- a device or system for imaging fluorescently labeled nucleic acid molecules in a sample includes a mobile phone having a camera therein.
- the device or system includes a modular attachment device configured to mount to the mobile phone and position a fluorescently labeled nucleic acid sample contained therein within a field of view of the camera.
- the modular attachment device includes an excitation light source; a sample holder configured to hold the sample containing the fluorescently labeled nucleic acid compressed between two optically transparent substrates, wherein fluorescently labeled nucleic acid molecules are stretched or extended in response to a compression force applied to the two optically transparent substrates; a lens or set of lenses for magnifying the image of the sample; a filter interposed between the lens and the camera of the mobile phone and configured to reject scattered background light from the excitation light source and transmit fluorescent light through the filter; and a moveable stage for moving the excitation light source and sample holder relative to the camera of the mobile phone.
- the mobile phone includes software or an application executed thereon to identify molecules of fluorescently labeled nucleic acid in the sample along with their respective lengths or lengths of sub-regions of the nucleic acid molecules.
- FIG. 1A illustrates a side view of a modular attachment device configured to mount to the mobile phone.
- the side of the modular attachment device is cut away to illustrate inner components.
- FIG. 1B illustrates front and back views of a mobile phone device according to one embodiment.
- FIG. 1C illustrates a schematic illustration of the modular attachment device mounted on a mobile phone.
- the screen or display of the mobile phone illustrates the graphical user interface (GUI) of software or an application for analyzing single molecules (e.g., nucleic acids).
- GUI graphical user interface
- FIG. 1D illustrates a sample holder and two step method for imparting mechanical shear forces on a pre-stained or pre-dyed sample to stretch or elongate the molecules prior to imaging.
- FIG. 1E illustrates a schematic representation of a system used to analyze the sizing of single molecules using the mobile phone and modular attachment device of FIGS. 1A and 1B .
- a remote computer e.g., server
- image processing and analysis to determine the length of molecules of nucleic acid.
- FIG. 2 illustrates a flow chart illustrating the operations used to automatically determine the length of single molecules (e.g., nucleic acid) by image processing software contained in the remote computer of FIG. 1E (or mobile phone in other embodiments).
- single molecules e.g., nucleic acid
- FIGS. 3A-3F illustrate screenshot images illustrating the GUI of the software application running on the mobile phone that is used to acquire images and upload the same to a remote server for processing. Results are returned to the mobile phone where they are displayed to the user on the GUI.
- FIG. 4A illustrates a large field-of-view (FOV) ( ⁇ 2 mm 2 ) mobile phone image of labeled DNA molecules stretched on a glass substrate. This image is taken at the boundary of the initial DNA droplet placed on the substrate, and it is averaged using thirteen (13) successive mobile phone images and is displayed after background subtraction.
- the inset (circle) shows a typical FOV corresponding to a 100 ⁇ objective-lens.
- FIG. 4B illustrates an enlarged mobile phone image showing single DNA molecules within the box labeled “b” in FIG. 4A .
- FIG. 4D illustrates an enlarged mobile phone image showing single DNA molecules within the box labeled “d” in FIG. 4A .
- FIG. 4F illustrates an enlarged mobile phone image showing single DNA molecules within the box labeled “f” in FIG. 4A .
- FIG. 5B illustrates an image of same single ⁇ DNA molecules of FIG. 5A obtained with a conventional bench-top microscope (100 ⁇ oil-immersion objective-lens, 1.3 NA).
- FIG. 5C illustrates a scatter plot of DNA length measurement obtained by the mobile phone device plotted against the bench-top microscope results.
- the solid line is a linear fit to the raw data.
- FIG. 5D illustrates a histogram of the distribution of the length measurement differences ( ⁇ l) between mobile phone results and conventional microscope results, where the mean error is ⁇ 0.33 ⁇ m and the standard deviation is 1.08 ⁇ m.
- FIG. 6A illustrates an image obtained of a 5 kbp segment of DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope.
- FIG. 6B illustrates an image obtained of a 10 kbp segment of DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope.
- FIG. 6C illustrates an image obtained of a 20 kbp segment of DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope.
- FIG. 6D illustrates an image obtained of a 40 kbp segment of T7 DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope.
- FIG. 6E illustrates an image obtained of a 48 kbp segment of ⁇ DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope.
- the solid lines are fitted normal distribution functions based on measured histograms.
- FIG. 8B is a graph of SNR as a function of the number of mobile phone image frames (n).
- the mean SNR of the single DNA images improves proportional to proportional to ⁇ square root over (n) ⁇ .
- FIG. 9A illustrates a representative fluorescent image of ⁇ DNA (RGB color scale) obtained using the mobile phone and modular attachment device.
- FIG. 9B illustrates a preliminary object mask generated by using an intensity threshold.
- FIG. 9C illustrates an improved object mask that uses curvature detection algorithm to digitally separate end-to-end conjugated DNA masks (darker arrows) and side-by-side conjugated DNA masks (lighter arrows).
- FIG. 10 illustrates a graph of the mean DNA lengths measured by the mobile phone (triangles) and the bench-top fluorescence microscope.
- the theoretical length of the fully stretched DNA molecule was calculated based on 0.34 nm per base pair.
- the full length of the error bar for each data point represents twice the standard deviation of a normal distribution curve that is fitted to the measured DNA length histograms shown in FIGS. 7A-7E .
- FIG. 1A illustrates a modular attachment device 10 that is used in conjunction with a mobile phone 100 as also seen in FIGS. 1B and 1C for single molecule imaging and sizing.
- the mobile phone 100 may include any number of makes and models of mobile phones.
- the mobile phone 100 includes a camera 102 that is used to obtain images of a sample 12 containing the molecules to be imaged when mounted to the modular attachment device 10 .
- the mobile phone 100 includes a display or screen 104 that is used by the user to display information and interact with the mobile phone 100 .
- the mobile phone 100 includes an application or software 106 that is loaded or otherwise executable by the mobile phone 100 .
- the software 106 is used to acquire images of the sample 12 using the modular attachment device 10 .
- the software 106 may be downloaded from a website or “store” as is typically used with software or applications that run on mobile phones 100 .
- the software 106 provides a graphical user interface (GUI) through which the user interacts with to acquire images of a sample 12 as well as view automatically generated data regarding sizing of molecules within the sample 12 as explained herein.
- GUI graphical user interface
- the modular attachment device 10 is made to temporarily secure itself to the side of the mobile phone 100 that contains the camera 102 .
- the modular attachment device 10 is secured to back side of the mobile phone 100 so that an optical path (OP) is created between a sample 12 that is contained in a sample holder 30 that is located inside the modular attachment device 10 and the camera 102 .
- the camera 102 of the mobile phone 100 typically includes a lens 108 that is positioned adjacent to an image sensor 110 or imaging chip that is contained within the camera 100 .
- the image sensor 110 or imaging chip may include a CCD or CMOS image sensor.
- the image sensor 110 or imaging chip is a color-based sensor that is capable of acquiring color images.
- the modular attachment device 10 can be temporarily secured to the housing or body of the mobile phone 100 using one or more clips or tabs 14 that are formed in the modular attachment device 10 as seen in FIG. 1C .
- the clips or tabs 14 may be flexible or bendable such that the modular attachment device 100 may be easily attached or remoted from the mobile phone 100 .
- the dimensions of the modular attachment device 10 may vary depending on the make or model of the mobile phone 100 . For example, different versions or models of the modular attachment device 10 may be made to accommodate different and shapes of mobile phones 100 . In the experiments described herein, a Lumia 1020, Nokia mobile phone 100 was used.
- the modular attachment device 10 may include a housing 11 that is used to contain the various components of the imaging device as well as the sample 12 .
- the housing 11 may be made of a polymer material such as a plastic-based material.
- the housing 11 may be made using any known manufacturing techniques including 3D printing techniques.
- the modular attachment device 10 includes a light source 16 that is used as an excitation light source for fluorescent probes or labels that are present within the sample 12 .
- the light source 16 is at least one laser diode (e.g., a 450 nm laser diode) that is powered by driver circuitry contained within the modular attachment device 10 and powered by one or batteries 17 that are also contained in the modular attachment device 10 and are used to power the light source 16 .
- the light source 16 may also include a light emitting diode (LEDs) or an array of the same.
- the light source 16 is positioned within the modular attachment device 10 to illuminate the sample 12 at an angle of around 75° (with respect to a normal of the camera 102 along optical path OP).
- the average illumination power density at the sample plane was estimated to be 2.4 W/cm 2 .
- the laser diode light source 16 was mounted on a ⁇ 12 ⁇ 30 mm copper host and further surrounded by a ⁇ 18 ⁇ 40 mm aluminum heat sink. In some embodiments, these may not be needed.
- the modular attachment device 10 further included an adjustable stage 20 (e.g., miniature dovetail stage (DT12, Thorlabs)) that is used to move both the sample 12 (via a sample holder 30 described below) and the light source 16 (in the z direction as seen in FIG. 1A along the optical path formed between the sample 12 and the camera 102 ). Movement of the adjustable stage 20 controls focus of the image that is obtained by the mobile phone 100 .
- a knob 22 can be used to adjust the movement of the stage 20 and thus the focus of the device.
- the focus of the modular attachment device 10 is set using the knob 22 and is generally adjusted to produce infinity focus for both PSF acquisition (using fluorescent beads) and experiments.
- a set of lenses 24 may be located in the modular attachment device 10 for magnification.
- One or more filters 26 loaded in a filter holder 27 are used to permit the passage of fluorescent light emitted from a specimen in the sample while preventing transmission of scattered excitation light.
- the filter holder 27 can be moveable in and out of the modular attachment device 10 such that different filters 26 can be loaded into the filter holder 27 as needed.
- this may include two (2) stacked 500 nm longpass filters (FF01-500/LP-23.3-D, Semrock) that were placed between the external lens 24 and the mobile phone camera lens 108 to reject the scattered background light due to high-power laser excitation.
- the modular attachment device 10 includes a switch 28 that is used to turn the light source 16 on or off.
- the modular attachment device 10 when used with the mobile phone 100 enables imaging of fluorescently labeled molecules such as nucleic acid over a large field of view.
- the DNA samples are imaged within a field of view that is around 2 mm 2 in size which is much larger than the FOV of a 100 ⁇ objective lens as seen in FIG. 4A .
- the sample 12 is contained in a sample holder 30 as seen in FIG. 1D which is loaded into the modular attachment device 10 .
- the sample holder 30 is used to impart shear stress on the sample 12 so as to stretch the molecules contained therein.
- the sample contains nucleic acid molecules (e.g., DNA) that are labeled with a fluorescent dye or label.
- the entire length of the nucleic acid molecule or fragment thereof may be labelled.
- a specific sub-region or multiple sub-regions of the nucleic acid molecule may be labelled.
- a sub-region defining a specific gene or allele can be labeled and imaged.
- the fluorescent dye or label may emit light at any number of colors or wavelengths depending on the particular dye or label that is used. In the experiments described herein, a fluorescent dye or label was used that emits green colored light although other colored dyes can be used.
- the sample holder 30 may include a first optically transparent substrate 30 a such as a silanized glass coverslip onto which the sample 12 containing pre-stained or pre-dyed molecules are placed.
- a second optically transparent substrate 30 b e.g., plasma treated glass
- the top or second optically transparent substrate 30 b is then quickly pressed down towards the first optically transparent substrate 30 a (e.g., using a tweezer or the like).
- the droplet containing the stained nucleic acid is pushed from the center of the first substrate 30 a to the edges located between the first and second substrates 30 a , 30 b , forming a strong shearing flow, which stretches the nucleic acid molecules on the first substrate 30 a .
- the sample holder 30 is then sealed at the edges with a colorless adhesive (e.g., nail polish) and can be placed inside the modular attachment device 10 for imaging.
- a colorless adhesive e.g., nail polish
- FIG. 1E illustrates a schematic representation of one embodiment of a system 40 used to analyze the sizing of single molecules using the mobile phone 100 and modular attachment device 10 of FIGS. 1A-1C .
- the system 40 includes one or more mobile phones 100 that include modular attachment devices 10 that are secured thereto to image samples 12 .
- a remote computer 42 such as a remote server is used to perform image processing and analysis on image files 50 obtained using the mobile phones 100 .
- the remote computer 42 contains one or more processors 44 therein that execute software 46 loaded or otherwise executed by the remote computer 42 to process and analyze images files 50 that are transferred to the remote computer 42 by the mobile phone(s) 100 .
- Files may be transferred to the remote computer 42 via a wireless network on which the mobile phones 100 operate. Files may also be transferred using a WiFi or other connection that links the mobile phone 100 to a wide area network such as the Internet.
- the image 50 that is transferred may be an image 50 of the sample 12 that has just been acquired or it may be a previously saved image 50 that is stored on the mobile phone 100 .
- the image 50 file type may include any number of file types commonly used by mobile phones 100 . On particular example is DNG format which can later be converted to TIFF format at the remote computer 42 as described herein.
- the image is uploaded to the remote computer 42 using HTTP for rapid digital processing by the software 46 .
- the software 46 on the remote computer 42 the software rapidly quantifies the length of the molecules in the sample 12 (e.g., each strand of nucleic acid) by fitting the mobile phone's two dimensional (2D) point-spread-function (PSF) (obtained by measuring fluorescent beads or other particles) to the measured fluorescent signatures contained in the images 50 .
- the results of the analysis can then be transferred back to the mobile phone 100 where the results can be displayed to the user on the display 104 of the mobile phone 100 using the graphical user interface of the mobile software or application 106 .
- one or more additional remote computers 52 may also be used to visualize the results of the detection and length measurements of single molecules in the sample 12 .
- the remote computers 52 may include personal computers (PCs), laptops, tablet computing devices, and the like.
- results may be shared with multiple different users beyond the mobile phone 100 that is used to run the test.
- the images 50 do not need to be transferred to a second or remote computer 42 .
- the processor (or multiple processors) contained within the mobile phone 100 may process the images and analyze the results. In such an embodiment, there is no need to off-load or transfer images to a remote server 42 or the like.
- FIG. 2 illustrates a flow chart illustrating the operations used to automatically determine the length of single molecules (e.g., nucleic acid) using the image processing software 46 contained in the remote computer 42 of FIG. 1E .
- the algorithm illustrated in FIG. 2 is used to process images 50 (operation a in FIG. 2 ).
- This automated length estimation process starts with digital alignment of multiple images 50 and then averaging (operation b) of multiple fluorescence images 50 recorded on the mobile phone 100 using the lossless digital negative (DNG) format, which displays the image in a Bayer pattern without any demosaicing and compression steps.
- DNG lossless digital negative
- the mean SNR of single DNA molecules that were imaged in experiments increased from 3.8 for a single frame to an SNR of 12.1 for an average of 10 frames (see FIGS. 8A and 8B ), following an SNR improvement factor that is proportional to the square root of the number of frames (n).
- 10-15 successive frames were averaged to benefit from this SNR improvement before the effects of photobleaching were observed.
- the next operation (operation c in FIG. 2 ) in the length estimation algorithm involves rejection of all the blue and red pixels in the Bayer pattern such that only the green pixels of the image are kept, improving the spectral overlap with the fluorescent signal band.
- the resulting green pixel array is then rotated by 45 degrees to form a new image where the pixel period is “effectively” increased by compared to the raw image pixel pitch; this is entirely due to the fact that red and blue pixels of the raw Bayer pattern are not used in the analysis.
- one or two colors of pixels remain (e.g., red or blue) and it does not have to be the green pixels as illustrated.
- the dye that was used with the nucleic acid emitted light in the green color region.
- FIG. 9A illustrates a representative mobile phone fluorescence image of ⁇ DNA displayed in RGB color scale.
- FIG. 9B illustrates a preliminary object mask generated by using an intensity threshold.
- FIG. 9C illustrates an improved masking method that utilizes a curvature detection algorithm to digitally separate end-to-end conjugated DNA masks (darker arrows) or side-by-side conjugated DNA masks (lighter arrows).
- the next operation (operation d) of the algorithm is to establish the skeleton of each nucleic molecule through PSF fitting.
- the PSF of the mobile phone based microscope was previously estimated by averaging the two-dimensional (2D) intensity profiles of 100 nm fluorescent particles (e.g., beads) imaged on the same mobile phone 100 . Obtaining the PSF of the mobile phone-based microscope needs to be done only once for each device.
- the PSF fitting procedure is initially applied to the short axis of each nucleic molecule to find its center.
- this fitting process cannot be as accurate as determining the lateral position of a single fluorescent molecule because: (1) the PSF is estimated using 100 nm particles, and (2) there are more than one fluorescent molecule along the short-axis of each DNA strand; however this does not pose a limitation for the current mobile microscopy design and would be important to consider only for platforms that can achieve much smaller sizing accuracy and precision.
- the peak points of these centers are connected to form a DNA skeleton along the long axis direction.
- the next operation (operation e) is to find the edges of the DNA strand along its long axis by comparing a PSF-based theoretical edge intensity profile (dashed line in FIG.
- the line is truncated as compared to the skeleton line formed in operation e due to the minimization process performed using the measured edge intensity and sliding PSF edge function as explained above.
- the length of the molecule can also be estimated by thresholding the measured DNA intensity profile.
- FIGS. 3A-3F illustrate screenshot images illustrating the GUI of the software application 106 running on the mobile phone 100 that is used to acquire images and upload the same to a remote computer 42 for processing and analysis. Results are returned to the mobile phone where they are displayed to the user on the GUI.
- FIG. 3A illustrates the main menu of the software or application 106 .
- the software is used to analyze DNA, although it should be understood that other molecules besides nucleic acids can be visualized using this platform.
- the user is given the option of capturing an image by running a current test or experiment or selecting a previously obtained image (e.g., from a prior test or experiment). The user also has the option of seeing the history details of prior tests that have been run on the microscope platform.
- FIG. 1 illustrates the main menu of the software or application 106 .
- the software is used to analyze DNA, although it should be understood that other molecules besides nucleic acids can be visualized using this platform.
- the user is given the option of capturing an image by running a current test or experiment
- FIG. 3B illustrates a screen shot of a captured or selected fluorescent image that was obtained with the microscope platform. The user is given the option to upload the image to the remote computer 42 .
- FIG. 3C illustrates the GUI displaying to the user that the image is being uploaded and processed by the remote computer 42 .
- FIG. 3D illustrates a notice to is presented to the user to notify the user that image processing has ended.
- FIG. 3E illustrates a histogram showing the measured lengths of DNA in a sample from a 153.6 ⁇ 153.6 ⁇ m 2 FOV. The user is also presented with a strand count (in this example 50) as well as a mean length (in this example 16.242 ⁇ m).
- FIG. 3F illustrates a labelled fluorescence image of DNA segmentation that shows each measured DNA molecule.
- a field-portable, mobile phone-based fluorescence microscope was created by integrating a 3D printed modular attachment device to the existing camera housing of a smartphone (Lumia 1020, Nokia). This robust mobile phone attachment was designed in Autodesk Inventor and printed by using a 3D printer (Dimension Elite 3D).
- a 450 nm laser diode powered by three AAA batteries and a constant current output driver was used as the excitation light, which illuminated the sample at an incidence angle of ⁇ 75°.
- the average illumination power density at the sample plane was estimated to be 2.4 W/cm 2 .
- the laser diode was mounted on a ⁇ 12 ⁇ 30 mm copper host and further surrounded by a ⁇ 18 ⁇ 40 mm aluminum heat sink.
- the focus of the mobile phone microscope was controlled by a miniature dovetail stage (DT12, Thorlabs) which moved both the sample chamber and the light source.
- Two stacked 500 nm longpass filters (FF01-500/LP-23.3-D, Semrock) were placed between the external lens and the mobile phone camera lens to reject the scattered background light due to high-power laser excitation.
- Lambda DNA 48,502 b.p., Life Technologies
- T7 DNA 39,937 b.p., Boca Scientific Inc.
- Both ⁇ and T7 DNA and YOYO-1 were diluted with 1 ⁇ TAE buffer (40 mM Tris-acetate, 1 mM EDTA, pH 8.3, Life Technologies) to desired concentrations in low-retention DNA tubes (LoBind, Eppendorf).
- prestained DNA solutions were warmed up at 65° C. for 10 minutes, followed by a quick cooling in running water for 2 minutes to open up the sticky ends of DNA. Then, 5 ⁇ L of this pre-labeled DNA solution was diluted in 110 ⁇ L imaging buffer (1 ⁇ TAE buffer added with 4.8% (v/v) 2-mercaptoethonal and 500 nm green fluorescent beads) to a final concentration of ⁇ 0.03 ng/ ⁇ L.
- the DNA stretching substrates were prepared by functionalization of glass coverslips with a mixed layer of silane molecules, which consisted of (3-aminopropyl) triethoxysilane (APTES, Sigma) and allyltrimethoxysilane (ATMS, Sigma).
- Standard 22 ⁇ 22 mm coverslips (Fisherbrand) were first rinsed with acetone, isopropanol, methanol, and deionized (DI) water. After air-blow drying, both sides of coverslips were treated with plasma (BD-10AS, Electro-Technic Products, Inc.) for 10 seconds to activate the glass surface with hydroxyl groups.
- the plasma-treated coverslips were then immersed into a mixture silane solution in acetone (1% APTES, 1% ATMS, v/v) and coated for 10 minutes.
- acetone 1% APTES, 1% ATMS, v/v
- the coated coverslips were thoroughly rinsed with acetone and de-ionized (DI) water, and then dried by blown air.
- DI de-ionized
- the 22 ⁇ 22 mm silanized coverslip was placed on a solid planar surface, and 3 ⁇ L of the stained DNA solution diluted in imaging buffer was pipetted onto the center of the coverslip.
- Another 18 ⁇ 18 mm plasma-treated coverslip was held horizontally which was approximately 1 mm above the bottom coverslip.
- the top coverslip was then quickly pressed down toward the bottom substrate with a tweezer.
- the droplet containing the DNA samples was pushed from the center to the edges between the top and bottom coverslips, forming a strong shearing flow, which stretches the DNA molecules on the bottom substrate.
- the sample was then sealed with colorless nail polish and imaged using the microscopes described herein.
- the DNA sample of interest after the preparation steps detailed earlier, was loaded onto the sample holder and inserted into the mobile phone attachment. All the fluorescence images were recorded in a lossless raw format (DNG) with an integration time of ⁇ 4 seconds per frame. About 10-15 frames of the same DNA sample were captured for image averaging, before photobleaching was observed.
- DNG lossless raw format
- a custom-developed Windows® mobile phone application was developed that allows for analysis of the lengths of single DNA molecules imaged on the phone.
- This application can be used to capture an image of the sample or alternatively open a saved image for DNA length measurement.
- the selected or captured image is subsequently uploaded to a remote server through HTTP for rapid digital processing.
- the uploaded image is first converted from DNG format to 16-bit TIFF format and then processed in MATLAB using the length quantification method described previously.
- the image processing algorithm may be programmed using any number of computer programs. Once the processing is finished, the results (a histogram of DNA length measurements and a corresponding labeled image marking all the locations of analyzed DNA molecules) are then sent back to the originating mobile phone.
- the processing time for a 200 ⁇ 200 pixel cropped section of the full field-of-view is ⁇ 7 seconds in MATLAB using a single PC (CPU: Intel Xeon ES-2620), and it can be reduced by more than an order of magnitude if the same algorithms are implemented in a more efficient software language such as C/C++ and/or adapted to utilize GPUs.
- the upload time of the 41 megapixel raw DNG image varies between 10 seconds to 3 minutes.
- a curvature detection algorithm was implemented in the masking method to detect connecting masks from closely located molecules and eventually separate those masks into single masks.
- the algorithm first smooths the edges of the preliminary object mask that is generated by intensity thresholding with a median filter. Then it automatically recognizes two different types of DNA mask junctions: end-to-end and side-by-side using the overall differences in object width in these two scenarios as seen in FIG. 9C .
- end-to-end DNA junctions the first derivatives of the mask curvatures along both sides of the long axis of the DNA were calculated to find the peak points. These two peak points were then connected to separate the end-to-end DNA mask ( FIG. 9C , darker arrows).
- two starting points in the junction area were defined by detecting the number of y coordinates (2 for single objects, 3 for junction points, and 4 for two parallel objects) at each x position. After determining these two starting points, a tracking algorithm was applied to form a continuous separation line between the molecules ( FIG. 9C , lighter arrows).
- Agarose gel was prepared with 1 ⁇ TBE (Tris/Borate/EDTA) buffer and 0.5 ⁇ g/ml of ethidium bromide was added for DNA detection under UV illumination. Two samples, 500 ng of ⁇ DNA and T7 DNA, were loaded into the sample wells. For comparison, 1 ⁇ g of HindIII digested ⁇ DNA and 1 kb DNA ladder were also loaded on the gel as markers. The gel was run at 40V for 8 hours before imaging.
- TBE Tris/Borate/EDTA
- FOV field-of-view
- the region of high-quality DNA stretching surrounds the initial droplet position and forms a ring-shaped band with its width spanning over a few millimeters, which provides a sufficient sample area for imaging of DNA molecules using the mobile phone attachment with a large FOV of ⁇ 2 mm 2 .
- FIG. 4A displays one of these fluorescence images captured on the mobile phone device, showing that ⁇ DNA molecules are linearly stretched around the initial droplet position and that the DNA alignment direction is approximately perpendicular to the boundary of the droplet.
- the mobile phone image in FIG. 4A displays one of these fluorescence images captured on the mobile phone device, showing that ⁇ DNA molecules are linearly stretched around the initial droplet position and that the DNA alignment direction is approximately perpendicular to the boundary of the droplet.
- FIGS. 5A and 5B illustrate, respectively, zoomed-in regions of the ⁇ DNA sample imaged on the mobile phone platform and a conventional fluorescence microscope and each DNA molecule image is superimposed with a length profile (line) calculated using the computational procedures outlined earlier. As illustrated in FIG.
- DNA length values measured on the mobile phone platform are in good agreement with those obtained using the bench-top fluorescence microscope.
- the mean error for the mobile phone based length measurement results is ⁇ 0.33 ⁇ m or ⁇ 0.96 kbp (shorter) compared to bench-top microscope measurements, with a standard deviation of ⁇ 1.08 ⁇ m or ⁇ 3.17 kbp ( FIG. 5D ).
- FIGS. 7A-7E illustrate the length distributions of these different DNA samples quantified by the mobile phone microscopy platform (top row) as well as the conventional fluorescence microscope (bottom row).
- the measured number of DNA molecules (N) is significantly less in bench-top microscope measurements compared to the mobile phone results due to much smaller FOV of the 100 ⁇ objective lens.
- the average length (L) of the stretched ⁇ DNA and T7 DNA molecules measured using the mobile phone device is 16.31 ⁇ m ( FIG. 7E top histogram) and 14.10 ⁇ m ( FIG. 7D top histogram), respectively, which are in good agreement with 16.64 ⁇ m and 14.41 ⁇ m that were measured using the conventional bench-top microscope, yielding an average length measurement accuracy of 98.0% and 97.8%, respectively. It should be emphasized that separation and detection of large molecular weight DNA segments are major challenges for conventional gel electrophoresis techniques which work better for small DNA fragments.
- Gel electrophoresis for example, cannot distinguish between 48.5 kbp ( ⁇ DNA) and 39.9 kpb (T7 DNA).
- the mobile phone based microscopy based single DNA imaging approach described herein exhibits better differentiation resolution, especially for large DNA molecules compared to gel electrophoresis methods. Therefore, the mobile phone imaging platform provides a cost-effective, compact and light-weight solution for quantitative characterization and differentiation of single DNA fragments even in field and resource limited settings.
- This simple, field-portable, and cost-effective fluorescent microscopy platform that can be installed on a mobile phone permits direct visualization of individual nucleic acid (e.g., DNA) molecules that are fluorescently labeled over a large FOV of ⁇ 2 mm 2 .
- a robust image processing framework that is integrated with remote processing was also developed to overcome the SNR challenge and allow quantitative length measurements of single DNA molecules imaged on the mobile phone platform, achieving a length accuracy of ⁇ 0.96 kbp and a standard deviation of ⁇ 3.17 kbp when compared to the results of a bench-top fluorescence microscope. High-throughput imaging, length quantification, and differentiation of individual ⁇ and T7 bacteriophage DNA molecules are also demonstrated using the same mobile phone based microscope.
- CNVs copy number variations
- the mobile phone based imaging platform described herein may be used to identify samples having particular copy numbers based on the length of the detected DNA sequences.
- a gene segment of DNA with three (3) copy numbers of a particular gene may appear three times as large as another sample with only a single copy of the gene. This difference can be distinguished using the microscope platform described herein.
- a nucleic sample may be digested by one or more enzymes to cut the DNA in appropriate locations.
- the digested DNA may be fluorescently labeled and then subject to imaging and analysis as described herein.
Abstract
Description
- This application claims priority to U.S. Provisional Patent Application No. 62/263,089 filed on Dec. 4, 2015, which is hereby incorporated by reference in its entirety. Priority is claimed pursuant to 35 U.S.C. §119 and any other applicable statute.
- This invention was made with Government support under 1444240, awarded by the National Science Foundation. The Government has certain rights in the invention.
- The technical field generally relates to imaging methods and devices and more specifically to methods and devices for imaging and measuring single molecules and in particular nucleic acids (e.g., DNA).
- Optical methods for imaging single biomolecules allow for exploration of their individual behavior and properties at the nanoscale level, which not only significantly advances knowledge of molecular biology and biophysics but also provide various diagnostics opportunities for biomedical applications. Imaging of single DNA molecules has been of particular interest as various diseases including cancer and neurological disorders such as Alzheimer's disease are associated with genomic alterations, including for example copy-number variations (CNVs). High spatial resolution and nondestructive nature of optical imaging methods are especially attractive for probing DNA-protein interactions or mapping genetic information from individual DNA molecules. These research and development efforts, however, have been mostly limited to advanced laboratory facilities using relatively costly, complex and bulky imaging set-ups, including for example confocal fluorescence microscopy, super-resolution microscopy, or label-free plasmonic imaging. Translation of these and other existing imaging techniques to field-portable, cost-effective and high-throughput instruments would open up a myriad of new applications in e.g., point-of-care (POC) medicine, global health and diagnostics fields, among others, and would also positively impact research and educational efforts in developing countries and resource-limited institutions, helping the democratization of advanced scientific instruments and measurement tools. To this end, mobile phones and other consumer electronics devices, including e.g., tablet PCs and wearable computers, have been emerging as powerful platforms to create cost-effective, portable and readily accessible alternatives to some of the advanced biomedical imaging and measurement tools. Mobile phones in particular have been experiencing significant advances in their optical imaging hardware, approximately doubling their space-bandwidth product every two years over the last ˜10-15 years, recently reaching to more than 40 million pixels in mobile phone-based digital camera systems. In addition to advanced optical interfaces that are now used in mobile phones, the computational power (now also including Graphics Processing Units, GPUs), data connectivity, massive volume (with >7 billion subscribers) and cost-effectiveness of mobile phones make them an ideal platform for conducting various advanced biomedical experiments and tests, including e.g., blood analysis, measurement of analytes in bodily fluids, flow-cytometry, among various others.
- Despite all of these recent advances and progress, imaging of single DNA molecules on a mobile phone device has not be achieved, leaving it as one of the major remaining milestones in mobile phone based imaging and micro-analysis systems, mostly due to extremely weak signal-to-noise ratio (SNR) and limited contrast of single molecule samples in the optical portion of the electro-magnetic spectrum.
- In one embodiment, a mobile phone-based device for the imaging and length quantification of individual nucleic acid molecules (e.g., DNA) is demonstrated. The device uses a field-portable and cost-effective modular attachment device that is mountable on the housing or body of the mobile phone device. The modular attachment device is mounted to align or integrate with the existing camera of the mobile phone. This modular attachment device, which in some embodiments weighs less than 190 grams (including three AAA batteries), utilizes a compact laser-diode (e.g., 450 nm, 75 mW) to excite fluorescently labeled molecules at a high-incidence angle of ˜75°. The optical path in the modular attachment device includes a thin-film based interference filter located therein to create a very strong dark-field performance; significantly suppressing the background noise created by the high-power excitation beam.
- The modular attachment device, in one embodiment, contains a miniature dovetail stage for depth-of-focus adjustment and a lens (or set of lenses) that is used to form a magnified image of the fluorescent specimen onto the imaging sensor or imaging chip of the mobile phone. The mobile phone includes software or an application “app” that is has a user interface that guides a user through the process operations needed to image single molecules. The user interface also provides a communication platform to transfer the raw images with a custom-designed back-end server that runs software thereon for digital processing of the acquired fluorescent images to rapidly quantify the length of each single molecule or specific sub-regions of the nucleic acid molecules. In one embodiment where the molecule is a nucleic acid strand, the measured fluorescent signatures of the stretched nucleic acid strand is fitted to the mobile phone microscope's two-dimensional (2D) point-spread-function (PSF). The results of the single molecule detection and length measurement process can be visualized on the screen of the mobile phone and, optionally, also through one or more remote computing devices.
- In one embodiment, a method for imaging and sizing fluorescently labeled nucleic acid molecules using a mobile phone includes securing a modular attachment device to the mobile phone with a sample containing stretched, fluorescently labeled nucleic acid molecules. The sample is illuminated with excitation light to cause the fluorescently labeled nucleic acids to emit fluorescent light. One or more images of the fluorescently labeled nucleic acids in the sample are captured using a camera of the mobile phone. The one or more images from the mobile phone are transmitted to a remote computer having at least one processor for image processing and analysis. The one or more images are processed with the at least one processor of the remote computer to generate analysis data of sample, wherein the analysis data includes the lengths of individual nucleic acid molecules or the lengths of specific sub-regions of nucleic acid molecules contained in the sample. The analysis data is received from the remote computer and at least some of the analysis data is displayed on a display of the mobile phone, a laptop, personal computer, or tablet computing device.
- In another embodiment, a method for imaging and sizing fluorescently labeled nucleic acid molecules using a mobile phone includes securing a modular attachment device to the mobile phone with a sample containing stretched, fluorescently labeled nucleic acid molecules. The sample is illuminated with excitation light to cause the fluorescently labeled nucleic acid molecules to emit fluorescent light. One or more images of the fluorescently labeled nucleic acid molecules in the sample are captured using a camera of the mobile phone. The one or more images are processed with at least one processor of the mobile phone to generate analysis data of sample, wherein the analysis data includes the length of nucleic acid molecules or specific sub-regions of nucleic acid molecules contained in the sample. The analysis data is displayed on a display of the mobile phone.
- In another embodiment, a device or system for imaging fluorescently labeled nucleic acid molecules in a sample includes a mobile phone having a camera therein. The device or system includes a modular attachment device configured to mount to the mobile phone and position a fluorescently labeled nucleic acid sample contained therein within a field of view of the camera. The modular attachment device includes an excitation light source; a sample holder configured to hold the sample containing the fluorescently labeled nucleic acid compressed between two optically transparent substrates, wherein fluorescently labeled nucleic acid molecules are stretched or extended in response to a compression force applied to the two optically transparent substrates; a lens or set of lenses for magnifying the image of the sample; a filter interposed between the lens and the camera of the mobile phone and configured to reject scattered background light from the excitation light source and transmit fluorescent light through the filter; and a moveable stage for moving the excitation light source and sample holder relative to the camera of the mobile phone. The mobile phone includes software or an application executed thereon to identify molecules of fluorescently labeled nucleic acid in the sample along with their respective lengths or lengths of sub-regions of the nucleic acid molecules.
-
FIG. 1A illustrates a side view of a modular attachment device configured to mount to the mobile phone. The side of the modular attachment device is cut away to illustrate inner components. -
FIG. 1B illustrates front and back views of a mobile phone device according to one embodiment. -
FIG. 1C illustrates a schematic illustration of the modular attachment device mounted on a mobile phone. The screen or display of the mobile phone illustrates the graphical user interface (GUI) of software or an application for analyzing single molecules (e.g., nucleic acids). -
FIG. 1D illustrates a sample holder and two step method for imparting mechanical shear forces on a pre-stained or pre-dyed sample to stretch or elongate the molecules prior to imaging. -
FIG. 1E illustrates a schematic representation of a system used to analyze the sizing of single molecules using the mobile phone and modular attachment device ofFIGS. 1A and 1B . In this embodiment, a remote computer (e.g., server) is used to perform image processing and analysis to determine the length of molecules of nucleic acid. -
FIG. 2 illustrates a flow chart illustrating the operations used to automatically determine the length of single molecules (e.g., nucleic acid) by image processing software contained in the remote computer ofFIG. 1E (or mobile phone in other embodiments). -
FIGS. 3A-3F illustrate screenshot images illustrating the GUI of the software application running on the mobile phone that is used to acquire images and upload the same to a remote server for processing. Results are returned to the mobile phone where they are displayed to the user on the GUI. -
FIG. 4A illustrates a large field-of-view (FOV) (˜2 mm2) mobile phone image of labeled DNA molecules stretched on a glass substrate. This image is taken at the boundary of the initial DNA droplet placed on the substrate, and it is averaged using thirteen (13) successive mobile phone images and is displayed after background subtraction. The inset (circle) shows a typical FOV corresponding to a 100× objective-lens. The large circular-shaped fluorescent spots that appear in this image are 500 nm green fluorescent polystyrene beads which are added into the sample to assist depth focusing and location matching (for comparison purposes). Scale bar=250 μm. -
FIG. 4B illustrates an enlarged mobile phone image showing single DNA molecules within the box labeled “b” inFIG. 4A . -
FIG. 4C illustrates the corresponding conventional bench-top fluorescence microscope image of the same molecules in region “b” ofFIG. 4B obtained using a 100× oil-immersion objective lens (NA=1.3) and a cooled monochrome CCD camera. Scale bar=10 μm. -
FIG. 4D illustrates an enlarged mobile phone image showing single DNA molecules within the box labeled “d” inFIG. 4A . -
FIG. 4E illustrates the corresponding conventional bench-top fluorescence microscope image of the same molecules in region “d” ofFIG. 4D obtained using a 100× oil-immersion objective lens (NA=1.3) and a cooled monochrome CCD camera. Scale bar=10 μm. -
FIG. 4F illustrates an enlarged mobile phone image showing single DNA molecules within the box labeled “f” inFIG. 4A . -
FIG. 4G illustrates the corresponding conventional bench-top fluorescence microscope image of the same molecules in region “f” ofFIG. 4F obtained using a 100× oil-immersion objective lens (NA=1.3) and a cooled monochrome CCD camera. Scale bar=10 μm. -
FIG. 5A illustrates an image of single λ DNA molecules imaged by the mobile phone-based imaging device. Lines that are superimposed in each image denote the automatically determined length measurements for each DNA strand. Scale bar=10 μm. -
FIG. 5B illustrates an image of same single λ DNA molecules ofFIG. 5A obtained with a conventional bench-top microscope (100× oil-immersion objective-lens, 1.3 NA). -
FIG. 5C illustrates a scatter plot of DNA length measurement obtained by the mobile phone device plotted against the bench-top microscope results. The solid line is a linear fit to the raw data. -
FIG. 5D illustrates a histogram of the distribution of the length measurement differences (Δl) between mobile phone results and conventional microscope results, where the mean error is −0.33 μm and the standard deviation is 1.08 μm. -
FIG. 6A illustrates an image obtained of a 5 kbp segment of DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope. -
FIG. 6B illustrates an image obtained of a 10 kbp segment of DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope. -
FIG. 6C illustrates an image obtained of a 20 kbp segment of DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope. -
FIG. 6D illustrates an image obtained of a 40 kbp segment of T7 DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope. -
FIG. 6E illustrates an image obtained of a 48 kbp segment of λ DNA with the mobile phone based microscope platform (top) along with a comparison image (bottom) of the same segment of DNA obtained using a bench-top fluorescence microscope. -
FIG. 7A illustrates a histogram of measured lengths for a 5 kbp segment of DNA using the mobile phone based microscope platform (top) along with histogram measurements obtained using a bench-top fluorescence microscope (NA=1.3) (bottom). -
FIG. 7B illustrates a histogram of measured lengths for a 10 kbp segment of DNA using the mobile phone based microscope platform (top) along with histogram measurements obtained using a bench-top fluorescence microscope (NA=1.3) (bottom). -
FIG. 7C illustrates a histogram of measured lengths for a 20 kbp segment of DNA using the mobile phone based microscope platform (top) along with histogram measurements obtained using a bench-top fluorescence microscope (NA=1.3) (bottom). -
FIG. 7D illustrates a histogram of measured lengths for a 40 kbp segment of T7 DNA using the mobile phone based microscope platform (top) along with histogram measurements obtained using a bench-top fluorescence microscope (NA=1.3) (bottom). -
FIG. 7E illustrates a histogram of measured lengths for a 48 kbp segment of λ DNA using the mobile phone based microscope platform (top) along with histogram measurements obtained using a bench-top fluorescence microscope (NA=1.3) (bottom). -
FIG. 8A illustrates quantitative SNR analysis of single DNA molecules as a function of the number of mobile phone image frames (n) for image averaging with n=1, 3, 6, 8, and 10. The solid lines are fitted normal distribution functions based on measured histograms. -
FIG. 8B is a graph of SNR as a function of the number of mobile phone image frames (n). The mean SNR of the single DNA images improves proportional to proportional to √{square root over (n)}. -
FIG. 9A illustrates a representative fluorescent image of λ DNA (RGB color scale) obtained using the mobile phone and modular attachment device. -
FIG. 9B illustrates a preliminary object mask generated by using an intensity threshold. -
FIG. 9C illustrates an improved object mask that uses curvature detection algorithm to digitally separate end-to-end conjugated DNA masks (darker arrows) and side-by-side conjugated DNA masks (lighter arrows). -
FIG. 10 illustrates a graph of the mean DNA lengths measured by the mobile phone (triangles) and the bench-top fluorescence microscope. The theoretical length of the fully stretched DNA molecule was calculated based on 0.34 nm per base pair. The full length of the error bar for each data point represents twice the standard deviation of a normal distribution curve that is fitted to the measured DNA length histograms shown inFIGS. 7A-7E . -
FIG. 1A illustrates amodular attachment device 10 that is used in conjunction with amobile phone 100 as also seen inFIGS. 1B and 1C for single molecule imaging and sizing. Themobile phone 100 may include any number of makes and models of mobile phones. Themobile phone 100 includes acamera 102 that is used to obtain images of asample 12 containing the molecules to be imaged when mounted to themodular attachment device 10. Themobile phone 100 includes a display orscreen 104 that is used by the user to display information and interact with themobile phone 100. Themobile phone 100 includes an application orsoftware 106 that is loaded or otherwise executable by themobile phone 100. Thesoftware 106 is used to acquire images of thesample 12 using themodular attachment device 10. In one embodiment, thesoftware 106 may be downloaded from a website or “store” as is typically used with software or applications that run onmobile phones 100. Thesoftware 106 provides a graphical user interface (GUI) through which the user interacts with to acquire images of asample 12 as well as view automatically generated data regarding sizing of molecules within thesample 12 as explained herein. - The
modular attachment device 10 is made to temporarily secure itself to the side of themobile phone 100 that contains thecamera 102. In the embodiment illustrated inFIG. 1A , themodular attachment device 10 is secured to back side of themobile phone 100 so that an optical path (OP) is created between asample 12 that is contained in asample holder 30 that is located inside themodular attachment device 10 and thecamera 102. Thecamera 102 of themobile phone 100 typically includes alens 108 that is positioned adjacent to animage sensor 110 or imaging chip that is contained within thecamera 100. Theimage sensor 110 or imaging chip may include a CCD or CMOS image sensor. Typically, theimage sensor 110 or imaging chip is a color-based sensor that is capable of acquiring color images. - The
modular attachment device 10 can be temporarily secured to the housing or body of themobile phone 100 using one or more clips ortabs 14 that are formed in themodular attachment device 10 as seen inFIG. 1C . The clips ortabs 14 may be flexible or bendable such that themodular attachment device 100 may be easily attached or remoted from themobile phone 100. The dimensions of themodular attachment device 10 may vary depending on the make or model of themobile phone 100. For example, different versions or models of themodular attachment device 10 may be made to accommodate different and shapes ofmobile phones 100. In the experiments described herein, a Lumia 1020, Nokiamobile phone 100 was used. Thecamera lens 108 has a focal length of 6.5 mm (f=6.5 mm). Themodular attachment device 10 may include ahousing 11 that is used to contain the various components of the imaging device as well as thesample 12. Thehousing 11 may be made of a polymer material such as a plastic-based material. Thehousing 11 may be made using any known manufacturing techniques including 3D printing techniques. - With reference to
FIG. 1A , themodular attachment device 10 includes alight source 16 that is used as an excitation light source for fluorescent probes or labels that are present within thesample 12. In one embodiment, thelight source 16 is at least one laser diode (e.g., a 450 nm laser diode) that is powered by driver circuitry contained within themodular attachment device 10 and powered by one orbatteries 17 that are also contained in themodular attachment device 10 and are used to power thelight source 16. Thelight source 16 may also include a light emitting diode (LEDs) or an array of the same. Thelight source 16 is positioned within themodular attachment device 10 to illuminate thesample 12 at an angle of around 75° (with respect to a normal of thecamera 102 along optical path OP). The laserdiode light source 16 emits a laser beam that is focused through a small convex lens (not shown) (f=35 mm) to form a tight illumination spot on thesample holder 30. In the embodiment used in the experiments described herein, the average illumination power density at the sample plane was estimated to be 2.4 W/cm2. To dissipate the heat, the laserdiode light source 16 was mounted on a Φ12×30 mm copper host and further surrounded by a Φ18×40 mm aluminum heat sink. In some embodiments, these may not be needed. Themodular attachment device 10 further included an adjustable stage 20 (e.g., miniature dovetail stage (DT12, Thorlabs)) that is used to move both the sample 12 (via asample holder 30 described below) and the light source 16 (in the z direction as seen inFIG. 1A along the optical path formed between thesample 12 and the camera 102). Movement of theadjustable stage 20 controls focus of the image that is obtained by themobile phone 100. Aknob 22 can be used to adjust the movement of thestage 20 and thus the focus of the device. The focus of themodular attachment device 10 is set using theknob 22 and is generally adjusted to produce infinity focus for both PSF acquisition (using fluorescent beads) and experiments. Themodular attachment device 10 further includes an external lens 24 (f=4 mm) that is used to collect fluorescent signal emitted from thesample 12. Alternatively a set oflenses 24 may be located in themodular attachment device 10 for magnification. One ormore filters 26 loaded in afilter holder 27 are used to permit the passage of fluorescent light emitted from a specimen in the sample while preventing transmission of scattered excitation light. Thefilter holder 27 can be moveable in and out of themodular attachment device 10 such thatdifferent filters 26 can be loaded into thefilter holder 27 as needed. In one embodiment, this may include two (2) stacked 500 nm longpass filters (FF01-500/LP-23.3-D, Semrock) that were placed between theexternal lens 24 and the mobilephone camera lens 108 to reject the scattered background light due to high-power laser excitation. As seen inFIG. 1A , themodular attachment device 10 includes aswitch 28 that is used to turn thelight source 16 on or off. - The
modular attachment device 10 when used with themobile phone 100 enables imaging of fluorescently labeled molecules such as nucleic acid over a large field of view. For example, as described herein, the DNA samples are imaged within a field of view that is around 2 mm2 in size which is much larger than the FOV of a 100× objective lens as seen inFIG. 4A . - The
sample 12 is contained in asample holder 30 as seen inFIG. 1D which is loaded into themodular attachment device 10. In one aspect thesample holder 30 is used to impart shear stress on thesample 12 so as to stretch the molecules contained therein. In one particular example, the sample contains nucleic acid molecules (e.g., DNA) that are labeled with a fluorescent dye or label. In some embodiments, the entire length of the nucleic acid molecule or fragment thereof may be labelled. In other embodiments, a specific sub-region or multiple sub-regions of the nucleic acid molecule may be labelled. For example, a sub-region defining a specific gene or allele can be labeled and imaged. The fluorescent dye or label may emit light at any number of colors or wavelengths depending on the particular dye or label that is used. In the experiments described herein, a fluorescent dye or label was used that emits green colored light although other colored dyes can be used. - The
sample holder 30 may include a first opticallytransparent substrate 30 a such as a silanized glass coverslip onto which thesample 12 containing pre-stained or pre-dyed molecules are placed. A second opticallytransparent substrate 30 b (e.g., plasma treated glass) is placed on top of thefirst substrate 30 a. The top or second opticallytransparent substrate 30 b is then quickly pressed down towards the first opticallytransparent substrate 30 a (e.g., using a tweezer or the like). The droplet containing the stained nucleic acid is pushed from the center of thefirst substrate 30 a to the edges located between the first andsecond substrates first substrate 30 a. As seen inFIG. 1D , thesample holder 30 is then sealed at the edges with a colorless adhesive (e.g., nail polish) and can be placed inside themodular attachment device 10 for imaging. -
FIG. 1E illustrates a schematic representation of one embodiment of asystem 40 used to analyze the sizing of single molecules using themobile phone 100 andmodular attachment device 10 ofFIGS. 1A-1C . In this embodiment, thesystem 40 includes one or moremobile phones 100 that includemodular attachment devices 10 that are secured thereto to imagesamples 12. In this embodiment, aremote computer 42 such as a remote server is used to perform image processing and analysis on image files 50 obtained using themobile phones 100. Theremote computer 42 contains one ormore processors 44 therein that executesoftware 46 loaded or otherwise executed by theremote computer 42 to process and analyze images files 50 that are transferred to theremote computer 42 by the mobile phone(s) 100. Files may be transferred to theremote computer 42 via a wireless network on which themobile phones 100 operate. Files may also be transferred using a WiFi or other connection that links themobile phone 100 to a wide area network such as the Internet. - Using the software or
application 106 contained on themobile phone 100, a user is able to upload animage 50 of thesample 12 to theremote computer 42. Theimage 50 that is transferred may be animage 50 of thesample 12 that has just been acquired or it may be a previously savedimage 50 that is stored on themobile phone 100. Theimage 50 file type may include any number of file types commonly used bymobile phones 100. On particular example is DNG format which can later be converted to TIFF format at theremote computer 42 as described herein. The image is uploaded to theremote computer 42 using HTTP for rapid digital processing by thesoftware 46. Using thesoftware 46 on theremote computer 42, the software rapidly quantifies the length of the molecules in the sample 12 (e.g., each strand of nucleic acid) by fitting the mobile phone's two dimensional (2D) point-spread-function (PSF) (obtained by measuring fluorescent beads or other particles) to the measured fluorescent signatures contained in theimages 50. The results of the analysis can then be transferred back to themobile phone 100 where the results can be displayed to the user on thedisplay 104 of themobile phone 100 using the graphical user interface of the mobile software orapplication 106. - Still referring to
FIG. 1E , one or more additionalremote computers 52 may also be used to visualize the results of the detection and length measurements of single molecules in thesample 12. Theremote computers 52 may include personal computers (PCs), laptops, tablet computing devices, and the like. In this regard, results may be shared with multiple different users beyond themobile phone 100 that is used to run the test. Note that in an alternative embodiment, theimages 50 do not need to be transferred to a second orremote computer 42. Rather, the processor (or multiple processors) contained within themobile phone 100 may process the images and analyze the results. In such an embodiment, there is no need to off-load or transfer images to aremote server 42 or the like. -
FIG. 2 illustrates a flow chart illustrating the operations used to automatically determine the length of single molecules (e.g., nucleic acid) using theimage processing software 46 contained in theremote computer 42 ofFIG. 1E . To measure the lengths of individual molecules imaged on themobile phones 100 using themodular attachment devices 10, the algorithm illustrated inFIG. 2 is used to process images 50 (operation a inFIG. 2 ). This automated length estimation process starts with digital alignment ofmultiple images 50 and then averaging (operation b) ofmultiple fluorescence images 50 recorded on themobile phone 100 using the lossless digital negative (DNG) format, which displays the image in a Bayer pattern without any demosaicing and compression steps. This averaging operation significantly improves the SNR of theimages 50. For example, the mean SNR of single DNA molecules that were imaged in experiments (calculated for over >350 individual DNA strands) increased from 3.8 for a single frame to an SNR of 12.1 for an average of 10 frames (seeFIGS. 8A and 8B ), following an SNR improvement factor that is proportional to the square root of the number of frames (n). In the experiments, 10-15 successive frames were averaged to benefit from this SNR improvement before the effects of photobleaching were observed. - The next operation (operation c in
FIG. 2 ) in the length estimation algorithm involves rejection of all the blue and red pixels in the Bayer pattern such that only the green pixels of the image are kept, improving the spectral overlap with the fluorescent signal band. The resulting green pixel array is then rotated by 45 degrees to form a new image where the pixel period is “effectively” increased by compared to the raw image pixel pitch; this is entirely due to the fact that red and blue pixels of the raw Bayer pattern are not used in the analysis. In some alternative embodiments, one or two colors of pixels remain (e.g., red or blue) and it does not have to be the green pixels as illustrated. In this particular embodiment, the dye that was used with the nucleic acid emitted light in the green color region. Other dyes or stains are possible that emit light in another color (e.g., red or blue). For example, if only the red or blue channels are used, there is no need for rotation of the image array. That is to say, the rotation of the image in operation c is not needed. The next operation (operation d) is the generation of a binary object mask for each molecule; which is automatically implemented by using a curvature detection algorithm to isolate the junctions of overlapping regions/masks due to closely located DNA molecules, significantly improving the overall detection efficiency of DNA strands.FIG. 9A illustrates a representative mobile phone fluorescence image of λ DNA displayed in RGB color scale.FIG. 9B illustrates a preliminary object mask generated by using an intensity threshold.FIG. 9C illustrates an improved masking method that utilizes a curvature detection algorithm to digitally separate end-to-end conjugated DNA masks (darker arrows) or side-by-side conjugated DNA masks (lighter arrows). - The next operation (operation d) of the algorithm is to establish the skeleton of each nucleic molecule through PSF fitting. The PSF of the mobile phone based microscope was previously estimated by averaging the two-dimensional (2D) intensity profiles of 100 nm fluorescent particles (e.g., beads) imaged on the same
mobile phone 100. Obtaining the PSF of the mobile phone-based microscope needs to be done only once for each device. The PSF fitting procedure is initially applied to the short axis of each nucleic molecule to find its center. Note that this fitting process cannot be as accurate as determining the lateral position of a single fluorescent molecule because: (1) the PSF is estimated using 100 nm particles, and (2) there are more than one fluorescent molecule along the short-axis of each DNA strand; however this does not pose a limitation for the current mobile microscopy design and would be important to consider only for platforms that can achieve much smaller sizing accuracy and precision. The peak points of these centers are connected to form a DNA skeleton along the long axis direction. The next operation (operation e) is to find the edges of the DNA strand along its long axis by comparing a PSF-based theoretical edge intensity profile (dashed line inFIG. 2 ), which is calculated by using one-dimensional convolution of the mobile phone PSF with an ideal rectangular function with the measured intensity profile of themobile phone image 50. The PSF-based edge function is digitally moved or slid (sliding PSF inFIG. 2 ) on the nucleic acid skeleton toward both of its ends until a minimum difference between the theoretical and the actual edge functions is observed. The estimated length of the stretched nucleic molecule is then indicated by a curve that connects both of these end points through the calculated skeleton. Operation g inFIG. 2 illustrates a line for the estimated length of the nucleic acid that is superimposed on the calculated nucleic acid skeleton. The line is truncated as compared to the skeleton line formed in operation e due to the minimization process performed using the measured edge intensity and sliding PSF edge function as explained above. For extremely low SNR DNA molecules, where these PSF fitting procedures cannot be successfully applied, the length of the molecule can also be estimated by thresholding the measured DNA intensity profile. -
FIGS. 3A-3F illustrate screenshot images illustrating the GUI of thesoftware application 106 running on themobile phone 100 that is used to acquire images and upload the same to aremote computer 42 for processing and analysis. Results are returned to the mobile phone where they are displayed to the user on the GUI.FIG. 3A illustrates the main menu of the software orapplication 106. In this specific embodiment, the software is used to analyze DNA, although it should be understood that other molecules besides nucleic acids can be visualized using this platform. In the main menu, the user is given the option of capturing an image by running a current test or experiment or selecting a previously obtained image (e.g., from a prior test or experiment). The user also has the option of seeing the history details of prior tests that have been run on the microscope platform.FIG. 3B illustrates a screen shot of a captured or selected fluorescent image that was obtained with the microscope platform. The user is given the option to upload the image to theremote computer 42.FIG. 3C illustrates the GUI displaying to the user that the image is being uploaded and processed by theremote computer 42.FIG. 3D illustrates a notice to is presented to the user to notify the user that image processing has ended.FIG. 3E illustrates a histogram showing the measured lengths of DNA in a sample from a 153.6×153.6 μm2 FOV. The user is also presented with a strand count (in this example 50) as well as a mean length (in this example 16.242 μm).FIG. 3F illustrates a labelled fluorescence image of DNA segmentation that shows each measured DNA molecule. - Methods
- Design of Mobile Phone-Integrated Fluorescence Microscopy.
- A field-portable, mobile phone-based fluorescence microscope was created by integrating a 3D printed modular attachment device to the existing camera housing of a smartphone (Lumia 1020, Nokia). This robust mobile phone attachment was designed in Autodesk Inventor and printed by using a 3D printer (Dimension Elite 3D). A 450 nm laser diode powered by three AAA batteries and a constant current output driver was used as the excitation light, which illuminated the sample at an incidence angle of ˜75°. The laser beam was focused through a small convex lens (f=35 mm) to form a tight illumination spot. The average illumination power density at the sample plane was estimated to be 2.4 W/cm2. To dissipate the heat, the laser diode was mounted on a Φ12×30 mm copper host and further surrounded by a Φ18×40 mm aluminum heat sink. The focus of the mobile phone microscope was controlled by a miniature dovetail stage (DT12, Thorlabs) which moved both the sample chamber and the light source. The fluorescence signal emitted from the specimen was collected though an external lens (f=4 mm) in addition to the built-in mobile phone camera lens (f=6.5 mm), and finally recorded by the mobile phone CMOS sensor chip (pixel pitch: 1.12 μm; image size: 7152×5368 pixels). Two stacked 500 nm longpass filters (FF01-500/LP-23.3-D, Semrock) were placed between the external lens and the mobile phone camera lens to reject the scattered background light due to high-power laser excitation.
- Fluorescence Labeling and Stretching of DNA Molecules.
- Lambda DNA (48,502 b.p., Life Technologies) and T7 DNA (39,937 b.p., Boca Scientific Inc.) were labeled with an intercalating dye YOYO-1 (Excitation/Emission=491/509 nm, Life Technologies) at a base pair to dye molecule ratio of 5:1 following a standard labeling protocol. Both λ and T7 DNA and YOYO-1 were diluted with 1×TAE buffer (40 mM Tris-acetate, 1 mM EDTA, pH 8.3, Life Technologies) to desired concentrations in low-retention DNA tubes (LoBind, Eppendorf). 32 μL of 10 ng/μL DNA was pipetted gently and added into 480 μL of 200 nM YOYO-1 solution. The mixture was incubated for 1 hour at room temperature covered by aluminum foil. The stained DNA solutions (0.6 ng/μL) were stored at 4° C. for future use and stable for at least several weeks.
- Before stretching of DNA molecules, prestained DNA solutions were warmed up at 65° C. for 10 minutes, followed by a quick cooling in running water for 2 minutes to open up the sticky ends of DNA. Then, 5 μL of this pre-labeled DNA solution was diluted in 110 μL imaging buffer (1×TAE buffer added with 4.8% (v/v) 2-mercaptoethonal and 500 nm green fluorescent beads) to a final concentration of ˜0.03 ng/μL.
- Preparation of Substrates for DNA Stretching:
- The DNA stretching substrates were prepared by functionalization of glass coverslips with a mixed layer of silane molecules, which consisted of (3-aminopropyl) triethoxysilane (APTES, Sigma) and allyltrimethoxysilane (ATMS, Sigma).
Standard 22×22 mm coverslips (Fisherbrand) were first rinsed with acetone, isopropanol, methanol, and deionized (DI) water. After air-blow drying, both sides of coverslips were treated with plasma (BD-10AS, Electro-Technic Products, Inc.) for 10 seconds to activate the glass surface with hydroxyl groups. The plasma-treated coverslips were then immersed into a mixture silane solution in acetone (1% APTES, 1% ATMS, v/v) and coated for 10 minutes. The coated coverslips were thoroughly rinsed with acetone and de-ionized (DI) water, and then dried by blown air. - To stretch DNA molecules, the 22×22 mm silanized coverslip was placed on a solid planar surface, and 3 μL of the stained DNA solution diluted in imaging buffer was pipetted onto the center of the coverslip. Another 18×18 mm plasma-treated coverslip was held horizontally which was approximately 1 mm above the bottom coverslip. The top coverslip was then quickly pressed down toward the bottom substrate with a tweezer. The droplet containing the DNA samples was pushed from the center to the edges between the top and bottom coverslips, forming a strong shearing flow, which stretches the DNA molecules on the bottom substrate. The sample was then sealed with colorless nail polish and imaged using the microscopes described herein.
- Image Acquisition.
- The DNA sample of interest, after the preparation steps detailed earlier, was loaded onto the sample holder and inserted into the mobile phone attachment. All the fluorescence images were recorded in a lossless raw format (DNG) with an integration time of ˜4 seconds per frame. About 10-15 frames of the same DNA sample were captured for image averaging, before photobleaching was observed.
- Imaging of DNA Molecules on a Conventional Bench-Top Microscope:
- Glass coverslips with stretched DNA molecules were imaged, for comparison purposes, on an Olympus IX73 inverted microscope with a
UPIanFLN 100× (NA=1.30) oil-immersion objective lens. Samples were excited by a 100 W mercury lamp. Fluorescence images were recorded by a passively cooled monochrome CCD camera (QIClick, QImaging) in 12-bit Tiff format. - Windows® Based Smart Mobile Application Development.
- A custom-developed Windows® mobile phone application was developed that allows for analysis of the lengths of single DNA molecules imaged on the phone. This application can be used to capture an image of the sample or alternatively open a saved image for DNA length measurement. The selected or captured image is subsequently uploaded to a remote server through HTTP for rapid digital processing. On this server, the uploaded image is first converted from DNG format to 16-bit TIFF format and then processed in MATLAB using the length quantification method described previously. It should be understood that the image processing algorithm may be programmed using any number of computer programs. Once the processing is finished, the results (a histogram of DNA length measurements and a corresponding labeled image marking all the locations of analyzed DNA molecules) are then sent back to the originating mobile phone. The processing time for a 200×200 pixel cropped section of the full field-of-view is ˜7 seconds in MATLAB using a single PC (CPU: Intel Xeon ES-2620), and it can be reduced by more than an order of magnitude if the same algorithms are implemented in a more efficient software language such as C/C++ and/or adapted to utilize GPUs. Depending on the network speed, the upload time of the 41 megapixel raw DNG image varies between 10 seconds to 3 minutes.
- Object Mask Generation to Separate Closely Located DNA Molecules:
- A curvature detection algorithm was implemented in the masking method to detect connecting masks from closely located molecules and eventually separate those masks into single masks. The algorithm first smooths the edges of the preliminary object mask that is generated by intensity thresholding with a median filter. Then it automatically recognizes two different types of DNA mask junctions: end-to-end and side-by-side using the overall differences in object width in these two scenarios as seen in
FIG. 9C . For end-to-end DNA junctions, the first derivatives of the mask curvatures along both sides of the long axis of the DNA were calculated to find the peak points. These two peak points were then connected to separate the end-to-end DNA mask (FIG. 9C , darker arrows). For side-by-side DNA junctions, two starting points in the junction area were defined by detecting the number of y coordinates (2 for single objects, 3 for junction points, and 4 for two parallel objects) at each x position. After determining these two starting points, a tracking algorithm was applied to form a continuous separation line between the molecules (FIG. 9C , lighter arrows). - DNA Gel Electrophoresis Experiments:
- 0.6% Agarose gel was prepared with 1×TBE (Tris/Borate/EDTA) buffer and 0.5 μg/ml of ethidium bromide was added for DNA detection under UV illumination. Two samples, 500 ng of λ DNA and T7 DNA, were loaded into the sample wells. For comparison, 1 μg of HindIII digested λ DNA and 1 kb DNA ladder were also loaded on the gel as markers. The gel was run at 40V for 8 hours before imaging.
- Results and Discussion
- In the experiments, mechanical stretching of DNA molecules from coiled form into a linear shape was achieved by quickly compressing a droplet of stained DNA solution (3 μL) in between two coverslips to generate a transient fluid flow. This procedure stretches the DNA fragments by utilizing the strong shear force that is created at the silanized bottom glass substrate.
FIG. 4A illustrates a large field-of-view (FOV) (˜2 mm2) mobile phone image of fluorescently labeled DNA molecules stretched on a glass substrate alongside corresponding images obtained with bench-top microscope having a 100× oil-immersion objective lens (Numerical Aperture, NA=1.3) and a cooled monochrome CCD camera. The region of high-quality DNA stretching surrounds the initial droplet position and forms a ring-shaped band with its width spanning over a few millimeters, which provides a sufficient sample area for imaging of DNA molecules using the mobile phone attachment with a large FOV of ˜2 mm2. - To test single molecule DNA imaging performance of the mobile phone microscope, a double-stranded λ bacteriophage DNA (˜48 kbp) was used. The sample glass substrate with combed DNA molecules of interest was placed within the sample holder and inserted into the modular attachment device that was secured to the mobile phone. Image acquisition for each sample was repeated 10-15 times for the same region of interest with an exposure time of ˜4 seconds per frame; these multiple frames were then averaged to create the final raw fluorescence image of the sample.
FIG. 4A displays one of these fluorescence images captured on the mobile phone device, showing that λ DNA molecules are linearly stretched around the initial droplet position and that the DNA alignment direction is approximately perpendicular to the boundary of the droplet. The mobile phone image inFIG. 4A covers a large FOV of 1.76 mm×1.09 mm, and this is especially advantageous for high-throughput imaging and sizing of a large number of DNA molecules within the same sample.FIGS. 4B, 4D, 4F show selected magnified regions that are denoted with the rectangles inFIG. 4A , which clearly illustrate that the single DNA strands imaged on the mobile phone attachment exhibit a comparable contrast to the images of the same molecules obtained using a 100× oil-immersion objective lens (NA=1.30) and a passively cooled monochrome CCD camera on a conventional bench-top fluorescence microscope (FIGS. 4C, 4E, 4G ). - To measure the respective lengths of the individual DNA molecules imaged on the mobile phone based fluorescence microscopy platform, an algorithm was created as described previously with respect
FIG. 2 . To test the accuracy and precision of the mobile phone-based DNA length measurements, a conventional bench-top fluorescence microscope was used with a 100× oil-immersion objective lens (NA=1.3) and a passively cooled CCD camera as the reference method.FIGS. 5A and 5B illustrate, respectively, zoomed-in regions of the λ DNA sample imaged on the mobile phone platform and a conventional fluorescence microscope and each DNA molecule image is superimposed with a length profile (line) calculated using the computational procedures outlined earlier. As illustrated inFIG. 5C , DNA length values measured on the mobile phone platform are in good agreement with those obtained using the bench-top fluorescence microscope. The mean error for the mobile phone based length measurement results is ˜0.33 μm or ˜0.96 kbp (shorter) compared to bench-top microscope measurements, with a standard deviation of ˜1.08 μm or ˜3.17 kbp (FIG. 5D ). - Experiments were also conducted for differentiating different DNA sequences that are combed, imaged, and measured under the same imaging conditions by using the mobile phone microscopy platform. In these experiments, relatively large molecular weight DNA strands were selected, corresponding to 48.5 kbp (λ DNA) and 39.9 kpb (T7 DNA), where conventional gel electrophoresis methods would not be able to differentiate as well as three shorter DNA fragments (5, 10, and 10 kbp) to demonstrate a broad sizing range.
-
FIGS. 6A-6E illustrate respective images of these single DNA molecules with various lengths imaged by the mobile phone microscopy platform (top row) along with images obtained from a bench-top inverted fluorescence microscope equipped with a 100× objective lens (NA=1.3) and a cooled monochrome CCD camera (bottom row).FIGS. 7A-7E illustrate the length distributions of these different DNA samples quantified by the mobile phone microscopy platform (top row) as well as the conventional fluorescence microscope (bottom row). - The measured number of DNA molecules (N) is significantly less in bench-top microscope measurements compared to the mobile phone results due to much smaller FOV of the 100× objective lens. The average length (L) of the stretched λ DNA and T7 DNA molecules measured using the mobile phone device is 16.31 μm (
FIG. 7E top histogram) and 14.10 μm (FIG. 7D top histogram), respectively, which are in good agreement with 16.64 μm and 14.41 μm that were measured using the conventional bench-top microscope, yielding an average length measurement accuracy of 98.0% and 97.8%, respectively. It should be emphasized that separation and detection of large molecular weight DNA segments are major challenges for conventional gel electrophoresis techniques which work better for small DNA fragments. Gel electrophoresis, for example, cannot distinguish between 48.5 kbp (λ DNA) and 39.9 kpb (T7 DNA). In contradistinction, the mobile phone based microscopy based single DNA imaging approach described herein exhibits better differentiation resolution, especially for large DNA molecules compared to gel electrophoresis methods. Therefore, the mobile phone imaging platform provides a cost-effective, compact and light-weight solution for quantitative characterization and differentiation of single DNA fragments even in field and resource limited settings. - There also was good agreement in the measurement for shorter DNA fragments (20 and 10 kbp) as illustrated in
FIG. 7B andFIG. 7C , yielding an average length measurement accuracy of 96.4% and 96.9% for 20 kbp and 10 kbp DNA samples, respectively, compared to the benchtop microscope measurements. These results, as summarized inFIGS. 7B-7E andFIG. 10 , illustrate that for 10 kbp and longer DNA molecules the mobile-phone platform can achieve an average DNA sizing accuracy of <0.34 μm or <1 kbp. On the other hand, for 5 kbp DNA samples, the average length measured by the mobile-phone based imaging platform was considerably longer compared to the bench-top microscope measurement results as illustrated inFIG. 7A (L=2.76 μm vs. L=1.66 μm, respectively). This length measurement discrepancy for 5 kbp DNA samples can be attributed to the reduced detection SNR for such short DNA fragments as well as to the limited spatial resolution of the mobile-phone, both of which can be substantially improved by e.g., substituting the current external lens in the imaging design with a higher numerical aperture lens. - This simple, field-portable, and cost-effective fluorescent microscopy platform that can be installed on a mobile phone permits direct visualization of individual nucleic acid (e.g., DNA) molecules that are fluorescently labeled over a large FOV of ˜2 mm2. A robust image processing framework that is integrated with remote processing was also developed to overcome the SNR challenge and allow quantitative length measurements of single DNA molecules imaged on the mobile phone platform, achieving a length accuracy of ˜0.96 kbp and a standard deviation of ˜3.17 kbp when compared to the results of a bench-top fluorescence microscope. High-throughput imaging, length quantification, and differentiation of individual λ and T7 bacteriophage DNA molecules are also demonstrated using the same mobile phone based microscope. Further improvements in the image quality and sizing accuracy can also be achieved by using specially designed substrates, including for example plasmonic designs, to significantly increase the fluorescent signal of each molecule through field enhancements. This mobile DNA imaging and sizing platform can be quite useful in various biomedical applications including for example field and POC measurements of copy number variations (CNVs), which might relate to e.g., early detection of cancers, nervous system disorders, and drug resistance in infectious diseases, among many others. For example, certain cancers and genetic disorders can be diagnosed or identified based on the number of copies of a particular gene or DNA sequence. The mobile phone based imaging platform described herein may be used to identify samples having particular copy numbers based on the length of the detected DNA sequences. For instance, a gene segment of DNA with three (3) copy numbers of a particular gene may appear three times as large as another sample with only a single copy of the gene. This difference can be distinguished using the microscope platform described herein. For such uses, a nucleic sample may be digested by one or more enzymes to cut the DNA in appropriate locations. The digested DNA may be fluorescently labeled and then subject to imaging and analysis as described herein.
- While embodiments of the present invention have been shown and described, various modifications may be made without departing from the scope of the present invention. For example, features or aspects of one embodiment may be incorporated in other embodiments even if not specifically identified as being substitutable. In addition, while certain embodiments have focused on using green colored fluorescent light for imaging of nucleic acids, other colored dyes or stains may also be used. The following publication, Wei et al., Imaging and Sizing of Single DNA Molecules on a Mobile Phone, ACS Nano, Vol. 8, No. 12, pp. 12725-12733 (Dec. 10, 2014) is incorporated by reference as if set forth fully herein. The invention, therefore, should not be limited, except to the following claims, and their equivalents.
Claims (19)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US15/368,420 US10248838B2 (en) | 2015-12-04 | 2016-12-02 | Method and device for single molecule imaging |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US201562263089P | 2015-12-04 | 2015-12-04 | |
US15/368,420 US10248838B2 (en) | 2015-12-04 | 2016-12-02 | Method and device for single molecule imaging |
Publications (2)
Publication Number | Publication Date |
---|---|
US20170160197A1 true US20170160197A1 (en) | 2017-06-08 |
US10248838B2 US10248838B2 (en) | 2019-04-02 |
Family
ID=58798394
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US15/368,420 Active 2037-02-27 US10248838B2 (en) | 2015-12-04 | 2016-12-02 | Method and device for single molecule imaging |
Country Status (1)
Country | Link |
---|---|
US (1) | US10248838B2 (en) |
Cited By (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN107917905A (en) * | 2017-12-29 | 2018-04-17 | 山东师范大学 | Ratio-type photometric analysis device and its detection method based on intelligent terminal |
US10248838B2 (en) | 2015-12-04 | 2019-04-02 | The Regents Of The University Of California | Method and device for single molecule imaging |
CN110378185A (en) * | 2018-04-12 | 2019-10-25 | 北京图森未来科技有限公司 | A kind of image processing method applied to automatic driving vehicle, device |
US10795315B2 (en) | 2016-05-11 | 2020-10-06 | The Regents Of The University Of California | Method and system for pixel super-resolution of multiplexed holographic color images |
US10838192B2 (en) | 2016-05-10 | 2020-11-17 | The Regents Of The University Of California | Method and device for high-resolution color imaging using merged images from holographic and lens-based devices |
CN113805326A (en) * | 2021-09-18 | 2021-12-17 | 吉林大学 | In-situ stretching multi-photon laser confocal imager and method for real-time in-situ three-dimensional observation of internal structure of blended polymer |
US11222415B2 (en) | 2018-04-26 | 2022-01-11 | The Regents Of The University Of California | Systems and methods for deep learning microscopy |
US11262286B2 (en) | 2019-04-24 | 2022-03-01 | The Regents Of The University Of California | Label-free bio-aerosol sensing using mobile microscopy and deep learning |
US11320362B2 (en) | 2016-09-23 | 2022-05-03 | The Regents Of The University Of California | System and method for determining yeast cell viability and concentration |
US20220283443A1 (en) * | 2019-08-06 | 2022-09-08 | Purdue Research Foundation | Pinpointing single molecule positions with in situ point spread function retrieval for three dimensional nanoscopy of whole cells and tissues |
US11460395B2 (en) | 2019-06-13 | 2022-10-04 | The Regents Of The University Of California | System and method for measuring serum phosphate levels using portable reader device |
US11501544B2 (en) | 2018-06-04 | 2022-11-15 | The Regents Of The University Of California | Deep learning-enabled portable imaging flow cytometer for label-free analysis of water samples |
US11514325B2 (en) | 2018-03-21 | 2022-11-29 | The Regents Of The University Of California | Method and system for phase recovery and holographic image reconstruction using a neural network |
US11893779B2 (en) | 2018-10-18 | 2024-02-06 | The Regents Of The University Of California | Device and method for motility-based label-free detection of motile objects in a fluid sample |
Family Cites Families (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
EP2461131B1 (en) | 2005-03-17 | 2017-08-09 | The Board of Trustees of The Leland Stanford Junior University | Apparatus and method for frequency-domain optical coherence tomography |
WO2011049965A1 (en) | 2009-10-20 | 2011-04-28 | The Regents Of The University Of California | Incoherent lensfree cell holography and microscopy on a chip |
US9331113B2 (en) | 2010-05-03 | 2016-05-03 | The Regents Of The University Of California | Wide-field lensless fluorescent imaging on a chip |
WO2012054351A2 (en) | 2010-10-18 | 2012-04-26 | The Regents Of The University Of California | Microscopy method and system incorporating nanofeatures |
US9767341B2 (en) | 2010-12-14 | 2017-09-19 | The Regents Of The University Of California | Method and device for holographic opto-fluidic microscopy |
US9057702B2 (en) | 2010-12-21 | 2015-06-16 | The Regents Of The University Of California | Compact wide-field fluorescent imaging on a mobile device |
KR20130131408A (en) | 2010-12-21 | 2013-12-03 | 더 리전트 오브 더 유니버시티 오브 캘리포니아 | Compact wide-field fluorescent imaging on a mobile device |
KR20140039151A (en) | 2011-01-06 | 2014-04-01 | 더 리전트 오브 더 유니버시티 오브 캘리포니아 | Lens-free tomographic imaging devices and methods |
US8866063B2 (en) | 2011-03-31 | 2014-10-21 | The Regents Of The University Of California | Lens-free wide-field super-resolution imaging device |
US20140160236A1 (en) | 2011-07-29 | 2014-06-12 | The Regents Of The University Of California | Lensfree holographic microscopy using wetting films |
US9715099B2 (en) | 2011-11-07 | 2017-07-25 | The Regents Of The University Of California | Maskless imaging of dense samples using multi-height lensfree microscope |
PL2812675T3 (en) | 2012-02-06 | 2021-12-13 | The Regents Of The University Of California | Portable rapid diagnostic test reader |
WO2013184835A1 (en) | 2012-06-07 | 2013-12-12 | The Regents Of The University Of California | Wide-field microscopy using self-assembled liquid lenses |
US9588037B2 (en) | 2012-07-13 | 2017-03-07 | The Regents Of The University Of California | High throughput lens-free three-dimensional tracking of sperm |
US20140120563A1 (en) | 2012-10-29 | 2014-05-01 | The Regents Of The University Of California | Allergen testing platform for use with mobile electronic devices |
WO2015017046A1 (en) | 2013-07-31 | 2015-02-05 | The Regents Of The University Of California | Fluorescent imaging using a flatbed scanner |
WO2015074001A1 (en) * | 2013-11-17 | 2015-05-21 | Quantum-Si Incorporated | Optical system and assay chip for probing, detecting and analyzing molecules |
WO2015108820A1 (en) | 2014-01-14 | 2015-07-23 | The Regents Of The University Of California | Method and device for detection and spatial mapping of mercury concentration in water samples |
WO2016019324A2 (en) | 2014-08-01 | 2016-02-04 | The Regents Of The University Of California | Device and method for iterative phase recovery based on pixel super-resolved on-chip holography |
US20160070092A1 (en) * | 2014-09-04 | 2016-03-10 | The Regents Of The University Of California | Method and device for fluorescent imaging of single nano-particles and viruses |
WO2016106215A1 (en) | 2014-12-23 | 2016-06-30 | The Regents Of The University Of California | Method and device for quantification of plant chlorophyll content |
WO2016118884A1 (en) | 2015-01-22 | 2016-07-28 | The Regents Of The University Of California | Device and method for nanoparticle sizing based on time-resolved on-chip microscopy |
US10088663B2 (en) | 2015-05-13 | 2018-10-02 | The Regents Of The University Of California | Device and method for tunable vapor condensed nanolenses |
EP3311163B1 (en) | 2015-06-19 | 2020-08-05 | The Regents of the University of California | Micro-plate reader for elisa testing |
US10248838B2 (en) | 2015-12-04 | 2019-04-02 | The Regents Of The University Of California | Method and device for single molecule imaging |
US20170168285A1 (en) | 2015-12-14 | 2017-06-15 | The Regents Of The University Of California | Systems and methods for image reconstruction |
-
2016
- 2016-12-02 US US15/368,420 patent/US10248838B2/en active Active
Cited By (18)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US10248838B2 (en) | 2015-12-04 | 2019-04-02 | The Regents Of The University Of California | Method and device for single molecule imaging |
US10838192B2 (en) | 2016-05-10 | 2020-11-17 | The Regents Of The University Of California | Method and device for high-resolution color imaging using merged images from holographic and lens-based devices |
US11397405B2 (en) | 2016-05-11 | 2022-07-26 | The Regents Of The University Of California | Method and system for pixel super-resolution of multiplexed holographic color images |
US10795315B2 (en) | 2016-05-11 | 2020-10-06 | The Regents Of The University Of California | Method and system for pixel super-resolution of multiplexed holographic color images |
US11320362B2 (en) | 2016-09-23 | 2022-05-03 | The Regents Of The University Of California | System and method for determining yeast cell viability and concentration |
CN107917905A (en) * | 2017-12-29 | 2018-04-17 | 山东师范大学 | Ratio-type photometric analysis device and its detection method based on intelligent terminal |
US11514325B2 (en) | 2018-03-21 | 2022-11-29 | The Regents Of The University Of California | Method and system for phase recovery and holographic image reconstruction using a neural network |
US11010874B2 (en) | 2018-04-12 | 2021-05-18 | Tusimple, Inc. | Images for perception modules of autonomous vehicles |
CN110378185A (en) * | 2018-04-12 | 2019-10-25 | 北京图森未来科技有限公司 | A kind of image processing method applied to automatic driving vehicle, device |
US11694308B2 (en) | 2018-04-12 | 2023-07-04 | Tusimple, Inc. | Images for perception modules of autonomous vehicles |
US11222415B2 (en) | 2018-04-26 | 2022-01-11 | The Regents Of The University Of California | Systems and methods for deep learning microscopy |
US11501544B2 (en) | 2018-06-04 | 2022-11-15 | The Regents Of The University Of California | Deep learning-enabled portable imaging flow cytometer for label-free analysis of water samples |
US11893779B2 (en) | 2018-10-18 | 2024-02-06 | The Regents Of The University Of California | Device and method for motility-based label-free detection of motile objects in a fluid sample |
US11262286B2 (en) | 2019-04-24 | 2022-03-01 | The Regents Of The University Of California | Label-free bio-aerosol sensing using mobile microscopy and deep learning |
US11460395B2 (en) | 2019-06-13 | 2022-10-04 | The Regents Of The University Of California | System and method for measuring serum phosphate levels using portable reader device |
US20220283443A1 (en) * | 2019-08-06 | 2022-09-08 | Purdue Research Foundation | Pinpointing single molecule positions with in situ point spread function retrieval for three dimensional nanoscopy of whole cells and tissues |
US11960102B2 (en) * | 2019-08-06 | 2024-04-16 | Purdue Research Foundation | Pinpointing single molecule positions with in situ point spread function retrieval for three dimensional nanoscopy of whole cells and tissues |
CN113805326A (en) * | 2021-09-18 | 2021-12-17 | 吉林大学 | In-situ stretching multi-photon laser confocal imager and method for real-time in-situ three-dimensional observation of internal structure of blended polymer |
Also Published As
Publication number | Publication date |
---|---|
US10248838B2 (en) | 2019-04-02 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10248838B2 (en) | Method and device for single molecule imaging | |
Wei et al. | Imaging and sizing of single DNA molecules on a mobile phone | |
US10830639B2 (en) | Devices, methods, and systems relating to super resolution imaging | |
CN107077732B (en) | System and method for calculating focus variation for digital microscope | |
Han et al. | Imaging cells in flow cytometer using spatial-temporal transformation | |
US7408176B2 (en) | System and method employing photokinetic techniques in cell biology imaging applications | |
US10930061B2 (en) | Three-dimensional image processing to locate nanoparticles in biological and nonbiological media | |
RU2010134422A (en) | METHOD AND DEVICE FOR ANALYSIS OF PARTICLES IN A LIQUID SAMPLE | |
JP6395251B2 (en) | Optical microscope system and screening device | |
JP6605716B2 (en) | Automatic staining detection in pathological bright field images | |
JP2018512609A (en) | Method, system and apparatus for automatically focusing a microscope on a substrate | |
WO2017193700A1 (en) | Imaging device and method for quickly acquiring large-sample three-dimensional structure information and molecular phenotype information | |
JP7068354B2 (en) | System level calibration | |
US10921252B2 (en) | Image processing apparatus and method of operating image processing apparatus | |
CN107389534A (en) | A kind of unicellular photodetector system based on one-dimensional nano structure probe | |
JP6105061B2 (en) | Apparatus, system and method for normalizing images using Gaussian fit residual selection criteria | |
JP2006275771A (en) | Cell image analyzer | |
WO2021148465A1 (en) | Method for outputting a focused image through a microscope | |
Sami et al. | AQAFI: a bioanalytical method for automated KPIs quantification of fluorescent images of human leukocytes and micro–nano particles | |
De Mey et al. | Fast 4D microscopy | |
US8963105B2 (en) | Image obtaining apparatus, image obtaining method, and image obtaining program | |
Nieman et al. | Hyperspectral imaging system for quantitative identification and discrimination of fluorescent labels in the presence of autofluorescence | |
RU200805U1 (en) | Fluorescent Biochip Analyzer | |
KR101188233B1 (en) | A diagnosis apparatus for biochip | |
Koerfer et al. | Measuring lipid dynamics and packing with minflux microscopy |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: THE REGENTS OF THE UNIVERSITY OF CALIFORNIA, CALIF Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:OZCAN, AYDOGAN;WEI, QINGSHAN;LUO, WEI;REEL/FRAME:041164/0494 Effective date: 20161202 |
|
AS | Assignment |
Owner name: NATIONAL SCIENCE FOUNDATION, VIRGINIA Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF CALIFORNIA, LOS ANGELES;REEL/FRAME:041245/0201 Effective date: 20161213 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
MAFP | Maintenance fee payment |
Free format text: PAYMENT OF MAINTENANCE FEE, 4TH YR, SMALL ENTITY (ORIGINAL EVENT CODE: M2551); ENTITY STATUS OF PATENT OWNER: SMALL ENTITY Year of fee payment: 4 |