US20180267284A1 - High-speed laser scanning microscopy platform for high-throughput automated 3d imaging and functional volumetric imaging - Google Patents

High-speed laser scanning microscopy platform for high-throughput automated 3d imaging and functional volumetric imaging Download PDF

Info

Publication number
US20180267284A1
US20180267284A1 US15/547,615 US201615547615A US2018267284A1 US 20180267284 A1 US20180267284 A1 US 20180267284A1 US 201615547615 A US201615547615 A US 201615547615A US 2018267284 A1 US2018267284 A1 US 2018267284A1
Authority
US
United States
Prior art keywords
laser scanning
imaging
scanning system
clock signal
image
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US15/547,615
Other languages
English (en)
Inventor
Adela Ben-Yakar
Ki Hyun Kim
Evan Hegarty
Sertan Kutal Gokce
Sudip Mondal
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Texas System
Original Assignee
University of Texas System
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by University of Texas System filed Critical University of Texas System
Priority to US15/547,615 priority Critical patent/US20180267284A1/en
Assigned to NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT reassignment NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF HEALTH AND HUMAN SERVICES (DHHS), U.S. GOVERNMENT CONFIRMATORY LICENSE (SEE DOCUMENT FOR DETAILS). Assignors: UNIVERSITY OF TEXAS, AUSTIN
Assigned to BOARD OF REGENTS, THE UNIVERSITY OF TEXAS SYSTEM reassignment BOARD OF REGENTS, THE UNIVERSITY OF TEXAS SYSTEM ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: BEN-YAKAR, ADELA, GOKCE, Sertan Kutal, HEGARTY, Evan, KIM, KI HYUN, MONDAL, SUDIP
Publication of US20180267284A1 publication Critical patent/US20180267284A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/008Details of detection or image processing, including general computer control
    • G02B21/0084Details of detection or image processing, including general computer control time-scale detection, e.g. strobed, ultra-fast, heterodyne detection
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0036Scanning details, e.g. scanning stages
    • G02B21/0048Scanning details, e.g. scanning stages scanning mirrors, e.g. rotating or galvanomirrors, MEMS mirrors
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/0076Optical details of the image generation arrangements using fluorescence or luminescence
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/008Details of detection or image processing, including general computer control
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/0088Inverse microscopes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T15/003D [Three Dimensional] image rendering
    • G06T15/08Volume rendering
    • HELECTRICITY
    • H01ELECTRIC ELEMENTS
    • H01SDEVICES USING THE PROCESS OF LIGHT AMPLIFICATION BY STIMULATED EMISSION OF RADIATION [LASER] TO AMPLIFY OR GENERATE LIGHT; DEVICES USING STIMULATED EMISSION OF ELECTROMAGNETIC RADIATION IN WAVE RANGES OTHER THAN OPTICAL
    • H01S3/00Lasers, i.e. devices using stimulated emission of electromagnetic radiation in the infrared, visible or ultraviolet wave range
    • H01S3/10Controlling the intensity, frequency, phase, polarisation or direction of the emitted radiation, e.g. switching, gating, modulating or demodulating
    • H01S3/101Lasers provided with means to change the location from which, or the direction in which, laser radiation is emitted

Definitions

  • a confocal laser scanning microscope uses a light beam (e.g., a laser beam) to image a sample. For example, the microscope focuses the light beam on a spot within a plane of the sample. It then scans the light beam across the plane of the sample. In order to capture a volumetric image, the microscope focuses the light beam on and scans the light beam across planes of the sample at various depths.
  • a light beam e.g., a laser beam
  • the latest resonant confocal microscope from NIKON CORP. of Tokyo, Japan provides only 128, 256, and 512 pixels per line.
  • the resonant confocal microscopes described in Sanderson, M. J. et al., Video-rate confocal microscopy. Methods in Enzymology, 360, 447-481 (2003) allow users to choose 128, 256, 512, and 1024 lines per image, and 128, 256, 512, and 1024 pixels per line, again due to the limitations in their hardware that synchronizes the scanners with the data acquisition.
  • a high-speed laser scanning microscope is described herein.
  • the laser scanning microscope can provide ultrafast imaging speed, a large field-of-view, and flexible control over the size of the field-of-view (“FOV”) and over the available large number of pixels for images.
  • FOV field-of-view
  • the above characteristics make the laser scanning microscope described herein ideal for high-throughput, automated, 3D imaging of biological specimens. It can especially be useful to image specimens with high aspect ratios since it is possible to choose a large size of the FOV in the long direction and any pixel numbers independently.
  • the imaging system can provide ultrafast, high-resolution imaging of living small animal models.
  • the microscope can follow-up regeneration in small animal model, Caenorhabditis elegans (“ C. elegans ”), after neuronal injuries and perform time-lapse volumetric imaging of calcium response dynamics of C. elegans neurons at the speeds that are not possible in any other existing optical imaging modality.
  • C. elegans Caenorhabditis elegans
  • the described synchronization technique is suitable for fast 3D imaging of most specimens in the fluorescence mode or scattering mode or reflectance mode and can be applied to any linear (e.g., confocal, OCT) or non-linear (two-photon, harmonic generations, etc.) imaging modalities.
  • linear e.g., confocal, OCT
  • non-linear two-photon, harmonic generations, etc.
  • the laser scanning system can include a light source configured to emit a light beam for illuminating the specimen, a scanning unit including a plurality of reflectors, where a first reflector scans the light beam along a first axis and a second reflector scans the light beam along a second axis, and a data acquisition unit configured to control acquisition of the image of the specimen.
  • the laser scanning system can also include a control circuit configured to receive a reference clock signal for the first reflector and generate a synchronization clock signal based on the reference clock signal. Additionally, the laser scanning system can include a synchronization controller configured to control the scanning unit and the data acquisition unit.
  • the synchronization controller can be configured to receive the synchronization clock signal, receive a plurality of imaging parameters, and generate a plurality of control signals based on the synchronization clock signal and the imaging parameters.
  • a first control signal synchronizes operation of the first and second reflectors of the scanning unit, and a second control signal synchronizes operation of the scanning unit and the data acquisition unit.
  • the control circuit can be further configured to generate an enhanced reference clock signal from the reference clock signal, and generate the synchronization clock signal from the enhanced reference clock signal.
  • generating the enhanced reference clock signal can include at least one of filtering, regulating the voltage of, suppressing fluctuation of, or supplying current to the reference clock signal.
  • the control circuit can include a frequency doubler circuit for generating the synchronization clock signal.
  • the imaging parameters can include at least one of a number of lines in the image, a number of pixels per line in the image, or a field of view.
  • the imaging parameters can further include at least one of a translational device movement range or a number of translational device movement steps.
  • the field of view can include a horizontal scan range and a vertical scan range.
  • Respective periods of the first and second control signals can be approximately equal to one another.
  • a period of the first control signal can be variable based on the number of lines in the image.
  • a period of the second control signal can be variable based on the number of lines in the image.
  • the respective periods of the first and second control signals can be equal to a period of the synchronization clock signal times the number of lines in the image plus 1.
  • an amplitude (or a maximum voltage level) of the first control signal can be variable based on the field of view. Additionally, a level of the first control signal can increase incrementally after each cycle of the synchronization clock signal to the amplitude before returning to a minimum level.
  • the laser scanning system can further include a translational device for supporting the specimen.
  • the translational device can be configured to move along a third axis.
  • the plurality of control signals can include a third control signal for synchronizing operation of the scanning unit, the data acquisition unit, and the translational device.
  • the third control signal can be synchronized with the first and second control signals. Additionally, a period of the third control signal can be variable based on the number of translational device movement steps. For example, the period of the third control signal can be equal to a period of the second control signal times the number of translational device movement steps.
  • an amplitude of the third control signal can be variable based on the translational device movement range. Additionally, a level of the third control signal can increase incrementally after each cycle of the second control signal to the amplitude before returning to a minimum level.
  • the synchronization controller can be configured to generate a fourth control signal for controlling operation for the first reflector.
  • An amplitude of the fourth control signal can be variable based on the field of view.
  • the laser scanning system can be at least one of a confocal laser scanning microscope, a multi-photon laser scanning microscope, or an optical coherence tomography.
  • the control unit can include a control circuit and a synchronization controller.
  • the control circuit can be configured to receive a reference clock signal for the first reflector and generate a synchronization clock signal based on the reference clock signal.
  • the synchronization controller can be configured to control the scanning unit and the data acquisition unit.
  • the synchronization controller can be configured to receive the synchronization clock signal, receive a plurality of imaging parameters, and generate a plurality of control signals based on the synchronization clock signal and the imaging parameters.
  • a first control signal synchronizes operation of the first and second reflectors of the scanning unit, and a second control signal synchronizes operation of the scanning unit and the data acquisition unit.
  • a computer-implemented method for controlling a laser scanning system is also described herein.
  • the method can include receiving a synchronization clock signal, where the synchronization clock signal is based on a reference clock signal for a resonant mirror of me laser scanning system, receiving a plurality of imaging parameters, and generating a plurality of control signals based on the synchronization clock signal and the imaging parameters.
  • a first control signal synchronizes operation of the resonant mirror and a galvanometric mirror of the laser scanning system
  • a second control signal synchronizes operation of the resonant and galvanometric mirrors and a data acquisition unit of the laser scanning system.
  • a microfluidic device for manipulating, housing, and trapping a plurality of specimens for surgery or imaging is also described herein.
  • the microfluidic device can include an inlet for receiving the specimens, an outlet in fluid connection with the inlet, a plurality of immobilization channels extending between the inlet and the outlet, and a perfusion compartment can be arranged between the inlet and the immobilization channels.
  • Each of the immobilization channels can include a plurality of sections, where each respective section has at least one of a different width or height as compared to the other sections.
  • each respective section can have a different width and a different height as compared to the other sections.
  • each of the immobilization channels can include at least three sections.
  • each of the immobilization channels can be configured to immobilize and orient at least one of the specimens.
  • the immobilization channels can extend in a direction between the inlet and the outlet, a width of each of the immobilization channels decreasing in the direction extending between the inlet and the outlet. Alternatively or additionally, a height of each of the immobilization channels can decrease in the direction extending between the inlet and the outlet.
  • the immobilization channels can be arranged substantially in parallel to each other, the immobilization channels reducing net hydraulic resistance for the microfluidic device.
  • the immobilization channels can be arranged with approximately equal spacing between adjacent immobilization channels.
  • the inlet and outlet can be configured to allow a pressure gradient to be created across the immobilization channels.
  • the microfluidic device can include a plurality of outlets, where a first outlet is in fluid connection with a first subset of the immobilization channels and a second outlet is in fluid connection with a second subset of the immobilization channels.
  • the microfluidic device can include a perfusion inlet and a perfusion outlet in fluid connection with the perfusion compartment.
  • the microfluidic device can include a sieve structure arranged between the perfusion compartment and at least one of the perfusion inlet or the perfusion outlet.
  • the microfluidic device can include an inlet for receiving the specimens, an outlet in fluid connection with the inlet, and a plurality of immobilization channels extending between the inlet and the outlet.
  • Each of the immobilization channels can include a plurality of sections, where each respective section has at least one of a different width or height as compared to the other sections.
  • a computer-implemented method for imaging of a plurality of specimens trapped within a microfluidic device is also described herein.
  • the method can include receiving a low-magnification image of the microfluidic device with the specimens trapped therein, creating an intensity profile of the low-magnification image, where the intensity profile includes a respective peak intensity pixel value for each row of the low-magnification image, and using the intensity profile, segmenting the low-magnification image into a plurality of segments, where each of the segments includes a respective specimen.
  • the method can also include, for each respective segment, identifying a feature of interest of the respective specimen and determining a center location of the feature of interest, and generating a translational moving sequence for high-magnification imaging based on the center location of the feature of interest of each respective specimen.
  • the feature of interest can be identified based on a plurality of highest intensity pixel values within the respective segment.
  • the low-magnification image can be a fluorescent image.
  • the method can include driving a translational device that supports the microfluidic device based on the translational moving sequence, and acquiring a high-magnification volumetric image of each of the specimens.
  • a magnification of the high-magnification volumetric image is at least 5 times greater than a magnification of the low-magnification image.
  • the highest intensity pixel values within the respective segment can include the three highest intensity pixel values.
  • the method can further include calculating respective distances between pairs of the highest intensity pixel values, and comparing the respective distances between the pairs of the highest intensity pixel values.
  • the feature of interest can be identified by a pair of the highest intensity pixel values having a smallest calculated distance. Additionally, the center location of the feature of interest can be determined from the pair of the highest intensity pixel values having the smallest calculated distance.
  • the method can include applying a moving average filter to the low-magnification image, where the intensity profile is created from the filtered low-magnification image.
  • the method can include disregarding at least one of the peak intensity pixel values having a value less than a threshold value.
  • the threshold value can be approximately 30% of an average peak intensity pixel value.
  • FIG. 1( a ) is a schematic diagram illustrating an example confocal laser scanning microscope.
  • FIG. 1( b ) is a block diagram of a control unit for controlling operations of the example confocal laser scanning microscope.
  • FIGS. 2( a )-2( d ) illustrate various control and synchronization signals generated by an example synchronization controller described herein.
  • the control and synchronization signals include the electrical voltage signals generated by the multifunction DAQ 112 shown in FIG. 1( b ) .
  • FIG. 2( a ) illustrates the frequency doubling from RR to LT, as well as the voltage level (or height) of GC incrementally increasing with each cycle of LT.
  • FIG. 2( b ) illustrates one period of FT and GC synchronized with RR and LT.
  • FIG. 2( c ) illustrates the voltage level (or height) of PC incrementally increasing with each period of FT and GC.
  • FIGS. 2( a )-2( d ) illustrates one period of PC synchronized with FT and GC.
  • Nline is equal to 23
  • Nstep is equal to 10.
  • one period of FT and GC is equal to 24 periods of LT
  • one period of PC is equal to 240 periods of LT (or 10 periods of FT).
  • FIGS. 3( a )-3( b ) illustrate the point spread function graphs of the example confocal laser scanning microscope described with reference to FIGS. 1( a )-1( b ) .
  • FIG. 3( a ) illustrates the lateral resolution.
  • FIG. 3( b ) illustrates the axial resolution.
  • FIG. 4 illustrates the maximum intensity projection of a high-resolution confocal 3D image taken by the example confocal laser scanning microscope described with reference to FIGS. 1( a )-1( b ) .
  • the field-of-view is 150 um ⁇ 50 um, and the pixel number is 3000 ⁇ 1000.
  • FIGS. 5( a )-5( e ) illustrate a microfluidic device for C. elegans immobilization and stimulus delivery for calcium imaging.
  • FIG. 5( a ) is a schematic of the device for C. elegans immobilization (e.g., through inlet SIN and outlet W OUT ) in an anesthetic free environment for high-resolution volumetric imaging of calcium responses.
  • FIG. 5( b ) illustrates an enlarged view of the trapping area 501 with a schematic of a C. elegans oriented with its head upward for chemical delivery channel
  • FIG. 5( c ) is a graph illustrating the stimulus delivery process tested using fluorescein and response from a single neuron fluorescence intensity for calcium response.
  • FIG. 5( d ) are fluorescence images of single ASH neuron from CX6632 animal when exposed to 1M glycerol.
  • FIG. 5( e ) are fluorescence images of ZIM294 animal when exposed to 1M glycerol stimulus. The fluorescence images were acquired using a CCD camera. Scale bar in FIG. 5( e ) is 10 mm.
  • FIGS. 6( a )-6( b ) illustrate a microfluidic device for use trapping a plurality of specimens for surgery or imaging.
  • FIGS. 7( a )-7( g ) illustrate an example valve sequence used with the parallel microfluidic device shown in FIGS. 6( a )-6( b ) .
  • FIG. 8 is a flow chart illustrating a high-throughput automated imaging work flow.
  • FIG. 9 is a chart comparing the imaging speed of the confocal laser scanning imaging platform described herein to state-of-the-art commercial laser scanning confocal microscopes (Nikon A1R+ and Zeiss LSM780).
  • FIGS. 10( a )-10( b ) are two sample images of the ALM axons.
  • FIG. 10( a ) shows a reconnected axon
  • FIG. 10( b ) shows non-reconnected axon.
  • FIG. 11 is a block diagram of an example computing device.
  • FIG. 12 illustrates an example fluorescent image of the whole animal immobilized inside an example microfluidic device described herein.
  • the image is a maximum intensity z projection of fluorescent confocal images of a whole L4 C. elegans animal.
  • the whole animal is successfully accommodated in the field-of-view of 630 ⁇ 150 ⁇ m 2 inside the microfluidic device.
  • the scale bar is 50 ⁇ m.
  • FIGS. 13( a )-13( b ) illustrate the intensity dynamics of neuronal responses to +10 mM NaCl stimulus.
  • FIG. 13( a ) illustrates a set of 24 neurons, which are annotated in the whole animal labeled with NLS::GCaMP and exposed to +10 mM NaCl stimulus for a 30 second period. The annotation numbers increase from the head to the tail from 1, n1 to 18, n6. Neurons 1-18 are responsive, and neurons n1-n6 are non-responsive.
  • FIG. 13( b ) illustrates the intensity dynamics plots of the neurons' responses over total time of 240 seconds. The +10 mM NaCl stimulus is applied at 120 second mark for 30 seconds as represented by the gray shade in the plot. The intensity dynamics are normalized by the minimum intensity level of each neuron.
  • FIG. 1( a ) a schematic diagram illustrating an example confocal laser scanning microscope 100 is shown.
  • the confocal laser scanning microscope 100 shows the fastest imaging speed compared to any other laser scanning confocal and multi-photon microscopes.
  • a confocal laser scanning microscope uses a light beam (e.g., a laser beam) to image a sample C. elegans, which is also referred to herein as a “worm”).
  • the confocal laser scanning microscope 100 can include an excitation light source 102 configured to emit a light beam 102 A for illuminating a sample or specimen 140 .
  • the specimen 140 can be supported on a translational device 130 .
  • the translational device 130 can be translated or moved in one or more directions by one or more actuators (not shown).
  • the translational device 130 can be translated in three directions, for example, the x-, y- and z-directions, which are all orthogonal to each other.
  • the translational device 130 can be a piezo-stage device, e.g., the translation device 130 can be translated by piezoelectric actuators. It should be understood that using piezoelectric actuators to translate the translational device 130 is provided as only one example and that the translation device 130 can be translated using other means, including but not limited to, a stepper motor.
  • a propagation path of the light beam 102 A is shown by solid lines.
  • the specimen 140 can be one or more C. elegans, but it should be understood that the specimen 140 should not be limited to the examples below.
  • the light source 102 can be a continuous wave (“CW”) solid-state laser with a 488 nm wavelength (e.g., SPECTRA PHYSICS, CYAN 488 of NEWPORT CORP. of Irvine, Calif.), which excites the green fluorescent protein (“GFP”) efficiently.
  • the light beam 102 A can be coupled into one end of a single mode optical fiber 103 (e.g., P1-460B-FC-5 of THORLABS, INC.
  • the collimated beam can be reflected by a dichroic mirror 107 (e.g., MD499 of THORLABS, INC. of Newton, N.J.), and then, scanned by a scanning unit 104 .
  • the scanning unit 104 can include a plurality of reflectors, for example, a first reflector 104 A configured to scan the light beam 102 A along a first axis and a second reflector 104 B configured to scan the light beam 102 A along a second axis.
  • the first and second axes can be orthogonal to one another, for example, the first axis and second axis can optionally be the x-axis and y-axis relative to a plane in the specimen 140 .
  • the first reflector 104 A can be a resonant mirror (e.g., CRS 8 KHz of CAMBRIDGE TECHNOLOGY, INC.
  • the second reflector 104 B can be a galvanometric mirror (e.g., 6215H of CAMBRIDGE TECHNOLOGY, INC. of Lexington, Mass.) for the Y-scanner (e.g., the slow axis).
  • the enlarged beam can be focused onto the specimen 140 by, for example, a 40 ⁇ objective lens 113 (e.g., 1.3NA, CF SUPER FLUOR of NIKON CORP. of Tokyo, JP), and can excite the GFPs inside the specimen 140 .
  • a 40 ⁇ objective lens 113 e.g., 1.3NA, CF SUPER FLUOR of NIKON CORP. of Tokyo, JP
  • the excited GFPs inside the specimen 140 can emit fluorescent photons, which can be collected by the objective lens 113 .
  • the collected photons 102 B travel backwards to the dichroic mirror 107 through the propagation path of the light beam 102 A.
  • a propagation path of the collected photons 102 B is shown by dashed lines.
  • the collected photons 102 B can pass through the dichroic mirror 107 , and then, are focused onto a pinhole 115 (e.g., P15S, 15 um diameter of THORLABS, INC.
  • a pinhole 115 e.g., P15S, 15 um diameter of THORLABS, INC.
  • the pinhole 115 allows only the in-focus photons to pass while blocking the out-of-focus photons.
  • the in-focus photons can then be collected into a photomultiplier tube (“PMT”) 119 (e.g., PMT, H10770PA-40 of HAMAMATSU PHOTONICS K.K. of Hamamatsu, JP).
  • PMT photomultiplier tube
  • the PMT 119 can convert the collected photons into electric currents, which can be conveyed to a high-speed transimpedance amplifier (“preamp”, not shown) (e.g., preamp, FEMTO DHPCA-100 of ELECTRO OPTICAL COMPONENTS, INC. of Santa Rosa, Calif.).
  • the preamp can convert and amplify the currents into voltage.
  • the voltage output can be sampled, for example, into 16-bit data by a high-speed data acquisition card (“DAQ”) (ATS9462 of ALAZAR TECHNOLOGIES, INC. of Pointe-Claire, QC, Canada) (e.g., the multifunction DAQ 112 of FIG. 1B ).
  • DAQ high-speed data acquisition card
  • the sampled data can be processed and reconstructed into two-dimensional (“ 2 D”) images using custom software, for example, software written with LABORATORY VIRTUAL INSTRUMENT ENGINEERING WORKBENCH (“LabVIEW”) of NATIONAL INSTRUMENTS CORP. of Austin, Tex.
  • 2D images can be displayed on a display device and/or saved in a storage device upon request.
  • the confocal laser scanning microscope 100 can also include a sensor camera 121 (e.g., Model 8050 of THORLABS, INC. of Newton, N.J.).
  • the sensor camera 121 can be configured to capture a low-magnification image of the specimens 140 supported by the translational device 130 , for example.
  • the low-magnification image can be a fluorescence image.
  • FIG. 1B a block diagram of a control unit 150 for controlling operations of the confocal laser scanning microscope 100 of FIG. 1( a ) is shown.
  • the control unit 150 can be used for controlling operations of laser scanning systems used with other imaging modalities.
  • the control unit 150 can take advantage of the fastest scanning speed that the resonant scanning mirror (e.g., the first reflector 104 A of FIG. 1( a ) ) can potentially achieve and can provide ultimately flexible control of the scanning operations to meet the requirements for various scanning applications.
  • the control unit 150 includes a control circuit 108 , an imaging parameter control unit 110 and a multifunction DAQ 112 .
  • a synchronization control unit MU can include (and can be configured to perform one or more functions of) the imaging parameter control unit 110 and/or the multifunction DAQ 112 .
  • the control unit 150 receives a plurality of input signals and generates a plurality of internal and output signals, which are referred to herein as control and synchronization signals.
  • the control and synchronization signals are illustrated in FIGS. 2( a )-2( d ) .
  • the control unit 150 receives a reference clock signal (“RC”) that is used to drive a resonant mirror (e.g., the first reflector of FIG. 1( a ) ) and a user input signal (“UI”).
  • RC reference clock signal
  • UI user input signal
  • the UI can include a plurality of imaging parameters, which can optionally be selected and/or entered by a user of the confocal laser scanning microscope.
  • the imaging parameters can include at least one of a number of lines in the image, a number of pixels per line in the image, or a field of view (e.g., horizontal (or x-axis) scan range and vertical (or y-axis) scan range), a translational device (or z-axis) movement range, or a number of translational device movement steps.
  • the internal signals generated by the control unit 150 include a line trigger signal or synchronization clock signal (“LT”) that is generated based on RC, and a plurality of waveforms (“WF”) that are generated based on UI for use by the multifunction DAQ 112 to generate the output signals.
  • the output signals include an enhanced reference clock signal (“RR”), a galvanometric mirror control signal or first control signal (“GC”), a frame trigger signal or second control signal (“FT”), a translational device control signal or third control signal (“PC”), and a resonant mirror scanning angle control signal or fourth control signal (“RA”). As shown in FIG.
  • the control circuit 108 receives RC, enhances RC into RR, converts RC into LT, and transmits RR and LT to the multifunction DAQ 112 . Additionally, the synchronization controller 160 generates WF based on UI, and transmits WF to the multifunction DAQ 112 . After receiving RR, LT, and WF, the multifunction DAQ 112 generates GC, FT, PC, and RA.
  • RC is an electrical signal used by a controller or driver for a resonant mirror (e.g., the first reflector of FIG. 1( a ) ). RC oscillates between high and low states to control operation of the resonant mirror. RC marks the beginning of each tilting cycle of the resonant mirror. RC is the electrical voltage signal provided by the resonant mirror driver electronics. RC can optionally follow the Transistor-Transistor Logic (“TTL”) digital signal standard where a voltage between 0 V and 0.8 V represents the off-state and a voltage between 2 V and 5 V represents me on-state. The quality of RC can be lower than the expected standard due to the quality of the resonant mirror driver electronics or electrical noise from the surroundings, hence, RC can be enhanced using the control circuit 108 as described below.
  • TTL Transistor-Transistor Logic
  • RR is an electrical signal generated by the control circuit 108 by enhancing RC.
  • RR strictly adheres to the TTL digital signal standard, and thus, delivers superior reliability as compared to RC.
  • RR marks the beginning of each tilting cycle of the resonant mirror.
  • RR has a duty cycle of 50%, which means 50% of one period is in the on-state (e.g., approximately 5 V), and the other 50% of one period is in the off-state (e.g., approximately 0 V).
  • the on-state and the off-state represent resonant mirror scanning directions opposite to each other.
  • RR is illustrated in FIG. 2( a ) .
  • the control circuit 108 can enhance RC into RR and can generate LT by processing RR.
  • the control circuit 108 enhances RC by at least one of the following: filtering the undesirable noise, regulating the maximum and minimum voltages of RC, suppressing the unwanted minor signal fluctuation in RC, or supplying more current to RC.
  • the enhancement makes RR a more reliable, robust, and clean signal, optionally adhering to the TTL digital signal standard, as compared to RC.
  • multiple non-inverting buffer logic gates connected in parallel can be used to accomplish the enhancement. It should be understood that other structures and techniques can be used to enhance RC and that the multiple non-inverting buffer logic gates are provided only as an example.
  • LT is an electrical signal generated by the control circuit 108 based on RC.
  • the control circuit 108 can generate LT using a frequency doubler circuit.
  • the frequency doubler circuit generates a short, square pulse when RR transitions either from off-state to on-state (i.e., a rise) or from on-state to off-state (i.e., a fall). This is illustrated in FIG. 2( a ) .
  • the train of the short square pulses comprises LT.
  • the frequency doubler circuit can include multiple non-inverting buffer logic gates, multiple capacitors, and one XOR logic gate. The non-inverting buffer logic gates and the capacitors introduce a delay to RR.
  • the original RR without the delay and the RR with the delay are sent to the two input terminals of the XOR logic gate. It should be understood that other structures and techniques can be used to double the frequency of RR and that the multiple non-inverting buffer logic gates, multiple capacitors, and one XOR logic gate are provided only as an example
  • LT marks the beginning of each line scan along a first axis (e.g., the x-axis).
  • LT comprises a short, square pulse when RR transitions from off-state to on-state and vice versa and the respective states represent scanning in opposite directions along the first axis.
  • LT therefore marks the timing to synchronize operations of the resonant mirror (e.g., the first reflector 104 A of FIG. 1( a ) ) and the galvanic mirror (e.g., the second reflector 104 B of FIG. 1( a ) ).
  • LT is generated by the control circuit 108 by processing RR.
  • LT can adhere to the TTL digital signal standard.
  • LT serves as the reference timing clock for GC (or the first control signal), FT (or the second control signal), and PC (or the third control signal).
  • LT is illustrated in FIG. 2( a ) .
  • the UI is a collection of various parameters selected by a user of the confocal laser scanning microscope. This allows the user to flexibly control the imaging parameters of the confocal laser scanning microscope.
  • the imaging parameters can include the specifics of the objective lens (e.g., the objective lens 113 of FIG. 1( a ) ), the target field-of-view (“FOV”) of the scanning operations, the desired pixel number of the image, the specifics of the depth scanning operations, and the wavelength ( ⁇ ex ) of the excitation light source (e.g., the light source 102 in FIG. 1( a ) ).
  • the specifics of the objective lens can include the magnification, the manufacturer, the imaging medium, and the numerical aperture (“NA”).
  • the target FOV can include the horizontal scanning range (also referred to herein as “x-range”) and the vertical scanning range (also referred to herein as “y-range”).
  • the desired pixel number of the image can include a number of pixels per line in the image (“Npixel”) and a number of lines in the image (also referred to herein as “Nline”).
  • the specifics of the depth of scanning operations can include a translational device movement range (also referred to herein as “z-range”), a translational device movement step size (also referred to herein as “z-step”), and a number of translational device movement steps (also referred to herein as “Nstep”).
  • the imaging parameter control unit 110 is configured to compute waveforms (“WF”) based on UI, which are used by the multifunction DAQ 112 to generate the electrical signal outputs, e.g., GC, FT, PC, and RA, shown in FIG. 2 . All of the waveforms use Nline as the unit for the length of the respective waveform.
  • the multifunction DAQ 112 is configured to generate the output electrical voltage signals based on WF provided by the imaging parameter control unit 110 and RR and LT provided by the control circuit 108 .
  • the multifunction DAQ 112 can use RR as the start trigger.
  • the multifunction DAQ 112 can begin generating the output electrical voltage signals only when the multifunction DAQ 112 detects the rise state transition, i.e., off-state to on-state, in RR.
  • the multifunction DAQ 112 can use LT as the reference timing clock for signal generation.
  • GC is an electrical signal that can be used to control or drive a galvanometric mirror (e.g., the second reflector 104 B of FIG. 1( a ) ).
  • GC can be used to synchronize operation of the resonant and galvanometric mirrors (e.g., the first and second reflectors 104 A, 104 B of FIG. 1( a ) ).
  • GC can control the tilting angle of the galvanometric mirror.
  • GC can have a sawtooth waveform shape as shown in FIGS. 2( b )-2( d ) .
  • the voltage of GC can have both positive and negative values.
  • the positive voltage can turn the galvanometric mirror clockwise, and the negative voltage can turn the galvanometric mirror counter-clockwise.
  • a maximum voltage of GC (also referred to herein as “amplitude” of GC) is variable based on the FOV, in particular the maximum voltage can vary based on y-range.
  • the maximum voltage of the GC waveform is determined by the manufacturer of the objective lens, the magnification of the objective lens, and the vertical scanning range (y-range).
  • the amplitude of the GC waveform is linearly proportional to the magnification of the objective lens and y-range.
  • GC can be generated by the multifunction DAQ 112 of FIG. 1B as an electrical voltage signal.
  • GC can be a sawtooth waveform.
  • the period of GC can be variable based on the number of lines in the image (Nline).
  • the period of GC can be the same as the period of FT, which can also be variable based on Nline.
  • the period of GC can be linearly proportional to Nline.
  • the 1 added to Nline is the fly-back time for the galvanometric mirror to return to its initial position after completing one period. This is shown by the dotted box 208 in FIG. 2( b ) .
  • the voltage level (or height of the waveform) incrementally increases after each cycle of LT.
  • the increment of the GC waveform is the result of dividing the amplitude of the GC waveform by (Nline ⁇ 1).
  • One incremental increase of the voltage level of GC occurs for every LT period as shown in FIG. 2( a ) .
  • the number of incremental increase of the voltage level of GC is (Nline ⁇ 1) before the voltage level returns to a minimum level.
  • FT is an electrical signal that determines the beginning of each frame.
  • FT signals the multifunction DAQ 112 for imaging when the data acquisition of a new frame has to commence.
  • FT can be a square pulse train adhering to the TTL digital signal standard.
  • the duty cycle of FT can be any value between 5% and 50%, for example the duty cycle of FT can be set to 10%.
  • the period of FT can be variable based on the number of lines in the image (Nline).
  • the period of FT can be the same as the period of GC, which can also be variable based on Nline.
  • the period of FT can be linearly proportional to Nline.
  • FT can be generated by the multifunction DAQ 112 of FIG. 1B as an electrical voltage signal
  • PC Third Control Signal
  • PC is an electrical signal that directs the position of a translational device (e.g., the translational device 130 of FIG. 1( a ) ).
  • the translational device can be a piezo-stage device that can be translated using piezoelectric actuators. Accordingly, the position of the translational device can be linearly proportional to the voltage of PC.
  • the voltage of PC can have a sawtooth waveform shape.
  • the period of PC can be variable based on the number of translational device movement steps (Nstep).
  • the period of PC can be linearly proportional to Nstep. For example, the period of PC can be equal to a period of LT times (Nline +1) times Nstep. This is shown in FIG.
  • the voltage of PC can have a positive value or be 0.
  • the maximum voltage or PC (or “amplitude” of the PC waveform) is proportional to the translational device moving range (z-range). As shown in FIGS. 2( c )-2( d ) , the voltage level of PC (or height of the waveform) incrementally increases after each cycle of GC and/or FT.
  • the increment of the PC waveform is the result of dividing the amplitude of the PC waveform by (Nstep ⁇ 1).
  • PC can be generated by the multifunction DAQ 112 of FIG. 1B as an electrical voltage signal.
  • RA is an electrical signal that determines the scanning angle of the resonant mirror (e.g., the first reflector of FIG. 1( a ) ).
  • RA can be a constant DC voltage.
  • the scanning angle of the resonant mirror is linearly proportional to the voltage of RA. In other words, the higher the voltage of RA, the larger the scanning angle of the resonant mirror.
  • the value of RA is determined by the manufacturer of the objective lens, the magnification of the objective lens, and the horizontal scanning range (x-range).
  • the value of RA is linearly proportional to the magnification of the objective lens and x-range.
  • the manufacturer of the objective lens decides the compensation factor for the RA value because the focal length of the objective lens slightly varies according to the manufacturer due to the difference in the manufacturers' objective lens designs.
  • RA can be generated by the multifunction DAQ 112 of FIG. 1B as an electrical voltage signal.
  • FIGS. 5( a )-5( e ) illustrate a microfluidic device for C. elegans immobilization and stimulus delivery for calcium imaging.
  • FIG. 5( a ) is a schematic of the device for C. elegans immobilization (e.g., through inlet S IN and outlet W OUT ) in an anesthetic free environment for high-resolution volumetric imaging of calcium responses.
  • FIG. 5( b ) illustrates an enlarged view of the trapping area with a schematic of a C. elegans oriented with its head upward for chemical delivery channel
  • FIG. 5( c ) is a graph illustrating the stimulus delivery process tested using fluorescein and response from a single neuron fluorescence intensity for calcium response.
  • FIG. 5( d ) are fluorescence images of single ASH neuron from CX6632 animal when exposed to 1M glycerol.
  • FIG. 5( e ) are fluorescence images of ZIM294 animal when exposed to 1M glycerol stimulus. The fluorescence images were acquired using a CCD camera. Scale bar in FIG. 5( e ) is 10 mm.
  • the device was designed on silicon wafers using a negative photo resist SU8-2025.
  • a spin coated layer of 35 ⁇ m SU8 was exposed using high-resolution photomask with the design shown in FIG. 5( a ) .
  • the layer was developed and hard baked to be used for PDMS molding.
  • the mold was vapor coated with silane for ⁇ 6 hours to help release the mold during peeling process.
  • PDMS was mixed in 10:1 ratio, mixed well, and degassed in vacuum chamber to get rid of bubbles.
  • PDMS was poured on the SU8 features and baked at 70° C. for 2 hours.
  • PDMS layer was peeled off from silicon wafer, cut into small pieces, and punched for access holes.
  • PDMS piece was cleaned in alcohol and blow dried.
  • a clean cover glass of 150 mm thickness and the PDMS piece was treated with 100 W oxygen plasma and irreversibly bonded to each other. Additional 2 hour of baking improves the surface adhesion during high pressure device operation.
  • C. elegans strain were grown on nematode growth medium (“NGM”) at 20° C. and using standard protocol.
  • ZIM294 Ex[Punc-31::NLSGCaMP5K; Punc-122::gfp] strain was used with GCaMP expressed in nucleus of all neuronal cells using unc-31 promoter.
  • the stain was picked under the stereoscope by visualizing GFP signal from six coelomocyte cells of the animal Age synchronized animals are obtained by bleaching gravid C. elegans and allowing them to hatch in M9 solution for 24 hours. Hatched L1s are plated on NGM plates to obtain larval stage 4 (L4) animals for imaging.
  • a freshly prepared stimulation device is opened and coupled to a S. basal filled syringe using a metal coupler at In1.
  • the device is primed with pressurized S. basal solution to get rid of all air bubbles in the device.
  • a single GFP labelled ZIM294 animal is picked in the syringe and pushed thought inlet In1 of the stimulation device. The animal is pushed inside the narrow trapped with its head up into the trap till the nose is exposed into the stimulation exposure region (see FIG. 5( b ) ).
  • GFP fluorescence signal is acquired from the immobilized animal and pre-exposed to the blue light for 2 minutes to capture the basal fluorescence signal level from all the neurons of interest.
  • Field of view (“FOV”) is adjusted to capture majority of the C. elegans neurons.
  • Glycerol solution in S. basal of 1 M is flushed though inlet In2 and outlet Out2 to expose animals with 1 M glycerol for 5 seconds. All the neurons are recorded within 700 ⁇ m ⁇ 50 ⁇ m FOV and 20 z-stack images with every 1.5 mm. High-speed volumetric imaging was recorded for 2 min with 3 volume per second.
  • GUI graphical user interface
  • C. elegans has total 302 neurons which connects among themselves to form a fair enough complex neuronal network. Function of these neurons are associated with calcium flux changes which can be monitored in vivo using fluorescent proteins. Genetically modified animals with protein molecules (GCaMP) that has calcium binding domains can demonstrate fluorescent changes on calcium amount within cell. Conventionally calcium dynamics are monitored using cell specific expression of GCaMP that depicts the dynamics from a predefined neurons and the neurons defined by the promoter driven expressions. In order to track dynamics from a wide range of neurons involved in one or more circuit, researchers have developed pan neuronal expression of fluorescent protein markers that show all 302 neurons. In those animals it becomes hard to distinguish single neurons from the whole ganglia where many neurons are present at high enough density. Currently, new strains are generated that has more localized fluorescence signal from proteins from the nucleus. These animals has localized fluorescence signal from ⁇ 2 um nuclear volume and do not show the complex neuronal processes.
  • GCaMP Genetically modified animals with protein molecules
  • Fluorescent signals are emitted from many nuclei present in the head and is difficult to resolve spatially in 3D using wide-field microscope.
  • a confocal microscope with ⁇ 2 um axial resolution and ⁇ 1 um lateral resolution can resolve all the nuclei present at high enough density within all stages of C. elegans.
  • FIG. 12 shows a sample image of the whole animal immobilized inside the stimulation imaging chip.
  • the specific channel design of the stimulation imaging chip successfully accommodates the whole animal from the head to the tail within the confocal microscope field-of-view (FOV) of 630 ⁇ 150 ⁇ m 2 .
  • FOV field-of-view
  • the sharpness in the neuronal boundaries demonstrates complete immobilization of the L4 stage C. elegans inside the stimulation imaging chip.
  • volumetric time-lapse confocal imaging of whole animal was conducted to demonstrate the described confocal system's capability to image whole nervous system in real-time.
  • a L4 C. elegans was immobilized in the stimulation imaging chip, and high-resolution confocal images of the whole animal were taken with optimum spatial resolution for neuronal identification and annotation.
  • the high-resolution imaging condition was a 630 ⁇ 150 ⁇ 35 ⁇ m 3 volume imaged with 4200 ⁇ 1000 ⁇ 70 voxels.
  • the volumetric time-lapse imaging was carried out for 240 seconds.
  • the volumetric time-lapse imaging condition is a volume of 630 ⁇ 150 ⁇ 25 ⁇ m 3 imaged with 2100 ⁇ 500 ⁇ 15 voxels at 2 volumes per second (VPS) speed.
  • For the first 120 seconds stimulus was not applied to the animal At 120 second mark, a +10 mM NaCl stimulus was applied for 30 seconds. Subsequently, the stimulus was stopped at 150 second mark, and the animal was imaged for the remaining 90 seconds.
  • neurons (1-18) were selected that showed significant response to +10 mM NaCl stimulus and six (6) neurons (n1-n6) that did not were selected. Seven responsive neurons were in the head, and 11 responsive neurons were found along the ventral cord. Two unresponsive neurons were in the head and four unresponsive neurons were along the ventral cord. Those 24 neurons are annotated in FIG. 13( a ) . The responsive neurons were spread over the whole animal from the head to the tail. The fluorescent intensity levels of the responsive neurons stayed level with a little oscillation for the first 120 seconds. Then, the fluorescent intensity levels significantly increased during the 30 second of +10 mM NaCl stimulation.
  • a microfluidic device (also referred to herein as a “parallel microfluidic platform” or “parallel microfluidic device”) for use trapping a plurality of specimens for surgery or imaging is shown.
  • the parallel microfluidic platform is designed to rapidly orient and immobilize L4 stage worms for femtosecond laser axotomy, long-term on-chip housing, and post-surgery imaging of axotomized worms at developmental stage between L4 to young adult.
  • the parallel microfluidic platform can include an inlet 601 for receiving the specimens (e.g., C. elegans or worms or nematodes), an outlet 602 a, 602 b (collectively referred to herein as outlet 602 ) in fluid connection with the inlet 601 , and a plurality of immobilization channels 603 extending between the inlet 601 and the outlet 602 .
  • Each of the immobilization channels 603 can include a plurality of sections (e.g., sections z 1 , z 2 , z 3 in FIGS. 6( a )-6( b ) ), and each respective section has a different width and/or height as compared to the other sections.
  • the parallel microfluidic platform can include a set of 20 parallel immobilization channels 603 as shown in FIG. 6( a ) . It should be understood that the parallel microfluidic platform can include more or less than 20 immobilization channels.
  • the parallel microfluidic device can include a perfusion compartment 604 arranged between the inlet 601 and the immobilization channels 603 .
  • the perfusion compartment 604 is for housing the nematodes after the surgery for long-term imaging As shown in FIG.
  • the parallel microfluidic device can include: an inlet 601 for delivering the worms in and out of the microfluidic chip; a plurality of immobilization channels 603 , each configured to orient and immobilize a single worm for axotomy and post-surgery imaging; an outlet 602 for guiding the worms along the immobilization channels 603 ; and a perfusion compartment 604 for housing and feeding the axotomized worms after the surgery.
  • each individual immobilization channel 603 is designed to have a tapered geometry to immobilize the worms for axotomy.
  • a width of each of the immobilization channels 603 decreases in the direction extending between the inlet 601 and the outlet 602 .
  • the respective widths of sections z 1 , z 2 , z 3 of each of the immobilization channels is different.
  • a tapered channel geometry enables partial immobilization because the vertical freedom of movement in the immobilization channels.
  • the lateral orientation of the worms can be arbitrary, which can be unfavorable for axotomy and imaging.
  • each tapered immobilization channel is designed to have a plurality of sections (e.g., three different sections z 1 , z 2 , z 3 in FIGS. 6( a )-6( b ) ), each section having different channel heights and aspect ratio.
  • each of the immobilization channels 603 has three different sections z 1 , z 2 , z 3 . It should be understood that each of the immobilization channels may have more or less than three sections.
  • the goal of the triple-layer parallel immobilization device is to immobilize L4 stage C.
  • the parallel microfluidic device can have a plurality of outlets 602 a and 602 b, each outlet in fluid connection with a subset of the immobilization channels 603 .
  • FIG. 6( a ) is a schematic top-view illustrating the parallel microfluidic chip.
  • the immobilization channels 603 are used to immobilize the nematodes for laser axotomy and post-process imaging. Synchronized worms are loaded into the parallel microfluidic chip through the inlet 601 . During the immobilization, a positive pressure gradient is created between the inlet 601 and the outlet 602 . After the axotomy process is finalized, the worms can be pushed back into the perfusion compartment 604 for post-surgery feeding. During the post-surgery feeding, the worms are housed and fed inside the perfusion compartment 604 .
  • the feeding is achieved by creating a positive pressure gradient between a perfusion inlet 605 and a perfusion outlet 606 both in fluid connection with the perfusion compartment 604 .
  • section z 3 , z 2 , z 1 of each of the immobilization channels have heights of 10 ⁇ m, 22 ⁇ m, and 40 ⁇ m, respectively.
  • FIGS. 7( a )-7( g ) illustrate an example valve sequence used with the parallel microfluidic device of FIGS. 6( a )-6( b ) .
  • a population of worm is put into microfluidic chip through inlet 601 .
  • the outlet 602 is opened to create a pressure gradient between inlet 601 and outlet 602 so that the worms can be pushed inside each immobilization channel
  • the perfusion inlet 605 and perfusion outlet 606 are closed.
  • FIG. 7( b ) a plurality of worms are pushed inside individual trapping chambers.
  • FIG. 7( b ) a plurality of worms are pushed inside individual trapping chambers.
  • the remaining worms inside the perfusion compartment 604 are delivered out of the microfluidic chip by reversing the flow at the perfusion inlet 605 and perfusion outlet 606 .
  • the axotomy is performed on each immobilized worm.
  • axotomized worms are pushed back to the perfusion compartment 604 by changing the flow at outlet 602 and opening the perfusion inlet 605 and perfusion outlet 606 .
  • axotomized worms are housed on chip and fed through the flow between perfusion inlet 605 and perfusion outlet 606 .
  • on-chip incubated worms are immobilized again with a similar procedure as described with reference to FIG. 7( d ) for performing post-surgery imaging.
  • Worm inlet (e.g., inlet 601 in FIGS. 6( a )-6( b ) ):
  • the worm inlet constitutes the interface between inside and outside of the microfluidic chip.
  • the inlet is pressurized to push the worms inside immobilization channels ( FIGS. 7 a,b,d and g ).
  • the inlet might be closed ( FIG. 7 e and f ), open-ended ( FIG. 7 c ), or pressurized ( FIGS. 7 a,b,d and g ).
  • Trapping chamber e.g., each of the plurality of immobilization channels 603 in FIGS. 6( a )-6( b ) :
  • Each trapping chamber has three different device section, e.g., zone 1 (Z 1 , 60 ⁇ m height & 600 ⁇ m length), zone 2 (Z 2 , 40 ⁇ m height & 600 ⁇ m length) and zone 3 (Z 3 , 22 ⁇ m height & 1800 ⁇ m length).
  • the immobilization channels 603 are arranged substantially in parallel to each other. As described herein, parallel immobilization channels 603 can contribute to increasing the speed and efficiency of automated imaging techniques. Additionally, the immobilization channels can reduce net hydraulic resistance for the microfluidic device.
  • the immobilization channels 603 can be arranged with approximately equal spacing between adjacent immobilization channels.
  • the spacing between each immobilization channel can be 150 ⁇ m.
  • the change of width and height throughout each of the immobilization channels 603 allows for rapid orientation and immobilization of individual nematodes.
  • Exit outlet (e.g., outlet 602 in FIGS. 6( a )-6( b ) ): There can be a plurality of outlets included in the microfluidic device.
  • each respective outlet 602 a and 602 b is in fluid connection with a first subset of the immobilization channels and a second outlet is in fluid connection with a second subset of the immobilization channels, respectively.
  • each outlet 602 a and 602 b helps to manipulate 10 worms inside the immobilization channels 603 .
  • having two outlets provides immobilization of 10 worms at once when desired.
  • the microfluidic device can have more or less than two outlets.
  • Perfusion compartment (e.g., the perfusion compartment 604 in FIGS. 6( a )-6( b ) ):
  • the perfusion compartment can have a perfusion inlet 605 and perfusion outlet 606 in fluid connection therewith.
  • the perfusion area is shown in FIG. 6( b ) and has a width of 3060 ⁇ m, length of 1200 ⁇ m and a height of 60 ⁇ m.
  • the height of perfusion inlet and outlet are 10 ⁇ m (e.g., z 4 of FIGS. 6( a )-6( b ) ).
  • a sieve structure 607 a, 607 b can be arranged in the boundary region between the perfusion compartment 604 and the perfusion inlet 605 and/or the perfusion outlet 606 as shown in FIG. 6( b ) .
  • the sieve structure 607 a, 607 b can include long sieve-like structures. These sieve structures lead to a narrow channel that is 10 ⁇ m high and 8 ⁇ m wide. The rationale behind incorporating 10 ⁇ m height sieve structures is to block the entrance of the worms into the perfusion channels while allowing the fluid flow for feeding.
  • the imaging platform includes: a high-speed laser scanning confocal microscope (e.g., the confocal laser scanning microscope of FIGS. 1( a )-1( b ) and the parallel microfluidic axotomy-imaging platform (or worm hospital) (i.e., the microfluidic device of FIGS. 6( a )-6( b ) ).
  • a 40X oil objective lens Nekon, 40X, 1.3NA
  • the confocal microscope provides maximum 350 ⁇ m ⁇ 350 ⁇ m field-of-view (FOV), and the lateral resolution of 275 ⁇ 11 nm and the axial resolution of 1.16 ⁇ 0.14 nm.
  • a microfluidic device is also used, which enables efficient automation of imaging.
  • the microfluidic device has 20 worm trapping channels which are evenly separated from one another.
  • the active trapping regions or the trapping channels are maximum 50 ⁇ m wide or narrower.
  • the FOV can be set to be 350 ⁇ m ⁇ 50 ⁇ m, and the pixel numbers to be 3500 ⁇ 500 to use the full capacity of the imaging resolution.
  • the confocal microscope demonstrates the imaging speed of 31 frames-per-second (FPS).
  • the z-axis step size can be set to be 200 nm and the number of z-axis steps to be 150, thus, the overall imaging volume size is 350 ⁇ m (x) ⁇ 50 ⁇ m (y) ⁇ 30 ⁇ m (z).
  • a microfluidic device e.g., the microfluidic device of FIGS. 6( a )-6( b )
  • a translational device of a laser scanning system e.g., the confocal laser scanning system of FIGS. 1( a )-1( b )
  • the orientation of the microfluidic device is aligned to minimize the tilting of the trapping channels (e.g., the immobilization channels 603 of FIGS. 6( a )-6( b ) ) in the field-of-view.
  • the worms are loaded inside the trapping channels of the microfluidic device, and a fluorescence image of the worms trapped within the microfluidic device is acquired through a low magnification objective lens (e.g., the objective lens 113 of FIG. 1( a ) ) using a sensor camera (e.g., the sensor camera 121 of FIG. 1( a ) ) at 804 .
  • the objective lens can have a relatively low-magnification such as 4 ⁇ , for example. It should be understood that the magnification can be more or less than 4 ⁇ .
  • the magnification of the high-magnification volumetric image (described below) can be at least 5 times greater than the magnification of the low-magnification image.
  • the low-magnification image can be transmitted to custom software for performing imaging target location analysis (step 806 in FIG. 8 ).
  • a smooth filter is optionally applied to the low-magnification image.
  • the smooth filter can optionally be a moving average filter.
  • a moving average filter can use a vector of ones with a length of 5 (i.e., a small vector) then convolves an input vector data with this small vector.
  • the resultant vector is a moving average of the input vector.
  • the input vector can be the maximum pixel intensities along each column of the segmented image. It should be understood that this is provided as only one example of the moving average filter.
  • the intensity profile can include the highest intensity pixel (e.g., the peak intensity pixel value) in each line (e.g., each row of the image) from the top to the bottom of the fluorescence image. For example, at 824 , the highest intensity pixel in each line from the top to the bottom of the fluorescence image is identified. Then, at 826 , the peak intensity pixel values that correspond to the trapped worms and trapping channels are identified. This can be performed by disregarding one or more of the peak intensity pixel values in the intensity profile having a value less than a threshold value.
  • the threshold value represents unhealthy worm that are not worth imaging.
  • the threshold value can optionally be 30% of the average peak intensity pixel value.
  • the threshold value can be more or less than 30% of the average peak intensity value so long as it translates to the intensity pixel value of a worm not worth imaging.
  • the low-magnification image can be segmented into a plurality of segments, wherein each of the segments includes a respective worm. After segmenting, the image can be analyzed to identify anterior lateral microtubule (“ALM”) cells of the worms.
  • ALM anterior lateral microtubule
  • a feature of interest e.g., an ALM cell
  • a center location of the feature of interest can be identified.
  • a plurality of highest intensity pixel values within the segment are identified. For example, the three highest intensity pixel values in the segment are identified. The three highest intensity pixel values correspond to two ALM cells and two posterior lateral microtubule (“PLM”) cells. The two PLM cells however appear to be one of the highest intensity pixel values because they are very close to each other.
  • respective distances between pairs of the three highest intensity pixel values are calculated, and the calculated distances are compared.
  • the center location is determined. Steps 828 - 834 is repeated for all the segmented trap images (e.g., for each segment). Then, a translational moving sequence for high-magnification imaging can be generated from the center locations of the features of interest (e.g., the ALM cells). In particular, translational moving distances from one ALM cell location to the next ALM cell location can be used to drive the translation device of the confocal laser scanning microscope.
  • the automated confocal imaging session can begin at 808 .
  • the low-magnification objective lens (e.g., 4 ⁇ ) of the confocal laser scanning microscope can be replaced by a high-magnification objective lens (e.g., a 40 ⁇ objective lens), then, run the automated confocal imaging software is run.
  • the magnification of the high-magnification lens can be at least 5 times greater than the magnification of the low-magnification lens.
  • the automated confocal imaging software is used to drive the translational device of the confocal laser scanning microscope to the ALM cell locations, for example, by following the translational moving sequence generated as described above, as well as take z-stack images of the ALM axons.
  • the automated confocal imaging software completes the automated imaging session after the automated confocal imaging software images the last ALM axon.
  • the imaging speed of the high-throughput automated confocal imaging platform described above can be compared to the estimated imaging speed of state-of-the-art commercial confocal microscopes.
  • the latest scanning confocal microscope of ZEISS of Oberkochen, Germany i.e., LSM780
  • LSM780 demonstrates the imaging speed of 8 FPS with 512 ⁇ 512 pixels referring to its specification.
  • the imaging speed of LSM780 for 3500 ⁇ 500 pixels is estimated to be 1.4 FPS. Therefore, to complete one automated imaging session, LSM780 needs 214 minutes which is more than 20 times the time required to perform the same imaging with the confocal laser scanning platform described herein.
  • LSM780 still takes 72 minutes even if it takes only two frames per plane assuming LSM780 requires less averaging to acquire images of the same quality as the confocal laser scanning platform described herein due to LSM780's longer pixel duration.
  • A1R+ The latest resonant scanning confocal microscope from NIKON CORP. of Tokyo, Japan (i.e., A1R+) demonstrates the imaging speed of 30 FPS with 512 ⁇ 512 pixels. Unlike Zeiss' LSM780 and the confocal laser scanning platform described herein, A1R+ cannot provide pixels more than 512 ⁇ 512 pixels. Hence, A1R+ must take seven 512 ⁇ 512 images to acquire one 3500 ⁇ 500 image. Taking seven smaller images requires 6 times of sample moving to image the whole target area, and the sample moving prolongs the necessary time to image the whole target area. Assuming the sample moving takes 10 ms per move, A1R+ takes 291 ms to take one frame of 3500 ⁇ 500 image (3.43 FPS).
  • A1R+ Based on the imaging speed of 3.43 FPS, A1R+ needs 88 minutes to complete one automated imaging session. In addition, the 512 ⁇ 512 images taken by A1R+ have to be computationally stitched together to form a 3500 ⁇ 500 image. That image stitching process further increases the overall imaging time of A1R+. Based on the estimations above, the confocal laser scanning platform described herein is eight times as fast as A1R+ and 20 times as fast as LSM780. This is shown in FIG. 9 .
  • FIGS. 10( a )-10( b ) are two sample images of the ALM axons.
  • FIG. 10( a ) shows a reconnected axon
  • FIG. 10( b ) shows non-reconnected axon.
  • the two wide images are the maximum projection of two z-stack images, and have the 350 ⁇ m ⁇ 50 ⁇ m FOV.
  • the ALM axons are aligned perfectly straight owing to the straight trapping channels. The unique design of the trapping channels also aligns the C.
  • the non-reconnected ALM axon is shown in FIG. 10( b ) .
  • the maximum projection image in FIG. 10( b ) shows much more autofluorescence than the maximum projection image in FIG. 10( a ) does.
  • the autofluorescence is also significant around the axotomy site in the small rectangle. However, the autofluorescence disappears in the depth-resolved zoom-in images in the large rectangle due to the out-of-focus signal rejection by confocal imaging.
  • the out-of-focus signal rejection enables accurate observation of the regrown ALM axon.
  • the logical operations described herein with respect to the various figures may be implemented (1) as a sequence of computer implemented acts or program modules (i.e., software) running on a computing device, (2) as interconnected machine logic circuits or circuit modules (i.e., hardware) within the computing device and/or (3) a combination of software and hardware of the computing device.
  • the logical operations discussed herein are not limited to any specific combination of hardware and software. The implementation is a matter of choice dependent on the performance and other requirements of the computing device.
  • the computing device 1100 may include a bus or other communication mechanism for communicating information among various components of the computing device 1100 .
  • computing device 1100 typically includes at least one processing unit 1106 and system memory 1104 .
  • system memory 1104 may be volatile (such as random access memory (RAM)), non-volatile (such as read-only memory (ROM), flash memory, etc.), or some combination of the two.
  • RAM random access memory
  • ROM read-only memory
  • flash memory etc.
  • the processing unit 1106 may be a standard programmable processor that performs arithmetic and logic operations necessary for operation of the computing device 1100 .
  • Computing device 1100 may have additional features/functionality.
  • computing device 1100 may include additional storage such as removable storage 1108 and non-removable storage 1110 including, but not limited to, magnetic or optical disks or tapes.
  • Computing device 1100 may also contain network connection(s) 1116 that allow the device to communicate with other devices.
  • Computing device 1100 may also have input device(s) 1114 such as a keyboard, mouse, touch screen, etc.
  • Output device(s) 1112 such as a display, speakers, printer, etc. may also be included.
  • the additional devices may be connected to the bus in order to facilitate communication of data among the components of the computing device 1100 . All these devices are well known in the art and need not be discussed at length here.
  • the processing unit 1106 may be configured to execute program code encoded in tangible, computer-readable media.
  • Computer-readable media refers to any media that is capable of providing data that causes the computing device 1100 (i.e., a machine) to operate in a particular fashion.
  • Various computer-readable media may be utilized to provide instructions to the processing unit 1106 for execution.
  • Common forms of computer-readable media include, for example, magnetic media, optical media, physical media, memory chips or cartridges, a carrier wave, or any other medium from which a computer can read.
  • Example computer-readable media may include, but is not limited to, volatile media, non-volatile media and transmission media.
  • Volatile and non-volatile media may be implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data and common forms are discussed in detail below.
  • Transmission media may include coaxial cables, copper wires and/or fiber optic cables, as well as acoustic or light waves, such as those generated during radio-wave and infra-red data communication.
  • Example tangible, computer-readable recording media include, but are not limited to, an integrated circuit (e.g., field-programmable gate array or application-specific IC), a hard disk, an optical disk, a magneto-optical disk, a floppy disk, a magnetic tape, a holographic storage medium, a solid-state device, RAM, ROM, electrically erasable program read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices.
  • an integrated circuit e.g., field-programmable gate array or application-specific IC
  • a hard disk e.g., an optical disk, a magneto-optical disk, a floppy disk, a magnetic tape, a holographic storage medium, a solid-state device, RAM, ROM, electrically erasable program read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (
  • the processing unit 1106 may execute program code stored in the system memory 1104 .
  • the bus may carry data to the system memory 1104 , from which the processing unit 1106 receives and executes instructions.
  • the data received by the system memory 1104 may optionally be stored on the removable storage 1108 or the non-removable storage 1110 before or after execution by the processing unit 1106 .
  • Computing device 1100 typically includes a variety of computer-readable media.
  • Computer-readable media can be any available media that can be accessed by device 1100 and includes both volatile and non-volatile media, removable and non-removable media.
  • Computer storage media include volatile and non-volatile, and removable and non-removable media implemented in any method or technology for storage of information such as computer readable instructions, data structures, program modules or other data.
  • System memory 1104 , removable storage 1108 , and non-removable storage 1110 are all examples of computer storage media.
  • Computer storage media include, but are not limited to, RAM, ROM, electrically erasable program read-only memory (EEPROM), flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by computing device 1100 . Any such computer storage media may be part of computing device 1100 .
  • the various techniques described herein may be implemented in connection with hardware or software or, where appropriate, with a combination thereof.
  • the methods and apparatuses of the presently disclosed subject matter, or certain aspects or portions thereof may take the form of program code (i.e., instructions) embodied in tangible media, such as floppy diskettes, CD-ROMs, hard drives, or any other machine-readable storage medium wherein, when the program code is loaded into and executed by a machine, such as a computing device, the machine becomes an apparatus for practicing the presently disclosed subject matter.
  • the computing device In the case of program code execution on programmable computers, the computing device generally includes a processor, a storage medium readable by the processor (including volatile and non-volatile memory and/or storage elements), at least one input device, and at least one output device.
  • One or more programs may implement or utilize the processes described in connection with the presently disclosed subject matter, e.g., through the use of an application programming interface (API), reusable controls, or the like.
  • API application programming interface
  • Such programs may be implemented in a high level procedural or object-oriented programming language to communicate with a computer system.
  • the program(s) can be implemented in assembly or machine language, if desired. In any case, the language may be a compiled or interpreted language and it may be combined with hardware implementations.
  • the synchronization techniques described herein allow the user to use an ultrahigh speed DAQ card, which provides a higher sampling rate (e.g., 180 million samples per second (MS/s)) than any other existing laser scanning microscopes (e.g., 80 MS/s is the maximum speed of the currently available frame grabbers). Taking advantage of such a high speed DAQ card became possible with the development of the described synchronization technique. The existing techniques cannot achieve these advanced features simply by installing this high-speed DAQ. Combined with flexible control capability, the high-speed DAQ card's higher sampling rate enables the larger field-of-view and the larger number of pixels of provided by the confocal laser scanning microscope described herein.
  • a higher sampling rate e.g., 180 million samples per second (MS/s)
  • any other existing laser scanning microscopes e.g. 80 MS/s is the maximum speed of the currently available frame grabbers.
  • the synchronization techniques described herein can enable a two-photon microscope to take images of up to 7000 ⁇ 500 pixels at 30 Hz rate, for example This is a faster rate than two-photon microscopes known to date.
  • two-photon microscopy at least two ultrafast laser pulses excite the sample fluorophores to generate one image pixel.
  • the highest pulse repetition rate that ultrafast lasers achieve is about 80 MHz.
  • this disclosure contemplates using beam splitters to multiply the pulse repetition rate of an ultrafast laser, e.g., to multiply the pulse repetition rate by 8 ⁇ , 16 ⁇ , 64 ⁇ , etc. to achieve higher imaging speeds.
  • the use of beam splitters to multiply the pulse repetition rate of ultrafast lasers is known in the art.
  • the microfluidic device described herein immobilizes the small model animal, C. elegans, in a fashion that will enable high-throughput, high-resolution, and automated imaging as well as volumetric functional imaging of their nervous system faster than any existing method.
  • the microfluidic device aids in automated imaging of large number of animals very rapidly. It straightens specimens to optimally fit the field-of-view of the laser scanning microscope. It also arranges the animals in parallel while keeping the distance between them consistent and minimal for fast imaging. This orderly arrangement also simplifies the automation process and prevents undesirable automation errors due to complexity.
  • the microfluidic device provides a different immobilization method as compared to current immobilization methods for high-resolution of C. elegans, which involve time-consuming manual methods.
  • the animals are immobilized either on agar pads or inside well-plates.
  • the immobilized animals are randomly oriented, usually bent, positioned in random distances, and many times clustered on top of each other. These features require finding each animal and focusing on their features of interest for high-resolution imaging that result in longer imaging and handling times.
  • the randomly oriented, bent animals require a larger field-of-view than organized, straight animals, and a larger field-of-view leads again to a longer imaging time.
  • a huge portion of the larger field-of-view is wasted since it contains no information of the animals
  • An automating imaging technique for high-throughput automated data acquisition of C. elegans nervous system includes locating target animals and their features of interest using a low resolution optical image and then moving to the identified locations of features of interest of each animal to take high resolution 3D images.
  • the techniques includes taking an image of the whole microfluidic device with animals trapped inside the device. Then, it includes analyzing the image, computing the locations of the trapped animals and their feature of interest, and recording the coordinates of the features.
  • the technique includes moving to each animal's location, taking high-resolution 3D images of their features of interest, and repeating the process until completing the last animal.
  • Such high-speed, high-resolution, 3D volumetric confocal imaging system does not currently exist.
  • Photo-bleaching is the photochemical destruction of fluorescent protein molecules. The longer the fluorescent protein is exposed to the excitation light, the more photo-bleaching occurs, the less the specimen emits fluorescent light. The faster imaging speed of the confocal laser scanning microscope described herein provides imaging a specimen in a shorter time before the specimen experience severe photo-bleaching.
  • Autofluorescence is a natural fluorescent light emission from biological cells and tissues.
  • SNR signal-to-noise ratio
  • C. elegans are immobilized under physical pressure, they begin expressing stronger autofluorescence over time.
  • the fluorescent signal levels start degrading under stress that further reduce the SNR. The longer C. elegans are immobilized the weaker the SNR becomes.
  • the SNR significantly deteriorates and it can be very challenging to recognize the neuronal axons in the low SNR images.
  • the confocal laser scanning microscope described herein addresses this image quality degradation due to SNR deterioration by completing the C. elegans imaging before the autofluorescence signifies or the health of their neurons deteriorate.
  • C. elegans naturally bend their bodies when they freely move around and even when they are anesthetized. Hence, their bodies have to be straightened when imaged.
  • Another challenge is the arrangement of C. elegans.
  • detection of the imaging location can be complicated and require a larger field of view to capture the whole nervous system.
  • the microfluidic device described herein solves all the aforementioned problems by immobilizing and straightening C. elegans in parallel trapping channels.
  • the dimensions of the trapping channels are designed to guide C. elegans to align themselves in ideal orientations for imaging.
  • the confocal laser scanning microscope described herein uses more economic components than other high-speed imaging techniques.
  • the most expensive component of the system is the high-speed DAQ card, which costs about $10,000.
  • Some of the current high-speed imaging techniques use intensified CCD cameras to achieve high imaging speed. This intensified CCD camera is very costly, usually from $40,000 to $60,000 per unit.
  • One of the high-speed imaging techniques using a hi-speed camera is two-photon temporal focusing microscopy (TF microscopy). TF microscopy also uses the high-speed camera and expensive lasers.
  • the imaging speed of TF microscopy is not faster than that of the confocal laser scanning microscope described herein while the field-of-view of TF microscopy is significantly smaller, one-eighth, than that of the confocal laser scanning microscope described herein when using the same objective.
  • the confocal laser scanning microscope described herein allow for flexible selection of pixel numbers and field-of-view control, which save data storage space and reduce data analysis time.
  • the flexibility of choosing the desired FOV and number of pixels enables the user to exactly fit the imaging field-of-view to the size of the animal Hence, the image of the animal has no wasted data.
  • other imaging methods with limited control of field-of-view and pixel numbers cannot fit the imaging field-of-view to the size of the animal.
  • the image of animal is bound to have wasted data with no information of the animal's features while the wasted data makes the image size larger than necessary.
  • the confocal laser scanning microscope described herein prevents waste of data, thus, requires less data storage space and reduces image analysis time.
  • the synchronization controller described herein can take advantage of an ultra-high speed DAQ card, it can improve the speed of any other optical imaging modality, including laser scanning microscopes, nonlinear imaging with or without temporal focusing, OCT, etc. while enabling oversampling of each pixel to improve SNR.
  • the confocal laser scanning microscope described herein demonstrates much faster imaging speed than the any commercial non-resonant confocal microscopes.
  • Our microscope requires 33 ms to take an image of 512 ⁇ 512 pixels.
  • a state-of-the-art non-resonant scanning confocal microscope from Olympus requires 125 ms to acquire the same image, which is nearly four times as long.
  • the confocal laser scanning microscope described herein can oversample, namely make a larger number of samples for pixel, while spending the same amount of time per pixel.
  • non-resonant confocal microscopes need a longer time to take an image as the number of pixels in an image increases.
  • the confocal laser scanning microscope described herein requires 33 ms to take an image of 7,000 ⁇ 512 pixels, while the Olympus non-resonant confocal microscope needs 1,712 ms to take the same image, which is nearly 52 times longer.
  • the confocal laser scanning microscope described herein offers a much larger FOV than other commercial resonant scanning confocal microscopes.
  • the confocal laser scanning microscope described herein can image up to 350 ⁇ m with a 40 ⁇ , 1.3NA objective, and up to 650 ⁇ m with 20 ⁇ , 0.95NA objective.
  • a state-of-the-art resonant scanning confocal microscope from Nikon can image up to 50 ⁇ m both vertically and horizontally with the same 40 ⁇ objective lens.
  • the confocal laser scanning microscope described herein offers a much larger field-of-view than commercial spinning disk confocal microscopes. Most commercial spinning disk confocal microscopes provide up to 100 ⁇ m by 100 ⁇ m field-of-view with a 40 ⁇ objective lens. They are limited by the camera sensor size and the pixel number to maintain the imaging speed. The confocal laser scanning microscope described herein provides a FOV larger than any other spinning disk confocal microscopes.
  • the confocal laser scanning microscope described herein generates a higher number of pixels per image.
  • the confocal laser scanning microscope described herein can generate an image with maximum 7000 ⁇ 4000 pixels (28 mega pixels) while the state-of-the-art resonant scanning confocal microscope from Nikon can generate an image with maximum 512 ⁇ 512 pixels (0.25 mega pixels).
  • the confocal laser scanning microscope described herein provides a high number of pixels per image and a larger field-of-view.
  • the confocal laser scanning microscope described herein can generate an image with maximum 7,000 ⁇ 4,000 pixels (28 mega pixels) while spinning disk confocal microscopes usually takes images with 1,024 ⁇ 1,024 pixels restricted by the camera peformance.
  • a camera with a larger number of pixels will not provide any benefit to spinning disk microscopes due to the low resolution of spinning disk and the cross-talk between pixels.
  • a larger pixel number will also slow down the imaging speed of spinning disk confocal microscopes.
  • the confocal laser scanning microscope described herein generates a comparable number of pixels per image but the confocal laser scanning microscope described herein provides a much greater imaging speed.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Chemical & Material Sciences (AREA)
  • Analytical Chemistry (AREA)
  • Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Engineering & Computer Science (AREA)
  • Electromagnetism (AREA)
  • Plasma & Fusion (AREA)
  • Computer Graphics (AREA)
  • Theoretical Computer Science (AREA)
  • Microscoopes, Condenser (AREA)
US15/547,615 2015-01-31 2016-01-29 High-speed laser scanning microscopy platform for high-throughput automated 3d imaging and functional volumetric imaging Abandoned US20180267284A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US15/547,615 US20180267284A1 (en) 2015-01-31 2016-01-29 High-speed laser scanning microscopy platform for high-throughput automated 3d imaging and functional volumetric imaging

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US201562110531P 2015-01-31 2015-01-31
US15/547,615 US20180267284A1 (en) 2015-01-31 2016-01-29 High-speed laser scanning microscopy platform for high-throughput automated 3d imaging and functional volumetric imaging
PCT/US2016/015643 WO2016123479A1 (fr) 2015-01-31 2016-01-29 Plate-forme de microscopie à balayage laser à haute vitesse pour l'imagerie 3d automatisée à débit de production élevé et imagerie volumétrique fonctionnelle

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2016/015643 A-371-Of-International WO2016123479A1 (fr) 2015-01-31 2016-01-29 Plate-forme de microscopie à balayage laser à haute vitesse pour l'imagerie 3d automatisée à débit de production élevé et imagerie volumétrique fonctionnelle

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US16/921,011 Continuation US11714270B2 (en) 2015-01-31 2020-07-06 High-speed laser scanning microscopy platform for high-throughput automated 3D imaging and functional volumetric imaging

Publications (1)

Publication Number Publication Date
US20180267284A1 true US20180267284A1 (en) 2018-09-20

Family

ID=56544387

Family Applications (2)

Application Number Title Priority Date Filing Date
US15/547,615 Abandoned US20180267284A1 (en) 2015-01-31 2016-01-29 High-speed laser scanning microscopy platform for high-throughput automated 3d imaging and functional volumetric imaging
US16/921,011 Active 2036-09-02 US11714270B2 (en) 2015-01-31 2020-07-06 High-speed laser scanning microscopy platform for high-throughput automated 3D imaging and functional volumetric imaging

Family Applications After (1)

Application Number Title Priority Date Filing Date
US16/921,011 Active 2036-09-02 US11714270B2 (en) 2015-01-31 2020-07-06 High-speed laser scanning microscopy platform for high-throughput automated 3D imaging and functional volumetric imaging

Country Status (2)

Country Link
US (2) US20180267284A1 (fr)
WO (1) WO2016123479A1 (fr)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111583292A (zh) * 2020-05-11 2020-08-25 浙江大学 一种面向双光子钙成像视频数据的自适应图像分割方法
US20210041363A1 (en) * 2018-09-07 2021-02-11 Suzhou Institute Of Biomedical Engineering And Technology, Chinese Academy Of Sciences Two-Photon Stimulated Emission Depletion Composite Microscope Using Continuous Light Loss
US20210048658A1 (en) * 2018-09-07 2021-02-18 Suzhou Institute Of Biomedical Engineering And Technology, Chinese Academy Of Sciences Composite Microscope Employing Two-Photon Excitation and Stimulated Emission Depletion Techniques

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106226894A (zh) * 2016-08-08 2016-12-14 中国科学院苏州生物医学工程技术研究所 一种双光子硬件同步控制装置
DE102017109455A1 (de) * 2017-05-03 2018-11-08 Carl Zeiss Microscopy Gmbh Mikroskopsystem und Verfahren zur Zeitsteuerung von Abläufen in einem Mikroskopsystem
CN107671426B (zh) * 2017-10-23 2023-11-03 深圳市杰普特光电股份有限公司 激光标刻装置及其标刻方法
EP3734345B1 (fr) * 2019-04-30 2023-08-02 Leica Microsystems CMS GmbH Dispositif de traitement d'image, système et procédé permettant d'améliorer le rapport signal-bruit d'images de microscopie

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6317258B1 (en) * 1999-03-19 2001-11-13 Olympus Optical Co., Ltd. Scanning confocal microscope
US20040233457A1 (en) * 2003-05-19 2004-11-25 Podoleanu Adrian Gh. Optical mapping apparatus with optimized OCT configuration
US20050110994A1 (en) * 2001-07-23 2005-05-26 Foster Thomas H. Method for operating a laser scanning confocal microscope system and a system thereof
US6982824B2 (en) * 2003-07-15 2006-01-03 Yokogawa Electric Corporation Three-dimensional confocal microscope system
US20090097108A1 (en) * 2005-05-12 2009-04-16 Fox William J Confocal scanning microscope having optical and scanning systems which provide a handheld imaging head
US8194311B2 (en) * 2007-12-13 2012-06-05 Nikon Corporation Scanning laser microscope

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5283433A (en) 1992-10-05 1994-02-01 The Regents Of The University Of California Scanning confocal microscope providing a continuous display
US5539764A (en) * 1994-08-24 1996-07-23 Jamar Technologies Co. Laser generated X-ray source
US5880880A (en) 1995-01-13 1999-03-09 The General Hospital Corp. Three-dimensional scanning confocal laser microscope
US7158294B2 (en) 2001-12-18 2007-01-02 Olympus Optical Co., Ltd. Laser scanning confocal microscope apparatus, image recording method, and recording medium
US20060197867A1 (en) * 2005-03-02 2006-09-07 Peter Johnson Imaging head and imaging system
WO2008081729A1 (fr) 2006-12-22 2008-07-10 Nikon Corporation Microscope confocal à balayage laser
WO2009075345A1 (fr) * 2007-12-13 2009-06-18 Nikon Corporation Microscope à balayage laser
US20120287949A1 (en) * 2011-05-13 2012-11-15 Xtera Communications, Inc. Polarization multiplexed signaling using time shifting in return-to-zero format
US8995746B2 (en) * 2013-03-15 2015-03-31 KLA—Tencor Corporation Image synchronization of scanning wafer inspection system

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6317258B1 (en) * 1999-03-19 2001-11-13 Olympus Optical Co., Ltd. Scanning confocal microscope
US20050110994A1 (en) * 2001-07-23 2005-05-26 Foster Thomas H. Method for operating a laser scanning confocal microscope system and a system thereof
US20040233457A1 (en) * 2003-05-19 2004-11-25 Podoleanu Adrian Gh. Optical mapping apparatus with optimized OCT configuration
US6982824B2 (en) * 2003-07-15 2006-01-03 Yokogawa Electric Corporation Three-dimensional confocal microscope system
US20090097108A1 (en) * 2005-05-12 2009-04-16 Fox William J Confocal scanning microscope having optical and scanning systems which provide a handheld imaging head
US8194311B2 (en) * 2007-12-13 2012-06-05 Nikon Corporation Scanning laser microscope

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210041363A1 (en) * 2018-09-07 2021-02-11 Suzhou Institute Of Biomedical Engineering And Technology, Chinese Academy Of Sciences Two-Photon Stimulated Emission Depletion Composite Microscope Using Continuous Light Loss
US20210048658A1 (en) * 2018-09-07 2021-02-18 Suzhou Institute Of Biomedical Engineering And Technology, Chinese Academy Of Sciences Composite Microscope Employing Two-Photon Excitation and Stimulated Emission Depletion Techniques
US11550134B2 (en) * 2018-09-07 2023-01-10 Suzhou Institute Of Biomedical Engineering And Technology, Chinese Academy Of Sciences Composite microscope employing two-photon excitation and stimulated emission depletion techniques
US11906429B2 (en) * 2018-09-07 2024-02-20 Suzhou Institute Of Biomedical Engineering And Technology, Chinese Academy Of Sciences Two-photon stimulated emission depletion composite microscope using continuous light loss
CN111583292A (zh) * 2020-05-11 2020-08-25 浙江大学 一种面向双光子钙成像视频数据的自适应图像分割方法

Also Published As

Publication number Publication date
WO2016123479A1 (fr) 2016-08-04
US20200333574A1 (en) 2020-10-22
US11714270B2 (en) 2023-08-01

Similar Documents

Publication Publication Date Title
US11714270B2 (en) High-speed laser scanning microscopy platform for high-throughput automated 3D imaging and functional volumetric imaging
US11946854B2 (en) Systems and methods for two-dimensional fluorescence wave propagation onto surfaces using deep learning
Olarte et al. Light-sheet microscopy: a tutorial
US10802263B2 (en) Imaging signal extraction apparatus and methods of using same
Liebling et al. Rapid three‐dimensional imaging and analysis of the beating embryonic heart reveals functional changes during development
Gong et al. High-throughput dual-colour precision imaging for brain-wide connectome with cytoarchitectonic landmarks at the cellular level
Holekamp et al. Fast three-dimensional fluorescence imaging of activity in neural populations by objective-coupled planar illumination microscopy
Dupont et al. Nanoscale three-dimensional single particle tracking
US7608840B2 (en) System and method employing photokinetic techniques in cell biology imaging applications
Follain et al. Seeing is believing–multi-scale spatio-temporal imaging towards in vivo cell biology
US11530990B2 (en) Light-sheet microscope with parallelized 3D image acquisition
US20090091566A1 (en) System and methods for thick specimen imaging using a microscope based tissue sectioning device
US10281399B2 (en) Systems and methods for particle tracking using spatiotemporal offset light beams
KR20230040306A (ko) 생세포 생물학적 샘플의 형광 이미지의 포착 방법 및 시스템
Otomo et al. descSPIM: affordable and easy-to-build light-sheet microscopy for tissue clearing technique users
Qi et al. High-throughput confocal airy beam oblique light-sheet tomography of brain-wide imaging at single-cell resolution
Klauss et al. Upgrade of a scanning confocal microscope to a single-beam path STED microscope
Wei et al. 3D deep learning enables fast imaging of spines through scattering media by temporal focusing microscopy
Li et al. Ten-kilohertz two-photon microscopy imaging of single-cell dendritic activity and hemodynamics in vivo
Quang et al. Superresolution measurements in vivo: imaging Drosophila embryo by photoactivated localization microscopy
Karagyozov et al. Recording neural activity in unrestrained animals with 3D tracking two photon microscopy
Chen et al. Bridging scales in scattering tissues via multifocal two-photon microscopy
WO2023061068A1 (fr) Tomographie par sectionnement à excitation par ultraviolets rapide translationnelle assistée par apprentissage profond
Zhao et al. Two-Photon Synthetic Aperture Microscopy for Minimally Invasive Fast 3D Imaging of Native Subcellular Behaviors in Deep Tissue
Saska et al. μSPIM: A Software Platform for Selective Plane Illumination Microscopy

Legal Events

Date Code Title Description
AS Assignment

Owner name: NATIONAL INSTITUTES OF HEALTH (NIH), U.S. DEPT. OF

Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF TEXAS, AUSTIN;REEL/FRAME:044063/0915

Effective date: 20170921

AS Assignment

Owner name: BOARD OF REGENTS, THE UNIVERSITY OF TEXAS SYSTEM,

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BEN-YAKAR, ADELA;KIM, KI HYUN;HEGARTY, EVAN;AND OTHERS;SIGNING DATES FROM 20150210 TO 20150325;REEL/FRAME:044842/0743

STPP Information on status: patent application and granting procedure in general

Free format text: DOCKETED NEW CASE - READY FOR EXAMINATION

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: NON FINAL ACTION MAILED

STPP Information on status: patent application and granting procedure in general

Free format text: RESPONSE TO NON-FINAL OFFICE ACTION ENTERED AND FORWARDED TO EXAMINER

STPP Information on status: patent application and granting procedure in general

Free format text: FINAL REJECTION MAILED

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION