WO2021077075A1 - Virtual fiducials - Google Patents
Virtual fiducials Download PDFInfo
- Publication number
- WO2021077075A1 WO2021077075A1 PCT/US2020/056302 US2020056302W WO2021077075A1 WO 2021077075 A1 WO2021077075 A1 WO 2021077075A1 US 2020056302 W US2020056302 W US 2020056302W WO 2021077075 A1 WO2021077075 A1 WO 2021077075A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- detector
- fiducial
- lens
- objective lens
- microscope
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/24—Base structure
- G02B21/241—Devices for focusing
- G02B21/245—Devices for focusing using auxiliary sources, detectors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0032—Optical details of illumination, e.g. light-sources, pinholes, beam splitters, slits, fibers
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/006—Optical details of the image generation focusing arrangements; selection of the plane to be imaged
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/0076—Optical details of the image generation arrangements using fluorescence or luminescence
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B27/00—Optical systems or apparatus not provided for by any of the groups G02B1/00 - G02B26/00, G02B30/00
- G02B27/32—Fiducial marks and measuring scales within the optical system
- G02B27/34—Fiducial marks and measuring scales within the optical system illuminated
-
- G—PHYSICS
- G01—MEASURING; TESTING
- G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
- G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
- G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
- G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
- G01N21/64—Fluorescence; Phosphorescence
- G01N21/645—Specially adapted constructive features of fluorimeters
- G01N21/6456—Spatial resolved fluorescence measurements; Imaging
- G01N21/6458—Fluorescence microscopy
Definitions
- the present invention relates to a microscope.
- the invention relates to a microscope for focusing on and locating structures at a partially reflective interface where multiple partially reflective interfaces are present.
- nucleotides which are characteristic chemical moieties of nucleotides which constitute nucleic acids.
- Rare bases have also been found in nature, such as 5-methylcytosine and other methylated bases, 5-hydroxym ethyl cytosine, 5 -formyl cytosine, and 5 -carbosyl cytosine.
- Other noncan onical bases include isoguanine, isocytosine, and universal bases such as inosine.
- nucleotides can be detected using fluorescent labeling specific to each type of nucleobase.
- the types of fluorescent labeling include direct labeling by covalent labeling of nucleic acids with a fluorescent label or noncovalent binding or intercalation of a fluorescent dye to nucleic acids, and indirect labeling via covalent attachment of a secondary label to a nucleic acid, and then binding this to a fluorescently labeled ligand binder.
- An alternative indirect strategy involves binding of a nucleic acid to a nucleic acid binder molecule (e.g., antibody, antibiotic, histone, antibody, nuclease) that is labeled with a fluorophore.
- Fluorescent labels for nucleic acids include organic fluorescent dyes, metal chelates, carbon nanotubes, quantum dots, gold particles, and fluorescent minerals.
- the fluorescent labels preferably fluoresce at unique wavelengths when exposed to a broadband optical source, thereby providing a method for identification of each of the subject nucleotides in a two dimensional (2D) spatial image.
- the fluorescent labels are bound to the nucleotides, which are located on the surfaces of the fluidic channel, and unnecessary exposure of the fluorescent labels to the excitation source causes photobleaching, a temporal phenomenon where excitation of the label results in a decreased fluorescence optical output over time.
- This is a problem in the prior art where the label activation energy is applied, and the microscope is focused by using the fluorescent labels as the focus target, thereby exposing the labels to photobleaching energy during the microscope focusing interval. Because the fluorescent labels are small and the magnification large, the range of microscope image focus is short, and the fluorescent labels do not appear until in the narrow range of sharp focus.
- imaging acquisition speed is a very important factor for the throughput of imaging-based DNA sequencers.
- imaging time has been shortened by increasing the number of cameras used to image multiple regions in parallel.
- the invention provides an optical scheme that employs a significantly larger field of view and a sensor that significantly improves the image-capturing speed without the complexity of current DNA sequencers.
- a first object of the invention is a microscope having an illuminated fiducial pattern which is positioned a fiducial lens focal length from a fiducial lens, the optical energy from the fiducial lens directed to a beam splitter and to an objective lens positioned an adjustable distance from a flow cell having inner surfaces, the objective lens on the optical axis of a detector lens, the detector lens receiving optical energy which passes through the beam splitter and focuses the optical energy to a detector, the microscope thereby configured to position the fiducial pattern onto a change in refractive index of the flow cell sufficient to form a partially reflective interface and provide for focusing the microscope onto an inner surface of the fluidic channel.
- a second object of the invention is a method for imaging the inner surface of a fluidic channel at an interface having a change in refractive index, the method comprising forming collimated fiducial pattern optical energy and directing the collimated fiducial pattern optical energy to an objective lens an adjustable distance from the flow cell, where optical energy reflected from the fluidic channel interface is directed to a detector lens and focused onto a detector, the method comprising first adjusting the adjustable distance until the fiducial pattern presents as a focused image at the detector, and subsequently illuminating the flow cell with optical energy operative to fluoresce labels at an inner surface of the fluidic channel and forming an image at the detector.
- a third object of the invention is a system for detecting a discontinuity in index of refraction forming a partially reflective optical interface, the system comprising a fiducial pattern generator forming a collimated image, the collimated image directed to an objective lens such as through a beam splitter, the objective lens positioned a variable focal length from the discontinuity in index of refraction forming a partially reflective optical interface, reflected optical energy from the partially reflective interface directed through the objective lens and to a detector lens and a detector positioned a focal length from the detector lens.
- a fourth object of the invention is a method for locating a surface of a fluidic channel, the method comprising: directing collimated optical energy from a fiducial pattern through an objective lens positioned an adjustable distance from a surface of the fluidic channel; directing reflected optical energy from the surface of the fluidic channel through the objective lens through a detector lens and to a detector positioned a detector lens focal length from the detector lens; adjusting the distance from the objective lens to the flow cell until a focused image of the fiducial pattern is present in the detector.
- a fifth object of the invention is a method for imaging fluorescent labels adjacent to an inner surface of a fluidic channel, the method comprising: directing collimated optical energy from a fiducial pattern through an objective lens an adjustable length from the inner surface of the fluidic channel; directing reflected optical energy from the inner surface of the fluidic channel through the objective lens to a detector lens and to a detector positioned a detector lens focal length from the detector lens; adjusting the distance from the objective lens to the fluidic channel inner surface until a focused image of the fiducial pattern is present in the detector; illuminating the flow cell with optical energy, causing the labels to fluoresce and provide a focused image at the detector.
- a sixth object of the invention is a system and method for high-resolution and large-field imaging.
- a microscope provides for imaging fine structures such as fluorescent labeled nucleotides at the inner surface of a fluidic channel.
- the microscope provides for the location of an upper or lower inner surface of a fluidic channel and subsequent measurement of structures such as fluorescent labeled nucleotides which are adjacent to the upper or lower inner surface of the fluidic channel.
- a fluidic channel has substantially planar upper or lower interior surfaces in a region of desired observation.
- the substantially planar interior surface is within an adjustable distance which includes the focal distance of an objective lens when the fluidic channel is present.
- a detector lens is positioned on the same axis as the objective lens, and a detector is positioned a detector lens focal length from the detector lens.
- an illuminated image mask with a fiducial pattern is positioned a fiducial lens focal length from a fiducial lens and substantially perpendicular to the axis of the objective lens.
- Preferably low intensity illumination energy from the fiducial lens is directed to a beam splitter located between the objective lens and detector lens, which directs the optical energy from the fiducial lens to the objective lens, where it forms an image of the fiducial pattern a focal length from the objective lens, causing focused or unfocused optical energy to be reflected from the discontinuity in index of refraction at the substantially planar inner surface of the fluidic channel.
- the objective lens is a focal length from the substantially planar surface of the fluidic channel
- focused reflected optical energy from the objective lens travels to the detector lens and forms a focused image of the fiducial pattern on the detector, providing the ability to precisely locate the inner surface and perform measurements with respect to that surface.
- the objective lens has a focal length which is preferably short to provide a minimum depth of field for measurement of adjacent structures to be measured.
- the combined flow cell top layer thickness and fluidic channel depth is constrained to be smaller than the focal length of the objective to ensure the ability of the microscope to focus on both the upper and lower inner surface of the fluidic channel.
- imaging is performed of the fluorescent features adjacent to the fluidic channel surface using high intensity optical energy suitable for imaging fluorescent labels associated with the nucleotides.
- a focused image of the fluorescent labels is thereby provided to the detector, and the low intensity fiducial illumination energy prior to the application of fluorescent label illumination energy greatly reduces undesired photobleaching.
- the invention provides a high-resolution lens system with a substantially larger field of view than conventional microscopes, coupled with high resolution imaging sensors with substantially larger pixel counts (>30 megapixels).
- Figure 1 is a section view 100 of a microscope according to an aspect of the invention.
- Figure 2 is a perspective view of a flow cell of figure 1.
- Figure 3 is a projection view of example fiducial masks for use with the microscope of figure 1.
- Figure 4 is a section view 400 of a microscope according to another aspect of the invention.
- Figure 5A is an example fiducial mask for focusing the microscope of figures 1 and 4.
- Figures 5B, 5C, 5D, 5E are intensity profiles as measured at a detector for objective separation distances from a flow cell.
- Figure 6 is a checkerboard fiducial pattern.
- Figure 7 is an example flow cell construction.
- the lower glass plate 704 can be opaque.
- Figure 8 A shows a detail view of a flow cell with a plurality of partially reflective interfaces.
- Figure 8B shows an example checkerboard fiducial pattern.
- Figure 8C shows an example detector image of the fiducial pattern of figure 8B.
- Figure 8D shows a detail view of a fiducial of figure 8B.
- Figure 9 illustrates the use of a DMD 901 to generate a fiducial pattern.
- Figure 1 shows a microscope according to an aspect of the invention. Reference coordinates x, y, and z are shown in each drawing figure for reference to other drawing figures.
- a fluidic channel 120 is formed in transparent housing 122, and includes a substantially planar inner surface 116.
- the index of refraction for the housing 122 is selected to be different from the index of refraction of a fluid being transported in the fluidic channel 120 by a ratio sufficient to form a partially reflective interface, such as one returning at least .06% of the incident optical energy, corresponding to a difference of index of refraction of at least 5% greater or smaller, or a minimum difference of 1% greater or smaller index of refraction at the partially reflective interface, returning ⁇ 25ppm of the incident optical energy.
- An example reflective interface is formed by the case of glass (1.5) over water (1.33), and a larger ratio of the two refractive indices is preferable, as the ratio is proportional to the reflected optical energy which is directed to the detector or sensor 102 for image formation and the change in index of refraction forms a reflective interface at the glass/liquid interface.
- each partially reflective surface is reflecting a percentage of the incoming optical energy according to the well- known Fresnel ratio where: n 1 and n2 are the index of refraction sequence as encountered by the incoming optical energy;
- R is the coefficient of reflection returned by the partially reflective interface.
- the optical energy transmitted through the subsequent optical interface T is 1 -R for the subsequent optical interface.
- the increased proportion of reflected optical energy improves resolution and reduces the required optical energy to perform the initial focusing of the microscope on the fluidic channel inner surface.
- the optical energy of the fiducial optical source may be on the order of 1/10, 1/100, 1/1000,
- the improved focus accuracy thereby provides for greater accuracy and resolution in establishing the objective lens to reflective surface focusing, greatly reducing the photobleaching of the fluorescent labels, since the reduced optical energy of the fiducial source is well below the photobleaching threshold.
- Optical source 146 generates uncollimated optical energy which backlights fiducial image mask 110 projecting the image mask pattern onto fiducial lens 108.
- Image mask 110 comprises patterns formed in optically opaque and transparent features, the fiducial image mask 110 being a focal length L2 142 from fiducial lens 108, resulting in collimated optical energy which reflects from beam splitter 106 to objective lens 112 on axis 150, where it is focused at an image plane a focal length below objective 112 and reflected by the index of refraction discontinuity at the inner surface 116 of the fluidic channel 120.
- the fiducial image is projected into the inner surface 116, and when the distance L3 144 from the objective lens 112 to the inner surface 116 is equal to the focal length of objective lens 112, a sharp image will be reflected by the inner surface 116.
- the image focal plane at 114 results in the reflection of an out-of-focus image at the inner surface 116 where the discontinuity in refractive index (and reflective surface) is located.
- a shorter distance L3 144 will result in a sharp focal plane at 118, whereas optical energy reflected from the index of refraction discontinuity at surface 116 will similarly be out-of-focus.
- the particular nature of the out-of-focus fiducial image patterns which are reflected to the detector 102 are governed by the well- known circle of confusion and point spread function, and are dependent on the particular fiducial image pattern in use.
- objective lens 112 When objective lens 112 is focused on the fiducial image in focus at inner surface 116, reflected optical energy is collimated by objective lens 112, and travels on optical axis 150 through beam splitter 106 to detector lens 104 (such as a tube lens) which is a fixed focus separation LI 140 from detector 102, thereby forming a focused image from inner surface 116 onto detector 102.
- detector lens 104 such as a tube lens
- objective lens 112 focal length is variable, such as by moving a stage holding the flow cell assembly 120/122 with respect to the objective lens 112 along the z-axis shown in figure 1.
- Fiducial lens 108 is a fixed focal length L2 142 from the fiducial pattern of fiducial mask 110, and the detector 102 is a fixed focal length LI 140 from detector lens 102.
- the displacement of the inner surface 116 such as by movement of flow cell assembly 120/122 in the z axis until a sharp focus of the fiducial pattern occurs at detector 102 provides for a precise determination of the inner surface 116.
- Figure 4 shows an example of the invention providing the focusing function described in figure 1 , with additional capability for multiple wavelength fluorescent label imaging.
- Reference numbers performing the same function as the structures of other figures use the same reference numbers.
- the operation of focusing on an inner surface 116 of the fluidic channel 120 occurs as was previously described by adjusting distance L3 144 until a sharp image of the fiducial pattern 110 is present on a detector 102 (also referred to as a fiducial detector where multiple detectors are present).
- an external fluorescent label optical source (not shown) illuminates the field of the fluidic channel 120, causing the fluorescent labels associated with nucleotides on an inner surface 116 of the fluidic channel to emit optical energy, each fluorescent label emitting optical energy in a unique wavelength from other fluorescent labels, resulting in a multi-colored fluorescent label pattern to be directed along optical axis 150 through beam splitter 106 and to beam splitter 103.
- Optical energy is directed to lens 104B to fluorescent label detector 102B and also to lens 104 A to fluorescent label detector 102 A.
- the invention may be operative using any number of lens/beam splitter/detector optical paths, one for each range of wavelengths emitted by a particular fluorescent label.
- four fluorescent-label optical paths and associated fluorescent label detectors may be used, each responsive to an associated fluorescent label.
- Each detector path (comprising dichroic reflector or beam splitter, detector lens, and detector) is typically sensitive to a range of wavelengths associated with the emitted wavelength of a particular fluorescent label.
- beam splitter 103 has a dichroic reflective coating which reflects a specified range of wavelengths to fluorescent label detector 102B, and passes other wavelengths to fluorescent label detector 102A with minimal transmission loss.
- a cascaded series of dichroic reflectors 103 can be provided on the optical axis 150, each dichroic reflector, lens, and detector associated with a particular fluorescent label wavelength.
- a single multi-wavelength color detector may be used which has sufficient spatial resolution and wavelength resolution to display the fluorescent labels in a separable form by wavelength.
- a four or five channel detector may be used which is specific to the particular wavelengths, or the RGB channels may be linearly combined to isolate the RGB image response into the particular fluorescent wavelengths.
- lenses 104, 108, and 112 are anti-reflective or have achromatic coatings as previously described.
- the optical source 146 may be a narrowband visible optical source such as a light emitting diode (LED) to reduce chromatic aberration and chromatic distortion of the lenses 104, 108, and 112.
- the image mask 110 is a quartz or glass substrate with patterned chrome forming the fiducial pattern deposited on the substrate surface facing fiducial lens 108 with the patterned chrome positioned at the focal plane of lens 108. It will be appreciated that the optical paths may incorporate additional components such mirrors, lenses, beam splitters and optical sources, so long as he essential features of the optical path of the invention is maintained.
- Figure 2 shows an example fluidic channel formed from a material which is transparent to the wavelength used for fiducial illumination as well as for the fluorescent marker wavelengths.
- Figure 3 shows example fiducial patterns 302 and 304 which may be applied to fiducial mask 110A and 110B, respectively.
- Fiducial pattern 302 formed of concentric circles may be useful where it is desired to correct non- planarity of the inner surface 116 when it is undesirably tilted with respect to the x-y plane, as the out of focus regions will indicate direction and angle of the tilt for correction.
- fiducial pattern 304 formed of an array of lines or other patterns that have features predominantly in the x-axis or y-axis may be used for automatic focusing using the detector response along a single line of detector photosensors approximately perpendicular to the array of lines.
- the fiducial patterns may include patterns with particular separation distances to enable visual measurements of structures bound to the surface 116 in the x and y directions.
- an automated focus operation is performed by a mechanical system which adjusts the separation distance L3 144 until a minimal fiducial pattern width and maximum amplitude difference is achieved.
- Figure 5A shows an example fiducial focal mask pattern
- figures 5B, 5C, and 5D show the detector response as the distance L3 is varied.
- An out of focus detector response (along a single line of the 2D detector) is shown as the plot of figure 5B.
- the fiducial detector response along this single line of the detector has the spatial detector response shown in figures 5C and 5D, with fiducial detector response plot 510 corresponding to optimum focus.
- fiducial detector response progresses in sequence to plots 508, 506, and 504.
- One difficulty of an automated focus algorithm is that it may attempt to auto-focus on the fiducial pattern 502 of figure 5 A with the fiducial detector producing the output of plot 504 for a large fraction of the focal range, which is indeterminate for direction of flow cell movement for optical focus.
- An alternative fiducial pattern is shown in figure 6 as an alternating checkerboard pattern comprising fine structures and coarse structures, thereby providing a coarse focus on the structures 602 and intervening gaps 604, after which the focus algorithm may operate on the fiducial lines of 602 as was described for figures 5A to 5E.
- the detector 102 may be a semiconductor or solid state detector array, or alternatively an eyepiece for direct observation.
- the detector 102 is a 2D array of photosensor cells with sufficient density of photosensor cells to form a sharp image of a focused fiducial pattern.
- the density of photosensor cells is at least 4 resolution linewidths of the linewidth of a fiducial pattern focused onto the detector.
- the photosensor cell density is such that at least four photosensors are covered by a fiducial pattern when the microscope is focused.
- the beam splitter 106 may be a dichroic coating or partially reflective surface on an optically transmissive non-dispersive substrate such as glass.
- the reflective coating may be on the order of 5% reflective and 95% transmissive, and the optical intensity of source 146 is selected to form a reflected image at surface 116 with at least 6db signal-to-noise ratio (SNR).
- SNR signal-to-noise ratio
- the transparent housing 122 is preferably a material with a different index of refraction from the index of refraction of the fluid being conveyed in channel 120, and sufficiently different to form an optically reflective interface sufficient to form an image at the detector.
- Figure 7 shows an example fluidic channel 708 formed by a void in adhesive 706 which separates upper and lower glass plates 702 and 704.
- the lower glass plate 704 can be opaque or relatively less transparent than the upper glass plate 702.
- a disadvantage of the checkerboard pattern of figure 6 is that where multiple reflective interfaces are present, blurring of the fiducial pattern 602 may occur from the out-of-focus images from the other reflective interfaces above and below the desired reflective interface of the fluid channel which superimpose onto the desired fiducial image from the desired reflective interface.
- the previously computed result shows ⁇ 10x more optical energy returned to the detector from air/glass interface 810 than from the glass/water reflection at interface 116 of figure 8A.
- figure 8B shows another example of an alternating checkboard pattern which reduces the influence of multiple reflective layers of the flow cell, such as upper reflective surface 810 which is a strong reflector in the present example, its reflection competing with the desired inner upper reflective interface 116 which is the focusing objective, and lower reflective interface 812 of fluidic channel 708 with spacer 706 as previously described.
- Objective lens 112 may focus the fiducial image onto a desired reflective interface 116, however upper reflective surface 810 and lower reflective interface 812 also contribute reflective optical energy which is superimposed onto the desired reflective interface 116 response.
- the alternating checkerboard pattern of figure 8B comprises the fiducial patterns 802 arranged such as at regular intervals within large open regions 804.
- Figure 8D shows figure 8B with detail view 820 of each fiducial, which may be any pattern as previously described, and shown as horizontal lines 830 in figure 8D.
- Figure 8C shows the resultant image at the detector.
- the advantage of using the sparsely arranged fiducial pattern becomes clear when viewing the resultant detector image of figure 8C, where a focused image has the pattern 822 representing the focused pattern 830, but also includes a weak (comparatively dim compared to pattern 822) circle of confusion artifact 824 from the defocused fiducial reflecting from lower surface 812, as well as a very strong circle of confusion artifact 826 reflecting from top surface 810, which is returning ⁇ 10x more optical energy than the desired fiducial image 802 as previously computed.
- each artifact 824 and 826 may be determined by ray -tracing geometry from lens 112 of figure 8A, such that the upper reflective surface artifact 826 may be approximated by the intersection of rays 811 with the upper surface 810, and lower reflective surface artifact 824 may be approximated by the intersection of rays 811 with the lower surface 812, each respectively forming a circle of confusion artifact and the detector, in the approximation where the fiducial extent 802 is negligible dimension compared to the separation distance from reflective surfaces 116 to 812 or from reflective surfaces 116 to 810.
- the resulting circles of confusion 824 and 826 will change diameter in opposite direction while the focal point is changed between surfaces 810 and 812, and the dimensions of each circle of confusion will indicate the separation distance to a desired reflective interface such as 116 and may be used for initial focusing.
- the desired reflective interface 116 may therefore be determined from the diameter of the circle of confusion artifacts 824 and 826 in combination with the reflective surface spacings of the flow cell, and thereafter the focus algorithm can change to one of finely adjusted using the pattern of the fiducial itself, such as 830, as was previously described for figures 5 A to 5E.
- fiducial patterns 802 of figure 8B it may be desirable to arrange the spacing between fiducial patterns 802 of figure 8B to ensure that the circle of confusion artifact 826 does not enter into an adjacent fiducial pattern for reasonable fluidic channel/objective separation distances. It may also be desirable to arrange the separation distances between 810/116 and 116/812 forming the plurality of reflective interfaces to minimize the influence of the circle of confusion artifacts 824 and 826 on the desired fiducial image 822.
- references to within an order of magnitude of a nominal value include the range of 1/10th of the nominal value to 10 times the nominal value, such as about 10%, 20%, 30%, 40%, 50%, 60%, 70%, 80%,
- a reference to an approximate value is understood to be within the range of 1/2 of the nominal value to 2x the nominal value, such as about 60%, 70%, 80%, 90%, 110%, 120%, 130%, 140%, 150%, 160%, 170%, 180% or 190%.
- any arbitrary angle of the beam splitter 106 may be selected which provides illumination of the fiducial image onto surface 116, such as about 20°, 30°, 40°, 45°, 50°, 60°, 70°, 80°, 90°, 100°, 110°, 120°, 130°, 135 ° , 140 ° , 150 ° or 160 ° .
- the substantially planar region of the fluidic channel is understood to be sufficiently planar to provide a region of focus, such that the variation in diameter in the circle of confusion from one region to another varies by less than a factor of 10.
- the microscope may operate correctly where the substantially planar region of the fluidic channel is tilted from the optical axis, or non-planar, but with a restricted region of focus, which will only limit the extent of focused fiducial image and extent of focused fluorescent label detector image.
- substantially planar is understood to only refer to the region of the image which is focused or can be focused.
- the invention provides a high-resolution lens system with a substantially larger field of view than conventional microscopes, coupled with high resolution imaging sensors with substantially larger pixel counts (>30 megapixels).
- Wavelength 500nm to 720nm is a useful range.
- Other useful wavelengths include a range between any of lOnm, 20nm, 50nm, lOOnm, 200nm, 250nm, 300nm, 350nm (typically ultraviolet), 380nm, 400nm, 450nm, 500nm, 550nm, 600nm, 650nm, 700nm, 740nm (typically visible), 750nm, 800nm, 900nm, lpm, l Omih, 100 pm, and 1mm (typically infrared).
- Magnification: 4x to 6x is a useful range. Other ranges include from any of lx, 2x, 3x, or 4x to any of 6x, 7x, 8x, 9x, lOx, 12x, 14x, 16x, 18x, or 20x. Magnification greater than 6x can be used with a larger imaging sensor.
- NA Numerical Aperture
- Other ranges include between any of 0.2, 0.25, 0.3, 0.35, 0.4, 0.45, 0.5, 0.55, 0.6, 0.65, 0.7, 0.75, 0.8, 0.85, 0.9, 1.0, 1.1, 1.2, 1.3, 1.4, 1.5, and 1.53.
- Resolution can be ⁇ 1 pm, or better than 500 line pairs per mm
- Other ranges include between any of 300nm, 350nm, 400nm, 450nm, 500nm, 600nm, 700nm, 800nm, 900nm, lOOOnm, 1 lOOnm, 1200nm, 1300nm,
- FOV Field of View
- Other useful FOVs include at least 4, 5, 6, 7, 8, 9, 10, 12, 15, 20, 25, 30, 40, 45, 50, 60, 70, 80, 90, 100, 200, 500, 750, and 1000 mm 2 .
- Top Solid support thickness typically 170-250 pm
- Top Solid support refractive index typically 1.50-1.53
- Aqueous layer thickness typically 170-250 pm
- Tube Lens Aperture diameter typically 35 to 60mm. Other ranges include between any of 30, 35, 40, 45, 50, 55, 60, and 65nm. Other ranges can be selected to be compatible with the objective and the size of the beam splitter.
- the large field of view requires a high degree of flatness for the substrate and thus requires more stringent manufacturing tolerances for the flow cell. This can be addressed by taking multiple images at different focal points and using computational imaging algorithms to extract signal from the sample across the whole field of view.
- the fluorescent background from the thick bottom solid support and any debris under the flow cell can obscure detection of the signal from the sample surfaces.
- This can be significantly reduced or virtually eliminated by the use of non-transparent low-fluorescence substrate material that is also biochemically compatible with sequencing protocols, such as UG-1 glass (Schott AG, Mainz, Germany), which is opaque in the visible range where sequencing imaging is carried out.
- UG-1 glass Schott AG, Mainz, Germany
- the use of opaque glass as the solid support of the flow cell reduces the fluorescent background.
- a patterned illumination generated by devices such as a Digital Micromirror Device (DMD) and use of computational methods.
- DMD Digital Micromirror Device
- a DMD 901 can be used — not only to generate illumination — but also to generate and control a fiducial pattern.
- Such a DMD can be used for fiducial focusing, since multiple patterns can be configured during imaging and focusing, which can optimize workflows by maximizing speed, quantifying tilt, and adapting to unexpected signals.
- the magnification and resolution of the lens system should match or correspond to the pixel size, feature density, feature size, and the sensing area of the imaging sensor to optimize image acquisition speed.
- the illumination light source should also produce sufficient power density and intensity uniformity at the sample surface(s).
- the embodiment provides surprisingly low fluorescence background and the large-field-of-view image with very high resolution. Improved performance can be measured by total imaging time per cycle (taking into account channel-switching and settling time), sensitivity for distinguishing bases, read length, and total run time.
- the embodiment can have applications in high-throughput cell imaging, such as for drug screening.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Microscoopes, Condenser (AREA)
- Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)
- Health & Medical Sciences (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Life Sciences & Earth Sciences (AREA)
- Biochemistry (AREA)
- General Health & Medical Sciences (AREA)
- Immunology (AREA)
- Pathology (AREA)
Abstract
Description
Claims
Priority Applications (6)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202080073343.4A CN114585958B (en) | 2019-10-19 | 2020-10-19 | Microscope and method for imaging fluorescent markers in a fluid channel |
EP20876361.5A EP4031922A4 (en) | 2019-10-19 | 2020-10-19 | Virtual fiducials |
JP2022523406A JP2022552743A (en) | 2019-10-19 | 2020-10-19 | virtual reference |
KR1020227016636A KR20220084147A (en) | 2019-10-19 | 2020-10-19 | virtual reference |
AU2020366521A AU2020366521B2 (en) | 2019-10-19 | 2020-10-19 | Virtual fiducials |
CA3158318A CA3158318A1 (en) | 2019-10-19 | 2020-10-19 | Virtual fiducials |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US16/658,052 US10895727B1 (en) | 2019-10-19 | 2019-10-19 | Microscope for locating structures on the inner surface of a fluidic channel |
US16/658,052 | 2019-10-19 | ||
US202016824632A | 2020-03-19 | 2020-03-19 | |
US16/824,632 | 2020-03-19 |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2021077075A1 true WO2021077075A1 (en) | 2021-04-22 |
Family
ID=75538690
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2020/056302 WO2021077075A1 (en) | 2019-10-19 | 2020-10-19 | Virtual fiducials |
Country Status (7)
Country | Link |
---|---|
EP (1) | EP4031922A4 (en) |
JP (1) | JP2022552743A (en) |
KR (1) | KR20220084147A (en) |
CN (1) | CN114585958B (en) |
AU (1) | AU2020366521B2 (en) |
CA (1) | CA3158318A1 (en) |
WO (1) | WO2021077075A1 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114280806A (en) * | 2022-02-10 | 2022-04-05 | 中国人民解放军陆军装甲兵学院 | Light collimation method based on kinoform |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2010103389A1 (en) | 2009-03-11 | 2010-09-16 | Sensovation Ag | Autofocus method and autofocus device |
US20120002031A1 (en) * | 2008-12-02 | 2012-01-05 | The Regents Of The University Of California | Imaging Arrangement and Microscope |
US20150031051A1 (en) * | 2012-07-25 | 2015-01-29 | Theranos, Inc. | Image analysis and measurement of biological samples |
WO2016061484A2 (en) | 2014-10-16 | 2016-04-21 | Illumina, Inc. | Optical scanning systems for in situ genetic analysis |
US20180120553A1 (en) * | 2016-10-27 | 2018-05-03 | Scopio Labs Ltd. | System for image reconstruction using a known pattern |
US20180149855A1 (en) * | 2015-04-23 | 2018-05-31 | The University Of British Columbia | Multifocal method and apparatus for stabilization of optical systems |
Family Cites Families (28)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP3265668B2 (en) * | 1993-01-13 | 2002-03-11 | 株式会社ニコン | How to calculate the best focus position |
JP3619571B2 (en) * | 1995-06-06 | 2005-02-09 | オリンパス株式会社 | Focus detection apparatus and design method for optical microscope |
JPH09133856A (en) * | 1995-11-07 | 1997-05-20 | Nikon Corp | Automatic focus detecting device for microscope |
US6025905A (en) * | 1996-12-31 | 2000-02-15 | Cognex Corporation | System for obtaining a uniform illumination reflectance image during periodic structured illumination |
US6181474B1 (en) * | 1999-03-22 | 2001-01-30 | Kovex Corporation | Scanning confocal microscope with objective lens position tracking |
US6974938B1 (en) * | 2000-03-08 | 2005-12-13 | Tibotec Bvba | Microscope having a stable autofocusing apparatus |
JP2002277736A (en) * | 2001-03-21 | 2002-09-25 | Olympus Optical Co Ltd | Image pickup device |
JP3867143B2 (en) * | 2003-06-25 | 2007-01-10 | 独立行政法人産業技術総合研究所 | Three-dimensional microscope system and image display method |
JP2005134834A (en) * | 2003-10-31 | 2005-05-26 | Olympus Corp | Imaging unit and electronic imaging equipment |
US7057826B2 (en) * | 2004-03-22 | 2006-06-06 | Angstrom Inc. | Small and fast zoom system |
US7295303B1 (en) * | 2004-03-25 | 2007-11-13 | Kla-Tencor Technologies Corporation | Methods and apparatus for inspecting a sample |
JP2006047922A (en) * | 2004-08-09 | 2006-02-16 | Nikon Corp | Image forming apparatus |
JP2006084794A (en) * | 2004-09-16 | 2006-03-30 | Olympus Corp | Observation device with focal position control mechanism |
JP5069220B2 (en) * | 2005-04-12 | 2012-11-07 | カリパー・ライフ・サイエンシズ・インク. | Compact optical detection system for microfluidic devices |
JP5058483B2 (en) * | 2005-09-14 | 2012-10-24 | オリンパス株式会社 | Long-term or continuous detection method for biological samples |
JP2009116271A (en) * | 2007-11-09 | 2009-05-28 | Nikon Corp | Focusing arrangement and microscope apparatus |
US7723657B2 (en) * | 2007-11-16 | 2010-05-25 | Mitutoyo Corporation | Focus detection apparatus having extended detection range |
TWI456254B (en) * | 2010-05-19 | 2014-10-11 | Ind Tech Res Inst | Fluorescence micro imaging system |
JP5393926B2 (en) * | 2011-08-24 | 2014-01-22 | オリンパスメディカルシステムズ株式会社 | Imaging apparatus and imaging apparatus system |
DE102011082756A1 (en) * | 2011-09-15 | 2013-03-21 | Leica Microsystems (Schweiz) Ag | Autofocusing method and device for a microscope |
DE102012009836A1 (en) * | 2012-05-16 | 2013-11-21 | Carl Zeiss Microscopy Gmbh | Light microscope and method for image acquisition with a light microscope |
JP6606058B2 (en) * | 2013-03-15 | 2019-11-13 | ザ リージェンツ オブ ザ ユニバーシティ オブ カリフォルニア | High-throughput cargo delivery to living cells using a photothermal platform |
JP6286183B2 (en) * | 2013-11-07 | 2018-02-28 | 株式会社日立ハイテクノロジーズ | Analysis equipment |
WO2015087960A1 (en) * | 2013-12-12 | 2015-06-18 | 株式会社ニコン | Structured illumination microscope, structured illumination method and program |
DE102015209402A1 (en) * | 2015-05-22 | 2016-11-24 | Sirona Dental Systems Gmbh | Device for optical 3D measurement of an object |
CA3037799A1 (en) * | 2017-01-26 | 2018-08-02 | Azure Biosystems, Inc. | Devices and methods for imaging biomolecules |
JP2019078866A (en) * | 2017-10-24 | 2019-05-23 | オリンパス株式会社 | Microscope system, observation method, and observation program |
US10895727B1 (en) * | 2019-10-19 | 2021-01-19 | SequLITE Genomics US, Inc. | Microscope for locating structures on the inner surface of a fluidic channel |
-
2020
- 2020-10-19 CA CA3158318A patent/CA3158318A1/en active Pending
- 2020-10-19 AU AU2020366521A patent/AU2020366521B2/en active Active
- 2020-10-19 CN CN202080073343.4A patent/CN114585958B/en active Active
- 2020-10-19 JP JP2022523406A patent/JP2022552743A/en active Pending
- 2020-10-19 WO PCT/US2020/056302 patent/WO2021077075A1/en unknown
- 2020-10-19 EP EP20876361.5A patent/EP4031922A4/en active Pending
- 2020-10-19 KR KR1020227016636A patent/KR20220084147A/en active Search and Examination
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120002031A1 (en) * | 2008-12-02 | 2012-01-05 | The Regents Of The University Of California | Imaging Arrangement and Microscope |
WO2010103389A1 (en) | 2009-03-11 | 2010-09-16 | Sensovation Ag | Autofocus method and autofocus device |
US20150031051A1 (en) * | 2012-07-25 | 2015-01-29 | Theranos, Inc. | Image analysis and measurement of biological samples |
WO2016061484A2 (en) | 2014-10-16 | 2016-04-21 | Illumina, Inc. | Optical scanning systems for in situ genetic analysis |
US20180149855A1 (en) * | 2015-04-23 | 2018-05-31 | The University Of British Columbia | Multifocal method and apparatus for stabilization of optical systems |
US20180120553A1 (en) * | 2016-10-27 | 2018-05-03 | Scopio Labs Ltd. | System for image reconstruction using a known pattern |
Non-Patent Citations (2)
Title |
---|
RAINER HEINTZMANN: "Handbook of Confocal Microscopy", 2006, SPRINGER, article "Structured Illumination Methods", pages: 265 - 279 |
See also references of EP4031922A4 |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN114280806A (en) * | 2022-02-10 | 2022-04-05 | 中国人民解放军陆军装甲兵学院 | Light collimation method based on kinoform |
Also Published As
Publication number | Publication date |
---|---|
AU2020366521A1 (en) | 2022-05-19 |
EP4031922A1 (en) | 2022-07-27 |
CA3158318A1 (en) | 2021-04-20 |
EP4031922A4 (en) | 2022-12-07 |
CN114585958B (en) | 2024-05-28 |
KR20220084147A (en) | 2022-06-21 |
JP2022552743A (en) | 2022-12-19 |
CN114585958A (en) | 2022-06-03 |
AU2020366521B2 (en) | 2024-03-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US10078206B2 (en) | High-resolution microscope and image splitter arrangment | |
US11131840B2 (en) | Microscope system and method for microscopic imaging | |
US6355934B1 (en) | Imaging system for an optical scanner | |
EP0880690B1 (en) | Fluorescence imaging system compatible with macro and micro scanning objectives | |
US6130745A (en) | Optical autofocus for use with microtiter plates | |
EP2960644B1 (en) | System and method for telecentric wide-field fluorescence imaging | |
US7567346B2 (en) | System and method for multimode imaging | |
WO2005113832A2 (en) | Wide field imager for quantitative analysis of microarrays | |
JP2018533070A (en) | Microscope system with transillumination-based automatic focusing for photoluminescence imaging | |
WO2005069842A2 (en) | Optical analysis systems | |
CN115524839A (en) | Large-view-field high-resolution imaging system and detection method for digital ELISA | |
CN209759461U (en) | optical system and sequencing system | |
AU2020366521B2 (en) | Virtual fiducials | |
US10895727B1 (en) | Microscope for locating structures on the inner surface of a fluidic channel | |
JP5070995B2 (en) | Confocal microscope | |
WO2005069843A2 (en) | Optical analysis systems | |
CN111308726A (en) | Optical system, method for adjusting optical system and sequencing system | |
EP2283343B1 (en) | Optical illumination apparatus and method | |
JP7248833B2 (en) | A Microscope System with Transillumination-Based Autofocusing for Photoluminescence Imaging | |
US20240118530A1 (en) | Autofocus device for optical microscope and method for maintaining autofocus | |
Guse et al. | Sophisticated lenses for microarray analysis | |
WO2018187442A1 (en) | Patterned optic for epi-fluorescence collection |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 20876361 Country of ref document: EP Kind code of ref document: A1 |
|
ENP | Entry into the national phase |
Ref document number: 2022523406 Country of ref document: JP Kind code of ref document: A Ref document number: 3158318 Country of ref document: CA |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
ENP | Entry into the national phase |
Ref document number: 2020876361 Country of ref document: EP Effective date: 20220421 |
|
ENP | Entry into the national phase |
Ref document number: 20227016636 Country of ref document: KR Kind code of ref document: A |
|
ENP | Entry into the national phase |
Ref document number: 2020366521 Country of ref document: AU Date of ref document: 20201019 Kind code of ref document: A |