Classifications

• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
  • B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
  • B01L3/00—Containers or dishes for laboratory use, e.g. laboratory glassware; Droppers
  • B01L3/50—Containers for the purpose of retaining a material to be analysed, e.g. test tubes
  • B01L3/502—Containers for the purpose of retaining a material to be analysed, e.g. test tubes with fluid transport, e.g. in multi-compartment structures
  • B01L3/5027—Containers for the purpose of retaining a material to be analysed, e.g. test tubes with fluid transport, e.g. in multi-compartment structures by integrated microfluidic structures, i.e. dimensions of channels and chambers are such that surface tension forces are important, e.g. lab-on-a-chip
  • B01L3/502769—Containers for the purpose of retaining a material to be analysed, e.g. test tubes with fluid transport, e.g. in multi-compartment structures by integrated microfluidic structures, i.e. dimensions of channels and chambers are such that surface tension forces are important, e.g. lab-on-a-chip characterised by multiphase flow arrangements
  • B01L3/502784—Containers for the purpose of retaining a material to be analysed, e.g. test tubes with fluid transport, e.g. in multi-compartment structures by integrated microfluidic structures, i.e. dimensions of channels and chambers are such that surface tension forces are important, e.g. lab-on-a-chip characterised by multiphase flow arrangements specially adapted for droplet or plug flow, e.g. digital microfluidics
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/16—Microscopes adapted for ultraviolet illumination ; Fluorescence microscopes
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
  • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
  • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
  • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
  • G01N21/64—Fluorescence; Phosphorescence
  • G01N21/645—Specially adapted constructive features of fluorimeters
  • G01N21/6452—Individual samples arranged in a regular 2D-array, e.g. multiwell plates
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/18—Arrangements with more than one light path, e.g. for comparing two specimens
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/34—Microscope slides, e.g. mounting specimens on microscope slides
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
  • G02B21/365—Control or image processing arrangements for digital or video microscopes
• • G—PHYSICS
  • G02—OPTICS
  • G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
  • G02B21/00—Microscopes
  • G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
  • G02B21/365—Control or image processing arrangements for digital or video microscopes
  • G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/45—Cameras or camera modules comprising electronic image sensors; Control thereof for generating image signals from two or more image sensors being of different type or operating in different modes, e.g. with a CMOS sensor for moving images in combination with a charge-coupled device [CCD] for still images
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
  • B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
  • B01L2200/00—Solutions for specific problems relating to chemical or physical laboratory apparatus
  • B01L2200/16—Reagents, handling or storing thereof
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
  • B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
  • B01L2300/00—Additional constructional details
  • B01L2300/06—Auxiliary integrated devices, integrated components
  • B01L2300/0627—Sensor or part of a sensor is integrated
  • B01L2300/0654—Lenses; Optical fibres
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
  • B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
  • B01L2300/00—Additional constructional details
  • B01L2300/08—Geometry, shape and general structure
  • B01L2300/0861—Configuration of multiple channels and/or chambers in a single devices
  • B01L2300/0877—Flow chambers
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
  • B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
  • B01L2400/00—Moving or stopping fluids
  • B01L2400/08—Regulating or influencing the flow resistance
  • B01L2400/084—Passive control of flow resistance
  • B01L2400/086—Passive control of flow resistance using baffles or other fixed flow obstructions
• • B—PERFORMING OPERATIONS; TRANSPORTING
  • B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
  • B01L—CHEMICAL OR PHYSICAL LABORATORY APPARATUS FOR GENERAL USE
  • B01L3/00—Containers or dishes for laboratory use, e.g. laboratory glassware; Droppers
  • B01L3/50—Containers for the purpose of retaining a material to be analysed, e.g. test tubes
  • B01L3/508—Containers for the purpose of retaining a material to be analysed, e.g. test tubes rigid containers not provided for above
  • B01L3/5085—Containers for the purpose of retaining a material to be analysed, e.g. test tubes rigid containers not provided for above for multiple samples, e.g. microtitration plates
• • C—CHEMISTRY; METALLURGY
  • C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
  • C12Q—MEASURING OR TESTING PROCESSES INVOLVING ENZYMES, NUCLEIC ACIDS OR MICROORGANISMS; COMPOSITIONS OR TEST PAPERS THEREFOR; PROCESSES OF PREPARING SUCH COMPOSITIONS; CONDITION-RESPONSIVE CONTROL IN MICROBIOLOGICAL OR ENZYMOLOGICAL PROCESSES
  • C12Q1/00—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions
  • C12Q1/68—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions involving nucleic acids
  • C12Q1/6869—Methods for sequencing
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
  • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
  • G01N21/62—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light
  • G01N21/63—Systems in which the material investigated is excited whereby it emits light or causes a change in wavelength of the incident light optically excited
  • G01N21/64—Fluorescence; Phosphorescence
  • G01N21/645—Specially adapted constructive features of fluorimeters
  • G01N2021/6482—Sample cells, cuvettes
• • G—PHYSICS
  • G01—MEASURING; TESTING
  • G01N—INVESTIGATING OR ANALYSING MATERIALS BY DETERMINING THEIR CHEMICAL OR PHYSICAL PROPERTIES
  • G01N21/00—Investigating or analysing materials by the use of optical means, i.e. using sub-millimetre waves, infrared, visible or ultraviolet light
  • G01N21/01—Arrangements or apparatus for facilitating the optical investigation
  • G01N21/03—Cuvette constructions
  • G01N21/05—Flow-through cuvettes
• • H—ELECTRICITY
  • H04—ELECTRIC COMMUNICATION TECHNIQUE
  • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
  • H04N23/00—Cameras or camera modules comprising electronic image sensors; Control thereof
  • H04N23/60—Control of cameras or camera modules
  • H04N23/67—Focus control based on electronic image sensor signals

Definitions

• aspects of the present disclosure relate generally to biological or chemical analysis and more particularly to systems and methods using image sensors for biological or chemical analysis.
• Various protocols in biological or chemical research involve performing a large number of controlled reactions on local support surfaces or within predefined reaction chambers. The designated reactions may then be observed or detected and subsequent analysis may help identify or reveal properties of chemicals involved in the reaction.
• an unknown analyte having an identifiable label e.g., fluorescent label
• an identifiable label e.g., fluorescent label
• Each known probe may be deposited into a corresponding well of a flow cell channel. Observing any chemical reactions that occur between the known probes and the unknown analyte within the wells may help identify or reveal properties of the analyte.
• Other examples of such protocols include known DNA sequencing processes, such as sequencing-by-synthesis (SBS) or cyclic-array sequencing.
• an optical system is used to direct an excitation light onto fluorescently-labeled analytes and to also detect the fluorescent signals that may be emitted from the analytes.
• Such optical systems may include an arrangement of lenses, filters, and light sources.
• the controlled reactions occur immediately over a solid-state imager (e.g., charged- coupled device (CCD) or a complementary metal-oxide-semiconductor (CMOS) detector) that does not require a large optical assembly to detect the fluorescent emissions.
• CCD charged- coupled device
• CMOS complementary metal-oxide-semiconductor
• Described herein are devices, systems, and methods for obtaining images which may be encountered in systems that perform optical analysis, such as bioassay systems.
• An implementation relates to a system comprising a flow cell comprising a plurality of reaction sites, wherein: the plurality of reaction sites comprises a plurality of sets of reaction sites; for each set of reaction sites from the plurality of sets of reaction sites: that set of reaction sites has a corresponding imaging plane; each reaction site comprised by that set of reaction sites has a location on that set of reaction sites’ corresponding imaging plane; and no reaction site from any set of reaction sites other than that set of reaction sites has a location on that set of reaction sites’ corresponding imaging plane; a set of cameras; and a processor to: obtain a plurality of unfiltered images using the set of cameras, wherein the plurality of unfiltered images comprises, for each set of reaction sites from the plurality of sets of reaction sites, an image corresponding to that set of reaction sites; and for each set of reaction sites from the plurality of sets of reaction sites, determine a derived image corresponding to that set of reaction sites, wherein the derived image corresponding to that set of reaction sites is based on using differences in
• a center-center distance between that reaction site and a nearest reaction site in the plurality of reaction sites is less than a diffraction limit for a wavelength of light used in obtaining the plurality of unfiltered images; and for each set of reaction sites from the plurality of sets of reaction sites, for each reaction site in that set of reaction sites, a center-center distance between that reaction site and a nearest reaction site in that set of reaction sites is greater than the diffraction limit for the wavelength of light used in obtaining the plurality of unfiltered images.
• the set of cameras comprises a corresponding camera focused that set of reaction sites’ corresponding imaging plane.
• the system comprises one or more beam splitters to direct signals from the plurality of reaction sites to the cameras from the set of cameras.
• obtaining the plurality of unfiltered images comprises: using a first camera from the set of cameras, capturing an unfiltered first image, wherein the first unfiltered image corresponds to a first set of reaction sites from the plurality of sets of reaction sites, and wherein the first camera is focused on the imaging plane corresponding to the first set of reaction sites when it is used to capture the first unfiltered image; refocusing the first camera on the imaging plane corresponding to a second set of reaction sites from the plurality of sets of reaction sites; and using the first camera, capturing a second unfiltered image, wherein the second unfiltered image corresponds to the second set of reaction sites, and wherein the first camera is focused on the imaging plane corresponding to the second set of reaction sites when it is used to capture the second unfiltered image.
• the set of cameras comprises a line scan camera;
• the line scan camera comprises a plurality of sets of sensors, wherein, for each set of sensors from the plurality of sets of sensors: that set of sensors has a corresponding set of reaction sites from the plurality of sets of reaction sites; and that set of sensors is focused on the corresponding imaging plane of its corresponding set of reaction sites; and obtaining the plurality of unfiltered images using the set of cameras comprises: capturing a first unfiltered image using a first set of sensors, wherein the first set of sensors corresponds to a first set of reaction sites from the plurality of sets of reaction sites; and capturing a second unfiltered image using a second set of sensors, wherein the second set of sensors corresponds to a second set of reaction sites from the plurality of sets of reaction sites.
• each set of reaction sites from the plurality of sets of reaction sites has a corresponding point spread function; and for each set of reaction sites from the plurality of sets of reaction sites, determining the derived image corresponding to that set of reaction sites comprises, for each other set of reaction sites from the plurality of sets of reaction sites, removing signals from reaction sites comprised by that other set of reaction sites using the unfiltered image corresponding to that other set of reaction sites and the point spread function corresponding to that other set of reaction sites.
• the corresponding point spread function for that set of reaction sites is different from the corresponding point spread functions for all other sets of reaction sites from the plurality of sets of reaction sites.
• the corresponding point spread function for that set of reaction sites is the same as the corresponding point spread function for at least one other set of reaction sites from the plurality of sets of reaction sites.
• the plurality of sets of reaction sites consists of two sets of reaction sites.
• the plurality of reaction sites comprises three or more sets of reaction sites.
• An implementation relates to a method comprising: obtaining a plurality of unfiltered images using a set of cameras, wherein each image from the plurality of unfiltered images is captured by detecting light emitted by a plurality of reaction sites comprised by a flow cell; the plurality of reaction sites comprises a plurality of sets of reaction sites; for each set of reaction sites from the plurality of sets of reaction sites: that set of reaction sites has a corresponding imaging plane; each reaction site comprised by that set of reaction sites has a location on that set of reaction sites’ corresponding imaging plane; and no reaction site from any set of reaction sites other than that set of reaction sites has a location on that set of reaction sites’ corresponding imaging plane; each unfiltered image from the plurality of unfiltered images has a corresponding set of reaction sites from the plurality of sets of reaction sites; and for each set of reaction sites from the plurality of sets of reaction sites, determining a derived image corresponding to that set of reaction sites based on using differences in focus between images from the plurality of unfiltered images
• a center-center distance between that reaction site and a nearest reaction site in the plurality of reaction sites is less than a diffraction limit for a wavelength of light used in obtaining the plurality of unfiltered images; and for each set of reaction sites from the plurality of sets of reaction sites, for each reaction site in that set of reaction sites, a centercenter distance between that reaction site and a nearest reaction site in that set of reaction sites is greater than the diffraction limit for the wavelength of light used in obtaining the plurality of unfiltered images.
• the set of cameras comprises a corresponding camera focused that set of reaction sites’ corresponding imaging plane.
• obtaining the plurality of unfiltered images comprises: using a first camera from the set of cameras, capturing an unfiltered first image, wherein the first unfiltered image corresponds to a first set of reaction sites from the plurality of sets of reaction sites, and wherein the first camera is focused on the imaging plane corresponding to the first set of reaction sites when it is used to capture the first unfiltered image; refocusing the first camera on the imaging plane corresponding to a second set of reaction sites from the plurality of sets of reaction sites; and using the first camera, capturing a second unfiltered image, wherein the second unfiltered image corresponds to the second set of reaction sites, and wherein the first camera is focused on the imaging plane corresponding to the second set of reaction sites when it is used to capture the second unfiltered image.
• the set of cameras comprises a line scan camera;
• the line scan camera comprises a plurality of sets of sensors, wherein, for each set of sensors from the plurality of sets of sensors: that set of sensors has a corresponding set of reaction sites from the plurality of sets of reaction sites; and that set of sensors is focused on the corresponding imaging plane of its corresponding set of reaction sites; and obtaining the plurality of unfiltered images using the set of cameras comprises: capturing a first unfiltered image using a first set of sensors, wherein the first set of sensors corresponds to a first set of reaction sites from the plurality of sets of reaction sites; and capturing a second unfiltered image using a second set of sensors, wherein the second set of sensors corresponds to a second set of reaction sites from the plurality of sets of reaction sites.
• each set of reaction sites from the plurality of sets of reaction sites has a corresponding point spread function; and for each set of reaction sites from the plurality of sets of reaction sites, determining the derived image corresponding to that set of reaction sites comprises, for each other set of reaction sites from the plurality of sets of reaction sites, removing signals from reaction sites comprised by that other set of reaction sites using the unfiltered image corresponding to that other set of reaction sites and the point spread function corresponding to that other set of reaction sites.
• the corresponding point spread function for that set of reaction sites is different from the corresponding point spread functions for all other sets of reaction sites from the plurality of sets of reaction sites.
• the corresponding point spread function for that set of reaction sites is the same as the corresponding point spread function for at least one other set of reaction sites from the plurality of sets of reaction sites.
• An implementation relates to a machine comprising: means for obtaining a plurality of differently focused unfiltered images based on signals from reaction sites comprised by a flow cell; and means for determining a plurality of derived images separating signals from corresponding sets of reaction sites based on differences in focus.
• FIG. 1 depicts a schematic diagram of an example of an imaging system that may be implemented in a system for biological or chemical analysis.
• FIG. 2 depicts a plan view of an example array of reaction sites where all reaction sites are at a common elevation.
• FIG. 3 depicts a plan view of an example a first array of reaction sites, where the reaction sites of the first array are at a first common elevation; and a second array of reaction sites, where the reaction sites of the second array are at a second common elevation.
• FIG. 4 depicts a cross-sectional view of an example of a flow cell providing the arrays of FIG. 3.
• FIG. 5 depicts a plan view of an example of an arrangement of three arrays of reaction sites, with each array being at different respective elevations.
• FIG. 6 depicts a cross-sectional view of an example of a flow cell providing the arrays of FIG. 5.
• FIG. 7 depicts a plan view of an example of an arrangement of four arrays of reaction sites, with each array being at different respective elevations.
• FIG. 8 depicts a cross-sectional view of an example of a flow cell providing the arrays of FIG. 7.
• FIG. 9A depicts a schematic view of an example of an imaging assembly capturing an image of a flow cell, with the flow cell in a first position.
• FIG. 9B depicts a schematic view of the imaging assembly of FIG. 9A capturing another image of the flow cell, with the flow cell in a second position.
• FIG. 10A depicts a schematic view of an example of another imaging assembly capturing an image of a flow cell, with the flow cell in a first position.
• FIG. 10B depicts a schematic view of the imaging assembly of FIG. 10A capturing another image of the flow cell, with the flow cell in a second position.
• FIG. 11A depicts a schematic view of an example of another imaging assembly capturing an image of a flow cell, with the flow cell in a first position.
• FIG. 11B depicts a schematic view of the imaging assembly of FIG. 11A capturing another image of the flow cell, with the flow cell in a second position.
• FIG. 12A depicts a schematic view of an example of another imaging assembly capturing an image of a flow cell, with the flow cell in a first position.
• FIG. 12B depicts a schematic view of the imaging assembly of FIG. 12A capturing another image of the flow cell, with the flow cell in a second position.
• FIG. 13 A depicts an exemplary image including illumination from reaction sites at different elevations.
• FIG. 13B depicts an exemplary image including illumination from reaction sites at different elevations.
• FIG. 14A depicts an exemplary image including illumination from in focus reaction sites after removal of background illumination.
• FIG. 14B depicts an exemplary image including illumination from in focus reaction sites after removal of background illumination.
• FIG. 15 depicts an exemplary image combining illumination from different in focus reaction sites in underlying images.
• FIG. 16 depicts illustrates a process which may be used to obtain a super-resolution image of a flow cell having reaction sites at different elevations.
• Examples described herein may be used in various biological or chemical processes and systems for academic or commercial analysis. More specifically, examples described herein may be used in various processes and systems where it is desired to detect an event, property, quality, or characteristic that is indicative of a designated reaction.
• the bioassay systems may be configured to perform a plurality of designated reactions that may be detected individually or collectively.
• the biosensors and bioassay systems may be configured to perform numerous cycles in which the plurality of designated reactions occurs in parallel.
• the bioassay systems may be used to sequence a dense array of DNA features through iterative cycles of enzymatic manipulation and image acquisition.
• the cartridges and biosensors may include one or more microfluidic channels that deliver reagents or other reaction components to a reaction site.
• the reaction sites are randomly distributed across a substantially planar surface.
• the reaction sites may have an uneven distribution in which some reaction sites are located closer to each other than other reaction sites.
• the reaction sites are patterned across a substantially planar surface in a predetermined manner.
• Each of the reaction sites may be associated with one or more image sensors that detect light from the associated reaction site.
• the reaction sites are located in reaction chambers that compartmentalize the designated reactions therein.
• image sensors may detect light emitted from reaction sites and the signals indicating photons emitted from the reaction sites and detected by the individual image sensors may be referred to as those sensors’ illumination values. These illumination values may be combined into an image indicating photons as detected from the reaction sites. Such an image may be referred to as an unfiltered image. Similarly, when an image is composed of values which have been processed, such as to computationally correct for crosstalk, rather than being composed of the values directly detected by individual image sensors, that image may be referred to as a sharpened image.
• a “designated reaction” includes a change in at least one of a chemical, electrical, physical, or optical property (or quality) of an analyte-of-interest.
• the designated reaction is a positive binding event (e.g., incorporation of a fluorescently labeled biomolecule with the analyte-of-interest). More generally, the designated reaction may be a chemical transformation, chemical change, or chemical interaction.
• the designated reaction includes the incorporation of a fluorescently-labeled molecule to an analyte.
• the analyte may be an oligonucleotide and the fluorescently-labeled molecule may be a nucleotide.
• the designated reaction may be detected when an excitation light is directed toward the oligonucleotide having the labeled nucleotide, and the fluorophore emits a detectable fluorescent signal.
• the detected fluorescence is a result of chemiluminescence or bioluminescence.
• a designated reaction may also increase fluorescence (or Forster) resonance energy transfer (FRET), for example, by bringing a donor fluorophore in proximity to an acceptor fluorophore, decrease FRET by separating donor and acceptor fluorophores, increase fluorescence by separating a quencher from a fluorophore or decrease fluorescence by co-locating a quencher and fluorophore.
• FRET fluorescence
• reaction component or “reactant” includes any substance that may be used to obtain a designated reaction.
• reaction components include reagents, enzymes, samples, other biomolecules, and buffer solutions.
• the reaction components may be delivered to a reaction site in a solution and/or immobilized at a reaction site.
• the reaction components may interact directly or indirectly with another substance, such as the analyte-of-interest.
• reaction site is a localized region where a designated reaction may occur.
• a reaction site may include support surfaces of a substrate where a substance may be immobilized thereon.
• a reaction site may include a substantially planar surface in a channel of a flow cell that has a colony of nucleic acids thereon.
• the nucleic acids in the colony may have the same sequence, being for example, clonal copies of a single stranded or double stranded template.
• a reaction site may contain only a single nucleic acid molecule, for example, in a single stranded or double stranded form.
• reaction sites may be randomly distributed along the support surface or arranged in a predetermined manner (e.g., side-by-side in a matrix, such as in microarrays).
• a reaction site may also include a reaction chamber that at least partially defines a spatial region or volume configured to compartmentalize the designated reaction.
• reaction chamber includes a spatial region that is in fluid communication with a flow channel.
• the reaction chamber may be at least partially separated from the surrounding environment or other spatial regions.
• a plurality of reaction chambers may be separated from each other by shared walls.
• the reaction chamber may include a cavity defined by interior surfaces of a well and have an opening or aperture so that the cavity may be in fluid communication with a flow channel.
• reaction chambers are described in greater detail in U.S. Pat. No. 9,096,899, entitled “Microdevices and Biosensor Cartridges for Biological or Chemical Analysis and Systems and Methods for the Same,” issued August 4, 2015, the disclosure of which is incorporated herein by reference, in its entirety.
• Reaction sites do not necessarily need to be provided in reaction chambers and may instead be provided on or in any other suitable kind of structure.
• the reaction chambers are sized and shaped relative to solids (including semi-solids) so that the solids may be inserted, fully or partially, therein.
• the reaction chamber may be sized and shaped to accommodate only one capture bead.
• the capture bead may have clonally amplified DNA or other substances thereon.
• the reaction chamber may be sized and shaped to receive an approximate number of beads or solid substrates.
• the reaction chambers may also be filled with a porous gel or substance that is configured to control diffusion or filter fluids that may flow into the reaction chamber.
• image sensors are associated with corresponding reaction sites.
• An image sensor that is associated with a reaction site is configured to detect light emissions from the associated reaction site when a designated reaction has occurred at the associated reaction site.
• a plurality of image sensors e.g., several pixels of a camera device
• a single image sensor e.g., a single pixel
• any other suitable relationships between the number of pixels and the number of reaction sites may be used.
• the image sensor, the reaction site, and other features of the biosensor may be configured so that at least some of the light is directly detected by the image sensor without being reflected.
• the term “adjacent” when used with respect to two reaction sites means no other reaction site is located between the two reaction sites.
• the term “adjacent” may have a similar meaning when used with respect to adjacent detection paths and adjacent image sensors (e.g., adjacent image sensors have no other image sensor therebetween).
• a reaction site may not be adjacent to another reaction site; but may still be within an immediate vicinity of the other reaction site.
• a first reaction site may be in the immediate vicinity of a second reaction site when fluorescent emission signals from the first reaction site are detected by the image sensor associated with the second reaction site.
• a first reaction site may be in the immediate vicinity of a second reaction site when the image sensor associated with the second reaction site detects, for example, crosstalk from the first reaction site.
• Adjacent reaction sites may be contiguous such that they abut each other or the adjacent sites may be non-contiguous having an intervening space between.
• a “substance” includes items or solids, such as capture beads, as well as biological or chemical substances.
• a “biological or chemical substance” includes biomolecules, samples-of-interest, analytes-of-interest, and other chemical compound(s).
• a biological or chemical substance may be used to detect, identify, or analyze other chemical compound(s), or function as intermediaries to study or analyze other chemical compound(s).
• the biological or chemical substances include a biomolecule.
• a “biomolecule” includes at least one of a biopolymer, nucleoside, nucleic acid, polynucleotide, oligonucleotide, protein, enzyme, polypeptide, antibody, antigen, ligand, receptor, polysaccharide, carbohydrate, polyphosphate, cell, tissue, organism, or fragment thereof or any other biologically active chemical compound(s) such as analogs or mimetics of the aforementioned species.
• Biomolecules, samples, and biological or chemical substances may be naturally occurring or synthetic and may be suspended in a solution or mixture within a spatial region. Biomolecules, samples, and biological or chemical substances may also be bound to a solid phase or gel material. Biomolecules, samples, and biological or chemical substances may also include a pharmaceutical composition. In some cases, biomolecules, samples, and biological or chemical substances of interest may be referred to as targets, probes, or analytes.
• components are readily separable when the components may be separated from each other without undue effort or a significant amount of time spent in separating the components.
• components may be removably coupled or engaged in an electrical manner such that the mating contacts of the components are not destroyed or damaged.
• Components may also be removably coupled or engaged in a mechanical manner such that the features that hold a component are not destroyed or damaged.
• Components may also be removably coupled or engaged in a fluidic manner such that ports of a component are not destroyed or damaged.
• the component is not considered to be destroyed or damaged if, for example, only a simple adjustment to the component (e.g., realignment) or a simple replacement (e.g., replacing a nozzle) is required.
• fluid communication refers to two spatial regions being connected together such that a liquid or gas may flow between the two spatial regions.
• a microfluidic channel may be in fluid communication with a reaction chamber such that a fluid may flow freely into the reaction chamber from the microfluidic channel.
• in fluid communication or “fluidically coupled” allow for two spatial regions being in fluid communication through one or more valves, restrictors, or other fluidic components to control or regulate a flow of fluid through a system.
• the term “immobilized,” when used with respect to a biomolecule or biological or chemical substance, includes substantially attaching the biomolecule or biological or chemical substance at a molecular level to a surface.
• a biomolecule or biological or chemical substance may be immobilized to a surface of the substrate material using adsorption techniques including non-covalent interactions (e.g., electrostatic forces, van der Waals, and dehydration of hydrophobic interfaces) and covalent binding techniques where functional groups or linkers facilitate attaching the biomolecules to the surface.
• Immobilizing biomolecules or biological or chemical substances to a surface of a substrate material may be based upon the properties of the substrate surface, the liquid medium carrying the biomolecule or biological or chemical substance, and the properties of the biomolecules or biological or chemical substances themselves.
• a substrate surface may be functionalized (e.g., chemically or physically modified) to facilitate immobilizing the biomolecules (or biological or chemical substances) to the substrate surface.
• the substrate surface may be first modified to have functional groups bound to the surface. The functional groups may then bind to biomolecules or biological or chemical substances to immobilize them thereon.
• nucleic acids can be attached to a surface and amplified. Examples of such amplification are described in U.S. Pat. No.
• the assay protocols executed by the systems and methods described herein include the use of natural nucleotides and also enzymes that are configured to interact with the natural nucleotides.
• Natural nucleotides include, for example, ribonucleotides or deoxyribonucleotides. Natural nucleotides can be in the mono-, di-, or tri-phosphate form and can have a base selected from adenine (A), Thymine (T), uracil (U), guanine (G) or cytosine (C). It will be understood however that non-natural nucleotides, modified nucleotides or analogs of the aforementioned nucleotides can be used.
• items or solid substances may be disposed within the reaction chambers.
• the item or solid When disposed, the item or solid may be physically held or immobilized within the reaction chamber through an interference fit, adhesion, or entrapment.
• items or solids that may be disposed within the reaction chambers include polymer beads, pellets, agarose gel, powders, quantum dots, or other solids that may be compressed and/or held within the reaction chamber.
• a nucleic acid superstructure such as a DNA ball, may be disposed in or at a reaction chamber, for example, by attachment to an interior surface of the reaction chamber or by residence in a liquid within the reaction chamber.
• a substance that is held or disposed in a reaction chamber can be in a solid, liquid, or gaseous state.
• FIG. 1 depicts an example of components of a system 500 that may be used to provide biological or chemical analysis.
• system 500 is a workstation that may be similar to a bench-top device. For example, a majority (or all) of the systems and components for conducting the designated reactions may be within a common housing.
• system 500 is a nucleic acid sequencing system (or sequencer) configured for various applications, including but not limited to de novo sequencing, resequencing of whole genomes or target genomic regions, and metagenomics. The sequencer may also be used for DNA or RNA analysis.
• system 500 may also be configured to generate reaction sites in a flow cell 510.
• system 500 may be configured to receive a sample and generate surface attached clusters of clonally amplified nucleic acids derived from the sample.
• the system 500 is to perform a large number of parallel reactions within flow cell 510.
• Flow cell 510 includes one or more reaction sites where designated reactions may occur.
• the reaction sites may be, for example, immobilized to a solid surface of flow cell 510 or immobilized to beads (or other movable substrates) that are located within corresponding reaction chambers of flow cell 510.
• the reaction sites may include, for example, clusters of clonally amplified nucleic acids.
• Flow cell 510 may include one or more flow channels that receive a solution from the system 500 and direct the solution toward the reaction sites.
• flow cell 510 may engage a thermal element for transferring thermal energy into or out of the flow channel.
• System 500 may include various components, assemblies, and systems (or subsystems) that interact with each other to perform a predetermined method or assay protocol for biological or chemical analysis.
• system 500 includes a system controller 595 that may communicate with the various components, assemblies, and sub-systems of the system 500. Examples of such components are described in greater detail below.
• a light emitter 550 is configured to output a light beam that is collimated by collimation lens 551.
• the collimated light is structured (patterned) by light structuring optical assembly 555 and directed by dichroic mirror 560 through objective lens 542 onto a sample of a flow cell 510, which is positioned on a motion stage 570.
• the sample fluoresces in response to the structured excitation light, and the resultant light is collected by objective lens 542 and directed to an image sensor of camera system 540 to detect fluorescence.
• imaging system 500 utilizes light structuring optical assembly 555 to acquire a plurality of images at various phases, with the fringe pattern displaced laterally in the modulation direction (e.g., in the x-y plane and perpendicular to the fringes), with this procedure repeated one or more times by rotating the pattern orientation about the optical axis (i.e., with respect to the x-y plane of the sample).
• the captured images may then be computationally reconstructed to generate a higher resolution image (e.g., an image having about twice the lateral spatial resolution of individual images).
• System 500 of the present example thus provides structured illumination microscopy (SIM) utilizing spatially structured excitation light to image a biological sample.
• system 500 may provide any other kind of illumination and/or optical arrangements (e.g., epifluorescence microscopy, etc.).
• Light structuring optical assembly 555 and the corresponding SIM algorithms may thus be omitted in some variations.
• light emitter 550 may include an incoherent light emitter (e.g., emit light beams output by one or more excitation diodes), or a coherent light emitter such as emitter of light output by one or more lasers or laser diodes.
• light emitter 550 includes an optical fiber 552 for guiding an optical beam to be output.
• optical fiber 552 may optically couple to a plurality of different light sources (not shown), each light source emitting light of a different wavelength.
• system 500 is illustrated as having a single light emitter 550, in some implementations multiple light emitters 550 may be included.
• system 500 may include a projection lens 556 that may include a lens element to articulate along the z-axis to adjust the structured beam shape and path.
• a component of the projection lens 556 may be articulated to account for a range of sample thicknesses (e.g., different cover glass thickness) of the sample in container 510.
• fluid delivery module or device 590 may direct the flow of reagents (e.g., fluorescently labeled nucleotides, buffers, enzymes, cleavage reagents, etc.) to (and through) flow cell 510 and waste valve 520.
• reagents e.g., fluorescently labeled nucleotides, buffers, enzymes, cleavage reagents, etc.
• Flow cell 510 may include one or more substrates upon which the samples are provided.
• flow cell 510 may include one or more substrates on which nucleic acids to be sequenced are bound, attached or associated.
• the substrate may include any inert substrate or matrix to which nucleic acids may be attached, such as for example glass surfaces, plastic surfaces, latex, dextran, polystyrene surfaces, polypropylene surfaces, polyacrylamide gels, gold surfaces, and silicon wafers.
• the substrate is within a channel or other area at a plurality of locations formed in a matrix or array across the flow cell 510.
• System 500 may also include a temperature station actuator 530 and heater/cooler 535 that may optionally regulate the temperature of conditions of the fluids within the flow cell 510.
• the flow cell 510 may be implemented as a patterned flow cell including a transparent cover plate, a substrate, and a liquid contained therebetween, and a biological sample may be located at an inside surface of the transparent cover plate or an inside surface of the substrate.
• the flow cell may include a large number (e.g., thousands, millions, or billions) of wells (also referred to as nanowells) or regions that are patterned into a defined array (e.g., a hexagonal array, rectangular array, etc.) into the substrate.
• Such wells may define reaction chambers providing reaction sites as described above.
• Each region may form a cluster (e.g., a monoclonal cluster) of a biological sample such as DNA, RNA, or another genomic material which may be sequenced, for example, using sequencing by synthesis.
• the flow cell may be further divided into a number of spaced apart lanes (e.g., eight lanes), each lane including a hexagonal array of clusters.
• Flow cell 510 may be mounted on a sample stage 570 to provide movement and alignment of the flow cell 510 relative to the objective lens 542.
• the sample stage may have one or more actuators to allow it to move in any of three dimensions.
• actuators may be provided to allow stage 570 to move in the x, y, and z directions relative to the objective lens 542, tilt relative to objective lens 542, and/or otherwise move relative to objective lens 542.
• Movement of stage 570 may allow one or more sample locations on flow cell 510 to be positioned in optical alignment with objective lens 542.
• Movement of sample stage 570 relative to objective lens 542 may be achieved by moving sample stage 570 itself, the objective lens 542, some other component of system 500, or any combination of the foregoing. Further implementations may also include moving the system 500 over a stationary sample. Alternatively, flow cell 510 may be fixed during imaging.
• a focus (z-axis) component 575 may be included to control positioning of the optical components relative to the flow cell 510 in the focus direction (typically referred to as the z axis, or z direction).
• Focus component 575 may include one or more actuators physically coupled to the optical stage or the sample stage, or both, to move flow cell 510 on sample stage 570 relative to the optical components (e.g., the objective lens 542) to provide proper focusing for the imaging operation.
• the actuator may be physically coupled to the respective stage such as, for example, by mechanical, magnetic, fluidic or other attachment or contact directly or indirectly to or with the stage.
• the one or more actuators may be configured to move the stage in the z-direction while maintaining the sample stage in the same plane (e.g., maintaining a level or horizontal attitude, perpendicular to the optical axis).
• the one or more actuators may also be configured to tilt the stage. This may be done, for example, so that flow cell 510 may be leveled dynamically to account for any slope in its surfaces.
• the structured light emanating from a test sample at a sample location being imaged may be directed through dichroic mirror 560 to one or more detectors of camera system 540.
• a filter switching assembly 565 with one or more emission filters may be included, where the one or more emission filters may be used to pass through particular ranges of emission wavelengths and block (or reflect) other ranges of emission wavelengths.
• the one or more emission filters may be used to switch between different channels of the imaging system.
• the emission filters may be implemented as dichroic mirrors that direct emission light of different wavelengths to different image sensors of camera system 540.
• Camera system 540 may include one or more image sensors to monitor and track the imaging (e.g., sequencing) of flow cell 510.
• Camera system 540 may be implemented, for example, as a CCD or CMOS image sensor camera, but other image sensor technologies (e.g., active pixel sensor) may be used. While camera system 540 and associated optical components are shown as being positioned above flow cell 510 in FIG. 1, one or more image sensors or other camera components may be incorporated into system 500 in numerous other ways as will be apparent to those skilled in the art in view of the teachings herein. For instance, one or more image sensors may be positioned under flow cell 510 or may even be integrated into flow cell 510.
• reaction sites are defined in wells that are formed as recesses in a floor surface of a flow channel of flow cell 510, with such wells being configured with the same depth, such that the reaction sites are all at the same elevation within flow cell 510.
• Some other versions of flow cells may have wells with different depths, thereby providing reaction sites at different elevations.
• providing reaction sites at offset elevations may enable more dense packing of analyte features on a surface than would be resolvable if the combination of arrays were at the same elevation on the surface.
• providing reaction sites at offset elevations may allow for resolution of reaction sites having a pitch which is less than the diffraction limit of the light they would emit in response to excitation.
• Providing reaction sites at offset elevations may ultimately enable a flow cell to provide more reaction sites, at a higher density, than could otherwise be achieved without the reaction sites being positioned at offset elevations in a flow cell of the same size.
• FIG. 2 shows an arrangement 600 where reaction sites 602 are all located at a common z-plane (i.e., depth or elevation) and resolvable in the x-y dimension using commercially available optics.
• reaction sites 602 are all at a depth or elevation of 200 nm; and are separated from each other by a pitch distance (i.e., the distance between the center of one reaction site 602 and the center of each adjacent reaction site 602) of 500 nm.
• Each reaction site 602 of this example is circular in shape, with a diameter of 200 nm.
• Increasing the packing or density of reaction sites 602, such that the pitch distances are reduced, may challenge the ability of some conventional image processing components and techniques to achieve desirable resolution of the reactions occurring at reaction sites 602.
• reaction sites 602, 652 are provided in two different arrays located at two different respective z-planes.
• reaction sites 602 are positioned at a depth or elevation of 200 nm; while reaction sites 652 positioned at a depth or elevation of 1 pm.
• reaction sites 602, 652 that would otherwise neighbor each other i.e., if located in the same z-plane are distinguishable by altering depth of detection.
• reaction sites 602, 652 in the combined array may be distinguished by acquiring a first image by focusing an optical detector (e.g., camera system 540) at a depth of about 200 nm in this example and then acquiring a second image by focusing the optical detector (e.g., camera system 540) to a depth of about 1 pm in this example, and then removing illumination from out of focus reaction sites from those images using processing techniques such as described in more detail below.
• depths and pitch distances are just illustrative examples and are not intended to be limiting in any way.
• reaction sites 602, 652 may be separated by elevations that are within 1 to 10 times the depth of field of an objective lens such as objective lens 542.
• FIG. 4 shows an example of how the arrangement 650 of FIG. 3 may be provided by a flow cell 660.
• flow cell 660 defines a first array of wells 604 having a first depth; and a second array of wells 654 having a second depth.
• Reaction sites 602 are positioned at the bottom of wells 604, such that the first depth of wells 604 provides reaction sites 602 at the first elevation of 200 nm.
• Reaction sites 652 are positioned at the bottom of wells 654, such that the second depth of wells 654 provides reaction sites 652 at the second elevation of 1 pm.
• a flow cell 660 may include other kinds of structures to provide different elevations for reaction sites.
• reaction sites may be positioned atop posts that extend to different respective heights.
• a flow cell may provide a combination of posts and wells.
• a first set of reaction sites are positioned atop the posts while a second set of reaction sites are positioned at the bottom of the wells, such that the posts and wells provide different respective elevations for the first and second reaction sites.
• a flow cell may provide a set of posts where reaction sites are located at different corresponding positions along the height of each post.
• the different reaction sites on each post may be separated from each other vertically (i.e., along the z-dimension) without being separated from each other horizontally (i.e., along the x-y plane).
• such an arrangement may be provided in accordance with at least some of the teachings of U.S. Provisional Pat. App. No. 63/195,123, “Flow Cells and Methods,” filed May 31, 2021, the disclosure of which is incorporated by reference herein, in its entirety; and/or U.S. Pat. Pub. No.
• reaction sites 602, 652 may be achieved via both z-plane focus of detection and differential z-plane excitation.
• epi-excitation may be combined with total internal reflection (TIR) excitation.
• epi -excitation can be combined with excitation by other waveguides.
• a waveguide may contact the deep wells 604 of reaction sites 602 but not the shallow wells 654 of reaction sites 652. Illumination via the waveguide may selectively excite fluorophores within the deep wells 604 and corresponding emission may be collected from only the deep wells 604. Emission from fluorophores within the shallow wells 654 may be obtained by a subtractive method. Specifically, all wells 604, 654 may be excited by epiillumination, and the emission from fluorophores within the shallow 654 wells may be identified by subtracting out the emission that was obtained from waveguide illumination of the deep wells 604. Other examples of how images (or other optical data) may be captured and processed from reaction sites at different elevations will be described in greater detail below.
• the elevations of 200 nm and 1 pm provided above are only illustrative examples. Any other suitable elevations may be used for reaction sites 602, 652.
• the reaction site size of a 200 nm diameter is only an illustrative example. Any other suitable reaction site size may be used; and a reaction site need not necessarily be circular (e.g., may instead be hexagonal or have any other suitable shape).
• the 500 nm pitch distance described above is also only an illustrative example. As another illustrative example, the pitch distance between reaction sites 602 may be 565 pm, the pitch distance between reaction sites 652 may be 565 pm, and the pitch distance between each reaction site 602 and the adjacent reaction sites 652 may be approximately 400 pm. Alternatively, any other suitable pitch distances may be used.
• FIG. 5 depicts an arrangement 700 with a first array of reaction sites 702, a second array of reaction sites 704, and a third array of reaction sites 706.
• Reaction sites 702 are all at a first elevation
• reaction sites 704 are all at a second elevation
• reaction sites 706 are all at a third elevation
• FIG. 6 depicts an example of a flow cell 750 providing reaction sites 702, 704, 706 at their different respective elevations.
• flow cell 750 defines wells at different depths corresponding to the different respective elevations of reaction sites 702, 704, 706, such that reaction sites 702, 704, 706 are positioned at the bottoms of respective wells.
• a flow cell may provide reaction sites 702, 704, 706 at different respective elevations in any other suitable fashion.
• FIG. 7 depicts an arrangement 800 with a first array of reaction sites 802, a second array of reaction sites 804, a third array of reaction sites 806, and a fourth array of reaction sites 808.
• Reaction sites 802 are all at a first elevation
• reaction sites 804 are all at a second elevation
• reaction sites 806 are all at a third elevation
• reaction sites 808 are all at a fourth elevation.
• FIG. 8 depicts an example of a flow cell 850 providing reaction sites 802, 804, 806, 808 at their different respective elevations.
• flow cell 850 defines wells at different depths corresponding to the different respective elevations of reaction sites 802, 804, 806, 808, such that reaction sites 802, 804, 806, 808 are positioned at the bottoms of respective wells.
• a flow cell may provide reaction sites 802, 804, 806, 808 at different respective elevations in any other suitable fashion. Still other variations may provide reaction sites at five or more different elevations in any other suitable arrangements.
• FIGS. 9A-9B show an imaging assembly 900 that includes a first camera 910, a second camera 920, a beam splitter 930, a tube lens 940, and an objective lens assembly 950.
• First camera 910 includes a first image sensor 912.
• Second camera 920 includes a second image sensor 922.
• Beam splitter 930 is configured to split images that are passed through tube lens 940 such that the images reach both cameras 910, 920 despite cameras 910, 920 being positioned separately and orthogonally relative to each other.
• Imaging assembly 900 is positioned over a flow cell 960 that includes reaction sites 962, 964.
• a light source (not shown) is used to emit an excitation light toward reaction sites 962, 964. Fluorophores at reaction sites 962, 964 emit light in response to the excitation light from the light source.
• Objective lens assembly 950 is configured to capture and collimate these light emissions from reaction sites 962, 964.
• Tube lens 940 is configured to re-image the emitted light from objective lens assembly 950 onto image sensors 912, 922, with a magnification determined by the ratio of the focal lengths.
• reaction sites 962 are all positioned at a first elevation while reaction sites 964 are all positioned at a second elevation, with the second elevation being higher than the first elevation. While flow cell 960 only provides two different reaction site 962, 964 elevations in this example, other versions may provide three or more reaction site elevations.
• imaging assembly 900 may capture a sequence of images as flow cell 960 is moved along the x-y plane. For instance, imaging assembly 900 may capture a first image of flow cell 960 when a reaction site 964 is positioned directly under imaging assembly 900 as shown in FIG. 9A; then capture a second image of flow cell 960 when a reaction site 962 is positioned directly under imaging assembly 900 as shown in FIG. 9B.
• flow cell 960 is moved relative to imaging assembly 900 to capture a sequence of images (e.g., using a component similar to focus component 575 described above).
• imaging assembly 900 is moved relative to flow cell 960 using any suitable components.
• first camera 910 may be focused such that the focal plane of first camera 910 is positioned at the elevation of reaction sites 962, such that first camera 910 is used to capture images in which reaction sites 962 are in focus and other reaction sites (e.g., reaction sites 964) are out of focus.
• Second camera 920 may be focused such that the focal plane of second camera 920 is positioned at the elevation of reaction sites 964, such that second camera 920 is used to capture images in which reaction sites 964 are in focus and other reaction sites (e.g., reaction sites 962) are out of focus.
• reaction site 964 may be imaged sharply by camera 920 while reaction site 962 is out of focus.
• reaction site 962 may be imaged sharply by camera 910 while reaction site 964 is out of focus.
• FIGS. 13A-13B show exemplary images which may be generated in this manner.
• FIG. 13 A shows an image in which reaction sites 962 at a first elevation are in focus, while reaction sites 964 at a second elevation are out of focus.
• FIG. 13B shows a companion image, in which reaction sites 962 at the first elevation are out of focus, while reaction sites 964 at the second elevation are in focus.
• the background illumination from the out of focus reaction sites may be removed from images such as shown in FIGS. 13A-13B, thereby providing images such as shown in FIGS. 14A-14B.
• FIG. 14A illustrates signals from the in focus reaction sites 962 of FIG. 13 A after background signals from out of focus reaction sites 964 have been removed, while FIG.
• FIG. 14B illustrates signals from the in focus reaction sites 964 of FIG. 13B after background signals from out of focus reaction sites 962 of FIG. 13B have been removed. Images such as shown in FIGS. 14A-14B may then be processed (e.g., by providing data used for sequencing by synthesis) and/or they may be combined to form a single super-resolution image such as shown in FIG. 15, which may allow all individual reaction sites to be resolved even though resolving individual reaction sites may not have been possible directly (e.g., because the pitch between adjacent reaction sites may have been below the diffraction limit of emitted light). Such processing may be executed by a controller such as controller 104, 595 and/or using any other suitable components.
• controller 104 such as controller 104, 595 and/or using any other suitable components.
• first camera 910 may capture images of one or more reaction sites 962 while second camera 920 simultaneously captures images of one or more reaction sites 964. Even in variations where first camera 910 captures images of one or more reaction sites 962 while second camera 920 simultaneously captures images of one or more reaction sites 964, there may still be some relative movement flow cell 960 and imaging assembly 900 during image capture. For instance, in one stage of operation first camera 910 may capture images of a first batch of more reaction sites 962 while second camera 920 simultaneously captures images of a first batch of reaction sites 964. Then, flow cell 960 may be moved relative to imaging assembly 900 such that first camera 910 may subsequently capture images of a second batch of reaction sites 962 while second camera 920 simultaneously captures images of a second batch of reaction sites 964.
• FIGS. 10A-10B show an imaging assembly 1000 that includes a camera 1010, a tube lens 1040, and an objective lens assembly 1050.
• Camera 1010 includes an image sensor 1012.
• Imaging assembly 1000 is positioned over a flow cell 1060 that includes reaction sites 1062, 1064.
• a light source (not shown) is used to emit an excitation light toward reaction sites 1062, 1064. Fluorophores at reaction sites 1062, 1064 emit light in response to the excitation light from the light source.
• Objective lens assembly 1050 is configured to capture and collimate these light emissions from reaction sites 1062, 1064.
• Tube lens 1040 is configured to re-image the emitted light from objective lens assembly 1050 onto image sensor 1012, with a magnification determined by the ratio of the focal lengths.
• reaction sites 1062 are all positioned at a first elevation while reaction sites 1064 are all positioned at a second elevation, with the second elevation being higher than the first elevation. While flow cell 1060 only provides two different reaction site 1062, 1064 elevations in this example, other versions may provide three or more reaction site elevations.
• imaging assembly 1000 may capture a sequence of images as flow cell 1060 is moved along the x-y plane. For instance, imaging assembly 1000 may capture a first image of flow cell 1060 when a reaction site 1064 is positioned directly under imaging assembly 1000 as shown in FIG. 10A; then capture a second image of flow cell 1060 when a reaction site 1062 is positioned directly under imaging assembly 1000 as shown in FIG. 10B.
• flow cell 1060 is moved relative to imaging assembly 1000 to capture a sequence of images (e.g., using a component similar to focus component 575 described above).
• at least a portion of imaging assembly 1000 is moved relative to flow cell 1060 using any suitable components.
• imaging assembly 1000 may provide selective refocusing of camera 1010 based on the position of flow cell 1060 in relation to imaging assembly 1000.
• Such selective refocusing of camera 1010 may be provided by varying the vertical position of objective lens assembly 1050 relative to flow cell 1060 and image sensor 1012, with the vertical position of objective lens assembly 1050 being based on the position of flow cell 1060 along a horizontal plane.
• camera 1010 may be automatically focused such that the focal plane of camera 1010 is positioned at the elevation of reaction sites 1064, such that camera 1010 is used to capture images focused on reaction sites 1064 when reaction sites 1064 are positioned directly under imaging assembly 1000.
• camera 1010 may be automatically focused such that the focal plane of camera 1010 is positioned at the elevation of reaction sites 1062, such that camera 1010 is used to capture images focused on reaction sites 1062 when reaction sites 1062 are positioned directly under imaging assembly 1000.
• each image captured when a reaction site 1064 at a first elevation was in focus may be correlated with an image captured when a reaction site 1062 at a second elevation was captured and, to the extent those images are offset relative to each other, one or both of those images may be translated so that they would be co-registered and could be used for removing background illumination from each other as described in more detail below.
• Any suitable components and techniques may be used to synchronize the focusing of camera 1010 with the positioning of flow cell 1060.
• the images captured by camera 1010 may be processed in accordance with the teachings herein. Such processing may be executed by a controller such as controller 104, 595 and/or using any other suitable components.
• FIGS. 11 A-l IB show an imaging assembly 1100 that includes a camera 1110, a tube lens 1140, and an objective lens assembly 1150.
• Camera 1110 includes an image sensor 1112.
• Imaging assembly 1100 is positioned over a flow cell 1160 that includes reaction sites 1162, 1164.
• a light source (not shown) is used to emit an excitation light toward reaction sites 1162, 1164. Fluorophores at reaction sites 1162, 1164 emit light in response to the excitation light from the light source.
• Objective lens assembly 1150 is configured to capture and collimate these light emissions from reaction sites 1162, 1164.
• Tube lens 1140 is configured to re-image the emitted light from objective lens assembly 1150 onto image sensor 1112, with a magnification determined by the ratio of the focal lengths.
• camera 1110 of imaging assembly 1100 is oriented obliquely relative to flow cell 1160, such that image sensor 1112 is not parallel with reaction sites 1162, 1164.
• reaction sites 1162 are all positioned at a first elevation while reaction sites 1164 are all positioned at a second elevation, with the second elevation being higher than the first elevation.
• flow cell 1160 only provides two different reaction site 1162, 1164 elevations in this example, other versions may provide three or more reaction site elevations.
• imaging assembly 1100 may capture a sequence of images as flow cell 1160 is moved along the x-y plane. For instance, imaging assembly 1100 may capture a first image of flow cell 1160 when a reaction site 1164 is positioned directly under imaging assembly 1100 as shown in FIG. 11 A; then capture a second image of flow cell 1160 when a reaction site 1162 is positioned directly under imaging assembly 1100 as shown in FIG. 11B.
• flow cell 1160 is moved relative to imaging assembly 1100 to capture a sequence of images (e.g., using a component similar to focus component 575 described above).
• imaging assembly 1100 is moved relative to flow cell 1160 using any suitable components.
• imaging assembly 1100 of FIGS. 11A-11B need not necessarily provide refocusing of camera 1110 based on the position of flow cell 1160 in relation to imaging assembly 1100. This is because camera 1110 is oriented obliquely relative to flow cell 1160, such that image sensor 1112 is not parallel with reaction sites 1162, 1164. Due to this oblique orientation of camera 1110, certain regions of images captured by camera 1110 will be substantially in focus while other regions of images captured by camera 1110 will not be substantially in focus, with the level of focus being dependent on the distance of the captured subject matter from the camera. In other words, the oblique tilt angle of camera 1110 may be selected such that at least some regions of reaction sites 1162, 1164 will be in focus regardless of the position of flow cell 1160 along the x-y plane.
• Two or more images may be captured of each reaction site 1162, 1164 as flow cell 1160 moves along the x-y plane, to thereby ensure that more than one region of each reaction site 1162, 1164 is substantially in focus among the images in an image set.
• camera 1110 may capture a series of images where, among the images in the series, all regions of each reaction site 1162, 1164 are substantially in focus, with the region of focus for each reaction site 1162, 1164 varying based on the x-y position of flow cell 1160 when the image at hand was captured.
• Image processing techniques may be used to merge the substantially in-focus regions of the various images of each reaction site 1162, 1164 to create a composite image of each reaction site 1162, 1164, where the entire composite image of each reaction site 1162, 1164 is substantially in focus.
• composite images of reaction sites 1162 are offset relative to composite images of reaction sites 1164, one or both of those composite images may be translated so that they would be co-registered and could be used for removing background illumination from each other as described in more detail below.
• the images captured by camera 1110 may be further processed in accordance with the teachings herein. Such processing may be executed by a controller such as controller 104, 595 and/or using any other suitable components.
• FIGS. 12A-12B show an imaging assembly 1200 that includes a camera 1210, a tube lens 1240, and an objective lens assembly 1250.
• Camera 1210 includes a first image sensor 1212, a first bandpass filter 1213, a second image sensor 1214, and a second bandpass filter 1214.
• Image sensor 1212 is vertically offset relative to image sensor 1214.
• Imaging assembly 1200 is positioned over a flow cell 1260 that includes reaction sites 1162, 1264.
• the vertical offset between image sensors 1212, 1214 is approximately equal to the vertical offset between reaction sites 1262, 1264 multiplied by the magnification squared.
• a light source (not shown) is used to emit an excitation light toward reaction sites 1262, 1264.
• Fluorophores at reaction sites 1262, 1264 emit light in response to the excitation light from the light source.
• Objective lens assembly 1250 is configured to capture and collimate these light emissions from reaction sites 1262, 1264.
• Tube lens 1240 is configured to reimage the emitted light from objective lens assembly 1250 onto image sensors 1212, 1214, with a magnification determined by the ratio of the focal lengths.
• reaction sites 1262 are all positioned at a first elevation while reaction sites 1264 are all positioned at a second elevation, with the second elevation being higher than the first elevation. While flow cell 1260 only provides two different reaction site 1262, 1264 elevations in this example, other versions may provide three or more reaction site elevations.
• imaging assembly 1200 may capture a sequence of images as flow cell 1260 is moved along the x-y plane. Moreover, imaging assembly 1200 may operate as a line scan system, such that imaging assembly 1200 may effectively capture images of relatively large areas simultaneously. For instance, with imaging assembly 1200 operating as a line scan system, imaging assembly 1200 may simultaneously capture images of reaction sites 1262 and reaction sites 1264 at the stage shown in FIG. 12 A; and also simultaneously capture images of reaction sites 1262 and reaction sites 1264 at the stage shown in FIG. 12B. By enabling the capture of images of several reaction sites 1262, 1264 simultaneously, imaging assembly 1200 may provide a faster processing times than some other versions.
• flow cell 1260 is moved relative to imaging assembly 1200 to capture a sequence of images (e.g., using a component similar to focus component 575 described above).
• imaging assembly 1200 is moved relative to flow cell 1260 using any suitable components.
• first image sensor 1212 is vertically positioned such that the focal plane of first image sensor 1212 is positioned at the elevation of reaction sites 1264, such that first image sensor 1212 is used to capture images focusing on reaction sites 1264.
• Second image sensor 1214 is vertically positioned such that the focal plane of second image sensor 1214 is positioned at the elevation of reaction sites 1262, such that second image sensor 1214 is used to capture images focusing on reaction sites 1262.
• the images captured by image sensors 1212, 1214 may be processed in accordance with the teachings herein. Such processing may be executed by a controller such as controller 104, 595 and/or using any other suitable components.
• first image sensor 1212 may capture images focusing on one or more reaction sites 1264 while second image sensor 1214 simultaneously captures images focusing on one or more reaction sites 1262.
• light 1270 at a first excitation wavelength may be used to illuminate reaction sites 1262.
• Fluorophores at reaction sites 1262 may emit light in a first emission wavelength spectrum in response to the excitation light 1270.
• First bandpass filter 1213 may be configured to only allow light within a certain wavelength range, that includes at least part of the first emission wavelength spectrum, to pass through first bandpass filter 1213.
• light 1272 at a second excitation wavelength may be used to illuminate reaction sites 1264.
• Fluorophores at reaction sites 1264 may emit light in a second emission wavelength spectrum in response to the excitation light 1272.
• the second emission wavelength spectrum can be different from the first emission wavelength spectrum.
• the first emission wavelength spectrum may emit light from approximately 630 nm to approximately 780 nm and the second emission wavelength spectrum may emit light from approximately 530 nm to approximately 625 nm.
• the second emission wavelength spectrum can overlap part of the first emission wavelength spectrum.
• the first emission wavelength spectrum may emit light from approximately 550 nm to approximately 700 nm and the second emission wavelength spectrum may emit light from approximately 475 nm to approximately 650 nm.
• Second bandpass filter 1215 may be configured to only allow light within a certain wavelength range, that includes the second emission wavelength spectrum, to pass through second bandpass filter 1215.
• first image sensor 1212 captures images focusing on one or more reaction sites 1264 while second image sensor 1214 simultaneously captures images focusing on one or more reaction sites 1262
• first image sensor 1212 may capture images of a first batch of more reaction sites 1264 while second image sensor 1214 simultaneously captures images of a first batch of reaction sites 1262.
• flow cell 1260 may be moved relative to imaging assembly 1200 such first image sensor 1212 may capture images of a second batch of reaction sites 1264 while second image sensor 1214 simultaneously captures images of a second batch of reaction sites 1262.
• reaction sites are set at different elevations from each other, it is possible to capture images in which signals from reaction sites at different elevations have different optical properties (e.g., being in-focus or out of focus). Using these different optical properties, it may be possible to resolve reaction sites at different elevations, thereby allowing images like those shown in FIGS. 13A- 13B to be used to derive cleaned images such as shown in FIGS. 14A-14B, and ultimately to derive super-resolution images such as shown in FIG. 15 in which individual reactions are depicted in focus and resolvable from their neighbors, despite neighboring reaction sites being separated by a pitch which may be less than the diffraction limit of the light emitted from the reaction sites. Examples of processing which may be used for this purpose are provided below in the context of FIG. 16.
• FIG. 16 that figure illustrates a process which may be used to obtain a super-resolution image of a flow cell having reaction sites at two different elevations, such as that illustrated in FIGS. 3 and 4.
• corresponding images having different focal planes are captured. This may be done, for example, by simultaneously capturing images of the same portion of a flow cell with two different cameras having two different focal planes, such as using an imaging assembly 900 as shown in FIG. 9 A, or an imaging assembly 1200 as such on FIG. 12 A.
• the background illumination i.e., the illumination from reaction sites to be removed from an image
• the background illumination is removed from each image using the correspondence between the images captured in block 1901. This may be done, for example, through use of equations 1 and 2:
• Ii and I2 are, respectively light actually emitted from reaction sites at different elevations (e.g., in a configuration shown in FIGS. 9A-9B, Ii may be light emitted from reaction sites 964, while I2 may be light emitted from reaction sites 962).
• Im is the light captured by the camera having a focal plane corresponding to the elevation of the reaction sites that emit Ii
• I n is the light captured by the camera having a focal plane corresponding to the elevation of the reaction sites that emit I2.
• h is the kernel (also sometimes referred to as a point spread function, or PSF) reflecting the blurriness of the reaction sites which are out of focus, and can be determined through modeling based on the fact that the focal plane, the wavelength of emitted light, the magnification, the numerical aperture of the objective, and the height difference between reaction sites are known, h may also be experimentally, for example, using raytracing in an optical system and/or techniques such as described in U.S. Pat. App. No.
• PSF point spread function
• h may also be approximated using a Gaussian or first order Bessel function (Airy function).
• F is the Fourier transform
• F' 1 is the inverse Fourier transform.
• equations 1 and 2 would operate to remove background illumination (i.e., illumination from out of focus reaction sites)
• background illumination i.e., illumination from out of focus reaction sites
• FIGS. 9A-12B For example, when an optics system simultaneously captures two images having different focal planes, those images can be represented as the light from the in-focus reaction sites, combined with the light from the out of focus reaction sites when that light is convolved with the blur kernel.
• equations 1 and 2 and with the ® operator used to represent convolution using equations 3 and 4, below.
• Equation 4 [00125] b can then be solved for by subtracting Ii®h from both sides of equation 4. This can then be plugged back into equation 3, providing equation 5, in which the only unknown is h. I n ®h can then be subtracted from both sides of equation 5, providing equation 6, in which the unknown value (Ii) is on the right side of the equation, while the captured images (I m and I n ) are on the right side of the equation.
• the unknown value (Ii) can then be isolated by factoring l-F(h) 2 from the right side of equation 8, to obtain equation 9, and then dividing both sides of equation 9 by 1- F(h) 2 and flipping the result to obtain equation 10.
• equation 1 can be obtained by taking the inverse Fourier transform of equation 10, there by providing a way to extract the light from a set of in-focus reaction sites from an image where those rection sites are in-focus (i.e., l m ) an image where those reaction sites are out of focus (i.e., l n ), and the blur kernel reflecting how out of focus the out of focus reaction sites are (i.e., h). Similar manipulations can be applied to obtain equation 2, in which light from the reaction sites which are in focus is I2 rather than Ii.
• the filtered images may be combined in block 1903 to obtain a single super resolution image showing light emitted from all of the reaction sites.
• the superresolution image can be provided as output of the process, such as for use in sequencing by synthesis or other types of processing.
• the creation of a combined super-resolution image may be omitted, and instead any further processing may be performed directly on the filtered images obtained in block 1902. Accordingly, the description set forth above regarding the process of FIG. 16 should be understood as being illustrative only, and should not be treated as limiting.
• hi represents the blurriness of the background illumination in image I n
• h 2 represents the blurriness of background illumination in image I m .
• Ii and I2 have the same meanings as in Equations 1-12.
• I3 is the illumination emitted from reaction sites at a third elevation which is different from the elevations of the reaction sites which emit Ii and I2.
• IL is the image captured with the reaction sites that emit Ii in focus
• IM is the image captured with the reaction sites that emit I2 in focus
• IN is the image captured with the reaction sites that emit I3 in focus.
• hL2 and hL3 are, respectively, kernels representing the blurriness of I2 and I3 in the image II.
• the term “set” should be understood as one or more things which are grouped together.
• “based on” should be understood as indicating that one thing is determined at least in part by what it is specified as being “based on”. Where one thing is required to be exclusively determined by another thing, then that thing will be referred to as being “exclusively based on” that which it is determined by.
• the phrase “means for obtaining a plurality of differently focused unfiltered images based on signals from reaction sites comprised by a flow cell” should be understood as a means plus function limitation in which the function is “obtaining a plurality of differently focused unfiltered images based on signals from reaction sites comprised by a flow cell” and the corresponding structure is one or more cameras, beam splitters and other components illustrated and/or discussed in the context of FIGS. 9A-12B.
• the phrase “means for determining a plurality of derived images separating signals from corresponding sets of reaction sites based on differences in focus” should be understood as a means plus function limitation in which the function is “determining a plurality of derived images separating signals from corresponding sets of reaction sites based on differences in focus” and the corresponding structure is a computer configured to filter unfocused background illumination as described in the context of equations 1-2, 11-16, and the surrounding description.

Landscapes

• Physics & Mathematics (AREA)
• Chemical & Material Sciences (AREA)
• Analytical Chemistry (AREA)
• Engineering & Computer Science (AREA)
• General Physics & Mathematics (AREA)
• Multimedia (AREA)
• Optics & Photonics (AREA)
• Health & Medical Sciences (AREA)
• Dispersion Chemistry (AREA)
• General Health & Medical Sciences (AREA)
• Computer Vision & Pattern Recognition (AREA)
• Clinical Laboratory Science (AREA)
• Hematology (AREA)
• Chemical Kinetics & Catalysis (AREA)
• Pathology (AREA)
• Human Computer Interaction (AREA)
• Signal Processing (AREA)
• Immunology (AREA)
• Biochemistry (AREA)
• Life Sciences & Earth Sciences (AREA)
• Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
• Investigating, Analyzing Materials By Fluorescence Or Luminescence (AREA)

Applications Claiming Priority (2)

Publications (1)

Family

ID=83319006

Family Applications (1)

Country Status (5)

Family Cites Families (5)

• 2022
  • 2022-08-23 WO PCT/US2022/041208 patent/WO2023034076A1/en active Application Filing
  • 2022-08-23 EP EP22769833.9A patent/EP4344443A1/de active Pending
  • 2022-08-23 CN CN202280049299.2A patent/CN118103750A/zh active Pending
  • 2022-08-30 US US17/898,802 patent/US20230070459A1/en active Pending
  • 2022-08-31 TW TW111132801A patent/TW202337561A/zh unknown

Also Published As

Similar Documents

Legal Events