CN107533218B - Method and apparatus for auto-focusing - Google Patents

Method and apparatus for auto-focusing Download PDF

Info

Publication number
CN107533218B
CN107533218B CN201680006723.XA CN201680006723A CN107533218B CN 107533218 B CN107533218 B CN 107533218B CN 201680006723 A CN201680006723 A CN 201680006723A CN 107533218 B CN107533218 B CN 107533218B
Authority
CN
China
Prior art keywords
objective lens
plate
plane
apertures
wells
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201680006723.XA
Other languages
Chinese (zh)
Other versions
CN107533218A (en
Inventor
什洛莫·图尔格曼
雅艾尔·巴兰
亚历克斯·埃弗罗斯
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IDEA BIO-MEDICAL Ltd
Original Assignee
IDEA BIO-MEDICAL Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by IDEA BIO-MEDICAL Ltd filed Critical IDEA BIO-MEDICAL Ltd
Publication of CN107533218A publication Critical patent/CN107533218A/en
Application granted granted Critical
Publication of CN107533218B publication Critical patent/CN107533218B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/24Base structure
    • G02B21/241Devices for focusing
    • G02B21/244Devices for focusing using image analysis techniques
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/006Optical details of the image generation focusing arrangements; selection of the plane to be imaged
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/06Means for illuminating specimens
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/24Base structure
    • G02B21/241Devices for focusing
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/24Base structure
    • G02B21/248Base structure objective (or ocular) turrets
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/33Immersion oils, or microscope systems or objectives for use with immersion fluids
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/34Microscope slides, e.g. mounting specimens on microscope slides

Landscapes

  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Analytical Chemistry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Engineering & Computer Science (AREA)
  • Oil, Petroleum & Natural Gas (AREA)
  • Microscoopes, Condenser (AREA)
  • Automatic Analysis And Handling Materials Therefor (AREA)
  • Optical Measuring Cells (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • Automatic Focus Adjustment (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

An autofocus method for determining a focus position of a plurality of wells in at least a portion of a multi-well plate, the method comprising: identifying, using a first objective lens having a first magnification, a focal position of each of the wells relative to the first objective lens in each of at least three wells of the selected subset of the plurality of wells; calculating a plane based on at least three of the focal positions along which the at least three apertures are in focus relative to at least one objective lens having a second magnification that is no greater than the first magnification; and scanning at least some of the plurality of wells in the portion of the plate along the plane using the at least one objective lens.

Description

Method and apparatus for auto-focusing
Technical field and background
The present invention relates generally to the field of optical measurement and/or detection techniques, and more particularly to a method and apparatus for auto-focusing that is particularly useful when viewing non-planar surfaces.
Autofocus is an important feature in many fields of automated detection, such as the computer chip industry, biomedical research, data reading/recording in optical information carriers, etc. In particular, when analyzing samples in multi-well plates comprising a plurality of wells on a single plate, the autofocus of the microscope observing the contents of the wells can make the workflow more efficient, as the operator does not need to focus an objective lens on each well in the plate individually.
In the past, various autofocus methods for inspecting multi-well plates have been disclosed, for example, in U.S. patent No. 7,109,459. However, existing auto-focusing methods may require time-consuming image analysis when using, for example, wells with non-planar bottoms (e.g., multi-well plates with U-shaped bottoms) for growing living cells into spheroids.
Therefore, there is a need for a method for autofocusing a microscope on a multiwell plate that is suitable for multiwell plates having wells with non-planar bottom surfaces.
Disclosure of Invention
The present invention relates generally to the field of optical measurement and/or detection techniques, and more particularly to a method and apparatus for auto-focusing that is particularly useful when viewing non-planar surfaces.
There is provided, in accordance with an embodiment of the present invention, an auto-focusing method for determining a focus position of a plurality of wells in at least a portion of a multi-well plate, the method including:
identifying, using a first objective lens having a first magnification, a focal position of each of at least three wells of a selected subset of the plurality of wells relative to the first objective lens in each of the wells;
calculating a plane along which at least three apertures are in focus relative to at least one objective lens having a second magnification that is no greater than the first magnification based on at least three of the focus positions; and
scanning at least some of a plurality of wells in a portion of the plate along the plane using the at least one objective lens.
In some embodiments, the at least one objective lens is a first objective lens, and the first magnification is equal to the second magnification. In some embodiments, calculating the plane comprises calculating a plane along which the at least three apertures are in focus relative to the first objective lens.
In some embodiments, the at least one objective lens is a second objective lens different from the first objective lens, wherein the second magnification is less than the first magnification. In some embodiments, calculating the plane includes translating the at least three focus positions identified using the first objective lens to respective second focus positions relative to the second objective lens based on optical characteristics of the second objective lens; and calculating a plane based on the at least three second focus positions. In some embodiments, computing the plane comprises: calculating a first plane along which at least three apertures are to be focused with respect to the first objective lens, based on at least three of said focus positions; and converting the first plane to a corresponding plane along which the at least three apertures will be focused relative to the second objective based on optical characteristics of the second objective, thereby calculating a plane.
In some embodiments, the at least one objective lens is used for scanning without additional focusing operations.
In some embodiments, the subset of the plurality of wells comprises more than three wells of the plurality of wells.
In some embodiments, identifying the focal position includes identifying the focal position of each aperture in the subset.
In some embodiments, each aperture comprises a substantially cylindrical sidewall and a bottom surface comprising a portion of at least one of a sphere, a paraboloid, and an ellipse. In some embodiments, each aperture has a U-shaped cross-section.
In some embodiments, each aperture includes a generally cylindrical sidewall and a planar bottom surface. In some embodiments, the planar bottom surface is substantially parallel to the top surface of the perforated plate such that the wells have a rectangular cross-section.
In some embodiments, each aperture is frustoconical.
In some embodiments, each aperture has sloped sidewalls, a planar bottom, and a trapezoidal cross-section.
In some embodiments, the method further comprises aligning the first objective lens to be axially over the center of one of the apertures prior to using the first objective lens.
In some embodiments, a portion of the plate comprises one quarter of the plate. In some embodiments, a portion of the plate comprises the entirety of the plate.
There is also provided, in accordance with an embodiment of the present invention, an auto-focusing method for determining a focus position of at least a portion of a hole in a plate, the method including: using a first objective lens having a first magnification to identify a first focal position of at least a portion of the aperture relative to the first objective lens at least one location of the aperture; identifying, for the first focus position, a respective focus position relative to at least one objective lens having a second magnification based on optical characteristics of the at least one objective lens; and scanning at least a portion of the aperture using the at least one objective lens at a height corresponding to the respective focal position, wherein the second magnification is not greater than the first magnification.
In some embodiments, the at least one objective lens is a first objective lens, the first magnification is equal to the second magnification, and the respective focus position is a first focus position.
In some embodiments, the at least one objective lens comprises a second objective lens different from the first objective lens, wherein the second magnification is less than the first magnification. In some such embodiments, the identifying includes translating the first focus position to a corresponding focus position relative to the second objective lens based on an optical characteristic of the second objective lens.
In some embodiments, at least one objective lens is used for scanning without additional focusing operations.
In some embodiments, the aperture comprises a substantially cylindrical sidewall and a bottom surface comprising a portion of at least one of a sphere, a paraboloid, and an ellipse. In some embodiments, the aperture has a U-shaped cross-section.
In some embodiments, the aperture includes a generally cylindrical sidewall and a planar bottom surface. In some embodiments, the planar bottom surface is substantially parallel to the top surface of the plate such that the aperture has a rectangular cross-section.
In some embodiments, the bore is frustoconical. In some embodiments, the holes have sloped sidewalls, a planar bottom, and a trapezoidal cross-section.
There is also provided, in accordance with an embodiment of the present invention, apparatus for automatically determining a focus position of a plurality of wells located in at least a portion of a plate containing wells, the apparatus including: a calculation component programmed to calculate a plane along which at least three apertures in a portion of the plate will be in focus relative to the objective lens; a first objective lens functionally associated with the computing component, the first objective lens having a first magnification, an image from the first objective lens being used by the computing component to identify a focal position for each aperture of at least three apertures of a selected subset of a plurality of apertures; and at least one objective lens having a second magnification that is not greater than the first magnification, the at least one objective lens to scan at least some of a plurality of apertures in a portion of a plate along the plane, wherein the calculation component is configured to calculate a plane based on at least three focus positions, wherein at least three apertures are focused along the calculation plane relative to the at least one objective lens.
In some embodiments, the at least one objective lens is configured to scan a plurality of apertures along a plane without performing additional focusing operations.
In some embodiments, the at least one objective lens is a first objective lens, and the second magnification is equal to the first magnification.
In some embodiments, the at least one objective lens is a second objective lens different from the first objective lens, and the second magnification is less than the first magnification.
In some embodiments, the calculation component is programmed to calculate the focal plane by: translating the at least three focus positions determined using the first objective lens into respective second focus positions relative to the second objective lens based on optical characteristics of the second objective lens; and calculating a focal plane based on the at least three second focal positions.
In some embodiments, the computing component is programmed to compute the focal plane by: calculating a first plane along which at least three apertures are to be focused with respect to the first objective lens based on the at least three focus positions; and converting the first plane to a corresponding plane based on optical characteristics of a second objective lens, the at least three apertures being focused along the corresponding plane relative to the second objective lens, thereby calculating a plane.
In some embodiments, the computing component is programmed to identify a focus position for each aperture in the subset.
In some embodiments, the device is adapted for use with a plate, wherein each aperture comprises a substantially cylindrical sidewall and a bottom surface comprising at least one of a portion of a sphere, a paraboloid, and a portion of an ellipse. In some embodiments, the device is adapted for use with a plate in which each aperture has a U-shaped cross-section.
In some embodiments, the device is adapted for use with a plate in which each well comprises a generally cylindrical side wall and a planar bottom surface. In some embodiments, the planar bottom surface is substantially parallel to the top surface of the plate such that each aperture has a substantially rectangular cross-section.
In some embodiments, the device is adapted for use with plates in which each aperture is frustoconical. In some embodiments, the device is suitable for plates in which each well has an inclined side wall, a planar bottom and a trapezoidal cross-section.
In some embodiments, a portion of the plate comprises one quarter of the plate. In some embodiments, a portion of the plate comprises the entirety of the plate.
There is also provided, in accordance with an embodiment of the present invention, an autofocus apparatus for automatically determining a focus position of at least a portion of an aperture, the apparatus including: a computing component programmed to compute a focus position of a portion of the aperture; a first objective lens functionally associated with the computing means, the first objective lens having a first magnification, the image from the first objective lens being used by the computing means to identify a focus position of the aperture relative to the first objective lens in at least one position of the aperture; and at least one objective lens having a second magnification that is not greater than the first magnification, the at least one objective lens for scanning at least a portion of the aperture at a height relative to a respective focal position of the aperture of the at least one objective lens, wherein the computing component is programmed to identify the respective focal position based on an optical characteristic of the at least one objective lens.
In some embodiments, the at least one objective lens is configured to scan a portion of the aperture without performing an additional focusing operation.
In some embodiments, the at least one objective lens is a first objective lens, the second magnification is equal to the first magnification, and the respective focus position is the same as the first focus position.
In some embodiments, the at least one objective lens is a second objective lens different from the first objective lens, and wherein the second magnification is less than the first magnification. In some embodiments, the computing component is programmed to identify the respective focus position by translating the first focus position to the respective focus position relative to the second objective lens based on an optical characteristic of the second objective lens.
In some embodiments, the device is adapted for use with an aperture comprising a substantially cylindrical sidewall and a bottom surface comprising at least one of a portion of a sphere, a paraboloid, and a portion of an ellipse. In some embodiments, the device is adapted for use with a bore having a U-shaped cross-section.
In some embodiments, the device is adapted for use with an aperture comprising a substantially cylindrical sidewall and a planar bottom surface. In some embodiments, the planar bottom surface is substantially parallel to the top surface of the plate such that the aperture has a substantially rectangular cross-section.
In some embodiments, the device is adapted for use with a frustoconical bore. In some embodiments, the device is adapted for use with apertures having sloped sidewalls, planar bottoms, and trapezoidal cross-sections.
Unless defined otherwise, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this invention belongs. In case of conflict, the terminology (including definitions) of the specification will be prioritized.
As used herein, the terms "comprises," "comprising," "includes," "including," "has," "having" and grammatical variations thereof are to be taken as specifying the stated features, integers, steps or components, but do not preclude the addition of one or more additional features, integers, steps, components or groups thereof. These terms include the terms "consisting of … …" and "consisting essentially of … …".
The indefinite articles "a" and "an" as used herein mean "at least one" or "one or more" unless the context clearly dictates otherwise.
Embodiments of the methods and/or apparatus of the present invention may involve performing or completing selected tasks manually, automatically, or a combination thereof. Some embodiments of the invention are implemented using components comprising hardware, software, firmware or a combination thereof. In some embodiments, some components are general purpose components, such as a general purpose computer or monitor. In some embodiments, some components are application-specific or custom components, such as circuits, integrated circuits, or software.
For example, in some embodiments, some embodiments are implemented as a plurality of software instructions executed by a data processor, e.g., that is part of a general purpose or custom computer. In some embodiments, the data processor or computer includes volatile memory for storing instructions and/or data and/or non-volatile memory for storing instructions and/or data, such as a magnetic hard disk and/or removable media. In some embodiments, the implementation includes a network connection. In some embodiments, implementations include a user interface that generally includes one or more input devices (e.g., to allow commands and/or parameters to be entered) and an output device (e.g., to allow reporting of operating parameters and results).
Drawings
Some embodiments of the invention are described herein with reference to the accompanying drawings. This description together with the drawings make apparent to those skilled in the art how to implement some embodiments of the invention. The drawings are for purposes of illustration and discussion and are not intended to show structural details of the embodiments in more detail than is necessary for a fundamental understanding of the invention. For purposes of clarity, some of the objects depicted in the drawings are not to scale.
In the drawings:
FIGS. 1A and 1B are a top view of a multi-well plate and a cross-sectional view of an individual well in a multi-well plate, the well having a non-planar bottom surface for which embodiments of the present teachings may be useful, respectively;
FIG. 2 is a block diagram of an embodiment of an imaging device for autofocusing samples in a multi-well plate according to an embodiment of the present teachings; and
fig. 3 is a flow chart of an embodiment of a method for automatically focusing an imaging device on a sample in a multi-well plate according to an embodiment of the present teachings.
Detailed Description
The principles, uses and embodiments of the present teachings can be better understood with reference to the accompanying description and drawings. One skilled in the art, upon perusing the description and figures presented herein, will be able to implement the invention without undue effort or experimentation.
Before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its application to the details of construction and the arrangement of the components and/or methods set forth in the following description and/or illustrated in the drawings and/or examples. The invention is capable of other embodiments and of being practiced or of being carried out in various ways. It is also to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting.
Reference is now made to fig. 1A and 1B, which are, respectively, a top view of a multi-well plate and a cross-sectional view of an individual well in a multi-well plate, the well having a non-planar bottom surface for which embodiments of the present teachings may be useful.
As shown in fig. 1A, perforated plate 10 has a top surface 11, side surfaces (not shown), and in some embodiments a bottom surface (not shown). The plate 10 comprises a plurality of holes 12, said holes 12 being arranged in a grid formed by columns 14 and rows 16 and being accessible through holes 17 in the top surface 11. Typically, rows and columns are enumerated or otherwise labeled to enable a user to easily reference a particular well 12. The multi-well plate 10 in the illustrated embodiment contains 96 wells, although other types of plates including, for example, a different number of wells (such as 12, 24, or 384 wells) can also be used with the teachings of the present invention, as described in further detail below. Typically, the holes 12 have a fixed distance between each other and are thus distributed at regular intervals on the plate 10. Specifications regarding the distance between the holes are standard in the art and are also typically provided by the manufacturer of the plate. Typically, the number of holes in the plate has 3: 2, in the longitudinal direction. Thus, the holes may be arranged, for example, in 3 × 2, 6 × 4, 12 × 8, or 24 × 16 grids.
Referring again to FIG. 1B, it can be seen that each hole 12 in the plate 10 can be non-rectangular in cross-section such that the hole has a non-linear bottom surface. In the illustrated embodiment, the well 12 contains a cavity 18 and has a U-shaped cross-section such that the sidewall 20 of the well generally forms a cylinder and the bottom 22 of the well forms a portion of a sphere, a portion of a paraboloid, or a portion of an ellipse, thereby defining a curved floor of the well. Thus, the holes typically have a U-shaped cross-section or a cross-section resembling a paraboloid. Typically, the thickness of the sidewalls 20 and the bottom 22 are the same. An edge 26, which typically forms a portion of and is flush with the top surface 11 of the plate 10 or is raised relative to the top surface 11 of the plate 10, typically surrounds the aperture 12.
Multi-well plates containing wells with non-planar floors are well known in the art and are commercially available from many manufacturers, such as Corning Incorporated Life Sciences of Tewksbury, Mass. Such multiwell plates are used for many types of samples, including for culturing spheroids, culturing non-adherent cells such as lymphocytes and other blood cells, for analysis of 3-dimensional samples, and for processing of compounds. Typically, analysis of these samples requires imaging the sample within the well.
It will be appreciated that since the bottom surface of the well 12 is curved, the area of the observation well which will be focused by the microscope is typically very small and in some cases comprises a single point. Thus, existing autofocus mechanisms, such as those disclosed in U.S. patent No. 7,109,459, are generally not successful in focusing a sample disposed within a well. As described below, the method taught by the present invention enables an operator to automatically focus an imaging device on an aperture having a non-planar bottom, such as the U-shaped aperture 12 in FIG. 1B, without having to manually focus the imaging device on each individual aperture.
It should be understood that although the exemplary schematic shows a hole having a U-shaped cross-section, the methods of the present teachings as described below may be used with other types of holes, such as holes having a planar bottom surface and a rectangular cross-section, or frustoconical holes, i.e., holes that include truncated cones having sloped sidewalls and a planar bottom, and that have a generally trapezoidal cross-section.
Referring now to fig. 2, fig. 2 is a block diagram of an embodiment of an imaging device 200 for autofocusing on wells in a multi-well plate, according to an embodiment of the present teachings.
It should be understood that the present disclosure discusses auto-focusing of wells that include samples by way of example only, and that the same methods and apparatus may also be used for auto-focusing on wells that do not contain samples, or for focusing on multi-well plates in which some wells include samples and others do not.
As shown in fig. 2, imaging device 100 includes a scanning microscope 202 functionally associated with a sample platform movable along X, Y and the Z-axis. The sample platform is configured to have disposed thereon a sample plate 205, which sample plate 205 may be, for example, a plate similar to plate 10 of fig. 1A and 1B.
The microscope 202 also includes a plurality of objective lenses 206 functionally associated with an objective lens changer 208. At any given time, a single objective lens 206 is aligned with a sample platform (not shown) and is operable such that a sample plate disposed on the sample platform may be viewed through the objective lens. The objective lens changer 208 is configured to change the operable lens for observing the specimen when the objective lens needs to be changed. An example of such a converter is described, for example, in WO2012/097191, the contents of which are incorporated herein by reference.
The microscope 202 is functionally associated with at least one illumination source controlled by a control unit (not shown). In some embodiments, the microscope includes a first illumination source comprising a transmissive light source 210a, such as an LED lamp, the transmissive light source 210a configured to illuminate a sample platform during imaging of a sample plate 205 disposed on the sample platform. In some embodiments, the microscope further comprises a second illumination source comprising an excitation light source 210b, the excitation light source 210b being configured to provide illumination to generate a response in a sample loaded on or in the sample plate 205, such as to provide illumination to excite a fluorescent or luminescent component of the sample. In some embodiments, illumination from light sources 210a and/or 210b impinges on one or more optical elements 212, such as mirrors, dichroic cubes, beam splitters, filters, and the like, prior to impinging on a sample disposed on sample plate 205. In some embodiments, illumination from illumination source 210 passes through optical fiber 213 before striking the sample.
In some embodiments, the image viewable through the microscope 202 is acquired by an image acquisition unit (not shown) and transferred to the processing unit 214 for further processing and analysis.
Referring now to fig. 3, fig. 3 is a flow chart of an embodiment of a method for automatically focusing an imaging device on a sample in a multi-well plate according to an embodiment of the present teachings.
The methods described below may be used in an imaging device, such as imaging device 200 of fig. 2, to automatically determine the focus position of a plurality of samples disposed in a sample plate, such as plate 10 of fig. 1A, that contains a plurality of wells. The method may be performed on plates containing wells having non-planar bottom surfaces, such as well 12 of fig. 1B, or on other types of wells, such as wells having planar bottom surfaces or frustoconical wells having sloped sidewalls and planar bottoms, etc.
A subset of the holes in the plate is selected, as shown in step 300. In some embodiments, the subset includes at least three wells each containing a liquid or sample, although this is not necessary for the methods disclosed herein. At step 302, for at least three apertures in the subset, and in some embodiments for all apertures in the subset, for a first objective lens having a first magnification (e.g., objective lens 206 of FIG. 2), a focus position of a sample contained in the aperture is identified.
Typically, the first objective lens has a considerable magnification, such as 20x, 10x, etc.
In some embodiments, the subset contains more than three apertures, but the focus positions are identified only for three apertures in the subset. In some embodiments, the subset contains more than three apertures, and the focal positions are identified for more than three apertures in the subset, but not for all apertures in the subset. For example, the subset may contain at least five apertures, and the focal positions are identified for at least four apertures in the subset, rather than for all apertures. In some embodiments, the focal position is identified for all of the apertures in the subset.
The focal position of the sample in the wells of the subset may be identified using any suitable method known in the art, including manual and automated methods. In some embodiments, the focus position is identified substantially as described in U.S. patent No. 7,109,459, the contents of which are incorporated herein by reference as if fully set forth herein.
According to the teaching of us patent No. 7,109,459, to determine the focus position, the focal plane of the first objective lens is spaced from a surface of the plate, such as the bottom surface of the plate, by a distance, for example, about one millimeter. The focal plane of the objective lens is then shifted towards the plate, for example by shifting the objective lens or the plate relative to each other. For example, the objective lens may be arranged below the plate such that the focal plane of the objective lens is below the surface of the plate and the focal plane is displaced vertically upwards towards the surface of the plate.
During the shift of the focal plane of the objective lens, the control hardware of the microscope records the intensity of the light reflected off the plate until the intensity of the detected light reaches a maximum value, which in some embodiments is above a preset threshold. This maximum value of the detected light intensity corresponds to the focal position of the surface of the plate.
Without wishing to be bound by theory, in the above example, in which the objective lens is arranged below the plate and the focal plane is initially set below the plate and displaced towards the plate, the location at which the maximum light intensity is observed is considered to correspond to the point at which the focal plane of the objective lens is tangent to the curved surface of the aperture bottom.
Subsequently, in some embodiments, the focal plane of the objective lens continues to be displaced towards the plate until another peak in the reflected light intensity is detected, which peak is defined by a respective threshold value depending on the environment and the sample being detected. Without wishing to be bound by theory, in the above example, where the objective lens is arranged below the plate and the focal plane is initially disposed below the plate and displaced towards the plate, it is believed that a second peak in reflected light intensity occurs when the focal plane of the objective lens is tangent to the bottom of the well plate, and that this second peak generally represents a shift from the focus position of the sample. The size of the offset may be determined manually by a user or may be determined automatically using methods known in the art.
In some embodiments, the offset is calculated from a first peak in the intensity of the detected light without continuing to search for a second peak in the intensity of the detected light. In such embodiments, the size of the offset may be determined manually by a user, or may be determined automatically using methods known in the art.
It will be appreciated that the direction in which the focal plane is displaced towards the plate and the order in which the peaks in the intensity of the detected light are identified depends on the settings of the imaging device. For example, in some embodiments, the objective lens is arranged below the sample plate, but the focal plane of the objective lens is disposed above the bottom of the well such that the focal plane is displaced downward towards the bottom of the well. Without wishing to be bound by theory, in these embodiments it is believed that a first peak in reflected light intensity occurs when the focal plane of the objective lens is tangent to the bottom of the well plate, and that this first peak generally represents a shift from the focused position of the sample, while the position of a second peak in detected reflected light intensity corresponds to a point where the focal plane of the objective lens is tangent to the curved surface of the well bottom. A corresponding situation may also arise in other embodiments, in which the objective lens is arranged above the sample plate and the focal plane of the objective lens is arranged above the bottom of the well, such that the focal plane is displaced downwards towards the bottom of the well.
As another example, in some embodiments the objective lens is arranged above the sample plate, but the focal plane of the objective lens is arranged below the bottom of the well, such that the focal plane is displaced upwards towards the bottom of the well. Without wishing to be bound by theory, in these embodiments it is believed that the position of the first peak in the detected reflected light intensity corresponds to the point at which the focal plane of the objective lens is tangent to the curved surface of the well bottom, whereas a second peak in the reflected light intensity occurs when the focal plane of the objective lens is tangent to the well plate bottom, and this second peak generally represents a shift from the focused position of the sample.
In some embodiments, the center of the hole where the focal position is located is determined based on the specifications of the plate provided by the manufacturer. In some embodiments, the center of the aperture is determined using an X-Y displacement of the plate or an X-Y displacement of the objective lens until the center of the aperture or the edge of the aperture is determined using suitable light detection parameters and features, as is known in the art.
At step 304, at least three focal positions determined in step 302 are used to calculate a plane along which at least some, and typically all, of the plurality of apertures in the plate are focused or nearly focused with respect to the second objective lens (such as objective lens 206 of FIG. 2). The second objective lens has a second magnification that is not greater than the first magnification of the first objective lens. As described below, the second objective lens is used to scan the aperture based on the location calculation plane, by maintaining the position of the second objective lens during scanning such that the calculated plane and the focal plane of the second objective lens are coincident or nearly coincident for any given scanned aperture.
In some embodiments, the plane is calculated by: at least three (typically each) of the focal positions determined in step 302 using the first objective lens are translated into respective second focal positions relative to the second objective lens based on the optical characteristics of the second objective lens, and a plane including the at least three second focal positions is calculated.
In some embodiments, the plane is calculated by: calculating a first plane based on at least three focal positions, wherein along the first plane at least some of the plurality of wells in the plate, and typically all of the wells in the plate, are in focus or near focus with respect to the first objective lens; the first plane is then converted into a corresponding plane based on the optical characteristics of the second objective lens, along which at least some of the apertures, and typically all of the apertures, are focused or nearly focused with respect to the second objective lens.
As described above, the second objective lens has a magnification not larger than the first magnification of the first objective lens. Thus, in some embodiments, the second magnification is less than the first magnification, and may be, for example, 4x or 2 x. In some embodiments, the second magnification is equal to the first magnification, but the second objective lens has a numerical aperture value that is higher than the numerical aperture value of the first objective lens.
In some embodiments, the plane is calculated using all of the focus positions identified in step 302. In other embodiments, the plane is calculated using less than all of the focus positions identified in step 302.
In some embodiments, for a portion of the plate (e.g., a quarter of the plate), the plane is calculated using at least three focal positions identified with the first objective lens within that portion of the plate. In such embodiments, for each portion or each quarter of the plate, the method described herein is repeated using a different set of focus positions for each such portion.
At step 306, which may occur before or after step 304 described above, the first objective lens is replaced with the second objective lens, for example, by a suitable hardware mechanism (such as objective lens changer 208 of fig. 2). In some embodiments, the first and second objective lenses are identical, thereby eliminating step 306 of FIG. 3.
Finally, at step 308, the second objective lens is used to scan or image the wells of the multi-well plate along the plane calculated in step 304 without any additional focusing operations.
The scanning of step 308 may be performed using any suitable method known in the art, including capturing a stack of images, which is particularly useful when imaging three-dimensional structures such as spheroids. In some embodiments, the teachings herein can be implemented on a plate having a single well or on a single well within a multi-well plate. In these embodiments, a first objective lens is used to find the focal point of the sample in the plate. Based on the optical characteristics of the second objective lens, the focal point found using the first objective lens is converted into the focal point of the second objective lens. Then, when the second objective lens is placed at the translated focus point or at its height, the second objective lens is used to scan the plate.
It should be appreciated that the teachings herein allow for focusing of the imaging device relative to the plate, regardless of "expected height differences" and "unexpected height differences" within the tube plate. The "expected height difference" is defined as the curvature of the plate listed in the specification of the plate and is the curvature that the manufacturer wishes to have in the plate, for example having a curved bottom due to the structure. An "unexpected height difference" is defined as a lack of flatness, which is undesirable in the specifications of the panel. The "unexpected height difference" may be, for example, due to a difference in the relative heights of the bottoms of the wells; or may be a deviation of flatness in a virtual surface tracked by the scanning component, e.g. as the objective lens is moved; or the surface on which the plate rests is not parallel to the virtual surface tracked by the scanning component as the objective lens moves.
It is appreciated that certain features of the invention, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable subcombination or as suitable in any other described embodiment of the invention. Certain features described in the context of various embodiments are not considered essential features of those embodiments, unless the embodiment is inoperative without those elements.
While the invention has been described in conjunction with specific embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, it is intended to embrace all such alternatives, modifications, and variations that fall within the scope of the included claims.
Any reference cited or identified in this application is not to be construed as an admission that such reference is available as prior art to the present invention.
Section headings are used herein for simplicity of understanding the specification and should not be construed as necessarily limiting.

Claims (28)

1. An auto-focusing method for determining a focus position of a plurality of wells in at least a portion of a multi-well plate, the method comprising:
identifying, using a first objective lens having a first magnification, a focal position of each of the wells relative to the first objective lens in each of at least three wells of the selected subset of the plurality of wells;
calculating a plane based on at least three of the focal positions along which the at least three apertures are focused relative to a second objective lens having a second magnification that is less than the first magnification; and
scanning at least some of the plurality of holes in the portion of the plate along the plane using the second objective lens.
2. The auto-focusing method of claim 1, wherein the calculating a plane comprises:
translating at least three of the focus positions identified using the first objective lens into respective second focus positions relative to the second objective lens based on optical characteristics of the second objective lens; and
calculating the plane based on at least three of the second focus positions.
3. The auto-focusing method of claim 2, wherein the calculating a plane comprises:
calculating a first plane based on at least three of the focal positions, wherein the at least three apertures are focused along the first plane relative to the first objective lens; and
calculating the plane by converting the first plane to a corresponding plane along which the at least three apertures are focused relative to the second objective lens based on optical characteristics of the second objective lens.
4. The auto-focusing method according to any one of claims 1 to 3, wherein the scanning is performed using the second objective lens without performing an additional focusing operation.
5. The autofocus method of any of claims 1 to 3, wherein the subset of the plurality of wells comprises more than three wells of the plurality of wells.
6. The auto-focusing method of any one of claims 1 to 3, wherein said identifying a focus position comprises identifying the focus position for each aperture in the subset.
7. The auto-focusing method of any one of claims 1 to 3, wherein each of the holes comprises a substantially cylindrical sidewall and a bottom surface containing a portion of at least one of a sphere, a paraboloid, and an ellipse.
8. The auto-focusing method of claim 7, wherein each of the holes has a U-shaped cross-section.
9. The autofocus method of any of claims 1 to 3, wherein each of the wells comprises a substantially cylindrical sidewall and a planar bottom surface.
10. The autofocus method of claim 9, wherein the bottom surface of the plane is substantially parallel to the top surface of the multiwell plate, such that the well has a rectangular cross-section.
11. The autofocus method of any of claims 1 to 3, wherein each of the holes is frustoconical.
12. The auto-focusing method according to any one of claims 1 to 3, wherein each of the holes has an inclined sidewall, a planar bottom, and a trapezoidal cross section.
13. The autofocus method of any of claims 1 to 3, further comprising aligning the first objective lens to be axially over a center of one of the apertures prior to using the first objective lens.
14. The autofocus method of any of claims 1 to 3, wherein the portion of the plate comprises a quarter of the plate.
15. The auto-focusing method according to any one of claims 1 to 3, wherein the portion of the plate includes all of the plate.
16. An autofocus apparatus for automatically determining the focus position of a plurality of wells located in at least a portion of a plate containing wells, the apparatus comprising:
a computing component programmed to compute a plane along which at least three apertures in the portion of the plate are focused relative to an objective lens;
a first objective lens functionally associated with the computing component, the first objective lens having a first magnification, an image from the first objective lens being used by the computing component to identify a focus position for each aperture of at least three apertures of the selected subset of the plurality of apertures; and
a second objective having a second magnification that is less than the first magnification, the second objective for scanning at least some of the plurality of apertures in the portion of the plate along the plane,
wherein the calculation component is configured to calculate the plane based on at least three of the focus positions along which the at least three apertures are focused relative to the second objective lens.
17. The autofocus device of claim 16, wherein the second objective lens is configured to scan the plurality of apertures along the plane without performing an additional focusing operation.
18. The autofocus device of claim 16, wherein the computing component is programmed to compute the focal plane by:
translating at least three of the focus positions identified using the first objective lens into respective second focus positions relative to the second objective lens based on optical characteristics of the second objective lens; and
calculating the focal plane based on at least three of the second focal positions.
19. The autofocus device of claim 16, wherein the computing component is programmed to compute the focal plane by:
calculating a first plane based on at least three of the focal positions, wherein the at least three apertures are focused along the first plane relative to the first objective lens; and
calculating the plane by converting the first plane to a corresponding plane along which the at least three apertures are focused relative to the second objective lens based on optical characteristics of the second objective lens.
20. An autofocus device according to any one of claims 16 to 19, wherein the computing means is programmed to identify the focus position for each aperture in the subset.
21. An autofocus device according to any one of claims 16 to 19, wherein the device is adapted for use with a plate, wherein each aperture in the plate comprises a substantially cylindrical side wall and a base comprising at least one of a portion of a sphere, a paraboloid and a portion of an ellipse.
22. An autofocus device according to any of claims 16 to 19, wherein the device is adapted for use with a plate in which each aperture has a U-shaped cross-section.
23. An autofocus device according to any of claims 16 to 19, wherein the device is adapted for use with a plate in which each aperture comprises a substantially cylindrical side wall and a planar base.
24. The autofocus device of claim 23, wherein the bottom surface of the plane is substantially parallel to the top surface of the plate, such that each of the holes has a substantially rectangular cross-section.
25. An autofocus device according to any one of claims 16 to 19, wherein the device is adapted for use with a plate in which each of the apertures is frusto-conical.
26. An autofocus device according to any one of claims 16 to 19, wherein the device is adapted for use with a plate in which each aperture has inclined side walls, a planar base and a trapezoidal cross-section.
27. The autofocus device of any of claims 16 to 19, wherein the portion of the plate comprises a quarter of the plate.
28. The autofocus device of any of claims 16 to 19, wherein the portion of the plate comprises all of the plate.
CN201680006723.XA 2015-01-22 2016-01-22 Method and apparatus for auto-focusing Active CN107533218B (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
GB1501093.7A GB2534402A (en) 2015-01-22 2015-01-22 Auto-focussing method and device
GB1501093.7 2015-01-22
PCT/IB2016/050323 WO2016116897A1 (en) 2015-01-22 2016-01-22 Auto-focusing method and device

Publications (2)

Publication Number Publication Date
CN107533218A CN107533218A (en) 2018-01-02
CN107533218B true CN107533218B (en) 2020-06-12

Family

ID=52673806

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201680006723.XA Active CN107533218B (en) 2015-01-22 2016-01-22 Method and apparatus for auto-focusing

Country Status (9)

Country Link
US (2) US10345566B2 (en)
EP (1) EP3248039B1 (en)
JP (1) JP2018508837A (en)
CN (1) CN107533218B (en)
CA (1) CA3012072C (en)
ES (1) ES2854700T3 (en)
GB (1) GB2534402A (en)
IL (1) IL253543B (en)
WO (1) WO2016116897A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6785984B2 (en) 2017-09-29 2020-11-18 富士フイルム株式会社 Observation device, observation method and observation program
CN108918370B (en) * 2018-06-27 2020-10-09 太原理工大学 Method and device for detecting concentration of adherent cells
DE102018131427B4 (en) * 2018-12-07 2021-04-29 Leica Microsystems Cms Gmbh Method for automatic position determination on a sample arrangement and corresponding microscope, computer program and computer program product
CN114578536B (en) * 2020-11-30 2024-03-26 深圳市瑞图生物技术有限公司 Image acquisition method, device, computer equipment and storage medium

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2001083425A (en) * 1999-09-14 2001-03-30 Nikon Corp Scanning confocal microscope
CN1301357A (en) * 1998-03-16 2001-06-27 普雷勒克斯公司 Confocal microscopy imaging system
CN102033308A (en) * 2010-10-22 2011-04-27 浙江大学 Ultra-high resolution optical microscope imaging method and device
CN102796659A (en) * 2012-08-21 2012-11-28 北京大学 Porous single cell observation plate and use thereof

Family Cites Families (25)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP2891739B2 (en) * 1989-03-20 1999-05-17 オリンパス光学工業株式会社 microscope
US5260825A (en) * 1989-03-20 1993-11-09 Olympus Optical Co., Ltd. Microscope
WO1999054711A1 (en) * 1998-04-17 1999-10-28 Ljl Biosystems, Inc. Sample-holding devices and systems
EP1368689B1 (en) 2001-02-02 2006-06-14 Cellomics, Inc. Method for estimating the best initial focus position
US6850362B2 (en) * 2001-08-08 2005-02-01 Atto Bioscience Inc. Microscope optical system with a stationary sample stage and stationary viewing ports suited for viewing various fields of view of a sample
US20030030869A1 (en) 2001-08-08 2003-02-13 International Business Machines Corporation Active real-time alignment system for optoelectronic (OE) devices
IL148664A0 (en) * 2002-03-13 2002-09-12 Yeda Res & Dev Auto-focusing method and device
JP2005114859A (en) 2003-10-03 2005-04-28 Nikon Corp Microscope
JP2006003653A (en) * 2004-06-17 2006-01-05 Olympus Corp Biological sample observating system
JP4914715B2 (en) * 2004-06-21 2012-04-11 オリンパス株式会社 Inverted microscope system
US20060001954A1 (en) * 2004-06-30 2006-01-05 Michael Wahl Crystal detection with scattered-light illumination and autofocus
DE102004048302B4 (en) * 2004-10-01 2017-09-07 Carl Zeiss Microscopy Gmbh Objective changer for stereomicroscopes and stereomicroscope
JP5152622B2 (en) * 2007-05-23 2013-02-27 横河電機株式会社 Drug discovery screening device and drug discovery screening method using this device
US7535556B2 (en) * 2007-05-31 2009-05-19 Genetix Limited Methods and apparatus for optical analysis of samples in biological sample containers
US7646482B2 (en) * 2007-05-31 2010-01-12 Genetix Limited Methods and apparatus for optical analysis of samples in biological sample containers
JP5108627B2 (en) * 2008-05-23 2012-12-26 オリンパス株式会社 Observation apparatus and observation method
JP5401062B2 (en) * 2008-09-05 2014-01-29 ベックマン コールター, インコーポレイテッド Image pattern determination method, system, apparatus, program, and computer-readable recording medium storing the program
JP2010191298A (en) * 2009-02-19 2010-09-02 Nikon Corp Microscope
CA2656506A1 (en) 2009-02-27 2010-08-27 Bank Of Canada Security device
EP2663890B1 (en) * 2011-01-12 2015-08-19 Idea Machine Development Design & Production Ltd. Compact microscopy system and method
KR101282926B1 (en) * 2011-07-28 2013-07-08 고려대학교 산학협력단 Surface tension induced concave microwell fabrication and cell aggregation using the same
WO2013023017A1 (en) * 2011-08-10 2013-02-14 Molecular Devices, Llc Method for presenting and evaluation of images of microtiter plate properties
EP2759592A4 (en) * 2011-09-20 2015-04-29 Kuraray Co Adherent cell culture method
US10274715B2 (en) * 2014-08-06 2019-04-30 Cellomics, Inc. Image-based laser autofocus system
US11086118B2 (en) * 2019-04-29 2021-08-10 Molecular Devices, Llc Self-calibrating and directional focusing systems and methods for infinity corrected microscopes

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN1301357A (en) * 1998-03-16 2001-06-27 普雷勒克斯公司 Confocal microscopy imaging system
JP2001083425A (en) * 1999-09-14 2001-03-30 Nikon Corp Scanning confocal microscope
CN102033308A (en) * 2010-10-22 2011-04-27 浙江大学 Ultra-high resolution optical microscope imaging method and device
CN102796659A (en) * 2012-08-21 2012-11-28 北京大学 Porous single cell observation plate and use thereof

Also Published As

Publication number Publication date
EP3248039B1 (en) 2020-11-18
ES2854700T3 (en) 2021-09-22
US11092791B2 (en) 2021-08-17
US20200088980A1 (en) 2020-03-19
EP3248039A1 (en) 2017-11-29
US10345566B2 (en) 2019-07-09
CN107533218A (en) 2018-01-02
GB201501093D0 (en) 2015-03-11
CA3012072C (en) 2021-03-16
IL253543A0 (en) 2017-09-28
GB2534402A (en) 2016-07-27
JP2018508837A (en) 2018-03-29
IL253543B (en) 2021-07-29
CA3012072A1 (en) 2016-07-28
US20170329115A1 (en) 2017-11-16
WO2016116897A1 (en) 2016-07-28
EP3248039A4 (en) 2018-09-05

Similar Documents

Publication Publication Date Title
US11092791B2 (en) Method and device for scanning wells in a multi-well plate
KR102411099B1 (en) Real-time autofocus scanning
US8878923B2 (en) System and method for enhanced predictive autofocusing
EP3368887B1 (en) Method with transillumination-based autofocusing for photoluminescence imaging
EP3203290B1 (en) Image processing method
US9360659B2 (en) Method for presenting and evaluation of images of micro-titer plate properties
US20080285879A1 (en) Methods, Software, and Apparatus for Focusing an Optical System Using Computer Image Analysis
US9741122B2 (en) Method and device for determining a distance between two optical boundary surfaces which are spaced apart from each other along a first direction
US20150358533A1 (en) Control method for imaging apparatus and imaging system
CN111983794B (en) Automatic focusing optical microscope
JP2009204451A (en) Well-plate and fluorescence imaging system using same
US20200351414A1 (en) Slide rack determination system
JP2007006852A (en) Microscope
US20220050281A1 (en) Method for automatically determining the position in a sample arrangement and corresponding microscope
KR102157450B1 (en) Observation device and method, observation device control program
JP2021512346A (en) Impact rescanning system
CN113167991B (en) Method for automatically determining a position on a sample assembly and corresponding microscope
JP2022044688A (en) Microscope system with transillumination-based autofocusing for photoluminescence imaging

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant