WO2016116897A1 - Auto-focusing method and device - Google Patents

Auto-focusing method and device Download PDF

Info

Publication number
WO2016116897A1
WO2016116897A1 PCT/IB2016/050323 IB2016050323W WO2016116897A1 WO 2016116897 A1 WO2016116897 A1 WO 2016116897A1 IB 2016050323 W IB2016050323 W IB 2016050323W WO 2016116897 A1 WO2016116897 A1 WO 2016116897A1
Authority
WO
WIPO (PCT)
Prior art keywords
objective lens
auto
wells
magnification
well
Prior art date
Application number
PCT/IB2016/050323
Other languages
French (fr)
Inventor
Shlomo Turgeman
Yael Paran
Alex EFROS
Original Assignee
Idea Biomedical Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Idea Biomedical Ltd. filed Critical Idea Biomedical Ltd.
Priority to JP2017557506A priority Critical patent/JP2018508837A/en
Priority to CA3012072A priority patent/CA3012072C/en
Priority to ES16739867T priority patent/ES2854700T3/en
Priority to CN201680006723.XA priority patent/CN107533218B/en
Priority to EP16739867.6A priority patent/EP3248039B1/en
Publication of WO2016116897A1 publication Critical patent/WO2016116897A1/en
Priority to IL253543A priority patent/IL253543B/en
Priority to US15/657,155 priority patent/US10345566B2/en
Priority to US16/423,063 priority patent/US11092791B2/en

Links

Classifications

    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/0004Microscopes specially adapted for specific applications
    • G02B21/002Scanning microscopes
    • G02B21/0024Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
    • G02B21/0052Optical details of the image generation
    • G02B21/006Optical details of the image generation focusing arrangements; selection of the plane to be imaged
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/06Means for illuminating specimens
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/24Base structure
    • G02B21/241Devices for focusing
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/24Base structure
    • G02B21/241Devices for focusing
    • G02B21/244Devices for focusing using image analysis techniques
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/24Base structure
    • G02B21/248Base structure objective (or ocular) turrets
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/33Immersion oils, or microscope systems or objectives for use with immersion fluids
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B21/00Microscopes
    • G02B21/34Microscope slides, e.g. mounting specimens on microscope slides
    • GPHYSICS
    • G02OPTICS
    • G02BOPTICAL ELEMENTS, SYSTEMS OR APPARATUS
    • G02B7/00Mountings, adjusting means, or light-tight connections, for optical elements
    • G02B7/28Systems for automatic generation of focusing signals

Definitions

  • the present invention generally relates to the field of optical measurement and/or inspection techniques and more specifically relates to an auto-focus method and device, particularly useful when viewing non planar surfaces.
  • Auto focusing is an essential feature in many automated inspection fields such as the computer chip industry, biomedical research, data reading/recording in optical information carriers, etc. Specifically, when analyzing samples in multiwell plates including a plurality of wells on a single plate, auto focusing of a microscope viewing the contents of the wells can enable more efficient work procedures as the operator need not focus the objective on each well in the plate separately.
  • the present invention generally relates to the field of optical measurement and/or inspection techniques and more specifically relates to an auto-focus method and device, particularly useful when viewing non planar surfaces.
  • an auto-focusing method for determining an in-focus position of a plurality of wells in at least a portion of a multi-well plate the method including:
  • a first objective lens having a first magnification to identify, in each of at least three wells of a selected subset of the plurality of wells, an in-focus position of each said well with respect to the first objective lens
  • the at least one objective lens is the first objective lens, and the first magnification is equal to the second magnification.
  • the computing a plane includes computing a plane along which the at least three wells are in focus with respect to the first objective lens.
  • the at least one objective lens is a second objective lens, different from the first objective lens, wherein the second magnification is smaller than the first magnification.
  • computing a plane includes translating at least three of the in-focus positions identified using the first objective lens to corresponding second in-focus positions with respect to the second objective lens based on optical characteristics of the second objective lens; and computing the plane on the basis of at least three the second in-focus positions.
  • computing a plane includes: on the basis of at least three said in-focus positions, computing a first plane along which the at least three wells will be in focus with respect to the first objective lens; and translating the first plane to a corresponding plane along which the at least three wells will be in focus with respect to the second objective lens based on optical characteristics of the second objective lens, thereby to compute the plane.
  • scanning using the at least one objective lens is carried out without carrying out additional focusing operations.
  • the subset of the plurality of wells includes more than three of the plurality of wells.
  • identifying an in-focus position includes identifying an in- focus position for each well in the subset.
  • each of the wells includes generally cylindrical side walls, and a bottom surface including a portion of at least one of a sphere, a parabola, and an ellipse. In some embodiments, each of the wells has a U-shaped cross-section.
  • each of the wells includes generally cylindrical side walls, and a planar bottom surface.
  • the planar bottom surface lies generally parallel to a top surface of the multiwell plate, such that the well has a rectangular cross section.
  • each of the wells is frusto -conical.
  • each of the wells has inclined side walls, a planar bottom, and a trapezoidal cross section.
  • the method further includes, prior to the using a first objective lens, aligning the first objective lens to lie axially over the center of one of the wells.
  • the portion of the plate includes a quadrant of the plate. In some embodiments, the portion of the plate includes an entirety of the plate.
  • an auto- focusing method for determining an in-focus position of at least a portion of a well in a plate, the method including: using a first objective lens having a first magnification to identify, at at least one location of the well, a first in-focus position of at least a portion of the well with respect to the first objective lens; identifying, for the first in-focus position, a corresponding in-focus position with respect to at least one objective lens having a second magnification, based on optical characteristics of the at least one objective lens; and using the at least one objective lens to scan, at a height corresponding to the corresponding in-focus position, at least the portion of the well, wherein the second magnification is not greater than the first magnification.
  • the at least one objective lens is the first objective lens
  • the first magnification is equal to the second magnification
  • the corresponding in-focus position is the first in-focus position.
  • the at least one objective lens includes a second objective lens, different from the first objective lens, wherein the second magnification is smaller than the first magnification.
  • the identifying includes translating the first in-focus position to the corresponding in-focus position with respect to the second objective lens based on optical characteristics of the second objective lens.
  • scanning using the at least one objective is carried out without carrying out additional focusing operations.
  • the well includes generally cylindrical side walls, and a bottom surface including a portion of at least one of a sphere, a parabola, and an ellipse. In some embodiments, the well has a U-shaped cross-section.
  • the well includes generally cylindrical side walls, and a planar bottom surface.
  • the planar bottom surface lies generally parallel to a top surface of the plate, such that the well has a rectangular cross section.
  • the well is frusto-conical. In some embodiments, the well has inclined side walls, a planar bottom, and a trapezoidal cross section.
  • an auto- focusing device for automatically determining an in-focus position of a plurality of wells located in at least a portion of a plate containing wells, the device including: a computation component programmed to compute a plane along which at least three wells in the portion of the plate would be in focus with respect to an objective lens; a first objective lens functionally associated with the computation component, the first objective lens having a first magnification, images from the first objective lens being used by the computation component for identifying an in-focus position for each of at least three wells of a selected subset of the plurality of wells; and at least one objective lens having a second magnification, the second magnification not being greater than the first magnification, for scanning at least some of the plurality of wells in the portion of the plate along the plane, wherein the computation component is configured to compute the plane along which the at least three wells would be in-focus with respect to the at least one objective lens on the basis of at least three the in- focus
  • the at least one objective lens is configured to scan the plurality of wells along the plane without carrying out additional focusing operations.
  • the at least one objective lens is the first objective lens, and the second magnification is equal to the first magnification.
  • the at least one objective lens is a second objective lens, different from the first objective lens, and the second magnification is smaller than the first magnification.
  • the computation component is programmed to compute the in- focus plane by: translating at least three of the in-focus positions identified using the first objective lens to corresponding second in-focus positions with respect to the second objective lens based on optical characteristics of the second objective lens; and computing the in-focus plane on the basis of at least three the second in-focus positions.
  • the computation component is programmed to compute the in- focus plane by: on the basis of at least three the in-focus positions, computing a first plane along which the at least three wells will be in focus with respect to the first objective lens; and translating the first plane to a corresponding plane along which the at least three wells will be in focus with respect to the second objective lens based on optical characteristics of the second objective lens, thereby to compute the plane.
  • the computation component is programmed to identify an in- focus position for each well in the subset.
  • the device is adapted for use with a plate in which each of the wells includes generally cylindrical side walls, and a bottom surface including at least one of a portion of a sphere, a parabola, and a portion of an ellipse. In some embodiments, the device is adapted for use with a plate in which each of the wells has a U-shaped cross section.
  • the device is adapted for use with a plate in which each of the wells includes generally cylindrical side walls, and a planar bottom surface.
  • the planar bottom surface lies generally parallel to a top surface of the plate, such that each of the wells has a generally rectangular cross section.
  • the device is adapted for use with a plate in which each of the wells is frusto-conical. In some embodiments, the device is adapted for use with a plate in which each of the wells has inclined side walls, a planar bottom, and a trapezoidal cross section.
  • the portion of the plate includes a quadrant of the plate. In some embodiments, the portion of the plate includes an entirety of the plate.
  • an auto-focusing device for automatically determining an in-focus position of at least a portion of a well, the device including: a computation component programmed to compute an in-focus position of the portion of the well; a first objective lens functionally associated with the computation component, the first objective lens having a first magnification, images from the first objective lens being used by the computation component for identifying, in at least one position of the well, a first in-focus position of the well with respect to the first objective lens; and at least one objective lens having a second magnification, the second magnification not being greater than the first magnification, for scanning at least a portion of the well at a height of a corresponding in-focus position of the well with respect to the at least one objective lens, wherein the computation component is programmed to identify the corresponding in-focus position based on optical characteristics of the at least one objective lens.
  • the at least one objective lens is configured to scan the portion of the well without carrying out additional focusing operations.
  • the at least one objective lens is the first objective lens
  • the second magnification is equal to the first magnification
  • the corresponding in-focus position is the same as the first in-focus position.
  • the at least one objective lens is a second objective lens different from the first objective lens, and wherein the second magnification is smaller than the first magnification.
  • the computation component is programmed to identify the corresponding in-focus position by translating the first in-focus position to the corresponding in-focus position with respect to the second objective lens based on optical characteristics of the second objective lens.
  • the device is adapted for use with a well including generally cylindrical side walls, and a bottom surface including at least one of a portion of a sphere, a parabola, and a portion of an ellipse. In some embodiments, the device is adapted for use with a well having a U-shaped cross section.
  • the device is adapted for use with a well including generally cylindrical side walls, and a planar bottom surface.
  • the planar bottom surface lies generally parallel to a top surface of the plate, such that the well has a generally rectangular cross section.
  • the device is adapted for use with a frusto-conical well. In some embodiments, the device is adapted for use with a well having inclined side walls, a planar bottom, and a trapezoidal cross section.
  • Embodiments of methods and/or devices of the invention may involve performing or completing selected tasks manually, automatically, or a combination thereof.
  • Some embodiments of the invention are implemented with the use of components that comprise hardware, software, firmware or combinations thereof.
  • some components are general-purpose components such as general purpose computers or monitors.
  • some components are dedicated or custom components such as circuits, integrated circuits or software.
  • some of an embodiment is implemented as a plurality of software instructions executed by a data processor, for example which is part of a general-purpose or custom computer.
  • the data processor or computer comprises volatile memory for storing instructions and/or data and/or a non-volatile storage, for example, a magnetic hard-disk and/or removable media, for storing instructions and/or data.
  • implementation includes a network connection.
  • implementation includes a user interface, generally comprising one or more of input devices (e.g., allowing input of commands and/or parameters) and output devices (e.g., allowing reporting parameters of operation and results.
  • FIGS. 1A and IB are, respectively, a top plan view of a multiwell plate and a sectional view of a single well in a multiwell plate, the well having a non-planar bottom surface, for which embodiments of the teachings herein may be useful;
  • FIG. 2 is a block diagram of an embodiment of an imaging device for auto-focusing on samples in a multiwell plate in accordance with an embodiment of the teachings herein;
  • FIG. 3 is a flow chart of an embodiment of a method for auto-focusing an imaging device on samples in a multiwell plate in accordance with an embodiment of the teachings herein.
  • Figures 1A and IB are, respectively, a top plan view of a multiwell plate and a sectional view of a single well in a multiwell plate, the well having a non-planar bottom surface, for which embodiments of the teachings herein may be useful.
  • a multiwell plate 10 has a top surface 11, side surfaces (not shown) and, in some embodiments, a bottom surface (not shown).
  • the plate 10 includes a plurality of wells 12, arranged in a grid formed of columns 14 and rows 16 and accessible via apertures 17 in top surface 11. Typically, the rows and columns are enumerated or otherwise labeled so as to enable a user to easily reference a specific well 12.
  • the multiwell plate 10 in the illustrated embodiment includes 96 wells, though other types of plates, which include, for example, a different number of wells, such as 12, 24, or 384 wells, may be used with the teachings herein as described in further detail hereinbelow.
  • the wells 12 have fixed distances between one another, and thus are distributed on plate 10 at regular intervals. Specifications as to the distanced between wells are standard in the art, and are typically also provided by the manufacturer of the plate. Often, the number of wells in the plate have a 3:2 aspect ratio. As such the wells may be arranged, for example, as a 3x2 grid, 6x4 grid, 12x8 grid, or 24x16 grid.
  • each well 12 in the plate 10 may be non-rectangular, such that the well has a non-linear bottom surface.
  • the well 12 includes a cavity 18 and has a U-shaped cross section, such that side walls 20 of the well generally form a cylinder, and a bottom portion 22 of the well forms part of a sphere, part of a parabola, or part of an ellipse, thereby defining a curved bottom surface to the well.
  • the well typically has a U-shaped cross-section or a cross-section somewhat resembling a parabola.
  • the thickness of side walls 20 and of bottom portion 22 is uniform.
  • Multiwell plates including wells having non-planar bottom surfaces are well known in the art, and are commercially available from many manufacturers, such as Corning Incorporated Life Sciences of Tewksbury, Massachusetts. Such multi-well plates are used for many types of samples, including for growing spheroids, for growing non-adherent cells such as lymphocytes and other blood cells, for analysis of 3-dimensional samples and for handling of compounds. Oftentimes, analysis of such samples requires imaging of the samples within the wells.
  • FIG. 2 is a block diagram of an embodiment of an imaging device 200 for auto-focusing on wells in a multiwell plate in accordance with an embodiment of the teachings herein.
  • imaging device 100 includes a scanning microscope 202, functionally associated with a sample platform movable along the X, Y, and Z axes.
  • the sample platform is configured to have disposed thereon a sample plate 205, which may be for example a plate like plate 10 of Figures 1A and IB.
  • Microscope 202 further includes a plurality of objective lenses 206 functionally associated with an objective lens exchanger 208.
  • a single one of lenses 206 is aligned with a sample platform (not shown) and is operational, such that the sample plate disposed on the sample platform may be viewed through the objective lens.
  • Objective lens exchanger 208 is configured to change the operational lens, used for viewing the sample, when a change of objective is required.
  • An example of such an exchanger is described, for example, in WO 2012/097191, the contents of which are incorporated herein by reference.
  • Microscope 202 is functionally associated with at least one illumination source, controlled by a controlling unit (not shown).
  • the microscope includes a first illumination source comprising a transmission light source 210a, such as an LED lamp, configured to illuminate the sample platform during imaging of a sample plate 205 disposed thereon.
  • the microscope further includes a second illumination source comprising an excitation light source 210b configured to provide illumination to yield a response in a sample carried on or in the sample plate 205, such as providing illumination to excite a fluorescent or a luminescent component of the sample.
  • illumination from light source(s) 210a and/or 210b impinges upon one or more optical elements 212, such as a mirror, a dichroic cube, a beam splitter, a filter, and the like, prior to impinging upon a sample disposed on the sample plate 205.
  • illumination from illumination source(s) 210 travels through an optic fiber 213 before impinging on the sample.
  • the image visible by microscope 202 is captured by an image capturing unit (not shown), and is transferred to a processing unit 214 for further processing and analysis.
  • Figure 3 is a flow chart of an embodiment of a method for auto-focusing an imaging device on samples in a multiwell plate in accordance with an embodiment of the teachings herein.
  • the method described hereinbelow may be used in an imaging device, such as imaging device 200 of Figure 2, to automatically determine an in-focus position of a plurality of samples disposed in a sample plate, such as plate 10 of Figure 1A, the plate containing a plurality of wells.
  • the method may be carried out on a plate including wells having a non- planar bottom surface, such as wells 12 of Figure IB, or on other types of wells, such as wells having a planar bottom surface, or frusto-conical wells having inclined side walls and a planar bottom, and the like.
  • a subset of the wells in the plate is selected.
  • the subset includes at least three wells that each contains a liquid or a sample, though this is not necessary for the method disclosed herein.
  • an in-focus position of the sample included in the well is identified with respect to a first objective lens having a first magnification, such as an objective lens 206 of Figure 2, at step 302.
  • the first objective lens has a fairly large magnification, such as for example 20x, lOx or the like.
  • the subset includes more than three wells, but in-focus positions are identified only for three of the wells in the subset.
  • the subset includes more than three wells, and in-focus positions are identified for more than three wells in the subset, but not for all the wells in the subset.
  • the subset may contain at least five wells, and in-focus positions are identified for at least four wells but not for all the wells in the subset.
  • in-focus positions are identified for all the wells in the subset.
  • the in-focus positions of the samples in the wells of the subset may be identified using any suitable method known in the art, including both manual and automatic methods.
  • the in-focus positions are identified substantially as described in US Patent No. 7,109,459, which is incorporated by reference as if fully set forth herein.
  • the focal plane of the first objective is spaced from a surface of the plate, such as a bottom surface of the plate, a certain distance, for example about one millimeter.
  • the focal plane of the objective is then displaced towards the plate, for example by displacing the objective or the plate relative to one another.
  • the objective lens may be disposed below the plate, such that the focal plane of the objective lens is disposed below the surface of the plate and the focal plane is displaced vertically upward toward the surface of the plate.
  • control hardware of the microscope records the intensity of light reflected from the plate, until the intensity of the detected light reaches a maximal value, which, in some embodiments, is higher than a preset threshold.
  • This maximal value of the detected light intensity corresponds to an in-focus position of a surface of the plate.
  • the location at which maximal light intensity is observed corresponds to a point at which the focal plane of the objective lens is tangential to the curved surface of the well bottom.
  • the focal plane of the objective continues to be displaced toward the plate, until another peak in the intensity of reflected light is detected, the peak being defined by a respective threshold value in accordance with the environment and the sample being tested.
  • this second peak in the intensity of the reflected light occurs when the focal plane of the objective lens is tangent to the intra-well plate bottom, and typically represents an offset from an in-focus position of the sample.
  • the magnitude of the offset may be determined manually by the user, or may be determined automatically using methods known in the art.
  • the offset is computed from the first peak in the intensity of detected light, without continuing the search for a second peak in the intensity of detected light.
  • the magnitude of the offset may be determined manually by the user, or may be determined automatically using methods known in the art.
  • the direction in which the focal plane is displaced toward the plate, and the order in which the peaks in intensity of detected light are identified is dependent on the setup of the imaging device.
  • the objective lens is disposed below the sample plate, but the focal plane of the objective lens is disposed above the well bottom, such that the focal plane would be displaced downward toward the well bottom.
  • the first peak in the intensity of the reflected light occurs when the focal plane of the objective lens is tangent to the intra-well plate bottom, and typically represents an offset from an in-focus position of the sample while the location at which the second peak in intensity of the reflected light is detected corresponds to a point at which the focal plane of the objective lens is tangential to the curved surface of the well bottom.
  • the objective lens is disposed above the sample plate, and the focal plane of the objective lens is disposed above the well bottom, such that the focal plane would be displaced downward toward the well bottom.
  • the objective lens is disposed above the sample plate, but the focal plane of the objective lens is disposed below the well bottom, such that the focal plane would be displaced upward toward the well bottom.
  • the location at which the first peak in intensity of the reflected light is detected corresponds to a point at which the focal plane of the objective lens is tangential to the curved surface of the well bottom while the second peak in the intensity of the reflected light occurs when the focal plane of the objective lens is tangent to the intra-well plate bottom, and typically represents an offset from an in- focus position of the sample.
  • the center of the well is identified based on the plate specifications provided by the manufacturer. In some embodiments, the center of the well is determined using X-Y displacement of the plate or X- Y displacement of the objective lens, until the center of a well or the edge of a well are identified using suitable light detection parameters and characteristics, as is known in the art.
  • the second objective lens has a second magnification which is not greater than the first magnification of the first objective lens.
  • the wells are scanned using the second objective lens based on the location computed plane, by maintaining the position of the second objective lens during scanning so that for any given well scanned, the calculated plane and the focal plane of the second objective lens are coincident or close to coincident.
  • the plane is computed by translating at least three of, and typically each of, the in-focus positions identified in step 302 using the first objective lens to corresponding second in-focus positions with respect to the second objective lens, based on optical characteristics of the second objective lens, and computing a plane including at least three of the second in-focus positions.
  • the plane is computed by computing, on the basis of at least three of the in-focus positions, a first plane along which at least some of the plurality of wells in the plate, and typically all the wells in the plate, are in-focus or close to in-focus with respect to the first objective lens.
  • the first plane is then translated into the corresponding plane along which at least some of the wells, and typically all the wells, are in-focus or close to in-focus with respect to the second objective lens, based on optical characteristics of the second objective lens.
  • the second objective lens has a magnification that is not greater than the first magnification of the first objective lens.
  • the second magnification is smaller than the first magnification, and may be, for example, 4x or 2x.
  • the second magnification is equal to the first magnification, but the numerical aperture value of the second objective lens is higher than the numerical aperture value of the first objective lens.
  • the plane is computed using all the in-focus positions identified at step 302. In other embodiments, the plane is computed using fewer than all the in-focus positions identified at step 302. In some embodiments, the plane is computed for a section of the plate, for example for a quadrant, using at least three in-focus positions identified, using the first objective lens, within that section of the plate. In such embodiments, the method described herein is repeated for each section or quadrant of the plate using a different set of in-focus positions for each such section.
  • the first objective lens is changed to the second objective lens, for example by a suitable hardware mechanism such as objective lens exchanger 208 of Figure 2.
  • a suitable hardware mechanism such as objective lens exchanger 208 of Figure 2.
  • the first and second objective lenses are identical, and step 306 of Figure 3 is omitted.
  • step 308 the wells of the multiwell plate are scanned, or imaged, along the plane computed at step 304, using the second objective lens, without carrying out any additional focusing operations.
  • the scanning at step 308 may be carried out using any suitable method known in the art, including capturing an image stack, which is particularly useful when imaging a three dimensional construct such as a spheroid.
  • the teachings herein may be carried out on a plate having a single well, or on a single well within a multi-well plate.
  • the first objective is used to find an in-focus point of the sample in the plate.
  • the in-focus point found using the first objective is translated into an in-focus point for the second objective, based on the optical characteristics of the second objective.
  • the second objective is then used to scan the plate, when placed at the translated in-focus point, or at the height thereof.
  • the teachings herein allow the imaging device to be in-focus with respect to the plate regardless of the "expected height difference” and of the “unexpected height difference” within the plate.
  • the “expected height difference” is defined as the curvature of the plate listed in the specifications of the plate and that is intended by the manufacturer to be in the plate, such as having a curved bottom due to the structure.
  • the “unexpected height difference” is defined as lack of planarity which is not intended in the specification of the plate.
  • Such “unexpected height difference” may be, for example, due to differences in the relative heights of the bottoms of the wells; or may be, for example, due to deviations from planarity in the virtual surface traced by the scanning components as the objective is moved; or the surface upon which the plate rests being non-parallel with the virtual surface traced by the scanning components as the objective is moved.

Landscapes

  • Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • Optics & Photonics (AREA)
  • Analytical Chemistry (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Engineering & Computer Science (AREA)
  • Oil, Petroleum & Natural Gas (AREA)
  • Microscoopes, Condenser (AREA)
  • Automatic Analysis And Handling Materials Therefor (AREA)
  • Optical Measuring Cells (AREA)
  • Apparatus Associated With Microorganisms And Enzymes (AREA)
  • Automatic Focus Adjustment (AREA)
  • Investigating Or Analysing Materials By Optical Means (AREA)

Abstract

An auto-focusing method for determining an in-focus position of a plurality of wells in at least a portion of a multi-well plate, the method including using a first objective lens having a first magnification to identify, in each of at least three wells of a selected subset of the plurality of wells, an in-focus position of each the well with respect to the first objective lens, on the basis of at least three the in-focus positions, computing a plane along which the at least three wells will be in focus with respect to at least one objective lens having a second magnification that is not greater than the first magnification, and using the at least one objective lens to scan, along the plane, at least some of the plurality of wells in the portion of the plate.

Description

AUTO-FOCUSING METHOD AND DEVICE
FIELD AND BACKGROUND
The present invention generally relates to the field of optical measurement and/or inspection techniques and more specifically relates to an auto-focus method and device, particularly useful when viewing non planar surfaces.
Auto focusing is an essential feature in many automated inspection fields such as the computer chip industry, biomedical research, data reading/recording in optical information carriers, etc. Specifically, when analyzing samples in multiwell plates including a plurality of wells on a single plate, auto focusing of a microscope viewing the contents of the wells can enable more efficient work procedures as the operator need not focus the objective on each well in the plate separately.
Various auto focusing methods for inspection of a multiwell plate have been disclosed in the past, such as in US Patent No. 7,109,459. However, when using wells having a non- planar bottom, such as a multiwell plate having wells with a U-shaped bottom, such as are used, for example, for growing living cells into spheroids, existing autofocus methods may require image analysis which is time-consuming.
There is thus a need for a method for auto focusing a microscope on a multiwell plate, which is suitable for multi-well plates having wells with a non-planar bottom surface.
SUMMARY
The present invention generally relates to the field of optical measurement and/or inspection techniques and more specifically relates to an auto-focus method and device, particularly useful when viewing non planar surfaces.
There is provided in accordance with an embodiment of the invention an auto- focusing method for determining an in-focus position of a plurality of wells in at least a portion of a multi-well plate, the method including:
using a first objective lens having a first magnification to identify, in each of at least three wells of a selected subset of the plurality of wells, an in-focus position of each said well with respect to the first objective lens;
on the basis of at least three said in-focus positions, computing a plane along which the at least three wells will be in focus with respect to at least one objective lens having a second magnification that is not greater than the first magnification; and using the at least one objective lens to scan, along the plane, at least some of the plurality of wells in the portion of the plate.
In some embodiments, the at least one objective lens is the first objective lens, and the first magnification is equal to the second magnification. In some embodiments, the computing a plane includes computing a plane along which the at least three wells are in focus with respect to the first objective lens.
In some embodiments, the at least one objective lens is a second objective lens, different from the first objective lens, wherein the second magnification is smaller than the first magnification. In some embodiments, computing a plane includes translating at least three of the in-focus positions identified using the first objective lens to corresponding second in-focus positions with respect to the second objective lens based on optical characteristics of the second objective lens; and computing the plane on the basis of at least three the second in-focus positions. In some embodiments, computing a plane includes: on the basis of at least three said in-focus positions, computing a first plane along which the at least three wells will be in focus with respect to the first objective lens; and translating the first plane to a corresponding plane along which the at least three wells will be in focus with respect to the second objective lens based on optical characteristics of the second objective lens, thereby to compute the plane.
In some embodiments, scanning using the at least one objective lens is carried out without carrying out additional focusing operations.
In some embodiments, the subset of the plurality of wells includes more than three of the plurality of wells.
In some embodiments, identifying an in-focus position includes identifying an in- focus position for each well in the subset.
In some embodiments, each of the wells includes generally cylindrical side walls, and a bottom surface including a portion of at least one of a sphere, a parabola, and an ellipse. In some embodiments, each of the wells has a U-shaped cross-section.
In some embodiments, each of the wells includes generally cylindrical side walls, and a planar bottom surface. In some embodiments, the planar bottom surface lies generally parallel to a top surface of the multiwell plate, such that the well has a rectangular cross section.
In some embodiments, each of the wells is frusto -conical.
In some embodiments, each of the wells has inclined side walls, a planar bottom, and a trapezoidal cross section. In some embodiments, the method further includes, prior to the using a first objective lens, aligning the first objective lens to lie axially over the center of one of the wells.
In some embodiments, the portion of the plate includes a quadrant of the plate. In some embodiments, the portion of the plate includes an entirety of the plate.
There is also provided, in accordance with an embodiment of the invention, an auto- focusing method for determining an in-focus position of at least a portion of a well in a plate, the method including: using a first objective lens having a first magnification to identify, at at least one location of the well, a first in-focus position of at least a portion of the well with respect to the first objective lens; identifying, for the first in-focus position, a corresponding in-focus position with respect to at least one objective lens having a second magnification, based on optical characteristics of the at least one objective lens; and using the at least one objective lens to scan, at a height corresponding to the corresponding in-focus position, at least the portion of the well, wherein the second magnification is not greater than the first magnification.
In some embodiments, the at least one objective lens is the first objective lens, the first magnification is equal to the second magnification, and the corresponding in-focus position is the first in-focus position.
In some embodiments, the at least one objective lens includes a second objective lens, different from the first objective lens, wherein the second magnification is smaller than the first magnification. In some such embodiments, the identifying includes translating the first in-focus position to the corresponding in-focus position with respect to the second objective lens based on optical characteristics of the second objective lens.
In some embodiments, scanning using the at least one objective is carried out without carrying out additional focusing operations.
In some embodiments, the well includes generally cylindrical side walls, and a bottom surface including a portion of at least one of a sphere, a parabola, and an ellipse. In some embodiments, the well has a U-shaped cross-section.
In some embodiments, the well includes generally cylindrical side walls, and a planar bottom surface. In some embodiments, the planar bottom surface lies generally parallel to a top surface of the plate, such that the well has a rectangular cross section.
In some embodiments, the well is frusto-conical. In some embodiments, the well has inclined side walls, a planar bottom, and a trapezoidal cross section.
There is also provided, in accordance with an embodiment of the invention, an auto- focusing device for automatically determining an in-focus position of a plurality of wells located in at least a portion of a plate containing wells, the device including: a computation component programmed to compute a plane along which at least three wells in the portion of the plate would be in focus with respect to an objective lens; a first objective lens functionally associated with the computation component, the first objective lens having a first magnification, images from the first objective lens being used by the computation component for identifying an in-focus position for each of at least three wells of a selected subset of the plurality of wells; and at least one objective lens having a second magnification, the second magnification not being greater than the first magnification, for scanning at least some of the plurality of wells in the portion of the plate along the plane, wherein the computation component is configured to compute the plane along which the at least three wells would be in-focus with respect to the at least one objective lens on the basis of at least three the in- focus positions.
In some embodiments, the at least one objective lens is configured to scan the plurality of wells along the plane without carrying out additional focusing operations.
In some embodiments, the at least one objective lens is the first objective lens, and the second magnification is equal to the first magnification.
In some embodiments, the at least one objective lens is a second objective lens, different from the first objective lens, and the second magnification is smaller than the first magnification.
In some embodiments, the computation component is programmed to compute the in- focus plane by: translating at least three of the in-focus positions identified using the first objective lens to corresponding second in-focus positions with respect to the second objective lens based on optical characteristics of the second objective lens; and computing the in-focus plane on the basis of at least three the second in-focus positions.
In some embodiments, the computation component is programmed to compute the in- focus plane by: on the basis of at least three the in-focus positions, computing a first plane along which the at least three wells will be in focus with respect to the first objective lens; and translating the first plane to a corresponding plane along which the at least three wells will be in focus with respect to the second objective lens based on optical characteristics of the second objective lens, thereby to compute the plane.
In some embodiments, the computation component is programmed to identify an in- focus position for each well in the subset.
In some embodiments, the device is adapted for use with a plate in which each of the wells includes generally cylindrical side walls, and a bottom surface including at least one of a portion of a sphere, a parabola, and a portion of an ellipse. In some embodiments, the device is adapted for use with a plate in which each of the wells has a U-shaped cross section.
In some embodiments, the device is adapted for use with a plate in which each of the wells includes generally cylindrical side walls, and a planar bottom surface. In some embodiments, the planar bottom surface lies generally parallel to a top surface of the plate, such that each of the wells has a generally rectangular cross section.
In some embodiments, the device is adapted for use with a plate in which each of the wells is frusto-conical. In some embodiments, the device is adapted for use with a plate in which each of the wells has inclined side walls, a planar bottom, and a trapezoidal cross section.
In some embodiments, the portion of the plate includes a quadrant of the plate. In some embodiments, the portion of the plate includes an entirety of the plate.
There is also provided, in accordance with an embodiment of the invention, an auto- focusing device for automatically determining an in-focus position of at least a portion of a well, the device including: a computation component programmed to compute an in-focus position of the portion of the well; a first objective lens functionally associated with the computation component, the first objective lens having a first magnification, images from the first objective lens being used by the computation component for identifying, in at least one position of the well, a first in-focus position of the well with respect to the first objective lens; and at least one objective lens having a second magnification, the second magnification not being greater than the first magnification, for scanning at least a portion of the well at a height of a corresponding in-focus position of the well with respect to the at least one objective lens, wherein the computation component is programmed to identify the corresponding in-focus position based on optical characteristics of the at least one objective lens.
In some embodiments, the at least one objective lens is configured to scan the portion of the well without carrying out additional focusing operations.
In some embodiments, the at least one objective lens is the first objective lens, the second magnification is equal to the first magnification, and the corresponding in-focus position is the same as the first in-focus position.
In some embodiments, the at least one objective lens is a second objective lens different from the first objective lens, and wherein the second magnification is smaller than the first magnification. In some embodiments, the computation component is programmed to identify the corresponding in-focus position by translating the first in-focus position to the corresponding in-focus position with respect to the second objective lens based on optical characteristics of the second objective lens.
In some embodiments, the device is adapted for use with a well including generally cylindrical side walls, and a bottom surface including at least one of a portion of a sphere, a parabola, and a portion of an ellipse. In some embodiments, the device is adapted for use with a well having a U-shaped cross section.
In some embodiments, the device is adapted for use with a well including generally cylindrical side walls, and a planar bottom surface. In some embodiments, the planar bottom surface lies generally parallel to a top surface of the plate, such that the well has a generally rectangular cross section.
In some embodiments, the device is adapted for use with a frusto-conical well. In some embodiments, the device is adapted for use with a well having inclined side walls, a planar bottom, and a trapezoidal cross section.
Unless otherwise defined, all technical and scientific terms used herein have the same meaning as commonly understood by one of ordinary skill in the art to which the invention pertains. In case of conflict, the specification, including definitions, will take precedence.
As used herein, the terms "comprising", "including", "having" and grammatical variants thereof are to be taken as specifying the stated features, integers, steps or components but do not preclude the addition of one or more additional features, integers, steps, components or groups thereof. These terms encompass the terms "consisting of" and "consisting essentially of .
As used herein, the indefinite articles "a" and "an" mean "at least one" or "one or more" unless the context clearly dictates otherwise.
Embodiments of methods and/or devices of the invention may involve performing or completing selected tasks manually, automatically, or a combination thereof. Some embodiments of the invention are implemented with the use of components that comprise hardware, software, firmware or combinations thereof. In some embodiments, some components are general-purpose components such as general purpose computers or monitors. In some embodiments, some components are dedicated or custom components such as circuits, integrated circuits or software.
For example, in some embodiments, some of an embodiment is implemented as a plurality of software instructions executed by a data processor, for example which is part of a general-purpose or custom computer. In some embodiments, the data processor or computer comprises volatile memory for storing instructions and/or data and/or a non-volatile storage, for example, a magnetic hard-disk and/or removable media, for storing instructions and/or data. In some embodiments, implementation includes a network connection. In some embodiments, implementation includes a user interface, generally comprising one or more of input devices (e.g., allowing input of commands and/or parameters) and output devices (e.g., allowing reporting parameters of operation and results.
BRIEF DESCRIPTION OF THE FIGURES
Some embodiments of the invention are described herein with reference to the accompanying figures. The description, together with the figures, makes apparent to a person having ordinary skill in the art how some embodiments of the invention may be practiced. The figures are for the purpose of illustrative discussion and no attempt is made to show structural details of an embodiment in more detail than is necessary for a fundamental understanding of the invention. For the sake of clarity, some objects depicted in the figures are not to scale.
In the Figures:
FIGS. 1A and IB are, respectively, a top plan view of a multiwell plate and a sectional view of a single well in a multiwell plate, the well having a non-planar bottom surface, for which embodiments of the teachings herein may be useful;
FIG. 2 is a block diagram of an embodiment of an imaging device for auto-focusing on samples in a multiwell plate in accordance with an embodiment of the teachings herein; and
FIG. 3 is a flow chart of an embodiment of a method for auto-focusing an imaging device on samples in a multiwell plate in accordance with an embodiment of the teachings herein.
DESCRIPTION OF SOME EMBODIMENTS OF THE INVENTION
The principles, uses and implementations of the teachings herein may be better understood with reference to the accompanying description and figures. Upon perusal of the description and figures present herein, one skilled in the art is able to implement the invention without undue effort or experimentation.
Before explaining at least one embodiment of the invention in detail, it is to be understood that the invention is not limited in its applications to the details of construction and the arrangement of the components and/or methods set forth in the following description and/or illustrated in the drawings and/or the Examples. The invention can be implemented with other embodiments and can be practiced or carried out in various ways. It is also understood that the phraseology and terminology employed herein is for descriptive purpose and should not be regarded as limiting.
Reference is now made to Figures 1A and IB which are, respectively, a top plan view of a multiwell plate and a sectional view of a single well in a multiwell plate, the well having a non-planar bottom surface, for which embodiments of the teachings herein may be useful.
As seen in Figure 1A, a multiwell plate 10 has a top surface 11, side surfaces (not shown) and, in some embodiments, a bottom surface (not shown). The plate 10 includes a plurality of wells 12, arranged in a grid formed of columns 14 and rows 16 and accessible via apertures 17 in top surface 11. Typically, the rows and columns are enumerated or otherwise labeled so as to enable a user to easily reference a specific well 12. The multiwell plate 10 in the illustrated embodiment includes 96 wells, though other types of plates, which include, for example, a different number of wells, such as 12, 24, or 384 wells, may be used with the teachings herein as described in further detail hereinbelow. Typically, the wells 12 have fixed distances between one another, and thus are distributed on plate 10 at regular intervals. Specifications as to the distanced between wells are standard in the art, and are typically also provided by the manufacturer of the plate. Often, the number of wells in the plate have a 3:2 aspect ratio. As such the wells may be arranged, for example, as a 3x2 grid, 6x4 grid, 12x8 grid, or 24x16 grid.
Turning to Figure IB, it is seen that the cross section of each well 12 in the plate 10 may be non-rectangular, such that the well has a non-linear bottom surface. In the illustrated embodiment, the well 12 includes a cavity 18 and has a U-shaped cross section, such that side walls 20 of the well generally form a cylinder, and a bottom portion 22 of the well forms part of a sphere, part of a parabola, or part of an ellipse, thereby defining a curved bottom surface to the well. As such, the well typically has a U-shaped cross-section or a cross-section somewhat resembling a parabola. Typically, the thickness of side walls 20 and of bottom portion 22 is uniform. A rim 26, typically forming part of, and being flush with or being raised with respect to, top surface 11 of plate 10, often surrounds the well 12.
Multiwell plates including wells having non-planar bottom surfaces are well known in the art, and are commercially available from many manufacturers, such as Corning Incorporated Life Sciences of Tewksbury, Massachusetts. Such multi-well plates are used for many types of samples, including for growing spheroids, for growing non-adherent cells such as lymphocytes and other blood cells, for analysis of 3-dimensional samples and for handling of compounds. Oftentimes, analysis of such samples requires imaging of the samples within the wells.
It will be appreciated that due to the curvature of the bottom surface of well 12 the area at which a microscope viewing the well would be in focus is typically very small, and in some cases comprises a single point. As such, existing auto-focusing mechanisms, such as that disclosed in US Patent No. 7,109,459 often do not succeed in focusing on a sample disposed within the well. As explained hereinbelow, the method of the teachings herein enables an operator to autofocus an imaging device on a well having a non-planar bottom, such as U-shaped wells 12 of Figure IB, without having to manually focus the imaging device on each individual well.
It will be appreciated that though the exemplary illustration shows wells having a U- shaped cross section, the method of the teachings herein as described hereinbelow may be used for other types of wells, such as wells having a planar bottom surface and a rectangular cross section, or wells of a frusto-conical shape, i.e. comprising a cutoff cone having inclined side walls and a planar bottom, and having a generally trapezoidal cross section.
Reference is now made to Figure 2, which is a block diagram of an embodiment of an imaging device 200 for auto-focusing on wells in a multiwell plate in accordance with an embodiment of the teachings herein.
It will be appreciated that the disclosure herein discusses auto-focusing on wells including samples as an example only, and that the same method and device may also be used to auto-focus on wells not containing a sample, or on a multiwell plate in which some wells include a sample and other wells do not.
As seen in Figure 2, imaging device 100 includes a scanning microscope 202, functionally associated with a sample platform movable along the X, Y, and Z axes. The sample platform is configured to have disposed thereon a sample plate 205, which may be for example a plate like plate 10 of Figures 1A and IB.
Microscope 202 further includes a plurality of objective lenses 206 functionally associated with an objective lens exchanger 208. At any given time, a single one of lenses 206 is aligned with a sample platform (not shown) and is operational, such that the sample plate disposed on the sample platform may be viewed through the objective lens. Objective lens exchanger 208 is configured to change the operational lens, used for viewing the sample, when a change of objective is required. An example of such an exchanger is described, for example, in WO 2012/097191, the contents of which are incorporated herein by reference. Microscope 202 is functionally associated with at least one illumination source, controlled by a controlling unit (not shown). In some embodiments, the microscope includes a first illumination source comprising a transmission light source 210a, such as an LED lamp, configured to illuminate the sample platform during imaging of a sample plate 205 disposed thereon. In some embodiments, the microscope further includes a second illumination source comprising an excitation light source 210b configured to provide illumination to yield a response in a sample carried on or in the sample plate 205, such as providing illumination to excite a fluorescent or a luminescent component of the sample. In some embodiments, illumination from light source(s) 210a and/or 210b impinges upon one or more optical elements 212, such as a mirror, a dichroic cube, a beam splitter, a filter, and the like, prior to impinging upon a sample disposed on the sample plate 205. In some embodiments, illumination from illumination source(s) 210 travels through an optic fiber 213 before impinging on the sample.
In some embodiments, the image visible by microscope 202 is captured by an image capturing unit (not shown), and is transferred to a processing unit 214 for further processing and analysis.
Reference is now made to Figure 3, which is a flow chart of an embodiment of a method for auto-focusing an imaging device on samples in a multiwell plate in accordance with an embodiment of the teachings herein.
The method described hereinbelow may be used in an imaging device, such as imaging device 200 of Figure 2, to automatically determine an in-focus position of a plurality of samples disposed in a sample plate, such as plate 10 of Figure 1A, the plate containing a plurality of wells. The method may be carried out on a plate including wells having a non- planar bottom surface, such as wells 12 of Figure IB, or on other types of wells, such as wells having a planar bottom surface, or frusto-conical wells having inclined side walls and a planar bottom, and the like.
As seen at step 300, a subset of the wells in the plate is selected. In some embodiments, the subset includes at least three wells that each contains a liquid or a sample, though this is not necessary for the method disclosed herein. For at least three of the wells in the subset, and in some embodiments for all the wells in the subset, an in-focus position of the sample included in the well is identified with respect to a first objective lens having a first magnification, such as an objective lens 206 of Figure 2, at step 302.
Typically, the first objective lens has a fairly large magnification, such as for example 20x, lOx or the like. In some embodiments, the subset includes more than three wells, but in-focus positions are identified only for three of the wells in the subset. In some embodiments, the subset includes more than three wells, and in-focus positions are identified for more than three wells in the subset, but not for all the wells in the subset. For example, the subset may contain at least five wells, and in-focus positions are identified for at least four wells but not for all the wells in the subset. In some embodiments, in-focus positions are identified for all the wells in the subset.
The in-focus positions of the samples in the wells of the subset may be identified using any suitable method known in the art, including both manual and automatic methods. In some embodiments, the in-focus positions are identified substantially as described in US Patent No. 7,109,459, which is incorporated by reference as if fully set forth herein.
In accordance with the teachings of US Patent No. 7,109,459, in order to identify the in-focus positions, the focal plane of the first objective is spaced from a surface of the plate, such as a bottom surface of the plate, a certain distance, for example about one millimeter. The focal plane of the objective is then displaced towards the plate, for example by displacing the objective or the plate relative to one another. For example, the objective lens may be disposed below the plate, such that the focal plane of the objective lens is disposed below the surface of the plate and the focal plane is displaced vertically upward toward the surface of the plate.
During displacement of the focal plane of the objective lens, control hardware of the microscope records the intensity of light reflected from the plate, until the intensity of the detected light reaches a maximal value, which, in some embodiments, is higher than a preset threshold. This maximal value of the detected light intensity corresponds to an in-focus position of a surface of the plate.
Without wishing to be bound by theory, in the example described above, in which the objective lens is disposed below the plate and the focal plane is initially disposed below the plate and is displaced toward the plate, it is believed that the location at which maximal light intensity is observed corresponds to a point at which the focal plane of the objective lens is tangential to the curved surface of the well bottom.
Subsequently, in some embodiments, the focal plane of the objective continues to be displaced toward the plate, until another peak in the intensity of reflected light is detected, the peak being defined by a respective threshold value in accordance with the environment and the sample being tested. Without wishing to be bound by theory, in the example described above, in which the objective lens is disposed below the plate and the focal plane is initially disposed below the plate and is displaced toward the plate, it is surmised that this second peak in the intensity of the reflected light occurs when the focal plane of the objective lens is tangent to the intra-well plate bottom, and typically represents an offset from an in-focus position of the sample. The magnitude of the offset may be determined manually by the user, or may be determined automatically using methods known in the art.
In some embodiments, the offset is computed from the first peak in the intensity of detected light, without continuing the search for a second peak in the intensity of detected light. In such embodiments, the magnitude of the offset may be determined manually by the user, or may be determined automatically using methods known in the art.
It will be appreciated that the direction in which the focal plane is displaced toward the plate, and the order in which the peaks in intensity of detected light are identified, is dependent on the setup of the imaging device. For example, in some embodiments, the objective lens is disposed below the sample plate, but the focal plane of the objective lens is disposed above the well bottom, such that the focal plane would be displaced downward toward the well bottom. Without wishing to be bound by theory, in such embodiments, it is surmised that the first peak in the intensity of the reflected light occurs when the focal plane of the objective lens is tangent to the intra-well plate bottom, and typically represents an offset from an in-focus position of the sample while the location at which the second peak in intensity of the reflected light is detected corresponds to a point at which the focal plane of the objective lens is tangential to the curved surface of the well bottom. A corresponding situation occurs in other embodiments in which the objective lens is disposed above the sample plate, and the focal plane of the objective lens is disposed above the well bottom, such that the focal plane would be displaced downward toward the well bottom.
As another example, in some embodiments, the objective lens is disposed above the sample plate, but the focal plane of the objective lens is disposed below the well bottom, such that the focal plane would be displaced upward toward the well bottom. Without wishing to be bound by theory, in such embodiments, it is surmised that the location at which the first peak in intensity of the reflected light is detected corresponds to a point at which the focal plane of the objective lens is tangential to the curved surface of the well bottom while the second peak in the intensity of the reflected light occurs when the focal plane of the objective lens is tangent to the intra-well plate bottom, and typically represents an offset from an in- focus position of the sample.
In some embodiments, the center of the well, at which the in-focus position would lie, is identified based on the plate specifications provided by the manufacturer. In some embodiments, the center of the well is determined using X-Y displacement of the plate or X- Y displacement of the objective lens, until the center of a well or the edge of a well are identified using suitable light detection parameters and characteristics, as is known in the art.
At step 304, at least three of the in-focus positions identified at step 302 are used to compute a plane along which at least some of the plurality of wells in the plate, and typically all the wells in the plate, are in-focus or close to in-focus with respect to a second objective lens, such as an objective lens 206 of Figure 2. The second objective lens has a second magnification which is not greater than the first magnification of the first objective lens. As described hereinbelow, the wells are scanned using the second objective lens based on the location computed plane, by maintaining the position of the second objective lens during scanning so that for any given well scanned, the calculated plane and the focal plane of the second objective lens are coincident or close to coincident.
In some embodiments, the plane is computed by translating at least three of, and typically each of, the in-focus positions identified in step 302 using the first objective lens to corresponding second in-focus positions with respect to the second objective lens, based on optical characteristics of the second objective lens, and computing a plane including at least three of the second in-focus positions.
In some embodiments, the plane is computed by computing, on the basis of at least three of the in-focus positions, a first plane along which at least some of the plurality of wells in the plate, and typically all the wells in the plate, are in-focus or close to in-focus with respect to the first objective lens. The first plane is then translated into the corresponding plane along which at least some of the wells, and typically all the wells, are in-focus or close to in-focus with respect to the second objective lens, based on optical characteristics of the second objective lens.
As mentioned above, the second objective lens has a magnification that is not greater than the first magnification of the first objective lens. As such, in some embodiments the second magnification is smaller than the first magnification, and may be, for example, 4x or 2x. In some embodiments, the second magnification is equal to the first magnification, but the numerical aperture value of the second objective lens is higher than the numerical aperture value of the first objective lens.
In some embodiments, the plane is computed using all the in-focus positions identified at step 302. In other embodiments, the plane is computed using fewer than all the in-focus positions identified at step 302. In some embodiments, the plane is computed for a section of the plate, for example for a quadrant, using at least three in-focus positions identified, using the first objective lens, within that section of the plate. In such embodiments, the method described herein is repeated for each section or quadrant of the plate using a different set of in-focus positions for each such section.
At step 306, which may occur before or after step 304 above, the first objective lens is changed to the second objective lens, for example by a suitable hardware mechanism such as objective lens exchanger 208 of Figure 2. In some embodiments the first and second objective lenses are identical, and step 306 of Figure 3 is omitted.
Finally, at step 308, the wells of the multiwell plate are scanned, or imaged, along the plane computed at step 304, using the second objective lens, without carrying out any additional focusing operations.
The scanning at step 308 may be carried out using any suitable method known in the art, including capturing an image stack, which is particularly useful when imaging a three dimensional construct such as a spheroid. In some embodiments, the teachings herein may be carried out on a plate having a single well, or on a single well within a multi-well plate. In such embodiments, the first objective is used to find an in-focus point of the sample in the plate. The in-focus point found using the first objective is translated into an in-focus point for the second objective, based on the optical characteristics of the second objective. The second objective is then used to scan the plate, when placed at the translated in-focus point, or at the height thereof.
It will be appreciated that the teachings herein allow the imaging device to be in-focus with respect to the plate regardless of the "expected height difference" and of the "unexpected height difference" within the plate. The "expected height difference" is defined as the curvature of the plate listed in the specifications of the plate and that is intended by the manufacturer to be in the plate, such as having a curved bottom due to the structure. The "unexpected height difference" is defined as lack of planarity which is not intended in the specification of the plate. Such "unexpected height difference" may be, for example, due to differences in the relative heights of the bottoms of the wells; or may be, for example, due to deviations from planarity in the virtual surface traced by the scanning components as the objective is moved; or the surface upon which the plate rests being non-parallel with the virtual surface traced by the scanning components as the objective is moved.
It will be appreciated that certain features of the invention, which are, for clarity, described in the context of separate embodiments, may also be provided in combination in a single embodiment. Conversely, various features of the invention, which are, for brevity, described in the context of a single embodiment, may also be provided separately or in any suitable subcombination or as suitable in any other described embodiment of the invention. Certain features described in the context of various embodiments are not to be considered essential features of those embodiments, unless the embodiment is inoperative without those elements.
Although the invention has been described in conjunction with specific embodiments thereof, it is evident that many alternatives, modifications and variations will be apparent to those skilled in the art. Accordingly, it is intended to embrace all such alternatives, modifications and variations that fall within the scope of the appended claims.
Citation or identification of any reference in this application shall not be construed as an admission that such reference is available as prior art to the invention.
Section headings are used herein to ease understanding of the specification and should not be construed as necessarily limiting.

Claims

CLAIMS:
1. An auto-focusing method for determining an in-focus position of a plurality of wells in at least a portion of a multi-well plate, the method comprising:
using a first objective lens having a first magnification to identify, in each of at least three wells of a selected subset of said plurality of wells, an in-focus position of each said well with respect to said first objective lens;
on the basis of at least three said in-focus positions, computing a plane along which said at least three wells will be in focus with respect to at least one objective lens having a second magnification that is not greater than said first magnification; and
using said at least one objective lens to scan, along said plane, at least some of said plurality of wells in said portion of said plate.
2. The auto-focusing method of claim 1, wherein said at least one objective lens is said first objective lens, and said first magnification is equal to said second magnification.
3. The auto-focusing method of claim 2, wherein said computing a plane comprises computing a plane along which said at least three wells are in focus with respect to said first objective lens.
4. The auto-focusing method of claim 1, wherein said at least one objective lens is a second objective lens, different from said first objective lens, wherein said second magnification is smaller than said first magnification.
5. The auto-focusing method of claim 4, wherein said computing a plane comprises: translating at least three of said in-focus positions identified using said first objective lens to corresponding second in-focus positions with respect to said second objective lens based on optical characteristics of said second objective lens; and
computing said plane on the basis of at least three said second in-focus positions.
6. The auto-focusing method of claim 4, wherein said computing a plane comprises: on the basis of at least three said in-focus positions, computing a first plane along which said at least three wells will be in focus with respect to said first objective lens; and translating said first plane to a corresponding plane along which said at least three wells will be in focus with respect to said second objective lens based on optical characteristics of said second objective lens, thereby to compute said plane.
7. The auto-focusing method of any one of the preceding claims, wherein said scanning using said at least one objective lens is carried out without carrying out additional focusing operations.
8. The auto-focusing method of any one of the preceding claims wherein said subset of said plurality of wells includes more than three of said plurality of wells.
9. The auto-focusing method of any one of the preceding claims wherein said identifying an in-focus position comprises identifying a said in-focus position for each well in said subset.
10. The auto-focusing method of any one of the preceding claims, wherein each of said wells comprises generally cylindrical side walls, and a bottom surface comprising a portion of at least one of a sphere, a parabola, and an ellipse.
11. The auto-focusing method of any one of the preceding claims, wherein each of said wells has a U-shaped cross-section.
12. The auto-focusing method of any one of claims 1 to 9, wherein each of said wells comprises generally cylindrical side walls, and a planar bottom surface.
13. The auto-focusing method of claim 12, wherein said planar bottom surface lies generally parallel to a top surface of said multiwell plate, such that said well has a rectangular cross section.
14. The auto-focusing method of any one of claims 1 to 9, wherein each of said wells is frusto-conical.
15. The auto-focusing method of any one of claims 1 to 9, wherein each of said wells has inclined side walls, a planar bottom, and a trapezoidal cross section.
16. The auto-focusing method of any one of the preceding claims, further comprising, prior to said using a first objective lens, aligning said first objective lens to lie axially over the center of one of said wells.
17. The auto-focusing method of any one of the preceding claims, wherein said portion of said plate comprises a quadrant of said plate.
18. The auto-focusing method of any one of claims 1 to 16, wherein said portion of said plate comprises an entirety of said plate.
19. An auto-focusing method for determining an in-focus position of at least a portion of a well in a plate, the method comprising:
using a first objective lens having a first magnification to identify, at at least one location of said well, a first in-focus position of at least a portion of said well with respect to said first objective lens;
identifying, for said first in-focus position, a corresponding in-focus position with respect to at least one objective lens having a second magnification, based on optical characteristics of said at least one objective lens; and
using said at least one objective lens to scan, at a height corresponding to said corresponding in-focus position, at least said portion of said well,
wherein said second magnification is not greater than said first magnification.
20. The auto-focusing method of claim 19, wherein said at least one objective lens is said first objective lens, said first magnification is equal to said second magnification, and said corresponding in-focus position is said first in-focus position.
21. The auto-focusing method of claim 19, wherein said at least one objective lens comprises a second objective lens, different from said first objective lens, wherein said second magnification is smaller than said first magnification.
22. The auto-focusing method of claim 21, wherein said identifying comprises translating said first in-focus position to said corresponding in-focus position with respect to said second objective lens based on optical characteristics of said second objective lens.
23. The auto-focusing method of any one of claims 19 to 22, wherein said scanning using said at least one objective is carried out without carrying out additional focusing operations.
24. The auto-focusing method of any one of claims 19 to 23, wherein said well comprises generally cylindrical side walls, and a bottom surface comprising a portion of at least one of a sphere, a parabola, and an ellipse.
25. The auto-focusing method of any one of claims 19 to 24, wherein said well has a U- shaped cross-section.
26. The auto-focusing method of any one of claims 19 to 23, wherein said well comprises generally cylindrical side walls, and a planar bottom surface.
27. The auto-focusing method of claim 26, wherein said planar bottom surface lies generally parallel to a top surface of said plate, such that said well has a rectangular cross section.
28. The auto-focusing method of any one of claims 19 to 23, wherein said well is frusto- conical.
29. The auto-focusing method of any one of claims 19 to 23, wherein said well has inclined side walls, a planar bottom, and a trapezoidal cross section.
30. An auto-focusing device for automatically determining an in-focus position of a plurality of wells located in at least a portion of a plate containing wells, the device comprising:
a computation component programmed to compute a plane along which at least three wells in said portion of said plate would be in focus with respect to an objective lens;
a first objective lens functionally associated with said computation component, said first objective lens having a first magnification, images from said first objective lens being used by said computation component for identifying an in-focus position for each of at least three wells of a selected subset of said plurality of wells; and at least one objective lens having a second magnification, said second magnification not being greater than said first magnification, for scanning at least some of said plurality of wells in said portion of said plate along said plane,
wherein said computation component is configured to compute said plane along which said at least three wells would be in-focus with respect to said at least one objective lens on the basis of at least three said in-focus positions.
31. The auto-focusing device of claim 30, wherein said at least one objective lens is configured to scan said plurality of wells along said plane without carrying out additional focusing operations.
32. The auto-focusing device of claim 30 or claim 31, wherein said at least one objective lens is said first objective lens, said second magnification is equal to said first magnification.
33. The auto-focusing device of claim 30 or claim 31, wherein said at least one objective lens is a second objective lens, different from said first objective lens, and wherein said second magnification is smaller than said first magnification.
34. The auto-focusing device of claim 33, wherein said computation component is programmed to compute said in-focus plane by:
translating at least three of said in-focus positions identified using said first objective lens to corresponding second in-focus positions with respect to said second objective lens based on optical characteristics of said second objective lens; and
computing said in-focus plane on the basis of at least three said second in-focus positions.
35. The auto-focusing device of claim 33, wherein said computation component is programmed to compute said in-focus plane by:
on the basis of at least three said in-focus positions, computing a first plane along which said at least three wells will be in focus with respect to said first objective lens; and translating said first plane to a corresponding plane along which said at least three wells will be in focus with respect to said second objective lens based on optical characteristics of said second objective lens, thereby to compute said plane.
36. The auto-focusing device of any one of claims 30 to 35, wherein said computation component is programmed to identify a said in-focus position for each well in said subset.
37. The auto-focusing device of any one of claims 30 to 36, wherein the device is adapted for use with a plate in which each of said wells comprises generally cylindrical side walls, and a bottom surface comprising at least one of a portion of a sphere, a parabola, and a portion of an ellipse.
38. The auto-focusing device of any one of claims 30 to 37, wherein the device is adapted for use with a plate in which each of said wells has a U-shaped cross section.
39. The auto-focusing device of any one of claims 30 to 36, wherein the device is adapted for use with a plate in which each of said wells comprises generally cylindrical side walls, and a planar bottom surface.
40. The auto-focusing device of claim 39, wherein said planar bottom surface lies generally parallel to a top surface of said plate, such that each of said wells has a generally rectangular cross section.
41. The auto-focusing device of any one of claims 30 to 36, wherein the device is adapted for use with a plate in which each of said wells is frusto-conical.
42. The auto-focusing device of any one of claims 30 to 36, wherein the device is adapted for use with a plate in which each of said wells has inclined side walls, a planar bottom, and a trapezoidal cross section.
43. The auto-focusing device of any one of claims 30 to 42, wherein said portion of said plate comprises a quadrant of said plate.
44. The auto-focusing device of any one of claims 30 to 42, wherein said portion of said plate comprises an entirety of said plate.
45. An auto-focusing device for automatically determining an in-focus position of at least a portion of a well, the device comprising: a computation component programmed to compute an in-focus position of said portion of said well;
a first objective lens functionally associated with said computation component, said first objective lens having a first magnification, images from said first objective lens being used by said computation component for identifying, in at least one position of said well, a first in-focus position of said well with respect to said first objective lens; and
at least one objective lens having a second magnification, said second magnification not being greater than said first magnification, for scanning at least a portion of said well at a height of a corresponding in-focus position of said well with respect to said at least one objective lens,
wherein said computation component is programmed to identify said corresponding in-focus position based on optical characteristics of said at least one objective lens.
46. The auto-focusing device of claim 45, wherein said at least one objective lens is configured to scan said portion of said well without carrying out additional focusing operations.
47. The auto-focusing device of claim 45 or claim 46, wherein said at least one objective lens is said first objective lens, said second magnification is equal to said first magnification, and said corresponding in-focus position is the same as said first in-focus position.
48. The auto-focusing device of any one of claims 45 to 46, wherein said at least one objective lens is a second objective lens different from said first objective lens, and wherein said second magnification is smaller than said first magnification.
49. The auto-focusing device of claim 48, wherein said computation component is programmed to identify said corresponding in-focus position by translating said first in-focus position to said corresponding in-focus position with respect to said second objective lens based on optical characteristics of said second objective lens.
50. The auto-focusing device of any one of claims 45 to 49, wherein the device is adapted for use with a well comprising generally cylindrical side walls, and a bottom surface comprising at least one of a portion of a sphere, a parabola, and a portion of an ellipse.
51. The auto-focusing device of any one of claims 45 to 49, wherein the device is adapted for use with a well having a U-shaped cross section.
52. The auto-focusing device of any one of claims 45 to 49, wherein the device is adapted for use with a well comprising generally cylindrical side walls, and a planar bottom surface.
53. The auto-focusing device of claim 52, wherein said planar bottom surface lies generally parallel to a top surface of said plate, such that said well has a generally rectangular cross section.
54. The auto-focusing device of any one of claims 45 to 49, wherein the device is adapted for use with a frusto-conical well.
55. The auto-focusing device of any one of claims 45 to 49, wherein the device is adapted for use with a well having inclined side walls, a planar bottom, and a trapezoidal cross section.
PCT/IB2016/050323 2015-01-22 2016-01-22 Auto-focusing method and device WO2016116897A1 (en)

Priority Applications (8)

Application Number Priority Date Filing Date Title
JP2017557506A JP2018508837A (en) 2015-01-22 2016-01-22 Autofocus method and autofocus device
CA3012072A CA3012072C (en) 2015-01-22 2016-01-22 Auto-focusing method and device
ES16739867T ES2854700T3 (en) 2015-01-22 2016-01-22 Autofocus method and device
CN201680006723.XA CN107533218B (en) 2015-01-22 2016-01-22 Method and apparatus for auto-focusing
EP16739867.6A EP3248039B1 (en) 2015-01-22 2016-01-22 Auto-focusing method and device
IL253543A IL253543B (en) 2015-01-22 2017-07-18 Auto-focusing method and device
US15/657,155 US10345566B2 (en) 2015-01-22 2017-07-23 Method and device for scanning wells in a multi-well plate
US16/423,063 US11092791B2 (en) 2015-01-22 2019-05-27 Method and device for scanning wells in a multi-well plate

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
GB1501093.7 2015-01-22
GB1501093.7A GB2534402A (en) 2015-01-22 2015-01-22 Auto-focussing method and device

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US15/657,155 Continuation-In-Part US10345566B2 (en) 2015-01-22 2017-07-23 Method and device for scanning wells in a multi-well plate

Publications (1)

Publication Number Publication Date
WO2016116897A1 true WO2016116897A1 (en) 2016-07-28

Family

ID=52673806

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2016/050323 WO2016116897A1 (en) 2015-01-22 2016-01-22 Auto-focusing method and device

Country Status (9)

Country Link
US (2) US10345566B2 (en)
EP (1) EP3248039B1 (en)
JP (1) JP2018508837A (en)
CN (1) CN107533218B (en)
CA (1) CA3012072C (en)
ES (1) ES2854700T3 (en)
GB (1) GB2534402A (en)
IL (1) IL253543B (en)
WO (1) WO2016116897A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3690016A4 (en) * 2017-09-29 2020-11-18 FUJIFILM Corporation Observation device, observation method, and observation program

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN108918370B (en) * 2018-06-27 2020-10-09 太原理工大学 Method and device for detecting concentration of adherent cells
DE102018131427B4 (en) * 2018-12-07 2021-04-29 Leica Microsystems Cms Gmbh Method for automatic position determination on a sample arrangement and corresponding microscope, computer program and computer program product
CN114578536B (en) * 2020-11-30 2024-03-26 深圳市瑞图生物技术有限公司 Image acquisition method, device, computer equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL163881A (en) * 2002-03-13 2008-11-26 Yeda Res & Dev Auto-focusing method and device
US20140210981A1 (en) * 2011-08-10 2014-07-31 Molecular Devices, Llc Method for presenting and evaluation of images of micro-titer plate properties

Family Cites Families (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5260825A (en) * 1989-03-20 1993-11-09 Olympus Optical Co., Ltd. Microscope
JP2891739B2 (en) * 1989-03-20 1999-05-17 オリンパス光学工業株式会社 microscope
WO1999054711A1 (en) * 1998-04-17 1999-10-28 Ljl Biosystems, Inc. Sample-holding devices and systems
IL138496A0 (en) * 1998-03-16 2001-10-31 Praelux Inc Confocal microscopy imaging system
JP4505663B2 (en) * 1999-09-14 2010-07-21 株式会社ニコン Scanning confocal microscope
ATE330244T1 (en) * 2001-02-02 2006-07-15 Cellomics Inc METHOD FOR ESTIMATING THE BEST INITIAL FOCUSING
US20030030869A1 (en) 2001-08-08 2003-02-13 International Business Machines Corporation Active real-time alignment system for optoelectronic (OE) devices
US6850362B2 (en) * 2001-08-08 2005-02-01 Atto Bioscience Inc. Microscope optical system with a stationary sample stage and stationary viewing ports suited for viewing various fields of view of a sample
JP2005114859A (en) * 2003-10-03 2005-04-28 Nikon Corp Microscope
JP2006003653A (en) * 2004-06-17 2006-01-05 Olympus Corp Biological sample observating system
JP4914715B2 (en) * 2004-06-21 2012-04-11 オリンパス株式会社 Inverted microscope system
US20060001954A1 (en) * 2004-06-30 2006-01-05 Michael Wahl Crystal detection with scattered-light illumination and autofocus
DE102004048302B4 (en) * 2004-10-01 2017-09-07 Carl Zeiss Microscopy Gmbh Objective changer for stereomicroscopes and stereomicroscope
JP5152622B2 (en) * 2007-05-23 2013-02-27 横河電機株式会社 Drug discovery screening device and drug discovery screening method using this device
US7646482B2 (en) * 2007-05-31 2010-01-12 Genetix Limited Methods and apparatus for optical analysis of samples in biological sample containers
US7535556B2 (en) * 2007-05-31 2009-05-19 Genetix Limited Methods and apparatus for optical analysis of samples in biological sample containers
JP5108627B2 (en) * 2008-05-23 2012-12-26 オリンパス株式会社 Observation apparatus and observation method
JP5401062B2 (en) * 2008-09-05 2014-01-29 ベックマン コールター, インコーポレイテッド Image pattern determination method, system, apparatus, program, and computer-readable recording medium storing the program
JP2010191298A (en) * 2009-02-19 2010-09-02 Nikon Corp Microscope
CA2656506A1 (en) 2009-02-27 2010-08-27 Bank Of Canada Security device
CN102033308B (en) * 2010-10-22 2012-08-29 浙江大学 Ultra-high resolution optical microscope imaging method and device
DK2663890T3 (en) * 2011-01-12 2015-11-30 Idea Machine Dev Design & Production Ltd COMPACT MICROSCOPY SYSTEM AND PROCEDURE
KR101282926B1 (en) * 2011-07-28 2013-07-08 고려대학교 산학협력단 Surface tension induced concave microwell fabrication and cell aggregation using the same
JP6313043B2 (en) * 2011-09-20 2018-04-18 株式会社クラレ Method for culturing adherent cells
CN102796659B (en) * 2012-08-21 2014-06-11 北京大学 Porous single cell observation plate and use thereof
US10274715B2 (en) * 2014-08-06 2019-04-30 Cellomics, Inc. Image-based laser autofocus system
US11086118B2 (en) * 2019-04-29 2021-08-10 Molecular Devices, Llc Self-calibrating and directional focusing systems and methods for infinity corrected microscopes

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
IL163881A (en) * 2002-03-13 2008-11-26 Yeda Res & Dev Auto-focusing method and device
US20140210981A1 (en) * 2011-08-10 2014-07-31 Molecular Devices, Llc Method for presenting and evaluation of images of micro-titer plate properties

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP3248039A4 *

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3690016A4 (en) * 2017-09-29 2020-11-18 FUJIFILM Corporation Observation device, observation method, and observation program
US11397313B2 (en) 2017-09-29 2022-07-26 Fujifilm Corporation Observation apparatus, observation method, and observation program

Also Published As

Publication number Publication date
EP3248039A4 (en) 2018-09-05
CN107533218A (en) 2018-01-02
CN107533218B (en) 2020-06-12
GB2534402A (en) 2016-07-27
EP3248039B1 (en) 2020-11-18
JP2018508837A (en) 2018-03-29
IL253543B (en) 2021-07-29
GB201501093D0 (en) 2015-03-11
IL253543A0 (en) 2017-09-28
CA3012072C (en) 2021-03-16
EP3248039A1 (en) 2017-11-29
US20170329115A1 (en) 2017-11-16
US20200088980A1 (en) 2020-03-19
CA3012072A1 (en) 2016-07-28
US10345566B2 (en) 2019-07-09
ES2854700T3 (en) 2021-09-22
US11092791B2 (en) 2021-08-17

Similar Documents

Publication Publication Date Title
US11092791B2 (en) Method and device for scanning wells in a multi-well plate
US20230174321A1 (en) Slide rack gripper apparatus
KR102411099B1 (en) Real-time autofocus scanning
JP7055098B2 (en) Microscope system with transillumination-based automatic focusing for photoluminescence imaging
CN111983794B (en) Automatic focusing optical microscope
JP4985980B2 (en) Well plate and fluorescence imaging system using it
US9741122B2 (en) Method and device for determining a distance between two optical boundary surfaces which are spaced apart from each other along a first direction
US11445081B2 (en) Slide rack determination system
KR20190008362A (en) Photographing Apparatus and Method and Photographing Control Program
KR20220038577A (en) Physical Calibration Slides
CN118158524A (en) Imaging method, device and system
SE2250140A1 (en) Imaging apparatus and method for determning a focal point of a well-plate
JP2022044688A (en) Microscope system with transillumination-based autofocusing for photoluminescence imaging
EP4275088A1 (en) Methods and systems to compensate for substrate thickness error

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16739867

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 253543

Country of ref document: IL

ENP Entry into the national phase

Ref document number: 2017557506

Country of ref document: JP

Kind code of ref document: A

NENP Non-entry into the national phase

Ref country code: DE

REEP Request for entry into the european phase

Ref document number: 2016739867

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 3012072

Country of ref document: CA