WO2007079397A2 - Autofocus method and system for an automated microscope - Google Patents
Autofocus method and system for an automated microscope Download PDFInfo
- Publication number
- WO2007079397A2 WO2007079397A2 PCT/US2006/062691 US2006062691W WO2007079397A2 WO 2007079397 A2 WO2007079397 A2 WO 2007079397A2 US 2006062691 W US2006062691 W US 2006062691W WO 2007079397 A2 WO2007079397 A2 WO 2007079397A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- optical detector
- interest
- image
- automated microscope
- sensor pixels
- Prior art date
Links
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/24—Base structure
- G02B21/241—Devices for focusing
- G02B21/245—Devices for focusing using auxiliary sources, detectors
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/0004—Microscopes specially adapted for specific applications
- G02B21/002—Scanning microscopes
- G02B21/0024—Confocal scanning microscopes (CSOMs) or confocal "macroscopes"; Accessories which are not restricted to use with CSOMs, e.g. sample holders
- G02B21/0052—Optical details of the image generation
- G02B21/006—Optical details of the image generation focusing arrangements; selection of the plane to be imaged
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/24—Base structure
- G02B21/241—Devices for focusing
- G02B21/244—Devices for focusing using image analysis techniques
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B7/00—Mountings, adjusting means, or light-tight connections, for optical elements
- G02B7/28—Systems for automatic generation of focusing signals
- G02B7/36—Systems for automatic generation of focusing signals using image sharpness techniques, e.g. image processing techniques for generating autofocus signals
Definitions
- Automated microscopes such as confocal laser scanning microscopes and wide-field fluorescence microscopes are powerful imaging tools that are especially valuable for inspection of biological samples.
- One important component in a typical automated microscope is an autofocusing system.
- the autofocusing system should be able to adjust focus for the microscope's optical system to obtain high- contrast images and should do so in a fast, accurate and reliable manner.
- very few existing autofocusing systems, if any, can meet such requirements in a cost-efficient way.
- Most known autofocusing systems fall into two categories: image-based or confocal-based, both of which have notable shortcomings.
- An image-based autofocusing system may rely on an image- processing algorithm to find a best focus for a microscope.
- Such an image-based autofocusing system may cause a main optical detector in the microscope to acquire a number of images while an objective lens is moved within its focus range, so that each image corresponds to a different focal position. The contrast of each image is then analyzed and evaluated by applying the image-processing algorithm to the image data. The best focal position is identified as one that corresponds to the strongest contrast in the acquired images.
- a image-based autofocusing system is usually simple, reliable and inexpensive, it is relatively slow since multiple images have to be acquired and then processed with the complex contrast-evaluation algorithm.
- this type of image-based autofocusing cannot be performed during image acquisition (i.e., operate in a "tracking mode") because the main optical detector would not be available for autofocusing operations.
- An image-based autofocusing system may also rely on a separate set of hardware (e.g., a separate optical detector and separate optical components) that operates somewhat independently from the microscope's main image acquisition system.
- This type of autofocusi ⁇ g system is also referred to as a hardware-based system.
- FIG. 1 shows a prior art microscope 100 equipped with a hardware-based autofocusing system 120.
- a main image acquisition system in the microscope 100 comprises a main charge coupled device' (CCD) detector 102, a main optical path 104 that comprises an objective lens 110 and other optical elements, a main illumination light source 106, and an object stage 108.
- the main illumination light source 106 generates a light beam 10 (typically a laser) that is directed, via the main optical path 104, to the object stage 108 to illuminate a sample thereon. An image of the sample is then detected by the main CCD detector 102.
- a light beam 10 typically a laser
- the hardware-based autofocusing system 120 provides a secondary image acquisition system that includes a secondary CCD detector 122, a secondary optical path 124 and an auto focus light source 126.
- the autofocus light source 126 typically generates an autofocus light beam 20 " having a different wavelength from the light beam 10 generated by the main illumination light source 106.
- the autofocus light beam 20 is coupled into the main optical path 104 to illuminate the object stage 108.
- a resulting image is then detected by the secondary CCD detector 122.
- a microcontroller (or microprocessor) 128 is available to analyze the autofocus images acquired by the secondary CCD detector 122.
- the microcontroller 128 is also coupled to a motion control unit 112 that adjusts a relative position of the object stage 108 with respect to the objective lens 110. By coordinating the movement of the object stage 108 and the acquisition and analysis of autofocus images, the microcontroller 128 may quickly identify an optimal focal position that produces the strongest contrast in the autofocus image.
- a hardware-based autofocusing system such as the system 120, may also be adapted for confocal-based autofocusing, wherein a physical confocal aperture (not shown) is used and, instead of analyzing entire images, light intensity through the confocal aperture may be analyzed for focus adjustments.
- a hardware-based autofocusing system can zero in on the best focus fairly fast and may also be able to perform focus adjustment when the microscope's main image acquisition system is busy acquiring sample images.
- the dedicated autofocusing hardware also substantially increases the overall complexity and cost of the microscope.
- a hardware-based autofocusing system is typically incapable of flexible adaptation to different imaging modes the microscope operates in.
- Position-sensitive autofocusing can be used for tracking-mode focus adjustments, and is widely used in optical drives such as compact disk (CD) drives and digital versatile disk (DVD) drives.
- CD compact disk
- DVD digital versatile disk
- it is very difficult to implement position- sensitive autofocusing in an imaging system with multiple objective lenses.
- the present invention is directed to an autofocusing system and method that overcomes these and other drawbacks of known systems and methods.
- the invention relates to a method for adjusting focus in an automated microscope.
- the method may comprise the steps of: providing an optical detector for image acquisition, wherein the optical detector comprises an array of sensor pixels; designating a region of interest in the array of sensor pixels to emulate a confocal aperture; directing a light beam to illuminale an object, according t ⁇ a predefined pattern, thereby forming an, image of the illuminated pattern at the optical detector, wherein the image of the illuminated pattern substantially overlaps the designated region of interest; detecting a light intensity from sensor pixels located within the designated region of interest; and adjusting a relative focal position of an objective lens based on the detected light intensity.
- the invention relates to an automated microscope.
- the automated microscope may comprise: at least one light source that generates a light beam; an optical path and an optical detector for image acquisition, wherein the optical path has an objective lens therein, and wherein the optical detector comprises an array of sensor pixels; a motion mechanism capable of moving the objective lens within a focus adjustment range; and a processor module coupled to the optical detector and the motion mechanism.
- the processor module may designate a region of interest in the array of sensor pixels to emulate a confocal aperture.
- the optical path may direct the light beam to illuminate the object according to a predefined pattern, thereby forming an image of the illuminated pattern at the optical detector, wherein the image of the illuminated pattern substantially overlaps the designated region of interest.
- the processor module may determine a desired relative focal position of the objective lens by coordinating the movement of the objective lens and detection of light intensity from sensor pixels located within the designated region of interest.
- the invention relates to a method for adjusting focus in an automated microscope.
- the method may comprise the steps of: providing an optical detector for image acquisition, wherein the optical detector comprises an array of sensor pixels; directing a light beam to illuminate an object according to a line pattern, thereby forming a line-shaped image at the optical detector; designating a region of interest in the array of sensor pixels, wherein the designated region of interest crosses the line-shaped image; determining, based on detection data collected from sensor pixels located within the designated region of interest, a width of the line-shaped image and a light intensity associated with the line-shaped image; and adjusting a relative focal position of an objective lens based on the width and the light intensity.
- an autofocus method and system for an automated microscope is disclosed. It is another technical advantage of the present invention that a pixel-based optical detector is used to emulate a confocal aperture and/or to improve the speed and accuracy of microscope focus adjustments. It is a further technical advantage of the present invention that the autofocus technique may be useful for confocal or wide-field microscopes.
- Figure 1 shows a prior art microscope equipped with a hardware- based auto focusing system.
- Figure 2 is a diagram illustrating a prior art method for confocal autofocusing.
- Figure 3 is a diagram illustrating an exemplary autofocusing method according to an embodiment of the present invention.
- Figure 4 is a block diagram illustrating an exemplary microscope with an autofocusing function according to an embodiment of the present invention.
- Figure 5 is a close-up view of a pixel-based optical detector according to an embodiment of the present invention.
- Figure 6 is a flow chart illustrating an exemplary autofocusing method according to an embodiment of the present invention.
- Figure 7 illustrates another exemplary autofocusing method according to an embodiment of the present invention.
- Embodiments of the present invention introduce a new autofocusing technique that not only provides faster and more accurate focus adjustment than existing image-based autofocusing approaches, but does not require a separate detection system as in existing hardware-based autofocusing systems.
- a pixel -based optical detector that serves both as a microscope's main detector for image acquisition and as the detector for autofocus purpose.
- the pixel-based optical detector may comprise a two- dimensional (2-D) array of sensor pixels whose detection data may be selectively accessed. That is, detection data associated with each sensor pixel in the 2-D array is capable of an independent readout and/or reset.
- CMOS complementary metal oxide semiconductor
- a suitable optical detector may be a charge-coupled device (CCD) detector.
- the pixel-based optical detector may be positioned in place of a physical confocal aperture and may be programmed to emulate a virtual confocal aperture. Light intensity detected from sensor pixels located within the virtual confocal aperture may be used as a basis for focus adjustments.
- FIG. 2 is a diagram illustrating ' a prior art method for confocal autofocusing.
- a light source 202 may generate a light beam 22.
- the light beam. 22 may be focused by an objective lens 204 onto an object 24 and illuminate a point 26 on an object 24.
- An image of the point 26 may be formed on a confocal aperture 208. If the focal plane of the objective lens 204 coincides with the object plane 206, then light beams originating from the point 26 are in focus on the confocal aperture 208. These light beams may produce the highest light intensity and may be detected by an optical detector 210 located behind the confocal aperture 208.
- Focus adjustment for the optical system 200 may involve changing a relative position of the objective lens 204 to find the focal position that produces one of the peaks in the light intensity at the confocal aperture 208.
- FIG. 3 is a diagram illustrating an exemplary autofocusing method according to an embodiment of the present invention.
- the exemplary method may be implemented with an autofocusing system 300.
- a light beam 32 generated by a light source 302, may pass through a beam-shaping element 303 that converts the light beam 32 into a light beam 33 that, after passing through an objective lens 304, forms a predefined illumination pattern (e.g., a point, a line, or a rectangular shape) on a object 34.
- a main difference from the prior art autofocusing system 200 shown in Figure 2
- the confocal aperture 208 may he emulated by a pixel-based optical detector 310 having a 2-D array of sensor pixels.
- the optical detector 310 may be positioned where the physical confocal aperture 208 used to be, wherein detection data associated with the sensor pixels may be selectively accessed.
- the illuminated pattern on the object 34 may form an image directly on. the 2-D array of sensor pixels.
- the random access capability of the optical detector 310 may allow selective detection of incident light on the 2-D pixel array.
- a "virtual confocal aperture” may be flexibly emulated by designating a region of interest (ROl) in the array of sensor pixels. With the emulated confocal aperture, detection signals from those sensor pixels located outside the ROI may be reset to reject out-of-focus light.
- the shape of the virtual confocal aperture (or ROI) may be the same as or similar to the predefined pattern, and may be determined based on the operation mode of a microscope in which this exemplary method is implemented. For example, if the microscope operates in a point-confocal mode, the illuminated pattern and the ROI may be configured to have a point-like shape.
- the illuminated pattern and the ROI may be shaped into a line. Both the illuminated pattern and the ROI are typically centered in a field of view of the microscope.
- the size of the ROI may be the same as or smaller than the image of the illuminated pattern.
- a search for a desired focus may involve detection of light intensity from those sensor pixels located within the ROI together with a synchronized movement of the objective lens 304.
- An optimal focal position of the objective lens 304 may be identified as one that produces one of the peaks in the light intensity inside the virtual confocal aperture.
- Focus adjustment according to the exemplary method illustrated in Figure 3 may be faster than traditional image-based autofocusing systems for a number of reasons.
- the detection data may be read out fairly fast because, instead of collecting data from the entire sensor pixel array, only data from those sensor pixels within the ROI are read out.
- no extensive image processing is required.
- the exemplary method in Figure 3 does not require a separate optical detector or optical system to be dedicated to autofocusing.
- the autofocusing function may be implemented with the microscope's main image acquisition system.
- the autofocusing system 300 shown in Figure 3 may actually be a microscope's main image acquisition system as well.
- the optical detector 310 may be the main optical detector that also serves the autofocusing purposes.
- FIG. 4 is a block diagram illustrating an exemplary microscope 400 with an autofocusing function according to an embodiment of the present invention.
- the microscope 400 may comprise one or more light sources 402 that arc capable of generating one or more light beams either for image acquisition (e.g., fluorescence excitation) or for autofocusing.
- a light beam 40 may be selected from the one or more light sources 402 with, for example, an optical switch (not shown).
- the light beam 40 may pass through a beam-shaping module, which, in this example, is a line-forming module 404 that converts the light beam 40 into a light beam 42 diverging in the horizontal direction only.
- the light beam 42 may be directed by an optical element 406 (e.g., a dicliroic mirror or a beam splitter) and then focused by an objective lens 408 to illuminate a line pattern 44 on an object 410.
- the line pattern 44 may be centered in the field of view of the microscope 400.
- Light reflecting off the object 410 may pass through the objective lens 408, the beam splitter 406 and a tube lens 412 before forming an image of the line pattern 44 on a pixel -based optical detector 414.
- FIG. 5 is a close-up view of the pixel -based optical detector 414 according to an embodiment of the present invention.
- the optical detector 414 may comprise a 2-D array of sensor pixels 502. Each sensor pixel may detect an optical signal incident thereon and have the resulting detection data read out or reset independently from the other sensor pixels.
- the illuminated line patter 44 may form an image covering a rectangular area 46 in the center of the optical detector 414. The size of the rectangular area 46 depends on overall magnification of the imaging system, and may vary depending on how focused the image is. The more focused the image is, the smaller the rectangular area 46 becomes.
- the size of the sharpest image of the line pattern 44 may be estimated and used as an upper limit to designate a region of interest (ROI) in the center of the optical detector 414.
- ROI region of interest
- the area 46 shown in Figure 5 represents approximately the smallest size observed for the image of the line pattern 44
- an array of sensor pixels of the same or smaller size than the area 46 may be designated as the ROI.
- either the rectangular area 46 or a slightly smaller rectangular area 48 may be selected to serve as a virtual confocal slit. Light intensity from those pixels located within the virtual confocal slit may be detected and analyzed, while detector data from pixels outside the virtual confocal slit may be either reset or ignored to reject out-of-focus light.
- the microscope 400 may further comprise a processor unit 416 which may be a microprocessor, microcontroller, a personal computer (PC), or similar electronic device. Coupled to the optical detector 414 and the objective lens 408, the processor unit 416 may coordinate the movement of the objective lens 408 with the detection of light intensity from the ROI in order to find a best focal position that corresponds to one of the highest light intensities detected. Instead of moving the objective lens 408, the object 410 may be moved with respect to the objective lens 408.
- a processor unit 416 may be a microprocessor, microcontroller, a personal computer (PC), or similar electronic device. Coupled to the optical detector 414 and the objective lens 408, the processor unit 416 may coordinate the movement of the objective lens 408 with the detection of light intensity from the ROI in order to find a best focal position that corresponds to one of the highest light intensities detected. Instead of moving the objective lens 408, the object 410 may be moved with respect to the objective lens 408.
- Figures 4 and 5 only show the major components in the microscope 400. In practice, more components may be desirable for more satisfactory operations of image acquisition and autofocusing.
- a preferred embodiment of an optical system for use in the microscope 400 may be found in a related U.S. Patent Application No. 11/184,444, filed on July 19, 2005, which is incorporated herein in its entirety.
- Figure 6 is a flow chart illustrating an exemplary autofocusing method according to an embodiment of the present invention.
- an autofocus light beam may be coupled into the main optical path of an automated microscope.
- the automated microscope may have one or more main light sources for image acquisition.
- the autofocus light beam may be generated from a light source dedicated to autofocusing and may have a wavelength that is substantially different from the main light sources. Alternatively, the autofocus light beam may he generated from one of the main light sources.
- the autofocus light beam Before being coupled into the main optical path, the autofocus light beam may be shaped according to a predefined pattern. According to a preferred embodiment, the light beam may be expanded to form a horizontal line pattern.
- the autofocus light beam may be focused by an objective lens and may illuminate an Object according to the predefined pattern.
- the autofocus light beam may be focused onto a horizontal line in the center of the microscope's field of view.
- the illuminated pattern on the object may form an image " at a main optical detector of the microscope.
- the image of an illuminated line pattern is also shaped like a line.
- the line may be. sharp or blurred depending on whether the illuminated line pattern is in focus or out of focus. If perfectly in focus, that is, the object plane coincides with the focal plane of the objective lens, the line may be the narrowest and the brightest. If out of focus to some extent, the line may be thicker and less bright.
- the main optical detector may have an array of sensor pixels that are amenable to selective or random data access.
- a region of interest (ROI) may be designated in the array of sensor pixels to emulate a confocal aperture.
- the ROI may be defined in such a way that it overlaps but is no larger than the sharpest image of the illuminated pattern. Therefore, for the illuminated line pattern centered in the field of view, the ROI may be chosen as a narrow and horizontally extending rectangular area centered in the array of sensor pixels.
- step 610 during autofocusing, light intensity may be detected from sensor pixels located within the ROI, while those sensor pixels outside the ROI may be reset.
- the relative position of the objective lens may be changed, in step 612, with respect to the object.
- the relative movement of the objective lens with respect to the object may involve moving the objective lens while keeping the object stationary, moving the object while keeping the objective lens stationary, or moving both the objective lens and the object.
- the steps 610 and 612 may be repeated such that, for each incremental position within a focus range, the corresponding light intensity in the ROI may be detected,
- a desired focal position of the objective lens may be selected for the microscope's image acquisition purposes. From the data collected in steps 610 and 612, a relationship of the changes in light intensity with respect to the relative position of the objective lens may be used as a basis for the search of a desired focal position. There may be one or more local maximums in the light intensity detected in the ROI. One of the local maximums may correspond to the best focal position of the objective lens. Other local maximums may be caused by strong reflections at, for example, an air-to-glass or glass-to-fluid interface. Thus, these local maximums may be used to identify the focal positions where the focal plane of the objective lens meets an interface in the object.
- One of the interfaces may be used as a reference for the focal position of the objective lens. For example, driring image acquisition of the microscope, a predetermined offset may be applied to the movement of the objective lens or an object stage in order to bring a sample of interest to the focal plane of the objective lens.
- FIG 7 illustrates another exemplary autofocusing method according to an embodiment of the present invention.
- the horizontally extending line pattern 44 may form a line-shaped image 74 on the optical detector 414.
- the ROI in this case may be designated as a vertically extending rectangular area 72.
- Both changes may be captured by the detection data collected from sensor pixels located within the rectangular area 72.
- the detection data may provide a light intensity distribution along the ROI.
- the line-shaped image 74 becomes more in focus, the light intensity becomes more concentrated in the center.
- the exemplary method illustrated in Figure 7 may provide more information associated with the focal position of the objective lens 408. For example, based on the width of the line-shaped image 74 and/or how fast the width changes, it may be predicted as to how far away the objective lens 408 is from its optimal focal position. Accordingly, the movement of the objective lens 408 may be sped up or slowed down. As a result, the search for the best focus may become faster and more accurate.
- the autofocusing technique in accordance with embodiments of the present invention may be adapted for a wide variety of microscopes.
- those skilled in the art may appreciate that the autofocusing technique disclosed herein may be applicable to both wide-field microscopes and confocal microscopes, and the microscopes may operate in either a fluorescence mode or a non-fluorescence mode.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Optics & Photonics (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Automatic Focus Adjustment (AREA)
- Microscoopes, Condenser (AREA)
Abstract
The invention relates to a method for adjusting focus in an automated microscope. The method may comprise the steps of: providing an optical detector for image acquisition, wherein the optical detector comprises an array of sensor pixels; designating a region of interest in the array of sensor pixels to emulate a confocal aperture; directing a light beam to illuminate an object according to a predefined pattern, thereby forming an image of the illuminated pattern at the optical detector, wherein the image of the illuminated pattern substantially overlaps the designated region of interest; detecting a light intensity from sensor pixels located within the designated region of interest; and adjusting a relative focal position of an objective lens based on the detected light intensity.
Description
AUTOFOCUS METHOD AND SYSTEM FOR AN AUTOMATED MICROSCOPE
BACKGROUND OF THE INVENTION
[0001] Automated microscopes such as confocal laser scanning microscopes and wide-field fluorescence microscopes are powerful imaging tools that are especially valuable for inspection of biological samples. One important component in a typical automated microscope is an autofocusing system. Ideally, the autofocusing system should be able to adjust focus for the microscope's optical system to obtain high- contrast images and should do so in a fast, accurate and reliable manner. However, very few existing autofocusing systems, if any, can meet such requirements in a cost-efficient way. Most known autofocusing systems fall into two categories: image-based or confocal-based, both of which have notable shortcomings.
[0002] An image-based autofocusing system may rely on an image- processing algorithm to find a best focus for a microscope. Such an image-based autofocusing system may cause a main optical detector in the microscope to acquire a number of images while an objective lens is moved within its focus range, so that each image corresponds to a different focal position. The contrast of each image is then analyzed and evaluated by applying the image-processing algorithm to the image data. The best focal position is identified as one that corresponds to the strongest contrast in the acquired images. Although such a image-based autofocusing system is usually simple, reliable and inexpensive, it is relatively slow since multiple images have to be acquired and then processed with the complex contrast-evaluation algorithm. In addition, this type of image-based autofocusing cannot be performed during image acquisition (i.e., operate in a "tracking mode") because the main optical detector would not be available for autofocusing operations.
[0003] An image-based autofocusing system may also rely on a separate set of hardware (e.g., a separate optical detector and separate optical components) that operates somewhat independently from the microscope's main image acquisition
system. This type of autofocusiαg system is also referred to as a hardware-based system.
[0004] Figure 1 shows a prior art microscope 100 equipped with a hardware-based autofocusing system 120. A main image acquisition system in the microscope 100 comprises a main charge coupled device' (CCD) detector 102, a main optical path 104 that comprises an objective lens 110 and other optical elements, a main illumination light source 106, and an object stage 108. The main illumination light source 106 generates a light beam 10 (typically a laser) that is directed, via the main optical path 104, to the object stage 108 to illuminate a sample thereon. An image of the sample is then detected by the main CCD detector 102.
[0005] In addition to and independent from the main image acquisition system, the hardware-based autofocusing system 120 provides a secondary image acquisition system that includes a secondary CCD detector 122, a secondary optical path 124 and an auto focus light source 126. The autofocus light source 126 typically generates an autofocus light beam 20 "having a different wavelength from the light beam 10 generated by the main illumination light source 106. The autofocus light beam 20 is coupled into the main optical path 104 to illuminate the object stage 108. A resulting image is then detected by the secondary CCD detector 122. A microcontroller (or microprocessor) 128 is available to analyze the autofocus images acquired by the secondary CCD detector 122. The microcontroller 128 is also coupled to a motion control unit 112 that adjusts a relative position of the object stage 108 with respect to the objective lens 110. By coordinating the movement of the object stage 108 and the acquisition and analysis of autofocus images, the microcontroller 128 may quickly identify an optimal focal position that produces the strongest contrast in the autofocus image. It should be noted that a hardware-based autofocusing system, such as the system 120, may also be adapted for confocal-based autofocusing, wherein a physical confocal aperture (not shown) is used and, instead of analyzing entire images, light intensity through the confocal aperture may be analyzed for focus adjustments.
[0006] With a secondary image acquisition system dedicated to autofocusing, a hardware-based autofocusing system can zero in on the best focus fairly fast and may also be able to perform focus adjustment when the microscope's main image acquisition system is busy acquiring sample images. However, the dedicated autofocusing hardware also substantially increases the overall complexity and cost of the microscope. Furthermore, a hardware-based autofocusing system is typically incapable of flexible adaptation to different imaging modes the microscope operates in.
[0007] Apart from confocal-based autofocusing, there is another type of non-image-based autofocusing approach known as position-sensitive autofocusing. Position-sensitive autofocusing can be used for tracking-mode focus adjustments, and is widely used in optical drives such as compact disk (CD) drives and digital versatile disk (DVD) drives. However, it is very difficult to implement position- sensitive autofocusing in an imaging system with multiple objective lenses.
BRIEF SUMMARY OF THE INVENTION
[0008] The present invention is directed to an autofocusing system and method that overcomes these and other drawbacks of known systems and methods.
[0009] According to one embodiment, the invention relates to a method for adjusting focus in an automated microscope. The method may comprise the steps of: providing an optical detector for image acquisition, wherein the optical detector comprises an array of sensor pixels; designating a region of interest in the array of sensor pixels to emulate a confocal aperture; directing a light beam to illuminale an object, according tυ a predefined pattern, thereby forming an, image of the illuminated pattern at the optical detector, wherein the image of the illuminated pattern substantially overlaps the designated region of interest; detecting a light intensity from sensor pixels located within the designated region of interest; and adjusting a relative focal position of an objective lens based on the detected light intensity.
[0010] According to another embodiment, the invention relates to an
automated microscope. The automated microscope may comprise: at least one light source that generates a light beam; an optical path and an optical detector for image acquisition, wherein the optical path has an objective lens therein, and wherein the optical detector comprises an array of sensor pixels; a motion mechanism capable of moving the objective lens within a focus adjustment range; and a processor module coupled to the optical detector and the motion mechanism. The processor module may designate a region of interest in the array of sensor pixels to emulate a confocal aperture. The optical path may direct the light beam to illuminate the object according to a predefined pattern, thereby forming an image of the illuminated pattern at the optical detector, wherein the image of the illuminated pattern substantially overlaps the designated region of interest. The processor module may determine a desired relative focal position of the objective lens by coordinating the movement of the objective lens and detection of light intensity from sensor pixels located within the designated region of interest.
[0011] According to yet another embodiment, the invention relates to a method for adjusting focus in an automated microscope. The method may comprise the steps of: providing an optical detector for image acquisition, wherein the optical detector comprises an array of sensor pixels; directing a light beam to illuminate an object according to a line pattern, thereby forming a line-shaped image at the optical detector; designating a region of interest in the array of sensor pixels, wherein the designated region of interest crosses the line-shaped image; determining, based on detection data collected from sensor pixels located within the designated region of interest, a width of the line-shaped image and a light intensity associated with the line-shaped image; and adjusting a relative focal position of an objective lens based on the width and the light intensity.
[0012] It is a technical advantage of the present invention that an autofocus method and system for an automated microscope is disclosed. It is another technical advantage of the present invention that a pixel-based optical detector is used to emulate a confocal aperture and/or to improve the speed and accuracy of microscope focus adjustments. It is a further technical advantage of the present invention that the autofocus technique may be useful for confocal or wide-field microscopes.
BRIEF DESCRIPTION OF THE DRAWINGS
[0013] In order to facilitate a fuller understanding of the present invention, reference is now made to the appended drawings. These drawings should not be construed as limiting the present invention, but are intended to be exemplary only.
[0014] Figure 1 shows a prior art microscope equipped with a hardware- based auto focusing system.
[0015] Figure 2 is a diagram illustrating a prior art method for confocal autofocusing.
[0016] Figure 3 is a diagram illustrating an exemplary autofocusing method according to an embodiment of the present invention.
[0017] Figure 4 is a block diagram illustrating an exemplary microscope with an autofocusing function according to an embodiment of the present invention.
[0018] Figure 5 is a close-up view of a pixel-based optical detector according to an embodiment of the present invention.
[0019] Figure 6 is a flow chart illustrating an exemplary autofocusing method according to an embodiment of the present invention.
[0020] Figure 7 illustrates another exemplary autofocusing method according to an embodiment of the present invention.
DETAILED DESCRIPTION OF THE INVENTION
[0021] Embodiments of the present invention introduce a new autofocusing technique that not only provides faster and more accurate focus adjustment than existing image-based autofocusing approaches, but does not require a separate detection system as in existing hardware-based autofocusing systems. These advantages are achieved by using a pixel -based optical detector that serves both as a microscope's main detector for image acquisition and as the detector for
autofocus purpose. The pixel-based optical detector may comprise a two- dimensional (2-D) array of sensor pixels whose detection data may be selectively accessed. That is, detection data associated with each sensor pixel in the 2-D array is capable of an independent readout and/or reset. One example of a suitable optical detector may be a complementary metal oxide semiconductor (CMOS) detector having a random access feature. Another example of a suitable optical detector may be a charge-coupled device (CCD) detector. The pixel-based optical detector may be positioned in place of a physical confocal aperture and may be programmed to emulate a virtual confocal aperture. Light intensity detected from sensor pixels located within the virtual confocal aperture may be used as a basis for focus adjustments.
[0022] Figure 2 is a diagram illustrating ' a prior art method for confocal autofocusing. In a simplified autofocusing system 200 (main imaging acquisition system for the microscope not shown), a light source 202 may generate a light beam 22. The light beam. 22 may be focused by an objective lens 204 onto an object 24 and illuminate a point 26 on an object 24. An image of the point 26 may be formed on a confocal aperture 208. If the focal plane of the objective lens 204 coincides with the object plane 206, then light beams originating from the point 26 are in focus on the confocal aperture 208. These light beams may produce the highest light intensity and may be detected by an optical detector 210 located behind the confocal aperture 208. Other out-of-focus light beams are blocked by the confocal aperture 210. Focus adjustment for the optical system 200 may involve changing a relative position of the objective lens 204 to find the focal position that produces one of the peaks in the light intensity at the confocal aperture 208.
[0023] Figure 3 is a diagram illustrating an exemplary autofocusing method according to an embodiment of the present invention. The exemplary method may be implemented with an autofocusing system 300. A light beam 32, generated by a light source 302, may pass through a beam-shaping element 303 that converts the light beam 32 into a light beam 33 that, after passing through an objective lens 304, forms a predefined illumination pattern (e.g., a point, a line, or a rectangular
shape) on a object 34. In the autofocusing system 300, a main difference from the prior art autofocusing system 200 (shown in Figure 2) is that the confocal aperture 208 may he emulated by a pixel-based optical detector 310 having a 2-D array of sensor pixels. The optical detector 310 may be positioned where the physical confocal aperture 208 used to be, wherein detection data associated with the sensor pixels may be selectively accessed. The illuminated pattern on the object 34 may form an image directly on. the 2-D array of sensor pixels.
[0024] The random access capability of the optical detector 310 may allow selective detection of incident light on the 2-D pixel array. As such, a "virtual confocal aperture" may be flexibly emulated by designating a region of interest (ROl) in the array of sensor pixels. With the emulated confocal aperture, detection signals from those sensor pixels located outside the ROI may be reset to reject out-of-focus light. The shape of the virtual confocal aperture (or ROI) may be the same as or similar to the predefined pattern, and may be determined based on the operation mode of a microscope in which this exemplary method is implemented. For example, if the microscope operates in a point-confocal mode, the illuminated pattern and the ROI may be configured to have a point-like shape. If the microscope operates in a line-confocal mode, the illuminated pattern and the ROI may be shaped into a line. Both the illuminated pattern and the ROI are typically centered in a field of view of the microscope. The size of the ROI may be the same as or smaller than the image of the illuminated pattern. A search for a desired focus may involve detection of light intensity from those sensor pixels located within the ROI together with a synchronized movement of the objective lens 304. An optimal focal position of the objective lens 304 may be identified as one that produces one of the peaks in the light intensity inside the virtual confocal aperture.
[0025] Focus adjustment according to the exemplary method illustrated in Figure 3 may be faster than traditional image-based autofocusing systems for a number of reasons. For example, the detection data may be read out fairly fast because, instead of collecting data from the entire sensor pixel array, only data from those sensor pixels within the ROI are read out. In addition, no extensive
image processing is required. Compared to hardware-based autofocusing systems, the exemplary method in Figure 3 does not require a separate optical detector or optical system to be dedicated to autofocusing. Instead, the autofocusing function may be implemented with the microscope's main image acquisition system. The autofocusing system 300 shown in Figure 3 may actually be a microscope's main image acquisition system as well. For example, the optical detector 310 may be the main optical detector that also serves the autofocusing purposes.
[0026] Figure 4 is a block diagram illustrating an exemplary microscope 400 with an autofocusing function according to an embodiment of the present invention. The microscope 400 may comprise one or more light sources 402 that arc capable of generating one or more light beams either for image acquisition (e.g., fluorescence excitation) or for autofocusing. A light beam 40 may be selected from the one or more light sources 402 with, for example, an optical switch (not shown). The light beam 40 may pass through a beam-shaping module, which, in this example, is a line-forming module 404 that converts the light beam 40 into a light beam 42 diverging in the horizontal direction only. The light beam 42 may be directed by an optical element 406 (e.g., a dicliroic mirror or a beam splitter) and then focused by an objective lens 408 to illuminate a line pattern 44 on an object 410. The line pattern 44 may be centered in the field of view of the microscope 400. Light reflecting off the object 410 may pass through the objective lens 408, the beam splitter 406 and a tube lens 412 before forming an image of the line pattern 44 on a pixel -based optical detector 414.
[0027] Figure 5 is a close-up view of the pixel -based optical detector 414 according to an embodiment of the present invention. The optical detector 414 may comprise a 2-D array of sensor pixels 502. Each sensor pixel may detect an optical signal incident thereon and have the resulting detection data read out or reset independently from the other sensor pixels. The illuminated line patter 44 may form an image covering a rectangular area 46 in the center of the optical detector 414. The size of the rectangular area 46 depends on overall magnification of the imaging system, and may vary depending on how focused the image is. The more focused the image is, the smaller the rectangular area 46 becomes. During
calibration, the size of the sharpest image of the line pattern 44 may be estimated and used as an upper limit to designate a region of interest (ROI) in the center of the optical detector 414. For example, if the area 46 shown in Figure 5 represents approximately the smallest size observed for the image of the line pattern 44, then an array of sensor pixels of the same or smaller size than the area 46 may be designated as the ROI. For example, either the rectangular area 46 or a slightly smaller rectangular area 48 may be selected to serve as a virtual confocal slit. Light intensity from those pixels located within the virtual confocal slit may be detected and analyzed, while detector data from pixels outside the virtual confocal slit may be either reset or ignored to reject out-of-focus light.
[0028] Referring back to Figure 4, the microscope 400 may further comprise a processor unit 416 which may be a microprocessor, microcontroller, a personal computer (PC), or similar electronic device. Coupled to the optical detector 414 and the objective lens 408, the processor unit 416 may coordinate the movement of the objective lens 408 with the detection of light intensity from the ROI in order to find a best focal position that corresponds to one of the highest light intensities detected. Instead of moving the objective lens 408, the object 410 may be moved with respect to the objective lens 408.
[0029] It should be noted that Figures 4 and 5 only show the major components in the microscope 400. In practice, more components may be desirable for more satisfactory operations of image acquisition and autofocusing. A preferred embodiment of an optical system for use in the microscope 400 may be found in a related U.S. Patent Application No. 11/184,444, filed on July 19, 2005, which is incorporated herein in its entirety.
[0030] Figure 6 is a flow chart illustrating an exemplary autofocusing method according to an embodiment of the present invention.
[0031] In step 602, an autofocus light beam may be coupled into the main optical path of an automated microscope. The automated microscope may have one or more main light sources for image acquisition. The autofocus light beam
may be generated from a light source dedicated to autofocusing and may have a wavelength that is substantially different from the main light sources. Alternatively, the autofocus light beam may he generated from one of the main light sources. Before being coupled into the main optical path, the autofocus light beam may be shaped according to a predefined pattern. According to a preferred embodiment, the light beam may be expanded to form a horizontal line pattern.
[0032] In step 604, the autofocus light beam may be focused by an objective lens and may illuminate an Object according to the predefined pattern. For example, the autofocus light beam may be focused onto a horizontal line in the center of the microscope's field of view.
[0033] In step 606, the illuminated pattern on the object may form an image" at a main optical detector of the microscope. The image of an illuminated line pattern is also shaped like a line. The line may be. sharp or blurred depending on whether the illuminated line pattern is in focus or out of focus. If perfectly in focus, that is, the object plane coincides with the focal plane of the objective lens, the line may be the narrowest and the brightest. If out of focus to some extent, the line may be thicker and less bright.
[0034] The main optical detector may have an array of sensor pixels that are amenable to selective or random data access. During calibration, in step 608, a region of interest (ROI) may be designated in the array of sensor pixels to emulate a confocal aperture. The ROI may be defined in such a way that it overlaps but is no larger than the sharpest image of the illuminated pattern. Therefore, for the illuminated line pattern centered in the field of view, the ROI may be chosen as a narrow and horizontally extending rectangular area centered in the array of sensor pixels.
[0035] In step 610, during autofocusing, light intensity may be detected from sensor pixels located within the ROI, while those sensor pixels outside the ROI may be reset. In synchronization with step 610, the relative position of the objective lens may be changed, in step 612, with respect to the object. The
relative movement of the objective lens with respect to the object may involve moving the objective lens while keeping the object stationary, moving the object while keeping the objective lens stationary, or moving both the objective lens and the object. The steps 610 and 612 may be repeated such that, for each incremental position within a focus range, the corresponding light intensity in the ROI may be detected,
[0036] In step 614, a desired focal position of the objective lens may be selected for the microscope's image acquisition purposes. From the data collected in steps 610 and 612, a relationship of the changes in light intensity with respect to the relative position of the objective lens may be used as a basis for the search of a desired focal position. There may be one or more local maximums in the light intensity detected in the ROI. One of the local maximums may correspond to the best focal position of the objective lens. Other local maximums may be caused by strong reflections at, for example, an air-to-glass or glass-to-fluid interface. Thus, these local maximums may be used to identify the focal positions where the focal plane of the objective lens meets an interface in the object. One of the interfaces may be used as a reference for the focal position of the objective lens. For example, driring image acquisition of the microscope, a predetermined offset may be applied to the movement of the objective lens or an object stage in order to bring a sample of interest to the focal plane of the objective lens.
[0037] According to embodiments of the present invention, various autofocus illumination patterns may be flexibly combined with various types of ROFs in the optical detector's sensor pixel array, either to serve different operation modes of a microscope or to improve the speed and accuracy in finding a best focus. Figure 7 illustrates another exemplary autofocusing method according to an embodiment of the present invention. In Figure 7, there is shown the same optical detector 414 as used in the microscope 400 shown in Figure 4. The horizontally extending line pattern 44 may form a line-shaped image 74 on the optical detector 414. The ROI in this case may be designated as a vertically extending rectangular area 72. As the focal position of the objective lens 408 is adjusted, the width and light intensity of the line-shaped image 74 may change.
Both changes may be captured by the detection data collected from sensor pixels located within the rectangular area 72. The detection data may provide a light intensity distribution along the ROI. As the line-shaped image 74 becomes more in focus, the light intensity becomes more concentrated in the center. Compared with the above-described autofocusing method which is based on light intensity detection in an emulated confocal aperture, the exemplary method illustrated in Figure 7 may provide more information associated with the focal position of the objective lens 408. For example, based on the width of the line-shaped image 74 and/or how fast the width changes, it may be predicted as to how far away the objective lens 408 is from its optimal focal position. Accordingly, the movement of the objective lens 408 may be sped up or slowed down. As a result, the search for the best focus may become faster and more accurate.
[0038] It should be noted at this point that, despite the foregoing specific examples, the autofocusing technique in accordance with embodiments of the present invention may be adapted for a wide variety of microscopes. For example, those skilled in the art may appreciate that the autofocusing technique disclosed herein may be applicable to both wide-field microscopes and confocal microscopes, and the microscopes may operate in either a fluorescence mode or a non-fluorescence mode.
[0039] While the foregoing description includes many details, it is to be understood that these have been included for purposes of explanation only, and are not to be interpreted as limitations of the present invention. It will be apparent to those skilled in the art that other modifications to the embodiments described above can be made without departing from the spirit and scope of the invention. Accordingly, such modifications are considered within the scope of the invention as intended to be encompassed by the following claims and their legal equivalents.
Claims
1. A method for adjusting focus in an automated microscope, the method comprising: providing an optical detector for image acquisition, wherein the optical detector comprises an array of sensor pixels; designating a region of interest in the array of sensor pixels to emulate a confocal aperture; directing a light beam to illuminate an object according to a predefined pattern, thereby forming an image of the illuminated pattern at the optical detector, wherein the image of the illuminated pattern substantially overlaps the designated region of interest; detecting a light intensity from sensor pixels located within the designated region of interest; and adjusting a relative focal position of an objective lens based on the detected light intensity.
2. The method according to claim 1, further comprising: selecting, for image acquisition, the relative focal position that corresponds to a peak in the light intensity detected.
3. The method according to claim 1 , wherein the step of designating the region of interest further comprises: calibrating the emulated confocal aperture such that a sharpest image of the illuminated pattern, formed at the optical detector, is no smaller than the designated region of interest.
4. The method according to claim 1, further comprising: resetting or ignoring sensor pixels that are located outside the designated region of interest.
5. The method according to claim 1, wherein: the automated microscope operates in a line-confocal mode; and the predefined pattern has a shape of a straight line and is centered in a field of view.
6. The method according to claim I5 wherein the optical detector is selected from a group consisting of: a CMOS optical detector; and a CCD camera.
7. The method according to claim 1, wherein, the light beam is dedicated to autofocusing and has a wavelength that is different from a light source employed by the automated microscope for image acquisition.
8. The method according to claim 1, further comprising: identifying one or more interfaces on or near the object by detecting changes in the light intensity while adjusting the relative focal position of the objective lens.
9. An automated microscope comprising: at least one light source that generates a light beam; an optical path and an optical detector for image acquisition, wherein the optical path has an objective lens therein, andLwherein the optical detector comprises an array of sensor pixels; a motion mechanism, capable of moving the objective lens within a focus adjustment range; and a processor module coupled to the optical detector and the motion mechanism; wherein: the processor module designates a region of interest in the array of sensor pixels to emulate a confocal aperture, the optical path directs the light beam to illuminate the object according to a predefined pattern, thereby forming an image of the illuminated pattern at the optical detector, wherein the image of the illuminated pattern substantially overlaps the designated region of interest, and the processor module determines a desired relative focal position of the objective lens by coordinating the movement of the objective lens and detection of light intensity from sensor pixels located within the designated region of interest.
10. The automated microscope according to claim 9, wherein the processor module selects, for imago acquisition, the relative focal position that corresponds to a peak in the light intensity detected.
11. The automated microscope according to claim 9, wherein the processor module calibrates the emulated confocal aperture such that a sharpest image of the illuminated pattern, formed at the optical detector, is no smaller than the designated region of interest.
12. The automated microscope according to claim 9, wherein the processor module resets or ignores sensor pixels that are located outside the designated region of interest.
13. The automated microscope according to claim 9, wherein: the automated microscope operates in a line-confocal mode; and the predefined pattern has a shape of a straight line.
14. The automated microscope according to claim 9, wherein: the automated microscope operates in a point-confocal mode; and the predefined pattern has a point-like shape.
15. The automated microscope according to claim 9, wherein: the automated microscope operates in a wide-field mode; and the predefined pattern has a point-like shape.
16. The automated microscope according to claim 9, wherein the optical detector is selected from a group consisting of: a CMOS optical detector; and a CCD camera.
17. The automated microscope according to claim 9, wherein the light beam is generated by an autofocus light source and has a wavelength that is different from a light source employed by the automated microscope for image acquisition.
18. The automated microscope according to claim 9, wherein the processor module identifies one or more interfaces on or near the object by detecting changes in the light intensity while adjusting the relative focal position of the objective lens.
19. A method for adjusting focus in an automated microscope, the method comprising: providing an optical detector for image acquisition, wherein the optical detector comprises an array of sensor pixels; directing a light beam to illuminate an object according to a line pattern, thereby forming a line-shaped image at the optical detector; • designating a region of interest in the array of sensor pixels, wherein the designated region of interest crosses the line-shaped image; determining; based on detection data collected from sensor pixels located within the designated region of interest, a width of the line-shaped image and a light intensity associated with the line-shaped image; and adjusting a relative focal position of an objective lens based on the width and the light intensity.
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2008548860A JP5015955B2 (en) | 2005-12-30 | 2006-12-28 | Automatic focusing method and system of automatic microscope |
EP06840357A EP1969412B1 (en) | 2005-12-30 | 2006-12-28 | Autofocus method and system for an automated microscope |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/320,676 | 2005-12-30 | ||
US11/320,676 US7297910B2 (en) | 2005-12-30 | 2005-12-30 | System and method for utilizing an autofocus feature in an automated microscope |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2007079397A2 true WO2007079397A2 (en) | 2007-07-12 |
WO2007079397A3 WO2007079397A3 (en) | 2007-11-01 |
Family
ID=38223406
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2006/062691 WO2007079397A2 (en) | 2005-12-30 | 2006-12-28 | Autofocus method and system for an automated microscope |
Country Status (4)
Country | Link |
---|---|
US (2) | US7297910B2 (en) |
EP (1) | EP1969412B1 (en) |
JP (1) | JP5015955B2 (en) |
WO (1) | WO2007079397A2 (en) |
Cited By (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007095387A2 (en) | 2006-02-17 | 2007-08-23 | Dharmacon, Inc. | Compositions and methods for inhibiting gene silencing by rna interference |
RU2515341C2 (en) * | 2012-08-20 | 2014-05-10 | Федеральное государственное бюджетное образовательное учреждение высшего профессионального образования "Московский государственный технический университет радиотехники, электроники и автоматики" | Two-photon scanning microscope with automatic precision image focusing and method for automatic precision image focusing |
US9661212B2 (en) | 2013-04-26 | 2017-05-23 | Hamamatsu Photonics K.K. | Image acquisition device and focusing method for image acquisition device |
US10330910B2 (en) | 2013-04-26 | 2019-06-25 | Hamamatsu Photonics K.K. | Image acquisition device and method and system for acquiring focusing information for specimen |
US10348954B2 (en) | 2013-04-26 | 2019-07-09 | Hamamatsu Photonics K.K. | Image acquisition device and method and system for creating focus map for specimen |
Families Citing this family (41)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
KR20090018711A (en) * | 2006-06-09 | 2009-02-20 | 위구-디바이스 아이엔씨. | Method and apparatus for auto-focussing infinity corrected microscopes |
JP2008052140A (en) * | 2006-08-25 | 2008-03-06 | Olympus Corp | Examination apparatus |
JP5172204B2 (en) * | 2007-05-16 | 2013-03-27 | 大塚電子株式会社 | Optical characteristic measuring apparatus and focus adjustment method |
DE102008018951A1 (en) * | 2008-04-15 | 2009-10-22 | Carl Zeiss Microimaging Gmbh | Microscope with holding focus unit |
JP5306041B2 (en) * | 2008-05-08 | 2013-10-02 | キヤノン株式会社 | Imaging apparatus and method thereof |
JP5739351B2 (en) * | 2009-03-11 | 2015-06-24 | サクラ ファインテック ユー.エス.エー., インコーポレイテッド | Automatic focusing method and automatic focusing device |
US10353190B2 (en) | 2009-12-30 | 2019-07-16 | Koninklijke Philips N.V. | Sensor for microscopy |
DE102017203492A1 (en) * | 2017-03-03 | 2018-09-06 | Witec Wissenschaftliche Instrumente Und Technologie Gmbh | Method and device for imaging a sample surface |
BR112012029152A8 (en) * | 2010-05-18 | 2018-02-06 | Koninklijke Philips Electronics Nv | AUTOFOCUS IMAGE FORMATION SYSTEM FOR A MICROSCOPE, METHOD FOR AUTOFOCUS IMAGE FORMATION OF A MICROSCOPE, COMPUTER READABLE MEDIA AND PROGRAM ELEMENT FOR AUTOFOCUS IMAGE FORMATION OF A MICROSCOPE |
TWI456254B (en) * | 2010-05-19 | 2014-10-11 | Ind Tech Res Inst | Fluorescence micro imaging system |
WO2011161594A1 (en) * | 2010-06-24 | 2011-12-29 | Koninklijke Philips Electronics N.V. | Autofocus based on differential measurements |
DE102010055882A1 (en) * | 2010-12-22 | 2012-06-28 | Carl Zeiss Microlmaging Gmbh | Pinhole for a confocal laser scanning microscope |
CN103649992B (en) | 2011-07-13 | 2017-12-26 | 皇家飞利浦有限公司 | For the method for the focal plane for automatically adjusting digital pathological image |
DE102011084562B4 (en) * | 2011-10-14 | 2018-02-15 | Leica Microsystems Cms Gmbh | Method and device for detecting and correcting spherical aberrations in a microscopic imaging beam path |
WO2013064237A2 (en) * | 2011-10-31 | 2013-05-10 | Torsten Matthias | Automatic structure determination |
JP5932376B2 (en) * | 2012-02-08 | 2016-06-08 | 富士機械製造株式会社 | Image transfer method and image transfer apparatus |
US8687180B2 (en) * | 2012-06-07 | 2014-04-01 | Molecular Devices, Llc | System, method, and device for determining a focal position of an objective in a microscopy imaging system |
US9488819B2 (en) * | 2012-08-31 | 2016-11-08 | Nanotronics Imaging, Inc. | Automatic microscopic focus system and method for analysis of transparent or low contrast specimens |
JP6205140B2 (en) * | 2013-03-01 | 2017-09-27 | オリンパス株式会社 | Scanning laser microscope equipment |
DE102013103971A1 (en) | 2013-04-19 | 2014-11-06 | Sensovation Ag | Method for generating an overall picture of an object composed of several partial images |
EP3019905B1 (en) * | 2013-04-30 | 2020-06-03 | Molecular Devices, LLC | Apparatus and method for generating in-focus images using parallel imaging in a microscopy system |
US10007102B2 (en) | 2013-12-23 | 2018-06-26 | Sakura Finetek U.S.A., Inc. | Microscope with slide clamping assembly |
EP3158385B1 (en) | 2014-06-23 | 2024-04-10 | Revvity Cellular Technologies GmbH | Method for autofocusing a microscope at a correct autofocus position in a sample |
JP6805135B2 (en) * | 2014-10-06 | 2020-12-23 | ライカ マイクロシステムズ (シュヴァイツ) アクチエンゲゼルシャフトLeica Microsystems (Schweiz) AG | microscope |
JP6865680B2 (en) * | 2014-10-06 | 2021-04-28 | ライカ マイクロシステムズ (シュヴァイツ) アクチエンゲゼルシャフトLeica Microsystems (Schweiz) AG | microscope |
US9921399B2 (en) | 2015-03-31 | 2018-03-20 | General Electric Company | System and method for continuous, asynchronous autofocus of optical instruments |
CN104932092B (en) * | 2015-06-15 | 2017-09-08 | 上海交通大学 | Auto-focusing microscope and its focusing method based on eccentric pencil method |
US9772540B2 (en) * | 2015-07-09 | 2017-09-26 | Bio-Tek Instruments, Inc. | Autofocus for imaging system |
DE102015116452A1 (en) | 2015-09-29 | 2017-03-30 | Carl Zeiss Microscopy Gmbh | microscope |
DE102016108226A1 (en) | 2016-05-03 | 2017-11-09 | Carl Zeiss Microscopy Gmbh | microscope |
US11280803B2 (en) | 2016-11-22 | 2022-03-22 | Sakura Finetek U.S.A., Inc. | Slide management system |
CN106707482A (en) * | 2017-02-28 | 2017-05-24 | 浙江大学 | Wide-view-field multi-scale high-resolution microimaging system and method |
EP3418789A1 (en) * | 2017-06-20 | 2018-12-26 | Euroimmun Medizinische Labordiagnostika AG | Method and microscope system for recording an image |
US11265449B2 (en) | 2017-06-20 | 2022-03-01 | Academia Sinica | Microscope-based system and method for image-guided microscopic illumination |
US10989903B2 (en) * | 2018-02-26 | 2021-04-27 | Washington State University | Modular scanning confocal optical profile microscopy with digital imaging processing |
US10247910B1 (en) | 2018-03-14 | 2019-04-02 | Nanotronics Imaging, Inc. | Systems, devices and methods for automatic microscopic focus |
US10146041B1 (en) | 2018-05-01 | 2018-12-04 | Nanotronics Imaging, Inc. | Systems, devices and methods for automatic microscope focus |
EP3614192A1 (en) * | 2018-08-20 | 2020-02-26 | Till GmbH | Microscope device |
CN113874774B (en) * | 2019-04-09 | 2024-09-27 | 卡尔蔡司显微镜有限责任公司 | Optical microscope with reconfigurable sensor array |
US11402331B2 (en) * | 2019-05-08 | 2022-08-02 | City University Of Hong Kong | Imaging and manipulation of biological sample |
WO2020240639A1 (en) * | 2019-05-24 | 2020-12-03 | 株式会社ニコン | Microscope device, method for controlling microscope device, and program for controlling microscope device |
Family Cites Families (22)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DD240611A1 (en) * | 1985-09-02 | 1986-11-05 | Zeiss Jena Veb Carl | METHOD FOR ADJUSTING FOCUSING IN OPTICAL EQUIPMENT |
DE68928217T2 (en) * | 1988-09-09 | 1998-01-29 | Canon Kk | Automatic image stabilization device |
US5774444A (en) * | 1990-05-25 | 1998-06-30 | Hitachi, Ltd. | Split photo detector for detecting a central portion and a peripheral portion of a reflected light beam |
EP0542962B2 (en) * | 1991-06-08 | 2002-03-13 | RENISHAW plc | Confocal spectroscopy |
JPH08327891A (en) * | 1995-06-02 | 1996-12-13 | Olympus Optical Co Ltd | Patterned light projecting device |
JPH09133856A (en) * | 1995-11-07 | 1997-05-20 | Nikon Corp | Automatic focus detecting device for microscope |
JP3579166B2 (en) * | 1996-02-14 | 2004-10-20 | オリンパス株式会社 | Scanning laser microscope |
JPH1164719A (en) * | 1997-08-22 | 1999-03-05 | Nikon Corp | Microscope equipped with focus detection means and displacement measuring device |
JPH11142716A (en) * | 1997-11-04 | 1999-05-28 | Nikon Corp | Focus detector |
US20020050518A1 (en) * | 1997-12-08 | 2002-05-02 | Roustaei Alexander R. | Sensor array |
US6677565B1 (en) * | 1998-08-18 | 2004-01-13 | Veeco Tucson Inc. | High speed autofocus and tilt for an optical imaging system |
US6819639B1 (en) * | 1999-07-15 | 2004-11-16 | Creo Srl | Method and apparatus for multi-channel auto-focus |
US6792203B1 (en) * | 1999-09-01 | 2004-09-14 | Olympus Optical Co., Ltd. | Camera and distance measuring apparatus used in the same |
JP3688185B2 (en) * | 2000-05-08 | 2005-08-24 | 株式会社東京精密 | Focus detection device and autofocus microscope |
JP2002258160A (en) * | 2001-03-05 | 2002-09-11 | Dainippon Printing Co Ltd | Method for positioning focusing point in confocal laser microscope, and method of measuring height of surface of object to be measured |
JP2002287017A (en) * | 2001-03-28 | 2002-10-03 | Fuji Photo Optical Co Ltd | Focusing state detecting device for photographic lens |
DE10127284A1 (en) * | 2001-06-05 | 2002-12-12 | Zeiss Carl Jena Gmbh | Automatic focussing of a microscope using an analysis unit that compares measured values with stored design values and adjusts the microscope accordingly |
JP4179790B2 (en) * | 2002-04-17 | 2008-11-12 | オリンパス株式会社 | Confocal scanning optical microscope |
JP2004191893A (en) * | 2002-12-13 | 2004-07-08 | Canon Inc | Imaging apparatus |
US20040140417A1 (en) * | 2002-12-27 | 2004-07-22 | Accretech (Israel) Ltd. | Image sensor for confocal microscopy |
US7232980B2 (en) * | 2004-05-24 | 2007-06-19 | Hamamatsu Photonics K.K. | Microscope system |
JP4551708B2 (en) * | 2004-07-21 | 2010-09-29 | キヤノン株式会社 | Imaging device |
-
2005
- 2005-12-30 US US11/320,676 patent/US7297910B2/en active Active
-
2006
- 2006-12-28 EP EP06840357A patent/EP1969412B1/en not_active Not-in-force
- 2006-12-28 WO PCT/US2006/062691 patent/WO2007079397A2/en active Application Filing
- 2006-12-28 JP JP2008548860A patent/JP5015955B2/en not_active Expired - Fee Related
-
2007
- 2007-10-31 US US11/930,206 patent/US7473877B2/en active Active
Non-Patent Citations (1)
Title |
---|
See references of EP1969412A4 * |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2007095387A2 (en) | 2006-02-17 | 2007-08-23 | Dharmacon, Inc. | Compositions and methods for inhibiting gene silencing by rna interference |
RU2515341C2 (en) * | 2012-08-20 | 2014-05-10 | Федеральное государственное бюджетное образовательное учреждение высшего профессионального образования "Московский государственный технический университет радиотехники, электроники и автоматики" | Two-photon scanning microscope with automatic precision image focusing and method for automatic precision image focusing |
US9661212B2 (en) | 2013-04-26 | 2017-05-23 | Hamamatsu Photonics K.K. | Image acquisition device and focusing method for image acquisition device |
US10330910B2 (en) | 2013-04-26 | 2019-06-25 | Hamamatsu Photonics K.K. | Image acquisition device and method and system for acquiring focusing information for specimen |
US10348954B2 (en) | 2013-04-26 | 2019-07-09 | Hamamatsu Photonics K.K. | Image acquisition device and method and system for creating focus map for specimen |
US10598916B2 (en) | 2013-04-26 | 2020-03-24 | Hamamatsu Photonics K.K. | Image acquisition device and method and system for acquiring focusing information for specimen |
Also Published As
Publication number | Publication date |
---|---|
US20080054156A1 (en) | 2008-03-06 |
EP1969412B1 (en) | 2013-03-06 |
EP1969412A4 (en) | 2010-11-10 |
EP1969412A2 (en) | 2008-09-17 |
US20070152130A1 (en) | 2007-07-05 |
JP2009522604A (en) | 2009-06-11 |
WO2007079397A3 (en) | 2007-11-01 |
US7473877B2 (en) | 2009-01-06 |
JP5015955B2 (en) | 2012-09-05 |
US7297910B2 (en) | 2007-11-20 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1969412B1 (en) | Autofocus method and system for an automated microscope | |
US11624901B2 (en) | Self-calibrating and directional focusing systems and methods for infinity corrected microscopes | |
US10477097B2 (en) | Single-frame autofocusing using multi-LED illumination | |
US8179432B2 (en) | Predictive autofocusing | |
US7576307B2 (en) | Microscope with dual image sensors for rapid autofocusing | |
US5604344A (en) | Autofocussing microscope having a pattern imaging system | |
US8878923B2 (en) | System and method for enhanced predictive autofocusing | |
US10838184B2 (en) | Artefact reduction for angularly-selective illumination | |
EP2572226A1 (en) | Autofocus imaging | |
CA3061440C (en) | Optical scanning arrangement and method | |
JPH11211439A (en) | Surface form measuring device | |
JP5053691B2 (en) | Specimen scanner device and specimen position detection method using the device | |
WO2016132451A1 (en) | Microscope | |
CN110945398A (en) | Digitally determining the position of the focus | |
JP2004102032A (en) | Scanning type confocal microscope system | |
JP2023078801A (en) | Microscope system and microscope control device | |
KR20040108144A (en) | Microscope autofocusing system using slit beam |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2008548860 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2006840357 Country of ref document: EP |