US20090052795A1 - System and method for auto-focusing an image - Google Patents
System and method for auto-focusing an image Download PDFInfo
- Publication number
- US20090052795A1 US20090052795A1 US12/207,272 US20727208A US2009052795A1 US 20090052795 A1 US20090052795 A1 US 20090052795A1 US 20727208 A US20727208 A US 20727208A US 2009052795 A1 US2009052795 A1 US 2009052795A1
- Authority
- US
- United States
- Prior art keywords
- image
- sub
- pixel
- fractal
- focus
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
- 238000000034 method Methods 0.000 title abstract description 18
- 238000004590 computer program Methods 0.000 claims description 4
- 239000000523 sample Substances 0.000 description 14
- 230000003287 optical effect Effects 0.000 description 7
- 238000010586 diagram Methods 0.000 description 5
- 239000011159 matrix material Substances 0.000 description 5
- 230000010339 dilation Effects 0.000 description 4
- 230000003628 erosive effect Effects 0.000 description 4
- 238000000399 optical microscopy Methods 0.000 description 4
- 238000012545 processing Methods 0.000 description 4
- 230000007423 decrease Effects 0.000 description 3
- 238000011156 evaluation Methods 0.000 description 3
- 238000001228 spectrum Methods 0.000 description 3
- 238000013461 design Methods 0.000 description 2
- 238000000386 microscopy Methods 0.000 description 2
- 239000012472 biological sample Substances 0.000 description 1
- 238000004364 calculation method Methods 0.000 description 1
- 230000003247 decreasing effect Effects 0.000 description 1
- 238000005286 illumination Methods 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 230000000135 prohibitive effect Effects 0.000 description 1
- 239000004065 semiconductor Substances 0.000 description 1
- 238000012360 testing method Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/70—Denoising; Smoothing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T5/00—Image enhancement or restoration
- G06T5/20—Image enhancement or restoration using local operators
- G06T5/30—Erosion or dilatation, e.g. thinning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
Definitions
- the present invention relates to digital imaging. More specifically, the invention relates to systems and methods for automated focusing of an image.
- FIG. 1 is a schematic of an automated scanning optical microscopy system.
- the automated scanning optical microscopy system 100 includes an optical microscope modified to automatically capture and save images of a sample 105 placed on a sample holder 107 such as, for example, a slide, which in turn is supported by a stage 110 .
- the optical components include an illumination source 120 , objective lens 124 , and camera 128 .
- Housing 130 supports the optical components. The design and selection of the optical components and housing are known to one of skill in the optical art and do not require further description.
- the automated system 100 includes a controller that enables the stage 110 supporting the slide 107 to place a portion of the sample 105 in the focal plane of the objective lens.
- the camera 128 captures an image of the sample and sends the image signal to an image processor for further processing and/or storage.
- the image processor and controller are both housed in a single PC 104 although other variations may be used.
- the mechanical design of the stage 110 is known to one of skill in the mechanical arts and does not require further description.
- the controller may also control a sample handling subsystem 160 that automatically transfers a slide 109 between the stage 110 and a storage unit 162 .
- the controller must also be capable of positioning the sample such that the image produced by the camera 128 is in focus. In addition, the controller must be able to position the sample very rapidly in order to reduce the time required to capture an image.
- One method of auto-focusing an image employs a laser range finder.
- the controller calculates the distance to a surface based on the signal from the laser range finder.
- the advantage of such a system is that it is very fast, thereby increasing the scan rate of the automated system.
- the disadvantage of such a system is that it requires additional hardware that may interfere with the optical performance of the automated system.
- a second disadvantage of such a system is the inability to focus directly on the feature of interest in the sample.
- the signal from the laser range finder is usually based on the highest reflective surface encountered by the laser beam. This surface is usually the cover slip or the slide and not the sample.
- Another method of auto-focusing an image employs image processing to determine when the image is in focus or, alternatively, select the most focused image from a set of images taken at different sample-objective lens distances.
- image processing to auto-focus is that it can focus directly on the sample instead of the slide or cover slip.
- image processing auto-focus is that it usually requires large computational resources that may. limit the scan rate of the automated system. The large computational requirement arises because prior art algorithms based on maximizing the high frequency power spectrum of the image or on detecting and maximizing edges must perform large numbers of computations.
- One embodiment of the present invention provides a method for automatically focusing an object comprising: acquiring at least one image of the object, the image characterized by a focal distance and comprising at least one pixel; determining a fractal pixel count of pixels having a fractal dimension within a predetermined range; and selecting an optimal focal distance from the image having the largest fractal pixel count.
- Another embodiment of the present invention provides an apparatus for automatically focusing an object comprising: an image capture sensor for capturing an image of the object, the captured image characterized by a focal distance; a fractal estimator coupled to the image capture sensor, the fractal estimator adapted to estimate a fractal dimension of at least one pixel of the captured image; and a focus controller coupled to the fractal estimator, the focus controller adapted to adjust the focal distance of the object based on maximizing the number of pixels having an estimated fractal dimension within a predetermined range.
- Another embodiment of the present invention provides an apparatus for automatically focusing an object comprising: an image capture sensor for capturing an image of the object, the captured image characterized by a focal distance; means for determining a fractal pixel count of the captured image; and means for controlling the focal distance based upon maximizing the fractal pixel count of the captured image.
- Another embodiment of the present invention is directed to a computer program product for use with an automated microscopy system, the computer program product comprising: a computer usable medium having computer readable program code means embodied in the computer usable medium for causing the automated microscopy system to automatically focus an object, the computer program product having: computer readable code means for causing a computer to acquire an image of the object at a focal distance; computer readable code means for causing the computer to determine a fractal pixel count of the acquired image; and computer readable code means for causing the computer to adjust the focal distance of the object based upon maximizing the fractal pixel count of the acquired image.
- FIG. 1 is a schematic diagram of a prior art automated scanning optical microscopy system
- FIG. 2 is a flowchart of an embodiment of the present invention
- FIG. 3 is a flowchart illustrating the generation of a boundary image in an embodiment of the present invention
- FIG. 5 is a graph of C.sub.D VS.-S produced by the embodiment shown in FIG. 2 .
- An underlying idea supporting current auto-focusing algorithms is that an image in focus will exhibit the largest pixel-to-pixel variations (the difference of pixel values between adjacent pixels) whereas an out-of-focus image will blur, or reduce, the pixel-to-pixel variations in the image.
- Autocorrelation or power spectrum algorithms are designed to measure and/or maximize the high frequency (variations occurring over a small number of pixels) component of an image.
- Autocorrelation is a computationally intensive process that is prohibitive when considered for high scanning rate automated optical microscopy.
- Maximum gradient methods avoid performing an autocorrelation by detecting edges and maximizing the variation across the edge.
- the maximum gradient method calculates the differences between adjacent pixels along a pre-selected direction and several directions may be used to find and maximize the pixel gradient across edges.
- the ability of the maximum gradient method to find the correct focus decreases as the contrast and/or brightness of the image decreases because decreasing contrast or brightness also decreases the differences between pixels.
- the inventor has surprisingly discovered a method for auto-focusing that requires neither a direct calculation of the pixel-to-pixel variations of the maximum gradient method nor the computationally intensive autocorrelation of the power spectrum methods. Instead, the present invention analyzes each image at different scale lengths to calculate a fractal dimension for each pixel in the image. Furthermore, the fractal dimension is estimated using the pixel values of the neighborhood pixels instead of a count of the neighborhood pixels. The fractal dimension is then used to determine if the image is a focused image.
- FIG. 2 is a flow diagram of one embodiment of the present invention.
- An image I.sub. 0 , is read in step 205 .
- the image may be read directly from a camera or may be read from memory.
- the controller captures several images of the sample at various sample-objective lens distances and stores each captured image in an appropriate memory device such as a hard drive, an optical drive, or semiconductor memory.
- an appropriate memory device such as a hard drive, an optical drive, or semiconductor memory.
- the process shown in FIG. 2 is completed and only images meeting criteria described below are saved to a memory device.
- a first boundary image, I.sub.B 1 is generated from 10 and stored.
- a second boundary image, I.sub.B 2 is generated from I.sub. 0 and stored in step 215 .
- FIG. 3 is a flow diagram illustrating the generation of each boundary image, I.sub.B.
- An erosion image, E.sub.L is generated from the captured image, I.sup. 0 , and stored in step 310 .
- a dilation image, D.sup.L is generated from 10 and stored in step 320 .
- the superscript, L, in E.sup.L and D.sup.L both refer to the size, or scale, of the structuring element used to perform the erosion or dilation, respectively.
- the structuring element may be represented by an L.times.L matrix comprised of ones and zeros.
- the structuring element is characterized by an origin pixel and a neighborhood.
- the neighborhood comprises all the matrix elements that are set to one and is contained within the L.times.L matrix.
- An image is generated by calculating a pixel value for the pixel at the origin of the structuring element based on the pixel values of the pixels in the neighborhood of the structuring element. In the case of erosion, the pixel value of the origin pixel is set to the minimum of the pixel values in the neighborhood. Dilation, in contrast, sets the pixel value to the maximum of the pixel values in the neighborhood.
- the neighborhood is coextensive with the structuring element where the L.times.L matrix comprised.
- the neighborhood is less than the structuring element in that the L.times.L matrix includes at least one zero.
- step 215 generates a second boundary image, I.sub.B 2 , at a different scale, L.sub. 2 , using a different size structuring element than the structuring element used to generate I.sub.B 1 .
- the selection of the scale for both boundary images may depend on the feature size of the object of interest, the computational limitations of the processor, and other such factors as is apparent to one of skill in the art.
- L.sub. 1 and L.sub. 2 are selected to maximize the difference between L.sub. 1 and L.sub. 2 under constraints such as those identified above.
- L.sub. 1 may be chosen from the group consisting of greater than 2, 3, 4, 5, and-greater than 5.
- the fractal dimension, d.sub.p, for each pixel in I.sub. 0 is estimated from the boundary images I.sub.B 1 and I.sub.B 2 in step 220 .
- the fractal dimension for each pixel may be estimated by the equation (1):
- N.sub. 2 represents the sum of the pixel values in the neighborhood of the structuring element centered on the pixel in I.sub.B 2 and N.sub. 1 represents the sum of the pixel values in the neighborhood of the structuring. element centered on the pixel in I.sub.B 1 .
- the fractal map is generated directly from I.sub. 0 .
- the fractal dimension for a pixel is estimated by centering an L.sub. 1 .times.L.sub. 1 structuring element on the pixel and summing the pixel values of the pixels within the structuring element to form a first sum, N.sub. 1 .
- a second structuring element of size L.sub. 2 .times.L.sub. 2 , where L.sub. 2 >L.sub. 1 is centered. on the pixel and a second sum, N.sub. 2 , of the pixel values of the pixels within the second structuring element is calculated.
- the fractal dimension of the pixel is estimated using the equation
- N.sub. 2 is the sum of the pixel values in the L.sub. 2 .times.L.sub. 2 structuring element
- N.sub. 1 is the sum of the pixel values in the L.sub. 1 .times.L.sub. 1 structuring element
- L.sub. 2 and L.sub. 1 are the sizes (in pixels) of the respective structuring elements.
- Equation (1) clearly shows that the fractal dimension is estimated by taking ratios of pixel values and therefore should provide a more robust method than maximum gradient methods of identifying out-of-focus images in low light or low contrast conditions. Furthermore, it is believed that the use of sums in N.sub. 1 and N.sub. 2 reduces the statistical variations that may be expected in low light conditions.
- the inventor has discovered that images containing many pixels having a fractal dimension within a range of values tend to be more in-focus than images containing few pixels having fractal dimensions within the range.
- the predetermined range of fractal dimensions may be determined by one of skill in the art by visually examining a group of images and selecting the range such that at least one image but not all the images are considered to be nearly in-focus. Setting the range narrowly may exclude all the images whereas setting the range broadly reduces the effectiveness of this test.
- the predetermined range is between 1 and 2.
- the predetermined range is chosen from a group consisting of 1-1.25, 1.25-1.5, 1.5-1.75, 1.75-2, 1.5-2, and 1.6-2.
- the predetermined range is determined by an operator before auto-focusing operations. In an alternate embodiment, the predetermined range may be set to a default range and dynamically adjusted during auto-focusing operations to produce at least one in-focus image.
- a fractal pixel is a pixel having a fractal dimension within the predetermined range.
- the fractal pixel count, C.sub.d is the number of fractal pixels in the image.
- step 235 checks for additional images. If there are additional images, control jumps back to step 205 to repeat the process for the additional image. If there are no more additional images, the focus image is determined in step 240 by selecting the image having the largest C.sub.d from the set of images.
- FIG. 5 is a graph illustrating the selection of the in-focus image from a set of images taken at different focal distances.
- 9 slices, or images taken at progressively larger focal distances are numbered from 1 to 9 on the horizontal axis.
- the fractal pixel count for each slice is shown on the ordinate axis.
- slice 5 contains the highest number of fractal. pixels of the 9 slices and is selected as the in-focus image.
- the slice 5 image 501 is shown in FIG. 5 , along with the slice 3 image 505 , which is an out-of-focus image.
- a fractal dimension map 502 shows the estimated fractal dimension for each pixel in the slice 5 image.
- Fractal pixel images 503 506 show the fractal pixels in the slice 5 and slice 3 images, respectively.
Landscapes
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Image Processing (AREA)
- Automatic Focus Adjustment (AREA)
- Focusing (AREA)
Abstract
A method and system for auto-focusing is disclosed where the number of the fractal pixels having a fractal dimension within a predetermined range is determined. The focused image is determined by adjusting the image to maximize the fractal pixel count. Alternatively, the focused image may be selected from a set of images, the image having the largest fractal pixel count selected as the focused image.
Description
- This application is a continuation of U.S. patent application Ser. No. 10/958,512, filed on Oct. 5, 2004, which is a continuation of U.S. patent application Ser. No. 10/368,055, filed on Feb. 14, 2003, which disclosures are incorporated herein by reference in their entirety.
- The present invention relates to digital imaging. More specifically, the invention relates to systems and methods for automated focusing of an image.
- It is well known that manual evaluation of biological samples is both slow and highly susceptible to error. It is also well known that automating the sample evaluation both increases the sample evaluation rate and reduces error.
-
FIG. 1 is a schematic of an automated scanning optical microscopy system. The automated scanningoptical microscopy system 100 includes an optical microscope modified to automatically capture and save images of asample 105 placed on asample holder 107 such as, for example, a slide, which in turn is supported by astage 110. The optical components include anillumination source 120,objective lens 124, andcamera 128.Housing 130 supports the optical components. The design and selection of the optical components and housing are known to one of skill in the optical art and do not require further description. - The
automated system 100 includes a controller that enables thestage 110 supporting theslide 107 to place a portion of thesample 105 in the focal plane of the objective lens. Thecamera 128 captures an image of the sample and sends the image signal to an image processor for further processing and/or storage. In the example, shown inFIG. 1 , the image processor and controller are both housed in a single PC 104 although other variations may be used. The mechanical design of thestage 110 is known to one of skill in the mechanical arts and does not require further description. - The controller may also control a
sample handling subsystem 160 that automatically transfers a slide 109 between thestage 110 and astorage unit 162. - The controller must also be capable of positioning the sample such that the image produced by the
camera 128 is in focus. In addition, the controller must be able to position the sample very rapidly in order to reduce the time required to capture an image. - One method of auto-focusing an image employs a laser range finder. The controller calculates the distance to a surface based on the signal from the laser range finder. The advantage of such a system is that it is very fast, thereby increasing the scan rate of the automated system. The disadvantage of such a system is that it requires additional hardware that may interfere with the optical performance of the automated system. A second disadvantage of such a system is the inability to focus directly on the feature of interest in the sample. The signal from the laser range finder is usually based on the highest reflective surface encountered by the laser beam. This surface is usually the cover slip or the slide and not the sample.
- Another method of auto-focusing an image employs image processing to determine when the image is in focus or, alternatively, select the most focused image from a set of images taken at different sample-objective lens distances. The advantage of using image processing to auto-focus is that it can focus directly on the sample instead of the slide or cover slip. The disadvantage of image processing auto-focus is that it usually requires large computational resources that may. limit the scan rate of the automated system. The large computational requirement arises because prior art algorithms based on maximizing the high frequency power spectrum of the image or on detecting and maximizing edges must perform large numbers of computations.
- Therefore, there remains a need for a rapid auto-focusing method that does not require large computational resources and can directly focus the sample.
- One embodiment of the present invention provides a method for automatically focusing an object comprising: acquiring at least one image of the object, the image characterized by a focal distance and comprising at least one pixel; determining a fractal pixel count of pixels having a fractal dimension within a predetermined range; and selecting an optimal focal distance from the image having the largest fractal pixel count.
- Another embodiment of the present invention provides an apparatus for automatically focusing an object comprising: an image capture sensor for capturing an image of the object, the captured image characterized by a focal distance; a fractal estimator coupled to the image capture sensor, the fractal estimator adapted to estimate a fractal dimension of at least one pixel of the captured image; and a focus controller coupled to the fractal estimator, the focus controller adapted to adjust the focal distance of the object based on maximizing the number of pixels having an estimated fractal dimension within a predetermined range.
- Another embodiment of the present invention provides an apparatus for automatically focusing an object comprising: an image capture sensor for capturing an image of the object, the captured image characterized by a focal distance; means for determining a fractal pixel count of the captured image; and means for controlling the focal distance based upon maximizing the fractal pixel count of the captured image.
- Another embodiment of the present invention is directed to a computer program product for use with an automated microscopy system, the computer program product comprising: a computer usable medium having computer readable program code means embodied in the computer usable medium for causing the automated microscopy system to automatically focus an object, the computer program product having: computer readable code means for causing a computer to acquire an image of the object at a focal distance; computer readable code means for causing the computer to determine a fractal pixel count of the acquired image; and computer readable code means for causing the computer to adjust the focal distance of the object based upon maximizing the fractal pixel count of the acquired image.
- The invention will be described by reference to the preferred and alternative embodiments thereof in conjunction with the drawings in which:
-
FIG. 1 is a schematic diagram of a prior art automated scanning optical microscopy system; -
FIG. 2 is a flowchart of an embodiment of the present invention; -
FIG. 3 is a flowchart illustrating the generation of a boundary image in an embodiment of the present invention; -
FIG. 4 a is a diagram illustrating an L=3 structuring element used in one embodiment of the present invention; -
FIG. 4 b is a diagram illustrating an L=3 structuring element used in another embodiment of the present invention; -
FIG. 5 is a graph of C.sub.D VS.-S produced by the embodiment shown inFIG. 2 . - An underlying idea supporting current auto-focusing algorithms is that an image in focus will exhibit the largest pixel-to-pixel variations (the difference of pixel values between adjacent pixels) whereas an out-of-focus image will blur, or reduce, the pixel-to-pixel variations in the image. Autocorrelation or power spectrum algorithms are designed to measure and/or maximize the high frequency (variations occurring over a small number of pixels) component of an image. Autocorrelation, however, is a computationally intensive process that is prohibitive when considered for high scanning rate automated optical microscopy.
- Maximum gradient methods avoid performing an autocorrelation by detecting edges and maximizing the variation across the edge. The maximum gradient method calculates the differences between adjacent pixels along a pre-selected direction and several directions may be used to find and maximize the pixel gradient across edges. The ability of the maximum gradient method to find the correct focus decreases as the contrast and/or brightness of the image decreases because decreasing contrast or brightness also decreases the differences between pixels.
- The inventor has surprisingly discovered a method for auto-focusing that requires neither a direct calculation of the pixel-to-pixel variations of the maximum gradient method nor the computationally intensive autocorrelation of the power spectrum methods. Instead, the present invention analyzes each image at different scale lengths to calculate a fractal dimension for each pixel in the image. Furthermore, the fractal dimension is estimated using the pixel values of the neighborhood pixels instead of a count of the neighborhood pixels. The fractal dimension is then used to determine if the image is a focused image.
-
FIG. 2 is a flow diagram of one embodiment of the present invention. An image, I.sub.0, is read instep 205. The image may be read directly from a camera or may be read from memory. In one embodiment, the controller captures several images of the sample at various sample-objective lens distances and stores each captured image in an appropriate memory device such as a hard drive, an optical drive, or semiconductor memory. In an alternative embodiment, after each image is captured, the process shown inFIG. 2 is completed and only images meeting criteria described below are saved to a memory device. - In
step 210, a first boundary image, I.sub.B1, is generated from 10 and stored. A second boundary image, I.sub.B2, is generated from I.sub.0 and stored instep 215. -
FIG. 3 is a flow diagram illustrating the generation of each boundary image, I.sub.B. An erosion image, E.sub.L, is generated from the captured image, I.sup.0, and stored instep 310. A dilation image, D.sup.L, is generated from 10 and stored instep 320. Instep 330, the boundary image, I.sub.B, is generated by subtracting the erosion image from the dilation image, i.e., I.sub.B=D.sup.L-E.sup.L. The superscript, L, in E.sup.L and D.sup.L both refer to the size, or scale, of the structuring element used to perform the erosion or dilation, respectively. - The structuring element may be represented by an L.times.L matrix comprised of ones and zeros. The structuring element is characterized by an origin pixel and a neighborhood. The neighborhood comprises all the matrix elements that are set to one and is contained within the L.times.L matrix. An image is generated by calculating a pixel value for the pixel at the origin of the structuring element based on the pixel values of the pixels in the neighborhood of the structuring element. In the case of erosion, the pixel value of the origin pixel is set to the minimum of the pixel values in the neighborhood. Dilation, in contrast, sets the pixel value to the maximum of the pixel values in the neighborhood. In one embodiment, the neighborhood is coextensive with the structuring element where the L.times.L matrix comprised. of all ones, as shown in
FIG. 4 a for an L=3 structuring element. In another embodiment, the neighborhood is less than the structuring element in that the L.times.L matrix includes at least one zero. In another embodiment, the neighborhood is a “cross” or “plus” centered on the origin of the structuring element, as shown inFIG. 4 b for an L=3 structuring element. - Referring to
FIG. 2 ,step 215 generates a second boundary image, I.sub.B2, at a different scale, L.sub.2, using a different size structuring element than the structuring element used to generate I.sub.B1. The selection of the scale for both boundary images may depend on the feature size of the object of interest, the computational limitations of the processor, and other such factors as is apparent to one of skill in the art. In one embodiment, L.sub.1 and L.sub.2 are selected to maximize the difference between L.sub.1 and L.sub.2 under constraints such as those identified above. In one embodiment, L.sub.1 may be chosen from the group consisting of greater than 2, 3, 4, 5, and-greater than 5. In a preferred embodiment, the scale of I.sub.B1 is set to L.sub.1=3 because L=3 represents the minimum, non-trivial balanced (in the sense that the origin is centered in .the structuring element) structuring element. L.sub.2 is selected such that L.sub.2 is greater than L.sub.1, or, stated differently, the ratio, R=L.sub.2/L.sub.1>1. In one embodiment, R is in the range selected from a group consisting of 1-4, 4-8, 8-16, and greater than 16. In a preferred embodiment, R=7. - The fractal dimension, d.sub.p, for each pixel in I.sub.0 is estimated from the boundary images I.sub.B1 and I.sub.B2 in
step 220. The fractal dimension for each pixel may be estimated by the equation (1): -
1dp=log(N2N1)log(L2L1) (1) - where N.sub.2 represents the sum of the pixel values in the neighborhood of the structuring element centered on the pixel in I.sub.B2 and N.sub.1 represents the sum of the pixel values in the neighborhood of the structuring. element centered on the pixel in I.sub.B1.
- In an alternative embodiment, the fractal map is generated directly from I.sub.0. The fractal dimension for a pixel is estimated by centering an L.sub.1.times.L.sub.1 structuring element on the pixel and summing the pixel values of the pixels within the structuring element to form a first sum, N.sub.1. A second structuring element of size L.sub.2.times.L.sub.2, where L.sub.2>L.sub.1, is centered. on the pixel and a second sum, N.sub.2, of the pixel values of the pixels within the second structuring element is calculated. The fractal dimension of the pixel is estimated using the equation
-
2dp=log(N2/N1)log(L2/L1) (2) - where d.sub.p is the fractal dimension of the pixel in I.sub.0, N.sub.2 is the sum of the pixel values in the L.sub.2.times.L.sub.2 structuring element, N.sub.1 is the sum of the pixel values in the L.sub.1.times.L.sub.1 structuring element, and L.sub.2 and L.sub.1, are the sizes (in pixels) of the respective structuring elements.
- The form of equation (1) clearly shows that the fractal dimension is estimated by taking ratios of pixel values and therefore should provide a more robust method than maximum gradient methods of identifying out-of-focus images in low light or low contrast conditions. Furthermore, it is believed that the use of sums in N.sub.1 and N.sub.2 reduces the statistical variations that may be expected in low light conditions.
- The inventor has discovered that images containing many pixels having a fractal dimension within a range of values tend to be more in-focus than images containing few pixels having fractal dimensions within the range.
- The predetermined range of fractal dimensions may be determined by one of skill in the art by visually examining a group of images and selecting the range such that at least one image but not all the images are considered to be nearly in-focus. Setting the range narrowly may exclude all the images whereas setting the range broadly reduces the effectiveness of this test. In one embodiment, the predetermined range is between 1 and 2. In a preferred embodiment, the predetermined range is chosen from a group consisting of 1-1.25, 1.25-1.5, 1.5-1.75, 1.75-2, 1.5-2, and 1.6-2.
- In one embodiment, the predetermined range is determined by an operator before auto-focusing operations. In an alternate embodiment, the predetermined range may be set to a default range and dynamically adjusted during auto-focusing operations to produce at least one in-focus image.
- After d.sub.p is estimated for each pixel in I.sub.0, a count of the fractal pixels in the image is performed in
step 230. A fractal pixel is a pixel having a fractal dimension within the predetermined range. The fractal pixel count, C.sub.d, is the number of fractal pixels in the image. - After C.sub.d is determined for the captured image, step 235 checks for additional images. If there are additional images, control jumps back to step 205 to repeat the process for the additional image. If there are no more additional images, the focus image is determined in
step 240 by selecting the image having the largest C.sub.d from the set of images. -
FIG. 5 is a graph illustrating the selection of the in-focus image from a set of images taken at different focal distances. In the example shown inFIG. 5 , 9 slices, or images taken at progressively larger focal distances are numbered from 1 to 9 on the horizontal axis. The fractal pixel count for each slice is shown on the ordinate axis. In thisexample slice 5 contains the highest number of fractal. pixels of the 9 slices and is selected as the in-focus image. Theslice 5image 501 is shown inFIG. 5 , along with theslice 3image 505, which is an out-of-focus image. Afractal dimension map 502 shows the estimated fractal dimension for each pixel in theslice 5 image.Fractal pixel images 503 506 show the fractal pixels in theslice 5 andslice 3 images, respectively. - Having described at least illustrative embodiments of the invention, various modifications and improvements will readily occur to those skilled in the art and are intended to be within the scope of the invention. Accordingly, the foregoing description is by way of example only and is not intended as limiting. The invention is limited only as defined in the following claims and the equivalents thereto.
Claims (1)
1. A computer program embodied in a computer readable medium for automatically selecting an in-focus image of an object, comprising:
obtaining a set of image slices of an object at different focal distances;
determining a fractal pixel count of each image slice; and
selecting the image slice of the object displaying the highest pixel count as the in-focus image of the object.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US12/207,272 US20090052795A1 (en) | 2003-02-14 | 2008-09-09 | System and method for auto-focusing an image |
Applications Claiming Priority (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/368,055 US6876776B2 (en) | 2003-02-14 | 2003-02-14 | System and method for auto-focusing an image |
US10/958,512 US7424165B2 (en) | 2003-02-14 | 2004-10-05 | System and method for auto-focusing an image |
US12/207,272 US20090052795A1 (en) | 2003-02-14 | 2008-09-09 | System and method for auto-focusing an image |
Related Parent Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/958,512 Continuation US7424165B2 (en) | 2003-02-14 | 2004-10-05 | System and method for auto-focusing an image |
Publications (1)
Publication Number | Publication Date |
---|---|
US20090052795A1 true US20090052795A1 (en) | 2009-02-26 |
Family
ID=32850081
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/368,055 Expired - Fee Related US6876776B2 (en) | 2003-02-14 | 2003-02-14 | System and method for auto-focusing an image |
US10/958,512 Expired - Fee Related US7424165B2 (en) | 2003-02-14 | 2004-10-05 | System and method for auto-focusing an image |
US12/207,272 Abandoned US20090052795A1 (en) | 2003-02-14 | 2008-09-09 | System and method for auto-focusing an image |
Family Applications Before (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/368,055 Expired - Fee Related US6876776B2 (en) | 2003-02-14 | 2003-02-14 | System and method for auto-focusing an image |
US10/958,512 Expired - Fee Related US7424165B2 (en) | 2003-02-14 | 2004-10-05 | System and method for auto-focusing an image |
Country Status (2)
Country | Link |
---|---|
US (3) | US6876776B2 (en) |
WO (1) | WO2004074882A2 (en) |
Cited By (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120120276A1 (en) * | 2009-07-24 | 2012-05-17 | Seoyoung Kim | Image pickup apparatus having auto focusing function using fractal dimension and an auto focusing method |
Families Citing this family (25)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7668362B2 (en) | 2000-05-03 | 2010-02-23 | Aperio Technologies, Inc. | System and method for assessing virtual slide image quality |
US6876776B2 (en) * | 2003-02-14 | 2005-04-05 | Ikonicys, Inc. | System and method for auto-focusing an image |
US7463761B2 (en) * | 2004-05-27 | 2008-12-09 | Aperio Technologies, Inc. | Systems and methods for creating and viewing three dimensional virtual slides |
US7347371B2 (en) * | 2004-07-30 | 2008-03-25 | Symbol Technologies, Inc. | Aiming pattern for imaging-based bar code readers |
US7333652B2 (en) * | 2004-08-03 | 2008-02-19 | Sony Corporation | System and method for efficiently performing a depth map recovery procedure |
US7822000B2 (en) * | 2005-06-30 | 2010-10-26 | Symbol Technologies, Inc. | Time division multiplexing for access ports in a wireless network |
US8164622B2 (en) | 2005-07-01 | 2012-04-24 | Aperio Technologies, Inc. | System and method for single optical axis multi-detector microscope slide scanner |
US7929801B2 (en) * | 2005-08-15 | 2011-04-19 | Sony Corporation | Depth information for auto focus using two pictures and two-dimensional Gaussian scale space theory |
US20070164115A1 (en) * | 2006-01-17 | 2007-07-19 | Symboltechnologies, Inc. | Automatic exposure system for imaging-based bar code reader |
US20070189750A1 (en) * | 2006-02-16 | 2007-08-16 | Sony Corporation | Method of and apparatus for simultaneously capturing and generating multiple blurred images |
US7616254B2 (en) | 2006-03-16 | 2009-11-10 | Sony Corporation | Simple method for calculating camera defocus from an image scene |
US7711201B2 (en) * | 2006-06-22 | 2010-05-04 | Sony Corporation | Method of and apparatus for generating a depth map utilized in autofocusing |
US8077964B2 (en) * | 2007-03-19 | 2011-12-13 | Sony Corporation | Two dimensional/three dimensional digital information acquisition and display device |
US8003314B2 (en) | 2007-04-16 | 2011-08-23 | Diagnostic Hybrids, Inc. | Methods for direct fluorescent antibody virus detection in liquids |
US8059336B2 (en) | 2007-05-04 | 2011-11-15 | Aperio Technologies, Inc. | Rapid microscope scanner for volume image acquisition |
US8277867B2 (en) * | 2007-09-14 | 2012-10-02 | Boston Scientific Scimed, Inc. | Microdrop ablumenal coating system and method |
US20090205675A1 (en) * | 2008-02-18 | 2009-08-20 | Diptabhas Sarkar | Methods and Systems for Using a Laser to Clean Hydrocarbon Transfer Conduits |
US8280194B2 (en) * | 2008-04-29 | 2012-10-02 | Sony Corporation | Reduced hardware implementation for a two-picture depth map algorithm |
US8194995B2 (en) * | 2008-09-30 | 2012-06-05 | Sony Corporation | Fast camera auto-focus |
US8553093B2 (en) * | 2008-09-30 | 2013-10-08 | Sony Corporation | Method and apparatus for super-resolution imaging using digital imaging devices |
US8083148B2 (en) | 2008-12-16 | 2011-12-27 | Hand Held Products, Inc. | Indicia reading terminal including frame processing |
DE102011075809A1 (en) * | 2011-05-13 | 2012-11-15 | Carl Zeiss Microimaging Gmbh | Method and device for defining a z-range in a sample, in which a z-stack of the sample is to be picked up by means of a microscope |
JP5777650B2 (en) * | 2013-01-29 | 2015-09-09 | 富士フイルム株式会社 | Ultrasonic diagnostic apparatus and ultrasonic image generation method |
US11800056B2 (en) | 2021-02-11 | 2023-10-24 | Logitech Europe S.A. | Smart webcam system |
US11800048B2 (en) | 2021-02-24 | 2023-10-24 | Logitech Europe S.A. | Image generating system with background replacement or modification capabilities |
Citations (13)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5040228A (en) * | 1989-08-28 | 1991-08-13 | At&T Bell Laboratories | Method and apparatus for automatically focusing an image-acquisition device |
US5625705A (en) * | 1994-06-03 | 1997-04-29 | Neuromedical Systems, Inc. | Intensity texture based classification system and method |
US5647025A (en) * | 1994-09-20 | 1997-07-08 | Neopath, Inc. | Automatic focusing of biomedical specimens apparatus |
US5710829A (en) * | 1995-04-27 | 1998-01-20 | Lucent Technologies Inc. | System and method for focused-based image segmentation for video signals |
US5768401A (en) * | 1995-08-02 | 1998-06-16 | Lucent Technologies Inc. | Balanced focus system and method for achieving optimal focus of different areas of an object that are concurrently imaged |
US5790710A (en) * | 1991-07-12 | 1998-08-04 | Jeffrey H. Price | Autofocus system for scanning microscopy |
US5809169A (en) * | 1995-03-17 | 1998-09-15 | Alcatel Alsthom Compagnie Generale D'electricite | Method of extracting contours using multifractal analysis |
US6151415A (en) * | 1998-12-14 | 2000-11-21 | Intel Corporation | Auto-focusing algorithm using discrete wavelet transform |
US6154574A (en) * | 1997-11-19 | 2000-11-28 | Samsung Electronics Co., Ltd. | Digital focusing method and apparatus in image processing system |
US6341180B1 (en) * | 1997-12-18 | 2002-01-22 | Cellavision Ab | Image content autofocus for microscopy using a noise-insensitive focus filter |
US6640104B1 (en) * | 1999-12-28 | 2003-10-28 | Lucent Technologies Inc. | Dynamic channel assignment for intelligent antennas |
US6876776B2 (en) * | 2003-02-14 | 2005-04-05 | Ikonicys, Inc. | System and method for auto-focusing an image |
US7268939B1 (en) * | 2003-08-21 | 2007-09-11 | The United States Of America As Represented By The Administrator Of National Aeronautics And Space Administration | Tracking of cells with a compact microscope imaging system with intelligent controls |
-
2003
- 2003-02-14 US US10/368,055 patent/US6876776B2/en not_active Expired - Fee Related
-
2004
- 2004-02-13 WO PCT/US2004/005819 patent/WO2004074882A2/en active Application Filing
- 2004-10-05 US US10/958,512 patent/US7424165B2/en not_active Expired - Fee Related
-
2008
- 2008-09-09 US US12/207,272 patent/US20090052795A1/en not_active Abandoned
Patent Citations (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5040228A (en) * | 1989-08-28 | 1991-08-13 | At&T Bell Laboratories | Method and apparatus for automatically focusing an image-acquisition device |
US5790710A (en) * | 1991-07-12 | 1998-08-04 | Jeffrey H. Price | Autofocus system for scanning microscopy |
US5625705A (en) * | 1994-06-03 | 1997-04-29 | Neuromedical Systems, Inc. | Intensity texture based classification system and method |
US5647025A (en) * | 1994-09-20 | 1997-07-08 | Neopath, Inc. | Automatic focusing of biomedical specimens apparatus |
US5809169A (en) * | 1995-03-17 | 1998-09-15 | Alcatel Alsthom Compagnie Generale D'electricite | Method of extracting contours using multifractal analysis |
US5710829A (en) * | 1995-04-27 | 1998-01-20 | Lucent Technologies Inc. | System and method for focused-based image segmentation for video signals |
US5768401A (en) * | 1995-08-02 | 1998-06-16 | Lucent Technologies Inc. | Balanced focus system and method for achieving optimal focus of different areas of an object that are concurrently imaged |
US6154574A (en) * | 1997-11-19 | 2000-11-28 | Samsung Electronics Co., Ltd. | Digital focusing method and apparatus in image processing system |
US6341180B1 (en) * | 1997-12-18 | 2002-01-22 | Cellavision Ab | Image content autofocus for microscopy using a noise-insensitive focus filter |
US6151415A (en) * | 1998-12-14 | 2000-11-21 | Intel Corporation | Auto-focusing algorithm using discrete wavelet transform |
US6640104B1 (en) * | 1999-12-28 | 2003-10-28 | Lucent Technologies Inc. | Dynamic channel assignment for intelligent antennas |
US6876776B2 (en) * | 2003-02-14 | 2005-04-05 | Ikonicys, Inc. | System and method for auto-focusing an image |
US7424165B2 (en) * | 2003-02-14 | 2008-09-09 | Ikonisys, Inc. | System and method for auto-focusing an image |
US7268939B1 (en) * | 2003-08-21 | 2007-09-11 | The United States Of America As Represented By The Administrator Of National Aeronautics And Space Administration | Tracking of cells with a compact microscope imaging system with intelligent controls |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20120120276A1 (en) * | 2009-07-24 | 2012-05-17 | Seoyoung Kim | Image pickup apparatus having auto focusing function using fractal dimension and an auto focusing method |
US8681262B2 (en) * | 2009-07-24 | 2014-03-25 | Lg Innotek Co., Ltd. | Image pickup apparatus having auto focusing function using fractal dimension and an auto focusing method |
Also Published As
Publication number | Publication date |
---|---|
US20040161160A1 (en) | 2004-08-19 |
US6876776B2 (en) | 2005-04-05 |
WO2004074882A3 (en) | 2004-10-14 |
WO2004074882A2 (en) | 2004-09-02 |
US7424165B2 (en) | 2008-09-09 |
US20050041881A1 (en) | 2005-02-24 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20090052795A1 (en) | System and method for auto-focusing an image | |
US10101572B2 (en) | Variable focal length lens system with multi-level extended depth of field image processing | |
US9692958B2 (en) | Focus assist system and method | |
US20120307108A1 (en) | System and method to capture depth data of an image | |
EP3371741B1 (en) | Focus detection | |
Shih | Autofocus survey: a comparison of algorithms | |
JPH0736613B2 (en) | Focus adjustment method for imaging device | |
JP2004126574A (en) | Focusing of electronic imaging apparatus | |
JP3283208B2 (en) | Automatic focus control method and automatic focus control system | |
WO2005020143A2 (en) | Image processors and methods of image processing | |
JP2007524943A (en) | Image subtraction of lighting artifacts | |
US7577351B2 (en) | Image data processing method and apparatus | |
JP2861723B2 (en) | Confocal microscope | |
JPH10170817A (en) | Method and device for calculating focal position, and electron microscope using the same | |
US9658444B2 (en) | Autofocus system and autofocus method for focusing on a surface | |
JP2023529083A (en) | How to Analyze Scan Effectiveness | |
JP2003214978A (en) | Inspection device for optical connector end surface | |
JP2005156597A (en) | Automatic focusing apparatus and method, program, and storage medium | |
EP1522961A2 (en) | Deconvolution of a digital image | |
US11495431B2 (en) | Transmission electron microscope and adjustment method of objective aperture | |
CN114815207B (en) | Microscopic imaging automatic focusing image depth of field fusion method and related equipment | |
US6292307B1 (en) | Automatically focusing an optical instrument having a lens with only two focus positions | |
KR20090107814A (en) | Substrate inspection apparatus and substrate inspection method using the same | |
JPH06217180A (en) | Autofocus contrller | |
JP2005331690A (en) | Focusing apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: IKONISYS, INC., CONNECTICUT Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:RECHT, JOEL M.;REEL/FRAME:021504/0780 Effective date: 20030213 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |