WO2006023443A2 - Method and apparatus of mechanical stage positioning in virtual microscopy image capture - Google Patents
Method and apparatus of mechanical stage positioning in virtual microscopy image capture Download PDFInfo
- Publication number
- WO2006023443A2 WO2006023443A2 PCT/US2005/028982 US2005028982W WO2006023443A2 WO 2006023443 A2 WO2006023443 A2 WO 2006023443A2 US 2005028982 W US2005028982 W US 2005028982W WO 2006023443 A2 WO2006023443 A2 WO 2006023443A2
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- image
- images
- specimen
- objective lens
- tile
- Prior art date
Links
- 238000000034 method Methods 0.000 title claims abstract description 96
- 230000033001 locomotion Effects 0.000 claims abstract description 45
- 238000012937 correction Methods 0.000 claims abstract description 18
- 239000002131 composite material Substances 0.000 claims abstract 11
- 239000000284 extract Substances 0.000 claims description 5
- 238000001000 micrograph Methods 0.000 claims description 2
- 230000000717 retained effect Effects 0.000 abstract description 2
- 230000008569 process Effects 0.000 description 70
- 238000010586 diagram Methods 0.000 description 12
- 230000003287 optical effect Effects 0.000 description 11
- 238000005070 sampling Methods 0.000 description 9
- 238000004891 communication Methods 0.000 description 7
- 238000000605 extraction Methods 0.000 description 6
- 230000006870 function Effects 0.000 description 5
- 238000012545 processing Methods 0.000 description 5
- 230000008901 benefit Effects 0.000 description 4
- 238000005259 measurement Methods 0.000 description 3
- 238000001514 detection method Methods 0.000 description 2
- 238000005516 engineering process Methods 0.000 description 2
- 238000012986 modification Methods 0.000 description 2
- 230000004048 modification Effects 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 101100101579 Rattus norvegicus Ubqln1 gene Proteins 0.000 description 1
- 230000005540 biological transmission Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000007423 decrease Effects 0.000 description 1
- 238000013461 design Methods 0.000 description 1
- 230000026058 directional locomotion Effects 0.000 description 1
- 238000003384 imaging method Methods 0.000 description 1
- 238000007689 inspection Methods 0.000 description 1
- 238000002955 isolation Methods 0.000 description 1
- 239000000463 material Substances 0.000 description 1
- 230000005055 memory storage Effects 0.000 description 1
- 239000002184 metal Substances 0.000 description 1
- 230000006855 networking Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 238000005096 rolling process Methods 0.000 description 1
- 239000007787 solid Substances 0.000 description 1
- 230000007723 transport mechanism Effects 0.000 description 1
- 230000000007 visual effect Effects 0.000 description 1
Classifications
-
- G—PHYSICS
- G02—OPTICS
- G02B—OPTICAL ELEMENTS, SYSTEMS OR APPARATUS
- G02B21/00—Microscopes
- G02B21/36—Microscopes arranged for photographic purposes or projection purposes or digital imaging or video purposes including associated control and data processing arrangements
- G02B21/365—Control or image processing arrangements for digital or video microscopes
- G02B21/367—Control or image processing arrangements for digital or video microscopes providing an output produced by processing a plurality of individual source images, e.g. image tiling, montage, composite images, depth sectioning, image comparison
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformations in the plane of the image
- G06T3/40—Scaling of whole images or parts thereof, e.g. expanding or contracting
- G06T3/4038—Image mosaicing, e.g. composing plane images from plane sub-images
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/30—Determination of transform parameters for the alignment of images, i.e. image registration
- G06T7/32—Determination of transform parameters for the alignment of images, i.e. image registration using correlation-based methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2200/00—Indexing scheme for image data processing or generation, in general
- G06T2200/32—Indexing scheme for image data processing or generation, in general involving image mosaicing
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10056—Microscopic image
Definitions
- This invention relates to a method, system, and apparatus for image capture of a virtual microscope slide, and more particularly for capturing a virtual microscope slide with a microscope stage platform having a low resolution x and y mechanical movement, and without optical encoder positional feedback control.
- the field of view is the area of the illuminated field diaphragm of the microscope optical system as viewed in the specimen plane using an objective lens for magnification.
- the field of view is further limited by the visual field diaphragm usually contained in the eyepiece. The field of view decreases dramatically with increasing magnification using a higher power objective lens.
- the field of view is the area of the illuminated field diaphragm of the microscope optical system as viewed in the specimen plane using a magnifying objective and is further limited by the sensing area of the image capture device.
- a virtual slide is a stored microscope image or image data structure recorded in multiple parts at high magnification to capture an area of a specimen on a microscope slide that is larger than the area of the field of view in the specimen plane of the optical system used in the recording.
- the multiple image fields are captured by moving the slide mounted on a stage platform into the field of view for each image capture such that side by side contiguous image fields can be reconstructed or stored as if they were continuous.
- This virtual slide stored image or image data structure enables viewing through a display screen the reconstructed digital image of the area recorded or portions thereof.
- the digital image of the stored image or image data structure can be changed to view different portions of the specimen, or changed to higher or lower digital magnifications to view with different resolutions.
- the capture of magnified images of the specimen is accomplished by capturing multiple data segments, usually called image tiles or image strips that need to be accurately aligned to provide a seamless magnified corporate image to the viewer.
- Virtual slides described in the prior art are captured with a rectangular sensor, such as a 752 by 480 pixel sensor, or by a linear sensor moved in one axis of the scan direction by a mechanical stage, such as a 1 by 1024 pixel sensor.
- lower cost stages may have lead screws that may be made of materials that are not as linear as the precision metal ones used with optically encoded feedback position control stages.
- a bowed, or curved, lead screw causes an undulating, or gradual shift in position relative to a precise linear path across the surface of the slide on the x, y planar surface of the stage platform.
- This error, and mechanical hysteresis is usually corrected by expensive optical encoder feed back control.
- a deviation in linearity without optical encoder feedback control can result in stage specifications of 20 ⁇ m tolerances in positional reproducibility of results. This can cause alignment errors of as much as 40 pixels between images without feedback control.
- a new and less expensive method and apparatus for constructing a virtual microscope slide comprised of digitally scanned images from a microscope sample such as a tissue specimen or the like.
- This is achieved by replacing the conventional highly precise x and y stage platform with a significantly less accurate and less precise x and y stage platform and using a larger image sensor to provide feedback control to compensate for positioning inaccuracies.
- the larger image sensor enables a much larger image capture.
- the larger area of image capture surrounding the center portion can be used to align images to compensate for stage inaccuracies and to provide a feedback control signal to replace the conventional optically encoded feedback control signal.
- the purpose of the feedback control is to maintain the capture image in the center of the larger imaged sensor so that overlapping areas for image alignment are always present.
- FIG. 1 shows an exemplary computer environment 10 in which the present invention can be implemented
- FIG. 2 shows a general configuration for the computers shown in FIG. 1 , where all or parts of the invention may be implemented;
- FIG. 3 is an overview diagram of the digital microscope 12 implemented according to one embodiment of the present invention.
- FIG. 4 depicts a rectangular region of an selected area of the slide according to one embodiment of the present invention.
- FIGS. 5 A, 5B, and 5C are a flow chart diagram of a process according to one embodiment of the present invention.
- FIGS. 6A and 6B show exemplary values of different parameters of an image sensor and stage device
- FIGS. 7 A, 7B and 7C illustrate exemplary diagrams of multiple tile image and alignment of these tile images according to one embodiment of the invention
- FIGS. 8A, 8B, 8C, and 8D illustrates exemplary pixel values of the alignment movements of the tile images shown in FIG. 7 A.
- FIGS. 9A, 9B, 9C, and 9D are flow chart diagrams illustrating processes according to one embodiment of the invention.
- program may connote a single program module or multiple program modules acting in concert.
- the term "computer” as used herein includes any device that electronically executes one or more programs, such as personal computers (PCs), hand-held devices, multi-processor systems, microprocessor-based programmable consumer electronics, network PCs, minicomputers, mainframe computers, consumer appliances having a microprocessor or microcontroller, routers, gateways, hubs and the like.
- PCs personal computers
- the invention may also be employed in distributed computing environments, where tasks are performed by remote processing devices that are linked through a communication network.
- programs may be located in both local and remote memory storage devices.
- FIG. 1 shows an exemplary computer environment 10 in which the present invention can be implemented.
- a digital microscope 12 is connected directly to multiple computers 14, 16 and indirectly to other computers 18, 20 via a network 22.
- the network can include any type of computer network, such as an intranet or the Internet.
- one digital microscope 12 is shown as an example, the system can include multiple microscopes connected to multiple computers or a single computer. Because the topology of the computer environment 10 can be greatly varied, the present system is shown as an example.
- the computer environment 10 can be as stripped down to a single computer connected directly to the digital microscope 12 without a network, or a vast computing network with hundreds of computers and digital microscopes being interconnected.
- other computer environments are contemplated, and these various computer environments are within the scope of the present invention.
- FIG. 2 shows a general configuration for the computers 14, 16, 18, 20 shown in FIG. 1 and indicated generally at 30, where all or parts of the invention may be implemented.
- the computer 14 may include at least one processing unit 32 and memory 34.
- the processing unit 32 executes instructions to carry out tasks in accordance with various embodiments of the invention. In carrying out such tasks, the processing unit 32 may transmit electronic signals to other parts of the computer 14 and to devices outside of the computer 14 to cause some result.
- the memory 34 may be system memory 36, volatile memory 38 (e.g., Random Access Memory "RAM”), or non- volatile memory 40 (e.g., Read-Only Memory "ROM” or flash memory).
- RAM Random Access Memory
- ROM Read-Only Memory
- the computer 14 may also have additional features/functionality.
- computer 14 may also include a removable 44 and/or non-removable 46 storage media, which includes for example, magnetic disks or tapes and/or optical disks or tapes.
- These computer storage media can be implemented in any method or technology for storage of information, including computer-executable instructions, data structures, program modules, or other data.
- Computer storage media includes, but is not limited to, RAM, ROM, EEPROM, flash memory, CD-ROM, digital versatile disk (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and can be accessed by the computer 14. Any such computer storage media may be part of computer 14.
- Computer 14 preferably also contains communication connections 48 that allow the computer to communicate with other computers and/or devices.
- a communication connection is an example of a communication medium.
- Communication media typically embody computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media.
- the term "communication media” includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media.
- the term "computer-readable medium” as used herein includes both computer storage media and communication media.
- Computer 14 may also have input devices 50 such as a keyboard, mouse, pen, voice input device, touch input device, etc.
- Output devices 52 such as a display 54, speakers, a printer, or a peripheral device may also be included. All of these devices are well known in the art.
- the microscope 12 includes a stage 62 that provides an x and y axis 64 and 66 to move a region of a plane 68 and into the field of view of an objective lens 70 located on a z axis 72 perpendicular to the x, y axis plane.
- the stage 62 is configured to receive a slide 74 onto an area of the x, y axis plane 68.
- the digital microscope 12 is capable of moving the slide with a specimen 75 deposited thereon along the x, y axis 64, 66, which constitutes the stage coordinate, for capturing a field of view image at those specified coordinates.
- the digital microscope 12 can be adapted to move the stage 62, the lens 70, or a combination of the lens and stage to these stage coordinates.
- the objective lens 70 can be adapted to move forward and downward on the z axis 72
- the stage 62 is adapted to move on the x and y axis 64, 66.
- either the stage 62 or the objective lens 70 can move in isolation to the defined stage coordinates on the x, y, and z axis 64, 66, 72.
- a program 76 is used to create and send the proper instructions to the microscope 12 for controlling the available device functions.
- the program 76 using data 78 that may be permanently or temporary saved on the storage media, may send instructions with specified stage coordinates to the microscope 12 for capturing one or more field images at those specified stage coordinates.
- the program 76 may also send instructions to control other device functions, such as focus, transmission of data, or ejection of the slide.
- the program 76 is implemented to control most, if not all, of the device functions of the digital microscope 12. Depending upon the movement configuration of the digital microscope 12, the program 76 should have control over the mechanical parts of the device.
- the program 76 preferably includes a user interface 80 that allows for user control of the microscope 12.
- the present invention contemplates the program 76 being, but not limited to, an implementation that is within the digital microscope 12, a separate computer connected to the device, a function of an application, or a web-based executable function, the program should be considered any program for use with a computer or a peripheral device.
- the implementation of the program includes software, firmware, modules within an application, and application program interface. Since these various implementations are contemplated and readily appreciated by one skill in the art, they are within the scope of the present invention.
- FIG. 4 depicts a rectangular region 82 of the specimen 75 being selected according to one embodiment of the present invention.
- a macro view of the specimen 75 is captured, which enables a user to easily select a region of the specimen though the user interface.
- the relationship of the macro view and its use in selecting a region for higher magnification image capture is described the previous U.S. Patent No. 6,101,265 by the present inventors. A similar method may be used in the present invention.
- a procedure of the this invention to accomplish this alignment is to select a small visually detectable object in the macro view image and click on it with the mouse pointer to obtain it's image pixel x,y coordinates. Then, after changing the magnification to obtain and image with a preliminary centration to acquire an image in the same general field of view of second higher resolution, for example at 2Ox and usually in a second viewing window, center the object in that window by scrolling, or automatic movement of the specimen relative to the optics, and record the x,y coordinates of the second higher magnification after the object is centered in the field of view and of the captured image.
- the difference relationship between the x,y coordinates of the macro view image and the higher magnification view image may then be used as offsets when navigating the macro view with the mouse pointer to look at different points at the higher magnification and to outline regions on the macro view for virtual slide capture at the higher magnification.
- the invention is not limited to the acquisition of a macro view however, but may be used in a system that simply scans the entire slide, or automatically locates the specimen region for image capture.
- the selected region is divided into multiple tiles 84, which is indicated respectively as DaO through Da41 in FIG. 4.
- more tiles 84 are used to divide the selected region.
- fewer tiles 84 are used for the lower magnification.
- the magnification used, and thus the number of tiles 84 used depends upon the specific needs in viewing the specimen. However, in general, if more details are desired, the greater magnification and number of tiles 84 would be used to divide the selected region. However, a complication arises when more tiles are used, in which case, the process will take more time and more image storage will be required.
- FIG. 5 A shows a flow chart diagram of a process for capturing a selected region according to one embodiment of the invention, which is indicated generally at 100.
- the process either starts (block 102) automatically from a detection of a slide or manually from a user executing the process.
- Other implementations to initiate the process are possible, and they are readily appreciated by a skilled artisan.
- the process determines whether a slide has been detected in device (block 104). If not (block 104), the process prompts the user for a slide to be inserted into the device (block 106), which goes back to check for a slide detection again (block 104).
- a macro view of the slide is captured in a low resolution image (block 108), which is outputted to the user on a display (block 110).
- the macro capture of the slide includes two macro images at .22x magnification, which is aligned and pasted together end-to-end to generate the macro capture of the entire slide.
- other implementations are possible, such as capturing a single field image. The specific implementation depends upon the capability of the device.
- the user using the macro view of the slide, can then select a predefined region of the slide (block 112) and request a capture at a selected magnification of the selected region (block 114).
- the process next determines an appropriate number of tiles to divide the selected region (block 116).
- the selected region is accordingly divided by the determined number of tiles (block 118).
- the number of tiles increases, and vice versa.
- the first tile is selected (block 122), and the device accordingly moves to the stage coordinates of the first tile (block 124) and captures an image of the first tile (block 126).
- the captured image of the first tile is set as ImageN (block 128).
- the process determines the movement direction based on the next tile. For example, if the next tile is to the right direction (i.e., positive) of the x axis, the movement would be a right movement on the x axis.
- next tile is the downward side (negative) of the y axis
- the movement would be a bottom movement on the y axis.
- first tile is preferably selected as the first tile image
- an x or y also referenced as (x,y)
- offset value would be calculated.
- FIG. 5B a flow chart diagram of a process for computing a (x,y) correction step value 136 is shown.
- the values are x sumoffset, y sumoffset, x offset, or y offset, and these values are different from one another.
- the notation (x,y) is used to represent a x or y value.
- the (x,y) sumoffset value is next compared to an (x,y) threshold value. Specifically, the process determines whether the (x,y) sumoffset value is greater than the (x,y) threshold value (block 140). If yes (block 140), the (x,y) sumoffset value exceeds the threshold value on the positive side, and in response, the (x,y) correction step value is set to equal to a first predefined value (block 142), which completes the process (block 144). Otherwise, when the (x,y) sumoffset value is not greater than the (x,y) threshold value (block 140), the process next determines whether the (x,y) sumoffset value is less than the (x,y) threshold value (block 146).
- the (x,y) correction step is set to a second predefined value (block 148), which again ends the process (block 144).
- the sampling portions and variables (x,y) sumoffset and (x,y) offset are based on a pixel value of the images and are thus in units of length ( ⁇ m) expressed as the number of pixels.
- the (x,y) threshold value has to be converted to stage steps in units of length ( ⁇ m), which can be derived by using the relationships expressed in FIG 6A and FIG 6B to obtain the first fixed value (block 142) and second fixed value (block 148). These values are in stage steps and are different depending on the magnification used in the image capture.
- the first and second predefined value are the same value, except one being a positive value and the other being a negative value. This is to compensate either the stage device went under (e.g., a positive value to correct the offset) or over (e.g., a negative value to correct the offset).
- the stage device went under (e.g., a positive value to correct the offset) or over (e.g., a negative value to correct the offset).
- other values or ranges of values can be used depending on the implementation design and/or the specification of the device. These various implementations are readily recognized by those skilled in the art, and thus they are within the scope of the present invention.
- the (x,y) correction step value is set to zero (block 150). At this point, the process ends (block 144) since a (x,y) correction step value has been obtained, and the process goes back to FIG. 5A.
- the (x,y) steps is set to a (x,y) default step, which is predefined, plus the (x,y) correction step value obtained in FIG. 5B (block 152).
- the process moves the stage (x,y) steps to the next tile (block 154) and captures an image (block 156).
- the captured image is then set as Image N+l (block 158), and Image N and Image N+l are aligned (block 160).
- a (x,y) offset value of Image N and Image N+l is computed (block 162), which initiates the subroutine shown in FIG. 5C.
- FIG. 5C a flow chart diagram of the process for computing the (x,y) offset value of Image N and Image N+l is computed 162, which starts by extracting sampling portions of both images (block 164).
- a set of correlation coefficient of image N and image N+l (block 166) is calculated based on the extracted sampling portions (block 166), and a maximum value from the set of the correlation coefficient will be retained (block 168) along with the (x,y) offset steps associated with the maximum value.
- whether the offset value is an x or y value is based on the direction of the next tile.
- the extracted sampling portions are also according to whether the next tile is to the x or y axis.
- each extracted sampling portion is hashed, and only the maximum is kept for each iteration of the sampling portions.
- the sampling portions are based on a pixel value of the images and the (x,y) offset steps are in numbers of pixels, i.e., the number of pixels required to move one image relative to the other image so that they will line up exactly in either the x or y direction.
- the offset steps are obtained, it is set as the (x,y) offset value (block 172), and the process ends (block 174) and loops back to the process in FIG. 5A.
- the sum of the absolute differences between the image pixel values of the sampling portions may used instead of the correlation coefficient.
- the minimum absolute difference is kept for each iteration of the sampling portions along with the (x,y) offset steps associated with the minimum value.
- the image N+l can now be set to image N (block 176).
- the process loops back to check if there is another next tile (block 130). If so (block 132), the process performs another iteration for the next tile by selecting the next tile (block 134). Otherwise, the process ends (block 132) because all the tiles are been scanned and captured through the process.
- the captured images are preferably aligned again, which is similarly to the process shown in FIGS. 5A, 5B, and 5C, except that the tile does not have to be captured. However, the calculation of the offset value and the movement based on this calculated offset value remains the same.
- FIG. 6A and 6B respectively show the pixel values of an associated image sensor and an inexpensive stage with low resolution incremental steps.
- the pixel size at the sensor face of a 5 megapixel 2/3 inch digital sensor of 6.75 ⁇ m in width and 6.75 ⁇ m in height is indicated, with the corresponding size in the specimen plane for a 1Ox, 2Ox, and 4Ox magnification.
- the pixel size in the specimen plane of a single pixel at 2Ox magnification is 0.34375.
- FIG. 6B also shows the number of stage steps for a 1.25 ⁇ m incremental positioning stage platform.
- the stage steps are truncated to the nearest integer value in the cases where an exact number of steps does not cover the distance specified.
- the image width of 103.4 ⁇ m at 40 x magnification would require 103.4 stage steps, which is truncated to 103 steps, causing a an alignment problem of approximately 2 pixels.
- the lower cost stages without optical encoder feedback control tend to result in errors of alignment.
- FIG. 7A illustrates an exemplary pattern of image tiled acquisition using a 5 megapixel image sensor, where each tile is a full 1280 by 960 pixel size.
- a selected area 200 of the specimen 75 is divided into multiple tile images 202.
- the selected area 200 is divided from tile ImageO through Image 17.
- the tile images 202 generally have large overlaps between them to ensure the whole image of the selected area 200 is correctly captured during alignment.
- FIG. 7B and 7C illustrate an exemplary alignment of extracted portions of ImageO, Image 1, Image2, and Image 11 shown in FIG. 7A.
- the center of each image is chosen as a tile, overlapping regions of images are thus available outside of the center region for subsequent alignment and extraction of the nominally centered portions after (x,y) offset correction.
- the centers DaO and Dal of ImageO and Image 1 overlap in the x direction, and the center Dal 1 of tile Image 11 is gapped and not correctly aligned with ImageO and Image 1. This is based on the assumption that the exact centers are located assuming precise stage motions.
- Extracting center portions of very largely overlapping initial images is an important aspect of the invention, since it is not feasible to cross correlate the image in the case of non-overlapped gaps due to overshoot of the stage motion.
- a tile is simply taken out of a different region of the image if there is either an overlap or gap due to undershooting or overshooting of stage motion..
- the procedure to match up two images with overlapping regions, and the two images are referred to as the Alpha image and the Delta image.
- the procedure is conceptualized as keeping the Alpha image region fixed and moving the Delta image region over the Alpha image region in a raster scan pattern and computing a parameter, for example the minimum absolute difference between the regions by subtracting each pixel while iterating the delta region over the alpha region in x and y and over a fixed search range.
- a parameter for example the minimum absolute difference between the regions by subtracting each pixel while iterating the delta region over the alpha region in x and y and over a fixed search range.
- the Delta region indexes stay the same and the Alpha region indexes change through the search procedure to compare different regions to the fixed Alpha region.
- the Alpha image regions and Delta image regions are defined by x and y start and end coordinates that define the regions that should be identical if there were no errors in positioning between the two images.
- the output are the X and Y offsets of the determined mispositioned images.
- FIG. 8 A shows an exemplary dimension of a first tile ImageO, 210 shown in FIG. 7 A.
- the microscope 12 uses the stage coordinates to move the nominal stage steps associated with 752 pixels in the x direction and 480 pixels in the y direction to capture each larger 1280 by 960 image.
- the tile ImageO 210 includes the center tile area DaO 212 and an extra captured area 214 adjacent to the center tile area.
- the complete area of the captured larger image 210 measures 1280 pixels across the x axis and 960 pixels across the y axis.
- the center area 212 measures 752 pixels on the x axis and 480 pixels on the y axis, and the remaining areas consists of the extra captured area 214, which measures 264 and 240 pixels on both sides of the tile at the x and y axis, respectively.
- these indicated measurements are only exemplary, because they vary with different captured resolutions of the microscope 12.
- Other alternative measurements and ratios are contemplated, and they are within the scope of the present invention.
- the larger image captured by the microscope 12 includes the tile along with the extra area adjacent to the tile.
- FIG. 8B shows an exemplary dimension of the second tile Image 1 220 that is captured to the right of tile ImageO 210 shown in FIG. 8A on the x axis.
- the microscope 12 is instructed to move right according to a predefined step to capture the second tile image 220, which includes its corresponding second center area Dal 222 and second extra captured area 224 adjacent to the tile area.
- the predefined step is defined by a distance of 752 pixels to the right of the first tile imageO 210.
- the first center area DaO 212 of the first tile ImageO 210 overlaps the second center area Dal 222 of the second tile Image 1 220 to ensure that the captured tile is larger than the divided tile.
- the overlapping areas ensure that the whole area of the tile is captured, and as a result, no areas of the tiles are lost due to the inaccurate movement of the microscope 12. Moreover, these extra areas are useful during the alignment process for accuracy.
- the area of correlation used is an overlapping area 226 between the two larger images. In the x direction this starts with the 132nd pixel and ends with the 395th pixel of the right image 211 (shown at the top). Similarly, the overlapping area of the left image 210 is between the 884th pixel and the 1147th pixel (shown at the bottom). The remaining tile Image2 through Image5 located on the right of ImageO on the x axis would be similarly overlapped according to the offset value in the x direction.
- FIG. 8C shows an exemplary dimension of tile Image5 230 and tile Image6 232, which is captured as a bottom movement from the tile Image5.
- the microscope 12 is instructed to move down on the y axis to capture the next tile image (e.g., Image ⁇ 232) from the last tile image (e.g., Image5 230) captured on the right of the x axis.
- the microscope 12 moves approximately 480 pixels equivalent stage steps downward from the tile Image5 230, which similarly includes a center area Da5 234 and an extra captured area 236, to capture tile image ⁇ 120, which also includes its corresponding center area Da6 238 and an extra captured area 240.
- an overlapping area is created between the two larger images. Again, with the two tile images on the top and bottom being captured, an overlapping area is guaranteed to ensure that no areas of the tile are lost due to the inaccurate movements of the microscope 12. Moreover, an offset value in the y direction is also calculate for tile Image5 and Image ⁇ . The area 242 is used to calculate this offset value. This is between the 480th pixel and the 719th pixel of tile Image5 230 (shown on the left) and between the zero (0) pixel and the 239th pixel of tile Image ⁇ 232. The overlapping area shown is measured about 239 pixels in distance, which is approximately the top of the extra captured area 240 of the tile Image ⁇ 232.
- FIG. 8D shows an exemplary dimension of tile Image ⁇ 232 and tile Image7 250, which is captured as a left movement from the tile Image ⁇ .
- the microscope 12 is instructed to move left on the x axis to capture the next tile image (e.g., Image7250) from the last tile image (e.g., Image ⁇ 232) captured on the y axis.
- the tile Image7 is the first tile image of the bottom movement on the y axis, and at the same time the first tile image on the left movement of the x axis.
- the microscope 12 moves from the stage coordinates of the tile image ⁇ to a stage step distance, which is based on the previous offset value in the x direction, to the left of the x axis.
- the tile image7 similarly includes a center area 252 and a extra captured area 254.
- An overlapping area 256 is used for calculating the x offset value is between the 132nd pixel and the 395th pixel of the first tile image (shown at the top).
- FIGS. 8A, 8B, 8C, and 8D are shown as a solid example, as stated, and the measurements, the number of field images used for each tile, the predefined distance, and the direction of the movements can be altered.
- the microscope 12 can be moved along both the x (left or right) and y axis (up and down). All these parameters can be set according to the desired benefits of speed or accuracy. As a result, these multiple alternative implementations are within the scope of the present invention.
- FIGS. 8 A, 8B, 8C, and 8D illustrate in detail the calculation of the alignment of images needed for final tile extraction.
- Another associated problem illustrated and described in relation to FIGS. 5A, 5B, and 5C is to make sure that the error of positioning with a fixed step size of moving the stage is not so large that after correlation there is not enough region left in the large image to cut out the smaller tile.
- This is solved by the other aspect of the invention, to vary the step size by feedback control based on the results of the cross-correlation of the images as shown in FIGS. 5 A, 5B, and 5C.
- FIG. 9A shows a flow chart diagram of an extraction process for capturing the images according to a more specific embodiment of the invention using a stage step of 1.25um, which is indicated generally at 300.
- the process starts by initializing the variables (block 302). Specifically, an Xoffset value, Yoffset value, SumXoffset value, and SumYoffset value are all set to zero.
- the first tile image is captured (block 302).
- the next tile image from the first tile image is preferably on the right (block 304).
- the process first determines whether there is a tile along the right direction of the x axis, which creates a right movement (block 306). If so, a Xcorrection value is computed, which is show in FIG. 9B.
- FIG. 9B a flow chart diagram for computing the Xcorrection value is shown and indicated generally at 310.
- a Xcorrection is set to a value of 4 (block 318), which would moves the stage 4 pixel steps over from the default steps.
- a Xthreshold value of 3 and Xcorrection value of 4 are used for the inexpensive stage using a 1.25um stage step.
- other Xthreshold value and Xcorrection value can be used depending on the specification of the stage device, which is readily appreciated by one skilled in the art.
- the process continues checking and determines whether the SumXoffset is less than the negative Xthreshold value of -3 (block 322). If so, the offset value of the aligned images needs to be compensated on the negative direction (e.g., left side) of the x axis. And the Xcorrection is set to -4 (block 324), which again ends the process (block 320) since a Xcorrection value has been obtained. Otherwise, when the SumXoffset is not less than Xthreshold value of -3 (block 322), the Xcorrection is set to zero because no correction is needed (block 326).
- a Xsteps value is set to Xdefault minus Xcorrection (block 308).
- the stage moves right based this Xsteps (block 308) and captures the image (block 328).
- the captured image is then set to the delta image for a right alignment with the alpha image of the previous image (block 328).
- a XoffSet is computed based on the results of the right alignment between the delta and alpha images (block 328).
- the process loops back to check whether there are any more right movements (block 306). If there are tiles left in the right direction on the x axis (block 306), the process goes back to computing a new Xcorrection with the new Xoffset value (block 306).
- the process determines whether there is a bottom movement for a next tile (block 330). In other words, the process checks whether there is a next tile down from the last tile that was captured on the right direction of the x axis. If not, which means all the tiles have been accounted for, the process ends (block 332). If, however, there are more tiles that would require a bottom movement, a Ycorrection value is computed (block 334), which is shown as a subroutine in FIG. 9C.
- a Ycorrection is set to a value of 4 (block 348), which would moves the stage 4 pixel steps down from the default steps.
- a Ythreshold value of 3 and Ycorrection value of 4 are used.
- the Ythreshold value and Ycorrection value may be different depending on the specification of the stage device, which is readily appreciated by one skilled in the art.
- the process continues by determining whether the SumYoffset is less than the negative Ythreshold value of -3 (block 352). If so, the offset value of the aligned images needs to be compensated on the negative direction (e.g., downward) of the y axis.
- the Ycorrection is accordingly set to -4 (block 354) to compensate 4 steps downward on the y axis. The process again ends at this point (block 350) since a Ycorrection value has been obtained.
- a Ysteps that equals to a Ydefault value minus the computed Ycorrection value is computed (block 334).
- the stage moves down the Ysteps obtained from the Ydefault value and the Ycorrection value (block 334) and captures an image (block 360).
- the captured image is set as the delta image (block 360), and the image before this captured image is set as the alpha image (block 334).
- a bottom alignment of the alpha image and the delta image is done, which would allow for a Yoffset value to be computed (block 360).
- the tiles on the left side of the x axis are next captured (block 362).
- a left alignment of the alpha and delta images is performed, and another Xoffset value will computed based on the left alignment (block 368).
- the process loops back to the left movement (block 362) and continues to check more tiles that would require another left movement (block 364).
- the process continues to another bottom movement process, which checks for bottom movement (block 370). If there are more tile downward of the y axis, the Ycorrection value is again computed (block 372) using the subroutine shown in FIG. 9C. After which, the Ysteps is computed using the Ydefault and the Ycorrection (block 372).
- the stage moves down on the y axis (block 372) and captures an image (block 374), which is set as the delta image. Again, an alpha image of the previous captured image is aligned with the delta image on the y axis, and another Yoffset value is computed from the results of the bottom alignment (block 374).
- the process loops back to the right movement (block 304) and determines whether there is a right movement for the next tile (block306). If no bottom movement is required (block 370), the process ends (block 332) because all the tiles have been accounted for and captured.
- FIG. 9D shows a flow chart diagram of an extraction process for capturing the final nominally centered DAO, Dal, etc. tiles from a series of captured and saved larger images ImageO, Image 1, etc.
- another alignment process which is indicated generally at 380, is performed with these captured images from FIGS. 9A, 9B, and 9C.
- the process starts with ImageO (block 382).
- the center DAO tile of ImageO is extracted and saved in the virtual slide data structure.
- the coordinates of the extracted tile, in ImageO x,y coordinates, starts at x equal to 264, and y equal to 240 as indicated in FIG. 8 A.
- the x,y tile size of the extracted tile is 752 by 480.
- the process loops back to the right (block 384) and checks right neighbors of the current image (block 386). If there is another right neighbor image (block 386), it continues the alignment of the right neighbor image (block 388) and extracts a tile corrected by it's beginning offset in x and y from the last extracted tile position. If there is no more right neighbor images (block 386), a bottom neighbor is checked (block 390). If no bottom neighbor exists (block 390), the process ends because all the images should have been accounted for (block 392).
- the current image is set as the alpha image and the bottom neighbor image is set as the delta image, and a bottom alignment is performed (block 394) and extracts a tile corrected by it's beginning offset in x and y from the last extracted tile position.
- the process moves left (block 396) and determines whether there is a left neighbor image (block 398). If so, the current image is set to the alpha image and the left neighbor image is set to the delta image for a left alignment to be performed (block 400) and extracts a tile corrected by it's beginning offset in x and y from the last extracted tile position. The process back to another left movement (block 396).
- This iteration is performed until a left neighbor no longer exists (block 398), which is followed by a determination of whether there is a bottom neighbor image (block 402). If there is a bottom neighbor image (block 402), the current image and the bottom neighbor are respectively set as alpha and delta, and a bottom alignment is performed for both images (block 404) and extracts a tile corrected by it's beginning offset in x and y from the last extracted tile position. At this point, the process loops back to a right movement (block 384), which checks for a right neighbor exist (block 386). On the other hand, if there is no bottom neighbor (block 402), the process ends (block 392).
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Multimedia (AREA)
- Chemical & Material Sciences (AREA)
- Analytical Chemistry (AREA)
- Optics & Photonics (AREA)
- Microscoopes, Condenser (AREA)
Abstract
Description
Claims
Priority Applications (3)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2007527913A JP4863998B2 (en) | 2004-08-16 | 2005-08-15 | Method and apparatus for mechanically positioning a stage in virtual microscope image capture |
CA2576183A CA2576183C (en) | 2004-08-16 | 2005-08-15 | Method and apparatus of mechanical stage positioning in virtual microscopy image capture |
EP05785418.4A EP1794706B1 (en) | 2004-08-16 | 2005-08-15 | Method and apparatus of mechanical stage positioning in virtual microscopy image capture |
Applications Claiming Priority (4)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US60179404P | 2004-08-16 | 2004-08-16 | |
US60/601,794 | 2004-08-16 | ||
US60558304P | 2004-08-30 | 2004-08-30 | |
US60/605,583 | 2004-08-30 |
Publications (2)
Publication Number | Publication Date |
---|---|
WO2006023443A2 true WO2006023443A2 (en) | 2006-03-02 |
WO2006023443A3 WO2006023443A3 (en) | 2006-09-28 |
Family
ID=35968092
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/US2005/028982 WO2006023443A2 (en) | 2004-08-16 | 2005-08-15 | Method and apparatus of mechanical stage positioning in virtual microscopy image capture |
Country Status (5)
Country | Link |
---|---|
US (1) | US7792338B2 (en) |
EP (1) | EP1794706B1 (en) |
JP (1) | JP4863998B2 (en) |
CA (1) | CA2576183C (en) |
WO (1) | WO2006023443A2 (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008028944A1 (en) * | 2006-09-06 | 2008-03-13 | Leica Microsystems Cms Gmbh | Method and microscopic system for scanning a sample |
DE102010039652A1 (en) | 2010-08-23 | 2012-02-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Mosaic shot generation |
US9261691B2 (en) | 2010-05-27 | 2016-02-16 | Canon Kabushiki Kaisha | Image pickup apparatus |
EP4067965A1 (en) * | 2021-03-31 | 2022-10-05 | PreciPoint GmbH | Method of providing an assembled image using a digital microscope, digital microscope system, and program for providing an assembled image using a digital microscope |
Families Citing this family (45)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7518652B2 (en) * | 2000-05-03 | 2009-04-14 | Aperio Technologies, Inc. | Method and apparatus for pre-focus in a linear array based slide scanner |
US7653260B2 (en) * | 2004-06-17 | 2010-01-26 | Carl Zeis MicroImaging GmbH | System and method of registering field of view |
US7792338B2 (en) * | 2004-08-16 | 2010-09-07 | Olympus America Inc. | Method and apparatus of mechanical stage positioning in virtual microscopy image capture |
CN101197044B (en) * | 2006-12-06 | 2011-02-02 | 鸿富锦精密工业(深圳)有限公司 | Image synthesis system and method |
US8044972B2 (en) * | 2006-12-21 | 2011-10-25 | Sectra Mamea Ab | Synchronized viewing of tomosynthesis and/or mammograms |
US7992100B2 (en) * | 2006-12-21 | 2011-08-02 | Sectra Ab | Dynamic slabbing to render views of medical image data |
US8051386B2 (en) * | 2006-12-21 | 2011-11-01 | Sectra Ab | CAD-based navigation of views of medical image data stacks or volumes |
WO2008118886A1 (en) | 2007-03-23 | 2008-10-02 | Bioimagene, Inc. | Digital microscope slide scanning system and methods |
DE102008014030B4 (en) * | 2008-03-12 | 2017-01-26 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Method for calibrating a stage camera system and stage camera system and microscope with such stage camera system |
US20100166268A1 (en) * | 2008-12-30 | 2010-07-01 | Ebm Technologies Incorporated | Storage system for storing the sampling data of pathological section and method thereof |
CN101769475B (en) * | 2008-12-31 | 2013-04-24 | 鸿富锦精密工业(深圳)有限公司 | Image measuring apparatus light source and automatic positioning system using same |
TWI417517B (en) * | 2009-02-27 | 2013-12-01 | Hon Hai Prec Ind Co Ltd | Light source for vision measuring machine and positioning system using the same |
US8891851B2 (en) * | 2009-07-15 | 2014-11-18 | Glenn F. Spaulding | Home healthcare management system and hardware |
US8941584B2 (en) * | 2009-09-28 | 2015-01-27 | Bryan Dangott | Apparatus, system, and method for simulating physical movement of a digital image |
US8705623B2 (en) * | 2009-10-02 | 2014-04-22 | Texas Instruments Incorporated | Line-based compression for digital image data |
RU2567213C2 (en) * | 2009-10-22 | 2015-11-10 | Конинклейке Филипс Электроникс Н.В. | Alignment of ordered stack of images of sample |
JP5452180B2 (en) | 2009-11-13 | 2014-03-26 | オリンパス株式会社 | Microscope equipment |
US20110228071A1 (en) * | 2010-02-10 | 2011-09-22 | Rohde Mitchell M | Microscope for Forensic Examination |
JP2012002923A (en) | 2010-06-15 | 2012-01-05 | Canon Inc | Imaging device |
JP4975177B2 (en) | 2010-09-10 | 2012-07-11 | キヤノン株式会社 | Imaging device |
US8542274B2 (en) | 2010-10-18 | 2013-09-24 | Olympus America Inc. | Wide field microscopic imaging system and method |
JP2013011856A (en) * | 2011-06-01 | 2013-01-17 | Canon Inc | Imaging system and control method thereof |
JP5732353B2 (en) * | 2011-08-31 | 2015-06-10 | 株式会社キーエンス | Magnification observation apparatus, magnification observation method, and magnification observation program |
US20130141736A1 (en) * | 2011-12-01 | 2013-06-06 | Mingwu Bai | Control method and apparatus for positioning a moving object |
US10509218B2 (en) | 2012-01-11 | 2019-12-17 | Sony Corporation | Information processing apparatus, imaging control method, program, digital microscope system, display control apparatus, display control method, and program including detection of a failure requiring reimaging |
JP5923824B2 (en) * | 2012-02-21 | 2016-05-25 | 株式会社ミツトヨ | Image processing device |
EP2642279B1 (en) * | 2012-03-19 | 2015-07-01 | Universidad de Barcelona | Method and system for improving characteristic peak signals in analytical electron microscopy |
WO2014006964A1 (en) * | 2012-07-04 | 2014-01-09 | ソニー株式会社 | Information processing device, information processing method, program, and microscope system |
JP2014178357A (en) * | 2013-03-13 | 2014-09-25 | Sony Corp | Digital microscope device, imaging method of the same and program |
US9591268B2 (en) | 2013-03-15 | 2017-03-07 | Qiagen Waltham, Inc. | Flow cell alignment methods and systems |
JP6455829B2 (en) * | 2013-04-01 | 2019-01-23 | キヤノン株式会社 | Image processing apparatus, image processing method, and program |
US9720218B2 (en) * | 2013-08-06 | 2017-08-01 | Howard Hughes Medical Institute | Volume imaging |
JP6127926B2 (en) * | 2013-11-11 | 2017-05-17 | ソニー株式会社 | Image processing apparatus and image processing method |
US9781356B1 (en) * | 2013-12-16 | 2017-10-03 | Amazon Technologies, Inc. | Panoramic video viewer |
JP2017526011A (en) * | 2014-08-18 | 2017-09-07 | ビューズアイキュウ インコーポレイテッド | System and method for embedded images in a wide field microscope scan |
US20160299498A1 (en) * | 2015-04-10 | 2016-10-13 | Nanovea, Inc. | System for navigating a field of view of a displayed and magnified surface |
JP6572117B2 (en) * | 2015-12-04 | 2019-09-04 | オリンパス株式会社 | Microscope, image pasting method, program |
US10157457B2 (en) * | 2016-08-10 | 2018-12-18 | Kla-Tencor Corporation | Optical measurement of opening dimensions in a wafer |
US10359613B2 (en) * | 2016-08-10 | 2019-07-23 | Kla-Tencor Corporation | Optical measurement of step size and plated metal thickness |
US10168524B2 (en) * | 2016-08-10 | 2019-01-01 | Kla-Tencor Corporation | Optical measurement of bump hieght |
US10373290B2 (en) * | 2017-06-05 | 2019-08-06 | Sap Se | Zoomable digital images |
JP6842387B2 (en) | 2017-08-31 | 2021-03-17 | 浜松ホトニクス株式会社 | Image acquisition device and image acquisition method |
EP3773148A2 (en) | 2018-04-11 | 2021-02-17 | Alcon Inc. | Automatic xy centering for digital microscope |
WO2023112002A1 (en) * | 2021-12-18 | 2023-06-22 | Imageprovision Technology Private Limited | Photomicrographic image-processing method for automatic scanning, detection and classification of particles |
US12023817B1 (en) * | 2023-11-14 | 2024-07-02 | Pramana, Inc. | System and method for a slide marking technique for target tissue extraction and downstream application |
Family Cites Families (73)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US3999047A (en) * | 1972-09-05 | 1976-12-21 | Green James E | Method and apparatus utilizing color algebra for analyzing scene regions |
US4150360A (en) * | 1975-05-29 | 1979-04-17 | Grumman Aerospace Corporation | Method and apparatus for classifying biological cells |
US4199748A (en) * | 1976-11-01 | 1980-04-22 | Rush-Presbyterian-St. Luke's Medical Center | Automated method and apparatus for classification of cells with application to the diagnosis of anemia |
US4175860A (en) * | 1977-05-31 | 1979-11-27 | Rush-Presbyterian-St. Luke's Medical Center | Dual resolution method and apparatus for use in automated classification of pap smear and other samples |
US4213036A (en) * | 1977-12-27 | 1980-07-15 | Grumman Aerospace Corporation | Method for classifying biological cells |
DE2903855A1 (en) * | 1979-02-01 | 1980-08-14 | Bloss Werner H Prof Dr Ing | METHOD FOR AUTOMATICALLY MARKING CELLS AND DETERMINING THE CHARACTERISTICS OF CELLS FROM CYTOLOGICAL MEASUREMENT DEVICES |
US4742558A (en) * | 1984-02-14 | 1988-05-03 | Nippon Telegraph & Telephone Public Corporation | Image information retrieval/display apparatus |
US4760385A (en) * | 1985-04-22 | 1988-07-26 | E. I. Du Pont De Nemours And Company | Electronic mosaic imaging process |
FR2583545B1 (en) | 1985-06-13 | 1987-08-07 | Primat Didier | IMPROVEMENT IN METHODS AND DEVICES FOR AUTOMATIC DIGITALIZATION OF A SCENE COMPRISING DISCRETE SIGNIFICANT ELEMENTS |
US4741043B1 (en) * | 1985-11-04 | 1994-08-09 | Cell Analysis Systems Inc | Method of and apparatus for image analyses of biological specimens |
US4777525A (en) * | 1985-12-23 | 1988-10-11 | Preston Jr Kendall | Apparatus and method for a multi-resolution electro-optical imaging, display and storage/retrieval system |
US5216596A (en) * | 1987-04-30 | 1993-06-01 | Corabi International Telemetrics, Inc. | Telepathology diagnostic network |
JP2686274B2 (en) * | 1988-03-24 | 1997-12-08 | 東亜医用電子株式会社 | Cell image processing method and apparatus |
US5544650A (en) * | 1988-04-08 | 1996-08-13 | Neuromedical Systems, Inc. | Automated specimen classification system and method |
US4965725B1 (en) * | 1988-04-08 | 1996-05-07 | Neuromedical Systems Inc | Neural network based automated cytological specimen classification system and method |
US5163095A (en) * | 1988-04-22 | 1992-11-10 | Toa Medical Electronics Co., Ltd. | Processor for extracting and memorizing cell images, and method of practicing same |
JP2813348B2 (en) * | 1988-04-22 | 1998-10-22 | 東亜医用電子株式会社 | Cell image extraction storage processing device and method |
JP2671393B2 (en) | 1988-06-21 | 1997-10-29 | ソニー株式会社 | Map information display device |
US5252487A (en) * | 1989-05-19 | 1993-10-12 | Cell Analysis Systems, Inc. | Method and apparatus for determining the amount of oncogene protein product in a cell sample |
US5073857A (en) * | 1989-06-01 | 1991-12-17 | Accuron Corporation | Method and apparatus for cell analysis |
US5268966A (en) * | 1989-08-10 | 1993-12-07 | International Remote Imaging Systems, Inc. | Method of differentiating particles based upon a dynamically changing threshold |
US5107422A (en) * | 1989-10-02 | 1992-04-21 | Kamentsky Louis A | Method and apparatus for measuring multiple optical properties of biological specimens |
US5072382A (en) * | 1989-10-02 | 1991-12-10 | Kamentsky Louis A | Methods and apparatus for measuring multiple optical properties of biological specimens |
US5313532A (en) * | 1990-01-23 | 1994-05-17 | Massachusetts Institute Of Technology | Recognition of patterns in images |
US5123056A (en) * | 1990-02-02 | 1992-06-16 | Siemens Medical Systems, Inc. | Whole-leg x-ray image processing and display techniques |
US5655029A (en) * | 1990-11-07 | 1997-08-05 | Neuromedical Systems, Inc. | Device and method for facilitating inspection of a specimen |
EP0556286B1 (en) * | 1990-11-07 | 1999-04-07 | Neuromedical Systems, Inc | Method with inspection auditing for images presented on a display |
US5257182B1 (en) * | 1991-01-29 | 1996-05-07 | Neuromedical Systems Inc | Morphological classification system and method |
US5218645A (en) * | 1991-03-29 | 1993-06-08 | Cell Analysis Systems, Inc. | Method and apparatus for separating cell objects for analysis |
US5216500A (en) * | 1991-07-15 | 1993-06-01 | Rj Lee Group, Inc. | Simultaneously recording of video image and microscope stage position data |
US5260871A (en) * | 1991-07-31 | 1993-11-09 | Mayo Foundation For Medical Education And Research | Method and apparatus for diagnosis of breast tumors |
US5428690A (en) * | 1991-09-23 | 1995-06-27 | Becton Dickinson And Company | Method and apparatus for automated assay of biological specimens |
CA2077781A1 (en) * | 1991-09-23 | 1993-03-24 | James W. Bacus | Method and apparatus for automated assay of biological specimens |
JPH05303621A (en) | 1992-04-24 | 1993-11-16 | Fujitsu Ltd | Method for displaying image information |
JP3018733B2 (en) | 1992-05-13 | 2000-03-13 | 株式会社ニコン | Still image transmission device |
JP3321197B2 (en) | 1992-06-22 | 2002-09-03 | オリンパス光学工業株式会社 | Microscope still image transmission system |
JP3448847B2 (en) | 1992-07-29 | 2003-09-22 | オリンパス光学工業株式会社 | Microscope still image observation system |
JPH06118307A (en) | 1992-10-02 | 1994-04-28 | Nikon Corp | Microscopic examination assisting device |
EP0610916A3 (en) * | 1993-02-09 | 1994-10-12 | Cedars Sinai Medical Center | Method and apparatus for providing preferentially segmented digital images. |
US5505948A (en) * | 1993-06-01 | 1996-04-09 | Dermatology Home Products, Inc. | Home skin peel composition for producing healthy and attractive skin |
JPH0715721A (en) | 1993-06-28 | 1995-01-17 | Nikon Corp | Image transmitting device |
US5793969A (en) * | 1993-07-09 | 1998-08-11 | Neopath, Inc. | Network review and analysis of computer encoded slides |
US5625765A (en) * | 1993-09-03 | 1997-04-29 | Criticom Corp. | Vision systems including devices and methods for combining images for extended magnification schemes |
JPH07107379A (en) * | 1993-10-01 | 1995-04-21 | Sharp Corp | Still image pickup device |
US5505946A (en) | 1994-04-01 | 1996-04-09 | Trustees Of Univ Of Pa | Bowman-birk inhibitor concentrate compositions and methods for the treatment of pre-malignant tissue |
JP3557246B2 (en) | 1994-06-08 | 2004-08-25 | オリンパス株式会社 | Microscope image remote observation device and microscope image remote observation method |
US5499097A (en) * | 1994-09-19 | 1996-03-12 | Neopath, Inc. | Method and apparatus for checking automated optical system performance repeatability |
JPH08287218A (en) * | 1995-04-10 | 1996-11-01 | Sharp Corp | Image composing device |
JP2000501844A (en) * | 1995-07-19 | 2000-02-15 | モルフォメトリックス テクノロジーズ インク. | Automatic scanning of microscope slides |
US6091842A (en) * | 1996-10-25 | 2000-07-18 | Accumed International, Inc. | Cytological specimen analysis system with slide mapping and generation of viewing path information |
US6430309B1 (en) * | 1995-09-15 | 2002-08-06 | Monogen, Inc. | Specimen preview and inspection system |
US6148096A (en) * | 1995-09-15 | 2000-11-14 | Accumed International, Inc. | Specimen preview and inspection system |
US6151405A (en) * | 1996-11-27 | 2000-11-21 | Chromavision Medical Systems, Inc. | System and method for cellular specimen grading |
US6078681A (en) * | 1996-03-18 | 2000-06-20 | Marine Biological Laboratory | Analytical imaging system and process |
US5978804A (en) * | 1996-04-11 | 1999-11-02 | Dietzman; Gregg R. | Natural products information system |
US5796861A (en) * | 1996-07-12 | 1998-08-18 | Frim International, Inc. | Mosaic construction, processing, and review of very large electronic micrograph composites |
US6404906B2 (en) * | 1997-03-03 | 2002-06-11 | Bacus Research Laboratories,Inc. | Method and apparatus for acquiring and reconstructing magnified specimen images from a computer-controlled microscope |
US6031930A (en) * | 1996-08-23 | 2000-02-29 | Bacus Research Laboratories, Inc. | Method and apparatus for testing a progression of neoplasia including cancer chemoprevention testing |
US6396941B1 (en) * | 1996-08-23 | 2002-05-28 | Bacus Research Laboratories, Inc. | Method and apparatus for internet, intranet, and local viewing of virtual microscope slides |
US6272235B1 (en) * | 1997-03-03 | 2001-08-07 | Bacus Research Laboratories, Inc. | Method and apparatus for creating a virtual microscope slide |
US5874162A (en) * | 1996-10-10 | 1999-02-23 | International Business Machines Corporation | Weighted sintering process and conformable load tile |
US5836877A (en) * | 1997-02-24 | 1998-11-17 | Lucid Inc | System for facilitating pathological examination of a lesion in tissue |
US6091930A (en) * | 1997-03-04 | 2000-07-18 | Case Western Reserve University | Customizable interactive textbook |
US5993001A (en) * | 1997-06-05 | 1999-11-30 | Joslin Diabetes Center, Inc. | Stereoscopic imaging system for retinal examination with remote examination unit |
WO2001027679A1 (en) | 1999-10-15 | 2001-04-19 | Cellavision Ab | Microscope and method for manufacturing a composite image with a high resolution |
US6711283B1 (en) * | 2000-05-03 | 2004-03-23 | Aperio Technologies, Inc. | Fully automatic rapid microscope slide scanner |
US7027628B1 (en) * | 2000-11-14 | 2006-04-11 | The United States Of America As Represented By The Department Of Health And Human Services | Automated microscopic image acquisition, compositing, and display |
US6816606B2 (en) * | 2001-02-21 | 2004-11-09 | Interscope Technologies, Inc. | Method for maintaining high-quality focus during high-throughput, microscopic digital montage imaging |
US7062091B2 (en) * | 2001-01-16 | 2006-06-13 | Applied Precision, Llc | Coordinate calibration for scanning systems |
SE517626C3 (en) * | 2001-04-12 | 2002-09-04 | Cellavision Ab | Microscopy procedure for scanning and positioning an object, where images are taken and joined in the same image coordinate system to accurately set the microscope table |
GB2383487B (en) * | 2001-12-18 | 2006-09-27 | Fairfield Imaging Ltd | Method and apparatus for acquiring digital microscope images |
US7116440B2 (en) * | 2003-02-28 | 2006-10-03 | Aperio Technologies, Inc. | Image processing and analysis framework |
US7792338B2 (en) * | 2004-08-16 | 2010-09-07 | Olympus America Inc. | Method and apparatus of mechanical stage positioning in virtual microscopy image capture |
-
2005
- 2005-08-11 US US11/202,045 patent/US7792338B2/en active Active
- 2005-08-15 EP EP05785418.4A patent/EP1794706B1/en active Active
- 2005-08-15 WO PCT/US2005/028982 patent/WO2006023443A2/en active Application Filing
- 2005-08-15 JP JP2007527913A patent/JP4863998B2/en active Active
- 2005-08-15 CA CA2576183A patent/CA2576183C/en active Active
Non-Patent Citations (1)
Title |
---|
None |
Cited By (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
WO2008028944A1 (en) * | 2006-09-06 | 2008-03-13 | Leica Microsystems Cms Gmbh | Method and microscopic system for scanning a sample |
US9588329B2 (en) | 2006-09-06 | 2017-03-07 | Leica Microsystems Cms Gmbh | Method and microscopic system for scanning a sample |
US10481374B2 (en) | 2006-09-06 | 2019-11-19 | Leica Microsystems Cms Gmbh | Method and microscopy system for scanning a sample |
US10698192B2 (en) | 2006-09-06 | 2020-06-30 | Leica Microsystems Cms Gmbh | Method and microscopy system for scanning a sample |
US9261691B2 (en) | 2010-05-27 | 2016-02-16 | Canon Kabushiki Kaisha | Image pickup apparatus |
DE102010039652A1 (en) | 2010-08-23 | 2012-02-23 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Mosaic shot generation |
WO2012025488A1 (en) | 2010-08-23 | 2012-03-01 | Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. | Mosaic image generation |
US9253449B2 (en) | 2010-08-23 | 2016-02-02 | Fraunhofer-Gesellschaft Zur Foerderung Der Angewandten Forschung E.V. | Mosaic picture generation |
EP4067965A1 (en) * | 2021-03-31 | 2022-10-05 | PreciPoint GmbH | Method of providing an assembled image using a digital microscope, digital microscope system, and program for providing an assembled image using a digital microscope |
WO2022207731A1 (en) * | 2021-03-31 | 2022-10-06 | Precipoint Gmbh | Method of providing an assembled image using a digital microscope, digital microscope system, and program for providing an assembled image using a digital microscope |
Also Published As
Publication number | Publication date |
---|---|
WO2006023443A3 (en) | 2006-09-28 |
JP4863998B2 (en) | 2012-01-25 |
CA2576183C (en) | 2013-04-02 |
EP1794706B1 (en) | 2014-11-26 |
CA2576183A1 (en) | 2006-03-02 |
US7792338B2 (en) | 2010-09-07 |
JP2008510201A (en) | 2008-04-03 |
US20060034543A1 (en) | 2006-02-16 |
EP1794706A2 (en) | 2007-06-13 |
EP1794706A4 (en) | 2009-10-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CA2576183C (en) | Method and apparatus of mechanical stage positioning in virtual microscopy image capture | |
US8581996B2 (en) | Imaging device | |
US8508587B2 (en) | Imaging device | |
US7925067B2 (en) | Focusable virtual microscopy apparatus and method | |
JP4779041B2 (en) | Image photographing system, image photographing method, and image photographing program | |
CN101395676B (en) | Method for operating a measurement system containing a scanning probe microscope, and measurement system | |
US20100149362A1 (en) | Imaging Device | |
JP3764364B2 (en) | Image feature point detection method, image processing method, and program | |
US20040114218A1 (en) | Method in microscopy and a microscope, where subimages are recorded and puzzled in the same coordinate system to enable a precise positioning of the microscope stage | |
EP2233882B1 (en) | Measuring device, method, and program | |
US7349580B2 (en) | Apparatus and method for calibrating zoom lens | |
US20040037547A1 (en) | Lens control apparatus, lens control method and camera | |
KR20130102465A (en) | Height measuring method and height measuring device | |
JP2006099602A (en) | Image construction method, fingerprint image construction apparatus and program | |
EP1377865B1 (en) | A method in microscopy and a microscope, where subimages are recorded and puzzled in the same coordinate system to enable a precise positioning of the microscope stage | |
CN116823605A (en) | Quick image stitching method for low-cost pathological section scanner | |
JP2000028336A (en) | Device for measuring shape and method therefor | |
CN118276296A (en) | Slide scanning method, slide reader and storage medium | |
CN112651261B (en) | Calculation method for conversion relation between high-precision 2D camera coordinate system and mechanical coordinate system | |
JP2014178781A (en) | Image processor, microscope system and image processing method | |
JP2010283088A (en) | Wafer appearance inspection device | |
JP2011259504A (en) | Imaging apparatus | |
WO2021005231A1 (en) | Lens calibration method for digital imaging apparatus | |
JP7087984B2 (en) | Imaging system and setting device | |
CN115138527B (en) | Rapid processing path generation method through visual guidance |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AK | Designated states |
Kind code of ref document: A2 Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW |
|
AL | Designated countries for regional patents |
Kind code of ref document: A2 Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU LV MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG |
|
121 | Ep: the epo has been informed by wipo that ep was designated in this application | ||
WWE | Wipo information: entry into national phase |
Ref document number: 2576183 Country of ref document: CA |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2007527913 Country of ref document: JP |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
WWE | Wipo information: entry into national phase |
Ref document number: 2005785418 Country of ref document: EP |
|
WWP | Wipo information: published in national office |
Ref document number: 2005785418 Country of ref document: EP |