US20030095696A1 - System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans - Google Patents

System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans Download PDF

Info

Publication number
US20030095696A1
US20030095696A1 US10/245,782 US24578202A US2003095696A1 US 20030095696 A1 US20030095696 A1 US 20030095696A1 US 24578202 A US24578202 A US 24578202A US 2003095696 A1 US2003095696 A1 US 2003095696A1
Authority
US
United States
Prior art keywords
image
defined
location
nodule
im
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/245,782
Inventor
Anthony Reeves
David Yankelevitz
Claudia Henshke
Antoni Chan
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Cornell Research Foundation Inc
Original Assignee
Cornell Research Foundation Inc
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority to US32203801P priority Critical
Application filed by Cornell Research Foundation Inc filed Critical Cornell Research Foundation Inc
Priority to US10/245,782 priority patent/US20030095696A1/en
Assigned to CORNELL RESEARCH FOUNDATION, INC. reassignment CORNELL RESEARCH FOUNDATION, INC. ASSIGNMENT OF ASSIGNORS INTEREST (SEE DOCUMENT FOR DETAILS). Assignors: YANKELEVITZ, DAVID, CHAN, ANTONI, HENSCHKE, CLAUDIA, REEVES, ANTHONY P.
Publication of US20030095696A1 publication Critical patent/US20030095696A1/en
Assigned to CORNELL RESEARCH FOUNDATION, INC. reassignment CORNELL RESEARCH FOUNDATION, INC. CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT SERIAL NUMBER FROM 10/257067 TO 10245782. DOCUMENT PREVIOUSLY RECORDED AT REEL 013655 FRAME 0987. Assignors: YANKELEVITZ, DAVID, CHAN, ANTONI, HENSCHKE, CLAUDIA, REEVES, ANTHONY P.
Assigned to CORNELL RESEARCH FOUNDATION, INC. reassignment CORNELL RESEARCH FOUNDATION, INC. CORRECTIVE ASSIGNMENT TO CORRECT THE ADDRESS OF THE ASSIGNEE PREVIOUSLY RECORDED ON REEL 014155 FRAME 0431. ASSIGNOR(S) HEREBY CONFIRMS THE CORRECTIVE ASSIGNMENT RECORDED ON JUNE 9, 2003. Assignors: YANKELEVITZ, DAVID, CHAN, ANTONI, HENSCHKE, CLAUDIA, REEVES, ANTHONY P.
Application status is Abandoned legal-status Critical

Links

Images

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00Apparatus for radiation diagnosis, e.g. combined with radiation therapy equipment
    • A61B6/52Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5258Devices using data or image processing specially adapted for radiation diagnosis involving detection or reduction of artifacts or noise
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/20Image enhancement or restoration by the use of local operators
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/155Segmentation; Edge detection involving morphological operators
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30061Lung
    • G06T2207/30064Lung nodule

Abstract

The present invention is directed to diagnostic imaging of small pulmonary nodules. There are two main stages in the evaluation of pulmonary nodules from Computed Tomography (CT) scans: detection, in which the locations of possible nodules are identified, and characterization, in which a nodule is represented by measured features that may be used to evaluate the probability that the nodule is cancer. Currently, the most useful prediction feature is growth rate, which requires the comparison of size estimates from two CT scans recorded at different times. The present invention includes methods for detection and feature extraction for size characterization. The invention focuses the analysis of small pulmonary nodules that are less than 1 centimeter in size, but is also suitable for larger nodules as well.

Description

  • This application claims the benefit of U.S. Provisional Application No. 60/322,038, filed Sep. [0001] 14, 2001, which is incorporated herein by reference.
  • BACKGROUND OF THE INVENTION
  • The present invention relates to the art of diagnostic imaging of small pulmonary nodules. In particular, the present invention is related to analyzing and manipulating computed tomography scans to: segment the lungs, measure lung volume, locate and determine the size of the nodules without explicit segmentation, register the nodules using a rigid-body transformation, and removing the pleural surface from juxtapleural nodules in thresholded images. [0002]
  • Lung cancer is the leading cause of cancer deaths among the population in the United States. Each year there are about 170,000 newly diagnosed cases of lung cancer and over 150,000 deaths. More people die of lung cancer than of colon, breast, and prostate cancers combined. Despite the research and improvements in medical treatments related to surgery, radiation therapy, and chemotherapy, currently the overall survival rate of all lung cancer patients is only about 14 percent. Unfortunately the survival rate has remained essentially the same over the past three decades. The high mortality rate of lung cancer is caused by the fact that more than 80% lung cancer is diagnosed after it has metastasized. Patients with early detection of lung cancer followed by proper treatment with surgery and/or combined with radiation and chemotherapy can improve their five-year survival rate from 13 percent to about 41 percent. Given that earlier-stage intervention leads to substantially higher rates of survival, it is therefore a major public health directive to reduce the mortality of lung cancer through detection and intervention of the cancer at earlier and more curable stages. [0003]
  • The development of the computed tomography (CT) technology and post-processing algorithms has provided radiologists with a useful tool for diagnosing lung cancers at early stages. However, current CT systems have their inherent shortcomings in that the amount of chest CT images (data) that is generated from a single CT examination, which can range from 30 to over 300 slices depending on image resolution along the scan axial direction, becomes a huge hurdle for the radiologists to interpret. Accordingly, there is a constant need for the improvement and development of diagnostic tools for enabling a radiologist to review and interpret the vast amount of information that is obtained through a CT examination. [0004]
  • International Publication No. WO 01/78005 A2 discloses a system and method for three dimensional image rendering and analysis, and is incorporated herein by reference. The system performs a variety of tasks that aid a radiologist in interpreting the results of a CT examination. [0005]
  • One task that radiologists focus on is segmenting the lung region from the image of a single slice obtained from the CT examination. In the prior art, some have suggested using a linear discriminant function and morphological filtering to automatically segment the lungs (S. Hu, E. A. Hoffman, and J. M. Reinhardt, “Automatic Lung Segmentation for Accurate Quantitation of Volumetric X-Ray CT Images,” [0006] IEEE Transactions on Medical Imaging, Vol 20, No 6, June 2001, which is incorporated herein by reference) while others have used mean and median filtering to remove the streaking artifacts due to excessive x-ray quantum noise (J. Hsieh, “Generalized Adaptive Median Filters and their Application in CT,” SPIE, Vol 2299, 1994; J. Hsieh, “Adaptive Trimmed Mean Filter for CT Imaging,” SPIE, Vol 2299, 1994 which is incorporated herein by reference).
  • Radiologists also study the location and size of the pulmonary nodules in the CT scan. It is preferred if the radiologist could perform this analysis without the use of explicit segmentation. In some prior work, the location of a nodule was determined by finding the center of mass of the nodule through an iterative correlation-based procedure (A. P. Reeves, W. J. Kostis, D. F. Yankelevitz, C. I. Henschke, “Analysis of Small Pulmonary Nodules without Explicit Segmentation of CT images,” [0007] Radiological Society of North America—2000 Scientific Program, vol. 217, pgs. 243-4, November 2000 which is incorporated herein by reference). The method works for isolated pulmonary nodules, but fails on nodules attached to the pleural surface.
  • Radiologists also estimate a measurement of doubling time of a nodule by registering two separate images of the nodule taken at two different times (time-1 and time-2). This analysis requires that the time-1 and time-2 nodules be registered correctly so that the growth can be properly measured. Other objects such as vessels and bronchial tubes must also be registered together. This results in their absence in the difference image and little effect on the growth measurement. Previously, two nodules were registered by finding the centers of mass of the nodules and translating the image accordingly (A. P. Reeves, W. J. Kostis, D. F. Yankelevitz, C. I. Henschke, “Analysis of Small Pulmonary Nodules without Explicit Segmentation of CT images,” [0008] Radiological Society of North America—2000 Scientific Program, vol. 217, pgs. 243-4, November 2000 which is incorporated herein by reference). However, this analysis did not guarantee that the two nodules would be correctly orientated, and that the other objects in the image would registered because these objects might be rotated about the nodule. Some have registered the nodules by performing a maximization search of the mutual information metric over the rigid-body transformation parameters (F. Maes, A. Collignon, D. Vandermeulen, G. Marchal and P. Suetens, “Multimodality image registration by maximization of mutual information,” IEEE Transactions on Medical Imaging, vol. 16, no. 2, pgs. 187-198, April 1997; Takagi, N.; Kawata, Y.; Nikvi, N.; Morit, K.; Ohmatsu, H.; Kakinuma, R.; Eguchi, K.; Kusumoto, M.; Kaneko, M.; Moriyama, N. “Computerized characterization of contrast enhancement patterns for classifying pulmonary nodules” Image Processing, 2000. Proceedings. 2000 International Conference on, vol. 1, pgs. 188-191, 2000 which are incorporated herein by reference).
  • Radiologists also need to remove the pleural surface from juxtapleural nodules in CT images. In some prior work, three-dimensional morphological filtering and mathematical moments were used to segment a juxtapleural nodule from pleural surface in a binary image (A. P. Reeves, W. J. Kostis, “Computer-Aided Diagnosis of Small Pulmonary Nodules,” [0009] Seminars in Ultrasound, CT, and MRI, vol. 21, no. 2, pgs. 116-128, April 2000 which is incorporated herein by reference).
  • SUMMARY OF THE INVENTION
  • The present invention is directed to diagnostic imaging of small pulmonary nodules. There are two main stages in the evaluation of pulmonary nodules from Computed Tomography (CT) scans: detection, in which the locations of possible nodules are identified, and characterization, in which a nodule is represented by measured features that may be used to evaluate the probability that the nodule is cancer. Currently, the most useful prediction feature is growth rate, which requires the comparison of size estimates from two CT scans recorded at different times. The present invention includes methods for detection and feature extraction for size characterization. The invention focuses the analysis of small pulmonary nodules that are less than 1 centimeter in size, but is also suitable for larger nodules as well. [0010]
  • For the purpose of Computer Aided Diagnosis (CAD), pulmonary nodules are dichotomized into attached nodules and isolated nodules based on their location with respect to other solid lung structures. Attached nodules are adjacent to some larger solid structure, such as the pleural surface. Isolated nodules consist of both well-circumscribed nodules and nodules that are larger than all adjacent structures, such as blood vessels or bronchi. Nodules themselves may be solid, non-solid or part-solid. The analysis of a CT scan for the existence and study of pulmonary nodules generally entails the following: [0011]
  • 1. Detection [0012]
  • (a) Identify the lung regions and main bronchi from thoracic CT images [0013]
  • (b) Separate the lungs into two major regions: (1) the lung parenchyma and (2) the lung surface region, including the pleural surface and major airways. [0014]
  • (c) Identify possible locations of isolated nodules in the lung parenchyma region and identify possible locations of attached nodules in the in the lung surface regions. [0015]
  • 2. Characterization [0016]
  • (a) Starting with a single location point within a possible nodule, identify the nodule region in the CT images. This entails locating the geometric center of the nodule and approximating its size. [0017]
  • (b) Given the location and approximate size of a nodule, compute characteristic features of the nodule, including robust size estimates. [0018]
  • In connection with the overall methodology of analyzing CT scans, the present invention includes sub-methods for the following: [0019]
  • 1. The Segmentation of Whole Lung CT Scans into Lung Parenchyma and Lung Surface Regions [0020]
  • The first preprocessing stage in CT lung image analysis is to obtain the regions of interest from the whole lung scans. The lung region consists of all tissue found within the pleural surface, including lung parenchyma, vessels, and possibly nodules. Features of this approach are the partitioning of the lung into three major regions and the tailoring of the segmentation algorithm for each region. In addition a distinction is made between the central lung parenchyma and the region of the of the lung parenchyma near to the lung walls. A properly segmented lung region greatly reduces the search space of an entire CT scan. [0021]
  • 2. The Characterization of Lung Air Volume and Inspiration Both From the Entire Parenchyma Region and from Single Axial CT Images [0022]
  • The total volume of the lungs is estimated from the whole lung scans. In addition the change in volume between different scans due to changes in inspiration is also addressed. [0023]
  • 3. The Automatic Location and Size Characterization of Nodules [0024]
  • An algorithm finds the center and approximate size of pulmonary nodules in CT images without the use of explicit segmentation. The algorithm has a weighting function that locates the center of mass of the nodule. A second weighting function, centered on the location of the first weighting function, estimates the size of the nodule. The process is repeated with weighting functions of increasing size until the size of the nodule region is reliably determined. The algorithm works for both isolated nodules and nodules attached to the walls. [0025]
  • The algorithm is designed for use on images that are resampled from high-resolution CT scans (1 mm slice thickness) into an isotropic voxel space. Such a system could be useful in helping radiologists analyze pulmonary nodules. In the CT image browser, the radiologist could click on a nodule and, using the algorithm, the computer could automatically locate the center and size of the nodule. Using this information, the computer then clips out a region of interest for the nodule and performs some nodule characterization analysis and perhaps some 3D visualization. [0026]
  • 4. The Registration of Nodules from Two Scans [0027]
  • An algorithm registers two different scans of a nodule region. A three-dimensional rigid-body transformation of one scan is made to optimally match the location and orientation (6-degrees of freedom) of the second scan. Powell's method is the preferred search strategy. [0028]
  • The analysis of pulmonary nodules without explicit segmentation estimates a measurement of doubling time by applying a weighted function on the difference image of the two nodules. The analysis requires that the time-1 and time-2 nodules be registered correctly so that the growth can be properly measured. Other objects such as vessels and bronchial tubes must also be registered together, resulting in their absence in the difference image and little effect on the growth measurement. [0029]
  • 5. The Segmentation of Nodules Attached to the Pleural Surface. [0030]
  • An algorithm segments nodules that are attached to the pleural surface from the pleural surface. Starting from a location within a nodule, the direction of the pleural surface is determined. A cutting plane is then iteratively moved towards the surface until the volume of the region behind the wall suddenly increases. The increase in volume indicates that the pleural surface has been reached. The orientation and location of the plane is then preferably optimized by a hill climbing procedure. [0031]
  • The algorithm removes the pleural surface (and any other extraneous objects) from a high-resolution image containing a juxtapleural nodule. The algorithm is not only required to perform a good segmentation, but expected to perform the same segmentation when given different scans of the same nodule. This property is necessary because the resulting segmented nodule will be used for the characterization and analysis of the nodule. If the segmentation is not performed consistently between images scanned at different times, then the doubling time estimation will not be accurate. [0032]
  • A preferred embodiment of the present invention is a method and apparatus for generating a lung mask for segmenting a lung image from voxel data containing the lung image, noise, solid components and surrounding background information. The apparatus of the invention is a masking unit configured with the teachings of the method of the invention. The invention can also be practiced on a machine readable medium. The method includes initially applying a median filter and a mean filter to the voxel data to reduce noise. The noise reduced voxel data is then thresholded to identify solid components and other structures. The surrounding background in the noise reduced voxel data is identified and deleted. The connected components of the voxel data are labeled, and the largest connected components are determined to select a lung region having a geometric form. The voxel data is morphological filtered to refine the geometric form of the lung region. [0033]
  • In a preferred embodiment, the voxel data is associated with a plurality of slices through a patient's lung with the slices beginning at about the patient's shoulders and the application of the median filter and the mean filter is performed for the first 25 percent of the plurality of slices only to substantially reduce the computation time. Preferably the median filter has a size of 4×4, and the mean filter has a size of 1×3. Preferably the voxel data in step is thresholded at a gray level of about 500. Preferably the largest connected components are selected to be associated with more than about 1 percent of the voxel data. Preferably the voxel data is associated with a plurality of slices for the morphological filtering with the slices being divided into a first end region, a middle region, and a second end region. The morphological filtering is preferably performed with 2D circular filter having a first diameter in the first end region and the second end region while being performed with 2D circular filter having a second diameter which is about twice the first diameter in the middle region. [0034]
  • The present invention also includes a method and apparatus for measuring lung volume from a segmented lung image. The lung image is obtained from a scan which includes a plurality of slices of voxel data having a gray level value and a volume associated therewith. The apparatus of the invention is a lung volume measuring unit configured with the teachings of the method of the invention. The invention can also be practiced on a machine readable medium. The method includes initially generating a matrix of entries from the segmented lung image. The matrix includes a plurality of columns and a plurality of rows. Each of the plurality of columns represent the gray level value and each of the plurality of rows represent one of the plurality of slices in the scan with the entries corresponding to the number of times that the gray level occurs in the corresponding slice. The number of voxels in the segmented lung image is next determined from the matrix entries. The number of voxels in the segmented lung image is multiplied by the volume of each voxel. [0035]
  • The present invention also includes a method and apparatus for measuring volume of tissue in a segmented lung image. The lung image is obtained from a scan which includes a plurality of slices of voxel data having a gray level value and a volume associated therewith. The apparatus of the invention is a lung tissue measuring unit configured with the teachings of the method of the invention. The invention can also be practiced on a machine readable medium. The method includes initially generating a matrix of entries from the segmented lung image. The matrix includes a plurality of columns and a plurality of rows. Each of the plurality of columns represent the gray level value and each of the plurality of rows represent one of the plurality of slices in the scan with the entries corresponding to the number of times that the gray level occurs in the corresponding slice. The sum of tissue of voxels in the segmented lung image is next determined from the matrix entries. The sum of tissue of voxels in the segmented lung image is multiplied by the volume of each voxel. The sum of tissue of voxels is preferably calculated by summing the product of each matrix entry multiplied by the corresponding gray level value divided by a gray level value assigned for tissue. [0036]
  • The present invention also includes a method and apparatus for finding the location, P′, and size, r′, of a pulmonary nodule in a high-resolution computed tomography (CT) image. The apparatus of the invention is a nodule finding unit configured with the teachings of the method of the invention. The invention can also be practiced on a machine readable medium. In the method, a set of initial processing parameters including an initial location, P[0037] 1, an initial size, r1, and target value, T, is initially selected. An initial new location Pi′ of the nodule is computed with a locator template function. After incrementally increasing size, ri, a new location Pi′ of the nodule is computed with the locator template function, and a size metric is computed with a sizing template function. The size, ri, is incrementally increased while determining a new location Pi′ of the nodule and computing the size metric until the size metric is less than the target value. The location, P′, and the size, r′, is then returned from the previous iteration of increasing size, ri.
  • A preferred method for finding the location, P, and size, r, of a pulmonary nodule in a high-resolution computed tomography image initially includes windowing the image to ignore bone structures, and selecting a locator template function and a sizing template function. A set of initial processing parameters including: an initial location, P; size, r; and termination criteria is selected. A search is performed to determine a maximum response of the locator template function. A response of the sizing template function is determined and compared to the termination criteria. If the termination criteria has not been satisfied, the size, r, is incrementally increased, the response functions are determined and compared to the termination criteria. Once the termination criteria are satisfied the location, P, and size, r, of the nodule are outputted. [0038]
  • In the preferred method for finding the location, P, and size, r, of a pulmonary nodule in a high-resolution computed tomography image, preferably the image at intensities over about 1000 are clipped to window the image. Preferably the locator template function is either; a Gaussian template function, a Laplacian of the Gaussian template function, or a difference of Gaussians template function. The template function preferably has at least four parameters corresponding to the x-location, y-location, z-location, and radius. The initial location, P, can generally be either calculated from the image or specified by a user. Preferred methods for searching include a hill climbing method and Powell's method. [0039]
  • The present invention also includes a method and apparatus for registering 3-d images of a pulmonary nodule from a high-resolution computed tomography (CT) scans. The images include a first image (im[0040] 1) obtained at time-1 and a second image (im2) obtained at time-2, and are in a floating point pixel-format associated with a 6-dimensional parameter space. The apparatus of the invention is a registering unit configured with the teachings of the method of the invention. The invention can also be practiced on a machine readable medium. The method includes calculating initial rigid-body transformation parameters for a rigid-body transformation on the first image (im1). The optimum rigid-body transformation parameters are determined by calculating a registration metric between the second image (im2) and the rigid-body transformation on the first image (im1). A registered image is generated from the optimum rigid-body transformation parameters.
  • In a preferred method for registering 3-d images of a pulmonary nodule from a high-resolution computed tomography (CT) scans, the calculation of the initial rigid-body transformation parameters is preferably preceded by masking one of the images by setting pixels to a background value. Preferably the background value is about −1000. The registration metric is generally either minimized or maximized. In one preferred embodiment, the registration metric is preferably calculated by: [0041]
  • transforming the first image (im[0042] 1) with the initial rigid-body transformation parameters to obtain a transformed first image (im1t);
  • calculating the registration metric as a correlation (C.) between the transformed first image (im[0043] 1t) and the second image (im2); and
  • searching for the maximum correlation (C.) in the 6-dimensional parameter space. [0044]
  • In another preferred embodiment, the registration metric is preferably calculated by: [0045]
  • transforming the first image (im[0046] 1) with the initial rigid-body transformation parameters to obtain a transformed first image (im1t);
  • calculating the registration metric as a mean-squared-difference (MSD) between the transformed first image (im[0047] 1t) and the second image (im2); and
  • searching for the minimum mean-squared-difference (MSD) in the 6-dimensional parameter space. [0048]
  • The transforming of the first image (im[0049] 1) to obtain the transformed first image (im1t) is preferably a mapping of a point v in 3-d space to a point v′ in transformed space defined by: v = R x R y R z v + [ t x t y t z ]
    Figure US20030095696A1-20030522-M00001
  • wherein R[0050] x, Ry, and Rz are rotation matrices defined as: R x = [ 1 0 0 0 cos ( r x ) - sin ( r x ) 0 sin ( r x ) cos ( r x ) ] R y = [ cos ( r y ) 0 sin ( r y ) 0 1 0 - sin ( r y ) 0 cos ( r y ) ] R z = [ cos ( r z ) - sin ( r z ) 0 sin ( r z ) cos ( r z ) 0 0 0 1 ] .
    Figure US20030095696A1-20030522-M00002
  • The initial rigid-body transformation parameters preferably include six parameters (tx,ty,tz,rx,ry,rz) respectively defined as translation in x, translation in y, translation in z, rotation about the x-axis, rotation about the y-axis, and rotation about the z-axis. Preferably the initial rotation parameters (rx,ry,rz) are all set to zero, and the initial translation parameters (tx,ty,tz,) are set so that the nodule in the first image (im[0051] 1) overlaps the nodule in the second image (im2) during the initial calculation of the registration metric. The initial translation parameters (tx,ty,tz,) can be set to a difference between the center of the first image (im1) and the center of the second image (im2). Preferably the initial translation parameters (tx,ty,tz) are set to a difference between the center of mass of the first image (im1) and the center of mass of the second image (im2). The searching is can be conducted by calculating the correlation (C) or mean-squared-difference (MSD) for every possible set of rigid-body transformation parameters. Preferably the searching is conducted by either a Hill-Climbing search method or by Powell's method.
  • The present invention also includes a method and apparatus for removing extraneous matter from an image having a juxtapleural nodule. The apparatus of the invention is a processing unit configured with the teachings of the method of the invention. The invention can also be practiced on a machine readable medium. The method includes providing an initial location P′. A spherical volume that fits inside the image and is centered at the initial location P′ is calculated. A center of mass, COM, of the spherical volume is calculated. An initial direction d′ directed towards the extraneous matter is determined in accordance with the following equation: [0052] d = COM - P COM - P .
    Figure US20030095696A1-20030522-M00003
  • A current location P[0053] i is initialized to be equal to the initial location P′. A current direction di is initialized to be equal to the initial direction d′. A maximum ratio γmax, step size s, prior mass massi-1, and prior change in mass Δi-1 are initialized. The current location Pi is moved by the step size s in the current direction di. An equation defining a plane A is determined so that the plane A is normal to the current direction di and the plane A passes through the current location Pi. A current mass, massi, is calculated of the nodule on a side of the plane A opposing that of the extraneous matter. A current change in mass Δi is calculated by subtracting the prior mass massi-1 from the current mass massi. A current ratio γ is calculated in accordance with the following equation: γ = Δ i Δ i - 1 - 1.
    Figure US20030095696A1-20030522-M00004
  • The prior mass mass[0054] i-1 is set equal to the current mass massi. The prior change in mass Δi-1 is set equal to the current change in mass Δi. The current ratio γ is compared to the maximum ratio γmax. The current direction di is modified to minimize the current mass massi, and the above steps are repeated starting with moving the current location Pi by the step size s in the current direction di while the current ratio γ is one of less than and equal to the maximum ratio γmax. The area of the nodule partitioned by the plane A is output in response to the current ratio γ being greater than the maximum ratio γmax.
  • In the preferred method for removing extraneous matter from an image having a juxtapleural nodule, the extraneous matter can include a pleural surface. Preferably the maximum ratio γ[0055] max is initialized to 0.5 and initializing the step size s is initialized to 1.5. Preferably the method also includes following the steps after the current ratio γ is determined to be greater than the maximum ratio γmax:
  • defining the current location P[0056] i as being visited;
  • determining on which side of the plane A the current location P[0057] i is located;
  • terminating in reponse to the current location P[0058] i not being located on a side of the plane opposing that of the extraneous matter;
  • defining the current location P[0059] i as being part of a region of interest in response to the current location Pi being located on the side of the plane opposing that of the extraneous matter; and
  • performing these additional steps recursively using a location corresponding to at least one of six (6) one-pixel moves from the current location P[0060] i.
  • Preferably the step where the current direction d, is modified to minimize the current mass mass[0061] i, and the step where the area of the nodule partitioned by the plane A is output in response to the current ratio γ being greater than the maximum ratio γmax include the steps of:
  • calculating recursively the current mass mass[0062] i of the nodule on a side of the plane A opposing that of the extraneous matter using at least one of six (6) directions and a step size s1 from the current location Pi; and
  • defining the current direction d[0063] i equal to the direction yielding the largest decrease in the current mass massi.
  • Preferably the initial location P′ is located near a center of the nodule. [0064]
  • For a better understanding of the present invention, reference is made to the following description to be taken in conjunction with the accompanying drawings and its scope will be pointed out in the appended claims.[0065]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • Preferred embodiments of the invention have been chosen for purposes of illustration and description and are shown in the accompanying drawings, wherein: [0066]
  • FIG. 1 illustrates at the top six (6) images that are selected slices from a, single computer tomography scan along with the corresponding extracted lung regions from the selected slices at the bottom; [0067]
  • FIG. 2 illustrates a histogram of image intensity of the lung region that includes parenchyma, vessels, and nodules and other solid structures such as bone and organs; [0068]
  • FIG. 3 is a table illustrating the densities of structures within the lungs; [0069]
  • FIG. 4 illustrates an air pocket that is not part of the lungs but has similar characteristics to the modeling of the lungs; [0070]
  • FIG. 5 is a lung mask generation algorithm; [0071]
  • FIG. 6 is a flow chart of the lung segmentation algorithm with sample images incorporated therein; [0072]
  • FIG. 7 illustrates on the left hand side the horizontal streaking artifacts due to beam hardening that can be reduced as shown on the right hand side with median and mean filtering; [0073]
  • FIG. 8 illustrates an original computer tomography scan on the left hand side with the image shown after thresholding in the center and the resulting image after the background has been identified, removed and inverted shown on the right hand side; [0074]
  • FIG. 9 illustrates on the left hand side a lung after thresholding without median and mean filtering and on the right hand side the image after median and mean filtering; [0075]
  • FIG. 10 illustrates two lungs, gas, and some noise, and that the retention of only the largest components would eliminate the unwanted regions; [0076]
  • FIG. 11 illustrates at the left hand side a segmented lung after thresholding but before morphological filtering, and at the right hand side the lung after morphological closing; [0077]
  • FIG. 12 illustrates the lungs being divided medially into three regions where large vessels are found in region [0078] 2 which require a large structuring element, and that only small vessels are found in regions 1 and 3;
  • FIG. 13 illustrates a table illustrating the timed execution of morphological filtering using both fixed (28 pixel diameter) and varying (28 pixel and 14 pixel diameter) structuring elements; [0079]
  • FIG. 14 illustrates a matrix containing the histograms of the segmented lung slices; [0080]
  • FIG. 15 illustrates an algorithm for finding the location and size of a nodule; [0081]
  • FIG. 16 illustrates a one dimensional model of a) isolated nodule next to blood vessels, and b) a nodule attached to the pleural wall; [0082]
  • FIG. 17 illustrates locator template functions; [0083]
  • FIG. 18 illustrates one dimensional examples of the maximizing locations of template functions for (a-c) a Gaussian template on an isolated nodule, (d-f) LOG template on a nodule on the wall, and (g-i) LOG template on an isolated nodule; [0084]
  • FIG. 19 illustrates two dimensional examples of the maximizing locations for two dimensional LOG templates of various radii on isolated and pleural nodules where the inner and outer circles represent the positive and negative regions, respectively, of the LOG template; [0085]
  • FIG. 20 illustrates two dimensional examples of a sizing template function of various radii which exhibit dramatic changes in the distribution of values inside the circle when the sizing template function becomes too large; [0086]
  • FIG. 21 illustrates a detailed algorithm for finding the location and size of a nodule; [0087]
  • FIG. 22 illustrates a response of the mean filter function for various sized spheres (solid intensity of 1000) versus the radius of the template function; [0088]
  • FIG. 23 illustrates a response of a Gaussian template function for various sized spheres (solid intensity of 1000) versus the radius of the template function; [0089]
  • FIG. 24 illustrates a graph of the Gaussian and the Laplacian of the Gaussian; [0090]
  • FIG. 25 illustrates a hill climbing search algorithm for the nodule finding algorithm; [0091]
  • FIG. 26 illustrates locator template functions; [0092]
  • FIG. 27 illustrates an algorithm for registering a first image and a second image using a rigid-body transformation; [0093]
  • FIG. 28 illustrates a hill climbing search algorithm for determining the best rigid-body transformation parameters for the registering algorithm; [0094]
  • FIG. 29 illustrates an algorithm for removing the pleural surface from juxtapleural nodules; [0095]
  • FIG. 30 illustrates an example of the pleural wall removal algorithm: The cut nodule is shown as dark gray white the rest of the nodule and the pleural surface are shown in light gray. (A) Given the initial location and direction, (B) the plane is moved in the direction. (C) The plane eventually intersects the pleural wall causing an increase in the size change of the cut nodule, and (D) the plane is reorientated to minimize the size of the cut nodule. At the next iteration, (E) the plane intersects the pleural wall, but this time (F) reorientating the plane to minimize the cut nodule still results in a large increase in size change. The algorithm terminates, returning the cut nodule from the previous iteration, (D); [0096]
  • FIG. 31 illustrates an algorithm for recursively finding the cut nodule region; and [0097]
  • FIG. 32 illustrates a hill climbing search algorithm for the algorithm for removing the pleural surface.[0098]
  • DETAILED DESCRIPTION OF THE INVENTION
  • A system in accordance with the present invention may include a scanner, processor, memory, display device, input devices, such as a mouse and keyboard, and a bus connecting the various components together. The system may be coupled to a communication medium, such as a modem connected to a phone line, wireless network, or the Internet. [0099]
  • The present invention is preferably implemented using a general purpose digital computer, microprocessor, microcontroller, or digital signal processor programmed in accordance with the teachings of the present specification, as will be apparent to those skilled in the computer art. Appropriate software coding may be readily be prepared by skilled programmers based on the teachings of the present disclosure, as will be apparent to those skilled in the software art. [0100]
  • The present invention preferably includes a computer program product, which includes a storage medium comprising instructions that can be used to direct a computer to perform processes in accordance with the invention. The storage medium preferably includes, but is not limited to, any type of disk including floppy disks, optical data carriers, compact discs (CD), digital video discs (DVD), magneto-optical disks, read only memory (ROM), random access memory (RAM), electically programmable read only memory (EPROM), electrically eraseable programmable read only memory (EEPROM), magnetic or optical cards, or any type of media suitable for storing information. [0101]
  • Stored on any one of the above described storage media, the present invention preferably includes programming for controlling both the hardware of the computer and enabling the computer to interact with a human user. Such programming may include, but is not limited to, software for implementation of device drivers, operating systems, and user applications. Such storage media preferably further includes programming or software instructions to direct the general purpose computer to perform tasks in accordance with the present invention. [0102]
  • The programming of the computer preferably includes software for digitizing and storing images obtained from the image acquisition device (helical computed tomography scanner). Alternatively, it should be understood that the present invention may also be implemented to process digital data derived from images obtained by other means, such as x-rays and magnetic resonance imaging (MRI), positron emission tomography (PET), ultrasound, optical tomography, and electrical impedance tomography. [0103]
  • The invention may also be implemented by the preparation of application specific integrated circuits (ASIC), field programmable gate arrays (FPGA), or by interconnecting the appropriate component devices, circuits, or modules, as will be apparent to those skilled in the art. [0104]
  • A. Lung Segmentation [0105]
  • This section discusses a lung segmentation algorithm in detail. First the model of the lungs will be presented with a discussion of the difficulties with this task. Then each stage of the algorithm is presented. [0106]
  • Referring now to FIG. 1, the object of the algorithm is illustrated. The top 6 images in FIG. 1 are selected slices from a single CT scan, and the bottom 6 images are the lung regions extracted from those slices. The lungs are modeled as a low density region surrounded by a high density one. Image filtering is preferably first performed to minimize the effects of image noise. A simple linear discriminant function based on CT voxel values (photon density) is preferably used to partition the scan into lung parenchyma and solid structures. Further filtering can be used to compensate for imperfections in the thresholding. [0107]
  • The photon density of the structures within the lungs may be found by manually segmenting the lung into different regions and analyzing the results. Referring to FIG. 3, a table presents the range and mean values for the intensity of solid tissue and lung parenchyma. These values were obtained by manually selecting regions within a lung CT scan. Regions of at least 100,000 voxels were selected from four 2.5 mm full lung scans. The distribution of intensities is shown in FIG. 2. Note that there is an overlap between the intensity of the lung region and the intensity of the surrounding solid tissue. [0108]
  • Referring again to the table in FIG. 3, it is almost possible to partition lung parenchyma and bone using a linear discriminant function. All voxels with a gray level value less than 500 can be considered parenchyma because the minimum intensity for solid tissue is 545. Unfortunately, vessels, nodules, and partial voxels can not be partitioned so distinctly. Using the linear discriminant function as described will result in classification errors where the histograms in FIG. 2 overlap, most prominantly between gray levels of 550 to 800. All values of gray level and intensity in the application are in GE units which equates to Hounsfield units HU as follows: HU=GE units −1024, for example 1000 GE=−24 HU. [0109]
  • One major challenge is handling the streaking artifacts found in 2.5 mm scans with a low radiation dose and a high pitch, such as those done in screening studies. When an X-ray beam passes through a region with a high attenuation coefficient, the remaining beam contains a greater proportion of high energy. This makes the path-integral of attenuation a non-linear function of distance (J. Hsieh, “Adaptive Trimmed Mean Filter for CT Imaging,” [0110] SPIE, Vol 2299, 1994; H. Soltanian-Zadeh, J. P Windham and J. Soltanianzadeh, “CT Artifact Correction: An Image Processing Approach,” SPIE, Vol 2710, 1996 which is incorporated herein by reference). In the case of lung CT scans, this artifact is prevalent through the shoulders, resulting in noise in the first 25% of the slices. The noise is characterized as both high intensity and low intensity horizontal streaks running through the image.
  • Finally, there are other structures which confound the segmentation scheme. Air or gas found outside of the lungs will have the same characteristics as the lung themselves. Specifically they consist of a low density region surrounded by a high density one. It is necessary to discriminate between the lungs and other stray tissue or air pockets. An example of such a region is shown in FIG. 4, which occurs well below the lungs and the diaphragm. [0111]
  • The segmentation algorithm consists of creating a mask representing the lung volume and applying an AND operation between the mask and the original image. The algorithm for creating the mask is set forth in FIG. 5, and FIG. 6 outlines these steps graphically while the motivation behind this routine is described in detail in the following sections. [0112]
  • The main object of image filtering is to remove the streaking artifacts on the first 25% of the slices due to x-ray beam hardening through the shoulders. The streaking artifacts are characteristically horizontal and tend to greatly distort the segmentation. Many of the later steps in this algorithm operate on binary images and are quite susceptible to noise. A combination of both median and mean filtering reduces the noise significantly. Median filtering preserves the edges around the chest cavity while eliminating much of the streaking effect. Since the streaks are horizontal, a small vertical mean filter will blur the streaking regions, further reducing their effect. This filtering stage is used only to generate a clean image for the mask as the original pixel values are retained in the final segmented lung image. [0113]
  • Experiments have shown that a median filter size of 4×4 produce the best results. Smaller filters did not reliably eliminate noise caused by the streaking artifacts. Further experiments have shown that a mean filter size of 1×3 produces excellent results. The results of filtering are shown in FIG. 9, but the importance of this step is seen more clearly in FIG. 7 after the thresholding operation. The filtering is preferably performed on 2 dimensional slices rather than 3D volumes. [0114]
  • On large data sets, such as full chest CT scans, median filtering is a time consuming operation. To speed up the algorithm, it is important to note that the streaking artifacts appears only at the beginning of the scans. Preferably the median filter for the first 25% of the slices is only computed to reduce the computation time of this stage by 75%. The mean filter is much smaller (1×3) and the computational gains of only running it on part of the image are insignificant. [0115]
  • Most of the segmentation is performed by a simple threshold operation. As seen in FIG. 2, the distribution of intensities of lung parenchyma and solid tissue is bimodal. A simple threshold of 500 can therefore be applied to the entire image. For the most part, this will separate the image into 2 regions: (1) solid tissue and (2) everything else. Included in “everything else” are the lungs, trachea, air surrounding the body, and black background outside of the field of view. By filling in all pixels which touch the image border and inverting the image, the lungs are clearly segmented from the chest cavity, as shown in FIG. 8. [0116]
  • As seen in FIG. 2 and the table in FIG. 3, there is some overlap between the intensities of structures in the lungs and the intensities of solid tissue outside the lungs. Specifically, there is significant overlap in the range between gray levels of 550 and 800. It is therefore impossible to threshold out the ribcage and keep all the vessels, as seen in FIG. 8. [0117]
  • FIG. 9 illustrates the effect of thresholding both with and without image filtering. The noisy image on the left shows the result of thresholding without filtering and the segmented image on the right shows the result of thresholding after filtering. [0118]
  • Up until this stage in the algorithm, any regions with similar characteristics to the lungs will be preserved. This includes air and gas found within the body. This also includes random noise in the background (i.e., outside the thorax) which was not removed by image filtering and thresholding. Selecting only the largest component(s) in the image, we will eliminate minor air pockets and all stray noise which is prevalent throughout the images. [0119]
  • FIG. 10 shows a region which is removed by retaining only the largest component(s) and discarding all other structures. To perform the selection, preferably all regions with volumes greater than 1% of the total number of pixels are chosen in the image, as explained in S. Hu, E. A. Hoffman, and J. M. Reinhardt, “Automatic Lung Segmentation for Accurate Quantitation of Volumetric X-Ray CT Images,” [0120] IEEE Transactions on Medical Imaging, Vol 20, No 6, June 2001, which is incorporated herein by reference.
  • As previously mentioned, the thresholding operation will segment out blood vessels along with the ribcage, resulting in holes and splotches in the lung region, as seen in FIG. 8. These can be filled in using a morphological filtering operation. By performing a closing, which consists of a dilation followed by an erosion, the spotty regions and holes within the lungs can be removed. Some of the vessels and other structures are quite large, necessitating the use of a large closing kernel. The results of morphological filtering are shown in FIG. 11. [0121]
  • Morphological filtering with large structuring elements is computationally expensive. Fortunately, large structures that require a large filter kernel only occur in the middle third of the slices of the lungs. Therefore, the lungs can be divided axially into three distinct regions [0122] 1, 2, and 3 as shown in FIG. 12.
  • As the slices corresponding to each region show, preferably a small structuring element is used in regions [0123] 1 and 3 where only small vessels occur, and a larger one is used in region 2, where large vessels are found. Specifically, a large 2D circular filter is preferably used in region 2 (typically 28 pixels in diameter) and filter of half the diameter is used in regions 1 and 3. Referring now to FIG. 13, a table that shows timing trials using a varying kernel size versus using a fixed large kernel for the entire image. In this experiment, a circular filter of diameter 28 was used as the fixed kernel size. This was compared to using the same kernel in region two and reducing it to a diameter of 14 in regions 1 and 3.
  • Once the binary mask of the lungs is generated, a simple AND operation with the original CT scan will yield the segmented lungs. Finally, the image is clipped such that the new bounding box is just large enough to contain the lungs. [0124]
  • B. Lung Volume Measurements [0125]
  • This section discusses the algorithms used for lung volume measurements. First the motivation behind measuring the lung volume will be explained. Next, a model of the lung will be presented, followed by the algorithm for calculating the volume. [0126]
  • Once the lung has been properly segmented, the volume of both tissue and air in the lungs can be calculated. The objectives of this research are as follows: [0127]
  • 1. Accurately measure lung volume. [0128]
  • 2. Determine both the inter-patient and intra-patient variation in lung volume. [0129]
  • 3. Explore the effects of inspiration on CAD algorithms. [0130]
  • 4. Compensate for any effects discovered in (3). [0131]
  • 5. Measure the relationship between cross-sectional area of the lungs and entire lung volume. [0132]
  • Once statistics of the lung volumes have been compiled the effect of inspiration on nodule volume measurements will be studied. A positive correlation between lung volume and nodule size in a large set of repeat scan will determine if such a relationship exists. It is also important to note that full chest scans are not always performed during a repeat examination. Typically, a high resolution scan of the suspicious region is performed. Such scans contain only a few cross-sectional slices of the region of interest. Therefore, the relationship between 2D cross-sectional area and inspiration must be explored. [0133]
  • The lungs can be modeled as containing air with a gray level value of zero, and tissue with a gray level value of 1000. All intensity values in between that range must be a combination of air and tissue, confounded by the partial voxel effect. Based on this assumption, a gray level of 500 represents a volume comprised of ½ air and ½ tissue. Equation 1 depicts this formally, where V is volume and I is intensity. [0134] V air / voxel = ( 1 - I voxel I tissue ) * ( V voxel ) ( 1 )
    Figure US20030095696A1-20030522-M00005
  • For example, a gray level of 250 represents 25% tissue and 75% air. If the image resolution is 0.5 mm×0.5 mm×2.5 mm per voxel, the volume of a voxel is 0.625 mm[0135] 3 and the volume of air in that voxel is 0.156 mm3.
  • Referring now to FIG. 14, a matrix is generated from the segmented lung image in which each column represents a gray level value and each row represents a slice in the scan to perform this analysis. The entries in the matrix are the number of times that a particular gray level appears in that slice of the image. This data structure is simply a histogram of the image, separated into slices. With such a structure in place, it is easy to perform and repeat the volume measurements on both the full lung volume and on an individual slices. [0136]
  • To calculate the volume in the lungs, the number of voxels in the segmented image is counted and multiplied by the volume of each voxel. This represents the volume of the entire lung. This can be performed quickly using the histogram because the counting has already been completed. Using the model described above, that each voxel is part air and part tissue, the sum of “tissue voxels” multiplied by the volume of a voxel equals the amount of tissue in the lung. The equations for calculating the volume of the lungs and the volume of the tissue in the lungs are as follows: [0137] V Lung = s Si I L [ s ] [ i ] * V voxel ( 2 ) V tissue = s Si I i I tissue * L [ s ] [ i ] * V voxel ( 3 )
    Figure US20030095696A1-20030522-M00006
  • where V represents volume, I represents voxel intensity, and L[s][i] is the number of pixels of intensity i in slice s of image L. [0138]
  • Often times with repeat scans, only a high resolution scan of the region of interest is acquired. As a result, full lung volumes are not always available to measure the amount of inspiration in repeat scans. As a solution, the area of single axial CT images from two scans may be used to estimate the variation in inspiration between the two. The histogram data structure described above can be used to calculate the cross-sectional area of a single slice. Given the volume of the 2 entire lungs, it may be possible to relate the cross-sectional area of each to the volume of the entire scan. [0139]
  • The lung segmentation algorithm was run on 196 individual chest scans and 24 pairs of repeat scans from a Cornell University ELCAP database. Out of the 196 scans, 115 contained 2.5 mm slices and 81 contained 5 mm slices. The 24 pairs of repeat scans consisted of 19 5 mm scans and 5 2.5 mm scans. Repeat scans of different reconstructions were not considered. In-plane resolution varied between 0.54 mm/pixel and 0.79 mm/pixel. [0140]
  • Images were acquired on a either a General Electric® LightSpeed™ or HiSpeed™ Helical CT scanner. X-ray tube current ranged from 40-200 mA and the tube potential was either 120 or 140 kVp. Testing is preferably performed on a dual-processor 700 MHz computer. The algorithm ran in approximately 6-8 minutes on a full lung scan with 2.5 mm contiguous slices. Without using the varying filter sizes as described above, the algorithm ran in about 14-15 minutes. [0141]
  • C. Finding Location and Size of Pulmonary Nodule [0142]
  • Given an initial seed point inside the nodule, an algorithm finds the center location of the nodule and the radius of the sphere circumscribing the nodule. The following subsections describe the algorithm and choices of functions. [0143]
  • The algorithm is provided a candidate location that is some seed point P, which is within the nodule in the image, and a starting radius r and delivers the optimal location P′ and radius r′ of the nodule. The algorithm for finding the location P′ and radius r′ of the nodule is shown in FIG. 15. The value of r is incrementally increased and for each value of r the best location of the nodule center P is computed. A new location is calculated by maximizing the correlation (or the response) between the image and a locater template function. The template function is chosen so that the maximum response is given when the template is centered over a nodule with radius r as discussed further below. Thus, maximizing the correlation yields the most likely location of a nodule with the current radius. [0144]
  • The algorithm determines the radius of the nodule by terminating itself at the appropriate iteration. Another template function, centered at P, is applied to the image at the end of each iteration. The sizing template function is designed so that its value decreases dramatically when the radius of the function has become larger than the radius of the actual nodule. Thus, when there is a large decrease in the value of the second template function, the radius of the actual nodule has been exceeded and the algorithm terminates and returns the location and radius from the previous iteration. [0145]
  • The nodule finding algorithm was developed assuming a two level model where the nodule, blood vessels, and pleural wall are all a single high intensity, while everything else is a single low intensity. The template functions use parameters of location and radius. The radius does not refer directly to the size of the template function. Rather, the radius is a parameter that describes the size of the nodule for which the template will detect; meaning that the template does not necessarily need to be zero past the extent of the radius [0146]
  • The locater template functions is designed to locate the approximate center of mass of a nodule (for nodules attached to the pleural surface a repeatable central location is obtained since the location of the actual center of mass is not knowable). The function has four parameters: the center in x, y, and z, and the radius. In the algorithm, the radius is fixed at each iteration, but the center of the template can move. The locater template function was designed, with a given radius, so that it is maximized when the function is centered over a nodule of the same radius. [0147]
  • Consider a 1-D example where an isolated nodule is modeled as a large region of high intensity. FIG. 16A shows an example model where the nodule is the center shaded region, while the outer regions consist of noise (composed of high-intensity objects like vessels). [0148]
  • Consider some simple 1-D template functions shown in FIG. 17. The square template function, FIG. 17A, biases everything equally, causing the template to be very sensitive to noise in the periphery. The sensitivity to noise can be reduced by tapering the template function to be shaped like a triangle, FIG. 17B, or a Gaussian, FIG. 17C. The large values near the center will keep the function centered over the high-intensity region of the nodule, while the lower values further from the center will diminish the effect of any other high-intensity objects. FIGS. 18A through 18C illustrate where the Gaussian template function will be maximized for cases where the size of the function is smaller, the same size, and larger than the size of the nodule. [0149]
  • Now consider a 1-D model of a nodule attached to the pleural wall, shown in FIG. 18B. The nodule is the lightly shaded central region, the pleural wall is the darkly shaded region on the right, and the lightly shaded region on the left is some noise (blood vessel). Although shaded differently, note that the nodule and the pleural wall are at the same intensity level. With this model, the Gaussian template function will fail to perform correctly. The template does not prevent itself from slipping into the wall and centering itself over the combination of the nodule and the wall. [0150]
  • Nodules on the pleural wall can be located by choosing a function that forces itself away from the wall. This can be achieved by using a function that has positive values within the radius of the function and negative values outside the radius, like FIGS. 17D through 17F. Two examples of this type of function are the Laplacian of the Gaussian (LOG) and the difference of Gaussians (DOG). When maximizing the response of the template function, there are two forces fighting against each other. The positive portion of the template function will try to keep the function centered over the high-intensity regions. Countering this, the negative portion of the template will try to push the template away from the high-intensity regions, resulting in an equilibrium along the edge of the high-intensity region of the nodule. FIGS. 18D through 18F show how the LOG-like template function should behave on the 1-D model of a nodule on the wall. If the total weights, the distribution, and the sizes of the positive and negative regions are balanced correctly, then the LOG-like template function should behave accordingly. [0151]
  • The LOG-like template function can also be used on isolated nodules. The positive region of the template function will stay near the center of the nodule, while the negative regions will force the function away from any noise in the periphery of the image. FIGS. 18G through 18I show how the LOG-like function will behave when applied to the 1D model of an isolated nodule. When the size of the template is smaller than the nodule, the template will hug the edge of the nodule and when the positive region of the template is larger than the nodule, it will be centered over the nodule. [0152]
  • The above illustrates the preferred behavior of the locator template function for the 1D model of an isolated nodule and a nodule on the wall. The model is now extended into two and three dimensions. For the 2D case, the 1D LOG-like function is extended into two dimensions. The template now consists of two circular regions; the smaller region contains positive values and the region outside the smaller region contains negative values. FIG. 19 shows a few examples of how the 2D template function is expected to behave for isolated and pleural nodules. For the 3D case, the locater template function will have spherical regions with an analogous distribution as the 2D and 1D cases. [0153]
  • One thing to note about the locater template function is that it does not need to have a constant total weight for different radii. The algorithm does not maximize the locater template function throughout all the iterations and all the radii; instead, it is maximizing the template function for a fixed radius in each iteration. Thus, the template is not required to have a constant weight for different radii. It should suffice to only maintain the proper scaling between the sizes and the distribution of the template regions. [0154]
  • The sizing template function is used to indicate when the radius of the function is equal to the size of the sphere circumscribing the real nodule. The sizing template function uses the radius during the current iteration and the location of the candidate nodule, determined by the locater template function. After each iteration in the algorithm, a value is calculated using the sizing template function. Two preferred methods for determining when the algorithm has found the location and size of the nodule in the image are discussed below. [0155]
  • The first method is to look for a large change in the response of the sizing template function. Using the LOG-like locater template function, the positive region, the inner circle, is expected to be overlayed on the high-intensity values of the nodule. As the radius of the template function increases, the positive region will remain within the nodule. This is illustrated in FIG. 20. Eventually the positive region will become larger than the nodule and there will be a sharp decrease in the response of the sizing template function between iterations of the algorithm. To find this stopping criterion, a sizing template function is chosen so to be a mean filter shaped like a sphere. When the sphere becomes larger than the nodule, the distribution of values inside the sphere changes, causing the response of the template function to change dramatically. [0156]
  • FIG. 22 shows the response of the mean filter function to various sizes of ideal nodules (spheres of intensity [0157] 1000). For the ideal nodule, the response of the filter function is constant until the radius of the filter function exceeds the radius of the ideal nodule. When this happens, the response of the filter quickly decreases.
  • The second method of finding the size of a nodule is to design the sizing template function so that it has a specific response when the template function is the same size as the real nodule. For example, if a 3D Gaussian function, where the standard deviation is equal to the radius, has the response shown in FIG. 23. When the response of the Gaussian template is 200, the radius of the Gaussian is the same as the radius of the nodule, thus providing a stopping criterion for our algorithm. [0158]
  • One very important property of the sizing template function is that it must have a constant total weight regardless of the size of the template. This property will insure that the response of the template will be consistent between different sizes of nodules. [0159]
  • The implementation of the algorithm will now be discussed. This will include a more detailed description of the algorithm, a mathematical definition of some template functions, calculation of the initial seed point, introduction of two search methods for the maximization of the locator template function, quick function evaluations, and the termination criterion. [0160]
  • A detailed description of the algorithm is shown in FIG. 21. The algorithm is modified so that it terminates when the response of the sizing template function is within c of the target value. This feature is added to the algorithm so that the radius does not go too far past the actual radius of the nodule. [0161]
  • The algorithm takes in a 3d CT image of a nodule. First, the image is clipped at intensities over 1000. This is done to minimize any affect that the very-high intensitied bone will have on the algorithm. [0162]
  • The next step is to define the locator and sizing template functions. The template functions are preferably either the Gaussian, the Laplacian of the Gaussian, or the difference of Gaussians. The template function has four parameters, (sx, sy, sz, σ), which correspond to the x-location, y-location, z-location, and radius. The initial location is either calculated from the image or specified by the user, and depending on the type of sizing template function, the target response value is set. [0163]
  • Starting with the initial conditions, a radius of 1, and a radius step-size of 1, the algorithm finds the best locator template response by using a search method to move the center of the template function. Preferably the search method is a hill-climbing method as discussed below. Once the maximum value is found for the given radius, the radius is increased by the radius step-size and the search is repeated using the current location as the starting point. [0164]
  • At each iteration the response of the sizing template function, γ is calculated. The algorithm iterates until the sizing response is less than the target value. If γ is within ε of the target, then the algorithm is finished. Otherwise, the algorithm backtracks by setting the location and radius parameters to their values in the previous iteration, dividing the radius step by two, and repeating the search procedure. Finally, after the target value is reached within ε, or the radius step-size is smaller than some α, the search process terminates and the current parameters are the location and radius of the nodule. [0165]
  • The template function is a function of four parameters: the center (location) of the template, (sx,sy,sz), and the radius of the template, σ. The response of the template function is calculated by taking the correlation between the image im and the template M as in Equation (4). [0166] Γ ( sx , sy , sz , σ ) = x , y , z im ( x , y , z ) * M sx , sy , σ ( x , y , z ) ( 4 )
    Figure US20030095696A1-20030522-M00007
  • The locater template function is designed to produce the largest response when the kernal is centered over the target object. Thus, by maximizing this function at each iteration of the nodule finding algorithm, the best candidate for a nodule of radius r is found. There are many types of functions to choose from, but the preferred functions are the Gaussian, the Laplacian of the Gaussian, and the Difference of Gaussians. [0167]
  • The 3D gaussian is a strictly positive symmetric function defined by Equation (5). The Gaussian function can be used to find nodules when the pleural surface is not present in the image. The metric function will have its highest value when it is centered over the nodule. A graph of the Gaussian is shown in FIG. 24. [0168] G sx , sy , sz , σ ( x , y , z , ) = 1 σ 3 ( 2 π ) 3 2 - ( ( x - sx ) 2 + ( y - sy ) 2 + ( z - sz ) 2 2 σ 2 ( 5 )
    Figure US20030095696A1-20030522-M00008
  • The Laplacian of the Gaussian (LOG) is defined in Equation 7. This function has a positive weight close to the center and a negative weight further out, as seen in FIG. 24. This function is useful in locating nodules on or near the pleural surface. The positive interior will latch onto the nodule, while the negative exterior will keep the kernal from moving towards the wall. In the algorithm, the LOG has the disadvantage that the initial location must be within the nodule. Otherwise, the negative weight of the exterior will cause the LOG to grow away from the nodule. [0169] LOG sx , sy , sz , σ ( x , y , z ) = - [ 2 x 2 + 2 y 2 + 2 z 2 ] G sx , sy , sz , σ ( x , y , z , ) ( 6 ) = 1 σ 2 ( 3 - x 2 σ 2 - y 2 σ 2 - z 2 σ 2 ) * G sx , sy , sz , σ ( x , y , z ) ( 7 )
    Figure US20030095696A1-20030522-M00009
  • The Difference of Gaussians, given in Equation (8), is similar to the Laplacian of the Gaussian in that they both have positive and negative regions. However, changing the σ[0170] 1, σ2, m1, and m2 values will lead to different sizes and weights of the two regions, allowing for a more customizable template than the LOG.
  • DOG sx,sy,sz,σ(x,y,z)=m 1 *G sx,sy,sz,σ1(x,y,z)−m 2 *G sx,sy,sz,σ2(x,y,z)  (8)
  • The initial seed point should be somewhere within the nodule in the image. This may be provided by user input, or it can be estimated from the image. A simple way to calculate the initial location would be to use the center of the image: [0171]
  • center[0172] x=im.xlo+(im.xhi−im.xlo+1)/2
  • center[0173] y=im.ylo+(im.yhi−im.ylo+1)/2
  • center[0174] z=im.zlo+(im.zhi−im.zlo+1)/2
  • When using the Gaussian for the locator template function this may be fine, but when using the LOG or DOG functions the initial starting location must be within the nodule. For these functions, the center of mass (COM) of the image is preferred for setting the initial conditions. The COM is calculated by first thresholding the image at half of the largest pixel value in the image and then calculating the center of mass using the standard equations: [0175] COM x = i , j , k im ( i , j , k ) * i i , j , k im ( i , j , k ) COM y = i , j , k im ( i , j , k ) * j i , j , k im ( i , j , k ) COM z = i , j , k im ( i , j , k ) * k i , j , k im ( i , j , k ) .
    Figure US20030095696A1-20030522-M00010
  • The method used to search for the optimal nodule location has a major impact on the running time of the algorithm. Any kind of fancy search procedure could be used, but this is not necessary for this application. From iteration to iteration the new optimal location will not deviate much from the previous optimal location. Since the previous optimal location is used as the starting point for each search, the search method will not have to look very far for the maximum in the search-space. [0176]
  • Fancy search methods, such as Powell's method described in W. Press, [0177] Numerical Recipes in C, 2nd Edition, Cambridge University Press, 1992, which is incorporated herein by reference, are usually less efficient when moving small distances because these algorithms are designed to search a very large space. In other words, they are optimized to tradeoff between the efficiency in moving giant steps and the efficiency of moving in small steps.
  • In the end, hill-climbing, a greedy search method, is preferred for the nodule finding algorithm because it is more efficient when the optimal location doesn't move very far. The Hill-Climbing is shown in FIG. 25. Using an the initial location and a stepsize, the hill-climbing algorithm evaluates the locator template function for each of the possible 6 moves in parameter-space and then moves in the direction of the largest decrease. The algorithm terminates when there is no move that decreases the metric. [0178]
  • The search procedure requires many evaluations of the correlation between locator template function and the image. These calculations can be costly because the template function usually involve exponentials. Fortunately, in any given iteration of the search procedure, the radius of the template function is held constant. It is possible to save calculations by storing the template function values in a temporary image (the classic engineering dichotomy of time versus space). [0179]
  • The values of the locater template function centered at the origin are stored in a temporary image at the beginning of each search procedure. For the Gaussian and the LOG, values are only calculated out to 3 or 5 times the radius σ because the functions converge to zero. Also, the function is only evaluated at positive location points because these functions are radially symmetric, [0180]
  • Now when the response of the template function is required, the temporary image is offset by the location of the template function, and the correlation between the image and the temporary image is calculated. [0181]
  • The target response determines when the algorithm should terminate. The target value is chosen such that the algorithm will terminate when the location and radius parameters best circumscribes the nodule. The target value can be found either through an ideal model of a nodule or through experimentation. FIG. 23 shows the response of a Gaussian function to several ideal nodules (spheres) of different radii. In the ideal case, the target response of the Gaussian sizing function should be 200. The best target response has been determined to be 300 by experimentation with a small subset of real nodules from the database. Using a small number (four) of nodules, the response of the sizing function was tracked and the value that causes all the nodules to be circumscribed was selected. [0182]
  • Based upon the experimentation, the locator template functions shown in FIG. 26 will be stable. The large negative values near the border between the positive and negative regions help the template find the edges of the nodule. In addition, the difference of Gaussians (DOG) can be used to correctly balance the weights and sizes of the positive and negative regions in the template so that the template will not slip into the pleural wall [0183]
  • The nodule finding algorithm is preferably implemented in the C programming language for a VisionX software package on a FreeBSD system. VisionX software provides computer tools and programs for the analysis and visualization of image data. It is suitable for a wide range of image analysis applications and is designed to address the processing needs of multidimensional image sets that arise both from temporal image sequences and from image modalities that involve three-dimensional data collection. [0184]
  • VisionX software has been used in a wide range of research applications including multispectral image analysis, three-dimensional object recognition, multiframe image analysis, target tracking, neural networks, biological cell analysis, and three-dimensional biomedical image analysis. Important features of the VisionX software include the ability to handle multidimensional image sets, a wide range of available processing functions, and a flexible tagged data format that facilities the automatic recording of the history of a file. [0185]
  • FreeBSD is an advanced operating system for x86 compatible, DEC Alpha, and PC-98 architectures. It is derived from BSD UNIX, which is a version of UNIX developed at the University of California, Berkeley. FreeBSD offers advanced networking, performance, security, and compatibility features. FreeBSD can be installed from a variety of media including CD-ROM, DVD-ROM, floppy disk, magnetic tape, an MS-DOS partition, or if there is a network connection, it can be installed directly over anonymous FTP or NFS. [0186]
  • The nodule finding algorithm preferably inputs a floating point, byte, or short image and outputs the location and size of the nodule. Many options are available, including translation and radius search limits, a choice between search strategies (Hill-Climbing or Powell's method), initial starting location, type of template function, and termination criteria. The program also preferably outputs several types of images for debugging purposes. The program was expanded to allow the algorithm to run on two-dimensional images. [0187]
  • D. Pulmonary Nodule Registration [0188]
  • The algorithm registers pulmonary nodules in 3-d images of high-resolution focused CT-scans. For the most accurate characterization it is important to have images from high-resolution CT scans because these images will better localize the boundaries of the nodule. A rigid-body transformation model is assumed, meaning that in general the structures in the images are confined to simple translation and rotation. In order to simplify the transformation model, an isotropic image-space is also assumed. Using these assumptions, an algorithm was developed to register pulmonary nodules from two different time periods by defining a metric between the two images and performing a minimizing search on the metric. [0189]
  • The algorithm requires two input images, and produces an output that is the first image registered to the second image. The rigid-body registration algorithm is shown in FIG. 27. The two input images, im[0190] 1 and im2, are converted to floating-point pixel format. Preferably the images are masked to ignore irrelevant pixel data (e.g. bones). Next, the initial conditions for the rigid-body transformation is determined. The metric between two images is defined as a number that represents how closely two images are related to each other. By selecting the appropriate rigid-body parameters, the metric between the second image and the transformation of first image can be minimized or maximized depending upon the registration metric, resulting in the best registration for the given metric.
  • The first step in the registration algorithm is to perform some pre-processing on the input images. If necessary, the input image is converted from byte or short pixel-formats to the floating point pixel-format. [0191]
  • If mask images are provided, the input images are masked by setting the appropriate pixels to the background value (−1000). Masking an image tells the registration algorithm to ignore certain areas of either image when attempting to perform the registration. This can be useful if a large structure in an image is causing misregistration of the object of interest. By using a mask, the algorithm can be told to ignore the larger structure, thus allowing the object of interest to be registered to itself. [0192]
  • The registration metric is defined as a function of two images, im[0193] 1 and im2 and six rigid-body transformation parameters, (tx,ty,tz,rx,ry,rz). To calculate the metric, the first image is transformed using the rigid-body parameters, resulting in im1t. One definition of the metric value is the correlation between the transformed image im1t and the second image im2, as given in the following equation. C = 1 N i , j , k i m 1 t ( i , j , k ) * i m 2 ( i , j , k ) i m 1 t ( i , j , k ) background i m 2 t ( i , j , k ) background ( 9 )
    Figure US20030095696A1-20030522-M00011
  • where N is the number of pixels that are not background pixels in either im[0194] 1t or im2.
  • The correlation metric is not absolute in the sense that there is no absolute best correlation that indicates that the two images are registered perfectly. The correlation is dependant on the distribution of the pixels; images with larger pixel values will produce a larger correlation. An absolute metric allows for a better sense of how well two images are registered to each other regardless of pixel distributions. [0195]
  • Instead of correlation, a mean-squared-difference (MSD) metric, defined in the following equation, can be used: [0196] MSD = 1 N i , j , k ( i m 1 t ( i , j , k ) - i m 2 ( i , j , k ) ) 2 i m 1 t ( i , j , k ) background i m 2 t ( i , j , k ) background ( 10 )
    Figure US20030095696A1-20030522-M00012
  • where N is the number of pixels that are not background pixels in either im[0197] 1t or im2. With the MSD metric, perfectly registered images will produce a metric of zero.
  • The rigid-body transformation uses six parameters: (tx,ty,tz,rx,ry,rz); translation in x, translation in y, translation in z, rotation about the x-axis, rotation about the y-axis, and rotation about the z-axis. The transformation is a mapping of a point v in 3-d space to a point v′ in transformed space defined by the following equation: [0198] ν = R x R y R z ν + [ t x t y t z ] ( 11 )
    Figure US20030095696A1-20030522-M00013
  • where R[0199] x, Ry, and Rz are the rotation matrices defined as: R x = [ 1 0 0 0 cos ( r x ) - sin ( r x ) 0 sin ( r x ) cos ( r x ) ] ( 12 ) R y = [ cos ( r y ) 0 sin ( r y ) 0 1 0 - sin ( r y ) 0 cos ( r y ) ] ( 13 ) R z = [ cos ( r z ) - sin ( r z ) 0 sin ( r z ) cos ( r z ) 0 0 0 1 ] . ( 14 )
    Figure US20030095696A1-20030522-M00014
  • The first image is transformed so that it has the same bounding box as the second image. The transformation uses either linear interpolation or nearest-neighbor interpolation, and pixels that are transformed from outside the bounding box of the first image are set to the background value. [0200]
  • The initial rigid-body transformation parameters must be determined before a minimization search can be performed. The initial rotation parameters are all set to zero because only a small amount of rotation is expected between the two images. The initial translation parameters should be set so that the two nodules will overlap at the first iteration of the search procedure. Assuming that the nodules are in the center of the images, the initial translation parameters can be set to the difference between the centers of the two images, where the center of an image is defined as: [0201]
  • center[0202] x=im.xlo+(im.xhi−im.xlo+1)/2
  • center[0203] y=im.ylo+(im.yhi−im.ylo+1)/2
  • center[0204] z=im.zlo+(im.zhi−im.zlo+1)/2
  • This assumption is not always true and a better method of determining the initial translation parameters is to use the centers of mass of the two nodules. Both images are thresholded at half of the largest pixel value in the image and the center of mass is calculated using the standard equations: [0205] COM x = i , j , k i m ( i , j , k ) * i i , j , k i m ( i , j , k ) COM y = i , j , k i m ( i , j , k ) * j i , j , k i m ( i , j , k ) COM z = i , j , k i m ( i , j , k ) * k i , j , k i m ( i , j , k ) .
    Figure US20030095696A1-20030522-M00015
  • The initial translation parameter is equal to the difference between the centers of mass of the two images. [0206]
  • Using the registration metric, a function of six parameters, and the initial conditions, the registration problem is now converted into a minimization/maximization search problem. Specifically, given some initial condition, a minimum or maximum of the metric function is found by searching the 6-dimensional parameter space. The following subsections describe three different search methods: exhaustive search, hill-climbing, and Powell's method. [0207]
  • The exhaustive search is a brute force method that finds the minimum (or maximum) by calculating the metric for every possible set of parameters. Of course the number of possible parameters in a 6-dimensional search space is infinite. In order to reduce the search space, a limit of translation and rotation deviation from the initial condition, along with rotation and translation stepsizes, is imposed. Even with this search space reduction, the exhaustive search is still impractical. [0208]
  • Consider a case where translation is limited to 5 pixels in each direction and the rotation by 5 degrees in each direction. With stepsizes of 1 pixel of translation and 1 degree of rotation, the exhaustive search will perform 11[0209] 6 or 1,771,561 metric evaluations. Suppose each metric evaluation takes 0.1 seconds, then the entire algorithm will take around 170,000 seconds, or 2,833 minutes, or just under two days. Even with such a seemingly small search space and appropriate step-sizes, the exhaustive search will take days to finish!
  • Hill-Climbing is a greedy search method. Starting at the initial condition and a set of translation and rotation stepsizes, the algorithm evaluates the metric for each of the possible 12 moves in parameter-space and then moves in the direction of the largest decrease (or increase). The algorithm terminates when there is no move that improves the metric. [0210]
  • By using a small step-size it is possible to calculate the best parameters up to some precision. Unfortunately, as the step-size is decreased, the running-time of the algorithm increases because the algorithm must take smaller steps, and thus perform more metric evaluations to get to the minimum. One solution to this problem is to repeat the algorithm several times while using a decreasing stepsize. A detailed description of the complete hill-climbing algorithm is shown in FIG. 28. [0211]
  • Powell's method is a multi-dimensional direction-set search algorithm. Starting with an initial set of 6 directions and an initial condition, in each iteration the algorithm minimizes the metric by moving in each of the six directions. For a given direction, any line minimization technique could be used, however Brent's Method is chosen because it is a parabolic minimization technique that does not explicitly use derivatives. At the end of each iteration (one pass through each of the six directions), the oldest direction is replaced by the total direction moved during the current iteration. By doing this, the algorithm adapts itself to move along the most minimizing path. A more in depth description of Powell's method can be found in Chapter 10.5 in [0212] Numerical Recipes in C, W. Press, 2nd Ed., Cambridge University Press, 1992, which is incorporated herein by reference.
  • Powell's method terminates when either all the parameters in one iteration change within some epsilon, or the metric after an iteration does not change by more than a tolerance value. [0213]
  • The registration algorithm works well on images with isolated nodules, but has trouble with images where the pleural surface is present because the pleural surface becomes the largest structure in the image. The largest structure has the largest effect on the metric value, causing the minimization technique to try to register the pleural surface to itself. Because the pleural wall can move and change shape with inspiration or position, there is no guarantee that the nodules near or along the pleural wall be registered correctly if the pleural wall is registered. A first method for addressing this problem is to use image masking or pixel masking. A mask is created that tells the algorithm to ignore the pleural surface and its contents will force the algorithm to register only the nodules together. A second method involves applying a function on the pixels so that all the pleural features become one intensity. This causes the registration algorithm to ignore structures like the ribs. A third method involves reducing the search space. A nodule-localization algorithm is used to find the centers of the nodules in both images. Taking the difference of the centers results in the translation parameters that overlap the nodules. Finally, the orientation of the nodules is determined by using the registration algorithm on only the rotation parameters. [0214]
  • The rigid-body registration algorithm is preferably implemented in the C programming language using the VisionX software library for the FreeBSD environment. The program, v3regrb, preferably inputs two input images of byte, short, or floating point pixel-types and a variety of options. The program preferably outputs the first input image registered to the second input image and a difference image associated with the two images. Both images preferably have the same bounding box as the second input image. The rigid-body transformation parameters for the registration are preferably stored with the metric and timing information with a history of the output images. [0215]
  • In order to increase the throughput of the registration process, the three-dimensional rigid-body transformation is preferably written into the program. The code for the transformation is preferably used from the existing stand-alone rigid-body transformation program (v3regrb). The rigid-body function preferably supports both linear and nearest-neighbor interpolation. The program may be modified to perform three-dimensional translation-only registration, two-dimensional rigid-body registration, and two-dimensional translation-only registration. [0216]
  • E. Removal of the Pleural Surface from Juxtapleural Nodules in Thresholded High-Resolution CT Images [0217]
  • The algorithm takes a binary (thresholded) image as its input. The algorithm also requires the location of a point near the center of the nodule. If the image is some region-of-interest that has been generated by a radiologist, then it is assumed that the nodule is in the center of the image. In this case the initial starting point will be the center of the image. The pleural-surface removal algorithm is shown in FIG. 29. [0218]
  • The pleural surface removal algorithm works by iteratively moving a plane towards the pleural-surface. The algorithm starts with an initial point P′ inside the nodule and a direction towards the wall, d′. The direction is calculated by taking the difference between the center of mass of a spherical region centered on P′ and the starting location P′. [0219]
  • With each iteration, a new location P[0220] i is calculated by stepping in direction d from the previous location Pi-1. Plane A, normal to direction d and passing through point P, separates the nodule from the pleural surface. This cut nodule is the connected component region that contains point P and that is behind the plane A. As the plane moves towards the pleural wall, the size of the cut nodule increases. FIGS. 30A and 30B show the cut nodule for two iterations.
  • The algorithm keeps track of the difference Δ in the size of the cut nodule between iterations. When the plane intersects the pleural surface, as seen in FIG. 30C, the difference Δ increases dramatically. This condition is manifested by the change in the difference increasing by more than γ[0221] max. When this occurs, the size of the cut nodule is minimized by reorientating the plane by changing the direction d while keeping the point P fixed, as in FIG. 30D. Additionally, the size difference and change in difference are recalculated. If the change in difference is less than γmax, then the algorithm keeps iterating. Otherwise, the algorithm terminates and returns the cut nodule formed by using the plane in the previous iteration.
  • FIG. 30 shows a two-dimensional example of the algorithm. The cut nodule is shown as dark gray while the rest of the nodule and the pleural surface are light gray. The initial starting point and the initial direction are shown in FIG. 30A. FIG. 30B shows an iteration where the plane does not intersect the pleural wall. FIG. 30C shows an iteration where the plane intersects the pleural surface, causing the change in the nodule size to increase. In FIG. 30D the plane is reorientated to minimize the cut nodule, forming a new direction. After another iteration, FIG. 30E shows the plane intersects the pleural wall again, but reorientating the plane still leads to a large increase in nodule size, as seen in FIG. 30F. Thus, the algorithm terminates and returns the cut nodule from the previous iteration, FIG. 30D. [0222]
  • In this section, a specific implementation of the algorithm is discussed. A seeded region growing algorithm is used to find the cut-nodule region, and a hill-climbing search is used to perform the minimization when reorientating the plane. This section first discusses the equations used for the plane, followed by a description of the region growing and hill-climbing algorithms. [0223]
  • The representation of the plane has four parameters and is defined as: [0224]
  • ax+by+cz+d=0  (15)
  • Given a direction normal to the plane, v, and a point on the plane, P, the parameters of the plane are calculated as: [0225]
  • a=vx  (16)
  • b=vy  (17)
  • c=vz  (18)
  • d=−(aP x +bP y +cP z)  (19)
  • Finally, a point p is behind the plane if: [0226]
  • ap x +bp y +cp z +d<0  (20)
  • A recursive region growing is used to determine the cut-nodule region. The starting point of the region-growing algorithm is the initial starting location P′, and the plane A is calculated from P[0227] i and di. A description of the region growing algorithm is shown in FIG. 31. For the given pixel p, the algorithm marks it as visited and then determines if it is behind the plane A. If it is not, then the algorithm exits. Otherwise, the pixel p is marked as part of the cut-nodule region, and the algorithm is recursively called for each of the six possible 1-pixel moves from p if the new point has not been visited yet and it is also a foreground pixel.
  • A simple greedy search algorithm is used to reorientate the plane so that it minimizes the cut-nodule size. A new plane is calculated by changing the direction normal to the plane. The hill-climbing algorithm is shown in FIG. 32. The hill-climbing algorithm takes the initial direction and a small stepsize. Next, the size of the cut-nodule is calculated for the planes formed by moving the direction in the six possible coordinate directions. If a smaller size is calculated, then the direction is moved in the direction of the largest decrease. The new direction is normalized to one, and the algorithm is repeated. If there is no decrease in the cut-nodule size, then the algorithm terminates. [0228]
  • The algorithm is preferably implemented in the C programming language for the VisionX software package on a FreeBSD UNIX system. The program preferably operates on binary images that have floating point, byte, or short pixel types. The program preferably outputs the segmented nodule and two debugging images. The initial conditions, initial direction, and termination criteria are preferably specified by options. [0229]
  • Thus, while there have been described what are presently believed to be the preferred embodiments of the invention, those skilled in the art will realize that changes and modifications may be made thereto without departing from the spirit of the invention, and is intended to claim all such changes and modifications as fall within the true scope of the invention. [0230]

Claims (138)

What is claimed is:
1. A method for generating a lung mask for segmenting a lung image from voxel data containing the lung image, noise, solid components and surrounding background information, the method comprising:
(a) applying a median filter and a mean filter to the voxel data to reduce noise;
(b) thresholding the noise reduced voxel data to identify solid components and other structures;
(c) identifying the surrounding background in the noise reduced voxel data;
(d) deleting the surrounding background from the noise reduced voxel data;
(e) labeling connected components of the voxel data;
(f) determining the largest connected components to select a lung region from the voxel data, the lung region having a geometric form; and
(g) morphological filtering the voxel data to refine the geometric form of the lung region.
2. The method as defined by claim 1, wherein the voxel data is associated with a plurality of slices through a patient's lung, the slices beginning at about the patient's shoulders; and
step (a) is performed for the first 25 percent of the plurality of slices only whereby the computation time is substantially reduced.
3. The method as defined by claim 1, wherein the median filter has a size of 4×4.
4. The method as defined by claim 1, wherein the mean filter has a size of 1×3.
5. The method as defined by claim 1, wherein the voxel data in step (b) is thresholded at a gray level of about 500.
6. The method as defined by claim 1, wherein the largest connected components are associated with more than about 1 percent of the voxel data.
7. The method as defined by claim 1, wherein the voxel data is associated with a plurality of slices, the slices being divided into a first end region, a middle region, and a second end region; and
the morphological filtering being performed with 2D circular filter having a first diameter in the first end region and the second end region; and the morphological filtering being performed with 2D circular filter having a second diameter which is about twice the first diameter in the middle region.
8. A method for measuring lung volume from a segmented lung image obtained from a scan which includes a plurality of slices of voxel data, the voxel data having a gray level value and a volume associated therewith, the method comprising:
generating a matrix of entries from the segmented lung image, the matrix having a plurality of columns and a plurality of rows, each of the plurality of columns representing the gray level value and each of the plurality of rows representing one of the plurality of slices in the scan, the entries corresponding to the number of times that the gray level occurs in the corresponding slice;
determining a number of voxels in the segmented lung image from the matrix entries; and
multiplying the number of voxels in the segmented lung image by the volume of each voxel.
9. A method for measuring volume of tissue in a segmented lung image obtained from a scan including a plurality of slices of voxel data, the voxel data having a gray level value and a volume, the method comprising:
generating a matrix of entries from the segmented lung image, the matrix having a plurality of columns and a plurality of rows, each of the plurality of columns representing the gray level value and each of the plurality of rows representing one of the plurality of slices in the scan, the entries corresponding to the number of times that the gray level occurs in the corresponding slice;
determining a sum of tissue of voxels in the segmented lung image from the matrix entries; and
multiplying the sum of tissue of voxels in the segmented lung image by the volume of each voxel.
10. The method as defined by claim 9, wherein the sum of tissue of voxels is calculated by summing the product of each matrix entry multiplied by the corresponding gray level value divided by a gray level value assigned for tissue.
11. A lung mask generating apparatus for segmenting a lung image from voxel data containing the lung image, noise, solid components and surrounding background information, the lung mask generating apparatus comprising:
a masking unit configured to:
(a) apply a median filter and a mean filter to the voxel data to reduce noise;
(b) threshold the noise reduced voxel data to identify solid components and other structures;
(c) identify the surrounding background in the noise reduced voxel data;
(d) delete the surrounding background from the noise reduced voxel data;
(e) label connected components of the voxel data;
(f) determine the largest connected components to select a lung region from the voxel data, the lung region having a geometric form; and
(g) morphologically filter the voxel data to refine the geometric form of the lung region.
12. A lung mask generating apparatus as defined by claim 11, wherein the voxel data is associated with a plurality of slices through a patient's lung, the slices beginning at about the patient's shoulders; and
step (a) is performed for the first 25 percent of the plurality of slices only whereby the computation time is substantially reduced.
13. A lung mask generating apparatus as defined by claim 11, wherein the median filter has a size of 4×4.
14. A lung mask generating apparatus as defined by claim 11, wherein the mean filter has a size of 1×3.
15. A lung mask generating apparatus as defined by claim 11, wherein the voxel data in step (b) is thresholded at a gray level of about 500.
16. A lung mask generating apparatus as defined by claim 11, wherein the largest connected components are associated with more than about 1 percent of the voxel data.
17. A lung mask generating apparatus as defined by claim 11, wherein the voxel data is associated with a plurality of slices, the slices being divided into a first end region, a middle region, and a second end region; and
the morphological filtering being performed with 2D circular filter having a first diameter in the first end region and the second end region; and the morphological filtering being performed with 2D circular filter having a second diameter which is about twice the first diameter in the middle region.
18. An apparatus for measuring lung volume from a segmented lung image obtained from a scan which includes a plurality of slices of voxel data, the voxel data having a gray level value and a volume associated therewith, the apparatus comprising:
a lung volume measuring unit configured to:
generate a matrix of entries from the segmented lung image, the matrix having a plurality of columns and a plurality of rows, each of the plurality of columns representing the gray level value and each of the plurality of rows representing one of the plurality of slices in the scan, the entries corresponding to the number of times that the gray level occurs in the corresponding slice;
determine a number of voxels in the segmented lung image from the matrix entries; and
multiply the number of voxels in the segmented lung image by the volume of each voxel.
19. An apparatus for measuring volume of tissue in a segmented lung image obtained from a scan including a plurality of slices of voxel data, the voxel data having a gray level value and a volume, the apparatus comprising:
a lung tissue measuring unit configured to:
generate a matrix of entries from the segmented lung image, the matrix having a plurality of columns and a plurality of rows, each of the plurality of columns representing the gray level value and each of the plurality of rows representing one of the plurality of slices in the scan, the entries corresponding to the number of times that the gray level occurs in the corresponding slice;
determine a sum of tissue of voxels in the segmented lung image from the matrix entries; and
multiply the sum of tissue of voxels in the segmented lung image by the volume of each voxel.
20. An apparatus for measuring volume of tissue as defined by claim 19, wherein the sum of tissue of voxels is calculated by summing the product of each matrix entry multiplied by the corresponding gray level value divided by a gray level value assigned for tissue.
21. An article of manufacture for generating a lung mask for segmenting a lung image from voxel data containing the lung image, noise, solid components and surrounding background information, the article comprising:
a machine readable medium containing one or more programs which when executed implement the steps of:
(a) applying a median filter and a mean filter to the voxel data to reduce noise;
(b) thresholding the noise reduced voxel data to identify solid components and other structures;
(c) identifying the surrounding background in the noise reduced voxel data;
(d) deleting the surrounding background from the noise reduced voxel data;
(e) labeling connected components of the voxel data;
(f) determining the largest connected components to select a lung region from the voxel data, the lung region having a geometric form; and
(g) morphological filtering the voxel data to refine the geometric form of the lung region.
22. An article of manufacture for generating a lung mask as defined by claim 21, wherein the voxel data is associated with a plurality of slices through a patient's lung, the slices beginning at about the patient's shoulders; and
step (a) is performed for the first 25 percent of the plurality of slices only whereby the computation time is substantially reduced.
23. An article of manufacture for generating a lung mask as defined by claim 21, wherein the median filter has a size of 4×4.
24. An article of manufacture for generating a lung mask as defined by claim 21, wherein the mean filter has a size of 1×3.
25. An article of manufacture for generating a lung mask as defined by claim 21, wherein the voxel data in step (b) is thresholded at a gray level of about 500.
26. An article of manufacture for generating a lung mask defined by claim 21, wherein the largest connected components are associated with more than about 1 percent of the voxel data.
27. An article of manufacture for generating a lung mask as defined by claim 21, wherein the voxel data is associated with a plurality of slices, the slices being divided into a first end region, a middle region, and a second end region; and
the morphological filtering being performed with 2D circular filter having a first diameter in the first end region and the second end region; and the morphological filtering being performed with 2D circular filter having a second diameter which is about twice the first diameter in the middle region.
28. An article of manufacture for measuring lung volume from a segmented lung image obtained from a scan which includes a plurality of slices of voxel data, the voxel data having a gray level value and a volume associated therewith, the article comprising:
a machine readable medium containing one or more programs which when executed implement the steps of:
generating a matrix of entries from the segmented lung image, the matrix having a plurality of columns and a plurality of rows, each of the plurality of columns representing the gray level value and each of the plurality of rows representing one of the plurality of slices in the scan, the entries corresponding to the number of times that the gray level occurs in the corresponding slice;
determining a number of voxels in the segmented lung image from the matrix entries; and
multiplying the number of voxels in the segmented lung image by the volume of each voxel.
29. An article of manufacture for measuring volume of tissue in a segmented lung image obtained from a scan including a plurality of slices of voxel data, the voxel data having a gray level value and a volume, the article comprising:
a machine readable medium containing one or more programs which when executed implement the steps of:
generating a matrix of entries from the segmented lung image, the matrix having a plurality of columns and a plurality of rows, each of the plurality of columns representing the gray level value and each of the plurality of rows representing one of the plurality of slices in the scan, the entries corresponding to the number of times that the gray level occurs in the corresponding slice;
determining a sum of tissue of voxels in the segmented lung image from the matrix entries; and
multiplying the sum of tissue of voxels in the segmented lung image by the volume of each voxel.
30. An article of manufacture for measuring volume of tissue as defined by claim 29, wherein the sum of tissue of voxels is calculated by summing the product of each matrix entry multiplied by the corresponding gray level value divided by a gray level value assigned for tissue.
31. A method for finding the location, P′, and size, r′, of a pulmonary nodule in a high-resolution computed tomography (CT) image, the method comprising:
(a) selecting a set of initial processing parameters including an initial location, P1, an initial size, r1, and target value, T;
(b) computing an initial new location Pi of the nodule with a locator template function;
(c) incrementally increasing size, ri;
(d) computing a new location Pi of the nodule with the locator template function;
(e) computing a size metric with a sizing template function;
(f) repeating steps (c) through (e) until the size metric is less than the target value;
(g) returning the location, P′, and the size, r′, from the previous iteration of steps (c) through (e).
32. A method for finding the location, P, and size, r, of a pulmonary nodule in a high-resolution computed tomography image, the method comprising:
(a) windowing the image to ignore bone structures;
(b) selecting a locator template function and a sizing template function;
(c) selecting a set of initial processing parameters including: an initial location, P; size, r; and termination criteria;
(d) performing a search to determine a maximum response of the locator template function;
(e) determining a response of the sizing template function and comparing the response to the termination criteria;
(f) incrementally increasing the size, r, only if the termination criteria has not been satisfied and repeating steps d and e; and
(g) outputting the location, P, and size, r, of the nodule.
33. A method for finding the location and size of a pulmonary nodule as defined in claim 32, wherein the windowing comprises clipping the image at intensities over about 1000.
34. A method for finding the location and size of a pulmonary nodule as defined in claim 32, wherein the locator template function is a Gaussian template function.
35. A method for finding the location and size of a pulmonary nodule as defined in claim 32, wherein the locator template function is a Laplacian of the Gaussian template function.
36. A method for finding the location and size of a pulmonary nodule as defined in claim 32, wherein the locator template function is a difference of Gaussians template function.
37. A method for finding the location and size of a pulmonary nodule as defined in claim 32, wherein the template function has at least four parameters corresponding to the x-location, y-location, z-location, and radius.
38. A method for finding the location and size of a pulmonary nodule as defined in claim 32, wherein the initial location, P, is calculated from the image.
39. A method for finding the location and size of a pulmonary nodule as defined in claim 32, wherein the initial location, P, is specified by a user.
40. A method for finding the location and size of a pulmonary nodule as defined in claim 32, wherein the search is performed by a hill climbing method.
41. A method for finding the location and size of a pulmonary nodule as defined in claim 32, wherein the search is performed by Powell's method.
42. A pulmonary nodule finding apparatus for finding the location, P′, and size, r′, of a pulmonary nodule in a high-resolution computed tomography (CT) image, the pulmonary nodule finding apparatus comprising:
a nodule finding unit configured to:
(a) select a set of initial processing parameters including an initial location, P1, an initial size, r1, and target value, T;
(b) compute an initial new location Pi of the nodule with a locator template function;
(c) incrementally increase size, ri;
(d) compute a new location Pi of the nodule with the locator template function;
(e) compute a size metric with a sizing template function;
(f) repeat steps (c) through (e) until the size metric is less than the target value;
(g) return the location, P′, and the size, r′, from the previous iteration of steps (c) through (e).
43. A pulmonary nodule finding apparatus for finding the location, P, and size, r, of a pulmonary nodule in a high-resolution computed tomography image, the pulmonary nodule finding apparatus comprising:
a nodule finding unit configured to:
(a) window the image to ignore bone structures;
(b) select a locator template function and a sizing template function;
(c) select a set of initial processing parameters including: an initial location, P; size, r; and termination criteria;
(d) perform a search to determine a maximum response of the locator template function;
(e) determine a response of the sizing template function and comparing the response to the termination criteria;
(f) incrementally increase the size, r, only if the termination criteria has not been satisfied and repeating steps d and e; and
(g) output the location, P, and size, r, of the nodule.
44. A pulmonary nodule finding apparatus as defined in claim 43, wherein the image is clipped at intensities over about 1000 to window the image.
45. A pulmonary nodule finding apparatus as defined in claim 43, wherein the locator template function is a Gaussian template function.
46. A pulmonary nodule finding apparatus as defined in claim 43, wherein the locator template function is a Laplacian of the Gaussian template function.
47. A pulmonary nodule finding apparatus as defined in claim 43, wherein the locator template function is a difference of Gaussians template function.
48. A pulmonary nodule finding apparatus as defined in claim 43, wherein the template function has at least four parameters corresponding to the x-location, y-location, z-location, and radius.
49. A pulmonary nodule finding apparatus as defined in claim 43, wherein the initial location, P, is calculated from the image.
50. A pulmonary nodule finding apparatus as defined in claim 43, wherein the initial location, P, is specified by a user.
51. A pulmonary nodule finding apparatus as defined in claim 43, wherein the search is performed by a hill climbing method.
52. A pulmonary nodule finding apparatus as defined in claim 43, wherein the search is performed by Powell's method.
53. An article of manufacture for finding the location, P′, and size, r′, of a pulmonary nodule in a high-resolution computed tomography (CT) image, the article comprising:
a machine readable medium containing one or more programs which when executed implement the steps of:
(a) selecting a set of initial processing parameters including an initial location, P1, an initial size, r1, and target value, T;
(b) computing an initial new location Pi of the nodule with a locator template function;
(c) incrementally increasing size, ri;
(d) computing a new location Pi of the nodule with the locator template function;
(e) computing a size metric with a sizing template function;
(f) repeating steps (c) through (e) until the size metric is less than the target value;
(g) returning the location, P′, and the size, r′, from the previous iteration of steps (c) through (e).
54. An article of manufacture for finding the location, P, and size, r, of a pulmonary nodule in a high-resolution computed tomography image, the article comprising:
a machine readable medium containing one or more programs which when executed implement the steps of:
(a) windowing the image to ignore bone structures;
(b) selecting a locator template function and a sizing template function;
(c) selecting a set of initial processing parameters including: an initial location, P; size, r; and termination criteria;
(d) performing a search to determine a maximum response of the locator template function;
(e) determining a response of the sizing template function and comparing the response to the termination criteria;
(f) incrementally increasing the size, r, only if the termination criteria has not been satisfied and repeating steps d and e; and
(g) outputting the location, P, and size, r, of the nodule.
55. An article of manufacture for finding the location and size of a pulmonary nodule as defined in claim 54, wherein the windowing comprises clipping the image at intensities over about 1000.
56. An article of manufacture for finding the location and size of a pulmonary nodule as defined in claim 54, wherein the locator template function is a Gaussian template function.
57. An article of manufacture for finding the location and size of a pulmonary nodule as defined in claim 54, wherein the locator template function is a Laplacian of the Gaussian template function.
58. An article of manufacture for finding the location and size of a pulmonary nodule as defined in claim 54, wherein the locator template function is a difference of Gaussians template function.
59. An article of manufacture for finding the location and size of a pulmonary nodule as defined in claim 54, wherein the template function has at least four parameters corresponding to the x-location, y-location, z-location, and radius.
60. An article of manufacture for finding the location and size of a pulmonary nodule as defined in claim 54, wherein the initial location, P, is calculated from the image.
61. An article of manufacture for finding the location and size of a pulmonary nodule as defined in claim 54, wherein the initial location, P, is specified by a user.
62. An article of manufacture for finding the location and size of a pulmonary nodule as defined in claim 54, wherein the search is performed by a hill climbing method.
63. An article of manufacture finding the location and size of a pulmonary nodule as defined in claim 54, wherein the search is performed by Powell's method.
64. A method for registering 3-d images of a pulmonary nodule from a high-resolution computed tomography (CT) scans, the images being in a floating point pixel-format associated with a 6-dimensional parameter space and including a first image (im1) obtained at time-1 and a second image (im2) obtained at time-2, the method comprising the steps of:
(a) calculating initial rigid-body transformation parameters for a rigid-body transformation on the first image (im1);
(b) determining the optimum rigid-body transformation parameters by calculating a registration metric between the second image (im2) and the rigid-body transformation on the first image (im1); and
(c) generating a registered image from the optimum rigid-body transformation parameters.
65. A method as defined in claim 64, wherein step (a) is preceded by masking one of the images by setting pixels to a background value.
66. A method as defined in claim 65, wherein the background value is about −1000.
67. A method as defined in claim 64, wherein the registration metric is minimized.
68. A method as defined in claim 64, wherein the registration metric is maximized.
69. A method as defined in claim 64, wherein the registration metric is calculated by
transforming the first image (im1) with the initial rigid-body transformation parameters to obtain a transformed first image (im1t);
calculating the registration metric as a correlation (C) between the transformed first image (im1t) and the second image (im2); and
searching for the maximum correlation (C) in the 6-dimensional parameter space.
70. A method as defined in claim 64, wherein the registration metric is calculated by
transforming the first image (im1) with the initial rigid-body transformation parameters to obtain a transformed first image (im1t);
calculating the registration metric as a mean-squared-difference (MSD) between the transformed first image (im1t) and the second image (im2); and
searching for the minimum mean-squared-difference (MSD) in the 6-dimensional parameter space.
71. A method as defined in claim 69, wherein the transforming of the first image (im1) to obtain the transformed first image (im1t) is a mapping of a point v in 3-d space to a point v′ in transformed space defined by:
ν = R x R y R Z ν + [ t x t y t z ]
Figure US20030095696A1-20030522-M00016
wherein Rx, Ry, and Rz are rotation matrices defined as:
R x = [ 1 0 0 0 cos ( r x ) - sin ( r x ) 0 sin ( r x ) cos ( r x ) ] R y = [ cos ( r y ) 0 sin ( r y ) 0 1 0 - sin ( r y ) 0 cos ( r y ) ] R z = [ cos ( r z ) - sin ( r z ) 0 sin ( r z ) cos ( r z ) 0 0 0 1 ]
Figure US20030095696A1-20030522-M00017
72. A method as defined in claim 70, wherein the transforming of the first image (im1) to obtain the transformed first image (im1t) is a mapping of a point v in 3-d space to a point v′ in transformed space defined by:
wherein Rx, Ry, and Rz are rotation matrices defined as:
R x = [ 1 0 0 0 cos ( r x ) - sin ( r x ) 0 sin ( r x ) cos ( r x ) ] R y = [ cos ( r y ) 0 sin ( r y ) 0 1 0 - sin ( r y ) 0 cos ( r y ) ] R z = [ cos ( r z ) - sin ( r z ) 0 sin ( r z ) cos ( r z ) 0 0 0 1 ]
Figure US20030095696A1-20030522-M00018
73. A method as defined in claim 64, wherein initial rigid-body transformation parameters include six parameters (tx,ty,tz,rx,ry,rz) respectively defined as translation in x, translation in y, translation in z, rotation about the x-axis, rotation about the y-axis, and rotation about the z-axis;
wherein the initial rotation parameters (rx,ry,rz) are all set to zero; and the initial translation parameters (tx,ty,tz,) are set so that the nodule in the first image (im1) overlaps the nodule in the second image (im2) during the initial calculation of the registration metric.
74. A method as defined in claim 73, wherein the initial translation parameters (tx,ty,tz,) are set to a difference between the center of the first image (im1) and the center of the second image (im2).
75. A method as defined in claim 73, wherein the initial translation parameters (tx,ty,tz) are set to a difference between the center of mass of the first image (im1) and the center of mass of the second image (im2).
76. A method as defined in claim 69, wherein the searching is conducted by calculating the correlation (C) for every possible set of rigid-body transformation parameters.
77. A method as defined in claim 70, wherein the searching is conducted by calculating the mean-squared-difference (MSD) for every possible set of rigid-body transformation parameters.
78. A method as defined in claim 69, wherein the searching is conducted by a Hill-Climbing search method.
79. A method as defined in claim 70, wherein the searching is conducted by a Hill-Climbing search method.
80. A method as defined in claim 69, wherein the searching is conducted by Powell's method.
81. A method as defined in claim 70, wherein the searching is conducted by Powell's method.
82. A registering apparatus for registering 3-d images of a pulmonary nodule from a high-resolution computed tomography (CT) scans, the images being in a floating point pixel-format associated with a 6-dimensional parameter space and including a first image (im1) obtained at time-1 and a second image (im2) obtained at time-2, the registering apparatus comprising:
a registering unit configured to:
(a) calculate initial rigid-body transformation parameters for a rigid-body transformation on the first image (im1);
(b) determine the optimum rigid-body transformation parameters by calculating a registration metric between the second image (im2) and the rigid-body transformation on the first image (im1); and
(c) generate a registered image from the optimum rigid-body transformation parameters.
83. A registering apparatus as defined in claim 82, wherein one of the images is initially masked by setting pixels to a background value.
84. A registering apparatus as defined in claim 83, wherein the background value is about −1000.
85. A registering apparatus as defined in claim 82, wherein the registration metric is minimized.
86. A registering apparatus as defined in claim 82, wherein the registration metric is maximized.
87. A registering apparatus as defined in claim 82, wherein the registration metric is calculated by
transforming the first image (im1) with the initial rigid-body transformation parameters to obtain a transformed first image (im1t);
calculating the registration metric as a correlation (C) between the transformed first image (im1t) and the second image (im2); and
searching for the maximum correlation (C) in the 6-dimensional parameter space.
88. A registering apparatus as defined in claim 82, wherein the registration metric is calculated by
transforming the first image (im1) with the initial rigid-body transformation parameters to obtain a transformed first image (im1t);
calculating the registration metric as a mean-squared-difference (MSD) between the transformed first image (im1t) and the second image (im2); and
searching for the minimum mean-squared-difference (MSD) in the 6-dimensional parameter space.
89. A registering apparatus as defined in claim 87, wherein the transforming of the first image (im1) to obtain the transformed first image (im1t) is a mapping of a point v in 3-d space to a point v′ in transformed space defined by:
ν = R x R y R Z ν + [ t x t y t z ]
Figure US20030095696A1-20030522-M00019
wherein Rx, Ry, and Rz are rotation matrices defined as:
R x = [ 1 0 0 0 cos ( r x ) - sin ( r x ) 0 sin ( r x ) cos ( r x ) ] R y = [ cos ( r y ) 0 sin ( r y ) 0 1 0 - sin ( r y ) 0 cos ( r y ) ] R z = [ cos ( r z ) - sin ( r z ) 0 sin ( r z ) cos ( r z ) 0 0 0 1 ]
Figure US20030095696A1-20030522-M00020
90. A registering apparatus as defined in claim 88, wherein the transforming of the first image (im1) to obtain the transformed first image (im1t) is a mapping of a point v in 3-d space to a point v′ in transformed space defined by:
v = R x R y R z v + [ t x t y t z ]
Figure US20030095696A1-20030522-M00021
wherein Rx, Ry, and Rz are rotation matrices defined as:
R x = [ 1 0 0 0 cos ( r x ) - sin ( r x ) 0 sin ( r x ) cos ( r x ) ] R y = [ cos ( r y ) 0 sin ( r y ) 0 1 0 - sin ( r y ) 0 cos ( r y ) ] R z = [ cos ( r z ) - sin ( r z ) 0 sin ( r z ) cos ( r z ) 0 0 0 1 ] .
Figure US20030095696A1-20030522-M00022
91. A registering apparatus as defined in claim 82, wherein initial rigid-body transformation parameters include six parameters (tx,ty,tz,rx,ry,rz) respectively defined as translation in x, translation in y, translation in z, rotation about the x-axis, rotation about the y-axis, and rotation about the z-axis;
wherein the initial rotation parameters (rx,ry,rz) are all set to zero; and the initial translation parameters (tx,ty,tz,) are set so that the nodule in the first image (im1) overlaps the nodule in the second image (im2) during the initial calculation of the registration metric.
92. A registering apparatus as defined in claim 91, wherein the initial translation parameters (tx,ty,tz,) are set to a difference between the center of the first image (im1) and the center of the second image (im2).
93. A registering apparatus as defined in claim 91, wherein the initial translation parameters (tx,ty,tz) are set to a difference between the center of mass of the first image (im1) and the center of mass of the second image (im2).
94. A registering apparatus as defined in claim 87, wherein the searching is conducted by calculating the correlation (C) for every possible set of rigid-body transformation parameters.
95. A registering apparatus as defined in claim 88, wherein the searching is conducted by calculating the mean-squared-difference (MSD) for every possible set of rigid-body transformation parameters.
96. A registering apparatus as defined in claim 87, wherein the searching is conducted by a Hill-Climbing search method.
97. A registering apparatus as defined in claim 88, wherein the searching is conducted by a Hill-Climbing search method.
98. A registering apparatus as defined in claim 87, wherein the searching is conducted by Powell's method.
99. A registering apparatus as defined in claim 88, wherein the searching is conducted by Powell's method.
100. An article of manufacture for registering 3-d images of a pulmonary nodule from a high-resolution computed tomography (CT) scans, the images being in a floating point pixel-format associated with a 6-dimensional parameter space and including a first image (im1) obtained at time-1 and a second image (im2) obtained at time-2, the article comprising:
a machine readable medium containing one or more programs which when executed implement the steps of:
(a) calculating initial rigid-body transformation parameters for a rigid-body transformation on the first image (im1);
(b) determining the optimum rigid-body transformation parameters by calculating a registration metric between the second image (im2) and the rigid-body transformation on the first image (im1); and
(c) generating a registered image from the optimum rigid-body transformation parameters.
101. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 100, wherein step (a) is preceded by masking one of the images by setting pixels to a background value.
102. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 101, wherein the background value is about −1000.
103. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 100, wherein the registration metric is minimized.
104. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 100, wherein the registration metric is maximized.
105. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 100, wherein the registration metric is calculated by
transforming the first image (im1) with the initial rigid-body transformation parameters to obtain a transformed first image (im1t);
calculating the registration metric as a correlation (C) between the transformed first image (im1t) and the second image (im2); and
searching for the maximum correlation (C) in the 6-dimensional parameter space.
106. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 100, wherein the registration metric is calculated by
transforming the first image (im1) with the initial rigid-body transformation parameters to obtain a transformed first image (im1t);
calculating the registration metric as a mean-squared-difference (MSD) between the transformed first image (im1t) and the second image (im2); and
searching for the minimum mean-squared-difference (MSD) in the 6-dimensional parameter space.
107. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 105, wherein the transforming of the first image (im1) to obtain the transformed first image (im1t) is a mapping of a point v in 3-d space to a point v′ in transformed space defined by:
v = R x R y R z v + [ t x t y t z ]
Figure US20030095696A1-20030522-M00023
wherein Rx, Ry and Rz are rotation matrices defined as:
R x = [ 1 0 0 0 cos ( r x ) - sin ( r x ) 0 sin ( r x ) cos ( r x ) ] R y = [ cos ( r y ) 0 sin ( r y ) 0 1 0 - sin ( r y ) 0 cos ( r y ) ] R z = [ cos ( r z ) - sin ( r z ) 0 sin ( r z ) cos ( r z ) 0 0 0 1 ] .
Figure US20030095696A1-20030522-M00024
108. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 106, wherein the transforming of the first image (im1) to obtain the transformed first image (im1t) is a mapping of a point v in 3-d space to a point v′ in transformed space defined by:
v = R x R y R z v + [ t x t y t z ]
Figure US20030095696A1-20030522-M00025
wherein Rx, Ry and Rz are rotation matrices defined as:
R x = [ 1 0 0 0 cos ( r x ) - sin ( r x ) 0 sin ( r x ) cos ( r x ) ] R y = [ cos ( r y ) 0 sin ( r y ) 0 1 0 - sin ( r y ) 0 cos ( r y ) ] R z = [ cos ( r z ) - sin ( r z ) 0 sin ( r z ) cos ( r z ) 0 0 0 1 ] .
Figure US20030095696A1-20030522-M00026
109. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 100, wherein initial rigid-body transformation parameters include six parameters (tx,ty,tz,rx,ry,rz) respectively defined as translation in x, translation in y, translation in z, rotation about the x-axis, rotation about the y-axis, and rotation about the z-axis;
wherein the initial rotation parameters (rx,ry,rz) are all set to zero; and the initial translation parameters (tx,ty,tz,) are set so that the nodule in the first image (im1) overlaps the nodule in the second image (im2) during the initial calculation of the registration metric.
110. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 109, wherein the initial translation parameters (tx,ty,tz,) are set to a difference between the center of the first image (im1) and the center of the second image (im2).
111. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 109, wherein the initial translation parameters (tx,ty,tz) are set to a difference between the center of mass of the first image (im1) and the center of mass of the second image (im2).
112. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 105, wherein the searching is conducted by calculating the correlation (C) for every possible set of rigid-body transformation parameters.
113. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 106, wherein the searching is conducted by calculating the mean-squared-difference (MSD) for every possible set of rigid-body transformation parameters.
114. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 105, wherein the searching is conducted by a Hill-Climbing search method.
115. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 106, wherein the searching is conducted by a Hill-Climbing search method.
116. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 105, wherein the searching is conducted by Powell's method.
117. An article of manufacture for registering 3-d images of a pulmonary nodule as defined in claim 106, wherein the searching is conducted by Powell's method.
118. A method for removing extraneous matter from an image, the image including a juxtapleural nodule, the method comprising the steps of:
(a) providing an initial location P′;
(b) calculating a spherical volume centered at the initial location P′, the spherical volume fitting inside the image;
(c) calculating a center of mass COM of the spherical volume;
(d) determining an initial direction d′, the initial direction d′ being directed towards the extraneous matter in accordance with the following equation
d = COM - P COM - P ;
Figure US20030095696A1-20030522-M00027
(e) initializing a current location Pi to be equal to the initial location P′;
(f) initializing a current direction di to be equal to the initial direction d′;
(g) initializing a maximum ratio γmax, step size s, prior mass massi-1, and prior change in mass Δi-1;
(h) moving the current location Pi by the step size s in the current direction di;
(i) determining an equation defining a plane A, the plane A being normal to the current direction di, the plane A passing through the current location Pi;
(j) calculating a current mass massi of the nodule on a side of the plane A opposing that of the extraneous matter;
(k) calculating a current change in mass Δi by subtracting the prior mass massi-1 from the current mass massi;
(l) calculating a current ratio γ in accordance with the following equation
γ = Δ i Δ i - 1 - 1 ;
Figure US20030095696A1-20030522-M00028
(m) setting the prior mass massi-1 equal to the current mass massi;
(n) setting the prior change in mass Δi-1 equal to the current change in mass Δi;
(o) comparing the current ratio γ to the maximum ratio γmax;
(p) modifying the current direction di to minimize the current mass massi, and performing steps (h)-(o) while the current ratio γ is one of less than and equal to the maximum ratio γmax; and
(q) modifying the current direction di, performing steps (h)-(o), and outputting the area of the nodule partitioned by the plane A in response to the current ratio γ being greater than the maximum ratio γmax.
119. A method for removing extraneous matter from an image, the image including a juxtapleural nodule as defined in claim 118, wherein the extraneous matter includes a pleural surface.
120. A method for removing extraneous matter from an image, the image including a juxtapleural nodule as defined in claim 118, wherein step (g) further includes the steps of:
initializing the maximum ratio γmax to 0.5; and
initializing the step size s to 1.5.
121. A method for removing extraneous matter from an image, the image including a juxtapleural nodule as defined in claim 118, wherein step (j) further includes the steps of:
(r) defining the current location Pi as being visited;
(s) determining on which side of the plane A the current location Pi is located;
(t) terminating in reponse to the current location Pi not being located on a side of the plane opposing that of the extraneous matter;
(u) defining the current location Pi as being part of a region of interest in response to the current location Pi being located on the side of the plane opposing that of the extraneous matter; and
(v) performing steps (r)-(u) recursively using a location corresponding to at least one of six (6) one-pixel moves from the current location Pi.
122. A method for removing extraneous matter from an image, the image including a juxtapleural nodule as defined in claim 118, wherein step (p) further includes the steps of:
calculating recursively the current mass massi of the nodule on a side of the plane A opposing that of the extraneous matter using at least one of six (6) directions and a step size s1 from the current location Pi; and
defining the current direction di equal to the direction yielding the largest decrease in the current mass massi.
123. A method for removing extraneous matter from an image, the image including a juxtapleural nodule as defined in claim 118, wherein step (q) further includes the steps of:
calculating recursively the current mass massi of the nodule on a side of the plane A opposing that of the extraneous matter using at least one of six (6) directions and a step size s1 from the current location Pi; and
defining the current direction di equal to the direction yielding the largest decrease in the current mass massi.
124. A method for removing extraneous matter from an image, the image including a juxtapleural nodule as defined in claim 118, wherein the initial location P′ is located near a center of the nodule.
125. A recursive apparatus for removing extraneous matter from an image, the image including a juxtapleural nodule, the recursive apparatus comprising:
a processing unit, the processing unit being configured to:
(a) accept an initial location P′;
(b) calculate a spherical volume centered at the initial location P′, the spherical volume fitting inside the image;
(c) calculate a center of mass COM of the spherical volume;
(d) determine an initial direction d′, the initial direction d′ being directed towards the extraneous matter in accordance with the following equation
d = COM - P COM - P ;
Figure US20030095696A1-20030522-M00029
(e) initialize a current location Pi to be equal to the initial location P′;
(f) initialize a current direction di to be equal to the initial direction d′;
(g) initialize a maximum ratio γmax, step size s, prior mass massi-1, and prior change in mass Δi-1;
(h) move the current location Pi by the step size s in the current direction di;
(i) determine an equation defining a plane A, the plane A being normal to the current direction di, the plane A passing through the current location Pi;
(j) calculate a current mass massi of the nodule on a side of the plane A opposing that of the extraneous matter;
(k) calculate a current change in mass Δi by subtracting the prior mass massi-1 from the current mass massi;
(l) calculate a current ratio γ in accordance with the following equation
γ = Δ i Δ i - 1 - 1 ;
Figure US20030095696A1-20030522-M00030
(m) set the prior mass massi-1 equal to the current mass massi;
(n) set the prior change in mass Δi-1 equal to the current change in mass Δi;
(o) compare the current ratio γ to the maximum ratio γmax;
(p) modify the current direction di to minimize the current mass massi, and performing steps (h)-(o) while the current ratio γ is one of less than and equal to the maximum ratio γmax; and
(q) modify the current direction di, performing steps (h)-(o), and outputting the area of the nodule partitioned by the plane A in response to the current ratio γ being greater than the maximum ratio γmax.
126. A recursive apparatus for removing extraneous matter from an image as defined in claim 125, wherein the extraneous matter includes a pleural surface.
127. A recursive apparatus for removing extraneous matter from an image as defined in claim 125, wherein in step (g) the processing unit is configured to:
initialize the maximum ratio γmax to 0.5; and
initialize the step size s to 1.5.
128. A recursive apparatus for removing extraneous matter from an image as defined in claim 125, wherein in step (j) the processing unit is configured to:
(r) define the current location Pi as being visited;
(s) determine on which side of the plane A the current location Pi is located;
(t) terminate in reponse to the current location Pi not being located on a side of the plane opposing that of the extraneous matter;
(u) define the current location Pi as being part of a region of interest in response to the current location Pi being located on the side of the plane opposing that of the extraneous matter; and
(v) perform steps (r)-(u) recursively using a location corresponding to at least one of six (6) one-pixel moves from the current location Pi.
129. A recursive apparatus for removing extraneous matter from an image as defined in claim 125, wherein in step (p) the processing unit is configured to:
calculate recursively the current mass massi of the nodule on a side of the plane A opposing that of the extraneous matter using at least one of six (6) directions and a step size s from the current location Pt1; and
define the current direction di equal to the direction yielding the largest decrease in the current mass massi.
130. A recursive apparatus for removing extraneous matter from an image as defined in claim 125, wherein in step (q) the processing unit is configured to:
calculate recursively the current mass massi of the nodule on a side of the plane A opposing that of the extraneous matter using at least one of six (6) directions and a step size s1 from the current location Pi; and
defining the current direction di equal to the direction yielding the largest decrease in the current mass massi.
131. A recursive apparatus for removing extraneous matter from an image as defined in claim 125, wherein the initial location P′ is located near a center of the nodule.
132. An article of manufacture for removing extraneous matter from an image, the image including a juxtapleural nodule, the article comprising:
a machine readable medium containing at least one program which when executed implements the steps of:
(a) accepting an initial location P′;
(b) calculating a spherical volume centered at the initial location P′, the spherical volume fitting inside the image;
(c) calculating a center of mass COM of the spherical volume;
(d) determining an initial direction d′, the initial direction d′ being directed towards the extraneous matter in accordance with the following equation
d = COM - P || COM - P || ;
Figure US20030095696A1-20030522-M00031
(e) initializing a current location Pi to be equal to the initial location P′;
(f) initializing a current direction di to be equal to the initial direction d′;
(g) initializing a maximum ratio γmax, step size s, prior mass massi-1, and prior change in mass Δi-1;
(h) moving the current location Pi by the step size s in the current direction di;
(i) determining an equation defining a plane A, the plane A being normal to the current direction di, the plane A passing through the current location Pi;
(j) calculating a current mass massi of the nodule on a side of the plane A opposing that of the extraneous matter;
(k) calculating a current change in mass Δi by subtracting the prior mass massi-1 from the current mass massi;
(l) calculating a current ratio γ in accordance with the following equation
γ = Δ i Δ i - 1 - 1 ;
Figure US20030095696A1-20030522-M00032
(m) setting the prior mass massi-1 equal to the current mass massi;
(n) setting the prior change in mass Δi-1 equal to the current change in mass Δi;
o) comparing the current ratio γ to the maximum ratio γmax;
(p) modifying the current direction di to minimize the current mass massi, and performing steps (h)-(o) while the current ratio γ is one of less than and equal to the maximum ratio γmax; and
(q) modifying the current direction di, performing steps (h)-(o), and outputting the area of the nodule partitioned by the plane A in response to the current ratio γ being greater than the maximum ratio γmax.
133. An article of manufacture for removing extraneous matter from an image as defined in claim 132, wherein the extraneous matter includes a pleural surface.
134. An article of manufacture for removing extraneous matter from an image as defined in claim 132, wherein in step (g) the article further implements the steps of:
initializing the maximum ratio γmax to 0.5; and
initializing the step size s to 1.5.
135. An article of manufacture for removing extraneous matter from an image as defined in claim 132, wherein in step (j) the article further implements the steps of:
(r) defining the current location Pi as being visited;
(s) determining on which side of the plane A the current location Pi is located;
(t) terminating in reponse to the current location Pi not being located on a side of the plane opposing that of the extraneous matter;
(u) defining the current location Pi as being part of a region of interest in response to the current location Pi being located on the side of the plane opposing that of the extraneous matter; and
(v) performing steps (r)-(u) recursively using a location corresponding to at least one of six (6) one-pixel moves from the current location Pi.
136. An article of manufacture for removing extraneous matter from an image as defined in claim 132, wherein in step (p) the article further implements the steps of:
calculating recursively the current mass massi of the nodule on a side of the plane A opposing that of the extraneous matter using at least one of six (6) directions and a step size s1 from the current location Pi; and
defining the current direction di equal to the direction yielding the largest decrease in the current mass massi.
137. An article of manufacture for removing extraneous matter from an image as defined in claim 132, wherein in step (q) the article further implements the steps of:
calculating recursively the current mass massi of the nodule on a side of the plane A opposing that of the extraneous matter using at least one of six (6) directions and a step size s1 from the current location Pi; and
defining the current direction di equal to the direction yielding the largest decrease in the current mass massi.
138. An article of manufacture for removing extraneous matter from an image as defined in claim 132, wherein the initial location P′ is located near a center of the nodule.
US10/245,782 2001-09-14 2002-09-16 System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans Abandoned US20030095696A1 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
US32203801P true 2001-09-14 2001-09-14
US10/245,782 US20030095696A1 (en) 2001-09-14 2002-09-16 System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/245,782 US20030095696A1 (en) 2001-09-14 2002-09-16 System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans
US12/074,211 US7660451B2 (en) 2001-09-14 2008-02-29 System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US12/074,211 Division US7660451B2 (en) 2001-09-14 2008-02-29 System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans

Publications (1)

Publication Number Publication Date
US20030095696A1 true US20030095696A1 (en) 2003-05-22

Family

ID=23253126

Family Applications (2)

Application Number Title Priority Date Filing Date
US10/245,782 Abandoned US20030095696A1 (en) 2001-09-14 2002-09-16 System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans
US12/074,211 Active US7660451B2 (en) 2001-09-14 2008-02-29 System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans

Family Applications After (1)

Application Number Title Priority Date Filing Date
US12/074,211 Active US7660451B2 (en) 2001-09-14 2008-02-29 System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans

Country Status (3)

Country Link
US (2) US20030095696A1 (en)
AU (1) AU2002341671A1 (en)
WO (1) WO2003024184A2 (en)

Cited By (42)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20020122576A1 (en) * 2000-11-04 2002-09-05 Juergen Weese Method and device for the registration of images
US20030099388A1 (en) * 2001-11-23 2003-05-29 University Of Chicago Novel subtraction technique for computerized detection of small lung nodules in computer tomography images
US20030105395A1 (en) * 2001-12-05 2003-06-05 Li Fan Vessel-feeding pulmonary nodule candidate generation
US20030113005A1 (en) * 2001-12-14 2003-06-19 Amit Saxena Image processing system
US20030144598A1 (en) * 2002-01-29 2003-07-31 Li Zhang Bronchial wall thickening recognition for reduced false-positives in pulmonary nodule detection
US20040105527A1 (en) * 2002-11-22 2004-06-03 Matthieu Ferrant Methods and apparatus for the classification of nodules
US20040126000A1 (en) * 2002-12-24 2004-07-01 Konica Minolta Holdings, Inc. Image processing apparatus, method, program, and recording medium
US20040184647A1 (en) * 2002-10-18 2004-09-23 Reeves Anthony P. System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans
US20040202990A1 (en) * 2003-03-12 2004-10-14 Bernhard Geiger System and method for performing a virtual endoscopy
US20050002548A1 (en) * 2003-06-20 2005-01-06 Novak Carol L. Automatic detection of growing nodules
US20050018890A1 (en) * 2003-07-24 2005-01-27 Mcdonald John Alan Segmentation of left ventriculograms using boosted decision trees
US20050135707A1 (en) * 2003-12-18 2005-06-23 Turek Matthew W. Method and apparatus for registration of lung image data
US20050171409A1 (en) * 2004-01-30 2005-08-04 University Of Chicago Automated method and system for the detection of lung nodules in low-dose CT image for lung-cancer screening
US20050240882A1 (en) * 2004-04-21 2005-10-27 Ge Medical Systems Information Technologies, Inc. Method and system for displaying regions of pathological interest
US20050285947A1 (en) * 2004-06-21 2005-12-29 Grindstaff Gene A Real-time stabilization
US20060018549A1 (en) * 2004-07-20 2006-01-26 Jianming Liang System and method for object characterization of toboggan-based clusters
US20060098856A1 (en) * 2003-01-30 2006-05-11 Koninklijke Philips Electronics N.V. Reconstruction of local patient doses in computed tomography
US20060239544A1 (en) * 2005-03-16 2006-10-26 Yankelevitz David F Method for expanding the domain of imaging software in a diagnostic work-up
US20060257027A1 (en) * 2005-03-04 2006-11-16 Alfred Hero Method of determining alignment of images in high dimensional feature space
US20060269109A1 (en) * 2005-04-18 2006-11-30 Kazunori Okada Refined segmentation of nodules for computer assisted diagnosis
US20070008317A1 (en) * 2005-05-25 2007-01-11 Sectra Ab Automated medical image visualization using volume rendering with local histograms
US20070019852A1 (en) * 2005-07-22 2007-01-25 Schildkraut Jay S Pulminary nodule detection in a chest radiograph
US20070036402A1 (en) * 2005-07-22 2007-02-15 Cahill Nathan D Abnormality detection in medical images
US20070053562A1 (en) * 2005-02-14 2007-03-08 University Of Iowa Research Foundation Methods of smoothing segmented regions and related devices
US20070100226A1 (en) * 2004-04-26 2007-05-03 Yankelevitz David F Medical imaging system for accurate measurement evaluation of changes in a target lesion
US20070140541A1 (en) * 2002-12-04 2007-06-21 Bae Kyongtae T Method and apparatus for automated detection of target structures from medical images using a 3d morphological matching algorithm
US20070165917A1 (en) * 2005-11-26 2007-07-19 Zhujiang Cao Fully automatic vessel tree segmentation
US20070223807A1 (en) * 2006-03-22 2007-09-27 Cornell Research Foundation, Inc. Medical imaging visibility index system and method for cancer lesions
US20070280643A1 (en) * 2004-03-26 2007-12-06 Seo Kang S Recording medium, method, and apparatus for reproducing text subtitle streams
US20080002872A1 (en) * 2006-06-30 2008-01-03 Gatesoupe Pascal Methods and apparatuses for correcting a mammogram with an implant, and for segmenting an implant
DE102006043910A1 (en) * 2006-09-19 2008-03-27 Siemens Ag Result filter and method for the selection of the result data of an application for automatic pattern recognition
US20080267499A1 (en) * 2007-04-30 2008-10-30 General Electric Company Method and system for automatic detection of objects in an image
US20080273651A1 (en) * 2007-05-05 2008-11-06 Franz Edward Boas Methods and apparatus for reducing artifacts in computed tomography images
US20090048505A1 (en) * 2007-08-14 2009-02-19 Siemens Aktiengesellschaft Upper body MRI scanner and associated control method
US20100142775A1 (en) * 2007-03-19 2010-06-10 Balaji Ganeshan Method, apparatus and computer program for analysing medical image data
US20100165206A1 (en) * 2008-12-30 2010-07-01 Intel Corporation Method and apparatus for noise reduction in video
US20100239187A1 (en) * 2009-03-17 2010-09-23 Sehoon Yea Method for Up-Sampling Depth Images
US20100284598A1 (en) * 2008-01-18 2010-11-11 Koninklijke Philips Electronics N.V. Image registration alignment metric
US20130051644A1 (en) * 2011-08-29 2013-02-28 General Electric Company Method and apparatus for performing motion artifact reduction
TWI396111B (en) * 2009-12-30 2013-05-11 Pou Yuen Technology Co Ltd
ES2530424A1 (en) * 2013-09-02 2015-03-02 Quibim S L Segmentation method for variable adaptive threshold for obtaining reference values ​​cut cut air imaging studies CT
US20150287186A1 (en) * 2012-11-06 2015-10-08 Timpel S.A. Method and device for simplifying information obtained from electrical impedance tomography

Families Citing this family (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1716538A1 (en) * 2004-02-13 2006-11-02 Philips Intellectual Property &amp; Standards GmbH Apparatus and method for registering images of a structured object
GB2451367B (en) 2004-05-20 2009-05-27 Medicsight Plc Nodule Detection
GB2415563B (en) 2004-06-23 2009-11-25 Medicsight Plc Lesion boundary detection
DE102004032914A1 (en) 2004-07-07 2006-02-02 Siemens Ag A method for determining a coordinate transformation from image coordinates of different images of an object
US8090208B2 (en) * 2006-10-04 2012-01-03 Siemens Computer Aided Diagnosis Ltd. Robust segmentation of a mass candidate in digital mammography images
EP2040059A3 (en) * 2007-09-19 2013-09-04 FUJIFILM Corporation Optical tomography imaging system, contact area detecting method and image processing method using the same, and optical tomographic image obtaining method
US8165369B2 (en) * 2007-10-03 2012-04-24 Siemens Medical Solutions Usa, Inc. System and method for robust segmentation of pulmonary nodules of various densities
US8781214B2 (en) * 2009-10-29 2014-07-15 Optovue, Inc. Enhanced imaging for optical coherence tomography
US8468003B2 (en) 2010-08-23 2013-06-18 Broncus Medical, Inc. Automated fiducial marker planning system and related methods
JP6038799B2 (en) 2010-11-17 2016-12-07 オプトビュー,インコーポレーテッド 3d retinoschisis detected using an optical coherence tomography
TW201221117A (en) * 2010-11-29 2012-06-01 Iner Aec Executive Yuan Enhancing segmentation for molecular image quantification system and the method thereof
US9678620B2 (en) 2011-10-11 2017-06-13 Koninklijke Philips N.V. Workflow for ambiguity guided interactive segmentation of lung lobes
CN103903303B (en) * 2012-12-27 2018-01-30 清华大学 Three-dimensional model creation method and apparatus
US10006271B2 (en) 2013-09-26 2018-06-26 Harris Corporation Method for hydrocarbon recovery with a fractal pattern and related apparatus
US9417357B2 (en) 2013-09-26 2016-08-16 Harris Corporation Method for hydrocarbon recovery with change detection and related apparatus

Citations (95)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2804979A (en) * 1954-11-19 1957-09-03 Harmon D Lassiter Portable lifting apparatus
US2948277A (en) * 1959-04-02 1960-08-09 Smith Corp A O Two temperature water heating system
US3007470A (en) * 1959-03-26 1961-11-07 Smith Corp A O Water heating system
US3070927A (en) * 1959-12-30 1963-01-01 Lundahl Lennart Viktor Samuel Method of and apparatus for making and filling flexible-walled tubes
US3100586A (en) * 1960-03-14 1963-08-13 John R Haynes Valved opener for sealed containers
US3434652A (en) * 1966-07-26 1969-03-25 Diamond Shamrock Corp Self-supporting plastic container and method of making same
US3539076A (en) * 1969-04-02 1970-11-10 Peggy Weiss Valved liquid dispenser
US3572498A (en) * 1968-09-23 1971-03-30 Trw Inc Variable speed conveyor
US3797842A (en) * 1972-06-14 1974-03-19 Cornelius Co Transfer cart
US3812644A (en) * 1971-09-12 1974-05-28 Chuba Kikai Co Ltd Method for packaging flowable materials and apparatus for manufacturing packaging bags
US3813845A (en) * 1972-06-23 1974-06-04 Gen Films Inc Filling and sealing system
US3924781A (en) * 1974-08-08 1975-12-09 Int Comador Of Memphis Inc Dispenser apparatus suspended for bottom discharge
US4117649A (en) * 1976-03-29 1978-10-03 Sig Schweizerische Industrie-Gesellschaft System for forming, filling and closing bags
US4241563A (en) * 1978-09-29 1980-12-30 Sig Schweizerische Industrie-Gesellschaft Apparatus for producing and filling tubular bags
US4291520A (en) * 1979-12-26 1981-09-29 Package Machinery Company Vertical form, fill and seal packaging machine with improved end sealing and stripping means
US4391081A (en) * 1980-09-08 1983-07-05 Hayssen Manufacturing Company Method of and apparatus for forming, filling and sealing packages
US4413775A (en) * 1982-07-12 1983-11-08 Scott Kenneth W Water heater control system
US4421253A (en) * 1982-02-17 1983-12-20 Willamette Industries, Inc. Disposable container assembly for liquids or semi-liquids in bulk
US4467845A (en) * 1981-04-30 1984-08-28 Norsk Hydro A.S. Method and means for filling of bulk material in flexible containers
US4473989A (en) * 1980-10-17 1984-10-02 Toyo Seikan Kaisha, Ltd. Method, a line and a pouch supporting base for automatically filling up and sealing pouches at high speed
US4586318A (en) * 1983-12-22 1986-05-06 All Packaging Machinery & Supplies Corp. Bag forming and bagger apparatus and method
US4674627A (en) * 1984-11-08 1987-06-23 Proctor & Schwartz, Inc. Sanitary conveyor assembly
US4753060A (en) * 1986-12-20 1988-06-28 Ecs Corporation Method and apparatus for filling bags
US4765351A (en) * 1985-08-23 1988-08-23 Clary Kenneth B Dual temperature water heater
US4844018A (en) * 1986-04-16 1989-07-04 Etsuko Niki Water supplying system for small-animal cages
US4867277A (en) * 1988-09-29 1989-09-19 Sloan William C Portable lifting device and cart
US4887411A (en) * 1987-06-25 1989-12-19 Baxter International Inc. Apparatus for filling bags or pouches with a perfusion liquid
US4964261A (en) * 1989-01-24 1990-10-23 Benn James A Bag filling method and apparatus for preparing pharmaceutical sterile solutions
US5032265A (en) * 1990-06-20 1991-07-16 Millipore Corporation Method and system for producing sterile aqueous solutions
US5083510A (en) * 1989-06-05 1992-01-28 Hohlt Kenneth W Trash compactor and waste material container
US5140801A (en) * 1989-09-14 1992-08-25 Indag Gessellschaft Fur Industriebedarf Mbh Apparatus for filling folded sheet bags
US5181365A (en) * 1991-12-09 1993-01-26 Minnesota Mining And Manufacturing Company Method and apparatus for forming individual pouches from a continuous web and packaging a product in the individual pouches
US5217698A (en) * 1986-02-06 1993-06-08 Steris Corporation Office size instrument sterilization system
US5228443A (en) * 1992-03-27 1993-07-20 General Electric Company Method for estimation and display of current source distribution from electric and magnetic measurements and 3D anatomical data
US5278941A (en) * 1992-06-08 1994-01-11 Ward Richard E Electric immersion heater with restricted heat-flow paths to the thermostatic control thereof
US5279098A (en) * 1990-07-31 1994-01-18 Ishida Scales Mfg. Co., Ltd. Apparatus for and method of transverse sealing for a form-fill-seal packaging machine
US5283837A (en) * 1991-08-27 1994-02-01 Picker International, Inc. Accurate estimation of surface normals in 3-D data sets
US5307607A (en) * 1992-10-13 1994-05-03 Frank Tondo Apparatus for compacting trash or the like
US5348623A (en) * 1988-12-09 1994-09-20 Terrill Designs, Inc. Water heating and distilling apparatus
US5351067A (en) * 1991-07-22 1994-09-27 International Business Machines Corporation Multi-source image real time mixing and anti-aliasing
US5461843A (en) * 1993-10-12 1995-10-31 Ag-Bag International Method for treatment of bagged organic materials
US5474024A (en) * 1994-10-04 1995-12-12 Thoren Caging Systems, Inc. Caging system with slide bar operator for quick disconnect water fitting
US5570569A (en) * 1994-04-08 1996-11-05 Masuda; Tokihisa Quadrangular package bag and method and apparatus therefor
US5664493A (en) * 1994-10-14 1997-09-09 Kim; Dong Ik Waste, glass, and plastic compactor
US5712926A (en) * 1994-10-20 1998-01-27 Eberhard; Jeffrey Wayne X-ray computed tomography (CT) system for detecting thin objects
US5749321A (en) * 1995-05-24 1998-05-12 Santen Seiyaku Kabushiki Kaisha Animal rearing apparatus
US5757953A (en) * 1996-02-29 1998-05-26 Eastman Kodak Company Automated method and system for region decomposition in digital radiographic images
US5791519A (en) * 1995-12-27 1998-08-11 International Sanitary Ware Manufacturing Cy, S.A. Soap bag
US5791454A (en) * 1995-06-01 1998-08-11 Konrad Doppelmayr & Sohn Maschinenfabrik Gesellschaft Mbh & Co. Kg Conveyor system for transporting goods
US5807256A (en) * 1993-03-01 1998-09-15 Kabushiki Kaisha Toshiba Medical information processing system for supporting diagnosis
US5818964A (en) * 1994-12-27 1998-10-06 Texas Instruments Incorporated Method and apparatus for selecting an adaptive filter for image data
US5818973A (en) * 1996-01-11 1998-10-06 Umax Data Systems Inc. Apparatus for digital correction in an image system
US5825936A (en) * 1994-09-22 1998-10-20 University Of South Florida Image analyzing device using adaptive criteria
US5823144A (en) * 1996-02-14 1998-10-20 Edstrom Industries, Inc. Cage and rack system incorporating automatic water docking system, latch mechanism, and quick-connect coupling
US5865144A (en) * 1997-08-29 1999-02-02 Semenuk; Michael Ventilated cage for laboratory animal
US5877771A (en) * 1996-07-12 1999-03-02 Silicon Graphics, Inc. Method and apparatus for supersampling based on the local rate of change in texture
US5975359A (en) * 1995-12-27 1999-11-02 International Sanitary Ware Manufacturing Cy, S.A. Needle engaging soap bag
US5992131A (en) * 1996-09-17 1999-11-30 Shikoku Kakoki Co., Ltd. Filling and packaging apparatus
US6026988A (en) * 1994-08-18 2000-02-22 Creamiser Products Corporation Liquid dispenser with tapping stem
US6032437A (en) * 1997-11-06 2000-03-07 Flexico-France Automatic machine for forming, filling, and sealing bags having transverse closure strips, and bags obtained thereby
US6039171A (en) * 1997-04-08 2000-03-21 Konrad Doppelmayr & Sohn Maschinenfabrik Mbh & Co. Kg Conveyor system for transporting goods
US6041579A (en) * 1997-05-12 2000-03-28 Beach, Llc Bag forming machine with straw inserting mechanism
US6047090A (en) * 1996-07-31 2000-04-04 U.S. Philips Corporation Method and device for automatic segmentation of a digital image using a plurality of morphological opening operation
US6167677B1 (en) * 1998-03-26 2001-01-02 Rovema Verpackungsmaschinen Gmbh Tubular bagging machine
US6182426B1 (en) * 1998-10-19 2001-02-06 Liqui-Box Corporation Vertical form, fill, seal machine and methods
US6199084B1 (en) * 1998-09-09 2001-03-06 Hitachi America, Ltd. Methods and apparatus for implementing weighted median filters
US6208763B1 (en) * 1998-04-14 2001-03-27 General Electric Company Method and apparatus for enhancing discrete pixel images
US6229331B1 (en) * 1998-12-02 2001-05-08 Tokyo Seimitsu Co., Ltd. Apparatus for and method of inspecting patterns on semiconductor integrated devices
US6269176B1 (en) * 1998-12-21 2001-07-31 Eastman Kodak Company Method for x-ray antiscatter grid detection and suppression in digital radiography
US6339998B1 (en) * 1999-11-22 2002-01-22 Motohiro Niki, et al. Water feed device for small animal rearing apparatus
US20020038477A1 (en) * 2000-10-03 2002-04-04 Mowery Thomas E. Lifting and transfer apparatus
US6418961B1 (en) * 2000-04-18 2002-07-16 Edstrom Industries, Inc. Water supply manifold
US20020092273A1 (en) * 2000-10-02 2002-07-18 Nygaard Jensen Tim Allan Sealable diaper-disposal system and method
US20020124533A1 (en) * 2001-01-04 2002-09-12 Dietmar Schmetzer Method and apparatus for the packaging of articles
US20020139089A1 (en) * 2001-03-15 2002-10-03 Quebec Inc. Apparatus for bagging material
US20020170270A1 (en) * 2001-04-03 2002-11-21 Borchard James A. Methods and apparatus for sealing a load placed on a pallet
USD472027S1 (en) * 2002-06-20 2003-03-18 Ivor Michel Walter Tote cart
US6549646B1 (en) * 2000-02-15 2003-04-15 Deus Technologies, Llc Divide-and-conquer method and system for the detection of lung nodule in radiological images
US6554164B1 (en) * 1999-06-28 2003-04-29 Ronald Archibald Jones Flexible packaging bag and support unit
US20030154692A1 (en) * 2001-03-02 2003-08-21 Optima Machinery Corporation Bag packaging method and assembly for a bag filling station
US6612356B2 (en) * 2001-04-10 2003-09-02 Exxonmobil Oil Corporation Apparatus for improving film machinability during film sealing
US6651406B2 (en) * 2001-02-13 2003-11-25 Sealed Air Corporation (Us) Apparatus and method for forming inflated containers
US20030230052A1 (en) * 2002-06-13 2003-12-18 Rabiea Jeffrey D. Plastic bag and packaging method using same
US20040040262A1 (en) * 2000-10-12 2004-03-04 Riccardo Palumbo Apparatus and method for packaging products
US20040103619A1 (en) * 1999-02-15 2004-06-03 Alberta Sunflower Seeds Ltd. Bag filling apparatus and method
US6751926B1 (en) * 1999-05-11 2004-06-22 Andrew Cooper Packaging filler product and machine for producing same
US6760468B1 (en) * 1996-02-06 2004-07-06 Deus Technologies, Llc Method and system for the detection of lung nodule in radiological images using digital image processing and artificial neural network
US20040182469A1 (en) * 2003-03-18 2004-09-23 Concetti S.P.A. Apparatus for filling bags with loose material and automatic machine equipped with said apparatus
US20040240754A1 (en) * 2001-06-29 2004-12-02 Smith Melvyn Lionel Overhead dimensioning system and method
US6871473B1 (en) * 2000-08-10 2005-03-29 Pactiv Corporation Method and apparatus for making reclosable plastic bags using a pre-applied slider-operated fastener
US6889739B2 (en) * 2003-04-08 2005-05-10 Automated Packaging Systems, Inc. Fluid filled unit formation machine and process
US6895726B2 (en) * 2001-01-16 2005-05-24 Poly-Clip System Corp. Poly-stretch bagger system
US20050132670A1 (en) * 2003-12-22 2005-06-23 Curran Shanley J. System and process for packing unit doses of liquid medication
US6910444B1 (en) * 2003-03-21 2005-06-28 John Soppe Heated milk supply system for livestock
US6912971B1 (en) * 2002-11-06 2005-07-05 Aquaflow Laboratory Products Limited Valve arrangement and assembly for dispensing a liquid from a container to an animal

Family Cites Families (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3757299A (en) * 1972-07-14 1973-09-04 Artek Syst Corp An assay medium method and apparatus for measuring the size of zones of inhibition in
US4720870A (en) * 1985-06-18 1988-01-19 Billiotte Jean Marie Method of automatically and electronically analyzing patterns in order to distinguish symmetrical perceptible areas in a scene together with their centers of symmetry
US5291560A (en) * 1991-07-15 1994-03-01 Iri Scan Incorporated Biometric personal identification system based on iris analysis
US5289374A (en) * 1992-02-28 1994-02-22 Arch Development Corporation Method and system for analysis of false positives produced by an automated scheme for the detection of lung nodules in digital chest radiographs
JPH07299053A (en) * 1994-04-29 1995-11-14 Arch Dev Corp Computer-aided diagnosing method
US5531520A (en) * 1994-09-01 1996-07-02 Massachusetts Institute Of Technology System and method of registration of three-dimensional data sets including anatomical body data
WO1996027846A1 (en) * 1995-03-03 1996-09-12 Arch Development Corporation Method and system for the detection of lesions in medical images
DE19616199B4 (en) * 1996-04-23 2005-02-10 Siemens Ag Calculator for a computer tomograph
US6144754A (en) * 1997-03-28 2000-11-07 Oki Electric Industry Co., Ltd. Method and apparatus for identifying individuals
US6078680A (en) * 1997-07-25 2000-06-20 Arch Development Corporation Method, apparatus, and storage medium for detection of nodules in biological tissue using wavelet snakes to characterize features in radiographic images
US6246784B1 (en) * 1997-08-19 2001-06-12 The United States Of America As Represented By The Department Of Health And Human Services Method for segmenting medical images and detecting surface anomalies in anatomical structures
DE19806728A1 (en) * 1998-02-18 1999-08-19 Philips Patentverwaltung Method for two-dimensional imaging of structures for medical diagnostics
US6138045A (en) * 1998-08-07 2000-10-24 Arch Development Corporation Method and system for the segmentation and classification of lesions
US6112112A (en) * 1998-09-18 2000-08-29 Arch Development Corporation Method and system for the assessment of tumor extent in magnetic resonance images
US6754374B1 (en) * 1998-12-16 2004-06-22 Surgical Navigation Technologies, Inc. Method and apparatus for processing images with regions representing target objects
US6243494B1 (en) * 1998-12-18 2001-06-05 University Of Washington Template matching in 3 dimensions using correlative auto-predictive search
AU5153901A (en) 2000-04-11 2001-10-23 Cornell Res Foundation Inc System and method for three-dimensional image rendering and analysis
US6470092B1 (en) * 2000-11-21 2002-10-22 Arch Development Corporation Process, system and computer readable medium for pulmonary nodule detection using multiple-templates matching
EP1356419B1 (en) * 2000-11-22 2014-07-16 MeVis Medical Solutions AG Graphical user interface for display of anatomical information
US6816607B2 (en) * 2001-05-16 2004-11-09 Siemens Corporate Research, Inc. System for modeling static and dynamic three dimensional anatomical structures by 3-D models
US6993174B2 (en) * 2001-09-07 2006-01-31 Siemens Corporate Research, Inc Real time interactive segmentation of pulmonary nodules with control parameters

Patent Citations (97)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US2804979A (en) * 1954-11-19 1957-09-03 Harmon D Lassiter Portable lifting apparatus
US3007470A (en) * 1959-03-26 1961-11-07 Smith Corp A O Water heating system
US2948277A (en) * 1959-04-02 1960-08-09 Smith Corp A O Two temperature water heating system
US3070927A (en) * 1959-12-30 1963-01-01 Lundahl Lennart Viktor Samuel Method of and apparatus for making and filling flexible-walled tubes
US3100586A (en) * 1960-03-14 1963-08-13 John R Haynes Valved opener for sealed containers
US3434652A (en) * 1966-07-26 1969-03-25 Diamond Shamrock Corp Self-supporting plastic container and method of making same
US3572498A (en) * 1968-09-23 1971-03-30 Trw Inc Variable speed conveyor
US3539076A (en) * 1969-04-02 1970-11-10 Peggy Weiss Valved liquid dispenser
US3812644A (en) * 1971-09-12 1974-05-28 Chuba Kikai Co Ltd Method for packaging flowable materials and apparatus for manufacturing packaging bags
US3797842A (en) * 1972-06-14 1974-03-19 Cornelius Co Transfer cart
US3813845A (en) * 1972-06-23 1974-06-04 Gen Films Inc Filling and sealing system
US3924781A (en) * 1974-08-08 1975-12-09 Int Comador Of Memphis Inc Dispenser apparatus suspended for bottom discharge
US4117649A (en) * 1976-03-29 1978-10-03 Sig Schweizerische Industrie-Gesellschaft System for forming, filling and closing bags
US4241563A (en) * 1978-09-29 1980-12-30 Sig Schweizerische Industrie-Gesellschaft Apparatus for producing and filling tubular bags
US4291520A (en) * 1979-12-26 1981-09-29 Package Machinery Company Vertical form, fill and seal packaging machine with improved end sealing and stripping means
US4391081A (en) * 1980-09-08 1983-07-05 Hayssen Manufacturing Company Method of and apparatus for forming, filling and sealing packages
US4473989A (en) * 1980-10-17 1984-10-02 Toyo Seikan Kaisha, Ltd. Method, a line and a pouch supporting base for automatically filling up and sealing pouches at high speed
US4467845A (en) * 1981-04-30 1984-08-28 Norsk Hydro A.S. Method and means for filling of bulk material in flexible containers
US4421253A (en) * 1982-02-17 1983-12-20 Willamette Industries, Inc. Disposable container assembly for liquids or semi-liquids in bulk
US4413775A (en) * 1982-07-12 1983-11-08 Scott Kenneth W Water heater control system
US4586318A (en) * 1983-12-22 1986-05-06 All Packaging Machinery & Supplies Corp. Bag forming and bagger apparatus and method
US4674627A (en) * 1984-11-08 1987-06-23 Proctor & Schwartz, Inc. Sanitary conveyor assembly
US4765351A (en) * 1985-08-23 1988-08-23 Clary Kenneth B Dual temperature water heater
US5217698A (en) * 1986-02-06 1993-06-08 Steris Corporation Office size instrument sterilization system
US4844018A (en) * 1986-04-16 1989-07-04 Etsuko Niki Water supplying system for small-animal cages
US4753060A (en) * 1986-12-20 1988-06-28 Ecs Corporation Method and apparatus for filling bags
US4887411A (en) * 1987-06-25 1989-12-19 Baxter International Inc. Apparatus for filling bags or pouches with a perfusion liquid
US4867277A (en) * 1988-09-29 1989-09-19 Sloan William C Portable lifting device and cart
US5348623A (en) * 1988-12-09 1994-09-20 Terrill Designs, Inc. Water heating and distilling apparatus
US4964261A (en) * 1989-01-24 1990-10-23 Benn James A Bag filling method and apparatus for preparing pharmaceutical sterile solutions
US5083510A (en) * 1989-06-05 1992-01-28 Hohlt Kenneth W Trash compactor and waste material container
US5140801A (en) * 1989-09-14 1992-08-25 Indag Gessellschaft Fur Industriebedarf Mbh Apparatus for filling folded sheet bags
US5032265A (en) * 1990-06-20 1991-07-16 Millipore Corporation Method and system for producing sterile aqueous solutions
US5279098A (en) * 1990-07-31 1994-01-18 Ishida Scales Mfg. Co., Ltd. Apparatus for and method of transverse sealing for a form-fill-seal packaging machine
US5351067A (en) * 1991-07-22 1994-09-27 International Business Machines Corporation Multi-source image real time mixing and anti-aliasing
US5283837A (en) * 1991-08-27 1994-02-01 Picker International, Inc. Accurate estimation of surface normals in 3-D data sets
US5181365A (en) * 1991-12-09 1993-01-26 Minnesota Mining And Manufacturing Company Method and apparatus for forming individual pouches from a continuous web and packaging a product in the individual pouches
US5228443A (en) * 1992-03-27 1993-07-20 General Electric Company Method for estimation and display of current source distribution from electric and magnetic measurements and 3D anatomical data
US5278941A (en) * 1992-06-08 1994-01-11 Ward Richard E Electric immersion heater with restricted heat-flow paths to the thermostatic control thereof
US5307607A (en) * 1992-10-13 1994-05-03 Frank Tondo Apparatus for compacting trash or the like
US5807256A (en) * 1993-03-01 1998-09-15 Kabushiki Kaisha Toshiba Medical information processing system for supporting diagnosis
US5461843A (en) * 1993-10-12 1995-10-31 Ag-Bag International Method for treatment of bagged organic materials
US5570569A (en) * 1994-04-08 1996-11-05 Masuda; Tokihisa Quadrangular package bag and method and apparatus therefor
US6026988A (en) * 1994-08-18 2000-02-22 Creamiser Products Corporation Liquid dispenser with tapping stem
US5825936A (en) * 1994-09-22 1998-10-20 University Of South Florida Image analyzing device using adaptive criteria
US5474024A (en) * 1994-10-04 1995-12-12 Thoren Caging Systems, Inc. Caging system with slide bar operator for quick disconnect water fitting
US5664493A (en) * 1994-10-14 1997-09-09 Kim; Dong Ik Waste, glass, and plastic compactor
US5712926A (en) * 1994-10-20 1998-01-27 Eberhard; Jeffrey Wayne X-ray computed tomography (CT) system for detecting thin objects
US5818964A (en) * 1994-12-27 1998-10-06 Texas Instruments Incorporated Method and apparatus for selecting an adaptive filter for image data
US5749321A (en) * 1995-05-24 1998-05-12 Santen Seiyaku Kabushiki Kaisha Animal rearing apparatus
US5791454A (en) * 1995-06-01 1998-08-11 Konrad Doppelmayr & Sohn Maschinenfabrik Gesellschaft Mbh & Co. Kg Conveyor system for transporting goods
US5791519A (en) * 1995-12-27 1998-08-11 International Sanitary Ware Manufacturing Cy, S.A. Soap bag
US5975359A (en) * 1995-12-27 1999-11-02 International Sanitary Ware Manufacturing Cy, S.A. Needle engaging soap bag
US5818973A (en) * 1996-01-11 1998-10-06 Umax Data Systems Inc. Apparatus for digital correction in an image system
US6760468B1 (en) * 1996-02-06 2004-07-06 Deus Technologies, Llc Method and system for the detection of lung nodule in radiological images using digital image processing and artificial neural network
US5823144A (en) * 1996-02-14 1998-10-20 Edstrom Industries, Inc. Cage and rack system incorporating automatic water docking system, latch mechanism, and quick-connect coupling
US5757953A (en) * 1996-02-29 1998-05-26 Eastman Kodak Company Automated method and system for region decomposition in digital radiographic images
US5877771A (en) * 1996-07-12 1999-03-02 Silicon Graphics, Inc. Method and apparatus for supersampling based on the local rate of change in texture
US6047090A (en) * 1996-07-31 2000-04-04 U.S. Philips Corporation Method and device for automatic segmentation of a digital image using a plurality of morphological opening operation
US5992131A (en) * 1996-09-17 1999-11-30 Shikoku Kakoki Co., Ltd. Filling and packaging apparatus
US6039171A (en) * 1997-04-08 2000-03-21 Konrad Doppelmayr & Sohn Maschinenfabrik Mbh & Co. Kg Conveyor system for transporting goods
US6041579A (en) * 1997-05-12 2000-03-28 Beach, Llc Bag forming machine with straw inserting mechanism
US5996535A (en) * 1997-08-29 1999-12-07 Ccr, Llc Cage for laboratory animal
US5865144A (en) * 1997-08-29 1999-02-02 Semenuk; Michael Ventilated cage for laboratory animal
US6032437A (en) * 1997-11-06 2000-03-07 Flexico-France Automatic machine for forming, filling, and sealing bags having transverse closure strips, and bags obtained thereby
US6167677B1 (en) * 1998-03-26 2001-01-02 Rovema Verpackungsmaschinen Gmbh Tubular bagging machine
US6208763B1 (en) * 1998-04-14 2001-03-27 General Electric Company Method and apparatus for enhancing discrete pixel images
US6199084B1 (en) * 1998-09-09 2001-03-06 Hitachi America, Ltd. Methods and apparatus for implementing weighted median filters
US20010000089A1 (en) * 1998-10-19 2001-04-05 Pritchard Barry L. Vertical form, fill, seal machine and methods
US6182426B1 (en) * 1998-10-19 2001-02-06 Liqui-Box Corporation Vertical form, fill, seal machine and methods
US6229331B1 (en) * 1998-12-02 2001-05-08 Tokyo Seimitsu Co., Ltd. Apparatus for and method of inspecting patterns on semiconductor integrated devices
US6269176B1 (en) * 1998-12-21 2001-07-31 Eastman Kodak Company Method for x-ray antiscatter grid detection and suppression in digital radiography
US20040103619A1 (en) * 1999-02-15 2004-06-03 Alberta Sunflower Seeds Ltd. Bag filling apparatus and method
US6751926B1 (en) * 1999-05-11 2004-06-22 Andrew Cooper Packaging filler product and machine for producing same
US6554164B1 (en) * 1999-06-28 2003-04-29 Ronald Archibald Jones Flexible packaging bag and support unit
US6339998B1 (en) * 1999-11-22 2002-01-22 Motohiro Niki, et al. Water feed device for small animal rearing apparatus
US6549646B1 (en) * 2000-02-15 2003-04-15 Deus Technologies, Llc Divide-and-conquer method and system for the detection of lung nodule in radiological images
US6418961B1 (en) * 2000-04-18 2002-07-16 Edstrom Industries, Inc. Water supply manifold
US6871473B1 (en) * 2000-08-10 2005-03-29 Pactiv Corporation Method and apparatus for making reclosable plastic bags using a pre-applied slider-operated fastener
US20020092273A1 (en) * 2000-10-02 2002-07-18 Nygaard Jensen Tim Allan Sealable diaper-disposal system and method
US20020038477A1 (en) * 2000-10-03 2002-04-04 Mowery Thomas E. Lifting and transfer apparatus
US20040040262A1 (en) * 2000-10-12 2004-03-04 Riccardo Palumbo Apparatus and method for packaging products
US20020124533A1 (en) * 2001-01-04 2002-09-12 Dietmar Schmetzer Method and apparatus for the packaging of articles
US6895726B2 (en) * 2001-01-16 2005-05-24 Poly-Clip System Corp. Poly-stretch bagger system
US6651406B2 (en) * 2001-02-13 2003-11-25 Sealed Air Corporation (Us) Apparatus and method for forming inflated containers
US20030154692A1 (en) * 2001-03-02 2003-08-21 Optima Machinery Corporation Bag packaging method and assembly for a bag filling station
US20020139089A1 (en) * 2001-03-15 2002-10-03 Quebec Inc. Apparatus for bagging material
US20020170270A1 (en) * 2001-04-03 2002-11-21 Borchard James A. Methods and apparatus for sealing a load placed on a pallet
US6612356B2 (en) * 2001-04-10 2003-09-02 Exxonmobil Oil Corporation Apparatus for improving film machinability during film sealing
US20040240754A1 (en) * 2001-06-29 2004-12-02 Smith Melvyn Lionel Overhead dimensioning system and method
US20030230052A1 (en) * 2002-06-13 2003-12-18 Rabiea Jeffrey D. Plastic bag and packaging method using same
USD472027S1 (en) * 2002-06-20 2003-03-18 Ivor Michel Walter Tote cart
US6912971B1 (en) * 2002-11-06 2005-07-05 Aquaflow Laboratory Products Limited Valve arrangement and assembly for dispensing a liquid from a container to an animal
US20040182469A1 (en) * 2003-03-18 2004-09-23 Concetti S.P.A. Apparatus for filling bags with loose material and automatic machine equipped with said apparatus
US6910444B1 (en) * 2003-03-21 2005-06-28 John Soppe Heated milk supply system for livestock
US6889739B2 (en) * 2003-04-08 2005-05-10 Automated Packaging Systems, Inc. Fluid filled unit formation machine and process
US20050132670A1 (en) * 2003-12-22 2005-06-23 Curran Shanley J. System and process for packing unit doses of liquid medication

Cited By (78)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7062078B2 (en) * 2000-11-04 2006-06-13 Koninklijke Philips Electronics, N.V. Method and device for the registration of images
US20020122576A1 (en) * 2000-11-04 2002-09-05 Juergen Weese Method and device for the registration of images
US6678399B2 (en) * 2001-11-23 2004-01-13 University Of Chicago Subtraction technique for computerized detection of small lung nodules in computer tomography images
US20030099388A1 (en) * 2001-11-23 2003-05-29 University Of Chicago Novel subtraction technique for computerized detection of small lung nodules in computer tomography images
US20030105395A1 (en) * 2001-12-05 2003-06-05 Li Fan Vessel-feeding pulmonary nodule candidate generation
US20030113005A1 (en) * 2001-12-14 2003-06-19 Amit Saxena Image processing system
US20030144598A1 (en) * 2002-01-29 2003-07-31 Li Zhang Bronchial wall thickening recognition for reduced false-positives in pulmonary nodule detection
US7203349B2 (en) * 2002-01-29 2007-04-10 Siemens Corporate Research, Inc. Bronchial wall thickening recognition for reduced false-positives in pulmonary nodule detection
US8050481B2 (en) * 2002-10-18 2011-11-01 Cornell Research Foundation, Inc. Method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans
US7751607B2 (en) * 2002-10-18 2010-07-06 Cornell Research Foundation, Inc. System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans
US20040184647A1 (en) * 2002-10-18 2004-09-23 Reeves Anthony P. System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans
US20100272341A1 (en) * 2002-10-18 2010-10-28 Cornell Research Foundation, Inc. Method and Apparatus for Small Pulmonary Nodule Computer Aided Diagnosis from Computed Tomography Scans
US7499578B2 (en) * 2002-10-18 2009-03-03 Cornell Research Foundation, Inc. System, method and apparatus for small pulmonary nodule computer aided diagnosis from computed tomography scans
US20090080748A1 (en) * 2002-10-18 2009-03-26 Cornell Research Foundation, Inc. System, Method and Apparatus for Small Pulmonary Nodule Computer Aided Diagnosis from Computed Tomography Scans
US6891922B2 (en) * 2002-11-22 2005-05-10 Ge Medical Systems Global Technology Company, Llc Methods and apparatus for the classification of nodules
US20040105527A1 (en) * 2002-11-22 2004-06-03 Matthieu Ferrant Methods and apparatus for the classification of nodules
US20070140541A1 (en) * 2002-12-04 2007-06-21 Bae Kyongtae T Method and apparatus for automated detection of target structures from medical images using a 3d morphological matching algorithm
US7949169B2 (en) * 2002-12-04 2011-05-24 Bae Kyongtae T Method and apparatus for automated detection of target structures from medical images using a 3D morphological matching algorithm
US20040126000A1 (en) * 2002-12-24 2004-07-01 Konica Minolta Holdings, Inc. Image processing apparatus, method, program, and recording medium
US7787669B2 (en) * 2003-01-30 2010-08-31 Koninklijke Philips Electronics N.V. Reconstruction of local patient doses in computed tomography
US20060098856A1 (en) * 2003-01-30 2006-05-11 Koninklijke Philips Electronics N.V. Reconstruction of local patient doses in computed tomography
US20040202990A1 (en) * 2003-03-12 2004-10-14 Bernhard Geiger System and method for performing a virtual endoscopy
US7304644B2 (en) * 2003-03-12 2007-12-04 Siemens Medical Solutions Usa, Inc. System and method for performing a virtual endoscopy
US20050002548A1 (en) * 2003-06-20 2005-01-06 Novak Carol L. Automatic detection of growing nodules
US20050018890A1 (en) * 2003-07-24 2005-01-27 Mcdonald John Alan Segmentation of left ventriculograms using boosted decision trees
US20050135707A1 (en) * 2003-12-18 2005-06-23 Turek Matthew W. Method and apparatus for registration of lung image data
US20050171409A1 (en) * 2004-01-30 2005-08-04 University Of Chicago Automated method and system for the detection of lung nodules in low-dose CT image for lung-cancer screening
US7305111B2 (en) * 2004-01-30 2007-12-04 University Of Chicago Automated method and system for the detection of lung nodules in low-dose CT images for lung-cancer screening
US20070280643A1 (en) * 2004-03-26 2007-12-06 Seo Kang S Recording medium, method, and apparatus for reproducing text subtitle streams
US20050240882A1 (en) * 2004-04-21 2005-10-27 Ge Medical Systems Information Technologies, Inc. Method and system for displaying regions of pathological interest
US7876939B2 (en) 2004-04-26 2011-01-25 David Yankelevitz Medical imaging system for accurate measurement evaluation of changes in a target lesion
US20110116606A1 (en) * 2004-04-26 2011-05-19 Yankelevitz David F Medical imaging system for accurate measurement evaluation of changes
US20070100226A1 (en) * 2004-04-26 2007-05-03 Yankelevitz David F Medical imaging system for accurate measurement evaluation of changes in a target lesion
US9033576B2 (en) 2004-04-26 2015-05-19 David Yankelevitz Medical imaging system for accurate measurement evaluation of changes
US20050285947A1 (en) * 2004-06-21 2005-12-29 Grindstaff Gene A Real-time stabilization
AU2005262899B2 (en) * 2004-06-21 2010-12-02 Intergraph Software Technologies Company Real-time stabilization
WO2006019547A1 (en) * 2004-07-20 2006-02-23 Siemens Medical Solutions Usa, Inc. System and method for object characterization of toboggan-based clusters
AU2005275463B2 (en) * 2004-07-20 2009-02-19 Siemens Medical Solutions Usa, Inc. System and method for object characterization of toboggan-based clusters
US20060018549A1 (en) * 2004-07-20 2006-01-26 Jianming Liang System and method for object characterization of toboggan-based clusters
US20070053562A1 (en) * 2005-02-14 2007-03-08 University Of Iowa Research Foundation Methods of smoothing segmented regions and related devices
US8073210B2 (en) 2005-02-14 2011-12-06 University Of Lowa Research Foundation Methods of smoothing segmented regions and related devices
US7653264B2 (en) 2005-03-04 2010-01-26 The Regents Of The University Of Michigan Method of determining alignment of images in high dimensional feature space
US20060257027A1 (en) * 2005-03-04 2006-11-16 Alfred Hero Method of determining alignment of images in high dimensional feature space
US7596401B2 (en) 2005-03-16 2009-09-29 Cornell Research Foundation, Inc. Method for expanding the domain of imaging software in a diagnostic work-up
US20060239544A1 (en) * 2005-03-16 2006-10-26 Yankelevitz David F Method for expanding the domain of imaging software in a diagnostic work-up
US7995809B2 (en) * 2005-04-18 2011-08-09 Siemens Medical Solutions Usa, Inc. Refined segmentation of nodules for computer assisted diagnosis
US20060269109A1 (en) * 2005-04-18 2006-11-30 Kazunori Okada Refined segmentation of nodules for computer assisted diagnosis
US20070008317A1 (en) * 2005-05-25 2007-01-11 Sectra Ab Automated medical image visualization using volume rendering with local histograms
US7532214B2 (en) * 2005-05-25 2009-05-12 Spectra Ab Automated medical image visualization using volume rendering with local histograms
US7738683B2 (en) 2005-07-22 2010-06-15 Carestream Health, Inc. Abnormality detection in medical images
US20070019852A1 (en) * 2005-07-22 2007-01-25 Schildkraut Jay S Pulminary nodule detection in a chest radiograph
WO2007018889A1 (en) * 2005-07-22 2007-02-15 Carestream Health, Inc. Pulminary nodule detection in a chest radiograph
US20070036402A1 (en) * 2005-07-22 2007-02-15 Cahill Nathan D Abnormality detection in medical images
US7623692B2 (en) 2005-07-22 2009-11-24 Carestream Health, Inc. Pulmonary nodule detection in a chest radiograph
US20070165917A1 (en) * 2005-11-26 2007-07-19 Zhujiang Cao Fully automatic vessel tree segmentation
US7873196B2 (en) 2006-03-22 2011-01-18 Cornell Research Foundation, Inc. Medical imaging visibility index system and method for cancer lesions
US20070223807A1 (en) * 2006-03-22 2007-09-27 Cornell Research Foundation, Inc. Medical imaging visibility index system and method for cancer lesions
US20080002872A1 (en) * 2006-06-30 2008-01-03 Gatesoupe Pascal Methods and apparatuses for correcting a mammogram with an implant, and for segmenting an implant
US8160346B2 (en) * 2006-06-30 2012-04-17 General Electric Company Methods and apparatuses for correcting a mammogram with an implant, and for segmenting an implant
DE102006043910A1 (en) * 2006-09-19 2008-03-27 Siemens Ag Result filter and method for the selection of the result data of an application for automatic pattern recognition
US8116574B2 (en) 2006-09-19 2012-02-14 Siemens Aktiengesellschaft Result filter and method for selecting the result data of an application for automatic pattern recognition
DE102006043910B4 (en) * 2006-09-19 2010-02-25 Siemens Ag Result filter and method for the selection of the result data of an application for automatic pattern recognition
US20100142775A1 (en) * 2007-03-19 2010-06-10 Balaji Ganeshan Method, apparatus and computer program for analysing medical image data
US20080267499A1 (en) * 2007-04-30 2008-10-30 General Electric Company Method and system for automatic detection of objects in an image
US20080273651A1 (en) * 2007-05-05 2008-11-06 Franz Edward Boas Methods and apparatus for reducing artifacts in computed tomography images
US20090048505A1 (en) * 2007-08-14 2009-02-19 Siemens Aktiengesellschaft Upper body MRI scanner and associated control method
DE102007038382A1 (en) 2007-08-14 2009-02-26 Siemens Ag Upper-body magnetic resonance apparatus and control method to
US8160674B2 (en) 2007-08-14 2012-04-17 Siemens Aktiengesellschaft Upper body MRI scanner and associated control method
US20100284598A1 (en) * 2008-01-18 2010-11-11 Koninklijke Philips Electronics N.V. Image registration alignment metric
US20100165206A1 (en) * 2008-12-30 2010-07-01 Intel Corporation Method and apparatus for noise reduction in video
US8903191B2 (en) * 2008-12-30 2014-12-02 Intel Corporation Method and apparatus for noise reduction in video
US8189943B2 (en) * 2009-03-17 2012-05-29 Mitsubishi Electric Research Laboratories, Inc. Method for up-sampling depth images
US20100239187A1 (en) * 2009-03-17 2010-09-23 Sehoon Yea Method for Up-Sampling Depth Images
TWI396111B (en) * 2009-12-30 2013-05-11 Pou Yuen Technology Co Ltd
US20130051644A1 (en) * 2011-08-29 2013-02-28 General Electric Company Method and apparatus for performing motion artifact reduction
US20150287186A1 (en) * 2012-11-06 2015-10-08 Timpel S.A. Method and device for simplifying information obtained from electrical impedance tomography
US9639928B2 (en) * 2012-11-06 2017-05-02 Timpel S.A. Method and device for simplifying information obtained from electrical impedance tomography
ES2530424A1 (en) * 2013-09-02 2015-03-02 Quibim S L Segmentation method for variable adaptive threshold for obtaining reference values ​​cut cut air imaging studies CT

Also Published As

Publication number Publication date
US20080187204A1 (en) 2008-08-07
US7660451B2 (en) 2010-02-09
AU2002341671A1 (en) 2003-04-01
WO2003024184A2 (en) 2003-03-27
WO2003024184A3 (en) 2003-06-05

Similar Documents

Publication Publication Date Title
Bae et al. Automatic segmentation of liver structure in CT images
Zhang et al. Atlas-driven lung lobe segmentation in volumetric X-ray CT images
US8331637B2 (en) System and method of automatic prioritization and analysis of medical images
US5568384A (en) Biomedical imaging and analysis
US6246784B1 (en) Method for segmenting medical images and detecting surface anomalies in anatomical structures
Kostis et al. Three-dimensional segmentation and growth-rate estimation of small pulmonary nodules in helical CT images
EP1504403B1 (en) Tomographic reconstruction of small objects using &#34;a priori&#34; knowledge
US7995810B2 (en) System and methods for image segmentation in n-dimensional space
US5669382A (en) System for measuring myocardium in cardiac images
US7676257B2 (en) Method and apparatus for segmenting structure in CT angiography
EP1365356B1 (en) Semi-automatic segmentation algorithm for pet oncology images
US7187800B2 (en) Method and apparatus for image segmentation using Jensen-Shannon divergence and Jensen-Renyi divergence
Mattes et al. PET-CT image registration in the chest using free-form deformations
Kuhnigk et al. Lung lobe segmentation by anatomy-guided 3D watershed transform
ES2425241T3 (en) Segmentation methods and systems using Reconfiguration limits
US6842638B1 (en) Angiography method and apparatus
Zhao et al. Automatic detection of small lung nodules on CT utilizing a local density maximum algorithm
US7106891B2 (en) System and method for determining convergence of image set registration
Kennedy et al. Super-resolution in PET imaging
US7660481B2 (en) Image enhancement using anisotropic noise filtering
US7489825B2 (en) Method and apparatus for creating a multi-resolution framework for improving medical imaging workflow
US7545979B2 (en) Method and system for automatically segmenting organs from three dimensional computed tomography images
Liu et al. Robust midsagittal plane extraction from normal and pathological 3-D neuroradiology images
Park et al. Construction of an abdominal probabilistic atlas and its application in segmentation
US7397934B2 (en) Registration of thoracic and abdominal imaging modalities

Legal Events

Date Code Title Description
AS Assignment

Owner name: CORNELL RESEARCH FOUNDATION, INC., NEW YORK

Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:REEVES, ANTHONY P.;YANKELEVITZ, DAVID;HENSCHKE, CLAUDIA;AND OTHERS;REEL/FRAME:013655/0987;SIGNING DATES FROM 20021122 TO 20021211

AS Assignment

Owner name: CORNELL RESEARCH FOUNDATION, INC., NEW YORK

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE INCORRECT SERIAL NUMBER FROM 10/257067 TO 10245782. DOCUMENT PREVIOUSLY RECORDED AT REEL 013655 FRAME 0987;ASSIGNORS:REEVES, ANTHONY P.;YANKELEVITZ, DAVID;HENSCHKE, CLAUDIA;AND OTHERS;REEL/FRAME:014155/0431;SIGNING DATES FROM 20021122 TO 20021211

STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION

AS Assignment

Owner name: CORNELL RESEARCH FOUNDATION, INC., NEW YORK

Free format text: CORRECTIVE ASSIGNMENT TO CORRECT THE ADDRESS OF THE ASSIGNEE PREVIOUSLY RECORDED ON REEL 014155 FRAME 0431;ASSIGNORS:REEVES, ANTHONY P.;YANKELEVITZ, DAVID;HENSCHKE, CLAUDIA;AND OTHERS;REEL/FRAME:023692/0329;SIGNING DATES FROM 20021122 TO 20021211