WO2017011532A1 - Traitement des anomalies candidates dans une imagerie médicale sur la base d'une classification hiérarchique - Google Patents

Traitement des anomalies candidates dans une imagerie médicale sur la base d'une classification hiérarchique Download PDF

Info

Publication number
WO2017011532A1
WO2017011532A1 PCT/US2016/042055 US2016042055W WO2017011532A1 WO 2017011532 A1 WO2017011532 A1 WO 2017011532A1 US 2016042055 W US2016042055 W US 2016042055W WO 2017011532 A1 WO2017011532 A1 WO 2017011532A1
Authority
WO
WIPO (PCT)
Prior art keywords
candidate
abnormality
nodules
node
context
Prior art date
Application number
PCT/US2016/042055
Other languages
English (en)
Inventor
Lin Lu
Binsheng Zhao
Lawrence H. Schwartz
Original Assignee
The Trustees Of Columbia University In The City Of New York
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by The Trustees Of Columbia University In The City Of New York filed Critical The Trustees Of Columbia University In The City Of New York
Publication of WO2017011532A1 publication Critical patent/WO2017011532A1/fr

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0012—Biomedical image inspection
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/52—Devices using data or image processing specially adapted for radiation diagnosis
    • A61B6/5211—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data
    • A61B6/5217—Devices using data or image processing specially adapted for radiation diagnosis involving processing of medical diagnostic data extracting a diagnostic or physiological parameter from medical diagnostic data
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/243—Classification techniques relating to the number of classes
    • G06F18/2431—Multiple classes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • G06F18/20—Analysing
    • G06F18/24—Classification techniques
    • G06F18/243—Classification techniques relating to the number of classes
    • G06F18/2433—Single-class perspective, e.g. one-against-all classification; Novelty detection; Outlier detection
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/42—Global feature extraction by analysis of the whole pattern, e.g. using frequency domain transformations or autocorrelation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16B—BIOINFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR GENETIC OR PROTEIN-RELATED DATA PROCESSING IN COMPUTATIONAL MOLECULAR BIOLOGY
    • G16B40/00—ICT specially adapted for biostatistics; ICT specially adapted for bioinformatics-related machine learning or data mining, e.g. knowledge discovery or pattern finding
    • G16B40/20—Supervised data analysis
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H10/00—ICT specially adapted for the handling or processing of patient-related medical or healthcare data
    • G16H10/40—ICT specially adapted for the handling or processing of patient-related medical or healthcare data for data related to laboratory analysis, e.g. patient specimen analysis
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H20/00—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance
    • G16H20/40—ICT specially adapted for therapies or health-improving plans, e.g. for handling prescriptions, for steering therapy or for monitoring patient compliance relating to mechanical, radiation or invasive therapies, e.g. surgery, laser therapy, dialysis or acupuncture
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00—ICT specially adapted for the handling or processing of medical images
    • G16H30/20—ICT specially adapted for the handling or processing of medical images for handling medical images, e.g. DICOM, HL7 or PACS
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H40/00—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices
    • G16H40/60—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices
    • G16H40/63—ICT specially adapted for the management or administration of healthcare resources or facilities; ICT specially adapted for the management or operation of medical equipment or devices for the operation of medical equipment or devices for local operation
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H50/00—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics
    • G16H50/20—ICT specially adapted for medical diagnosis, medical simulation or medical data mining; ICT specially adapted for detecting, monitoring or modelling epidemics or pandemics for computer-aided diagnosis, e.g. based on medical expert systems
    • G—PHYSICS
    • G16—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16H—HEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H70/00—ICT specially adapted for the handling or processing of medical references
    • G16H70/60—ICT specially adapted for the handling or processing of medical references relating to pathologies
    • A—HUMAN NECESSITIES
    • A61—MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61B—DIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B6/00—Apparatus or devices for radiation diagnosis; Apparatus or devices for radiation diagnosis combined with radiation therapy equipment
    • A61B6/02—Arrangements for diagnosis sequentially in different planes; Stereoscopic radiation diagnosis
    • A61B6/03—Computed tomography [CT]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/10—Image acquisition modality
    • G06T2207/10072—Tomographic images
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30004—Biomedical image processing
    • G06T2207/30096—Tumor; Lesion
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/03—Recognition of patterns in medical or anatomical images
    • G06V2201/032—Recognition of patterns in medical or anatomical images of protuberances, polyps nodules, etc.

Definitions

  • a visible nodule is a structure in an organ that has different intensity values to those of the organ in medical imagery such as magnetic resonance imagery (MRI) and computed tomography (CT) x-ray imagery.
  • MRI magnetic resonance imagery
  • CT computed tomography
  • Performing nodule detection by human analysts suffers because the human can become tired and lose focus when screening a large number of images.
  • the accuracy of manual nodule detection depends on radiologists' reading skills, which varies among individual radiologists. Automated computer-aided detection methods, once trained by expert radiologists, can manually provide fast and objective nodule detection results.
  • Techniques including a method, a system and a computer-readable medium, are provided for automated detection and processing of tissue abnormalities, such as nodules, in medical imagery.
  • the techniques include determining voxels involved with each of a plurality of candidate nodules in a medical image.
  • the techniques also include determining whether a candidate nodule belongs in one of multiple nodule classes based at least on anatomical location context, size, and shape by successively subjecting the candidate nodule to hierarchical tests for anatomical context, size range based on anatomical context, and shape parameter value range based on anatomical context and size range.
  • the techniques include rejecting a candidate nodule that does not fall into any one of the nodule classes.
  • the techniques also include presenting a property of the candidate nodule on a display device based on the nodule class to which the candidate nodule belongs.
  • FIG. 1A is a block diagram that illustrates an imaging system for tissue detection, according to an embodiment
  • FIG. IB is a block diagram that illustrates scan elements in a 2D scan, such as one scanned image from a CT scanner;
  • FIG. 1C is a block diagram that illustrates scan elements in a 3D scan, such as stacked multiple scanned images from a CT imager or true 3D scan elements from volumetric CT imagers or ultrasound;
  • FIG. 2 is a flow chart that illustrates an example method to classify candidate nodules based on a hierarchical series of tests for anatomical location context, size and shape, according to an embodiment
  • FIG. 3 is a block diagram that illustrates a computer system upon which an embodiment of the invention may be implemented
  • FIG. 4 illustrates a chip set upon which an embodiment of the invention may be implemented
  • FIG. 5 is a plot that illustrates an example distribution of lung nodule sizes in a data set used to demonstrate the method of FIG. 2, according to an embodiment
  • FIG. 6A through FIG. 6C are flow charts that illustrate an example of the method of
  • FIG. 2 implemented for lung nodules, according to an embodiment
  • FIG. 7A through FIG. 7F are images that illustrate six example types of nodules processed by a peripheral-nodule detector, according to an embodiment
  • FIG. 8A through FIG. 8C are images that illustrate three example types of nodules processed by a chestwall-nodule detector, according to an embodiment
  • FIG. 9A through FIG. 9D are images that illustrate four example types of nodules processed by a mediastinum-nodule detector; according to an embodiment
  • FIG. 10A through FIG. 10E are images that illustrate example results from various processing steps, according to an embodiment
  • FIG. 11 is an image that illustrates an example scaled geodesic distance map resulting from one step of a classification process, according to an embodiment
  • FIG. 12 is a table that illustrates example node features, according to an embodiment
  • FIG. 13A and FIG. 13B are free-response receiver operating characteristic (FROC) curves that illustrate example performance of the method on a training set and testing set, respectively, according to an embodiment
  • FIG. 14A and FIG. 14B are FROC curves that illustrate example performance of the method on a training set and testing set, respectively, using different diameter thresholds, according to various embodiments.
  • FIG. 151 A and FIG. 15B are FROC curves that illustrate example performance of the method on a training set and testing set, respectively, using different sphericity thresholds, according to various embodiments.
  • a method and apparatus are described for automatic detection and processing of tissue abnormalities, such as nodules, in medical imagery.
  • tissue abnormalities such as nodules
  • numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be apparent, however, to one skilled in the art that the present invention may be practiced without these specific details. In other instances, well-known structures and devices are shown in block diagram form in order to avoid unnecessarily obscuring the present invention.
  • the method is used to detect nodules, or other tissue abnormalities, in other organs and tissues, such as in the brain, liver, intestines, muscles or connective tissue.
  • FIG. 1A is a block diagram that illustrates an imaging system 100 for tissue detection, according to an embodiment.
  • the system 100 is designed for determining the spatial arrangement of soft target tissue in a living body.
  • a living body is depicted, but is not part of the system 100.
  • a living body is depicted in a first spatial arrangement 132a at one time and includes a target tissue in a corresponding spatial arrangement 134a.
  • the same living body is in a second spatial arrangement 132b that includes the same or changed target tissue in a different corresponding spatial arrangement 134b.
  • system 100 includes a scanning device 140, such as a full dose X-ray computed tomography (CT) scanner, or a magnetic resonance imaging (MRI) scanner, among others, such as magnetic resonance spectral imaging (MRSI) scanner and ultrasound scanner,.
  • CT computed tomography
  • MRI magnetic resonance imaging
  • MRSI magnetic resonance spectral imaging
  • the scanning device 140 is used at one or more different times.
  • the device 140 is configured to produce scanned images that each represents a cross section of the living body at one of multiple cross sectional (transverse) slices arranged along the axial direction of the body, which is oriented in the long dimension of the body.
  • data from the imager 140 is received at a computer 160 and stored on storage device 162.
  • Scan data 180a, 180b, 190a, 190b based on data measured at imager 140 at one or more different times or axial locations or both are stored on storage device 162.
  • scan data 180a and scan data 180b, which include scanned images at two slices separated in the axial direction is stored based on measurements from scanning device 140 at one time.
  • Scan data 190a, 190b, which include scanned images at two slices separated in the axial direction is stored based on measurements from scanning device 140 at a different time.
  • a tissue and abnormality detection process 150 operates on computer 160 to determine a boundary between scan elements of scan data which are inside and outside a particular target tissue or tissue abnormality.
  • the boundary data is stored in boundary data 158 in associations with the scan data, e.g., scan data 180a, 180b, 190a, 190b.
  • FIG. 1A Although processes, equipment, and data structures are depicted in FIG. 1A as integral blocks in a particular arrangement for purposes of illustration, in other embodiments one or more processes or data structures, or portions thereof, are arranged in a different manner, on the same or different hosts, in one or more databases, or are omitted, or one or more different processes or data structures are included on the same or different hosts.
  • system 100 is depicted with a particular number of scanning devices 140, computers 160, and scan data 150, 160 on storage device 162 for purposes of illustration, in other embodiments more or fewer scanning devices, computers, storage devices and scan data constitute an imaging system for determining spatial arrangement of tissues, including cells.
  • FIG. IB is a block diagram that illustrates scan elements in a 2D scan 110, such as one scanned image from a CT scanner.
  • the two dimensions of the scan 110 are represented by the x direction arrow 102 and the y direction arrow 104.
  • the scan 110 consists of a two dimensional array of 2D scan elements 112 (also called picture elements, pixels, in case the data are displayed as an image on a display device) each with an associated position.
  • a 2D scan element position is given by a row number in the x direction and a column number in the y direction of a rectangular array of scan elements.
  • a value at each scan element position represents a measured or computed intensity or amplitude that represents a physical property (e.g., X-ray absorption, or resonance frequency of an MRI scanner) at a corresponding position in at least a portion of the spatial arrangement 132a, 132b of the living body.
  • the measured property is called amplitude hereinafter and is treated as a scalar quantity.
  • two or more properties are measured together at a pixel location and multiple amplitudes are obtained that can be collected into a vector quantity, such as spectral amplitudes in MRSI.
  • FIG. 1C is a block diagram that illustrates scan elements in a 3D scan 120, such as stacked multiple scanned images from a CT imager or true 3D scan elements from volumetric CT imagers or MRI or ultrasound (US) imagers.
  • the three dimensions of the scan are represented by the x direction arrow 102, the y direction arrow 104, and the z direction arrow 106.
  • the scan 120 consists of a three dimensional array of 3D scan elements (also called volume elements and abbreviated as voxels) 122 each with an associated position.
  • a 3D scan element position is given by a row number in the x direction, column number in the y direction and a scanned image number (also called a scan number) in the z (axial) direction of a cubic array of scan elements or a temporal sequence of scanned slices.
  • a value at each scan element position represents a measured or computed intensity that represents a physical property (e.g., X-ray absorption for a CT scanner, or resonance frequency of an MRI scanner) at a corresponding position in at least a portion of the spatial arrangement 132a, 132b of the living body.
  • a 3D scan repeated in time, as the fourth dimension, provides a 4D scan of a single subject.
  • voxels is used herein to represent either 2D scan elements (pixels) or 3D scan elements (voxels), or 4D scan elements, or some combination, depending on the context.
  • Amplitude is often expressed as one of a series of discrete gray-levels, given in Hounsfield units (HU) for x-ray CT scans.
  • FIG. 2 is a flow chart that illustrates an example method 200 to classify candidate nodules based on a hierarchical series of tests for anatomical location context, size and shape, according to an embodiment.
  • steps are depicted in FIG. 2, as integral steps in a particular order for purposes of illustration, in other embodiments, one or more steps, or portions thereof, are performed in a different order, or overlapping in time, in series or in parallel, or are omitted, or one or more additional steps are added, or the method is changed in some combination of ways.
  • an embodiment of the method 200 is applied to classifying lung nodules in CT scans.
  • a means for performing any or all of these steps includes the scanning device 140 depicted in FIG. 1A or the computer systems or chip set as described below with reference to FIG. 3 and FIG. 4, respectively, alone or in some combination.
  • step 201 data is obtained that indicates a set of images.
  • the set represents a corresponding succession of cross sections of a subject, such as an animal or human patient, e.g., from one or more MRI or CT scans. Any method may be used to obtain the set of images, including collecting the images from a MRI or CT scanner, retrieving the images from data storage either locally or remotely, either in response to a query or unsolicited, from various files or a database.
  • step 203 each image is tested against one or more criteria for using the images. These criteria ensure that at least some images of the set are suitable for the analyses to follow. If not, control passes back to step 201 to obtain another set, or (not shown) the process ends. For nodule identification and classification it is useful to have three dimensional data with at least two voxels in each dimension for capturing nodules of about 3
  • step 203 it is determined if the data set supports this kind of resolution.
  • the criteria for the lung nodules are described in more detail in the later section.
  • a fraction of the data set is separated into a training set and another fraction is separated into a testing set.
  • nodule or other abnormality identification by an expert is used to indicate which abnormalities are to be identified and which are to be rejected.
  • step 205 candidate abnormalities are determined, using any method known in the art to identify voxels in one or more images that are candidates for being classified as an abnormality, such as a nodule.
  • images of the set for one subject are interpolated to isotropic volumetric data.
  • a target organ volume is determined that includes several adjacent interpolated images from the same subject.
  • multi-scale enhancement filters of dot and line are applied to the volumetric data.
  • the output of dot and line enhancement filters are normalized and combined into voxel clusters with properties indicted by the parameters Zc_dot and Zc_line.
  • Candidate abnormalities are determined according to half-peak volumes of the voxel clusters.
  • Half -peak volume is defined as the number of voxels that have Zc_dot values larger than half of the local maximal Zc_dot peak value.
  • Voxels with Zc_dot values smaller than ThrZc_dot are regarded as noise and set as 0; otherwise they are set as 1.
  • the cluster volumes are labeled using a region-growing algorithm. Within each labeled volume, voxels with Zc_dot values smaller than half of the local peak Zc_dot value are removed and the remaining voxels are selected to create the candidate abnormality.
  • the candidate abnormalities are stored with their characteristic (e.g., voxel coordinates, subject identifier, and cluster parameters) in data storage on one or more computer systems or chip sets, as described in more detail later with reference to FIG. 3 and FIG. 4.
  • characteristic e.g., voxel coordinates, subject identifier, and cluster parameters
  • each candidate nodule to test the candidate nodule in a hierarchical set of operations, called nodes of a classification tree.
  • a node-specific set of conditions are evaluated and tested against node-specific thresholds.
  • a candidate abnormality that satisfies the node-specific thresholds of the node- specific conditions is classified as an abnormality of that node; and, node-specific features are extracted from the accepted abnormality.
  • a candidate abnormality that does not satisfy the node-specific threshold is passed on to the next node in the hierarchy.
  • a candidate abnormality that fails all the tests is rejected as not a true abnormality, e.g., not an abnormality of the type being sought, such as a nodule of a particular tissue.
  • step 207 the next candidate abnormality is selected for classification, e.g., retrieved from storage on a computer system or chip set.
  • step 211 at the first level of the hierarchy of tests, an anatomical location context is determined for the abnormality. For example, it is determined whether a nodule is away from the boundaries of the organ, or, if at a boundary, whether the candidate nodule is associated with or affected by a tissue type or organ that shares the boundary with the candidate nodule.
  • the result of step 211 is an anatomical location context for the current candidate abnormality. For purposes of illustration it is assumed that the anatomical location contexts considered for the current organ are designated context A, context B, among others.
  • step 213 is determined whether the candidate abnormality is considered small in the current context.
  • the methods to determine the size of a candidate abnormality differ and the thresholds to determine the difference between "small” and not small (called “large” here) can also differ.
  • the way to determine the size of a candidate nodule that is separate from a boundary might include the boundary and give a wrong result if the same method is used in a different context at the boundary.
  • more than two size thresholds are used to distinguish small from mid-sized and mid-sized from large candidate abnormalities. The separation of candidate abnormality processing by size is based on the observation that shape determinations are more difficult with the smaller candidate abnormalities and subtle changes in shape may not be as detectable as with larger candidate abnormalities.
  • the size test performed at step 213 depends on the context, in terms of either the processing of the candidate abnormality to determine a size or in terms of the one or more thresholds that are first order parameters of the method 200, or both.
  • the values for the first thresholds are based on optimizing the performance of the method 200 using the training set and the testing set.
  • step 213 If the candidate abnormality is small according to step 213, then control passes to step 215. Otherwise control passes to step 217. Both steps test for the shape of the nodule.
  • the methods to determine the shape of a candidate abnormality differ and the thresholds to determine the difference between "ball like” and not ball-like (called “irregular” here) can also differ.
  • a ball-like abnormality is spherical and unattached to other tissues, whereas an irregular abnormality is not spherical or is attached to other tissues, especially vessels, or both.
  • the shape tests performed at steps 215 and 217 depend on the context and size, in terms of either the processing of the candidate abnormality to determine a shape (e.g., sphericity or blobness or both, as described in a later section for candidate lung nodules) or in terms of the one or more shape thresholds that are first order parameters of the method 200, or both.
  • the values for the thresholds are based on optimizing the performance of the method 200 using the training set and the testing set.
  • the size test is shown as the second level of the hierarchy, and the shape test as the third level of the hierarchy in FIG.
  • the order of the properties used in the hierarchy in one location context e.g., location context A
  • a different location context e.g., location context B.
  • leaf nodes Based on the results of the size and shape tests, or other tests, particular processes and thresholds are applied in the last level of the hierarchy, called leaf nodes, represented by steps 221, 241, 261, 281.
  • some leaf nodes are compound nodes made up of several sub-nodes based on other properties than size and shape or other properties used as intermediate levels of the hierarchy, such as type of connection to adjacent tissue, as explained in the example embodiment for periphery node 5 and periphery node 6.
  • Each node in the detection tree including, in some embodiments, nodes corresponding to steps 213, 215 and 217, corresponds to one type of abnormality.
  • each node contains three procedures for testing the current candidate abnormality. The procedures are as follows: 1) compute condition values, 2) compare condition values to thresholds and determine whether the candidate abnormality could be classified by the node, and 3) extract abnormality features (and train classifier).
  • candidate abnormalities determined as "Yes” are regarded as true abnormalities of the class corresponding to the node, as indicated in steps 227, 247, 267 and 277 in FIG. 2.
  • steps 227, 247, 267 and 273 each includes storing or presenting on a display device the classified abnormality and zero or more of its nodule features.
  • step 291 includes storing or presenting on a display device the rejected abnormality and zero or more of its features.
  • both branches of size test node 213 and shape test nodes 215 and 217 are not followed. Instead, one branch of each is followed leading to only one leaf node. If a candidate nodule fails to be classified by the first leaf node, then control passes to the next leaf node, until all leaf nodes have been applied as determined in steps 225, 245, 265 and 285. If all leaf nodes for the anatomical location context have been applied and the candidate abnormality is found to belong to none of those classes, then control passes to step 291 where the candidate is rejected as not an abnormality of interest.
  • control then passes to step 293 to determine whether there is another candidate abnormality to classify. If so, then control passes back to step 207 to repeat the process for the next candidate abnormality. If not, the process ends.
  • a more detailed example embodiment for use with candidate nodules in the lung as the tissue abnormality is described here.
  • the diversity of lung nodules poses difficulty for the current computer-aided diagnostic (CAD) schemes for lung nodule detection on computed tomography (CT) scan images, especially in large-scale CT screening studies.
  • CAD computer-aided diagnostic
  • CT computed tomography
  • the hybrid method described here integrates several existing and widely-used algorithms in the field of nodule detection, in a new way, including morphological operation, dot-enhancement based on Hessian matrix, adaptive thresholding, fuzzy connectedness segmentation, local density maximum algorithm, geodesic distance map and regression tree classification, as described in various references listed herein. Therefore these well known algorithms are not described in detail herein.
  • all of the adopted algorithms were organized into a novel tree structure with multiple nodes. Each node in the tree structure tailored to deal with one type of lung nodule.
  • Intensity based schemes use the intensity difference of voxels between lung nodules and surrounding background (tissues) for nodule detection.
  • Zhao et al. [15] developed a local density maximum algorithm to detect nodules with local high-density structures.
  • Li et al. [7] employed enhancement procedure into nodule detection by applying a group of selective dot- enhancement filters to the original CT images. The dot-enhancement filters could suppress other normal anatomic structures that may be easily mistaken for nodules, such as small blood vessels and airway walls.
  • Messay et al. [9] combined intensity thresholding with morphological processing to generate candidate nodules for detection.
  • Shape based schemes developed statistical models to characterize lung nodules and search for matching objects in the image space.
  • Okada et al. [11] presented a method to fit nodules by ellipsoid based on anisotropic Gaussian filters.
  • Casio et al. [4] developed a series of stable 3D mass-spring models for nodule matching.
  • Pai et al.[12] proposed to identify initial candidate nodules based on surface normal overlap.
  • Matsumoto et al. [8] developed novel quantized convergence index filters aiming to match round lesions.
  • [14] presented a method that could provide good description to objects of specific shapes with high spherical elements by employing volumetric shape index map and the dot-enhancement map.
  • Machine learning schemes characterize candidate nodules as a group of extracted features and use pre-trained classifiers for the discrimination.
  • Golosio et al. [5] proposed a multi-threshold method to construct a classification system for candidate nodules of different intensity levels with the help of artificial neural networks.
  • Murphy et al. [10] employed shape index and curvedness as nodule features and reduced false positives via two successive k- nearest-neighbor classifiers.
  • Tan et al. [13] proposed to conduct nodule determination in a newly-defined gauge coordinates system with feature- selective classifiers based on genetic algorithms and artificial neural networks.
  • Li et al. [6] proposed to utilize both the global three-dimensional (3D) information and local two-dimensional (2D) information of CT scan images to train nodule detectors.
  • nodule detection usually stems from five problematic situations recognized by herein.
  • CT scans in the dataset might be generated by various protocols (e.g., different tube exposure time products, different convolution kernels, and different slice thicknesses) and thus with various noise patterns.
  • nodules might attach to surrounding structures of similar density (e.g., small blood vessels, airway walls and pulmonary scars), leading to the failure of purely intensity-based schemes.
  • high-contrast structures e.g., pulmonary vasculature and chest wall
  • models-based schemes might impede the reliability of models-based schemes.
  • intensity can vary significantly even in an individual nodule, especially if the nodule contains ground glass opacity (GGO).
  • GGO ground glass opacity
  • the shape and size of nodules can vary significantly. Machine-learning based schemes have to use a lot of features to characterize heterogeneous candidate nodules, leading to overfitting and low efficiency.
  • the method was demonstrates on a data set of actual scans including 294 CT scans from the Lung Image Database Consortium (LIDC) dataset.
  • the CT scans were randomly divided into two independent subsets: a training set (196 scans) and a testing set (98 scans).
  • the 294 CT scans contained 631 lung nodules, which were annotated by at least two radiologists participating in the LIDC project.
  • the sensitivity and false positive per scan using the method trained on the training set were 87% and 2.61, respectively, for the training set and 85.2% and 3.13, respectively, for the testing set.
  • the database contains lung nodules that were annotated by four experienced radiologists (who participated in the LIDC project) in a two-phase reading procedure.
  • the first reading of CT scan images was blind.
  • Each radiologist identified the locations and radiological characteristics of lung nodules independently.
  • the second reading was unblinded.
  • Each radiologist reviewed the first reading results along with the information provided by the other three radiologists in the second reading phase, and decided whether to change their previous annotations. Final annotations were determined after the second unblinded reading.
  • the dataset used in this embodiment were selected from LIDC database according to eight conditions: 1) the CT scan contained nodules of diameter 3-30 millimeters (mm, 1 mm
  • the CT scan images were not contrast-enhanced; 3) the slice thickness was 1.25-3 mm; 4) the slice interval was 0.625-3.0 mm; 5) the scan voltage was 12-140 kilovolts,
  • FIG. 5 is a plot that illustrates an example distribution of lung nodule sizes in the data set used to demonstrate the method of FIG. 2, according to an embodiment. The size distribution of the selected nodules is shown and approximates a Poisson distribution with a peak at a size of about 6 to 7 mm.
  • FIG. 6A through FIG. 6C are flow charts that illustrate an example of the method of FIG. 2 implemented for lung nodules, according to an embodiment.
  • the method of FIG. 6 A through FIG. 6C is implemented as three separate modules.
  • the first module generates candidate nodules.
  • the second module classifies them into three anatomical location context categories: peripheral-nodule; chestwall-nodule; and mediastinum-nodule.
  • the third module, responsible for detection is composed of detection nodes in the form of the tree structure of FIG. 6A.
  • the candidate nodules are categorized and partitioned in terms of their location, size, and shape.
  • a candidate nodule Based on its location, a candidate nodule can be categorized as a peripheral-nodule, chestwall-nodule or mediastinum-nodule. Based on its size, a candidate nodule can be large or small, according to its diameter. And based on its shape, a candidate nodule can be ball-like or irregular according to sphericity. A ball-like nodule is spherical and unattached to other tissues, whereas an irregular nodule is not spherical or is attached to other tissues, especially vessels, or both.
  • each leaf node in the detection tree corresponds to one type of nodule.
  • Each node contains three procedures for selecting the corresponding nodule (see FIG. 6B and FIG. 6C). The procedures are as follows: 1) compute condition values, 2) compare condition values to thresholds and determine whether the candidate nodule could enter (i.e., be accepted by) the node, and 3) extract image features and train classifier. In each node, candidate nodules determined as "Yes” (accepted) will be regarded as true nodules; otherwise, candidate nodules determined as "No” will continue to the next node. To facilitate the illustration, nodes are named according to their order in the detection pipeline. For instance, node "PER_NODE_3" denotes the third node to detect within the peripheral-nodule
  • the example implementation involves multiple parameters, which can be put into two groups, primary parameters and secondary parameters.
  • Primary parameters are those used to categorize and partition candidate nodules (e.g. diameter and sphericity thresholds), while secondary parameters are derived from adopted specific algorithms. Experiments were performed with the test sets and training sets to determine the optimal or preferred values for the primary parameters (as described in more detail below). For secondary parameters, the settings were derived from the related literature where such parameters have been widely studied.
  • Step 1 interpolate CT images to isotropic volumetric data. In this step, all CT images are stacked to form a volume and then interpolated into an isotropic one, that is, volumetric data of same spacing along sagittal, coronal and transverse directions.
  • Step 2 generates target lung area. In step 2, target lung area is segmented by the lung segmentation algorithm developed by Zhao [15].
  • Step 3 applies multi-scale enhancement filters of dot and line to the volumetric data as described in more detail below.
  • Step 4 normalizes and combines the output of dot and line enhancement filters.
  • Step 5 determines candidate nodules according to half-peak volume.
  • step 3 multi-scale enhancement filters of dot and line developed by Li et al. [7] are adopted.
  • the basic dot and line shapes in the volumetric data could be represented by Gaussian functions as in Equation 1 and Equation 2.
  • the enhancement dot and line filters are constructed by the three eigenvalues of the Hessian matrix of the above equations to yield Equation 3 and Equation 4.
  • ⁇ ⁇ , ⁇ 2 and A 3 are the three eigenvalues that satisfy ⁇ ⁇ ⁇ 2 ⁇
  • the output of dot and line filters will multiply their own Gaussian factor ⁇ ⁇ 2, which is used as a scale to modify filters for the detection of target objects of different sizes.
  • the final filter output is the maximal filter output among all the scales.
  • step 4 the output of dot and line filters is first normalized to [0,1] (denoted as z n_dot an d z n_iine) > an d then the normalized dot and line filters are combined according to Equation 5 through Equation 8.
  • the DOT_MAXVALUE, LINE_MAXVALUE a and ⁇ are empirically set as 35.0, 100.0[6, 7], 0.4 and 0.4[22], respectively.
  • step 5 the concept of "half -peak volume" is used to generate candidate nodules.
  • Half-peak volume is defined as the number of voxels that have z_c_dot values larger than half of the local maximal z_c_dot peak value.
  • Half -peak volume is obtained by this procedure.
  • a threshold Thr_z c_dot 0.02 is applied to the output of dot filter of the target lung area.
  • Voxels with z_c_dot values smaller than Thr_z c_dot are regarded as noise and set as 0, otherwise they are set as 1.
  • the candidate volumes are labeled using a region-growing algorithm. Within each labeled candidate volume, voxels with z_c_dot values smaller than half of the local peak z_c_dot value are removed and the remaining voxels are selected to create the candidate nodule.
  • FIG. 7A through FIG. 7F are images that illustrate six example types of nodules processed by a peripheral-nodule detector, according to an embodiment.
  • FIG. 8A through FIG. 8C are images that illustrate three example types of nodules processed by a chestwall-nodule detector, according to an embodiment.
  • FIG. 9A through FIG. 9D are images that illustrate four example types of nodules processed by a mediastinum-nodule detector; according to an embodiment.
  • FIG. 10A shows an example slice of lung image.
  • FIG. 10B shows an example extracted lung region.
  • Candidate nodules attached to the pulmonary vasculature are defined as mediastinum-nodules.
  • Candidate nodules attached to the chest wall are defined as chestwall-nodules.
  • Candidate nodules other than mediastinum-nodules and chestwall-nodules are defined as peripheral- nodules.
  • a morphological opening operation is applied to the extracted region with a ball of radii 60 mm.
  • FIG. IOC shows an example modified region after morphological opening operation. The surface of the mask in FIG. IOC is defined as chest wall.. Then the extracted region is subtracted from the modified region.
  • FIG. 10D shows an example region after subtracting extracted region from modified region. In the subtracted volumes, the largest object is defined as the pulmonary vasculature.
  • FIG. 10E shows an example pulmonary vasculature.
  • the example peripheral-nodule detector consists of six nodes, PER_NODE_l through PER_NODE_6, which produce example nodules depicted in FIG. 7A though FIG. 7F.
  • PER_NODE_l is for large candidate nodules. As shown in FIG. 10D, a group of objects could be attained after applying a threshold Thr_ac ate gory. Then, by performing morphological open operation (with spherical structural element of radii 3.0 mm) to the objects, one can obtain a group of candidate nodules.
  • PER_NODE_2 and PER_NODE_3 are based on the properties of blobness, sphericity and half peak volume.
  • the thresholds of blobness>75.0 [6, 7] and sphericity>0.50 are used to select ball-like candidate nodules. If a candidate nodule has a half peak diameter>3 mm, it is used for classification in PER_NODE_2. If a candidate nodule has a half peak diameter ⁇ 3 mm, it is used for classification in PER_NODE_3.
  • Blobness and sphericity are calculated by Equations 9 and 10.
  • PER_NODE_4 targets irregular nodules with no attaching tissue, especially ground glass opacity (GGO) with no vessel going through or surrounding.
  • GGO ground glass opacity
  • Candidate nodules that encounter PER_NODE_4 will be modified by an adaptive threshold based on Hounsfield units [16].
  • the voxel with the largest z_c_dot value is picked up and labeled as point p_max_c_dot.
  • the I is the Hounsfield unit of point p_max_c_dot.
  • the Thr_adaptive_HU is applied to the reconstruction of candidate nodule, that is, the voxels with Hounsfield units larger than the Thr_adaptive_HU are selected to reconstruct the candidate nodule's volumetric data.
  • PER_NODE_5 mainly takes advantage of intensity information to refine irregular- shaped candidate nodule.
  • candidate nodules that are directed to PER_NODE_5 undergo fuzzy segmentation [17].
  • the refined result by fuzzy segmentation is used for the following procedures.
  • fuzzy segmentation the relation between each pair of voxels (p,q) is represented by fuzzy connectedness strength, computed by Equation 11.
  • /uzzy(p, q) exp(- 3 ⁇ 43 ⁇ 4 (11)
  • A(p,q) (I _p+I_q )*0.5- ⁇
  • I _p and I_q are the Hounsfield units of the voxels p and q.
  • ⁇ and ⁇ are mean and standard deviation of Hounsfield units in the target region.
  • the ⁇ and ⁇ are estimated from the target region determined by the local density maximum algorithm developed by Zhao [15]. The algorithm provides a potential nodule region quickly.
  • Volume_ori is the original volume of candidate nodules
  • Volume_ldm is the volume provided by local density maximum algorithm.
  • LDMRatio ori ⁇ iu m e ori nvoiu m e ldm
  • small value LDMRatio_ori>0.05 are used to select candidate nodules for classification in the PER_NODE_5; otherwise, candidate nodules of LDMRatio_ori ⁇ 0.05 were considered as noise.
  • PER_NODE_6 is similar to PER_NODE_5.
  • PER_NODE_5 fails to refine irregular-shape candidate nodules based on intensity
  • PER_NODE_6 will use geodesic distance transformation to estimate the mean and standard deviation of Hounsfield units for fuzzy segmentation instead of local density maximum algorithm.
  • Geodesic distance transformation is preferable because local density maximum algorithm might fail if candidate nodules are traversed by more than one vessel.
  • an adaptive threshold algorithm mentioned above is used to generate an initial region and then apply geodesic distance transformation. Secondly, the local maximal geodesic distance G_max_local is searched according to the connectivity between voxels within the initial region.
  • the chestwall-nodule detector consists of three nodes CWL_NODE_l through CWL_NODE_3, which produce example nodules depicted in FIG. 8A though FIG. 8C.
  • the first CWL_NODE_l is for large candidate nodules, which is similar to PER_NODE_l, while the other two nodes are for un-ball-like nodules.
  • candidate nodules would be modified by a finer threshold based on Hounsfield units.
  • scaled geodesic distance map [18] is used to characterize those un-ball-like nodules.
  • Candidate chestwall-nodules are regenerated by using the region-growing algorithm, which has two parameters, the starting seeds and the grown threshold.
  • the starting seeds are the original candidate nodules.
  • Scaled geodesic distance map is used to attain the shape property of candidate chestwall-nodules. To calculate the scaled geodesic distance map, a geodesic distance transformation is applied to the regions of candidate nodules starting from the outer surface of the lung wall. The outer surface of the lung wall is actually the outer surface of the target lung region as described above.
  • FIG. 11 is an image that illustrates an example scaled geodesic distance map resulting from one step of a classification process, according to an embodiment. As shown in FIG. 11 , the scaled geodesic distance map appears as a group of iso-surfaces indicated by an arrow.
  • GD_maxSGDM denotes the order of iso-surface with the volume of MaxSGDMgd.
  • GD_locall _maxSGDM and GD_local2_maxSGDM are used to represent the orders of the two iso-surfaces with the closest local minimal volumes around GD_maxSGDM. Since a scale factor 1.0 is used to scale the geodesic distance map, the values of GD naxSGDM, GD_locall _maxSGDM and GD_local2_maxSGDM also correspond to the real geodesic distance values in the scaled geodesic distance map. Thus, the LRMI can be computed
  • N sosurface represents the total number of iso-surfaces within the scaled geodesic distance map.
  • the ARNI can be computed according to Equation 14.
  • ARNI - y N isosurface SGDM(gd n )
  • the two proposed parameters LRMI and ARNI are used in CWL_NODE_2 and CWL_ NODE_3, respectively.
  • the mediastinum-nodule detector consists of four nodes MED_NODE_l through MED_NODE_4, which produce example nodules depicted in FIG. 9A though FIG. 9D. [0077]
  • the entering condition of MED_NODE_l is the same as that of PER_NODE_l.
  • Candidate nodules of diameter>15 mm are used for classification in MED_NODE_l.
  • the candidate nodules that encounter MED_NODE_2 are first modified by the adaptive threshold algorithm described above. Then, the sphericity of each regenerated candidate nodule is calculated. Those regenerated candidate nodules with sphericity larger than 0.5 are used for classification in MED_NODE_2.
  • MED_NODE_3 The entering condition of MED_NODE_3 is the same as that of PER_NODE_5. It is noted that, only those candidate nodules with LDMRatio or i > 0.05 are used for classification in MED_NODE_3.
  • Classifiers in the nodes are trained by image features and the regression tree classification algorithm [19] based on two concepts: the detection rate (DR) and the false positive rate (FR).
  • the DR and FR can be calculated according to Equation 15 and Equation 16.
  • the training result of DR is advantageously higher than DRjhr
  • the training result of FR is advantageously lower than FR_thr.
  • the number scales of candidates in the nodes are determined by a series of pre-setting DR_thrs and FR hrs. For instance, low DR_thr and high FR hr might make the amount of candidates in an individual node too large, while high DRjhr and low FRjhr might make it too small. Both situations are harmful to the performance of the tree structure.
  • proper settings of DRjhrs and FRjhrs is advantageous.
  • DRjhrs is set as 75% and FRjhrs is set as 4.0 for most of nodes in the detection system, except those last nodes in the detectors.
  • the DRjhrs and FRjhrs of the last nodes were set as 50% and 4.0 respectively, because candidate nodules in the last nodes are the most difficult to classify.
  • FIG. 12 is a table that illustrates example node features, according to an embodiment. All of the features used for node training are presented in Table 1 presented in FIG. 12.
  • Mean_CT_Value is obtained by computing the average Hounsfield units of volumetric data. Volume is obtained by counting the total voxels of volumetric data. Sphericity is defined by Equation 10. AdaThr_ is obtained by computing the sphericity of volumetric data that is modified by adaptive threshold. Max_dot is defined by Equation 17 and Dotline_Ratio by Equation 18.
  • Max_dot Max(z c dot ) (17)
  • GD_R1 is obtained by computing the maximal geodesic distance to the surface of volumetric data (The distance value inside the volumetric data is positive, otherwise negative).
  • GD_Ratiol and GD_Ratio2 are obtained by suppose p_c is the voxel corresponding to the value GD_R1.
  • the geodesic distance transformation is performed starting from p_c and recording the maximal geodesic distance GD_R2 and the corresponding voxel p_l.
  • the geodesic distance transformation is performed again starting from p_l and recording the maximal geodesic distance GD_R3 and the corresponding voxel p_2.
  • the ratios are defined by Equation 19 and Equation 20.
  • Volume_ori is the original volume of candidate nodules
  • Volume nod is the volume of candidate nodules that have been modified by the
  • Ori_LDMRatio and Modified _LDMRatio are obtained using Equation 22 and 23 respectively.
  • Equation 13 LRMI and ARNI are obtained using Equation 13 and Equation 14, provided above.
  • Equation 24 the final feature Modified iatio is defined by Equation 24.
  • the criterion to differentiate a truly detected nodule from a false positive was based on the comparison between the centroid of a detected nodule and that of the nearest annotated nodule. If the Euclidean distance from the centroid of the detected nodule to that of the nearest annotated nodule did not exceed a distance threshold, the detected nodule was regarded as a truly detected nodule, otherwise it was considered a false positive. For these purposes, if the nearest annotated nodule was smaller than 10 mm, the distance threshold was
  • FIG. 13A and FIG. 13B are free-response receiver operating characteristic (FROC) curves that illustrate example performance of the method on a training set and testing set, respectively, according to an embodiment.
  • the proposed hybrid method was coded in C++ and tested on a computer with 3.60 GHz CPU and 8 GB Memory. On average, the hybrid method takes 628 second/scan for detection without I/O process.
  • a purpose was to isolate extremely small peripheral-nodules (PER_NODE_3).
  • Sen is the sensitivity.
  • FP/s is the false positives per scan.
  • the hierarchical classifier method can achieve sensitivity of 87% with 2.61 false positive per scan on the training dataset, and sensitivity of 85.2% with 3.13 false positive per scan on the testing dataset, respectively.
  • This method was compared with six recent CAD schemes, four of which were evaluated on an independent test. As shown in Table 4, only the hierarchical classifier method yielded sensitivity higher than 85% while maintaining false positive per scan lower than 4.0. Though Li's scheme had better results than the five others, it was only tested by the cross-validation method rather than using an independent dataset. Besides, Li's dataset was small, containing no more than one hundred CT scans. Murphy's method was tested on CT scans of the most number, but it required too many features and the sensitivity was just 80%.
  • This hierarchical classifier method for lung nodules has at least two advantages.
  • the first advantage is that candidate nodules are partitioned in a "soft" way rather than a "hard” way [19, 24].
  • PER_NODE_l, CWL_NODE_l and MED_NODE_l are actually similar to each other in terms of size, as shown in FIG. 7A, FIG. 8A and FIG. 9A. Based on such overlap, accurate thresholds were not needed to control the entry into nodes, because one true nodule that was rejected by one node might be accepted by another. As indicated in Table 3, only 4.17% and 4.93% of true nodules were entirely missed by nodes in the training and test dataset, respectively.
  • the second advantage is that specific types of candidate nodules can be processed by specific nodes. To partition nodules, the order of nodes is very useful.
  • candidate nodules are partitioned in the order of from large and regular to small and irregular.
  • large and regular nodules are more easily detected correctly than those small and irregular nodules; thus, nodes targeting large and regular nodules yielded better performance than those nodes targeting small and irregular nodules.
  • all of these six nodes targeting large and regular nodules (PER_NODE_l-2, CWL_NODE_l-2 and MED_NODE_l-2 (See FIG. 8A, FIG. 8B, FIG. 9A. FIG. 9B) could achieve high DR close to 100% while maintaining very low FR.
  • CWL_NODE_3 and MED_NODE_3-4 (See FIG. 8C through FIG. 8E, FIG. 9C and FIG. 9D).
  • CWL_NODE_3 two nodes targeting at irregular-shaped chestwall-nodules
  • PER_NODE_4 irregular peripheral-nodules with no attaching tissues
  • the good performance of PER_NODE_4 is due to the non- attachment to any other tissues (See FIG. 8D).
  • the high performance of CWL_NODE_3 lies in the anatomical fact that there were only a few small vessels and airways located in the region close to the lung wall.
  • PER_NODE_3 Three nodes targeting very small peripheral-nodules (PER_NODE_3), irregular-shape peripheral-nodules of similar intensity to the attaching tissues (PER_NODE_6) and irregular-shape mediastinum-nodules of similar intensity to the attaching tissues (MED_NODE_4), were the least successful.
  • very small candidate nodules See FIG. 8C
  • candidate nodules were similar to small vessels not only based on shape but also on intensity, making them extremely difficult to detect. That is why PER_NODE_6 and MED_NODE_4 were placed at the end of the detectors.
  • the hierarchical classifier method performed well, yielding high sensitivity and low false positives per scan in a large scale dataset.
  • the present method would be a useful tool for both routine diagnosis and screening studies on a wide variety of CT imaging protocols.
  • FIG. 3 is a block diagram that illustrates a computer system 300 upon which an embodiment of the invention may be implemented.
  • Computer system 300 includes a communication mechanism such as a bus 310 for passing information between other internal and external components of the computer system 300.
  • Information is represented as physical signals of a measurable phenomenon, typically electric voltages, but including, in other embodiments, such phenomena as magnetic, electromagnetic, pressure, chemical, molecular atomic and quantum interactions. For example, north and south magnetic fields, or a zero and non-zero electric voltage, represent two states (0, 1) of a binary digit (bit). Other phenomena can represent digits of a higher base.
  • a superposition of multiple simultaneous quantum states before measurement represents a quantum bit (qubit).
  • a sequence of one or more digits constitutes digital data that is used to represent a number or code for a character.
  • information called analog data is represented by a near continuum of measurable values within a particular range.
  • Computer system 300, or a portion thereof, constitutes a means for performing one or more steps of one or more methods described herein.
  • a sequence of binary digits constitutes digital data that is used to represent a number or code for a character.
  • a bus 310 includes many parallel conductors of information so that information is transferred quickly among devices coupled to the bus 310.
  • One or more processors 302 for processing information are coupled with the bus 310.
  • a processor 302 performs a set of operations on information.
  • the set of operations include bringing information in from the bus 310 and placing information on the bus 310.
  • the set of operations also typically include comparing two or more units of information, shifting positions of units of information, and combining two or more units of information, such as by addition or multiplication.
  • a sequence of operations to be executed by the processor 302 constitutes computer instructions.
  • Computer system 300 also includes a memory 304 coupled to bus 310.
  • the memory 304 such as a random access memory (RAM) or other dynamic storage device, stores information including computer instructions. Dynamic memory allows information stored therein to be changed by the computer system 300. RAM allows a unit of information stored at a location called a memory address to be stored and retrieved independently of information at neighboring addresses.
  • the memory 304 is also used by the processor 302 to store temporary values during execution of computer instructions.
  • the computer system 300 also includes a read only memory (ROM) 306 or other static storage device coupled to the bus 310 for storing static information, including instructions, that is not changed by the computer system 300.
  • ROM read only memory
  • Also coupled to bus 310 is a non-volatile (persistent) storage device 308, such as a magnetic disk or optical disk, for storing information, including instructions, that persists even when the computer system 300 is turned off or otherwise loses power.
  • Information is provided to the bus 310 for use by the processor from an external input device 312, such as a keyboard containing alphanumeric keys operated by a human user, or a sensor.
  • a sensor detects conditions in its vicinity and transforms those detections into signals compatible with the signals used to represent information in computer system 300.
  • a display device 314 such as a cathode ray tube (CRT) or a liquid crystal display (LCD), for presenting images
  • a pointing device 316 such as a mouse or a trackball or cursor direction keys, for controlling a position of a small cursor image presented on the display 314 and issuing commands associated with graphical elements presented on the display 314.
  • special purpose hardware such as an application specific integrated circuit (IC) 320
  • IC application specific integrated circuit
  • the special purpose hardware is configured to perform operations not performed by processor 302 quickly enough for special purposes.
  • application specific ICs include graphics accelerator cards for generating images for display 314, cryptographic boards for encrypting and decrypting messages sent over a network, speech recognition, and interfaces to special external devices, such as robotic arms and medical scanning equipment that repeatedly perform some complex sequence of operations that are more efficiently implemented in hardware.
  • Computer system 300 also includes one or more instances of a communications interface 370 coupled to bus 310.
  • Communication interface 370 provides a two-way communication coupling to a variety of external devices that operate with their own processors, such as printers, scanners and external disks. In general the coupling is with a network link 378 that is connected to a local network 380 to which a variety of external devices with their own processors are connected.
  • communication interface 370 may be a parallel port or a serial port or a universal serial bus (USB) port on a personal computer.
  • USB universal serial bus
  • communications interface 370 is an integrated services digital network (ISDN) card or a digital subscriber line (DSL) card or a telephone modem that provides an information communication connection to a corresponding type of telephone line.
  • ISDN integrated services digital network
  • DSL digital subscriber line
  • a communication interface 370 is a cable modem that converts signals on bus 310 into signals for a communication connection over a coaxial cable or into optical signals for a communication connection over a fiber optic cable.
  • communications interface 370 may be a local area network (LAN) card to provide a data communication connection to a compatible LAN, such as Ethernet.
  • LAN local area network
  • Wireless links may also be implemented.
  • Carrier waves, such as acoustic waves and electromagnetic waves, including radio, optical and infrared waves travel through space without wires or cables.
  • Signals include man-made variations in amplitude, frequency, phase, polarization or other physical properties of carrier waves.
  • the communications interface 370 sends and receives electrical, acoustic or electromagnetic signals, including infrared and optical signals that carry information streams, such as digital data.
  • Non- volatile media include, for example, optical or magnetic disks, such as storage device 308.
  • Volatile media include, for example, dynamic memory 304.
  • Transmission media include, for example, coaxial cables, copper wire, fiber optic cables, and waves that travel through space without wires or cables, such as acoustic waves and electromagnetic waves, including radio, optical and infrared waves.
  • the term computer-readable storage medium is used herein to refer to any medium that participates in providing information to processor 302, except for transmission media.
  • Computer-readable media include, for example, a floppy disk, a flexible disk, a hard disk, a magnetic tape, or any other magnetic medium, a compact disk ROM (CD-ROM), a digital video disk (DVD) or any other optical medium, punch cards, paper tape, or any other physical medium with patterns of holes, a RAM, a programmable ROM (PROM), an erasable PROM (EPROM), a FLASH-EPROM, or any other memory chip or cartridge, a carrier wave, or any other medium from which a computer can read.
  • the term non-transitory computer-readable storage medium is used herein to refer to any medium that participates in providing information to processor 302, except for carrier waves and other signals.
  • Logic encoded in one or more tangible media includes one or both of processor instructions on a computer-readable storage media and special purpose hardware, such as ASIC 320.
  • Network link 378 typically provides information communication through one or more networks to other devices that use or process the information.
  • network link 378 may provide a connection through local network 380 to a host computer 382 or to equipment 384 operated by an Internet Service Provider (ISP).
  • ISP equipment 384 in turn provides data communication services through the public, world-wide packet-switching communication network of networks now commonly referred to as the Internet 390.
  • a computer called a server 392 connected to the Internet provides a service in response to information received over the Internet.
  • server 392 provides information representing video data for presentation at display 314.
  • the invention is related to the use of computer system 300 for implementing the techniques described herein. According to one embodiment of the invention, those techniques are performed by computer system 300 in response to processor 302 executing one or more sequences of one or more instructions contained in memory 304. Such instructions, also called software and program code, may be read into memory 304 from another computer-readable medium such as storage device 308. Execution of the sequences of instructions contained in memory 304 causes processor 302 to perform the method steps described herein.
  • hardware such as application specific integrated circuit 320, may be used in place of or in combination with software to implement the invention. Thus, embodiments of the invention are not limited to any specific combination of hardware and software.
  • Computer system 300 can send and receive information, including program code, through the networks 380, 390 among others, through network link 378 and communications interface 370.
  • a server 392 transmits program code for a particular application, requested by a message sent from computer 300, through Internet 390, ISP equipment 384, local network 380 and communications interface 370.
  • the received code may be executed by processor 302 as it is received, or may be stored in storage device 308 or other non- volatile storage for later execution, or both.
  • computer system 300 may obtain application program code in the form of a signal on a carrier wave.
  • Various forms of computer readable media may be involved in carrying one or more sequence of instructions or data or both to processor 302 for execution.
  • instructions and data may initially be carried on a magnetic disk of a remote computer such as host 382.
  • the remote computer loads the instructions and data into its dynamic memory and sends the instructions and data over a telephone line using a modem.
  • a modem local to the computer system 300 receives the instructions and data on a telephone line and uses an infrared transmitter to convert the instructions and data to a signal on an infra-red a carrier wave serving as the network link 378.
  • An infrared detector serving as communications interface 370 receives the instructions and data carried in the infrared signal and places information representing the instructions and data onto bus 310.
  • Bus 310 carries the information to memory 304 from which processor 302 retrieves and executes the instructions using some of the data sent with the instructions.
  • the instructions and data received in memory 304 may optionally be stored on storage device 308, either before or after execution by the processor 302.
  • FIG. 4 illustrates a chip set 400 upon which an embodiment of the invention may be implemented.
  • Chip set 400 is programmed to perform one or more steps of a method described herein and includes, for instance, the processor and memory components described with respect to FIG. 3 incorporated in one or more physical packages (e.g., chips).
  • a physical package includes an arrangement of one or more materials, components, and/or wires on a structural assembly (e.g., a baseboard) to provide one or more
  • Chip set 400 or a portion thereof, constitutes a means for performing one or more steps of a method described herein.
  • the chip set 400 includes a communication mechanism such as a bus 401 for passing information among the components of the chip set 400.
  • a processor 403 has connectivity to the bus 401 to execute instructions and process information stored in, for example, a memory 405.
  • the processor 403 may include one or more processing cores with each core configured to perform independently.
  • a multi-core processor enables
  • the processor 403 may include one or more microprocessors configured in tandem via the bus 401 to enable independent execution of instructions, pipelining, and multithreading.
  • the processor 403 may also be accompanied with one or more specialized components to perform certain processing functions and tasks such as one or more digital signal processors (DSP) 407, or one or more application-specific integrated circuits (ASIC) 409.
  • DSP digital signal processors
  • ASIC application-specific integrated circuits
  • a DSP 407 typically is configured to process real-world signals (e.g., sound) in real time independently of the processor 403.
  • an ASIC 409 can be configured to performed specialized functions not easily performed by a general purposed processor.
  • Other specialized components to aid in performing the inventive functions described herein include one or more field
  • FPGA programmable gate arrays
  • the processor 403 and accompanying components have connectivity to the memory 405 via the bus 401.
  • the memory 405 includes both dynamic memory (e.g., RAM, magnetic disk, writable optical disk, etc.) and static memory (e.g., ROM, CD-ROM, etc.) for storing executable instructions that when executed perform one or more steps of a method described herein.
  • the memory 405 also stores the data associated with or generated by the execution of one or more steps of the methods described herein. 5. Alterations, extensions and modifications
  • indefinite article “a” or “an” is meant to indicate one or more of the item, element or step modified by the article.
  • a value is “about” another value if it is within a factor of two (twice or half) of the other value. While example ranges are given, unless otherwise clear from the context, any contained ranges are also intended in various embodiments. Thus, a range from 0 to 10 includes the range 1 to 4 in some embodiments.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Medical Informatics (AREA)
  • General Health & Medical Sciences (AREA)
  • Public Health (AREA)
  • Epidemiology (AREA)
  • Primary Health Care (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biomedical Technology (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • General Physics & Mathematics (AREA)
  • Radiology & Medical Imaging (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Evolutionary Biology (AREA)
  • Databases & Information Systems (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • Biotechnology (AREA)
  • Urology & Nephrology (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Software Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Quality & Reliability (AREA)
  • Bioethics (AREA)
  • Spectroscopy & Molecular Physics (AREA)
  • Pathology (AREA)
  • Physiology (AREA)
  • High Energy & Nuclear Physics (AREA)
  • Optics & Photonics (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Molecular Biology (AREA)

Abstract

L'invention concerne des techniques de détection automatique et de traitement d'anomalies dans une imagerie médicale. Les techniques comprennent la détermination de voxels impliqués dans chaque pluralité d'anomalies candidates dans une image médicale. Les techniques consistent également à déterminer si une anomalie candidate appartient à l'une des multiples classes d'anomalies en se basant au moins sur le contexte d'emplacement anatomique, la taille, et la forme, en soumettant successivement les anomalies candidates à des essais hiérarchiques destinés au contexte anatomique, à une plage de tailles basée sur le contexte anatomique, et à une plage de valeurs de paramètres de forme basée sur le contexte anatomique et sur la plage de tailles. Les techniques comprennent le rejet d'une anomalie candidate qui n'entre pas dans l'une des classes d'anomalies. Les techniques consistent également à présenter sur un dispositif d'affichage une propriété de l'anomalie candidate sur la base de la classe d'anomalies à laquelle appartient l'anomalie candidate.
PCT/US2016/042055 2015-07-13 2016-07-13 Traitement des anomalies candidates dans une imagerie médicale sur la base d'une classification hiérarchique WO2017011532A1 (fr)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201562191834P 2015-07-13 2015-07-13
US62/191,834 2015-07-13

Publications (1)

Publication Number Publication Date
WO2017011532A1 true WO2017011532A1 (fr) 2017-01-19

Family

ID=57757572

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2016/042055 WO2017011532A1 (fr) 2015-07-13 2016-07-13 Traitement des anomalies candidates dans une imagerie médicale sur la base d'une classification hiérarchique

Country Status (1)

Country Link
WO (1) WO2017011532A1 (fr)

Cited By (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20210272278A1 (en) * 2020-02-28 2021-09-02 Canon Medical Systems Corporation Medical information processing system and medical information processing method
US11335001B2 (en) * 2019-03-14 2022-05-17 Siemens Healthcare Gmbh Method and system for monitoring a biological process
US20220165418A1 (en) * 2019-03-29 2022-05-26 Ai Technologies Inc. Image-based detection of ophthalmic and systemic diseases
US20230011759A1 (en) * 2021-07-07 2023-01-12 Canon Medical Systems Corporation Apparatus, method, and non-transitory computer-readable storage medium for improving image quality of a medical image volume
CN116703955A (zh) * 2023-08-04 2023-09-05 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) 磁共振图像的海马体时间纵向分割方法及计算机设备

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6728334B1 (en) * 2001-10-24 2004-04-27 Cornell Research Foundation, Inc. Automatic detection of pulmonary nodules on volumetric computed tomography images using a local density maximum algorithm
US6760468B1 (en) * 1996-02-06 2004-07-06 Deus Technologies, Llc Method and system for the detection of lung nodule in radiological images using digital image processing and artificial neural network
US20090252395A1 (en) * 2002-02-15 2009-10-08 The Regents Of The University Of Michigan System and Method of Identifying a Potential Lung Nodule

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6760468B1 (en) * 1996-02-06 2004-07-06 Deus Technologies, Llc Method and system for the detection of lung nodule in radiological images using digital image processing and artificial neural network
US6728334B1 (en) * 2001-10-24 2004-04-27 Cornell Research Foundation, Inc. Automatic detection of pulmonary nodules on volumetric computed tomography images using a local density maximum algorithm
US20090252395A1 (en) * 2002-02-15 2009-10-08 The Regents Of The University Of Michigan System and Method of Identifying a Potential Lung Nodule

Cited By (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US11335001B2 (en) * 2019-03-14 2022-05-17 Siemens Healthcare Gmbh Method and system for monitoring a biological process
US20220165418A1 (en) * 2019-03-29 2022-05-26 Ai Technologies Inc. Image-based detection of ophthalmic and systemic diseases
US20210272278A1 (en) * 2020-02-28 2021-09-02 Canon Medical Systems Corporation Medical information processing system and medical information processing method
US11954850B2 (en) * 2020-02-28 2024-04-09 Canon Medical Systems Corporation Medical information processing system and medical information processing method
US20230011759A1 (en) * 2021-07-07 2023-01-12 Canon Medical Systems Corporation Apparatus, method, and non-transitory computer-readable storage medium for improving image quality of a medical image volume
US12062153B2 (en) * 2021-07-07 2024-08-13 Canon Medical Systems Corporation Apparatus, method, and non-transitory computer-readable storage medium for improving image quality of a medical image volume
CN116703955A (zh) * 2023-08-04 2023-09-05 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) 磁共振图像的海马体时间纵向分割方法及计算机设备
CN116703955B (zh) * 2023-08-04 2024-03-26 哈尔滨工业大学(深圳)(哈尔滨工业大学深圳科技创新研究院) 磁共振图像的海马体时间纵向分割方法及计算机设备

Similar Documents

Publication Publication Date Title
Lu et al. Hybrid detection of lung nodules on CT scan images
Gerard et al. FissureNet: a deep learning approach for pulmonary fissure detection in CT images
Tan et al. A novel computer‐aided lung nodule detection system for CT images
El-Regaily et al. Multi-view Convolutional Neural Network for lung nodule false positive reduction
Han et al. Fast and adaptive detection of pulmonary nodules in thoracic CT images using a hierarchical vector quantization scheme
US7738683B2 (en) Abnormality detection in medical images
EP4014201A1 (fr) Segmentation d'objet tridimensionnelle d'images médicales localisées avec détection d'objet
US8023710B2 (en) Virtual colonoscopy via wavelets
Ochs et al. Automated classification of lung bronchovascular anatomy in CT using AdaBoost
Staal et al. Automatic rib segmentation and labeling in computed tomography scans using a general framework for detection, recognition and segmentation of objects in volumetric data
EP2589340B1 (fr) Appareil, procédé et programme de traitement d'image médicale
El-Baz et al. Three-dimensional shape analysis using spherical harmonics for early assessment of detected lung nodules
US11896407B2 (en) Medical imaging based on calibrated post contrast timing
Lisowska et al. Thrombus detection in CT brain scans using a convolutional neural network
WO2017011532A1 (fr) Traitement des anomalies candidates dans une imagerie médicale sur la base d'une classification hiérarchique
Bagci et al. Automatic detection and quantification of tree-in-bud (TIB) opacities from CT scans
Paulhac et al. Comparison between 2D and 3D local binary pattern methods for characterisation of three-dimensional textures
Lee et al. Potential of computer-aided diagnosis to improve CT lung cancer screening
Xue et al. Region-of-interest aware 3D ResNet for classification of COVID-19 chest computerised tomography scans
Ren et al. High-performance CAD-CTC scheme using shape index, multiscale enhancement filters, and radiomic features
Wang et al. False positive reduction in pulmonary nodule classification using 3D texture and edge feature in CT images
Manikandan et al. Automated classification of emphysema using data augmentation and effective pixel location estimation with multi-scale residual network
Hellmann et al. Deformable dilated faster R-CNN for universal lesion detection in CT images
Yazar A Comparative study on classification performance of Emphysema with transfer learning methods in deep convolutional neural networks
Irving et al. Segmentation of obstructed airway branches in CT using airway topology and statistical shape analysis

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 16825094

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 16825094

Country of ref document: EP

Kind code of ref document: A1