EP1774469A1 - System and method for automated suspicious object boundary determination - Google Patents
System and method for automated suspicious object boundary determinationInfo
- Publication number
- EP1774469A1 EP1774469A1 EP05772337A EP05772337A EP1774469A1 EP 1774469 A1 EP1774469 A1 EP 1774469A1 EP 05772337 A EP05772337 A EP 05772337A EP 05772337 A EP05772337 A EP 05772337A EP 1774469 A1 EP1774469 A1 EP 1774469A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- parameter values
- machine learning
- suspicious object
- learning system
- performance level
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/143—Segmentation; Edge detection involving probabilistic approaches, e.g. Markov random field [MRF] modelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10088—Magnetic resonance imaging [MRI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10116—X-ray image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30068—Mammography; Breast
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30096—Tumor; Lesion
Definitions
- the present invention relates, generally, to systems and methods for determining suspicious object boundaries in tissues and more specifically, to automated systems and methods of suspicious object boundary determination.
- Computer aided detection (CAD) and computer aided diagnosis (CADx) are computer based approaches for suspicious object detection and diagnosis. These approaches are supposed to perform better than traditional visual inspection by a radiologist due to the capability of the computerized systems to "see” detailed characteristics in medical diagnostic images of suspicious objects much more accurately. Additionally, researchers have been continuously improving algorithms for CAD and CADx.
- CADx is performed after CAD is completed and makes use of the output from CAD - especially suspicious object segmentation data - as inputs, thus employing a CAD system that more correctly detects the boundaries of suspicious objects directly impacts, beneficially, the success rate of the CADx system.
- the CADx system uses the CAD output data, the CADx system generates certain classifiers.
- the CADx system employs various classification schemes, such as artificial neural network, Bayesian, decision tree, etc. on the CAD data to arrive at a diagnosis. By properly training theses classification schemes (i.e., machine learning systems), in an objective manner, the resulting diagnostic success rate is improved.
- the current suspicious object detection algorithms have a common problem regarding suspicious object segmentation, in that it is impossible for the algorithms to provide a precise boundary definition for any given suspicious object. The reason is simple; the boundary between suspicious object and surrounding tissue is not clear-cut. There is no definitive threshold or algorithm to differentiate suspicious object pixels with boundary pixels. What an algorithm can do is offer a parameter adjustment feature (with certain possibly optimal default parameter values) for radiologists to determine the suspicious object boundary. Therefore, the capability of a computer to segment suspicious object from digital images becomes limited and highly dependent on the individual radiologist's own judgment.
- FIGs. Ia and Ib show a breast cancer tumor segmented by the FastMarch algorithm.
- CADx first trains a computer using a set of examples containing suspicious objects with a known nature (malignant/benign), also referred to herein as a ground truth. However, if the segmentation of these training examples is arbitrarily determined by a radiologist, the machine learning based on these training examples might not generate maximum performance for diagnosing new suspicious objects.
- the system and method of the present invention overcome such problems by establishing an optimal set of default values for relevant segmentation parameters of training data and these values could be applied to new suspicious objects consistently for segmentation/diagnosis.
- the system and method of the present invention provide a combination of machine learning and genetic algorithm techniques for suspicious object boundary determination.
- machine learning e.g. artificial neural network, Bayesian method, decision tree, etc.
- ground truth normally whether a nodule is malignant or benign
- the output of such prediction would be either benign/malignant or a likelihood of malignancy.
- Embodiments of the present invention provide a system and method for automated suspicious object boundary determination using machine learning and genetic algorithms.
- the system and method include at least one training set of suspicious object identification images, which are initially segmented using a set of randomly generated parameter values. However, parameter values may also be selected from a stored set of preferred values.
- the segmented suspicious object identification images are processed using image feature extraction algorithms to produce input data for a machine learning system. Subsequently, the machine learning system is tested using at least one testing set of suspicious object identification images. Performance of the machine learning system is evaluated by comparing the outputs produced during testing against known ground truths of the testing set. The performance level is determined based on the amount of difference occurring between the outputs and the ground truths and passed to the genetic algorithm to be used as a measure of the fitness of the parameter set being evaluated.
- Acceptability of the performance level is determined (based on presets) and used by a genetic algorithm to decide whether to continue or halt. If the performance level is acceptable, the parameter values are set as default values for use in automatic segmentation, however, if the performance level is unacceptable, the genetic algorithm adjusts the parameter values and performs the method steps again using the adjusted parameter values in place of the previous parameter values.
- the system includes a processor configured for performing the method as described above, as well as input devices (e.g., keyboard, mouse, etc), a hard drive and/or optical storage device and a display screen.
- input devices e.g., keyboard, mouse, etc
- a hard drive and/or optical storage device e.g., a hard drive and/or optical storage device
- a display screen e.g., a graphical user interface
- a further embodiment of the present invention may be a software application, suite of software tools, or computer executable instructions for performing the above-described method on a personal computer, workstation, server or other computing device.
- the software may be stored on a computer-readable medium such as magnetic media, optical media, memory cards, and ROMs.
- the software may be executable across a network.
- the software is stored on a server networked to one or more workstations.
- the workstations provide an operator the ability to control the software executed on the server.
- FIGs. Ia and Ib are illustrations of prior art segmentation of a breast cancer suspicious object using two different sets of parameter values
- FIG. 2 is a flowchart illustrating the steps in performing an embodiment of the present invention
- FIG. 3 is an illustration of a suspicious object diagnostic system in accordance with the present invention
- FIG. 4 is an illustration of an integrated medical imaging and diagnostic system in accordance with the present invention
- FIG. 5 is an image of a training example showing a malignant suspicious object for training the diagnostic system in accordance with the present invention.
- FIG. 6 is an image of a training example showing a benign suspicious object for training the diagnostic system in accordance with the present invention.
- An embodiment of the present invention performs the steps as shown in FIG. 2.
- the process begins with step 201, wherein a set of randomly generated parameter values is selected.
- the set of randomly generated parameter values is utilized to perform suspicious object segmentation of a set of training examples in Step 202.
- the training examples as shown in FIGs. 5 and 6, are of previously characterized suspicious objects and have corresponding ground truth records, which are used in a later step to rate performance of the suspicious object boundary determination system.
- the ground truths may include such information as malignancy, shape/contour of the suspicious object, etc.
- the segmented suspicious objects are processed by image feature extraction algorithms. Some examples of image features that are applicable include boundary perimeter length, area of a superimposed and fitted circle or oval, roughness of boundary edge, brightness gradient, etc.
- step 204 the generated features and characteristics data outputted from step 203 along with the ground truth records are entered in to a machine learning system or classifier (e.g. a neural network).
- the outputs from the classifier are tested on a set of testing examples (another set of suspicious objects that are segmented, and feature- extracted like the training data) in step 205.
- step 206 the testing results (predicted likelihood of malignancy) are compared with ground truth records for the set of testing examples.
- the actual ground truth data and the testing results are compared and the difference is treated as the performance rating (the lower the difference, the better the performance) in step 207.
- step 208 it is determined whether the performance rating is acceptable based on presets.
- the genetic algorithm is stopped and the current set of parameter values is used as default values for automatic segmentation, along with the trained classifier that works best with it in step 209.
- a genetic algorithm adjusts the parameters using any of several methods (e.g. mutation and crossover) in step 210 and the whole process continues from step 202.
- Overall the inventive method for automated suspicious object boundary determination using machine learning and at least one genetic algorithm includes the steps of providing at least one training set of suspicious object identification images, wherein the at least one training set are segmented using a set of chosen or randomly generated parameter values; and processing the segmented suspicious object identification images using image feature extraction algorithms to produce input data for a machine learning system.
- the method further includes the steps of testing the machine learning system using at least one testing set of suspicious object identification images and evaluating performance of the machine learning system. Outputs produced in the testing step are compared against known ground truths of the testing set (i.e. cross validation). The performance level is determined based on the number and/or sizes of differences occurring between the outputs and the ground truths. The method also includes the step of determining acceptability of the performance level based on pre-sets. If the performance level is acceptable, the genetic algorithm terminates and the parameter values are set as default values for use in automatic segmentation and the trained classifier that works with them is set. If the performance level is unacceptable, the genetic algorithm adjusts the parameter values and performs these method steps again starting at the providing step using the adjusted parameter values in place of the previous randomly generated parameter values.
- FIG. 3 An additional embodiment of the present invention, as shown in FIG. 3, provides a computer system 300 having a processor 302, display screen 304 and input devices, such as a keyboard 306 and mouse 308. Additionally, the system 300 includes at least mass storage device 310, e.g., hard drive, CD-Rom, optical storage, etc. The system may also have a networking interface 312, such as 10/100/1000 Base-T or wireless IEEE 802.1 la/b/c.
- the computer system 300 is configured to execute computer-readable instructions for performing the method as described above.
- the instructions may be stored on the mass storage device 310 or on a removable media readable by the mass storage device.
- the instructions may be downloadable from a network - either a LAN or Internet - or executable across a network.
- the medical diagnostic system 400 includes one or more medical imaging systems 402, e.g. ultrasound imaging, Magnetic Resonance • Imaging, X-Ray, etc., and the computer system 300 as described above.
- medical imaging systems 402 e.g. ultrasound imaging, Magnetic Resonance • Imaging, X-Ray, etc.
- Such a medical diagnostic system 400 provides an integrated solution for suspicious object imaging, segmentation and diagnosis.
- the inventive system for automated suspicious object boundary determination utilizing a machine learning system and at least one genetic algorithm includes at least one training set of suspicious object identification images.
- the at least one training set is segmented using a set of randomly generated parameter values.
- the system further includes at least one image feature extraction algorithm for processing the segmented suspicious object identification images to produce input data for the machine learning system; and at least one testing set of suspicious object identification images for testing outputs of the machine learning system.
- the at least one genetic algorithm evaluates results from the at least one testing set for determining a performance level for the machine learning system. If the performance level is acceptable, the parameter values are set as default values for use in automatic segmentation. If the performance level is unacceptable, the genetic algorithm adjusts the parameter values.
Landscapes
- Engineering & Computer Science (AREA)
- Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Probability & Statistics with Applications (AREA)
- Software Systems (AREA)
- Measuring And Recording Apparatus For Diagnosis (AREA)
- Image Analysis (AREA)
- Apparatus For Radiation Diagnosis (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
- Ultra Sonic Daignosis Equipment (AREA)
Abstract
A system and method is provided for automated suspicious object boundary determination using a machine learning system (300) and genetic algorithms. The machine learning system (300) is trained (204) and tested (205) using sets of pre-categorized examples. Genetic algorithms assign initial parameter values (201), evaluate the system's performance (206) during testing and assign a performance rating (207), whereupon if the rating is acceptable, the current machine learning system's settings are assigned as default parameters (209) for future suspicious object segmentation. However, if the performance rating is unacceptable, the genetic algorithms adjust the settings (210) and retrain the system using the newly adjusted settings.
Description
SYSTEM AND METHOD FOR AUTOMATED SUSPICIOUS OBJECT BOUNDARY DETERMINATION
The present invention relates, generally, to systems and methods for determining suspicious object boundaries in tissues and more specifically, to automated systems and methods of suspicious object boundary determination.
Computer aided detection (CAD) and computer aided diagnosis (CADx) are computer based approaches for suspicious object detection and diagnosis. These approaches are supposed to perform better than traditional visual inspection by a radiologist due to the capability of the computerized systems to "see" detailed characteristics in medical diagnostic images of suspicious objects much more accurately. Additionally, researchers have been continuously improving algorithms for CAD and CADx.
While many algorithms have been developed for detecting suspicious objects using CAD, performing effective automatic suspicious object segmentation presents significant challenges since the boundary of a suspicious object is very difficult to detect, thus, these algorithms usually provide boundary adjustment capabilities for radiologists to determine the actual boundary. Although this does not seem to cause too much inconvenience for radiologists, it does cause difficulties for CADx.
Traditionally CADx is performed after CAD is completed and makes use of the output from CAD - especially suspicious object segmentation data - as inputs, thus employing a CAD system that more correctly detects the boundaries of suspicious objects directly impacts, beneficially, the success rate of the CADx system. Using the CAD output data, the CADx system generates certain classifiers. The CADx system employs various classification schemes, such as artificial neural network, Bayesian, decision tree, etc. on the CAD data to arrive at a diagnosis. By properly training theses classification schemes (i.e., machine learning systems), in an objective manner, the resulting diagnostic success rate is improved.
The current suspicious object detection algorithms have a common problem regarding suspicious object segmentation, in that it is impossible for the algorithms to provide a precise boundary definition for any given suspicious object. The reason is simple; the boundary between suspicious object and surrounding tissue is not clear-cut. There is no definitive threshold or algorithm to differentiate suspicious object pixels with
boundary pixels. What an algorithm can do is offer a parameter adjustment feature (with certain possibly optimal default parameter values) for radiologists to determine the suspicious object boundary. Therefore, the capability of a computer to segment suspicious object from digital images becomes limited and highly dependent on the individual radiologist's own judgment.
A group of algorithms that is finding favor in the area of computational modeling is the family of algorithms known as genetic algorithms. Genetic algorithms encode solutions using a chromosome inspired data structure and apply recombination operators to these structures in a manner that preserves critical information. FIGs. Ia and Ib show a breast cancer tumor segmented by the FastMarch algorithm.
As shown by FIGs. Ia and Ib, by adjusting parameters, the detected shape of the tumor can change dramatically. Such freedom of segmentation would bring the following problems: (1) It impedes automatic suspicious object segmentation and automatic report generation. (2) It complicates CADx operations. CADx first trains a computer using a set of examples containing suspicious objects with a known nature (malignant/benign), also referred to herein as a ground truth. However, if the segmentation of these training examples is arbitrarily determined by a radiologist, the machine learning based on these training examples might not generate maximum performance for diagnosing new suspicious objects.
The system and method of the present invention overcome such problems by establishing an optimal set of default values for relevant segmentation parameters of training data and these values could be applied to new suspicious objects consistently for segmentation/diagnosis. The system and method of the present invention provide a combination of machine learning and genetic algorithm techniques for suspicious object boundary determination. The idea of using machine learning (e.g. artificial neural network, Bayesian method, decision tree, etc.) is to learn from a large number of examples with ground truth (normally whether a nodule is malignant or benign) in order for the computer to predict the nature of a new suspicious object. The output of such prediction would be either benign/malignant or a likelihood of malignancy.
Assuming that the suspicious object diagnostics system has five adjustable parameters, theoretically, each possible combination of values would be tested (exhaustive approach) on the whole training dataset to see whether such segmentation could lead to a closest match between machine prediction capability and known ground truth. However, since in practice the range of parameter values is very large, it is usually impossible to run such an algorithm within a tolerable time limit. Therefore, the present invention uses genetic algorithms to reach a near optimal solution in a reasonable time.
Embodiments of the present invention provide a system and method for automated suspicious object boundary determination using machine learning and genetic algorithms. The system and method include at least one training set of suspicious object identification images, which are initially segmented using a set of randomly generated parameter values. However, parameter values may also be selected from a stored set of preferred values. The segmented suspicious object identification images are processed using image feature extraction algorithms to produce input data for a machine learning system. Subsequently, the machine learning system is tested using at least one testing set of suspicious object identification images. Performance of the machine learning system is evaluated by comparing the outputs produced during testing against known ground truths of the testing set. The performance level is determined based on the amount of difference occurring between the outputs and the ground truths and passed to the genetic algorithm to be used as a measure of the fitness of the parameter set being evaluated.
Acceptability of the performance level is determined (based on presets) and used by a genetic algorithm to decide whether to continue or halt. If the performance level is acceptable, the parameter values are set as default values for use in automatic segmentation, however, if the performance level is unacceptable, the genetic algorithm adjusts the parameter values and performs the method steps again using the adjusted parameter values in place of the previous parameter values.
The system includes a processor configured for performing the method as described above, as well as input devices (e.g., keyboard, mouse, etc), a hard drive and/or optical storage device and a display screen. Optionally, a graphical user interface may be provided. A further embodiment of the present invention may be a software application, suite of software tools, or computer executable instructions for performing the above-described method on a personal computer, workstation, server or other computing device. The
software may be stored on a computer-readable medium such as magnetic media, optical media, memory cards, and ROMs.
Additionally, the software may be executable across a network. In such a case, the software is stored on a server networked to one or more workstations. The workstations provide an operator the ability to control the software executed on the server.
These and other features, aspects, and advantages of the present invention will become better understood with regard to the following description, and accompanying drawings wherein:
FIGs. Ia and Ib are illustrations of prior art segmentation of a breast cancer suspicious object using two different sets of parameter values;
FIG. 2 is a flowchart illustrating the steps in performing an embodiment of the present invention;
FIG. 3 is an illustration of a suspicious object diagnostic system in accordance with the present invention; FIG. 4 is an illustration of an integrated medical imaging and diagnostic system in accordance with the present invention;
FIG. 5 is an image of a training example showing a malignant suspicious object for training the diagnostic system in accordance with the present invention; and
FIG. 6 is an image of a training example showing a benign suspicious object for training the diagnostic system in accordance with the present invention.
An embodiment of the present invention performs the steps as shown in FIG. 2. The process begins with step 201, wherein a set of randomly generated parameter values is selected. The set of randomly generated parameter values is utilized to perform suspicious object segmentation of a set of training examples in Step 202. The training examples, as shown in FIGs. 5 and 6, are of previously characterized suspicious objects and have corresponding ground truth records, which are used in a later step to rate performance of the suspicious object boundary determination system. The ground truths may include such information as malignancy, shape/contour of the suspicious object, etc. In step 203, the segmented suspicious objects are processed by image feature extraction algorithms. Some examples of image features that are applicable include boundary perimeter length, area of a superimposed and fitted circle or oval, roughness of boundary edge, brightness gradient, etc. In step 204, the generated features and characteristics data outputted from step 203
along with the ground truth records are entered in to a machine learning system or classifier (e.g. a neural network). The outputs from the classifier are tested on a set of testing examples (another set of suspicious objects that are segmented, and feature- extracted like the training data) in step 205. Subsequently in step 206, the testing results (predicted likelihood of malignancy) are compared with ground truth records for the set of testing examples. The actual ground truth data and the testing results are compared and the difference is treated as the performance rating (the lower the difference, the better the performance) in step 207. In step 208, it is determined whether the performance rating is acceptable based on presets. If the performance rating is deemed acceptable, then the genetic algorithm is stopped and the current set of parameter values is used as default values for automatic segmentation, along with the trained classifier that works best with it in step 209. However, if the performance rating is not acceptable, a genetic algorithm adjusts the parameters using any of several methods (e.g. mutation and crossover) in step 210 and the whole process continues from step 202. Overall the inventive method for automated suspicious object boundary determination using machine learning and at least one genetic algorithm includes the steps of providing at least one training set of suspicious object identification images, wherein the at least one training set are segmented using a set of chosen or randomly generated parameter values; and processing the segmented suspicious object identification images using image feature extraction algorithms to produce input data for a machine learning system. The method further includes the steps of testing the machine learning system using at least one testing set of suspicious object identification images and evaluating performance of the machine learning system. Outputs produced in the testing step are compared against known ground truths of the testing set (i.e. cross validation). The performance level is determined based on the number and/or sizes of differences occurring between the outputs and the ground truths. The method also includes the step of determining acceptability of the performance level based on pre-sets. If the performance level is acceptable, the genetic algorithm terminates and the parameter values are set as default values for use in automatic segmentation and the trained classifier that works with them is set. If the performance level is unacceptable, the genetic algorithm adjusts the parameter values and performs these method steps again starting at the providing step
using the adjusted parameter values in place of the previous randomly generated parameter values.
An additional embodiment of the present invention, as shown in FIG. 3, provides a computer system 300 having a processor 302, display screen 304 and input devices, such as a keyboard 306 and mouse 308. Additionally, the system 300 includes at least mass storage device 310, e.g., hard drive, CD-Rom, optical storage, etc. The system may also have a networking interface 312, such as 10/100/1000 Base-T or wireless IEEE 802.1 la/b/c.
The computer system 300 is configured to execute computer-readable instructions for performing the method as described above. The instructions may be stored on the mass storage device 310 or on a removable media readable by the mass storage device. In addition, the instructions may be downloadable from a network - either a LAN or Internet - or executable across a network.
Yet another embodiment of the present invention provides for a complete medical diagnostic system 400 as shown in FIG. 4. The medical diagnostic system 400, includes one or more medical imaging systems 402, e.g. ultrasound imaging, Magnetic Resonance • Imaging, X-Ray, etc., and the computer system 300 as described above. Such a medical diagnostic system 400 provides an integrated solution for suspicious object imaging, segmentation and diagnosis.
Overall the inventive system for automated suspicious object boundary determination utilizing a machine learning system and at least one genetic algorithm, includes at least one training set of suspicious object identification images. The at least one training set is segmented using a set of randomly generated parameter values. The system further includes at least one image feature extraction algorithm for processing the segmented suspicious object identification images to produce input data for the machine learning system; and at least one testing set of suspicious object identification images for testing outputs of the machine learning system. The at least one genetic algorithm evaluates results from the at least one testing set for determining a performance level for the machine learning system. If the performance level is acceptable, the parameter values are set as default values for use in automatic segmentation. If the performance level is unacceptable, the genetic algorithm adjusts the parameter values.
The described embodiments of the present invention are intended to be illustrative rather than restrictive, and are not intended to represent every embodiment of the present
invention. Various modifications and variations can be made without departing from the spirit or scope of the invention as set forth in the following claims both literally and in equivalents recognized in law.
Claims
1. A method for automated suspicious object boundary determination using machine learning and at least one genetic algorithm, said method comprising the steps of: providing at least one training set of suspicious object identification images, wherein said at least one training set are segmented (202) using a set of initial parameter values (201); processing said segmented suspicious object identification images using image feature extraction algorithms (203) to produce input data for a machine learning system; testing said machine learning system (205) using at least one testing set of suspicious object identification images; evaluating performance of said machine learning system (206), wherein outputs produced in said testing step are compared against known ground truths of said testing set, said performance level is determined based on the amount of difference occurring between said outputs and said ground truths; and determining acceptability of said performance (207) level based on pre-sets, said determination is performed by said at least one genetic algorithm, if said performance level is acceptable (209) said parameter values are set as default values for use in automatic segmentation, if said performance level is unacceptable (210) said genetic algorithm adjusts said parameter values and performs said method steps starting at said providing step using said adjusted parameter values in place of said randomly generated parameter values.
2. The method of Claim I3 wherein the initial parameter values (201) are randomly generated.
3. The method of Claim 1, wherein the initial parameter values (201) are generated by an operator skilled in the use of the segmentation algorithm.
4. The method of Claim 1, wherein the initial parameter values (201) are a combination of randomly generated and operator generated values.
5. The method of Claim 1, wherein said machine learning system utilizes at least one of a neural network, naϊve Bayesian classifier, Bayesian network, decision tree, support vector machine, linear or non-linear discriminant function.
6. The method of Claim 1, wherein said feature extraction algorithm is configured for extracting (203) one or more features select from the group consisting of: boundary perimeter length, area of a superimposed and fitted circle or oval, roughness of boundary edge and brightness gradient.
7. The method of Claim 1, wherein said parameter values (201) are provided for any one or more of the parameters in the group consisting of: seed point location in a region of interest (ROI), segmentation algorithm, image pre-processing, attenuation compensation, and boundary halting criteria.
8. A system for automated suspicious object boundary determination utilizing a machine learning system (300) and at least one genetic algorithm, said system comprising: at least one training set of suspicious object identification images, wherein said at least one training set is segmented using a set of initial parameter values; at least one image feature extraction algorithm for processing said segmented suspicious object identification images to produce input data for said machine learning system (300); at least one testing set of suspicious object identification images for testing outputs of said machine learning system (300); and said at least one genetic algorithm for evaluating results from said at least one testing set for determining a performance level for said machine learning system (300), if said performance level is acceptable said parameter values are set as default values for use in automatic segmentation, if said performance level is unacceptable said genetic algorithm adjusts said parameter values.
9. The system of Claim 8, wherein the initial parameter values are randomly generated.
10. The method of Claim 8, wherein the initially generated parameter values are generated by a human skilled in the use of the segmentation algorithm.
11. The method of Claim 8, wherein the initially generated parameter values are a combination of randomly generated and human generated values.
12. The system of Claim 8, wherein said machine learning system utilizes at least one of a neural network, Bayesian, and decision tree.
13. The system of Claim 8, wherein said system is retrained and retested until an acceptable performance level is obtained.
14. The system of Claim 8, wherein said feature extraction algorithm is configured for extracting one or more features select from the group consisting of: boundary perimeter length, area of a superimposed and fitted circle or oval, roughness of boundary edge and brightness gradient.
15. The system of Claim 8, further comprising a medical imaging device (402) for imaging a patient and providing said imaged data to said machine learning system (300) for subsequent segmentation and diagnosis.
16. The system of Claim 15, wherein said medical imaging device (402) is selected from a group consisting of MRI, ultrasound and X-Ray imaging systems.
17. A computer-readable medium storing a plurality of computer-executable instructions for performing automated suspicious object boundary determination, said instructions configured for performing the steps of: generating a set of initial parameter values (201); providing at least one training set of suspicious object identification images, wherein said at least one training set are segmented (202) using said set of randomly generated parameter values; processing said segmented suspicious object identification images using image feature extraction algorithms (203) to produce input data for a machine learning system (300); testing said machine learning system using at least one testing set of suspicious object identification images (205); evaluating performance of said machine learning system (300), wherein outputs produced in said testing step are compared (206) against known ground truths of said testing set, said performance level is determined (207) based on the number of differences occurring between said outputs and said ground truths; and determining acceptability of said performance level (208) based on pre-sets, said determination is performed by at least one genetic algorithm, if said performance level is acceptable said parameter values are set as default values (209) for use in automatic segmentation, if said performance level is unacceptable said at least one genetic algorithm adjusts said parameter values (210) and performs said method steps starting at said providing step using said adjusted parameter values in place of said randomly generated parameter values.
18. The computer-readable medium of Claim 17, wherein said computer-readable medium is selected from the group consisting of magnetic media, optical media, memory card and ROM.
19. The computer-readable medium of Claim 17, wherein said instructions are executable across a network.
20. A suspicious object boundary determination system using machine learning and at least one genetic algorithm, said system comprising: means for providing at least one training set of suspicious object identification images, wherein said at least one training set are segmented (202) using a set of randomly generated parameter values (201); means for processing said segmented suspicious object identification images using image feature extraction (203) algorithms to produce input data for a machine learning system (300); means for testing (205) said machine learning system (300) using at least one testing set of suspicious object identification images; means for evaluating performance of said machine learning system (300), wherein outputs produced in said testing step are compared (206) against known ground truths of said testing set, said performance level is determined (207) based on the number of differences occurring between said outputs and said ground truths; and means for determining acceptability of said performance level (208) based on pre-sets, said determination is performed by said at least one genetic algorithm, if said performance level is acceptable said parameter values are set as default values for use in automatic segmentation (209), if said performance level is unacceptable said genetic algorithm adjusts said parameter values (210) and performs said method steps starting at said providing step using said adjusted parameter values in place of said randomly generated parameter values.
21. The system of Claim 20, wherein said machine learning system (300) utilizes at least one of a neural network, Bayesian, and decision tree.
22. The system of Claim 20, wherein said system is retrained (204) and retested (205) until an acceptable performance level is obtained (209).
23. The system of Claim 20, wherein said feature extraction algorithm is configured for extracting one or more features selected from the group consisting of: boundary perimeter length, area of a superimposed and fitted circle or oval, roughness of boundary edge and brightness gradient.
24. The system of Claim 20, further comprising a means for imaging a patient (402) and providing said imaged data to said machine learning system (300) for subsequent segmentation and diagnosis.
25. The system of Claim 24, wherein said imaging means (402) is selected from a group consisting of MRI, ultrasound and X-Ray imaging systems.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US59107504P | 2004-07-26 | 2004-07-26 | |
PCT/IB2005/052445 WO2006013514A1 (en) | 2004-07-26 | 2005-07-21 | System and method for automated suspicious object boundary determination |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1774469A1 true EP1774469A1 (en) | 2007-04-18 |
Family
ID=35106636
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP05772337A Withdrawn EP1774469A1 (en) | 2004-07-26 | 2005-07-21 | System and method for automated suspicious object boundary determination |
Country Status (4)
Country | Link |
---|---|
EP (1) | EP1774469A1 (en) |
JP (1) | JP2008507372A (en) |
CN (1) | CN1989524A (en) |
WO (1) | WO2006013514A1 (en) |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101395614A (en) * | 2006-03-03 | 2009-03-25 | 皇家飞利浦电子股份有限公司 | Identifying a set of image characteristics for assessing similarity of images |
JP2008181294A (en) * | 2007-01-24 | 2008-08-07 | Sony Corp | Information processing apparatus, method and program |
JP4895204B2 (en) * | 2007-03-22 | 2012-03-14 | 富士フイルム株式会社 | Image component separation device, method, and program, and normal image generation device, method, and program |
JP5643284B2 (en) * | 2009-03-20 | 2014-12-17 | ウォーターピック,インコーポレイティド | Oral irrigator with bactericidal action by radiant energy delivery |
US8700549B2 (en) | 2012-05-23 | 2014-04-15 | King Fahd University Of Petroleum And Minerals | Method of predicting gas composition |
US8781202B2 (en) * | 2012-07-26 | 2014-07-15 | International Business Machines Corporation | Tumor classification based on an analysis of a related ultrasonic attenuation map |
CN103325123A (en) * | 2013-07-09 | 2013-09-25 | 江南大学 | Image edge detection method based on self-adaptive neural fuzzy inference systems |
WO2016059385A1 (en) * | 2014-10-17 | 2016-04-21 | University College Cardiff Consultants Limited | A method for optimising segmentation of a tumour on an image, and apparatus therefor |
CN108369196A (en) * | 2015-10-12 | 2018-08-03 | Mm(英国)有限公司 | Food properties MRI detecting systems |
JP6631641B2 (en) | 2016-01-20 | 2020-01-15 | 富士通株式会社 | Image processing apparatus, image processing method, and image processing program |
US10127659B2 (en) * | 2016-11-23 | 2018-11-13 | General Electric Company | Deep learning medical systems and methods for image acquisition |
CN108389187A (en) * | 2018-01-30 | 2018-08-10 | 李家菊 | Image department image-recognizing method based on convolutional neural networks method and support vector machines method |
JP7192854B2 (en) | 2018-03-28 | 2022-12-20 | ソニーグループ株式会社 | Arithmetic device, arithmetic method, program and discrimination system |
CN111493903B (en) * | 2019-01-30 | 2024-02-13 | 上海西门子医疗器械有限公司 | Organ program automatic selection method, storage medium, and X-ray medical apparatus |
Family Cites Families (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5048095A (en) * | 1990-03-30 | 1991-09-10 | Honeywell Inc. | Adaptive image segmentation system |
US5999639A (en) * | 1997-09-04 | 1999-12-07 | Qualia Computing, Inc. | Method and system for automated detection of clustered microcalcifications from digital mammograms |
IL134557A0 (en) * | 1997-08-28 | 2001-04-30 | Qualia Computing Inc | Method and system for automated detection of clustered microcalcifications from digital mammograms |
JP2873955B1 (en) * | 1998-01-23 | 1999-03-24 | 東京工業大学長 | Image processing method and apparatus |
US7058210B2 (en) * | 2001-11-20 | 2006-06-06 | General Electric Company | Method and system for lung disease detection |
JP3642059B2 (en) * | 2002-09-06 | 2005-04-27 | 独立行政法人理化学研究所 | Contour data extraction method and apparatus for biological tomographic image |
-
2005
- 2005-07-21 WO PCT/IB2005/052445 patent/WO2006013514A1/en active Application Filing
- 2005-07-21 EP EP05772337A patent/EP1774469A1/en not_active Withdrawn
- 2005-07-21 CN CNA2005800251047A patent/CN1989524A/en active Pending
- 2005-07-21 JP JP2007523213A patent/JP2008507372A/en active Pending
Non-Patent Citations (1)
Title |
---|
See references of WO2006013514A1 * |
Also Published As
Publication number | Publication date |
---|---|
WO2006013514A1 (en) | 2006-02-09 |
JP2008507372A (en) | 2008-03-13 |
CN1989524A (en) | 2007-06-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20080097942A1 (en) | System and Method for Automated Suspicious Object Boundary Determination | |
WO2006013514A1 (en) | System and method for automated suspicious object boundary determination | |
US7593561B2 (en) | Computer-aided detection of microcalcification clusters | |
CN107480677B (en) | Method and device for identifying interest region in three-dimensional CT image | |
JP4949264B2 (en) | System and method for automatically detecting and segmenting tumor boundaries in medical image data | |
US20110172514A1 (en) | Method for increasing the robustness of computer-aided diagnosis to image processing uncertainties | |
US20130243244A1 (en) | Apparatus, Method, and Computer Program Product for Medical Diagnostic Imaging Assistance | |
US9014456B2 (en) | Computer aided diagnostic system incorporating appearance analysis for diagnosing malignant lung nodules | |
WO2011008906A1 (en) | Computer-aided detection (cad) of intracranial aneurysms | |
KR20150073628A (en) | System and method for adapting diagnosis model of computer aided diagnosis | |
CN111128348A (en) | Medical image processing method, device, storage medium and computer equipment | |
CN117174257B (en) | Medical image processing device, electronic apparatus, and computer-readable storage medium | |
CN101847260B (en) | Image processing apparatus, and image processing method | |
EP3977400A1 (en) | A computer based method for classifying a mass of an organ as a cyst | |
Pamula Pullaiah et al. | Detection of Breast Cancer on Magnetic Resonance Imaging Using Hybrid Feature Extraction and Deep Neural Network Techniques. | |
US12051195B2 (en) | Method and system to assess medical images for suitability in clinical interpretation | |
Wijerathna et al. | Brain Tumor Detection Using Image Processing | |
Zaki et al. | Qualitative and quantitative comparisons of haemorrhage intracranial segmentation in CT brain images | |
CN113870194A (en) | Deep layer characteristic and superficial layer LBP characteristic fused breast tumor ultrasonic image processing device | |
KR101856200B1 (en) | Method for classifying a skull feature | |
KR102516949B1 (en) | Method and apparatus for determining density values for specific tissues of the head and neck based on artificial intelligence | |
Kaftan et al. | Locally adaptive fuzzy pulmonary vessel segmentation in contrast enhanced CT data | |
US11721022B2 (en) | Apparatus and method for automated analyses of ultrasound images | |
JP2023057036A (en) | Device and method for processing medical image | |
Mencattini et al. | Uncertainty propagation for the assessment of tumoral masses segmentation |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
17P | Request for examination filed |
Effective date: 20070226 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
17Q | First examination report despatched |
Effective date: 20070709 |
|
DAX | Request for extension of the european patent (deleted) | ||
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20100202 |