EP2313848A1 - Methods for enhancing vascular patterns in cervical imagery - Google Patents

Methods for enhancing vascular patterns in cervical imagery

Info

Publication number
EP2313848A1
EP2313848A1 EP08795361A EP08795361A EP2313848A1 EP 2313848 A1 EP2313848 A1 EP 2313848A1 EP 08795361 A EP08795361 A EP 08795361A EP 08795361 A EP08795361 A EP 08795361A EP 2313848 A1 EP2313848 A1 EP 2313848A1
Authority
EP
European Patent Office
Prior art keywords
image
areas
enhancement
contrast
intensity
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Withdrawn
Application number
EP08795361A
Other languages
German (de)
French (fr)
Other versions
EP2313848A4 (en
Inventor
Wenjing Li
Sankar Venkataraman
Ulf Peter Gustafsson
John Taylor Hargrove
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
STI Medical Systems LLC
Original Assignee
STI Medical Systems LLC
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by STI Medical Systems LLC filed Critical STI Medical Systems LLC
Publication of EP2313848A1 publication Critical patent/EP2313848A1/en
Publication of EP2313848A4 publication Critical patent/EP2313848A4/en
Withdrawn legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/90Dynamic range modification of images or parts thereof
    • G06T5/94Dynamic range modification of images or parts thereof based on local image properties, e.g. for local contrast enhancement
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/20Image enhancement or restoration using local operators
    • G06T5/30Erosion or dilatation, e.g. thinning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20036Morphological image processing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20092Interactive image processing based on input by user
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20221Image fusion; Image merging
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20212Image combination
    • G06T2207/20224Image subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30101Blood vessel; Artery; Vein; Vascular

Definitions

  • This invention generally relates to medical imaging and image enhancement. This invention relates more specifically to computer aided detection and/ or diagnosis of uterine cervical cancer and pre-cancerous lesions.
  • a colposcopic examination involves a systematic visual evaluation of the lower genital tract (cervix, vulva, and vagina) with the purpose of identifying and ranking the severity of lesions, so that biopsies representing the highest-grade abnormality can be taken, if necessary.
  • visualization enhancement techniques are employed in medical imaging to improve the identification of diagnostically significant tissue structures.
  • different colored filters are used to accentuate blood vessel patterns that cannot be easily seen by using regular white light.
  • a green filter is commonly used and blocks all light except green light and allows for the increased visualization of cervical blood vessel patterns.
  • the implementation of the green filter visual enhancement is commonly accomplished by filtering the standard white light by placing a green-colored optical filter at the output end of the light source, i.e. illuminating the cervix with green light, or by placing a green-colored filter between the cervix and the colposcope detection optics, i.e. filtering the reflected white light before being detected, either visually by the operator or electronically with an imaging sensor.
  • a green-colored optical filter at the output end of the light source, i.e. illuminating the cervix with green light
  • a green-colored filter between the cervix and the colposcope detection optics i.e. filtering the reflected white light before being detected, either visually by the operator or electronically with an imaging sensor.
  • Mathematical morphology is a technique for the analysis and processing of geometrical structures and has been used, as related to the current invention, in the automated analysis of vessels from angiograms (K. Sun and N. Sang, Enhancement of vascular angiogram by multiscale morphology, in Bioinformatics and Biomedical Engineering, 1311-1313 (2007), incorporated herein by reference), micro-calcification analysis from mammograms (Wirth, M., Fraschini, M., and Lyon, J., Contrast enhancement of microcalcifications in mammograms using morphological enhancement and non-flat structuring elements, Proc. 17* IEEE Symposium on Computer-Based Medical Systems, (2008), incorporated herein by reference) and brain magnetic resonance imaging (J.D.
  • the algorithm approach can be applied to the standard white light image, providing an image display that is more pleasingly to the human eye.
  • image pre-processing steps can be performed to further improve the visualization enhancement.
  • One such step would be to segment the images into different regions and apply the visualization enhancement to some of these regions only; for example, only those regions with a high likelihood of finding pre-cancerous or cancerous lesions.
  • Applying a visual enhancement algorithm as described in the current invention to uterine cervical images can provide the physician with increased visualization of blood vessel patterns that are sometimes difficult to detect by the naked eye. Such an algorithm could assist the physician in the identification of diagnostically important structures and provide important information in the diagnostic process.
  • US Patent Number 6,147,705 to Rrauter et al discloses a video colposcope which includes a system microcomputer having algorithms for color balance levels stored into memory.
  • a video camera obtains a subject electronic image of a subject object, and using algorithm-driven digital signal processing circuitry (DSP), color saturation, hue, and intensity levels of the subject electronic image are modified according to previously stored DSP reference filter algorithms and reference color balance levels, thus producing a modified electronic image corresponding to the subject electronic image.
  • DSP digital signal processing circuitry
  • the modified electronic image is outputted to a display in continuous real time as the corresponding subject image is obtained by the video camera.
  • This modified electronic image emulates that obtained through an optical green filter and incorporates a simulated white balance.
  • US Patent Number 6,277,067 to Blair discloses a method and portable apparatus for the visual examination and grading of cervical epithelium by means of a hand-held colposcope assembly capable of producing a digital image of the cervix.
  • This invention enables realtime imaging and archiving of the entire cervix for the purpose of detecting cancerous and pre-cancerous tissue and by virtue of computerized image processing to suggest an objective diagnosis of the cervical epithelium by means of a low cost, portable, hand-held digital colposcope.
  • US Patent Number 6,032,070 to Flock et al. discloses a system and method to view an anatomical structure such as blood vessels in high contrast with its surrounding tissue.
  • the system and method is used to produce an image of an anatomical structure using reflected electromagnetic radiation singularly scattered from target tissue.
  • the system and method also provide same-side illumination and detection of reflected electromagnetic radiation in a convenient integral imaging device.
  • the system and method also provides helmet mounted imaging technology in a single integral helmet which allows the wearer to view an anatomical structure located within a patient such that the image is continuously orientated according to the orientation to the helmet wearer's head.
  • the system and method is also used in the performance of venipuncture.
  • the system and method provide improved contrast between any anatomical structure and its surrounding tissue for use in any imaging system.
  • US Patent Number 7,305,111 to Arimura et al. discloses a method, system, and computer program product for detecting at least one nodule in a medical image of a subject, including identifying, in the medical image, an anatomical region corresponding to at least a portion of an organ of interest; filtering the medical image to obtain a difference image; detecting, in the differenced image, a first plurality of nodule candidates within the anatomical region, calculating respective nodule feature values of the first plurality of nodule candidates from the first plurality based on pixel values of at least one of the medical images and the differenced image; removing false positive nodule candidates from the first plurality of nodule candidates based on the respective nodule feature values to obtain a second plurality of nodule candidates; and determining the at least one nodule by classifying each of the second plurality of nodule candidates as a nodule or a non-nodule based on at least one of the pixel values
  • the method includes: acquiring, using a first imaging modality, a first medical image that includes the anatomical structure; applying the first medical image to a trained image processing device to obtain a second medical image, corresponding to the first medical image in which the appearance of the anatomical structure is modified; and outputting the second medical image.
  • the image processing device is trained using plural teacher images obtained from a second imaging modality that is different from the first imaging modality.
  • the method also includes processing the first medical image to obtain plural processed images, wherein each of the plural processed images has a corresponding image resolution; applying the plural processed images to respective multi-training artificial neural networks (MTANNs) to obtain plural output images, wherein each MTANN is trained to detect the anatomical structure at one of the corresponding image resolutions; and combining the plural output images to obtain a second medical image in which the appearance of the anatomical structure is enhanced.
  • MTANNs multi-training artificial neural networks
  • US Patent Application Number 2006/0018548 to Chen et al. discloses a method, system, and computer software product for analyzing medical images, including obtaining image data representative of a plurality of medical images of the abnormality, each medical image corresponding to an image of the abnormality acquired at a different time relative to a time of administration of a contrast medium, each medical image including a predetermined number of voxels; partitioning each medical image into at least two groups based on the obtained image data, wherein each group corresponds to a subset of the predetermined number of voxels, and each group is associated with a temporal image pattern in the plurality of medical images; selecting, from among the temporal patterns, an enhancement temporal pattern as representative of the abnormality; and determining, based on the selected temporal pattern, a medical state of the abnormality.
  • US Patent Application Number 2006/0147101 to Zhang et al. discloses a method for computer-aided detection of microcalcification clusters that obtains digital mammography data for a single view image and normalizes and filters the image data to reduce noise.
  • a first mask is generated and applied to the image data for defining the breast structure, forming a first cropped image.
  • a second mask is generated and applied to the image data for defining muscle structure, forming a second cropped image.
  • An artifact mask corresponding to vascular calcifications and known imaging artifacts is generated and applied to the first and second cropped images, defining first and second artifact-masked cropped images.
  • inversion pulses are successively applied to the imaged slice and the slab orthogonal to the imaging plane, with the thickness equal to the FOV size in the phase-encoding direction.
  • Each double-inversion results in a reinversion of the magnetization in a central part of the FOV, while outer areas of the FOV and inflowing blood remain inverted.
  • the SFQIR module was implemented for single-slice and multislice acquisition with a fast spin-echo readout sequence. Timing parameters of the sequence corresponding to the maximal suppression efficiency can be found by minimizing variation of the normalized signal over the entire range of T. sub.1 occurring in tissues.
  • US Patent Application Number 2007/0165921 to Agam et al. discloses a method for improving a thoracic diagnostic image for the detection of nodules.
  • Non-lung regions are removed from the diagnostic image to provide a lung image.
  • Vessels and vessel junctions of the lung(s) in the lung image are enhanced according to a first-order partial derivative of each of a plurality of voxels of the lung image.
  • a vessel tree representation is constructed from the enhanced vessels and vessel junctions. The vessel tree representation can be subtracted from the lung image to enhance the visibility of nodules in the lung(s).
  • IVUS intravascular ultrasound
  • New catheter designs including contrast agent introduction subsystems and/ or Doppler subsystems are disclosed.
  • Methods for acquiring and analyzing Doppler data from intravascular ultrasound (IVUS) catheters are disclosed.
  • RF-based detection of blood and/ or contrast agents such as micro-bubbles are disclosed.
  • Methods for frame-grating image data analysis permitting frame registration before, during and after a contrasting effect is imposed on a system being imaged are disclosed.
  • Methods for difference imaging for contrast detection are disclosed.
  • Methods for quantification and visualization of IVUS data are disclosed. And methods for IVUS imaging are disclosed.
  • US Patent Application Number to Shen et al. discloses a method and system for automatically detecting rib metastasis in a thoracic CT volume.
  • the ribs are segmented in said CT volume by recursive tracing.
  • a series of cross-sectional images are then generated along a centerline of each rib.
  • Cortical and trabecular bone structures are segmented in each of the cross-sectional images for each rib.
  • Features are calculated for each cross-sectional image based on characteristics of the cortical and trabecular bone structures, and alterations are detected in the cross-sectional images based on the features.
  • Rib metastasis is detected in a rib when an alteration is detected in a number of consecutive cross-sectional images along the centerline of the rib.
  • the presently preferred embodiment of the present invention comprises identifying a texture region in an image having blood vessel structures; detecting high intensity areas and low intensity areas in the texture region; and controllably variably increasing contrast between the high intensity areas and the low intensity areas without introducing unacceptable unwanted noise, by using a tuning parameter to controllably variably add the high intensity areas to the texture region and subtract the low intensity areas from the texture region, so that visualization of the blood vessel patterns is controllably variably enhanced.
  • the invention comprises a method of image contrast enhancement for increased visualization of blood vessel structures by identifying a texture region with high likelihood of presence of disease, applying mathematical morphology operations to detect high and low intensity (brightness) areas within the texture region, and calculating a contrast enhanced image by combining the result of the texture region identification, morphological operations and a tuning parameter.
  • the texture region is identified in the original image by determining areas within the image with high variations in intensity.
  • areas of high and low intensity within the texture region are identified using mathematical mo ⁇ hology operations.
  • variable amounts, determined by a selectable tuning parameter, of the high intensity areas are added, and the low intensity areas are subtracted, from the texture region of the original image, producing images with controllably variable visualization enhancement of blood vessel structures.
  • FIG 1 shows a flowchart of the visualization enhancement method
  • FIG 2 (a) shows an image of the cervix and FIG 2 (b) shows the identified texture region of the cervix;
  • FIG 3 (a) shows the original cervical image
  • FIG 3 (b) displays a magnified region (indicated by a square in FIG 3 (a)) of the original image without contrast enhancement
  • FIGS 3 (c), 3 (d) and 3 (e) show the result of the blood vessel structure enhancement with the tuning parameter, ⁇ , set to 0, 0.5, and 1.0, respectively.
  • the presently preferred embodiment of the invention provides a method which increases and controllably varies the contrast between small blood vessel patterns and the surrounding tissue, without introducing artifacts (noise) in images of the uterine cervix, and as such provides a means to enhance the visualization of said blood vessel patterns.
  • a flowchart of the presently preferred embodiment of the invention is shown in FIG 1. The steps of the presently preferred method are described in more detail below. 1. Texture Region Identification
  • the visualization (contrast) enhancement method starts with an image of an organ or tissue (such as the cervix) (designated I).
  • a segmentation step is applied to the image in which the texture region of the cervix is identified.
  • Texture analysis refers to the characterization of regions in an image by their texture. Texture analysis attempts to quantify rough, smooth, silky, or bumpy as a function of the spatial intensity variations in the image (the spatial extent of variations in brightness (or intensity) of the image, preferably measured by using variations in brightness in a black and white version of the image, or "grayscale").
  • roughness or bumpiness can be understood as the spatial extent of variations in intensity values, or gray levels, in a black and white version of the image.
  • the texture region is referred to as the region which is rich in texture content or, in other words, has high variations in intensity (instead of being smooth in intensity).
  • the cervical texture region is associated with both diseased findings, such as abnormal blood vessel structures, and normal findings, such as immature metaplasia. If cervical blood vessel patterns are not located within these fields of rich texture, pre-cancerous lesions are less likely. Thus, by detecting the texture regions, and only applying the enhancement algorithm to these areas, only blood vessel patterns associated with precancerous or cancerous lesions will be visually enhanced.
  • This invention provides the means for controllable contrast enhancement and, with segmentation, controllable local contrast enhancement.
  • the preferred texture region identification used in the present invention is based on the work presented by Li et al (W. Li, J. Gu, D. Ferris, and A. Poirson, Automated image analysis of uterine cervical images, Proc. OfSPIE 6414, 65142P1-65142P9 (2007), incorporated herein by reference) which utilizes parts of a technique presented by Forstner (Forstner, W., A framework for low level feature extraction, in Proc. of European Conference on Computer Vision, 383-394 (1994), incorporated herein by reference), Grading et al (Grading, J.
  • the texture region analysis method determines the texture contrast (i.e. intensity variations) in the image, and separates the image into areas of high and low texture.
  • the high texture areas are clustered in one region, which defines the texture region in the cervical image.
  • the texture region which is a sub-part of the entire cervical image, I, is designated /, practice, convention, «..
  • FIG 2 (a) shows an image of the cervix
  • FIG 2 (b) shows the texture region identified using the method described above.
  • detecting the texture region is the preferred method of the current invention, it is not a pre-requisite for the following steps.
  • the entire image of the cervix can just as well be used in the following steps.
  • the step following optional detection of the texture region preferably uses operations based on mathematical morphology (J. Serra, Image Analysis and Mathematical Morphology, Academic Press, New York, 1982, incorporated herein by reference).
  • Mathematical morphology is a technique for the analysis and processing of geometrical structures, such as blood vessel patterns, using a few simple mathematical concepts from set theory (which is a branch of mathematics that studies the collections of objects).
  • the basic idea in mathematical morphology is to compare the structures in an image against a so- called structuring element having a simple pre-defined shape, and drawing conclusions on how this shape fits or misses the structures in the image.
  • Commonly used structuring elements in mathematical morphology include, but are not limited to, disk shape, box shape, and diamond shape.
  • Mathematical morphology is commonly applied to digital images, and includes edge detection, noise removal, image enhancement and image segmentation.
  • the preferred morphology methods used in the present invention are the top-hat and bottom-hat filters (P. Soille, A note on morphological contrast enhancement, Technical Report concluded ijk des Mines d'Ales-EERIE (1997), incorporated herein by reference; F. Meyer, Iterative image transformations for an automatic screening of cervical smears, The Journal of Histochemistry and Cytochemistry, The Histochemical Society, 128-135 (1979), incorporated herein by reference).
  • the top-hat filter captures high intensity (bright) areas in an image.
  • the top-hat filter is based on neighborhood ranking and uses the ranked value from two different sized areas.
  • the brightest value in an area defined by a sliding window is compared to the brightest value in a surrounding annular (ring-shaped) area. If the brightness difFerence exceeds a threshold value (typically defined as the average brightness of the surrounding area), the area is defined as a bright area.
  • a threshold value typically defined as the average brightness of the surrounding area
  • the output of the top-hat filter defines the high brightness areas in the image and is designated
  • a bottom-hat filter can be used to capture low intensity (dark) areas, such as the blood vessel structures.
  • the size of the sliding window preferably a disk shaped structuring element
  • the output of the bottom-hat filter defines the low intensity (darker) areas in the image and is designated BH(I textur J.
  • the final step in the preferred embodiment of the current invention combines the information from the previous steps in order to improve the local contrast of the image by enhancing the contrast between blood vessel structures and the surrounding tissue.
  • One preferred method is low intensity based contrast enhancement which involves subtracting the low intensity areas from the original image and by doing so, increasing the contrast between the low intensity areas and their surroundings (K. Sun and N. Sang, Enhancement of vascular angiogram by multiscale morphology, in Bioinformatics and Biomedical Engineering, 1311-1313 (2007), incorporated herein by reference).
  • Another preferred method is high intensity contrast enhancement which involves adding the output from the top-hat operation (the high intensity areas) and subtracting the bottom-hat output (the low intensity areas) from the original image.
  • I enHancC U ,, ⁇ e + ⁇ TH ⁇ I ⁇ J]- BH ⁇ I ⁇ ) (1) to create an enhanced image;
  • I mhanC ede
  • the controllably variable tuning parameter, a has values controllably selectable between 0 and 1, and provides a means for variable visualization (contrast) enhancement similar to different filter characteristics. From Equation (1), we can see that the tuning parameter preferably only controls the output of the top hat filter and therefore only controls contrast enhancement of the high intensity (brightness) areas, and does not control the output of the bottom hat filter (the contrast enhancement of the low intensity (brightness) areas).
  • a value of a 0 means that no high intensity based contrast enhancement is applied which, as described above, has the effect of only subtracting the low intensity areas from the original image and by doing so only increases the contrast of the low intensity areas from their surroundings.
  • a value of a 1 adds the full output from the top-hat filter and subtracts the bottom-hat output from the original image which, as described above, stretches both the high intensity areas toward increased intensity and low intensity areas towards decreased intensity, thereby applying maximum contrast enhancement.
  • a value of the 0 ⁇ a ⁇ 1 provides (in addition to variable contrast enhancement) a means of controlling the amount of unwanted noise generated in the enhanced image.
  • the reason for this behavior is a consequence of the properties (statistical variations) of light. For example, noise in detected signals increases with the intensity of the light.
  • a controllably variable visualization enhancement will also provide the user the opportunity to fine tune the amount of contrast enhancement to his or her personal preference.
  • FIG 3 shows the original cervical image and FIG 3 (b) displays a magnified region of the original image without contrast enhancement.
  • FIG 3 (c), Fig 3(d), and Fig. 3(e) show the results of the contrast enhancement with the tuning parameter, a, set to 0, 0.5, and 1.0, respectively, clearly demonstrating the increased visualization of the blood vessel structure.
  • This invention provides visualization enhancement and is not limited to blood vessels or the cervix.
  • the contrast enhancement method may also be suitable for other tissue diagnosis instruments and for any other methods that require variable adjustment of contrast.

Landscapes

  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Apparatus For Radiation Diagnosis (AREA)
  • Image Processing (AREA)
  • Endoscopes (AREA)

Abstract

A method of contrast enhancement for improved visualization of diagnostically important tissue structures, such as blood vessels. A texture analysis algorithm is applied to identify regions with a high likelihood of disease. Mathematical morphology operations are applied to identify areas of high and low brightness (intensity). The low intensity areas are then subtracted, and controllably variable amounts of the high intensity areas are added, controlled by a selectable tuning parameter, to produce an image with controllably variable visualization enhancement.

Description

Description Methods for Enhancing Vascαlar Patterns in Cervical Imagery
TECHNICAL FIELD.
This invention generally relates to medical imaging and image enhancement. This invention relates more specifically to computer aided detection and/ or diagnosis of uterine cervical cancer and pre-cancerous lesions.
BACKGROUND^ ART.
Although this invention is being disclosed in connection with cervical cancer, it is applicable to many other areas of medicine. Visual inspection is common practice in the field of medicine to detect and/ or diagnose a disease. For example, a colposcopic examination involves a systematic visual evaluation of the lower genital tract (cervix, vulva, and vagina) with the purpose of identifying and ranking the severity of lesions, so that biopsies representing the highest-grade abnormality can be taken, if necessary. At times, visualization enhancement techniques are employed in medical imaging to improve the identification of diagnostically significant tissue structures. In colposcopy, different colored filters are used to accentuate blood vessel patterns that cannot be easily seen by using regular white light. A green filter is commonly used and blocks all light except green light and allows for the increased visualization of cervical blood vessel patterns. Three different abnormal blood vessel patterns can be distinguished during a colposcopic exam: mosaic, punctation and atypical; all of which are major diagnostic features in the identification of pre-cancerous regions of the cervix (Reid, R., Herschman, B.R., Crum, C.P., Fu, Y.S., Braun, L., Shah, K.V. et al, Genital warts and cervical cancer. V. The tissue basis of colposcopic change, Am. J. Obstet. Gynecol. 149(3): 293-303. 1984, incorporated herein by reference; Reid, R. and Scalzi, P., Genital warts and cervical cancer. VII. An improved colposcopic index for differentiating benign papillomaviral infections from high-grade cervical intraepithelial neoplasia, Am. J. Obstet. Gynecol. 153(6): 611-618. 1985, incorporated herein by reference; D. G. Ferris, J. T. Cox, D. M. O'Connor, V. C. Wright, and J. Foerster, Modem Colposcopy. Textbook and Atlas, pp. 1-699, American Society for Colposcopy and Cervical Pathology, 2004, incorporated herein by reference)
The implementation of the green filter visual enhancement is commonly accomplished by filtering the standard white light by placing a green-colored optical filter at the output end of the light source, i.e. illuminating the cervix with green light, or by placing a green-colored filter between the cervix and the colposcope detection optics, i.e. filtering the reflected white light before being detected, either visually by the operator or electronically with an imaging sensor. These approaches have a number of drawbacks: First, the use of colored filters reduces the amount of light available and could result in a decrease in image quality. Second, colored filters add cost and mechanical complexity in that a filter assembly must be incorporated which allows for both standard white light and green filtered light during the colposcopic exam. Third, colored filters are limited to the colors of the filters.
In digital colposcopy, in which images or videos of the cervix are electronically captured using a light sensitive imaging sensor and displayed on an external monitor, other visualization enhancement techniques can be employed. The current invention applies image algorithms in the form of mathematical morphology operations in order to enhance the contrast between the cervical blood vessel patterns and the surrounding tissue, and as such provides a non-physical implementation for the increased visualization of blood vessel structures, similar to the effect of using an optical green filter.
Mathematical morphology is a technique for the analysis and processing of geometrical structures and has been used, as related to the current invention, in the automated analysis of vessels from angiograms (K. Sun and N. Sang, Enhancement of vascular angiogram by multiscale morphology, in Bioinformatics and Biomedical Engineering, 1311-1313 (2007), incorporated herein by reference), micro-calcification analysis from mammograms (Wirth, M., Fraschini, M., and Lyon, J., Contrast enhancement of microcalcifications in mammograms using morphological enhancement and non-flat structuring elements, Proc. 17* IEEE Symposium on Computer-Based Medical Systems, (2008), incorporated herein by reference) and brain magnetic resonance imaging (J.D. Mendiola-Santibanez, LR. Terol-Villalobos, G. Herrera-Ruiz, and A. Fernandez-Bouzas, Morphological contrast measure and contrast enhancement: One application to the segmentation of brain MRI, Signal Processing 87, (2008), incorporated herein by reference). By implementing the visualization enhancement as an algorithm applied to an image of the cervix offers several advantages compared to the optical green filter approach. First, the algorithm approach will not reduce the amount of light and will maintain the image quality of the captured images or videos. Second, no incremental cost or mechanical complexity is added. Third, the algorithm implementation can provide the capabilities of variable visualization enhancements similar to different filter characteristics (such as color) by changing one or several algorithm parameters. Fourth, the algorithm approach can be applied to the standard white light image, providing an image display that is more pleasingly to the human eye. Fifth, image pre-processing steps can be performed to further improve the visualization enhancement. One such step would be to segment the images into different regions and apply the visualization enhancement to some of these regions only; for example, only those regions with a high likelihood of finding pre-cancerous or cancerous lesions. Applying a visual enhancement algorithm as described in the current invention to uterine cervical images can provide the physician with increased visualization of blood vessel patterns that are sometimes difficult to detect by the naked eye. Such an algorithm could assist the physician in the identification of diagnostically important structures and provide important information in the diagnostic process.
Although many of the algorithms described in the present invention are well-known in the art, the inventors are unaware of another contrast enhancement method combining a pre-processing step to identify regions with high likelihood of disease, a mathematical morphology step to identify high and low intensity regions, and applying a tuning parameter for variable visualization enhancements, all as described later, which achieves unexpectedly better results.
The following patents and patent applications may be considered relevant to the field of the invention: US Patent Number 6,147,705 to Rrauter et al, incorporated herein by reference, discloses a video colposcope which includes a system microcomputer having algorithms for color balance levels stored into memory. A video camera obtains a subject electronic image of a subject object, and using algorithm-driven digital signal processing circuitry (DSP), color saturation, hue, and intensity levels of the subject electronic image are modified according to previously stored DSP reference filter algorithms and reference color balance levels, thus producing a modified electronic image corresponding to the subject electronic image. The modified electronic image is outputted to a display in continuous real time as the corresponding subject image is obtained by the video camera. This modified electronic image emulates that obtained through an optical green filter and incorporates a simulated white balance.
US Patent Number 6,277,067 to Blair, incorporated herein by reference, discloses a method and portable apparatus for the visual examination and grading of cervical epithelium by means of a hand-held colposcope assembly capable of producing a digital image of the cervix. This invention enables realtime imaging and archiving of the entire cervix for the purpose of detecting cancerous and pre-cancerous tissue and by virtue of computerized image processing to suggest an objective diagnosis of the cervical epithelium by means of a low cost, portable, hand-held digital colposcope.
US Patent Number 6,032,070 to Flock et al., incorporated herein by reference, discloses a system and method to view an anatomical structure such as blood vessels in high contrast with its surrounding tissue. The system and method is used to produce an image of an anatomical structure using reflected electromagnetic radiation singularly scattered from target tissue. The system and method also provide same-side illumination and detection of reflected electromagnetic radiation in a convenient integral imaging device. The system and method also provides helmet mounted imaging technology in a single integral helmet which allows the wearer to view an anatomical structure located within a patient such that the image is continuously orientated according to the orientation to the helmet wearer's head. The system and method is also used in the performance of venipuncture. The system and method provide improved contrast between any anatomical structure and its surrounding tissue for use in any imaging system.
US Patent Number 7,305,111 to Arimura et al., incorporated herein by reference, discloses a method, system, and computer program product for detecting at least one nodule in a medical image of a subject, including identifying, in the medical image, an anatomical region corresponding to at least a portion of an organ of interest; filtering the medical image to obtain a difference image; detecting, in the differenced image, a first plurality of nodule candidates within the anatomical region, calculating respective nodule feature values of the first plurality of nodule candidates from the first plurality based on pixel values of at least one of the medical images and the differenced image; removing false positive nodule candidates from the first plurality of nodule candidates based on the respective nodule feature values to obtain a second plurality of nodule candidates; and determining the at least one nodule by classifying each of the second plurality of nodule candidates as a nodule or a non-nodule based on at least one of the pixel values and the respective nodule feature value. True-positive nodules are identified using linear discriminant analysis and/or a MultiMTANN.
US Patent Application Number 2005/0100208 to Susuki et al,. incorporated herein by reference, discloses a method, system, and computer program product for modifying an appearance of an anatomical structure in a medical image, e.g., rib suppression in a chest radiograph. The method includes: acquiring, using a first imaging modality, a first medical image that includes the anatomical structure; applying the first medical image to a trained image processing device to obtain a second medical image, corresponding to the first medical image in which the appearance of the anatomical structure is modified; and outputting the second medical image. Further, the image processing device is trained using plural teacher images obtained from a second imaging modality that is different from the first imaging modality. In one embodiment, the method also includes processing the first medical image to obtain plural processed images, wherein each of the plural processed images has a corresponding image resolution; applying the plural processed images to respective multi-training artificial neural networks (MTANNs) to obtain plural output images, wherein each MTANN is trained to detect the anatomical structure at one of the corresponding image resolutions; and combining the plural output images to obtain a second medical image in which the appearance of the anatomical structure is enhanced. US Patent Application Number 2006/0018548 to Chen et al., incorporated herein by reference, discloses a method, system, and computer software product for analyzing medical images, including obtaining image data representative of a plurality of medical images of the abnormality, each medical image corresponding to an image of the abnormality acquired at a different time relative to a time of administration of a contrast medium, each medical image including a predetermined number of voxels; partitioning each medical image into at least two groups based on the obtained image data, wherein each group corresponds to a subset of the predetermined number of voxels, and each group is associated with a temporal image pattern in the plurality of medical images; selecting, from among the temporal patterns, an enhancement temporal pattern as representative of the abnormality; and determining, based on the selected temporal pattern, a medical state of the abnormality.
US Patent Application Number 2006/0147101 to Zhang et al., incorporated herein by reference, discloses a method for computer-aided detection of microcalcification clusters that obtains digital mammography data for a single view image and normalizes and filters the image data to reduce noise. A first mask is generated and applied to the image data for defining the breast structure, forming a first cropped image. A second mask is generated and applied to the image data for defining muscle structure, forming a second cropped image. An artifact mask corresponding to vascular calcifications and known imaging artifacts is generated and applied to the first and second cropped images, defining first and second artifact-masked cropped images. In a repeated sequence, portions of each artifact-masked cropped image are processed using an enhancement algorithm and reducing edge effects to obtain a set of microcalcification cluster candidates and suspected microcalcification clusters. Image processing algorithms remove false positives from the listing of microcalcification clusters and classify candidate microcalcification clusters to identify true positives. US Patent Application Number 2006/0184002 to Yarnykh et al., incorporated herein by reference, discloses a reduced field-of-view (FOV) imaging technique that combines suppression of signals from outer volume and inflowing blood. Both outer volume and blood suppression are achieved using an SFQIR (Small-FOV Quadruple-inversion-Recovery) preparative pulse sequence including two double-inversion pulse pairs separated by appropriate delays. Within each pair, inversion pulses are successively applied to the imaged slice and the slab orthogonal to the imaging plane, with the thickness equal to the FOV size in the phase-encoding direction. Each double-inversion results in a reinversion of the magnetization in a central part of the FOV, while outer areas of the FOV and inflowing blood remain inverted. The SFQIR module was implemented for single-slice and multislice acquisition with a fast spin-echo readout sequence. Timing parameters of the sequence corresponding to the maximal suppression efficiency can be found by minimizing variation of the normalized signal over the entire range of T. sub.1 occurring in tissues. US Patent Application Number 2007/0165921 to Agam et al., incorporated herein by reference, discloses a method for improving a thoracic diagnostic image for the detection of nodules. Non-lung regions are removed from the diagnostic image to provide a lung image. Vessels and vessel junctions of the lung(s) in the lung image are enhanced according to a first-order partial derivative of each of a plurality of voxels of the lung image. A vessel tree representation is constructed from the enhanced vessels and vessel junctions. The vessel tree representation can be subtracted from the lung image to enhance the visibility of nodules in the lung(s). US Patent Application Number 2008/0051660 to Kakadaris et al., incorporated herein by reference, discloses a set of intravascular ultrasound (IVUS) related systems, apparatuses and methods. New catheter designs including contrast agent introduction subsystems and/ or Doppler subsystems are disclosed. Methods for acquiring and analyzing Doppler data from intravascular ultrasound (IVUS) catheters are disclosed. RF-based detection of blood and/ or contrast agents such as micro-bubbles are disclosed. Methods for frame-grating image data analysis permitting frame registration before, during and after a contrasting effect is imposed on a system being imaged are disclosed. Methods for difference imaging for contrast detection are disclosed. Methods for quantification and visualization of IVUS data are disclosed. And methods for IVUS imaging are disclosed.
US Patent Application Number to Shen et al., incorporated herein by reference, discloses a method and system for automatically detecting rib metastasis in a thoracic CT volume. The ribs are segmented in said CT volume by recursive tracing. A series of cross-sectional images are then generated along a centerline of each rib. Cortical and trabecular bone structures are segmented in each of the cross-sectional images for each rib. Features are calculated for each cross-sectional image based on characteristics of the cortical and trabecular bone structures, and alterations are detected in the cross-sectional images based on the features. Rib metastasis is detected in a rib when an alteration is detected in a number of consecutive cross-sectional images along the centerline of the rib.
DISCLOSURE OF INVENTION.
In its most general form, the presently preferred embodiment of the present invention comprises identifying a texture region in an image having blood vessel structures; detecting high intensity areas and low intensity areas in the texture region; and controllably variably increasing contrast between the high intensity areas and the low intensity areas without introducing unacceptable unwanted noise, by using a tuning parameter to controllably variably add the high intensity areas to the texture region and subtract the low intensity areas from the texture region, so that visualization of the blood vessel patterns is controllably variably enhanced. Thus, the invention comprises a method of image contrast enhancement for increased visualization of blood vessel structures by identifying a texture region with high likelihood of presence of disease, applying mathematical morphology operations to detect high and low intensity (brightness) areas within the texture region, and calculating a contrast enhanced image by combining the result of the texture region identification, morphological operations and a tuning parameter. The texture region is identified in the original image by determining areas within the image with high variations in intensity. Next, areas of high and low intensity within the texture region are identified using mathematical moφhology operations. Lastly, variable amounts, determined by a selectable tuning parameter, of the high intensity areas are added, and the low intensity areas are subtracted, from the texture region of the original image, producing images with controllably variable visualization enhancement of blood vessel structures.
BRIEF DESCRIPTION OF DRAWINGS.
The preferred embodiments of this invention will be described, with reference to the following figures, wherein: FIG 1 shows a flowchart of the visualization enhancement method;
FIG 2 (a) shows an image of the cervix and FIG 2 (b) shows the identified texture region of the cervix; and
FIG 3 (a) shows the original cervical image, FIG 3 (b) displays a magnified region (indicated by a square in FIG 3 (a)) of the original image without contrast enhancement, and FIGS 3 (c), 3 (d) and 3 (e) show the result of the blood vessel structure enhancement with the tuning parameter, α, set to 0, 0.5, and 1.0, respectively.
BEST MODE FOR CARRYING OUT INVENTION. The presently preferred embodiment of the invention provides a method which increases and controllably varies the contrast between small blood vessel patterns and the surrounding tissue, without introducing artifacts (noise) in images of the uterine cervix, and as such provides a means to enhance the visualization of said blood vessel patterns. A flowchart of the presently preferred embodiment of the invention is shown in FIG 1. The steps of the presently preferred method are described in more detail below. 1. Texture Region Identification
The visualization (contrast) enhancement method starts with an image of an organ or tissue (such as the cervix) (designated I). In the presently preferred embodiment of the current invention, a segmentation step is applied to the image in which the texture region of the cervix is identified. Texture analysis refers to the characterization of regions in an image by their texture. Texture analysis attempts to quantify rough, smooth, silky, or bumpy as a function of the spatial intensity variations in the image (the spatial extent of variations in brightness (or intensity) of the image, preferably measured by using variations in brightness in a black and white version of the image, or "grayscale"). Thus, roughness or bumpiness can be understood as the spatial extent of variations in intensity values, or gray levels, in a black and white version of the image. For the cervix, the texture region is referred to as the region which is rich in texture content or, in other words, has high variations in intensity (instead of being smooth in intensity). The cervical texture region is associated with both diseased findings, such as abnormal blood vessel structures, and normal findings, such as immature metaplasia. If cervical blood vessel patterns are not located within these fields of rich texture, pre-cancerous lesions are less likely. Thus, by detecting the texture regions, and only applying the enhancement algorithm to these areas, only blood vessel patterns associated with precancerous or cancerous lesions will be visually enhanced. This invention provides the means for controllable contrast enhancement and, with segmentation, controllable local contrast enhancement.
The preferred texture region identification used in the present invention is based on the work presented by Li et al (W. Li, J. Gu, D. Ferris, and A. Poirson, Automated image analysis of uterine cervical images, Proc. OfSPIE 6414, 65142P1-65142P9 (2007), incorporated herein by reference) which utilizes parts of a technique presented by Forstner (Forstner, W., A framework for low level feature extraction, in Proc. of European Conference on Computer Vision, 383-394 (1994), incorporated herein by reference), Grading et al (Grading, J. and Lindeberg, T., Direct computation of shape cues using scale-adapted spatial derivative operators, International Journal of Computer Vision 17, 163-191 (1996), incorporated herein by reference), and Carson et al (C. Carson, S. Belongie, H. Greenspan, and J. Malik, Blobworld: image segmentation using expectation maximization and its application to image querying, IEEE Transactions on Pattern Analysis and Machine Intelligence, 24, 1026-1038 (2002), incorporated herein by reference). The texture region analysis method determines the texture contrast (i.e. intensity variations) in the image, and separates the image into areas of high and low texture. The high texture areas are clustered in one region, which defines the texture region in the cervical image. The texture region, which is a sub-part of the entire cervical image, I, is designated /,„,„,«.. FIG 2 (a) shows an image of the cervix and FIG 2 (b) shows the texture region identified using the method described above.
Although detecting the texture region is the preferred method of the current invention, it is not a pre-requisite for the following steps. The entire image of the cervix can just as well be used in the following steps.
2. Defining High Intensity and Low Intensity Regions
The step following optional detection of the texture region preferably uses operations based on mathematical morphology (J. Serra, Image Analysis and Mathematical Morphology, Academic Press, New York, 1982, incorporated herein by reference). Mathematical morphology is a technique for the analysis and processing of geometrical structures, such as blood vessel patterns, using a few simple mathematical concepts from set theory (which is a branch of mathematics that studies the collections of objects). The basic idea in mathematical morphology is to compare the structures in an image against a so- called structuring element having a simple pre-defined shape, and drawing conclusions on how this shape fits or misses the structures in the image. Commonly used structuring elements in mathematical morphology include, but are not limited to, disk shape, box shape, and diamond shape. Mathematical morphology is commonly applied to digital images, and includes edge detection, noise removal, image enhancement and image segmentation.
The preferred morphology methods used in the present invention are the top-hat and bottom-hat filters (P. Soille, A note on morphological contrast enhancement, Technical Report Ecole des Mines d'Ales-EERIE (1997), incorporated herein by reference; F. Meyer, Iterative image transformations for an automatic screening of cervical smears, The Journal of Histochemistry and Cytochemistry, The Histochemical Society, 128-135 (1979), incorporated herein by reference). The top-hat filter captures high intensity (bright) areas in an image. Here, the top-hat filter is based on neighborhood ranking and uses the ranked value from two different sized areas. The brightest value in an area defined by a sliding window (preferably a disk shaped structuring element) is compared to the brightest value in a surrounding annular (ring-shaped) area. If the brightness difFerence exceeds a threshold value (typically defined as the average brightness of the surrounding area), the area is defined as a bright area. The output of the top-hat filter defines the high brightness areas in the image and is designated
TH(I[eχtur<J- After the bright areas have been identified, a bottom-hat filter can be used to capture low intensity (dark) areas, such as the blood vessel structures. Here, the size of the sliding window (preferably a disk shaped structuring element) is preferably chosen such that it slightly exceeds the diameter of the size of the vessel sought to be enhanced. The output of the bottom-hat filter defines the low intensity (darker) areas in the image and is designated BH(ItexturJ.
3. Contrast Enhancement
The final step in the preferred embodiment of the current invention combines the information from the previous steps in order to improve the local contrast of the image by enhancing the contrast between blood vessel structures and the surrounding tissue. One preferred method is low intensity based contrast enhancement which involves subtracting the low intensity areas from the original image and by doing so, increasing the contrast between the low intensity areas and their surroundings (K. Sun and N. Sang, Enhancement of vascular angiogram by multiscale morphology, in Bioinformatics and Biomedical Engineering, 1311-1313 (2007), incorporated herein by reference). Another preferred method is high intensity contrast enhancement which involves adding the output from the top-hat operation (the high intensity areas) and subtracting the bottom-hat output (the low intensity areas) from the original image. This method stretches the high intensity areas toward increased intensity whereas low intensity areas are stretched towards decreased intensity, thereby increasing the contrast of the region by a greater amount than only subtracting the low intensity areas (Wirth, M., Fraschini, M., and Lyon, J., Contrast enhancement of microcalcifications in mammograms using morphological enhancement and non-flat structuring elements, Proc. 17th IEEE Symposium on Computer-Based Medical Systems, (2008), incorporated herein by reference; K. Sun and N. Sang, Enhancement of vascular angiogram by multiscale morphology, in Bioinformatics and Biomedical Engineering, 1311-1313 (2007), incorporated herein by reference). 3(a). Tuning Parameter
The presently preferred embodiment expands on the addition and subtraction approach by incorporating a controllably variable tuning parameter, α, according to the formula:
IenHancC = U ,,^e + ^TH {I ^J]- BH {I ^) (1) to create an enhanced image; ImhanCede • The controllably variable tuning parameter, a, has values controllably selectable between 0 and 1, and provides a means for variable visualization (contrast) enhancement similar to different filter characteristics. From Equation (1), we can see that the tuning parameter preferably only controls the output of the top hat filter and therefore only controls contrast enhancement of the high intensity (brightness) areas, and does not control the output of the bottom hat filter (the contrast enhancement of the low intensity (brightness) areas). A value of a = 0 means that no high intensity based contrast enhancement is applied which, as described above, has the effect of only subtracting the low intensity areas from the original image and by doing so only increases the contrast of the low intensity areas from their surroundings.
A value of a = 1 adds the full output from the top-hat filter and subtracts the bottom-hat output from the original image which, as described above, stretches both the high intensity areas toward increased intensity and low intensity areas towards decreased intensity, thereby applying maximum contrast enhancement.
A value of the 0 < a < 1 provides (in addition to variable contrast enhancement) a means of controlling the amount of unwanted noise generated in the enhanced image. Although one at first observation might think that maximum contrast enhancement (with a = 1) is the standard, and desired, operating parameter, it might also increase the noise in the image to an unacceptable level, because high intensity (brightness) areas are more susceptible to noise. This would counteract the intended contrast enhancement. The reason for this behavior is a consequence of the properties (statistical variations) of light. For example, noise in detected signals increases with the intensity of the light. A controllably variable visualization enhancement will also provide the user the opportunity to fine tune the amount of contrast enhancement to his or her personal preference.
The results of the contrast enhancement method of the current invention are illustrated in FIG 3. FIG 3 (a) shows the original cervical image and FIG 3 (b) displays a magnified region of the original image without contrast enhancement. FIG 3 (c), Fig 3(d), and Fig. 3(e) show the results of the contrast enhancement with the tuning parameter, a, set to 0, 0.5, and 1.0, respectively, clearly demonstrating the increased visualization of the blood vessel structure. While the present invention has been shown and described with reference to the particular embodiments described in the detailed description and illustrated in the figures, it will be understood by one skilled in the art that various changes in detail may be effected therein without departing from the spirit and scope of the invention, as defined by the claims. Accordingly, no limitations are to be implied or inferred except as explicitly set forth in the claims.
INDUSTRIAL APPLICABILITY.
This invention provides visualization enhancement and is not limited to blood vessels or the cervix. The contrast enhancement method may also be suitable for other tissue diagnosis instruments and for any other methods that require variable adjustment of contrast.

Claims

CLAIMSWhat is claimed is:
1. A method of contrast enhancement for an image, comprising: identifying a texture region in said image having blood vessel structures; detecting high intensity areas and low intensity areas in said texture region; controllably variably increasing contrast between said high intensity areas and said low intensity areas without introducing unacceptable unwanted noise by using a tuning parameter to controllably variably add said high intensity areas to said texture region and by subtracting said low intensity areas from said texture region, whereby visualization of said blood vessel patterns is controllably variably enhanced.
.
2. A method according to claim 1, wherein said identifying step comprises applying a top-hat filter using a first structuring element to define said high intensity region in said image, and using a bottom-hat filter having a second structuring element to identify said low intensity regions in said image using.
3. A method according to claim 2, wherein said first structuring element is disk shaped and said second structuring element is disk shaped and has a diameter slightly exceeding the diameter of said blood vessels.
4. A method according to claim 3, wherein said identifying step is performed by collecting said image and segmenting said image using intensity variations in said image.
EP08795361A 2008-08-15 2008-08-15 Methods for enhancing vascular patterns in cervical imagery Withdrawn EP2313848A4 (en)

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
PCT/US2008/009777 WO2010019121A1 (en) 2008-08-15 2008-08-15 Methods for enhancing vascular patterns in cervical imagery

Publications (2)

Publication Number Publication Date
EP2313848A1 true EP2313848A1 (en) 2011-04-27
EP2313848A4 EP2313848A4 (en) 2012-08-29

Family

ID=41669099

Family Applications (1)

Application Number Title Priority Date Filing Date
EP08795361A Withdrawn EP2313848A4 (en) 2008-08-15 2008-08-15 Methods for enhancing vascular patterns in cervical imagery

Country Status (4)

Country Link
EP (1) EP2313848A4 (en)
JP (1) JP2012500040A (en)
CN (1) CN102124471A (en)
WO (1) WO2010019121A1 (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102682305B (en) * 2012-04-25 2014-07-02 深圳市迈科龙医疗设备有限公司 Automatic screening system and automatic screening method using thin-prep cytology test
KR101578770B1 (en) 2013-11-21 2015-12-18 삼성전자주식회사 Apparatus por processing a medical image and method for processing a medical image
CN103593829A (en) * 2013-11-26 2014-02-19 北京科技大学 Hand vein pattern developing method based on mathematical morphology operation
JP6523642B2 (en) * 2014-09-26 2019-06-05 テルモ株式会社 Diagnostic imaging device

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793883A (en) * 1995-09-29 1998-08-11 Siemens Medical Systems, Inc. Method for enhancing ultrasound image
US20070025605A1 (en) * 2005-07-28 2007-02-01 Siemens Aktiengesellschaft Method for the improved display of co-registered 2D-3D images in medical imaging

Family Cites Families (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH0816815A (en) * 1994-06-28 1996-01-19 Ge Yokogawa Medical Syst Ltd Picture processing method and picture processor
JP3568279B2 (en) * 1995-06-30 2004-09-22 富士写真フイルム株式会社 Image reproducing method and apparatus
JP4274590B2 (en) * 1997-01-20 2009-06-10 オリンパス株式会社 Image processing device
FR2829268A1 (en) * 2001-09-04 2003-03-07 Koninkl Philips Electronics Nv IMAGE PROCESSING METHOD FOR DIGITIZED SUBTRACTIVE ANGIOGRAPHY
JP4159291B2 (en) * 2002-01-30 2008-10-01 フジノン株式会社 Electronic endoscope device
WO2003098522A1 (en) * 2002-05-17 2003-11-27 Pfizer Products Inc. Apparatus and method for statistical image analysis
JP3572304B2 (en) * 2002-05-23 2004-09-29 稔 冨田 Image analysis method using photo retouching software in medical field
JP2004032137A (en) * 2002-06-24 2004-01-29 Pentax Corp Picture-contour emphasizing device
WO2005071595A1 (en) * 2004-01-15 2005-08-04 Philips Intellectual Property & Standards Gmbh Automatic contrast medium control in images
JP2006261861A (en) * 2005-03-15 2006-09-28 Fuji Photo Film Co Ltd Imaging apparatus
US8098907B2 (en) * 2005-07-01 2012-01-17 Siemens Corporation Method and system for local adaptive detection of microaneurysms in digital fundus images
US20080058593A1 (en) * 2006-08-21 2008-03-06 Sti Medical Systems, Llc Computer aided diagnosis using video from endoscopes
US20080081998A1 (en) * 2006-10-03 2008-04-03 General Electric Company System and method for three-dimensional and four-dimensional contrast imaging

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5793883A (en) * 1995-09-29 1998-08-11 Siemens Medical Systems, Inc. Method for enhancing ultrasound image
US20070025605A1 (en) * 2005-07-28 2007-02-01 Siemens Aktiengesellschaft Method for the improved display of co-registered 2D-3D images in medical imaging

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
IVAN R TEROL-VILLALOBOS ED - RAÃ L MONROY ET AL: "Multiscale Image Enhancement and Segmentation Based on Morphological Connected Contrast Mappings", 12 March 2004 (2004-03-12), MICAI 2004: ADVANCES IN ARTIFICIAL INTELLIGENCE; [LECTURE NOTES IN COMPUTER SCIENCE;LECTURE NOTES IN ARTIFICIAL INTELLIGENCE;LNCS], SPRINGER-VERLAG, BERLIN/HEIDELBERG, PAGE(S) 662 - 671, XP019003985, ISBN: 978-3-540-21459-5 pages 662-671, * abstract * * Sections 5.1 and 5.2; page 668 - page 670; figure 3 * *
See also references of WO2010019121A1 *
XIN ZHANG ET AL: "Retinal Spot Lesion Detection Using Adaptive Multiscale Morphological Processing", 1 January 2006 (2006-01-01), ADVANCES IN VISUAL COMPUTING LECTURE NOTES IN COMPUTER SCIENCE;;LNCS, SPRINGER, BERLIN, DE, PAGE(S) 490 - 501, XP019050869, ISBN: 978-3-540-48626-8 * abstract * * Section 2 "Preliminary"; page 492 * * Section 3 "Proposed Algorithm"; page 493; figure 3 * * Section 3.3 "Scale Map Generation"; page 496 * *

Also Published As

Publication number Publication date
WO2010019121A1 (en) 2010-02-18
EP2313848A4 (en) 2012-08-29
CN102124471A (en) 2011-07-13
JP2012500040A (en) 2012-01-05

Similar Documents

Publication Publication Date Title
US8351667B2 (en) Methods of contrast enhancement for images having blood vessel structures
EP2054852B1 (en) Computer aided analysis using video from endoscopes
Azhari et al. Brain tumor detection and localization in magnetic resonance imaging
Abd Halim et al. Nucleus segmentation technique for acute leukemia
JP4311598B2 (en) Abnormal shadow detection method and apparatus
JP2007007440A (en) Automated method and apparatus to detect phyma and parenchyma deformation in medical image using computer
CN110610498A (en) Mammary gland molybdenum target image processing method, system, storage medium and equipment
CN110288698B (en) Meniscus three-dimensional reconstruction system based on MRI
Dabass et al. Biomedical image enhancement using different techniques-a comparative study
Ganvir et al. Filtering method for pre-processing mammogram images for breast cancer detection
EP2313848A1 (en) Methods for enhancing vascular patterns in cervical imagery
CN115908190A (en) Method and system for enhancing image quality of video image
Wang et al. Improving segmentation of breast arterial calcifications from digital mammography: good annotation is all you need
Wu et al. Hybrid enhancement algorithm for nailfold images with large fields of view
Ye et al. Segmentation and feature extraction of endoscopic images for making diagnosis of acute appendicitis
JPH08287230A (en) Computer-aided image diagnostic device
Zainudin et al. Feature extraction on medical image using 2D Gabor filter
Sowmiya et al. Survey or Review on the Deep Learning Techniques for Retinal Image Segmentation in Predicting/Diagnosing Diabetic Retinopathy
Sobhi et al. Extraction of Laryngeal Cancer Informative Frames from Narrow Band Endoscopic Videos
JP7478245B2 (en) Medical imaging device and method of operation thereof
CN118628378B (en) CycleGAN-based X-ray image enhancement method
Prakash Medical image processing methodology for liver tumour diagnosis
Bashir et al. Enhancement of fundus images for diagnosing diabetic retinopathy using B-spline
Lavanya et al. Retinal vessel feature extraction from fundus image using image processing techniques
Goel et al. A Scientific Implementation for Medical Images to Detect and Classify Various Diseases Using Machine Learning

Legal Events

Date Code Title Description
PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

Free format text: ORIGINAL CODE: 0009012

17P Request for examination filed

Effective date: 20110209

AK Designated contracting states

Kind code of ref document: A1

Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HR HU IE IS IT LI LT LU LV MC MT NL NO PL PT RO SE SI SK TR

AX Request for extension of the european patent

Extension state: AL BA MK RS

DAX Request for extension of the european patent (deleted)
A4 Supplementary search report drawn up and despatched

Effective date: 20120730

RIC1 Information provided on ipc code assigned before grant

Ipc: G06T 5/00 20060101AFI20120724BHEP

GRAP Despatch of communication of intention to grant a patent

Free format text: ORIGINAL CODE: EPIDOSNIGR1

INTG Intention to grant announced

Effective date: 20130408

STAA Information on the status of an ep patent application or granted ep patent

Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN

18D Application deemed to be withdrawn

Effective date: 20130820