WO2014045174A1 - Labeling a cervical image - Google Patents

Labeling a cervical image Download PDF

Info

Publication number
WO2014045174A1
WO2014045174A1 PCT/IB2013/058523 IB2013058523W WO2014045174A1 WO 2014045174 A1 WO2014045174 A1 WO 2014045174A1 IB 2013058523 W IB2013058523 W IB 2013058523W WO 2014045174 A1 WO2014045174 A1 WO 2014045174A1
Authority
WO
WIPO (PCT)
Prior art keywords
cervical
image
cervical region
region
analyzer
Prior art date
Application number
PCT/IB2013/058523
Other languages
French (fr)
Inventor
Vipin Gupta
Pallavi Vajinepalli
Original Assignee
Koninklijke Philips N.V.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips N.V. filed Critical Koninklijke Philips N.V.
Priority to BR112015006004A priority Critical patent/BR112015006004A2/en
Priority to RU2015114810A priority patent/RU2659013C2/en
Priority to CN201380049028.8A priority patent/CN104661584B/en
Publication of WO2014045174A1 publication Critical patent/WO2014045174A1/en

Links

Classifications

    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/0059Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence
    • A61B5/0082Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes
    • A61B5/0084Measuring for diagnostic purposes; Identification of persons using light, e.g. diagnosis by transillumination, diascopy, fluorescence adapted for particular medical purposes for introduction into the body, e.g. by catheters
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B5/00Measuring for diagnostic purposes; Identification of persons
    • A61B5/43Detecting, measuring or recording for evaluating the reproductive systems
    • A61B5/4306Detecting, measuring or recording for evaluating the reproductive systems for evaluating the female reproductive systems, e.g. gynaecological evaluations
    • A61B5/4318Evaluation of the lower reproductive system
    • A61B5/4331Evaluation of the lower reproductive system of the cervix
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B2576/00Medical imaging apparatus involving image processing or analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30096Tumor; Lesion
    • GPHYSICS
    • G16INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR SPECIFIC APPLICATION FIELDS
    • G16HHEALTHCARE INFORMATICS, i.e. INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR THE HANDLING OR PROCESSING OF MEDICAL OR HEALTHCARE DATA
    • G16H30/00ICT specially adapted for the handling or processing of medical images
    • G16H30/40ICT specially adapted for the handling or processing of medical images for processing medical images, e.g. editing

Definitions

  • the invention relates to a system and a method for labeling a cervical image obtained during a colposcopy of a patient.
  • the invention further relates to a workstation, an imaging system and a colposcope comprising the system.
  • the invention further relates to a computer program product for causing a processor system to perform the method.
  • Colposcopy is a medical diagnostic technique for examining the cervix and adjoining regions for cervical cancer and other medical conditions. Cervical cancer is a leading cause of cancer for women in India and other developing countries.
  • a colposcopy typically comprises applying staining agents such as acetic acid and Lugol's iodine solution to the cervical region to improve the visibility of lesions. Following this, the cervical region is examined under a microscope while illuminating the cervical region. Precancerous and malignant areas either show as having specific vascular patterns in a cervical image or turning aceto-white and back in a transient manner over a series of cervical images, e.g., in a video. Such characteristics are a cue for an immediate biopsy of such areas.
  • US 2009/0046905 Al describes a Computer- Aided-Diagnosis (CAD) system for cervical cancer screening.
  • CAD Computer- Aided-Diagnosis
  • the system automatically analyzes data acquired from the uterine cervix and provides tissue and patient diagnosis, as well as adequacy of the examination. It is said that CAD system is designed for multi-data (different moments in time, different contrast agents like acetic acid, Lugol's iodine, etc.).
  • the CAD system employs feature extraction to extract colposcopic features including: anatomic, acetowhite, blood vessel structure, lesion margin, contour, Lugol's iodine staining.
  • Images enhancements can be provided that enhance specific features in the imagery, in particular the colposcopic features.
  • the individual features can also be classified in terms of their significance to the tissue diagnosis: normal, low-grade, high-grade and cancer.
  • a problem of the above system is that it is insufficiently suitable for analyzing and/or processing the aforementioned multi-data type of cervical images.
  • a first aspect of the invention provides a system for labeling a cervical image obtained during a colposcopy of a patient, the system comprising:
  • an analyzer for i) calculating an image characteristic of the cervical region, the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region, and ii) analyzing the image characteristic to determine whether the technique was used in obtaining the cervical image, thereby obtaining a determined use;
  • a labeler for labeling the cervical image based on the determined use.
  • a workstation, an imaging apparatus and/or a colposcope is provided comprising the system set forth.
  • a method for labeling a cervical image obtained during a colposcopy of a patient comprising:
  • the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region
  • a computer program product comprising instructions for causing a processor system to perform the method set forth.
  • the above measures analyze a cervical image which is obtained from a colposcopic examination of a patient.
  • a cervical image is also referred to as colposcopic image since it was obtained from the colposcopic examination.
  • the cervical image typically shows the cervical region of the patient as well as adjoining regions of the cervical region.
  • the cervical region is detected, e.g., using a cervical region detection algorithm or segmentation algorithm which is known per se from the field of medical image analysis.
  • the image characteristic is then calculated based on image data of the cervical region.
  • the image characteristic therefore constitutes a characteristic of the cervical region which is derivable from the image data of the cervical region.
  • the image characteristic is indicative of a use of a technique for improving a visibility of lesions in the cervical region. It is noted that several of such techniques are known per se from the field of colposcopy. It is also known by clinicians how such techniques in general terms affect an appearance of the cervical region.
  • the image characteristic thus represents an aspect of the appearance that is derivable from the image data of the cervical region and indicative of a use of the technique.
  • the image characteristic is analyzed to determine whether said technique was used in obtaining the cervical image.
  • the term "used in obtaining the cervical image” refers to a use of the technique before or during the colposcopy which resulted in the technique affecting the appearance of the cervical region in the cervical image.
  • the cervical image is then labeled accordingly, either explicitly, e.g., by modifying a header of the cervical image, or implicitly, e.g., by creating metadata associated with the cervical image.
  • the above measures have the effect that a cervical image is automatically analyzed to determine whether a technique for improving a visibility of lesions was used in obtaining the cervical image, with the cervical image then being labeled accordingly. As such, further analysis and/or processing of the cervical image can be based on which technique for improving the visibility of lesions was used in obtaining the cervical image.
  • the inventors have recognized that the further analysis and/or processing of a cervical image benefits from knowing whether said technique was used since this allows the further analysis and/or processing to be optimized for a specific type of cervical image and/or applied selectively to said type of cervical image.
  • an improved cervical cancer screening is obtained.
  • known systems such as that of US 2009/0046905 Al attempt to deal with a wide variety of appearances of the cervical region, e.g., by extracting a wide variety of features from the cervical image.
  • the further analysis and/or processing cannot be optimized for a specific type of cervical image.
  • the analyzer is arranged for:
  • each of the plurality of image characteristics being indicative of the use of a respective one of a plurality of different techniques for improving the visibility of lesions in the cervical region
  • Different techniques may be used for improving the visibility of lesions in the cervical region.
  • a staining agent may be applied to the cervical region before obtaining the cervical image.
  • Another example is the aforementioned use of a green filter during the acquisition of the cervical image.
  • the cervical image is labeled correctly irrespective of which technique of the different technique was used in obtaining the cervical image.
  • the labeler is arranged for labeling the cervical image according to which ones of the plurality of different techniques were used. Certain ones of the plurality of different techniques may be combined. For example, the use of a green filter during image acquisition may be combined with applying acetic acid to the cervical region. By labeling the cervical image according to which ones of the plurality of different techniques were used, the cervical image is labeled correctly even if several different techniques were combined.
  • the plurality of different techniques comprises at least one of: using a green filter during image acquisition, applying a staining agent to the cervical region, and zooming onto the cervical region.
  • Said techniques are well suited for improving the visibility of lesions in the cervical region and thus likely to be used.
  • the staining agent is at least one of: acetic acid and Lugol's iodine.
  • the analyzer is arranged for determining the use of acetic acid by comparing the image characteristic to a reference image characteristic calculated from an earlier cervical image of the patient.
  • the analyzer thus exploits the fact that lesions change a transient manner over a series of cervical images, e.g., by turning aceto-white and back.
  • the analyzer is arranged for determining whether the cervical image is a pre-acetic acid or post-acetic acid cervical image based on said comparing.
  • the analyzer is arranged for determining the use of Lugol's iodine based on determining an absence of at least one of: using the green filter during image acquisition, and applying acetic acid to the cervical region.
  • the analyzer is arranged for determining which of the plurality of different techniques were used by:
  • the cervical region appears normal, determining whether the cervical image is a satisfactory zoomed or unsatisfactory zoomed cervical image and/or whether the cervical image is a pre-acetic acid or post-acetic acid cervical image.
  • the inventors have recognized that certain combinations of techniques may occur whereas others are unlikely to occur.
  • the above hierarchical approach takes into account said fact.
  • the use of one or more of the plurality of different techniques can be determined more efficiently, i.e., less computationally complex.
  • the analyzer is arranged for determining the use of zooming onto the cervical region by i) calculating a size of the cervical region, and ii) analyzing the size of the cervical region to determine whether or not the cervical region is satisfactorily zoomed in on in the cervical image.
  • the analyzer is arranged for determining that the cervical image is unsatisfactory for further analysis and/or processing based on said analyzing of the size of the cervical region.
  • Fig. 1 shows a system for labeling a cervical image based on whether a technique for improving a visibility of lesions was used in obtaining the cervical image
  • Fig. 2 shows a method for labeling the cervical image
  • Fig. 3 shows a computer program product for performing the method
  • Fig. 4 shows a workflow of a colposcopy procedure
  • Fig. 5 shows a labeling of the cervical image according to which ones of a plurality of different techniques were used.
  • Fig. 1 schematically shows a system 100 for labeling a cervical image 110 obtained during a colposcopy of a patient.
  • the system 100 comprises a detector 120 for detecting a cervical region 122 in the cervical image 110.
  • the system 100 further comprises an analyzer 140 for calculating an image characteristic of the cervical region 122 and analyzing the image characteristic to obtain a determined use 142.
  • the analyzer 140 is shown to receive the cervical region 122, or data indicative thereof, from the detector 120.
  • the analyzer 140 may receive the cervical region 122 in the form of coordinates.
  • the analyzer 140 is further shown to receive the cervical image 110, thereby enabling the analyzer 140 to calculate the image characteristics of the cervical region 122.
  • the analyzer 140 may receive the cervical region 122 in the form of image data of the cervical region 122. Hence, it may not be needed for the analyzer 140 to receive all of the cervical image 122.
  • the system 100 further comprises a labeler 160 for labeling the cervical image 110 based on the determined use 142.
  • the labeler 160 is shown to receive the determined user 142 from the analyzer 140, e.g., in the form of use data.
  • the labeler 160 is further shown to receive the cervical image 110.
  • the labeler 160 may label the cervical image 110 explicitly, e.g., by including metadata in a header of the cervical image 110 and thereby producing as output 162 a labeled cervical image.
  • the labeler 160 may produce as output 162 a separate label in the form of label data which is associated with the cervical image 110 but provided separately. Hence, the labeler 160 may not need to receive the cervical image 110.
  • the operation of the system 100 may be briefly explained as follows.
  • the detector 120 detects a cervical region 122 in the cervical image 110.
  • the analyzer 140 then calculates an image characteristic of the cervical region 122, the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region.
  • the analyzer 140 further analyzes the image characteristic to determine whether the technique was used in obtaining the cervical image 110, thereby obtaining a determined use 142.
  • the labeler 160 labels the cervical image 110 based on the determined use 142.
  • Fig. 2 shows a method 200 for labeling a cervical image obtained during a colposcopy of a patient. It is noted that the method 200 may correspond to the operation of the system 100. However, the method 200 may also be performed in separation of the system 100, e.g., on a different system or device.
  • the method 200 comprises, in a step titled
  • the method 200 further comprises, in a step titled "CALCULATING IMAGE
  • CHARACTERISTIC OF CERVICAL REGION calculating 220 an image characteristic of the cervical region, the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region.
  • the method 200 further comprises, in a step titled "ANALYZING IMAGE CHARACTERISTIC”, analyzing 230 the image characteristic to determine whether the technique was used in obtaining the cervical image, thereby obtaining a determined use.
  • the method 200 further comprises, in a step titled "LABELING CERVICAL IMAGE”, labeling 240 the cervical image based on the determined use.
  • Fig. 3 shows a computer program product 260 comprising instructions for causing a processor system to perform the method according to the present invention.
  • the computer program product 260 may be comprised on a computer readable medium 250, for example as a series of machine readable physical marks and/or as a series of elements having different electrical, e.g., magnetic, or optical properties or values.
  • Fig. 4 shows a workflow 300 of a colposcopy procedure as may be performed by a clinician.
  • a first stage 310 of the colposcopy may comprise douching and cleaning any secretions occurring in the cervical region as well as adjoining regions of the cervical region.
  • a normal saline solution may be used.
  • the cervical image may be considered a 'normal' cervical image and it may be desirable to label it accordingly.
  • the colposcope may also be zoomed onto the cervical region. Zooming constitutes a technique 144 for improving the visibility of lesions in the cervical region since it allows a clinician to obtain a better view of the cervical region and thus of the lesions therein.
  • a cervical image 110 acquired at this stage 310 may be therefore also be a satisfactory zoomed cervical image. Alternatively, in certain situations, the cervical image may also be considered an unsatisfactory zoomed cervical image.
  • a second stage 320 of the colposcopy may comprise using a green filter to highlight certain blood pattern vessel patterns which may be indicative of lesions in the cervical region.
  • a cervical image 110 acquired at this stage 320 of the colposcopy may therefore be a green filter cervical image.
  • a strength of the green filter i.e., a width of the passed and/or blocked spectrum, may vary.
  • the cervical image 110 may be a green+ filter cervical image.
  • the cervical image 110 may be a green- filter cervical image.
  • a third stage 330 of the colposcopy may comprise applying acetic acid to the cervical region, e.g., a 3-5% acetic acid solution.
  • a cervical image 110 acquired at this stage 330 of the colposcopy may therefore be a post-acetic cervical image.
  • a fourth stage 340 of the colposcopy may comprise applying Lugo's Iodine to the cervical region.
  • a cervical image 110 acquired at this stage 340 of the colposcopy therefore may be a post-acetic cervical image.
  • a fifth stage 350 of the colposcopy may comprise performing a biopsy from an abnormal area of the cervix.
  • the present invention involves determine whether a technique was used in obtaining the cervical image, and labeling the cervical image accordingly.
  • the detector 120 may detect the cervical region 122 in the cervical image as follows. Initially, a Gaussian low-pass filter may be applied to the RGB values of the cervical image to remove impulse noise. This may be followed by a two-step method to identify the presence of pink pixels in the cervical image based on the cervix being pink in color. In a first step, a feature space may be identified for cervical region detection.
  • the feature space may be defined as the red color component of the RGB color space, where the red color values exceed a threshold T .
  • the threshold T may be been defined
  • an unsupervised two class clustering technique based on K-Means may be applied.
  • a central cluster in cervical image may then be identified as the cervical region.
  • the above detection of the cervical region 122 is based on detecting a convex hull of the cervical region obtained after color filtering. Alternatively, other cervical region detection algorithms or segmentation algorithms from the field of medical image analysis may be used as well.
  • Fig. 5 shows a labeling of the cervical image 110 according to which ones of a plurality of different techniques were used in obtaining the cervical image.
  • the plurality of different techniques 144 may comprise one or more of, e.g., using a green filter during image acquisition, applying a staining agent to the cervical region, and zooming onto the cervical region.
  • the staining agent may be, e.g., acetic acid or Lugol's iodine.
  • the analyzer 140 may be arranged for calculating a plurality of image characteristics of the cervical region 122, each of the plurality of image characteristics being indicative of the use of a respective one of the plurality of different techniques 144.
  • the analyzer 140 may be further arranged for analyzing one or more of the plurality of image characteristics to determine the use of at least one of the plurality of different techniques in obtaining the cervical image.
  • the labeler 160 may be arranged for labeling the cervical image 110 according to which ones of the plurality of different techniques were used. Consequently, the cervical image 110 may be labeled with one or more labels.
  • Fig. 5 schematically illustrates a labeling of the cervical image 110 by arrows leading from the cervical image 110 to a plurality of labels which are indicated as follows: NRML for normal cervical images, ZM for satisfactory zoomed cervical images, PR- AC for pre-acetic acid cervical images, PO-AC for post-acetic acid cervical images, UN-ZM for unsatisfactory zoomed cervical images, GRN for green filter cervical images, LU-IO for Lugol's Iodine cervical images.
  • Fig. 5 also schematically indicates during which of the stages of the colposcopy procedure 300, as was shown in Fig. 4, the cervical image 110 was most likely acquired by means of dashed bounding boxes. For labeling the cervical image 110 in accordance with Fig.
  • the analyzer 140 may be arranged for determining which of the plurality of different techniques 144 were used by analyzing the one or more image characteristics to determine whether the green filter was applied GRN, Lugol's iodine was applied LU-IO, or if the cervical region appears normal NRML, and if the cervical region appears normal, determining whether the cervical image is a satisfactory zoomed ZM or unsatisfactory zoomed UN-ZM cervical image and/or whether the cervical image is a pre- acetic acid PR- AC or post-acetic acid PO-AC cervical image.
  • the cervical region 122 as detected by the detector 120 is converted into a binary mask. Then, a so-termed perceivable magnification level is calculated based on a ratio of the area of the binary mask and the total area of the cervical image 110.
  • a second step if the area of the cervical region 122 exceeds a predetermined threshold, it is determined whether the cervical image is a first image from a series of images.
  • the cervical image is labeled as normal, i.e., NRML and a R/G color channel ratio is pre-computed for use in labeling subsequent images from the series of images:
  • N e.g., 100-200
  • a third step if the cervical image is not a first image from a series of images, it is determined whether the cervical image is a post-acetic acid cervical image by:
  • N Randomly sample N pixels from the cervical region, the value N may be chosen to be approximately 200 considering computational complexity and performance;
  • a fourth step if the area of the cervical region 122 exceeds a predetermined upper threshold T and if it satisfies certain positional requirements, the cervical image 110 is considered a sufficiently zoomed image, i.e., a satisfactory zoomed image.
  • a positional requirement is that the cervical region is in the center of the cervix image.
  • the positional requirements may also take into account that the cervical region is significantly and thus a part of the cervical region is located outside of said center. Hence, the label ZM is applied. Otherwise, the above process is continued in the following fifth step.
  • the cervical image is a green filter image by comparing the average intensity of the red and green color components.
  • the cervical image is considered a green filter cervical image and the label GR is applied.
  • the label GRN+ may be applied if the average intensity of the green color component is significantly higher than that of the red color component and the label GRN- may be applied is the average intensity of the green color component is somewhat higher than that of the red color component. If neither of said labels is applied, the above process is continued in the following sixth step.
  • a number of pixels are sampled from the image randomly which are validated with color heuristics.
  • color heuristics may be derived
  • the cervical region generally has a brownish/blackish/yellowish kind of appearance.
  • color heuristics may be check for presence of these color/hues, and if the number of pixels N satisfying the heuristics is more than a threshold ⁇ , the cervical image is considered a Lugol's iodine stained cervical image and the label LU-IO is applied.
  • the label LU-IO+ may be applied if the number of pixels N is more than an upper threshold N H .
  • the label LU-IO- may be applied if the number of pixels N is more than a lower threshold N L . If the number of pixels N is lower than N L , the above process is continued in the following seventh step.
  • the cervical image 110 is not labeled in the last four steps, it is declared as unsatisfactory colposcopy image and not fit for analysis. If applicable, also a label UN-ZO for unsatisfactory zoom is applied to the cervical image.
  • the analyzer 140 may arranged for determining the use of acetic acid PR- AC, PO-AC by comparing the image characteristic to a reference image
  • the earlier cervical image may be identified based on a time stamp, in particular a comparison of the time step of the cervical image and the presumed earlier cervical image. In case the system involves acquiring the cervical image, the system may automatically activate the time stamp mode such that such time information is available for the acquired images.
  • the analyzer 140 may be arranged for determining whether the cervical image 110 is a pre-acetic acid PR- AC or post-acetic acid PO-AC cervical image based on said comparing.
  • the analyzer 140 may be arranged for determining the use of Lugol's iodine LU- IO based on determining an absence of at least one of: using the green filter during image acquisition GRN, and applying acetic acid to the cervical region PR- AC, PO-AC.
  • the analyzer 140 may be arranged for determining the use of zooming ZM onto the cervical region 122 by i) calculating a size of the cervical region, and ii) analyzing the size of the cervical region to determine whether or not the cervical region is satisfactorily zoomed in on the cervical image 110.
  • the invention also applies to computer programs, particularly computer programs on or in a carrier, adapted to put the invention into practice.
  • the program may be in the form of a source code, an object code, a code intermediate source and an object code such as in a partially compiled form, or in any other form suitable for use in the implementation of the method according to the invention.
  • a program may have many different architectural designs.
  • a program code implementing the functionality of the method or system according to the invention may be sub-divided into one or more sub-routines. Many different ways of distributing the functionality among these sub-routines will be apparent to the skilled person.
  • the subroutines may be stored together in one executable file to form a self-contained program.
  • Such an executable file may comprise computer-executable instructions, for example, processor instructions and/or interpreter instructions (e.g. Java interpreter instructions).
  • one or more or all of the sub-routines may be stored in at least one external library file and linked with a main program either statically or dynamically, e.g. at run-time.
  • the main program contains at least one call to at least one of the sub-routines.
  • the sub-routines may also comprise function calls to each other.
  • An embodiment relating to a computer program product comprises computer-executable instructions corresponding to each processing step of at least one of the methods set forth herein. These instructions may be sub-divided into subroutines and/or stored in one or more files that may be linked statically or dynamically.
  • Another embodiment relating to a computer program product comprises computer-executable instructions corresponding to each means of at least one of the systems and/or products set forth herein. These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynamically.
  • the carrier of a computer program may be any entity or device capable of carrying the program.
  • the carrier may include a storage medium, such as a ROM, for example, a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example, a hard disk.
  • the carrier may be a transmissible carrier such as an electric or optical signal, which may be conveyed via electric or optical cable or by radio or other means.
  • the carrier may be constituted by such a cable or other device or means.
  • the carrier may be an integrated circuit in which the program is embedded, the integrated circuit being adapted to perform, or used in the performance of, the relevant method.

Landscapes

  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Medical Informatics (AREA)
  • Animal Behavior & Ethology (AREA)
  • Pathology (AREA)
  • Veterinary Medicine (AREA)
  • Biomedical Technology (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Public Health (AREA)
  • Molecular Biology (AREA)
  • Surgery (AREA)
  • Biophysics (AREA)
  • General Health & Medical Sciences (AREA)
  • Gynecology & Obstetrics (AREA)
  • Reproductive Health (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • General Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • Image Analysis (AREA)
  • Image Processing (AREA)
  • Measuring And Recording Apparatus For Diagnosis (AREA)

Abstract

System (100) for labeling a cervical image (110) obtained during a colposcopy of a patient, the system comprising: a detector (120) for detecting a cervical region (122) in the cervical image; an analyzer (140) for i) calculating an image characteristic of the cervical region (122), the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region, and ii) analyzing the image characteristic to determine whether the technique was used in obtaining the cervical image (110), thereby obtaining a determined use (142); and a labeler (160) for labeling the cervical image (110) based on the determined use (142).

Description

Labeling a cervical
FIELD OF THE INVENTION
The invention relates to a system and a method for labeling a cervical image obtained during a colposcopy of a patient. The invention further relates to a workstation, an imaging system and a colposcope comprising the system. The invention further relates to a computer program product for causing a processor system to perform the method.
Colposcopy is a medical diagnostic technique for examining the cervix and adjoining regions for cervical cancer and other medical conditions. Cervical cancer is a leading cause of cancer for women in India and other developing nations. A colposcopy typically comprises applying staining agents such as acetic acid and Lugol's iodine solution to the cervical region to improve the visibility of lesions. Following this, the cervical region is examined under a microscope while illuminating the cervical region. Precancerous and malignant areas either show as having specific vascular patterns in a cervical image or turning aceto-white and back in a transient manner over a series of cervical images, e.g., in a video. Such characteristics are a cue for an immediate biopsy of such areas.
BACKGROUND OF THE INVENTION
Various systems are known for automatically analyzing cervical images.
For example, US 2009/0046905 Al describes a Computer- Aided-Diagnosis (CAD) system for cervical cancer screening. The system automatically analyzes data acquired from the uterine cervix and provides tissue and patient diagnosis, as well as adequacy of the examination. It is said that CAD system is designed for multi-data (different moments in time, different contrast agents like acetic acid, Lugol's iodine, etc.). The CAD system employs feature extraction to extract colposcopic features including: anatomic, acetowhite, blood vessel structure, lesion margin, contour, Lugol's iodine staining. Images enhancements can be provided that enhance specific features in the imagery, in particular the colposcopic features. The individual features can also be classified in terms of their significance to the tissue diagnosis: normal, low-grade, high-grade and cancer. SUMMARY OF THE INVENTION
A problem of the above system is that it is insufficiently suitable for analyzing and/or processing the aforementioned multi-data type of cervical images.
It would be advantageous to have a system or method which enables better analyzing and/or processing different types of cervical images.
To better address this concern, a first aspect of the invention provides a system for labeling a cervical image obtained during a colposcopy of a patient, the system comprising:
a detector for detecting a cervical region in the cervical image;
an analyzer for i) calculating an image characteristic of the cervical region, the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region, and ii) analyzing the image characteristic to determine whether the technique was used in obtaining the cervical image, thereby obtaining a determined use; and
a labeler for labeling the cervical image based on the determined use. In a further aspect of the invention, a workstation, an imaging apparatus and/or a colposcope is provided comprising the system set forth.
In a further aspect of the invention, a method is provided for labeling a cervical image obtained during a colposcopy of a patient, the method comprising:
detecting a cervical region in the cervical image;
calculating an image characteristic of the cervical region, the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region;
analyzing the image characteristic to determine whether the technique was used in obtaining the cervical image, thereby obtaining a determined use; and
labeling the cervical image based on the determined use.
In a further aspect of the invention, a computer program product is provided comprising instructions for causing a processor system to perform the method set forth.
The above measures analyze a cervical image which is obtained from a colposcopic examination of a patient. Such a cervical image is also referred to as colposcopic image since it was obtained from the colposcopic examination. The cervical image typically shows the cervical region of the patient as well as adjoining regions of the cervical region. The cervical region is detected, e.g., using a cervical region detection algorithm or segmentation algorithm which is known per se from the field of medical image analysis.
An image characteristic is then calculated based on image data of the cervical region. The image characteristic therefore constitutes a characteristic of the cervical region which is derivable from the image data of the cervical region. The image characteristic is indicative of a use of a technique for improving a visibility of lesions in the cervical region. It is noted that several of such techniques are known per se from the field of colposcopy. It is also known by clinicians how such techniques in general terms affect an appearance of the cervical region. The image characteristic thus represents an aspect of the appearance that is derivable from the image data of the cervical region and indicative of a use of the technique.
The image characteristic is analyzed to determine whether said technique was used in obtaining the cervical image. Here, the term "used in obtaining the cervical image" refers to a use of the technique before or during the colposcopy which resulted in the technique affecting the appearance of the cervical region in the cervical image. The cervical image is then labeled accordingly, either explicitly, e.g., by modifying a header of the cervical image, or implicitly, e.g., by creating metadata associated with the cervical image.
The above measures have the effect that a cervical image is automatically analyzed to determine whether a technique for improving a visibility of lesions was used in obtaining the cervical image, with the cervical image then being labeled accordingly. As such, further analysis and/or processing of the cervical image can be based on which technique for improving the visibility of lesions was used in obtaining the cervical image.
The inventors have recognized that the further analysis and/or processing of a cervical image benefits from knowing whether said technique was used since this allows the further analysis and/or processing to be optimized for a specific type of cervical image and/or applied selectively to said type of cervical image. Advantageously, an improved cervical cancer screening is obtained. It is noted that known systems such as that of US 2009/0046905 Al attempt to deal with a wide variety of appearances of the cervical region, e.g., by extracting a wide variety of features from the cervical image. Disadvantageously, the further analysis and/or processing cannot be optimized for a specific type of cervical image.
Disadvantageously, manual labeling is needed in order to allow further analysis and/or processing to be applied selectively to said type of cervical image.
Optionally, the analyzer is arranged for:
calculating a plurality of image characteristics of the cervical region, each of the plurality of image characteristics being indicative of the use of a respective one of a plurality of different techniques for improving the visibility of lesions in the cervical region; and
analyzing one or more of the plurality of image characteristics to determine the use of at least one of the plurality of different techniques in obtaining the cervical image.
Different techniques may be used for improving the visibility of lesions in the cervical region. For example, a staining agent may be applied to the cervical region before obtaining the cervical image. Another example is the aforementioned use of a green filter during the acquisition of the cervical image. By calculating multiple image characteristics of the cervical region, with each image characteristic being associated with a different technique for improving the visibility of lesions in the cervical regions, it can be determined whether at least one of the different techniques was used in obtaining the cervical image.
Advantageously, the cervical image is labeled correctly irrespective of which technique of the different technique was used in obtaining the cervical image.
Optionally, the labeler is arranged for labeling the cervical image according to which ones of the plurality of different techniques were used. Certain ones of the plurality of different techniques may be combined. For example, the use of a green filter during image acquisition may be combined with applying acetic acid to the cervical region. By labeling the cervical image according to which ones of the plurality of different techniques were used, the cervical image is labeled correctly even if several different techniques were combined.
Optionally, the plurality of different techniques comprises at least one of: using a green filter during image acquisition, applying a staining agent to the cervical region, and zooming onto the cervical region. Said techniques are well suited for improving the visibility of lesions in the cervical region and thus likely to be used.
Optionally, the staining agent is at least one of: acetic acid and Lugol's iodine.
Optionally, the analyzer is arranged for determining the use of acetic acid by comparing the image characteristic to a reference image characteristic calculated from an earlier cervical image of the patient. The analyzer thus exploits the fact that lesions change a transient manner over a series of cervical images, e.g., by turning aceto-white and back.
Optionally, the analyzer is arranged for determining whether the cervical image is a pre-acetic acid or post-acetic acid cervical image based on said comparing.
Optionally, the analyzer is arranged for determining the use of Lugol's iodine based on determining an absence of at least one of: using the green filter during image acquisition, and applying acetic acid to the cervical region. Optionally, the analyzer is arranged for determining which of the plurality of different techniques were used by:
analyzing the one or more image characteristics to determine whether the green filter was applied, Lugol's iodine was applied, or if the cervical region appears normal;
if the cervical region appears normal, determining whether the cervical image is a satisfactory zoomed or unsatisfactory zoomed cervical image and/or whether the cervical image is a pre-acetic acid or post-acetic acid cervical image.
The inventors have recognized that certain combinations of techniques may occur whereas others are unlikely to occur. The above hierarchical approach takes into account said fact. Advantageously, the use of one or more of the plurality of different techniques can be determined more efficiently, i.e., less computationally complex.
Optionally, the analyzer is arranged for determining the use of zooming onto the cervical region by i) calculating a size of the cervical region, and ii) analyzing the size of the cervical region to determine whether or not the cervical region is satisfactorily zoomed in on in the cervical image.
Optionally, the analyzer is arranged for determining that the cervical image is unsatisfactory for further analysis and/or processing based on said analyzing of the size of the cervical region.
It will be appreciated by those skilled in the art that two or more of the above- mentioned embodiments, implementations, and/or aspects of the invention may be combined in any way deemed useful.
Modifications and variations of the workstation, the imaging apparatus, the colposcope, the method, and/or the computer program product, which correspond to the described modifications and variations of the system, can be carried out by a person skilled in the art on the basis of the present description.
The invention is defined in the independent claims. Advantageous
embodiments are defined in the dependent claims.
BRIEF DESCRIPTION OF THE DRAWINGS
These and other aspects of the invention are apparent from and will be elucidated with reference to the embodiments described hereinafter. In the drawings,
Fig. 1 shows a system for labeling a cervical image based on whether a technique for improving a visibility of lesions was used in obtaining the cervical image; Fig. 2 shows a method for labeling the cervical image;
Fig. 3 shows a computer program product for performing the method;
Fig. 4 shows a workflow of a colposcopy procedure; and
Fig. 5 shows a labeling of the cervical image according to which ones of a plurality of different techniques were used.
DETAILED DESCRIPTION OF EMBODIMENTS
Fig. 1 schematically shows a system 100 for labeling a cervical image 110 obtained during a colposcopy of a patient. The system 100 comprises a detector 120 for detecting a cervical region 122 in the cervical image 110. The system 100 further comprises an analyzer 140 for calculating an image characteristic of the cervical region 122 and analyzing the image characteristic to obtain a determined use 142. For that purpose, the analyzer 140 is shown to receive the cervical region 122, or data indicative thereof, from the detector 120. For example, the analyzer 140 may receive the cervical region 122 in the form of coordinates. The analyzer 140 is further shown to receive the cervical image 110, thereby enabling the analyzer 140 to calculate the image characteristics of the cervical region 122. Alternatively or additionally, the analyzer 140 may receive the cervical region 122 in the form of image data of the cervical region 122. Hence, it may not be needed for the analyzer 140 to receive all of the cervical image 122. The system 100 further comprises a labeler 160 for labeling the cervical image 110 based on the determined use 142. For that purpose, the labeler 160 is shown to receive the determined user 142 from the analyzer 140, e.g., in the form of use data. The labeler 160 is further shown to receive the cervical image 110. In this example, the labeler 160 may label the cervical image 110 explicitly, e.g., by including metadata in a header of the cervical image 110 and thereby producing as output 162 a labeled cervical image. Alternatively or additionally, the labeler 160 may produce as output 162 a separate label in the form of label data which is associated with the cervical image 110 but provided separately. Hence, the labeler 160 may not need to receive the cervical image 110.
The operation of the system 100 may be briefly explained as follows. The detector 120 detects a cervical region 122 in the cervical image 110. The analyzer 140 then calculates an image characteristic of the cervical region 122, the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region. The analyzer 140 further analyzes the image characteristic to determine whether the technique was used in obtaining the cervical image 110, thereby obtaining a determined use 142. Finally, the labeler 160 labels the cervical image 110 based on the determined use 142. Fig. 2 shows a method 200 for labeling a cervical image obtained during a colposcopy of a patient. It is noted that the method 200 may correspond to the operation of the system 100. However, the method 200 may also be performed in separation of the system 100, e.g., on a different system or device. The method 200 comprises, in a step titled
"DETECTING CERVICAL REGION", detecting 210 a cervical region in the cervical image. The method 200 further comprises, in a step titled "CALCULATING IMAGE
CHARACTERISTIC OF CERVICAL REGION", calculating 220 an image characteristic of the cervical region, the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region. The method 200 further comprises, in a step titled "ANALYZING IMAGE CHARACTERISTIC", analyzing 230 the image characteristic to determine whether the technique was used in obtaining the cervical image, thereby obtaining a determined use. The method 200 further comprises, in a step titled "LABELING CERVICAL IMAGE", labeling 240 the cervical image based on the determined use.
Fig. 3 shows a computer program product 260 comprising instructions for causing a processor system to perform the method according to the present invention. The computer program product 260 may be comprised on a computer readable medium 250, for example as a series of machine readable physical marks and/or as a series of elements having different electrical, e.g., magnetic, or optical properties or values.
The operation of the system 100 and the method 200 may be further explained in reference to Figs. 4 and 5. Fig. 4 shows a workflow 300 of a colposcopy procedure as may be performed by a clinician. A first stage 310 of the colposcopy may comprise douching and cleaning any secretions occurring in the cervical region as well as adjoining regions of the cervical region. For this purpose, a normal saline solution may be used. Hence, at this stage 310 of the colposcopy, it may be that no special technique for improving a visibility of lesions in the cervical region was used. Therefore, if a cervical image 110 is acquired using a colposcope at this stage 310 of the colposcopy, the cervical image may be considered a 'normal' cervical image and it may be desirable to label it accordingly. At this stage 310 of the colposcopy, the colposcope may also be zoomed onto the cervical region. Zooming constitutes a technique 144 for improving the visibility of lesions in the cervical region since it allows a clinician to obtain a better view of the cervical region and thus of the lesions therein. A cervical image 110 acquired at this stage 310 may be therefore also be a satisfactory zoomed cervical image. Alternatively, in certain situations, the cervical image may also be considered an unsatisfactory zoomed cervical image. A second stage 320 of the colposcopy may comprise using a green filter to highlight certain blood pattern vessel patterns which may be indicative of lesions in the cervical region. A cervical image 110 acquired at this stage 320 of the colposcopy may therefore be a green filter cervical image. A strength of the green filter, i.e., a width of the passed and/or blocked spectrum, may vary. In case a 'strong' green filter was used, the cervical image 110 may be a green+ filter cervical image. In case a 'weak' green filter was used, the cervical image 110 may be a green- filter cervical image. A third stage 330 of the colposcopy may comprise applying acetic acid to the cervical region, e.g., a 3-5% acetic acid solution. A cervical image 110 acquired at this stage 330 of the colposcopy may therefore be a post-acetic cervical image. A fourth stage 340 of the colposcopy may comprise applying Lugo's Iodine to the cervical region. A cervical image 110 acquired at this stage 340 of the colposcopy therefore may be a post-acetic cervical image. Finally, a fifth stage 350 of the colposcopy may comprise performing a biopsy from an abnormal area of the cervix.
It is noted that the above workflow of a colposcopy procedure is an example which typically varies across countries and regions. In particular, the stage of applying Lugo's Iodine to the cervical region may be omitted in many countries and regions.
It may not be known whether, and if so which technique for improving a visibility of lesions in the cervical region was used in obtaining the cervical image. A reason for that may be that it is not known during which stage of the colposcopy the cervical image as acquired, which techniques were actually applied during a stage, and which stages the colposcopy comprised. The present invention involves determine whether a technique was used in obtaining the cervical image, and labeling the cervical image accordingly.
For that purpose, the detector 120 may detect the cervical region 122 in the cervical image as follows. Initially, a Gaussian low-pass filter may be applied to the RGB values of the cervical image to remove impulse noise. This may be followed by a two-step method to identify the presence of pink pixels in the cervical image based on the cervix being pink in color. In a first step, a feature space may be identified for cervical region detection. The feature space may be defined as the red color component of the RGB color space, where the red color values exceed a threshold T . The threshold T may be been defined
experimentally, e.g., having a value of 225 in case of 8-bit color values. Having identified the feature space, an unsupervised two class clustering technique based on K-Means may be applied. A central cluster in cervical image may then be identified as the cervical region. The above detection of the cervical region 122 is based on detecting a convex hull of the cervical region obtained after color filtering. Alternatively, other cervical region detection algorithms or segmentation algorithms from the field of medical image analysis may be used as well.
Fig. 5 shows a labeling of the cervical image 110 according to which ones of a plurality of different techniques were used in obtaining the cervical image. The plurality of different techniques 144 may comprise one or more of, e.g., using a green filter during image acquisition, applying a staining agent to the cervical region, and zooming onto the cervical region. Here, the staining agent may be, e.g., acetic acid or Lugol's iodine. For labeling the cervical image accordingly, the analyzer 140 may be arranged for calculating a plurality of image characteristics of the cervical region 122, each of the plurality of image characteristics being indicative of the use of a respective one of the plurality of different techniques 144. The analyzer 140 may be further arranged for analyzing one or more of the plurality of image characteristics to determine the use of at least one of the plurality of different techniques in obtaining the cervical image. Moreover, the labeler 160 may be arranged for labeling the cervical image 110 according to which ones of the plurality of different techniques were used. Consequently, the cervical image 110 may be labeled with one or more labels.
Fig. 5 schematically illustrates a labeling of the cervical image 110 by arrows leading from the cervical image 110 to a plurality of labels which are indicated as follows: NRML for normal cervical images, ZM for satisfactory zoomed cervical images, PR- AC for pre-acetic acid cervical images, PO-AC for post-acetic acid cervical images, UN-ZM for unsatisfactory zoomed cervical images, GRN for green filter cervical images, LU-IO for Lugol's Iodine cervical images. Fig. 5 also schematically indicates during which of the stages of the colposcopy procedure 300, as was shown in Fig. 4, the cervical image 110 was most likely acquired by means of dashed bounding boxes. For labeling the cervical image 110 in accordance with Fig. 5, the analyzer 140 may be arranged for determining which of the plurality of different techniques 144 were used by analyzing the one or more image characteristics to determine whether the green filter was applied GRN, Lugol's iodine was applied LU-IO, or if the cervical region appears normal NRML, and if the cervical region appears normal, determining whether the cervical image is a satisfactory zoomed ZM or unsatisfactory zoomed UN-ZM cervical image and/or whether the cervical image is a pre- acetic acid PR- AC or post-acetic acid PO-AC cervical image.
It is noted that in the above, some labels are mutually exclusive whereas others are not. Whether this is the case depends on the particular technique and the colposcopy procedure. For example, in this particular example, it is unlikely that the labels GRN indicating use of a green filter and the label LU-IO indicating application of Lugol's iodine are both applied since typically a green filter is not used during or after applying Lugol's iodine. However, the label PO-AC indicating a post-acetic acid application and the label ZM indicating zooming onto the cervical region may both be applied at a same time.
In the following, a more detailed example is provided of how the labeling of the cervical image 110 in accordance with Fig.5 may be achieved.
In a first step, the cervical region 122 as detected by the detector 120 is converted into a binary mask. Then, a so-termed perceivable magnification level is calculated based on a ratio of the area of the binary mask and the total area of the cervical image 110.
In a second step, if the area of the cervical region 122 exceeds a predetermined threshold, it is determined whether the cervical image is a first image from a series of images. In this case, the cervical image is labeled as normal, i.e., NRML and a R/G color channel ratio is pre-computed for use in labeling subsequent images from the series of images:
a. Randomly sample N (e.g., 100-200) pixels from the cervical region; b. Sort the pixels based on the intensity;
c. Compute the mean intensity Mi of each color channel of the first (N/2) pixels, with Mi being a 3-channel vector, i.e., (R, G, B);
d. Compute the R/G ratio Ri = Mi(l)/Mi(2), i.e., the mean intensity of the red color channel divided by the mean intensity of the green color channel.
In a third step, if the cervical image is not a first image from a series of images, it is determined whether the cervical image is a post-acetic acid cervical image by:
a. Randomly sample N pixels from the cervical region, the value N may be chosen to be approximately 200 considering computational complexity and performance;
b. Sort the pixels based on the intensity;
c. Compute the mean intensity M2 of, e.g., the first 100 pixels;
d. Compute the R/G ratio R2 = M2(l)/M2(2) and compare Rl and R2 using the relation 'R1>R2+A';
e. If the relation is satisfied, apply the label post-acetic acid, i.e., PO-AC, otherwise normal, i.e., NRML.
In a fourth step, if the area of the cervical region 122 exceeds a predetermined upper threshold T and if it satisfies certain positional requirements, the cervical image 110 is considered a sufficiently zoomed image, i.e., a satisfactory zoomed image. An example of a positional requirement is that the cervical region is in the center of the cervix image. The positional requirements may also take into account that the cervical region is significantly and thus a part of the cervical region is located outside of said center. Hence, the label ZM is applied. Otherwise, the above process is continued in the following fifth step.
In the fifth step, if the area of the cervical region 122 is below a predetermined lower threshold Tls it is determined whether the cervical image is a green filter image by comparing the average intensity of the red and green color components. Here, if the average intensity of the green color component is higher than that of the red color component, the cervical image is considered a green filter cervical image and the label GR is applied. Optionally, the label GRN+ may be applied if the average intensity of the green color component is significantly higher than that of the red color component and the label GRN- may be applied is the average intensity of the green color component is somewhat higher than that of the red color component. If neither of said labels is applied, the above process is continued in the following sixth step.
In the sixth step, a number of pixels are sampled from the image randomly which are validated with color heuristics. Such color heuristics may be derived
experimentally after analyzing several labeled images. For Lugol's iodine stained images, the cervical region generally has a brownish/blackish/yellowish kind of appearance. Hence, color heuristics may be check for presence of these color/hues, and if the number of pixels N satisfying the heuristics is more than a threshold Ντ, the cervical image is considered a Lugol's iodine stained cervical image and the label LU-IO is applied. Optionally, the label LU-IO+ may be applied if the number of pixels N is more than an upper threshold NH.
Alternatively, the label LU-IO- may be applied if the number of pixels N is more than a lower threshold NL. If the number of pixels N is lower than NL, the above process is continued in the following seventh step.
In the seventh step, if the cervical image 110 is not labeled in the last four steps, it is declared as unsatisfactory colposcopy image and not fit for analysis. If applicable, also a label UN-ZO for unsatisfactory zoom is applied to the cervical image.
In general, the analyzer 140 may arranged for determining the use of acetic acid PR- AC, PO-AC by comparing the image characteristic to a reference image
characteristic calculated from an earlier cervical image of the patient, which was, if the cervical image was obtained after the use of the acetic acid, most likely obtained without said use. The earlier cervical image may be identified based on a time stamp, in particular a comparison of the time step of the cervical image and the presumed earlier cervical image. In case the system involves acquiring the cervical image, the system may automatically activate the time stamp mode such that such time information is available for the acquired images. Moreover, the analyzer 140 may be arranged for determining whether the cervical image 110 is a pre-acetic acid PR- AC or post-acetic acid PO-AC cervical image based on said comparing. The analyzer 140 may be arranged for determining the use of Lugol's iodine LU- IO based on determining an absence of at least one of: using the green filter during image acquisition GRN, and applying acetic acid to the cervical region PR- AC, PO-AC. The analyzer 140 may be arranged for determining the use of zooming ZM onto the cervical region 122 by i) calculating a size of the cervical region, and ii) analyzing the size of the cervical region to determine whether or not the cervical region is satisfactorily zoomed in on the cervical image 110.
It will be appreciated that the invention also applies to computer programs, particularly computer programs on or in a carrier, adapted to put the invention into practice. The program may be in the form of a source code, an object code, a code intermediate source and an object code such as in a partially compiled form, or in any other form suitable for use in the implementation of the method according to the invention. It will also be appreciated that such a program may have many different architectural designs. For example, a program code implementing the functionality of the method or system according to the invention may be sub-divided into one or more sub-routines. Many different ways of distributing the functionality among these sub-routines will be apparent to the skilled person. The subroutines may be stored together in one executable file to form a self-contained program. Such an executable file may comprise computer-executable instructions, for example, processor instructions and/or interpreter instructions (e.g. Java interpreter instructions). Alternatively, one or more or all of the sub-routines may be stored in at least one external library file and linked with a main program either statically or dynamically, e.g. at run-time. The main program contains at least one call to at least one of the sub-routines. The sub-routines may also comprise function calls to each other. An embodiment relating to a computer program product comprises computer-executable instructions corresponding to each processing step of at least one of the methods set forth herein. These instructions may be sub-divided into subroutines and/or stored in one or more files that may be linked statically or dynamically.
Another embodiment relating to a computer program product comprises computer-executable instructions corresponding to each means of at least one of the systems and/or products set forth herein. These instructions may be sub-divided into sub-routines and/or stored in one or more files that may be linked statically or dynamically.
The carrier of a computer program may be any entity or device capable of carrying the program. For example, the carrier may include a storage medium, such as a ROM, for example, a CD ROM or a semiconductor ROM, or a magnetic recording medium, for example, a hard disk. Furthermore, the carrier may be a transmissible carrier such as an electric or optical signal, which may be conveyed via electric or optical cable or by radio or other means. When the program is embodied in such a signal, the carrier may be constituted by such a cable or other device or means. Alternatively, the carrier may be an integrated circuit in which the program is embedded, the integrated circuit being adapted to perform, or used in the performance of, the relevant method.
It should be noted that the above-mentioned embodiments illustrate rather than limit the invention, and that those skilled in the art will be able to design many alternative embodiments without departing from the scope of the appended claims. In the claims, any reference signs placed between parentheses shall not be construed as limiting the claim. Use of the verb "comprise" and its conjugations does not exclude the presence of elements or steps other than those stated in a claim. The article "a" or "an" preceding an element does not exclude the presence of a plurality of such elements. The invention may be implemented by means of hardware comprising several distinct elements, and by means of a suitably programmed computer. In the device claim enumerating several means, several of these means may be embodied by one and the same item of hardware. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.

Claims

CLAIMS:
1. System (100) for labeling a cervical image (110) obtained during a colposcopy of a patient, the system comprising:
a detector (120) for detecting a cervical region (122) in the cervical image; an analyzer (140) for i) calculating an image characteristic of the cervical region (122), the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region, and ii) analyzing the image characteristic to determine whether the technique was used in obtaining the cervical image (110), thereby obtaining a determined use (142); and
a labeler (160) for labeling the cervical image (110) based on the determined use (142).
2. System (100) according to claim 1, wherein the analyzer (140) is arranged for:
calculating a plurality of image characteristics of the cervical region (122), each of the plurality of image characteristics being indicative of the use of a respective one of a plurality of different techniques (144) for improving the visibility of lesions in the cervical region; and
analyzing one or more of the plurality of image characteristics to determine the use of at least one of the plurality of different techniques in obtaining the cervical image.
3. System (100) according to claim 2, wherein the labeler (160) is arranged for labeling the cervical image according to which ones of the plurality of different techniques were used (144).
4. System (100) according to claim 2, wherein the plurality of different techniques (144) comprises at least one of: using a green filter during image acquisition (GRN), applying a staining agent to the cervical region (LU-IO, PR-AC, PO-AC), and zooming onto the cervical region (ZM, UN-ZM).
5. System (100) according to claim 4, wherein the staining agent is at least one of: acetic acid and Lugol's iodine.
6. System (100) according to claim 5, wherein the analyzer (140) is arranged for determining the use of acetic acid (PR-AC, PO-AC) by comparing the image characteristic to a reference image characteristic calculated from an earlier cervical image of the patient.
7. System (100) according to claim 6, wherein the analyzer (140) is arranged for determining whether the cervical image (110) is a pre-acetic acid (PR- AC) or post-acetic acid (PO-AC) cervical image based on said comparing.
8. System (100) according to claim 5, wherein the analyzer (140) is arranged for determining the use of Lugol's iodine (LU-IO) based on determining an absence of at least one of: using the green filter during image acquisition (GRN), and applying acetic acid to the cervical region (PR-AC, PO-AC).
9. System (100) according to claim 4, wherein the analyzer (140) is arranged for determining which of the plurality of different techniques (144) were used by:
analyzing the one or more image characteristics to determine whether the green filter was applied (GRN), Lugol's iodine was applied (LU-IO), or if the cervical region appears normal (NRML);
if the cervical region appears normal, determining whether the cervical image is a satisfactory zoomed (ZM) or unsatisfactory zoomed (UN-ZM) cervical image and/or whether the cervical image is a pre-acetic acid (PR- AC) or post-acetic acid (PO-AC) cervical image.
10. System (100) according to claim 4, wherein the analyzer (140) is arranged for determining the use of zooming (ZM) onto the cervical region (122) by i) calculating a size of the cervical region, and ii) analyzing the size of the cervical region to determine whether or not the cervical region is satisfactorily zoomed in on the cervical image (110).
11. System (100) according to claim 10, wherein the analyzer (140) is arranged for determining that the cervical image (110) is unsatisfactory for further analysis and/or processing based on said analyzing of the size of the cervical region (122).
12. Workstation or imaging apparatus comprising the system according to claim 1.
13. Colposcope comprising the system according to claim 1.
14. Method (200) for labeling a cervical image obtained during a colposcopy of a patient, the method comprising:
detecting (210) a cervical region in the cervical image;
calculating (220) an image characteristic of the cervical region, the image characteristic being indicative of a use of a technique for improving a visibility of lesions in the cervical region;
analyzing (230) the image characteristic to determine whether the technique was used in obtaining the cervical image, thereby obtaining a determined use; and
labeling (240) the cervical image based on the determined use.
15. A computer program product (260) comprising instructions for causing a processor system to perform the method according to claim 14.
PCT/IB2013/058523 2012-09-21 2013-09-13 Labeling a cervical image WO2014045174A1 (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
BR112015006004A BR112015006004A2 (en) 2012-09-21 2013-09-13 system and method for labeling a cervical image obtained during a colposcopy of a patient, workstation or imaging device, colposcope, and computer program product
RU2015114810A RU2659013C2 (en) 2012-09-21 2013-09-13 Cervical image labelling
CN201380049028.8A CN104661584B (en) 2012-09-21 2013-09-13 Mark uterine neck image

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201261704140P 2012-09-21 2012-09-21
US61/704,140 2012-09-21

Publications (1)

Publication Number Publication Date
WO2014045174A1 true WO2014045174A1 (en) 2014-03-27

Family

ID=49709770

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2013/058523 WO2014045174A1 (en) 2012-09-21 2013-09-13 Labeling a cervical image

Country Status (4)

Country Link
CN (1) CN104661584B (en)
BR (1) BR112015006004A2 (en)
RU (1) RU2659013C2 (en)
WO (1) WO2014045174A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109543719A (en) * 2018-10-30 2019-03-29 浙江大学 Uterine neck atypia lesion diagnostic model and device based on multi-modal attention model

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002025588A2 (en) * 2000-09-21 2002-03-28 Md Online Inc. Medical image processing systems
US20050235272A1 (en) * 2004-04-20 2005-10-20 General Electric Company Systems, methods and apparatus for image annotation
US20090046905A1 (en) 2005-02-03 2009-02-19 Holger Lange Uterine cervical cancer computer-aided-diagnosis (CAD)
WO2012123881A2 (en) * 2011-03-16 2012-09-20 Koninklijke Philips Electronics N.V. Medical instrument for examining the cervix

Family Cites Families (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GR1004180B (en) * 2000-03-28 2003-03-11 ����������� ����� ��������� (����) Method and system for characterization and mapping of tissue lesions
CA2682940A1 (en) * 2007-04-11 2008-10-23 Forth Photonics Limited A supporting structure and a workstation incorporating the supporting structure for improving, objectifying and documenting in vivo examinations of the uterus
RU2429779C2 (en) * 2009-07-22 2011-09-27 Общество с ограниченной ответственностью "Диагностика +" (ООО "Диагностика +") Diagnostic technique for human and animal organ conditions and device for its implementation
CN102298666A (en) * 2010-06-28 2011-12-28 深圳市金科威实业有限公司 Vaginoscope network system and method for image quality estimation
CN202288239U (en) * 2011-08-12 2012-07-04 三维医疗科技江苏股份有限公司 Digital gynecatoptron utilizing singlechip as core

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002025588A2 (en) * 2000-09-21 2002-03-28 Md Online Inc. Medical image processing systems
US20050235272A1 (en) * 2004-04-20 2005-10-20 General Electric Company Systems, methods and apparatus for image annotation
US20090046905A1 (en) 2005-02-03 2009-02-19 Holger Lange Uterine cervical cancer computer-aided-diagnosis (CAD)
WO2012123881A2 (en) * 2011-03-16 2012-09-20 Koninklijke Philips Electronics N.V. Medical instrument for examining the cervix

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109543719A (en) * 2018-10-30 2019-03-29 浙江大学 Uterine neck atypia lesion diagnostic model and device based on multi-modal attention model
CN109543719B (en) * 2018-10-30 2020-09-08 浙江大学 Cervical atypical lesion diagnosis model and device based on multi-modal attention model

Also Published As

Publication number Publication date
RU2659013C2 (en) 2018-06-26
CN104661584B (en) 2017-06-27
RU2015114810A (en) 2016-11-10
BR112015006004A2 (en) 2017-07-04
CN104661584A (en) 2015-05-27

Similar Documents

Publication Publication Date Title
Safuan et al. White blood cell (WBC) counting analysis in blood smear images using various color segmentation methods
JP6231885B2 (en) Medical device for examining the neck
Oh et al. Informative frame classification for endoscopy video
Suman et al. Detection and classification of bleeding region in WCE images using color feature
US8712122B2 (en) Shape based similarity of continuous wave doppler images
Tang et al. Splat feature classification: Detection of the presence of large retinal hemorrhages
Kang et al. Real-time image processing system for endoscopic applications
Cavalcanti et al. A coarse-to-fine approach for segmenting melanocytic skin lesions in standard camera images
CN110517264B (en) Nidus extraction method and device based on blood vessel segmentation
Li et al. Automated image analysis of uterine cervical images
Figueiredo et al. An intelligent system for polyp detection in wireless capsule endoscopy images
Shah Detection of tumor in MRI images using image segmentation
Manikandan et al. A cluster based segmentation of magnetic resonance images for brain tumor detection
WO2014045174A1 (en) Labeling a cervical image
Al-abayechia et al. Automatic skin lesion segmentation with optimal colour channel from dermoscopic images
CN107358224B (en) Method for detecting outer iris outline in cataract surgery
Ashame et al. Abnormality Detection in Eye Fundus Retina
JP3751914B2 (en) Medical image processing method and apparatus
Das et al. A novel humanitarian technology for early detection of cervical neoplasia: ROI extraction and SR detection
Waseem et al. Drusen detection from colored fundus images for diagnosis of age related Macular degeneration
Feroui et al. New segmentation methodology for exudate detection in color fundus images
Eswaran et al. Projection based algorithm for detecting exudates in color fundus images
Mohamed et al. Detection of melanoma using image processing techniques driven tds index
CN110009616B (en) Punctate calcification detection method
Radhi Efficient algorithm for the detection of a brain tumor from an MRI images

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 13799373

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

REG Reference to national code

Ref country code: BR

Ref legal event code: B01A

Ref document number: 112015006004

Country of ref document: BR

ENP Entry into the national phase

Ref document number: 2015114810

Country of ref document: RU

Kind code of ref document: A

122 Ep: pct application non-entry in european phase

Ref document number: 13799373

Country of ref document: EP

Kind code of ref document: A1

ENP Entry into the national phase

Ref document number: 112015006004

Country of ref document: BR

Kind code of ref document: A2

Effective date: 20150318