WO2013038331A1 - System and method for the detection of abnormalities in a biological sample - Google Patents

System and method for the detection of abnormalities in a biological sample Download PDF

Info

Publication number
WO2013038331A1
WO2013038331A1 PCT/IB2012/054708 IB2012054708W WO2013038331A1 WO 2013038331 A1 WO2013038331 A1 WO 2013038331A1 IB 2012054708 W IB2012054708 W IB 2012054708W WO 2013038331 A1 WO2013038331 A1 WO 2013038331A1
Authority
WO
WIPO (PCT)
Prior art keywords
sample
cells
cell
view
aforementioned
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Ceased
Application number
PCT/IB2012/054708
Other languages
English (en)
French (fr)
Inventor
Subhendu Seth
Sarif Kumar NAIK
Shankar Mosur VENKATESAN
Sunil Kumar
Payal Keswarpu
Sanjay Jayavanth
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Koninklijke Philips NV
Original Assignee
Koninklijke Philips Electronics NV
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Koninklijke Philips Electronics NV filed Critical Koninklijke Philips Electronics NV
Priority to EP12787088.9A priority Critical patent/EP2745111B1/en
Priority to MX2014002843A priority patent/MX346624B/es
Priority to IN1734CHN2014 priority patent/IN2014CN01734A/en
Priority to CN201280044762.0A priority patent/CN103907023B/zh
Priority to US14/343,427 priority patent/US9567651B2/en
Publication of WO2013038331A1 publication Critical patent/WO2013038331A1/en
Anticipated expiration legal-status Critical
Ceased legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/695Preprocessing, e.g. image segmentation
    • CCHEMISTRY; METALLURGY
    • C12BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
    • C12QMEASURING OR TESTING PROCESSES INVOLVING ENZYMES, NUCLEIC ACIDS OR MICROORGANISMS; COMPOSITIONS OR TEST PAPERS THEREFOR; PROCESSES OF PREPARING SUCH COMPOSITIONS; CONDITION-RESPONSIVE CONTROL IN MICROBIOLOGICAL OR ENZYMOLOGICAL PROCESSES
    • C12Q1/00Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions
    • C12Q1/70Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions involving virus or bacteriophage
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • G06T7/0014Biomedical image inspection using an image reference approach
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V20/00Scenes; Scene-specific elements
    • G06V20/60Type of objects
    • G06V20/69Microscopic objects, e.g. biological cells or cellular parts
    • G06V20/698Matching; Classification
    • GPHYSICS
    • G06COMPUTING OR CALCULATING; COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30024Cell structures in vitro; Tissue sections in vitro

Definitions

  • the invention relates to the field microscopic detection of abnormalities in a biological sample comprising cells.
  • Cancer arising from cervix is the number one cancer in women in many industrialized countries as well as emerging countries. About 30% of cancers in women are due to cervical cancer with more than 100,000 new cases diagnosed every year, e.g., in India.
  • the estimated compounded annual growth rate (CAGR) for cervical cancer cases is 2.56% and at this growth rate approximately 175,000 new cases of cervical cancer will be detected in the year 2012.
  • One of the recommended tools for screening of cervical cancer is to detect cyto logical precursors of cancer in Papanicolaou tests (also called Pap-smear, Pap-test, cervical smear, or smear test), which is a screening test used in gynecology to detect premalignant and malignant processes in the cervical canal especially in the transformation zone.
  • Papanicolaou tests also called Pap-smear, Pap-test, cervical smear, or smear test
  • a speculum is used to gather cells from the outer opening of the cervix of the uterus and the endocervix.
  • the cells are examined under a microscope to look for abnormalities.
  • the test aims to detect potentially pre-cancerous changes, which are, among others, caused by sexually transmitted human papilloma viruses.
  • the test remains an effective, widely used method for early detection of pre-cancer and cervical cancer.
  • the test may also detect infections and abnormalities in the endocervix and endometrium.
  • a method for the detection of abnormalities in a biological sample comprising cells comprises at least the following steps, or is capable to carry out, and/or comprises means capable to carry out, at least the following steps, respectively: a) acquiring an image of said sample by digital image acquisition
  • step el selecting a new field of view and carrying on with step c) if, in step d), it turns out that, in said field of view, the determination of cell aggregates is negative, or
  • step e2) carrying out further process steps if, in step d), it turns out that, in said field of view, the determination of cell aggregates is affirmative.
  • cell aggregates refers to a group of at least two cells being in physical contact with one another and forming a two- or three-dimensional cluster.
  • the determination of cell aggregates is negative means that no cell aggregates could be found in the actual field of view.
  • the term “the determination of cell aggregates is affirmative” as used herein, means that cell aggregates have been found in the actual field of view, suggesting that the actual field of view could comprise abnormal cells.
  • the process according to the invention automatically scans the sample for fields of view which are likely to comprise images of abnormal cells - which is usually the case for cells which appear in clusters, or aggregates.
  • the approach thus carries out a preselection in which only those fields of view are passed over to further analysis which comprise images of cell aggregates, while those fields of view which do not comprise images of cell aggregates are discarded, because it is unlikely that they comprise images of abnormal cells. This again saves time and reduces computational efforts.
  • this methodological approach comprises a feedback loop, which significantly reduces the computational time for complex image processing algorithms as well as it simplifies the tedious task of examining each of the cells found in the sample, namely by reducing the evaluation time.
  • the approach does not analyse the acquired image as a whole, but selects subunits of said image, which are called "field of view” herein, for image processing.
  • An overview of the described method is given in Fig. 1.
  • the cells which have the highest risk to become cancerous are ectocervical cells, while endocervical cells have a smaller risk to become cancerous (in which case an adenocarcinoma is formed).
  • Ectocervical cells are also called squamous cells, while endocervical cells are also called columnar cells.
  • the method according to the invention thus further comprises the steps of: f) determining the degree of variation of at least one given morphological feature of at least two cells in the field of view, and
  • gl classifying the sample as "likely to comprise abnormal cells” if the degree of variation of said morphological feature exceeds a predetermined threshold, or g2) classifying the sample as "likely to comprise normal cells” if the degree of variation of said morphological feature falls below a predetermined threshold.
  • classifying the sample as likely to comprise abnormal cells is equivalent to "suspecting a sample for abnormality", as shown in Fig. 2.
  • abnormal cells relates to cells which are in a process of becoming cancerous, or malignant, or are cancerous, or malignant, already.
  • said morphological feature is at least one selected from the group consisting of
  • the variability of said morphological feature can be used as a further distinguishing feature, because in abnormal cell aggregates the nucleus size varies widely, whereas in normal cell aggregates the nucleus sizes remain uniform.
  • This complimentary approach thus serves to identify abnormal cells, particularly in those regions of interest which have earlier been identified, by cell aggregation analysis, as suspicious. If the variation said morphological feature in the field of view exceeds, statistically, a given threshold, the sample can be classified as "likely to comprise abnormal cells".
  • the cell nuclei sizes in the field of view can for example be determined by calculating the respective image area, e.g., by counting the number of pixels in the respective region.
  • the variation of nuclei sizes in the field of view can for example be expressed as standard deviation of these areas, or by determining the variation in major axis or minor axis of the ellipse encircling these regions, or ratio of these values. While no fixed threshold value exists for the variation of sizes of the nuclei, thresholds can be determined a priori using ground truth data which could also vary on account other factors such as magnification, resolution of the image, etc.
  • shape relates to the two-dimensional shape of a cell nucleus image, in the field of view.
  • a cell nucleus shape is considered to have a high degree of regularity in case the shape of its image is circular, or close to circular.
  • the criterion to determine the cellular shape is by employing properties like form factor, perimeter, major axis, minor axis cell membrane signature.
  • the sample can as well be classified as likely to comprise abnormal cells.
  • the ratio of cytoplasm size, or area and nucleus size, or area, in a given cell, is another indicator which can be used in the context of the present invention. While normal cells have large cytoplasm and small nucleus, abnormal cells tend to have large nuclei and small cytoplasm.
  • the cellular Nucleus harbours the most significant changes in precancerous and cancerous cells. Hence, identifying the nucleus automatically can be a useful approach to detect abnormal cells in cervical smears.
  • the segmentation of nucleus is a challenging task due to the varied morphological appearance with clumps and artefacts (see Fig. 15).
  • the Pap smear images are blurry and highly affected by unwanted noises, e.g., blood, air artefacts (bubbles), or vagina discharge.
  • Pap- smear images of that kind may lead to an increase in false alarms whene analyzed with a segmentation algorithm.
  • Existing techniques are unable to tackle all these problems. Hence a fast and accurate nucleus segmentation technique is necessary to solve this issue.
  • the cell nucleus is therefore detected by an optical techniqe encompassing multilevel thresholding.
  • Image histograms are usually the basis for thresholding.
  • a histogram is unimodal if there is one hump, bimodal if there are two humps and multimodal if there are many humps.
  • Histograms of Pap-smear images are multimodal in nature (see, e.g., Fig. 11 A).
  • multilevel thresholding has been introduced to locate initial seeds for nucleus segmentation. This is the first and foremost common step for all the above four methods.
  • said optical technique encompassing multilevel thresholding is at least one selected from the group consisting of
  • IRMT Information gain-based Recursive Multilevel Thresholding technique
  • IGTMT Information and Graph Theory-based Multilevel Thresholding technique
  • IRMT may be used to refine the region based on local multilevel thresholding, although it may be unable to solve the boundary leak problem. Hence, local boundary adjustment is necessary to solve this problem. IGTMT may be used to fine-tune the boundary region of Pap-smear nuclei. The different approaches wuill be discussed in detail in the follwing:
  • multilevel thresholding has been introduced to locate initial seed for nucleus segmentation.
  • information gain-based local region selection and refinement technique has been introduced to fine-tune and isolate the nucleus region (see Fig. 10 (A)). If change in multilevel threshold yields abrupt change in information gain for a particular region of interest (ROI), region growing using multilevel threshing stops.
  • ROI region of interest
  • IEMT Information gain and color Edge-based Multilevel Thresholding
  • IGMT and IEMT methods are capable of finding the nucleus region in Pap- smear images.
  • region growing for a ROI based on multiple threshold levels may lead to chance of under/over segmentation of nuclei (see, e.g., Fig. 11(B)).
  • IRMT Recursive multilevel-based thresholding is introduced in IRMT to reduce the possibility of over/under segmentation of nuclei in IGMT and IEMT methods (see Fig. 7(A)).
  • IRMT consists of two major steps: (i) global seed selection, followed by (ii) local region refinement.
  • IRMT method Global seed selection of Pap-smear images as carried out in the IRMT method is identical to IGMT and IEMT. In case of a local region refinement, the IRMT method provides two major steps: (ii.a.) Selection of upper and lower bound of threshold for individual region:
  • optimal threshold t is computed using information gain and color edge for individual ROI. This optimal threshold t sometimes yields over/under segmented nuclei. Therefore, region (R u b) having gray value in-between t-1 and t+1 and connected with the ROI (R t UR t +i) is chosen for farther processing (see Fig. 11(B)). The idea behind this step is that the exact nucleus boundary lies in between this bounding region (R u b).
  • Recursive multilevel threshold for region refinement The same multilevel thresholding technique is applied on the histogram of bounding region (R u b) (see Fig. 12 (A) and (B)). Sub-thresholds trhus obtained will increase the chance of getting more refined optimal threshold using information gain and color edge-based region growing method. This will help in fine-tuning the individual ROI obtained by the IGMT or IEMT method.
  • the proposed IRMT method may sometimes fails to solve the boundary leak problem.
  • the basic idea behind the IGTMT approach is to utilize the graph cut theory for local boundary refinement (see Fig. 14 (B)).
  • global multilevel thresholding is the first step in the IGTMT method, to carry out seed initialization of the probable region of the nucleus. This is followed by the selection of upper and lower bound of threshold for individual region which is similar to the IRMT method. Thereafter, to increase the accuracy of segmentation scheme, IGTMT introduces the min cut/max flow based graph theory approach.
  • the IGTMT method uses the similarity measure based on gray level difference of neighbourhood pixels in Rub region.
  • the method further comprises the step of determining at least one feature selected from the group of
  • jazziness shall mean the variation of distance between cell boundary points from centre of the cell or a fixed reference point preferably inside the cell. High jazziness in texture can be considered as an indication of abnormality.
  • texture shall mean the spatial arrangements of colors or intensities in a nucleus or cell region. High variations in texture can be considered as an indication of abnormality.
  • fractal dimension of the nucleus relates to a statistical quantity that gives an indication of how completely a fractal appears to fill space of a given cell, as one zooms down to finer and finer scales.
  • regularity of shape of a cell and/or a employing properties like form factor, cell nucleus perimeter, major axis, minor axis cell membrane signature.
  • jazziness of a cellular membrane the variation of distance between cell boudry points from centre of the cell or a some fixed reference point prferably inside the cell
  • the method according to the invention further comprises at least one step selected from the group consisting of: a) detailed inspection of the cervix by colposcopy;
  • the method according to the invention further comprises the step of recommending further investigation by at least one step selected from the group consisting of a) detailed inspection of the cervix by colposcopy;
  • Colposcopy is a medical diagnostic procedure to examine an illuminated, magnified view of the cervix and the tissues of the vagina and vulva. Primarily in order to detect premalignant lesions and malignant lesions which may result in cancer. Colposcopy is done using a colposcope, which provides an enlarged view of the areas, allowing the colposcopist to visually distinguish normal from abnormal appearing tissue and take directed biopsies for further pathological examination. The main goal of colposcopy is to prevent cervical cancer by detecting precancerous lesions early and treating them.
  • HPV DNA test detects cervical infection with human papilloma virus
  • HPV HPV DNA test kits are today commercially available. Such test may be carried out during a routine smear test, as described above (in which case part of the smear sample is taken for the HPV DNA test, while another part is taken for the method according to the invention, or with a newly taken sample with comparable properties, and can be used to improve, confirm or falsify the diagnostic significance of the method according to the invention.
  • Biomarker tests have been developed to investigate whether or not a patient suspected to be predisposed for cervical cancer, or a patient who is suspected for having cervical cancer, or in which cervical cancer has already been diagnosed, has, in its genome or proteome, an abnormality which coincides with increased or decreased likelihood of getting a given cancer, or which coincides with increased or decreased responsiveness towards a given therapy.
  • abnormality is, for example, a mutation in a given gene, an abnormality in an epigenomic feature, like DNA methylation, or an abnormality with respect to expression of a given gene.
  • the image acquisition is carried out by means of a scanner.
  • a two dimensional imaging device can be used. In both cases the imaging device is preferably a CCD (linear or two dimensional) or a CMOS (linear or two dimensional).
  • the image acquisition is carried out by means of an optical magnification device.
  • Said optical magnification device is, for example, a microscope.
  • the method according to the invention further comprises, prior to step a), a step in which an image of the sample is acquired at lower magnification, as is the case in step a).
  • a step in which an image of the sample is acquired at lower magnification as is the case in step a).
  • an overview image is made first.
  • the low magnification slide overview is processed by the algorithm to identify the regions suspicious for abnormality and those suspected region are further scanned with higher magnification. This will provide an advantage of quick scanning of the slides.
  • steps b) and following are carried out while the digital image acquisition and/or the digital image processing is still in process.
  • this approach allows to forgo an image archive of the raw images.
  • step d) comprises at least the steps of • Segmentation of cell nuclei
  • the latter can be done by determining the inter-nuclei distance of at least two cells.
  • segmentation of cell nuclei refers to the process of partitioning a digital image comprising the image of at least one cell into multiple segments (sets of pixels in order to identify the cell nuclei. More precisely, image segmentation is the process of assigning a label to every pixel in an image such that pixels with the same label share certain visual characteristics.
  • the result of image segmentation is a set of segments that collectively cover the entire image, or a set of contours extracted from the image (see edge detection).
  • Each of the pixels in a region are similar with respect to some characteristic or computed property, such as color, intensity, or texture. Adjacent regions are significantly different with respect to the same characteristic(s).
  • the resulting contours after image segmentation can be used to create 3D reconstructions with the help of interpolation algorithms like marching cubes.
  • centroid of a cell relates to the geometric center, or barycenter, of a cell's two-dimensional image, as determined with digital image processing methods, e.g., by image moments.
  • the biological sample comprising cells is a cervical sample.
  • the method can also be used with samples from other body tissues which have to be checked for abnormalities, like breast samples, prostate samples, liver samples, lung samples and so forth.
  • the method further comprises at least one step selected from the group consisting of:
  • the method according to the invention further comprises at least one step of counting a given cell type, or updating an existing count thereof.
  • the biological sample comprising cells comprises at least one sample selected from the group consisting of
  • a smear sample is for example similar or identical to those samples used in the Papanicolaou tests (also called Pap smear, Pap test, cervical smear, or smear test).
  • a tissue slice is for example, sliced by a microtome.
  • a liquid sample can preferably consist of a suspension of cells, e.g., obtained by a smear.
  • FNAC fine needle aspiration cytology
  • abrasive cytology samples and/or exfoliated samples.
  • the term slide is used.
  • a sample is indeed placed on a slide to make it available for investigation, e.g. a tissue slice, or a smear.
  • other devices can also be used to carry a sample, e.g. a small cuvette in case the sample is a liquid sample or a cartridge in case the sample is a brush sample.
  • slice as used in the flow charts is thus by no means construed to limiting the scope of the present invention.
  • the biological sample comprising cells is stained, preferably prior to step a) of image acquisition.
  • Dyes which are preferably used comprise Pap-stain, ultra fast Pap-statin, Romanowsky-type stain, Haris Haematoxylin stain, fluorescent stains like Achrodyn Orange, and H & E stain.
  • optical and/or digital image enhancement approaches are used.
  • Optical image enhancement is preferably carried out prior to step a) of image acquisition.
  • Preferred methods comprise dark field microscopy, phase contrast, differential interference contrast (DIC) and/or reflected interference contrast (RIC).
  • Digital contrast enhancement is preferably carried out after step a) of image acquisition.
  • Preferred methods comprise bright field microscopy, for example a typical transmission microscope.
  • steps b) and following are carried out while the data related to the acquired image, or parts thereof, is still in a volatile memory.
  • volatile memory is used interchangeably with the term temporary memory, and shall be understood in such way that the data related to the acquired image are not yet stored on the hard disk or on a flash storage.
  • a preferred form of such volatile memory is a random access memory (RAM) used by the image processor, or by the computer's CPU.
  • a system for the detection of abnormalities in a biological sample comprising cells is provided.
  • the system is capable to carry out, and/or comprises means capable to carry out, at least the following steps:
  • step el selecting a new field of view and carrying on with step c) if, in step d), it turns out that, in said field of view, the determination of cell aggregates is negative, or
  • step e2) carrying out further process steps if, in step d), it turns out that, in said field of view, the determination of cell aggregates is affirmative.
  • said system is further capable to carry out, and/or comprises further means capable to carry out said the steps of: f) determining the degree of variation of at least one given morphological feature of at least two cells in the field of view, and
  • gl classifying the sample as "likely to comprise abnormal cells” if the degree of variation of said morphological feature exceeds a predetermined threshold, or g2) classifying the sample as "likely to comprise normal cells” if the degree of variation of said morphological feature falls below a predetermined threshold.
  • said system is preferably capable to carry out, and/or comprises further means capable to carry out the other method steps discussed above.
  • a device for the detection of abnormalities in a biological sample comprising cells comprises at least the following items:
  • a user interface comprising at least one output means and one input means.
  • Said output means is preferably a display, or a touch screen, while said input means is preferably an array of keys, or buttons, or a touchscreen.
  • the method according to the invention is not restricted to the use in such device. It can also be used "stand-alone" for the detection of locations/regions in a slide or set of images being suspected to contain images of abnormal cells.
  • the device according to the invention further comprises at least one optical magnification unit.
  • the device according to the invention further comprises at least one interface for connecting the device with other equipment.
  • Such interface is, preferably, a GSM interface, a 3G interface, a USB interface, a Bluetooth interface, a Firewire interface and/or a WiFi interface, hypertext terminal, etc.
  • the device according to the invention further comprises at least one sample collector and/or at least one cartridge in which the sample is transferred, said cartridge being disposed for placement in the sample receiving unit.
  • the system are device discussed above is preferably in the form of a point of are device (POC).
  • POC point of are device
  • it is provided as a handheld or desktop unit. Even more preferably, it is battery driven and/or portable.
  • Fig. 1 shows a flow diagram identifying regions of interest for the presence or absence of cell aggregates.
  • Fig. 2 shows a flow diagram for distinguishing whether or not identified cell aggregates comprise abnormal cells or normal cells (termed “endocervical cells” here, which is, strictly speaking, clinically imprecise, because endocervical cells can also become malignant).
  • Fig. 3 shows an artificially created example of a Pap smear image created to explain the envisaged concept.
  • Fig. 4 shows the segmentation of the cells and the corresponding nuclei.
  • Fig. 5 shows results after clustering, i.e., the cluster number and an inner rectangle showing the region of interest for possible abnormality.
  • Fig. 6 shows the envisaged system according to the invention, and its work flow.
  • Figs. 7 and 8 show flow diagrams comprising an alternative approach to identify regions of interest.
  • Fig. 9 shows the Evolution of the Pap-smear nucleus segmentation techniques, from IGMT and IEMT toIGTMT and IRMT.
  • Fig. 10 shows flow diagrams of (A) IGMT and (B) IEMT technique for Pap- smear nucleus segmentation.
  • Fig. 11 shows multiple threshold levels in in a Papsmear image histogram, and the resulting segmentation.
  • R t _i is a single image region below t-l th threshold as seen in Fig. 11 (A)
  • R t is the region having gray value in-between t-l th and t th threshold as seen in Fig. 11 (A)
  • R t +i is region having gray value in-between t th and t+l th threshold as seen in Fig. 11 (A).
  • the actual region boundary of the nucleus is marked by an arrow.
  • Fig.12 shows again multiple threshold levels in in a Papsmear image histogram, and the resulting segmentation.
  • Fig. 12 (A) shows recursive multiple threshold levels T rl to T rM in ascending order between t-l th and t+l th threshold of Fig. 11 (A).
  • Fig. 12 (B) shows regions thresholded by levels T rl to T rM .
  • Fig. 13 shows R t _i and outside the region R t +i presented as source and sink respectively indicating the flow of a directed graph.
  • Fig. 14 shows flow diagrams of (A) IRMT and (A) IGTMT for Pap-smear nucleus segmentation.
  • Fig. 15 shows a Pap-smear image showing overlapping nucleus along with their intensity variation (in white circle) and focused region (marked in black arrow) and unfocused region (marked in white arrow).
  • Figs. 1 and 2 show flow charts which have been described in the text already.
  • Fig. 3 shows an artificially created example of a Pap smear image to explain the concept of the present invention.
  • the cytoplasm parts of the cells stick together, and the nuclei of the cells are very close to one another (small inter- nuclei distance).
  • Inter-nuclei distance mapping is thus used in the algorithmic identification process to identify abnormal cells, particularly in those regions of interest which have earlier been identified, by cell aggregation analysis, as suspicious.
  • Fig. 4 shows the result of the segmentation of the cells and the corresponding nuclei. Based on the subsequent algorithms, regions of interest can be determined which are highly suspicious to comprise abnormal cells.
  • Fig. 5 shows the results of such process clustering. Two different clusters have been identified, wherein cluster No 2 - marked by a rectangle - is likely to comprise abnormal cells, due to (i) extensive cell clustering, (ii) high variation of nuclei sizes, and (iii) small inter-nuclei distances.
  • Fig. 6 shows a system and work flow according to the present invention.
  • the sample is collected by means of a sample collector 61, which may adopt the shape of a brush, similar to a Q-tip, and is transferred to a cartridge 62 which is disposed for placement in the sample receiving unit 63 of a device 64 according to the invention.
  • the device is shown in form of a portable point of care device.
  • the sample can be stained in between.
  • the sample is then scanned by the optical magnification unit and the image acquisition device unit present in the device.
  • an input means 65 which is embodied, herein, as an array of keys
  • the device acquires an image from the sample in the cartridge and passes it to the algorithm embedded into the system.
  • the method steps according to the invention are accomplished, and results of the analysis are shown on output means 66, which is embodied, herein, as a display screen.
  • Figs. 7 and 8 show flow diagrams comprising a more elaborated approach to identify regions of interest which may be likely to comprise abnormal cells.
  • the main focus is to identify the cellular regions and find cell aggregates. Once the latter are identified the algorithm passes the respective field of view to further analysis, as explained in Fig. 8.
  • Box 1 of Fig. 7 the system initiation is done. Here, essentially, the system resets and arrives at a reference position, clears all the buffers, etc.
  • a cytology sample is loaded, in most cases as a slide (see above), and the initiation for cell count of all type of cells, such as normal/abnormal squamous cells and their types, and normal/abnormal endo- cervical cells, is initiated, and the respective result is stored.
  • a scan strategy is chosen. The scan strategy involves the selection of step size of the movement of the sample in x and y direction and the focus depth (z direction) relative to the imaging devices (i.e., either the sample or the imaging device is moved), and the selection of magnification, contrast, etc. Further, the system starts reading the sample/slide, and the images are acquired.
  • the quality parameter of the slide/images are estimated.
  • the quality parameters are checked for their adequacy (by comparing with a priori data). If the quality is not adequate, the system goes in the loop to check the scope for up-gradation in Box 13. If there is scope to upgrade the scan strategy (i.e, if the scan parameters are within the defined range of the system), then the system provides an on-the-fly feedback to change the scan strategy (Box 12). If there is no scope for upgrading the scan parameters, a report is generated (Box 14) and the systems stops or goes for the next slide (Box 15).
  • the actual field of view comprises only normal squamous cell, and their number is counted.
  • the cells which are not comprised in clusters are assumed to be normal, given the fact that significant abnormalities are rather found in clustered cells than in isolated cells. If in Box 10 clusters are found, they are suspected for abnormality and the system passes the image of the actual field of view, or other data related to the said clusters, for detailed analysis to link 1 in Fig. 8. If in the respective field of view isolated cells as well as clusters of cells have been determined, the image of the actual field of view, or other data related to the said clusters, are passed for further processing in Fig. 8, while isolated cells are just counted.
  • the system checks if there is any other field of view left to be scanned in Box 11. If yes, the system scans the next field of view and repeats the above described process. If all the fields of view are completed the system generates a report on the actual sample (estimation of abnormality, its severity, type of carcinoma, number of cells etc.) and stops, or moves to the next sample in Box 16.
  • Images of a field of view comprising clusters, or other data related to the said clusters, are then passed on to the algorithm in Fig. 8.
  • the morphological features in each cell of a given cluster are extracted to measure the variability of these features (Box 2 and Box 3). If the measurements are not in an abnormal range (Box 4), then the cell cluster is suspected to comprise normal endocervical cells (Box 11), hence a confirmatory test is done (Box 12). If the assumption is true then the count of normal endocervical cells is done in Box 14. If not, the sample is considered to comprise squamous cells, and a count for squamous cells is done in Box 13.

Landscapes

  • Engineering & Computer Science (AREA)
  • Health & Medical Sciences (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Chemical & Material Sciences (AREA)
  • Molecular Biology (AREA)
  • Organic Chemistry (AREA)
  • Biomedical Technology (AREA)
  • Multimedia (AREA)
  • Immunology (AREA)
  • Proteomics, Peptides & Aminoacids (AREA)
  • Zoology (AREA)
  • Wood Science & Technology (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Medical Informatics (AREA)
  • Biophysics (AREA)
  • Microbiology (AREA)
  • Biotechnology (AREA)
  • Biochemistry (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • General Engineering & Computer Science (AREA)
  • Genetics & Genomics (AREA)
  • Analytical Chemistry (AREA)
  • Virology (AREA)
  • Investigating Or Analysing Biological Materials (AREA)
  • Measuring Or Testing Involving Enzymes Or Micro-Organisms (AREA)
PCT/IB2012/054708 2011-09-13 2012-09-11 System and method for the detection of abnormalities in a biological sample Ceased WO2013038331A1 (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
EP12787088.9A EP2745111B1 (en) 2011-09-13 2012-09-11 System and method for the detection of precancer or cancer cells in a biological sample
MX2014002843A MX346624B (es) 2011-09-13 2012-09-11 Sistema y metodo para la deteccion de anormalidades en una muestra biologica.
IN1734CHN2014 IN2014CN01734A (enExample) 2011-09-13 2012-09-11
CN201280044762.0A CN103907023B (zh) 2011-09-13 2012-09-11 检测生物学样品中的异常的系统和方法
US14/343,427 US9567651B2 (en) 2011-09-13 2012-09-11 System and method for the detection of abnormalities in a biological sample

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US201161534031P 2011-09-13 2011-09-13
US61/534,031 2011-09-13

Publications (1)

Publication Number Publication Date
WO2013038331A1 true WO2013038331A1 (en) 2013-03-21

Family

ID=47178777

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/IB2012/054708 Ceased WO2013038331A1 (en) 2011-09-13 2012-09-11 System and method for the detection of abnormalities in a biological sample

Country Status (6)

Country Link
US (1) US9567651B2 (enExample)
EP (1) EP2745111B1 (enExample)
CN (1) CN103907023B (enExample)
IN (1) IN2014CN01734A (enExample)
MX (1) MX346624B (enExample)
WO (1) WO2013038331A1 (enExample)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3817652A4 (en) * 2018-07-06 2021-08-25 Enzyvant Therapeutics GmbH DETERMINATION OF TISSUE POWER BY QUANTITATIVE HISTOMORPHOLOGICAL ANALYSIS

Families Citing this family (31)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JP6143365B2 (ja) * 2014-03-05 2017-06-07 富士フイルム株式会社 細胞画像評価装置および方法並びにプログラム
GB2530252B (en) * 2014-09-10 2020-04-01 Smiths Heimann Sas Determination of a degree of homogeneity in images
CA2965564C (en) * 2014-11-10 2024-01-02 Ventana Medical Systems, Inc. Classifying nuclei in histology images
US20180253590A1 (en) * 2015-03-20 2018-09-06 Inspirata, Inc. Systems, methods, and apparatuses for digital histopathological imaging for prescreened detection of cancer and other abnormalities
CN106290169A (zh) * 2015-05-29 2017-01-04 深圳市搜罗盟网络科技有限公司 一种癌症检测设备
EP3395937B1 (en) * 2015-12-22 2025-08-20 Nikon Corporation Image processing apparatus
WO2017110974A1 (ja) * 2015-12-24 2017-06-29 コニカミノルタ株式会社 画像処理装置及びプログラム
TWI594207B (zh) * 2016-04-26 2017-08-01 財團法人金屬工業研究發展中心 細胞核影像輪廓擷取裝置及其方法
RU2647675C1 (ru) * 2016-10-26 2018-03-16 Федеральное государственное казенное военное образовательное учреждение высшего образования "Военный учебно-научный центр Военно-воздушных сил "Военно-воздушная академия имени профессора Н.Е. Жуковского и Ю.А. Гагарина" (г. Воронеж) Министерства обороны Российской Федерации Способ измерения морфологической мультифрактальной сигнатуры
CN106479880B (zh) * 2016-11-01 2019-06-04 上海市同仁医院 一种人乳头瘤病毒结果判读装置
JP6886306B2 (ja) * 2017-02-02 2021-06-16 オリンパス株式会社 位相分布算出方法、評価方法、画像処理装置、画像処理システム、プログラム
CN108693342A (zh) * 2017-12-13 2018-10-23 青岛汉朗智能医疗科技有限公司 宫颈癌、子宫癌的检测方法及系统
CN110135221A (zh) * 2018-02-08 2019-08-16 佛山市水木联合医疗器械研究院 一种利用标准细胞库图像识别样本细胞的方法
FR3079617B1 (fr) * 2018-03-29 2023-12-22 Office National Detude Et De Rech Aerospatiales Onera Methode de detection de cellules presentant au moins une anomalie dans un echantillon cytologique
US10950016B2 (en) 2018-06-11 2021-03-16 Shanghai United Imaging Healthcare Co., Ltd. Systems and methods for reconstructing cardiac images
JP7164978B2 (ja) * 2018-06-29 2022-11-02 キヤノン株式会社 粒子測定方法、粒子測定装置及び核酸濃度測定システム
CN108961249A (zh) * 2018-07-19 2018-12-07 厦门理工学院 一种子宫颈癌细胞再识别诊断方法
EP3611695A1 (en) * 2018-08-15 2020-02-19 Koninklijke Philips N.V. Generating annotation data of tissue images
KR20210113236A (ko) * 2018-12-18 2021-09-15 패스웨어 인코포레이티드 병리학 시료의 자동화된 이미징 및 분석을 위한 컴퓨터 사용 현미경 검사 기반의 시스템 및 방법
CN113544490B (zh) * 2019-03-29 2024-07-02 贝克顿·迪金森公司 用于颗粒辨别的参数
CN110210578B (zh) * 2019-06-19 2021-11-16 四川智动木牛智能科技有限公司 基于图论的宫颈癌组织病理学显微图像聚类系统
CN110400281B (zh) * 2019-08-05 2021-06-01 山东志盈医学科技有限公司 一种数字切片扫描仪中图像增强方法
CN110853022B (zh) * 2019-11-14 2020-11-06 腾讯科技(深圳)有限公司 病理切片图像的处理方法、装置、系统及存储介质
CN111275191B (zh) * 2020-02-26 2023-11-28 上海商汤智能科技有限公司 检测细胞的方法及装置、电子设备和存储介质
CN112233060B (zh) * 2020-09-04 2024-03-29 广州金域医学检验中心有限公司 数字病理图像异常样本的筛选方法、装置、设备及介质
CN114428076A (zh) * 2020-09-29 2022-05-03 中国石油化工股份有限公司 聚合物改性沥青的储存稳定性判定方法和质量控制方法
CN112378727A (zh) * 2020-12-14 2021-02-19 湖南莱博赛医用机器人有限公司 基于机器视觉的dna倍体定量分析装置及其应用方法
WO2024063671A1 (ru) * 2022-09-21 2024-03-28 Ооо "Хоспитекс Диагностикс" Система дая цитологического анализа патологии шейки матки
CN117787864B (zh) * 2023-12-27 2024-10-15 石家庄博瑞迪生物技术有限公司 一种动物组织采样管溯源入库管理方法
CN119741248B (zh) * 2024-09-20 2025-11-18 四川大学 一种类器官细胞聚集实时监测及动态分析方法
CN120125582A (zh) * 2025-05-13 2025-06-10 大熊(天津)医疗科技有限公司 一种医学细胞检测方法

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5740270A (en) 1988-04-08 1998-04-14 Neuromedical Systems, Inc. Automated cytological specimen classification system and method
US5257182B1 (en) 1991-01-29 1996-05-07 Neuromedical Systems Inc Morphological classification system and method
US6026174A (en) 1992-10-14 2000-02-15 Accumed International, Inc. System and method for automatically detecting malignant cells and cells having malignancy-associated changes
WO1996009594A1 (en) 1994-09-20 1996-03-28 Neopath, Inc. Apparatus for automated identification of thick cell groupings on a biological specimen
AU3586195A (en) 1994-09-20 1996-04-09 Neopath, Inc. Apparatus for automated identification of cell groupings on a biological specimen
WO1996009600A1 (en) 1994-09-20 1996-03-28 Neopath, Inc. Apparatus for identification and integration of multiple cell patterns
AUPP278698A0 (en) 1998-04-03 1998-04-30 University Of Queensland, The Method of cell nuclei segmentation
US6379907B1 (en) * 1999-08-05 2002-04-30 The Regents Of The University Of California Diagnostic method using expression of MN/CA9 protein in AGUS Pap smears
US7274809B2 (en) * 2002-08-29 2007-09-25 Perceptronix Medical, Inc. And British Columbia Cancer Agency Computerized methods and systems related to the detection of malignancy-associated changes (MAC) to detect cancer
CN101059505A (zh) * 2007-05-28 2007-10-24 宋士明 一种活细胞技术检查宫颈癌细胞的方法

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
BOZZO J ET AL: "Red blood cell aggregability is increased by aspirin and flow stress, whereas dipyridamole induces cell shape alterations: measurements by digital image analysis.", EUROPEAN JOURNAL OF CLINICAL INVESTIGATION SEP 1996, vol. 26, no. 9, September 1996 (1996-09-01), pages 747 - 754, XP002690034, ISSN: 0014-2972 *
FOWLER J D ET AL: "Hydraulic permeability of immobilized bacterial cell aggregates.", APPLIED AND ENVIRONMENTAL MICROBIOLOGY JAN 1991, vol. 57, no. 1, January 1991 (1991-01-01), pages 102 - 113, XP002690036, ISSN: 0099-2240 *
MUNN L L ET AL: "Analysis of lymphocyte aggregation using digital image analysis", JOURNAL OF IMMUNOLOGICAL METHODS, ELSEVIER SCIENCE PUBLISHERS B.V.,AMSTERDAM, NL, vol. 166, no. 1, 5 November 1993 (1993-11-05), pages 11 - 25, XP023992808, ISSN: 0022-1759, [retrieved on 19931105], DOI: 10.1016/0022-1759(93)90324-Z *
SHAPIRO AMOS ET AL: "Raman molecular imaging: a novel spectroscopic technique for diagnosis of bladder cancer in urine specimens.", EUROPEAN UROLOGY JAN 2011, vol. 59, no. 1, January 2011 (2011-01-01), pages 106 - 112, XP002690035, ISSN: 1873-7560 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP3817652A4 (en) * 2018-07-06 2021-08-25 Enzyvant Therapeutics GmbH DETERMINATION OF TISSUE POWER BY QUANTITATIVE HISTOMORPHOLOGICAL ANALYSIS

Also Published As

Publication number Publication date
EP2745111B1 (en) 2016-06-29
US9567651B2 (en) 2017-02-14
EP2745111A1 (en) 2014-06-25
CN103907023A (zh) 2014-07-02
MX2014002843A (es) 2014-07-09
US20140227682A1 (en) 2014-08-14
MX346624B (es) 2017-03-27
IN2014CN01734A (enExample) 2015-05-29
CN103907023B (zh) 2016-10-05

Similar Documents

Publication Publication Date Title
US9567651B2 (en) System and method for the detection of abnormalities in a biological sample
Demir et al. Automated cancer diagnosis based on histopathological images: a systematic survey
Belsare et al. Histopathological image analysis using image processing techniques: An overview
US20190042826A1 (en) Automatic nuclei segmentation in histopathology images
US9842391B2 (en) Method and apparatus for processing an image of a tissue sample
TWI379248B (en) Methods and systems for processing biological specimens utilizing multiple wavelengths
US8891850B2 (en) System and methods for digital evaluation of cellblock preparations
JP2023030033A (ja) デジタル病理学分析結果の格納および読み出し方法
CN101167101A (zh) 自动图像分析
WO2007119204A2 (en) Method for processing biomedical images
US7865000B2 (en) Medical image processing apparatus for analyzing properties of living body based on image data thereof
López et al. Digital image analysis in breast cancer: an example of an automated methodology and the effects of image compression
Wang et al. Automated analysis of fluorescent in situ hybridization (FISH) labeled genetic biomarkers in assisting cervical cancer diagnosis
Naghdy et al. Cervical cancer classification using Gabor filters
Shirazi et al. Automated pathology image analysis
Razavi et al. Automatically diagnosing HER2 amplification status for breast cancer patients using large FISH images
Ko et al. A computer-aided grading system of breast carcinoma: scoring of tubule formation
Schilling et al. Towards rapid cervical cancer diagnosis: automated detection and classification of pathologic cells in phase-contrast images
Forsberg et al. Evaluating cell nuclei segmentation for use on whole-slide images in lung cytology
Lu et al. Efficient epidermis segmentation for whole slide skin histopathological images
Edwards et al. Segmentation of biological cell images for sonification
Li et al. Detection of epithelial versus mesenchymal regions in 2D images of tumor biopsies using shearlets
WO2024186756A2 (en) System and method for biomarker detection
Shete et al. Breast cancer cell detection using digital image processing
Alomari et al. Adaptive Localization of Focus Point Regions via Random Patch Probabilistic Density from Whole‐Slide, Ki‐67‐Stained Brain Tumor Tissue

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 12787088

Country of ref document: EP

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 2012787088

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 14343427

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: MX/A/2014/002843

Country of ref document: MX

NENP Non-entry into the national phase

Ref country code: DE