WO2013038331A1 - System and method for the detection of abnormalities in a biological sample - Google Patents
System and method for the detection of abnormalities in a biological sample Download PDFInfo
- Publication number
- WO2013038331A1 WO2013038331A1 PCT/IB2012/054708 IB2012054708W WO2013038331A1 WO 2013038331 A1 WO2013038331 A1 WO 2013038331A1 IB 2012054708 W IB2012054708 W IB 2012054708W WO 2013038331 A1 WO2013038331 A1 WO 2013038331A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- sample
- cells
- cell
- view
- aforementioned
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Ceased
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
- G06V20/695—Preprocessing, e.g. image segmentation
-
- C—CHEMISTRY; METALLURGY
- C12—BIOCHEMISTRY; BEER; SPIRITS; WINE; VINEGAR; MICROBIOLOGY; ENZYMOLOGY; MUTATION OR GENETIC ENGINEERING
- C12Q—MEASURING OR TESTING PROCESSES INVOLVING ENZYMES, NUCLEIC ACIDS OR MICROORGANISMS; COMPOSITIONS OR TEST PAPERS THEREFOR; PROCESSES OF PREPARING SUCH COMPOSITIONS; CONDITION-RESPONSIVE CONTROL IN MICROBIOLOGICAL OR ENZYMOLOGICAL PROCESSES
- C12Q1/00—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions
- C12Q1/70—Measuring or testing processes involving enzymes, nucleic acids or microorganisms; Compositions therefor; Processes of preparing such compositions involving virus or bacteriophage
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
- G06T7/0014—Biomedical image inspection using an image reference approach
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
- G06V20/00—Scenes; Scene-specific elements
- G06V20/60—Type of objects
- G06V20/69—Microscopic objects, e.g. biological cells or cellular parts
- G06V20/698—Matching; Classification
-
- G—PHYSICS
- G06—COMPUTING OR CALCULATING; COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30024—Cell structures in vitro; Tissue sections in vitro
Definitions
- the invention relates to the field microscopic detection of abnormalities in a biological sample comprising cells.
- Cancer arising from cervix is the number one cancer in women in many industrialized countries as well as emerging countries. About 30% of cancers in women are due to cervical cancer with more than 100,000 new cases diagnosed every year, e.g., in India.
- the estimated compounded annual growth rate (CAGR) for cervical cancer cases is 2.56% and at this growth rate approximately 175,000 new cases of cervical cancer will be detected in the year 2012.
- One of the recommended tools for screening of cervical cancer is to detect cyto logical precursors of cancer in Papanicolaou tests (also called Pap-smear, Pap-test, cervical smear, or smear test), which is a screening test used in gynecology to detect premalignant and malignant processes in the cervical canal especially in the transformation zone.
- Papanicolaou tests also called Pap-smear, Pap-test, cervical smear, or smear test
- a speculum is used to gather cells from the outer opening of the cervix of the uterus and the endocervix.
- the cells are examined under a microscope to look for abnormalities.
- the test aims to detect potentially pre-cancerous changes, which are, among others, caused by sexually transmitted human papilloma viruses.
- the test remains an effective, widely used method for early detection of pre-cancer and cervical cancer.
- the test may also detect infections and abnormalities in the endocervix and endometrium.
- a method for the detection of abnormalities in a biological sample comprising cells comprises at least the following steps, or is capable to carry out, and/or comprises means capable to carry out, at least the following steps, respectively: a) acquiring an image of said sample by digital image acquisition
- step el selecting a new field of view and carrying on with step c) if, in step d), it turns out that, in said field of view, the determination of cell aggregates is negative, or
- step e2) carrying out further process steps if, in step d), it turns out that, in said field of view, the determination of cell aggregates is affirmative.
- cell aggregates refers to a group of at least two cells being in physical contact with one another and forming a two- or three-dimensional cluster.
- the determination of cell aggregates is negative means that no cell aggregates could be found in the actual field of view.
- the term “the determination of cell aggregates is affirmative” as used herein, means that cell aggregates have been found in the actual field of view, suggesting that the actual field of view could comprise abnormal cells.
- the process according to the invention automatically scans the sample for fields of view which are likely to comprise images of abnormal cells - which is usually the case for cells which appear in clusters, or aggregates.
- the approach thus carries out a preselection in which only those fields of view are passed over to further analysis which comprise images of cell aggregates, while those fields of view which do not comprise images of cell aggregates are discarded, because it is unlikely that they comprise images of abnormal cells. This again saves time and reduces computational efforts.
- this methodological approach comprises a feedback loop, which significantly reduces the computational time for complex image processing algorithms as well as it simplifies the tedious task of examining each of the cells found in the sample, namely by reducing the evaluation time.
- the approach does not analyse the acquired image as a whole, but selects subunits of said image, which are called "field of view” herein, for image processing.
- An overview of the described method is given in Fig. 1.
- the cells which have the highest risk to become cancerous are ectocervical cells, while endocervical cells have a smaller risk to become cancerous (in which case an adenocarcinoma is formed).
- Ectocervical cells are also called squamous cells, while endocervical cells are also called columnar cells.
- the method according to the invention thus further comprises the steps of: f) determining the degree of variation of at least one given morphological feature of at least two cells in the field of view, and
- gl classifying the sample as "likely to comprise abnormal cells” if the degree of variation of said morphological feature exceeds a predetermined threshold, or g2) classifying the sample as "likely to comprise normal cells” if the degree of variation of said morphological feature falls below a predetermined threshold.
- classifying the sample as likely to comprise abnormal cells is equivalent to "suspecting a sample for abnormality", as shown in Fig. 2.
- abnormal cells relates to cells which are in a process of becoming cancerous, or malignant, or are cancerous, or malignant, already.
- said morphological feature is at least one selected from the group consisting of
- the variability of said morphological feature can be used as a further distinguishing feature, because in abnormal cell aggregates the nucleus size varies widely, whereas in normal cell aggregates the nucleus sizes remain uniform.
- This complimentary approach thus serves to identify abnormal cells, particularly in those regions of interest which have earlier been identified, by cell aggregation analysis, as suspicious. If the variation said morphological feature in the field of view exceeds, statistically, a given threshold, the sample can be classified as "likely to comprise abnormal cells".
- the cell nuclei sizes in the field of view can for example be determined by calculating the respective image area, e.g., by counting the number of pixels in the respective region.
- the variation of nuclei sizes in the field of view can for example be expressed as standard deviation of these areas, or by determining the variation in major axis or minor axis of the ellipse encircling these regions, or ratio of these values. While no fixed threshold value exists for the variation of sizes of the nuclei, thresholds can be determined a priori using ground truth data which could also vary on account other factors such as magnification, resolution of the image, etc.
- shape relates to the two-dimensional shape of a cell nucleus image, in the field of view.
- a cell nucleus shape is considered to have a high degree of regularity in case the shape of its image is circular, or close to circular.
- the criterion to determine the cellular shape is by employing properties like form factor, perimeter, major axis, minor axis cell membrane signature.
- the sample can as well be classified as likely to comprise abnormal cells.
- the ratio of cytoplasm size, or area and nucleus size, or area, in a given cell, is another indicator which can be used in the context of the present invention. While normal cells have large cytoplasm and small nucleus, abnormal cells tend to have large nuclei and small cytoplasm.
- the cellular Nucleus harbours the most significant changes in precancerous and cancerous cells. Hence, identifying the nucleus automatically can be a useful approach to detect abnormal cells in cervical smears.
- the segmentation of nucleus is a challenging task due to the varied morphological appearance with clumps and artefacts (see Fig. 15).
- the Pap smear images are blurry and highly affected by unwanted noises, e.g., blood, air artefacts (bubbles), or vagina discharge.
- Pap- smear images of that kind may lead to an increase in false alarms whene analyzed with a segmentation algorithm.
- Existing techniques are unable to tackle all these problems. Hence a fast and accurate nucleus segmentation technique is necessary to solve this issue.
- the cell nucleus is therefore detected by an optical techniqe encompassing multilevel thresholding.
- Image histograms are usually the basis for thresholding.
- a histogram is unimodal if there is one hump, bimodal if there are two humps and multimodal if there are many humps.
- Histograms of Pap-smear images are multimodal in nature (see, e.g., Fig. 11 A).
- multilevel thresholding has been introduced to locate initial seeds for nucleus segmentation. This is the first and foremost common step for all the above four methods.
- said optical technique encompassing multilevel thresholding is at least one selected from the group consisting of
- IRMT Information gain-based Recursive Multilevel Thresholding technique
- IGTMT Information and Graph Theory-based Multilevel Thresholding technique
- IRMT may be used to refine the region based on local multilevel thresholding, although it may be unable to solve the boundary leak problem. Hence, local boundary adjustment is necessary to solve this problem. IGTMT may be used to fine-tune the boundary region of Pap-smear nuclei. The different approaches wuill be discussed in detail in the follwing:
- multilevel thresholding has been introduced to locate initial seed for nucleus segmentation.
- information gain-based local region selection and refinement technique has been introduced to fine-tune and isolate the nucleus region (see Fig. 10 (A)). If change in multilevel threshold yields abrupt change in information gain for a particular region of interest (ROI), region growing using multilevel threshing stops.
- ROI region of interest
- IEMT Information gain and color Edge-based Multilevel Thresholding
- IGMT and IEMT methods are capable of finding the nucleus region in Pap- smear images.
- region growing for a ROI based on multiple threshold levels may lead to chance of under/over segmentation of nuclei (see, e.g., Fig. 11(B)).
- IRMT Recursive multilevel-based thresholding is introduced in IRMT to reduce the possibility of over/under segmentation of nuclei in IGMT and IEMT methods (see Fig. 7(A)).
- IRMT consists of two major steps: (i) global seed selection, followed by (ii) local region refinement.
- IRMT method Global seed selection of Pap-smear images as carried out in the IRMT method is identical to IGMT and IEMT. In case of a local region refinement, the IRMT method provides two major steps: (ii.a.) Selection of upper and lower bound of threshold for individual region:
- optimal threshold t is computed using information gain and color edge for individual ROI. This optimal threshold t sometimes yields over/under segmented nuclei. Therefore, region (R u b) having gray value in-between t-1 and t+1 and connected with the ROI (R t UR t +i) is chosen for farther processing (see Fig. 11(B)). The idea behind this step is that the exact nucleus boundary lies in between this bounding region (R u b).
- Recursive multilevel threshold for region refinement The same multilevel thresholding technique is applied on the histogram of bounding region (R u b) (see Fig. 12 (A) and (B)). Sub-thresholds trhus obtained will increase the chance of getting more refined optimal threshold using information gain and color edge-based region growing method. This will help in fine-tuning the individual ROI obtained by the IGMT or IEMT method.
- the proposed IRMT method may sometimes fails to solve the boundary leak problem.
- the basic idea behind the IGTMT approach is to utilize the graph cut theory for local boundary refinement (see Fig. 14 (B)).
- global multilevel thresholding is the first step in the IGTMT method, to carry out seed initialization of the probable region of the nucleus. This is followed by the selection of upper and lower bound of threshold for individual region which is similar to the IRMT method. Thereafter, to increase the accuracy of segmentation scheme, IGTMT introduces the min cut/max flow based graph theory approach.
- the IGTMT method uses the similarity measure based on gray level difference of neighbourhood pixels in Rub region.
- the method further comprises the step of determining at least one feature selected from the group of
- jazziness shall mean the variation of distance between cell boundary points from centre of the cell or a fixed reference point preferably inside the cell. High jazziness in texture can be considered as an indication of abnormality.
- texture shall mean the spatial arrangements of colors or intensities in a nucleus or cell region. High variations in texture can be considered as an indication of abnormality.
- fractal dimension of the nucleus relates to a statistical quantity that gives an indication of how completely a fractal appears to fill space of a given cell, as one zooms down to finer and finer scales.
- regularity of shape of a cell and/or a employing properties like form factor, cell nucleus perimeter, major axis, minor axis cell membrane signature.
- jazziness of a cellular membrane the variation of distance between cell boudry points from centre of the cell or a some fixed reference point prferably inside the cell
- the method according to the invention further comprises at least one step selected from the group consisting of: a) detailed inspection of the cervix by colposcopy;
- the method according to the invention further comprises the step of recommending further investigation by at least one step selected from the group consisting of a) detailed inspection of the cervix by colposcopy;
- Colposcopy is a medical diagnostic procedure to examine an illuminated, magnified view of the cervix and the tissues of the vagina and vulva. Primarily in order to detect premalignant lesions and malignant lesions which may result in cancer. Colposcopy is done using a colposcope, which provides an enlarged view of the areas, allowing the colposcopist to visually distinguish normal from abnormal appearing tissue and take directed biopsies for further pathological examination. The main goal of colposcopy is to prevent cervical cancer by detecting precancerous lesions early and treating them.
- HPV DNA test detects cervical infection with human papilloma virus
- HPV HPV DNA test kits are today commercially available. Such test may be carried out during a routine smear test, as described above (in which case part of the smear sample is taken for the HPV DNA test, while another part is taken for the method according to the invention, or with a newly taken sample with comparable properties, and can be used to improve, confirm or falsify the diagnostic significance of the method according to the invention.
- Biomarker tests have been developed to investigate whether or not a patient suspected to be predisposed for cervical cancer, or a patient who is suspected for having cervical cancer, or in which cervical cancer has already been diagnosed, has, in its genome or proteome, an abnormality which coincides with increased or decreased likelihood of getting a given cancer, or which coincides with increased or decreased responsiveness towards a given therapy.
- abnormality is, for example, a mutation in a given gene, an abnormality in an epigenomic feature, like DNA methylation, or an abnormality with respect to expression of a given gene.
- the image acquisition is carried out by means of a scanner.
- a two dimensional imaging device can be used. In both cases the imaging device is preferably a CCD (linear or two dimensional) or a CMOS (linear or two dimensional).
- the image acquisition is carried out by means of an optical magnification device.
- Said optical magnification device is, for example, a microscope.
- the method according to the invention further comprises, prior to step a), a step in which an image of the sample is acquired at lower magnification, as is the case in step a).
- a step in which an image of the sample is acquired at lower magnification as is the case in step a).
- an overview image is made first.
- the low magnification slide overview is processed by the algorithm to identify the regions suspicious for abnormality and those suspected region are further scanned with higher magnification. This will provide an advantage of quick scanning of the slides.
- steps b) and following are carried out while the digital image acquisition and/or the digital image processing is still in process.
- this approach allows to forgo an image archive of the raw images.
- step d) comprises at least the steps of • Segmentation of cell nuclei
- the latter can be done by determining the inter-nuclei distance of at least two cells.
- segmentation of cell nuclei refers to the process of partitioning a digital image comprising the image of at least one cell into multiple segments (sets of pixels in order to identify the cell nuclei. More precisely, image segmentation is the process of assigning a label to every pixel in an image such that pixels with the same label share certain visual characteristics.
- the result of image segmentation is a set of segments that collectively cover the entire image, or a set of contours extracted from the image (see edge detection).
- Each of the pixels in a region are similar with respect to some characteristic or computed property, such as color, intensity, or texture. Adjacent regions are significantly different with respect to the same characteristic(s).
- the resulting contours after image segmentation can be used to create 3D reconstructions with the help of interpolation algorithms like marching cubes.
- centroid of a cell relates to the geometric center, or barycenter, of a cell's two-dimensional image, as determined with digital image processing methods, e.g., by image moments.
- the biological sample comprising cells is a cervical sample.
- the method can also be used with samples from other body tissues which have to be checked for abnormalities, like breast samples, prostate samples, liver samples, lung samples and so forth.
- the method further comprises at least one step selected from the group consisting of:
- the method according to the invention further comprises at least one step of counting a given cell type, or updating an existing count thereof.
- the biological sample comprising cells comprises at least one sample selected from the group consisting of
- a smear sample is for example similar or identical to those samples used in the Papanicolaou tests (also called Pap smear, Pap test, cervical smear, or smear test).
- a tissue slice is for example, sliced by a microtome.
- a liquid sample can preferably consist of a suspension of cells, e.g., obtained by a smear.
- FNAC fine needle aspiration cytology
- abrasive cytology samples and/or exfoliated samples.
- the term slide is used.
- a sample is indeed placed on a slide to make it available for investigation, e.g. a tissue slice, or a smear.
- other devices can also be used to carry a sample, e.g. a small cuvette in case the sample is a liquid sample or a cartridge in case the sample is a brush sample.
- slice as used in the flow charts is thus by no means construed to limiting the scope of the present invention.
- the biological sample comprising cells is stained, preferably prior to step a) of image acquisition.
- Dyes which are preferably used comprise Pap-stain, ultra fast Pap-statin, Romanowsky-type stain, Haris Haematoxylin stain, fluorescent stains like Achrodyn Orange, and H & E stain.
- optical and/or digital image enhancement approaches are used.
- Optical image enhancement is preferably carried out prior to step a) of image acquisition.
- Preferred methods comprise dark field microscopy, phase contrast, differential interference contrast (DIC) and/or reflected interference contrast (RIC).
- Digital contrast enhancement is preferably carried out after step a) of image acquisition.
- Preferred methods comprise bright field microscopy, for example a typical transmission microscope.
- steps b) and following are carried out while the data related to the acquired image, or parts thereof, is still in a volatile memory.
- volatile memory is used interchangeably with the term temporary memory, and shall be understood in such way that the data related to the acquired image are not yet stored on the hard disk or on a flash storage.
- a preferred form of such volatile memory is a random access memory (RAM) used by the image processor, or by the computer's CPU.
- a system for the detection of abnormalities in a biological sample comprising cells is provided.
- the system is capable to carry out, and/or comprises means capable to carry out, at least the following steps:
- step el selecting a new field of view and carrying on with step c) if, in step d), it turns out that, in said field of view, the determination of cell aggregates is negative, or
- step e2) carrying out further process steps if, in step d), it turns out that, in said field of view, the determination of cell aggregates is affirmative.
- said system is further capable to carry out, and/or comprises further means capable to carry out said the steps of: f) determining the degree of variation of at least one given morphological feature of at least two cells in the field of view, and
- gl classifying the sample as "likely to comprise abnormal cells” if the degree of variation of said morphological feature exceeds a predetermined threshold, or g2) classifying the sample as "likely to comprise normal cells” if the degree of variation of said morphological feature falls below a predetermined threshold.
- said system is preferably capable to carry out, and/or comprises further means capable to carry out the other method steps discussed above.
- a device for the detection of abnormalities in a biological sample comprising cells comprises at least the following items:
- a user interface comprising at least one output means and one input means.
- Said output means is preferably a display, or a touch screen, while said input means is preferably an array of keys, or buttons, or a touchscreen.
- the method according to the invention is not restricted to the use in such device. It can also be used "stand-alone" for the detection of locations/regions in a slide or set of images being suspected to contain images of abnormal cells.
- the device according to the invention further comprises at least one optical magnification unit.
- the device according to the invention further comprises at least one interface for connecting the device with other equipment.
- Such interface is, preferably, a GSM interface, a 3G interface, a USB interface, a Bluetooth interface, a Firewire interface and/or a WiFi interface, hypertext terminal, etc.
- the device according to the invention further comprises at least one sample collector and/or at least one cartridge in which the sample is transferred, said cartridge being disposed for placement in the sample receiving unit.
- the system are device discussed above is preferably in the form of a point of are device (POC).
- POC point of are device
- it is provided as a handheld or desktop unit. Even more preferably, it is battery driven and/or portable.
- Fig. 1 shows a flow diagram identifying regions of interest for the presence or absence of cell aggregates.
- Fig. 2 shows a flow diagram for distinguishing whether or not identified cell aggregates comprise abnormal cells or normal cells (termed “endocervical cells” here, which is, strictly speaking, clinically imprecise, because endocervical cells can also become malignant).
- Fig. 3 shows an artificially created example of a Pap smear image created to explain the envisaged concept.
- Fig. 4 shows the segmentation of the cells and the corresponding nuclei.
- Fig. 5 shows results after clustering, i.e., the cluster number and an inner rectangle showing the region of interest for possible abnormality.
- Fig. 6 shows the envisaged system according to the invention, and its work flow.
- Figs. 7 and 8 show flow diagrams comprising an alternative approach to identify regions of interest.
- Fig. 9 shows the Evolution of the Pap-smear nucleus segmentation techniques, from IGMT and IEMT toIGTMT and IRMT.
- Fig. 10 shows flow diagrams of (A) IGMT and (B) IEMT technique for Pap- smear nucleus segmentation.
- Fig. 11 shows multiple threshold levels in in a Papsmear image histogram, and the resulting segmentation.
- R t _i is a single image region below t-l th threshold as seen in Fig. 11 (A)
- R t is the region having gray value in-between t-l th and t th threshold as seen in Fig. 11 (A)
- R t +i is region having gray value in-between t th and t+l th threshold as seen in Fig. 11 (A).
- the actual region boundary of the nucleus is marked by an arrow.
- Fig.12 shows again multiple threshold levels in in a Papsmear image histogram, and the resulting segmentation.
- Fig. 12 (A) shows recursive multiple threshold levels T rl to T rM in ascending order between t-l th and t+l th threshold of Fig. 11 (A).
- Fig. 12 (B) shows regions thresholded by levels T rl to T rM .
- Fig. 13 shows R t _i and outside the region R t +i presented as source and sink respectively indicating the flow of a directed graph.
- Fig. 14 shows flow diagrams of (A) IRMT and (A) IGTMT for Pap-smear nucleus segmentation.
- Fig. 15 shows a Pap-smear image showing overlapping nucleus along with their intensity variation (in white circle) and focused region (marked in black arrow) and unfocused region (marked in white arrow).
- Figs. 1 and 2 show flow charts which have been described in the text already.
- Fig. 3 shows an artificially created example of a Pap smear image to explain the concept of the present invention.
- the cytoplasm parts of the cells stick together, and the nuclei of the cells are very close to one another (small inter- nuclei distance).
- Inter-nuclei distance mapping is thus used in the algorithmic identification process to identify abnormal cells, particularly in those regions of interest which have earlier been identified, by cell aggregation analysis, as suspicious.
- Fig. 4 shows the result of the segmentation of the cells and the corresponding nuclei. Based on the subsequent algorithms, regions of interest can be determined which are highly suspicious to comprise abnormal cells.
- Fig. 5 shows the results of such process clustering. Two different clusters have been identified, wherein cluster No 2 - marked by a rectangle - is likely to comprise abnormal cells, due to (i) extensive cell clustering, (ii) high variation of nuclei sizes, and (iii) small inter-nuclei distances.
- Fig. 6 shows a system and work flow according to the present invention.
- the sample is collected by means of a sample collector 61, which may adopt the shape of a brush, similar to a Q-tip, and is transferred to a cartridge 62 which is disposed for placement in the sample receiving unit 63 of a device 64 according to the invention.
- the device is shown in form of a portable point of care device.
- the sample can be stained in between.
- the sample is then scanned by the optical magnification unit and the image acquisition device unit present in the device.
- an input means 65 which is embodied, herein, as an array of keys
- the device acquires an image from the sample in the cartridge and passes it to the algorithm embedded into the system.
- the method steps according to the invention are accomplished, and results of the analysis are shown on output means 66, which is embodied, herein, as a display screen.
- Figs. 7 and 8 show flow diagrams comprising a more elaborated approach to identify regions of interest which may be likely to comprise abnormal cells.
- the main focus is to identify the cellular regions and find cell aggregates. Once the latter are identified the algorithm passes the respective field of view to further analysis, as explained in Fig. 8.
- Box 1 of Fig. 7 the system initiation is done. Here, essentially, the system resets and arrives at a reference position, clears all the buffers, etc.
- a cytology sample is loaded, in most cases as a slide (see above), and the initiation for cell count of all type of cells, such as normal/abnormal squamous cells and their types, and normal/abnormal endo- cervical cells, is initiated, and the respective result is stored.
- a scan strategy is chosen. The scan strategy involves the selection of step size of the movement of the sample in x and y direction and the focus depth (z direction) relative to the imaging devices (i.e., either the sample or the imaging device is moved), and the selection of magnification, contrast, etc. Further, the system starts reading the sample/slide, and the images are acquired.
- the quality parameter of the slide/images are estimated.
- the quality parameters are checked for their adequacy (by comparing with a priori data). If the quality is not adequate, the system goes in the loop to check the scope for up-gradation in Box 13. If there is scope to upgrade the scan strategy (i.e, if the scan parameters are within the defined range of the system), then the system provides an on-the-fly feedback to change the scan strategy (Box 12). If there is no scope for upgrading the scan parameters, a report is generated (Box 14) and the systems stops or goes for the next slide (Box 15).
- the actual field of view comprises only normal squamous cell, and their number is counted.
- the cells which are not comprised in clusters are assumed to be normal, given the fact that significant abnormalities are rather found in clustered cells than in isolated cells. If in Box 10 clusters are found, they are suspected for abnormality and the system passes the image of the actual field of view, or other data related to the said clusters, for detailed analysis to link 1 in Fig. 8. If in the respective field of view isolated cells as well as clusters of cells have been determined, the image of the actual field of view, or other data related to the said clusters, are passed for further processing in Fig. 8, while isolated cells are just counted.
- the system checks if there is any other field of view left to be scanned in Box 11. If yes, the system scans the next field of view and repeats the above described process. If all the fields of view are completed the system generates a report on the actual sample (estimation of abnormality, its severity, type of carcinoma, number of cells etc.) and stops, or moves to the next sample in Box 16.
- Images of a field of view comprising clusters, or other data related to the said clusters, are then passed on to the algorithm in Fig. 8.
- the morphological features in each cell of a given cluster are extracted to measure the variability of these features (Box 2 and Box 3). If the measurements are not in an abnormal range (Box 4), then the cell cluster is suspected to comprise normal endocervical cells (Box 11), hence a confirmatory test is done (Box 12). If the assumption is true then the count of normal endocervical cells is done in Box 14. If not, the sample is considered to comprise squamous cells, and a count for squamous cells is done in Box 13.
Landscapes
- Engineering & Computer Science (AREA)
- Health & Medical Sciences (AREA)
- Life Sciences & Earth Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- General Physics & Mathematics (AREA)
- Chemical & Material Sciences (AREA)
- Molecular Biology (AREA)
- Organic Chemistry (AREA)
- Biomedical Technology (AREA)
- Multimedia (AREA)
- Immunology (AREA)
- Proteomics, Peptides & Aminoacids (AREA)
- Zoology (AREA)
- Wood Science & Technology (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Quality & Reliability (AREA)
- Radiology & Medical Imaging (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Medical Informatics (AREA)
- Biophysics (AREA)
- Microbiology (AREA)
- Biotechnology (AREA)
- Biochemistry (AREA)
- Bioinformatics & Cheminformatics (AREA)
- General Engineering & Computer Science (AREA)
- Genetics & Genomics (AREA)
- Analytical Chemistry (AREA)
- Virology (AREA)
- Investigating Or Analysing Biological Materials (AREA)
- Measuring Or Testing Involving Enzymes Or Micro-Organisms (AREA)
Priority Applications (5)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| EP12787088.9A EP2745111B1 (en) | 2011-09-13 | 2012-09-11 | System and method for the detection of precancer or cancer cells in a biological sample |
| MX2014002843A MX346624B (es) | 2011-09-13 | 2012-09-11 | Sistema y metodo para la deteccion de anormalidades en una muestra biologica. |
| IN1734CHN2014 IN2014CN01734A (enExample) | 2011-09-13 | 2012-09-11 | |
| CN201280044762.0A CN103907023B (zh) | 2011-09-13 | 2012-09-11 | 检测生物学样品中的异常的系统和方法 |
| US14/343,427 US9567651B2 (en) | 2011-09-13 | 2012-09-11 | System and method for the detection of abnormalities in a biological sample |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| US201161534031P | 2011-09-13 | 2011-09-13 | |
| US61/534,031 | 2011-09-13 |
Publications (1)
| Publication Number | Publication Date |
|---|---|
| WO2013038331A1 true WO2013038331A1 (en) | 2013-03-21 |
Family
ID=47178777
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| PCT/IB2012/054708 Ceased WO2013038331A1 (en) | 2011-09-13 | 2012-09-11 | System and method for the detection of abnormalities in a biological sample |
Country Status (6)
| Country | Link |
|---|---|
| US (1) | US9567651B2 (enExample) |
| EP (1) | EP2745111B1 (enExample) |
| CN (1) | CN103907023B (enExample) |
| IN (1) | IN2014CN01734A (enExample) |
| MX (1) | MX346624B (enExample) |
| WO (1) | WO2013038331A1 (enExample) |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3817652A4 (en) * | 2018-07-06 | 2021-08-25 | Enzyvant Therapeutics GmbH | DETERMINATION OF TISSUE POWER BY QUANTITATIVE HISTOMORPHOLOGICAL ANALYSIS |
Families Citing this family (31)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| JP6143365B2 (ja) * | 2014-03-05 | 2017-06-07 | 富士フイルム株式会社 | 細胞画像評価装置および方法並びにプログラム |
| GB2530252B (en) * | 2014-09-10 | 2020-04-01 | Smiths Heimann Sas | Determination of a degree of homogeneity in images |
| CA2965564C (en) * | 2014-11-10 | 2024-01-02 | Ventana Medical Systems, Inc. | Classifying nuclei in histology images |
| US20180253590A1 (en) * | 2015-03-20 | 2018-09-06 | Inspirata, Inc. | Systems, methods, and apparatuses for digital histopathological imaging for prescreened detection of cancer and other abnormalities |
| CN106290169A (zh) * | 2015-05-29 | 2017-01-04 | 深圳市搜罗盟网络科技有限公司 | 一种癌症检测设备 |
| EP3395937B1 (en) * | 2015-12-22 | 2025-08-20 | Nikon Corporation | Image processing apparatus |
| WO2017110974A1 (ja) * | 2015-12-24 | 2017-06-29 | コニカミノルタ株式会社 | 画像処理装置及びプログラム |
| TWI594207B (zh) * | 2016-04-26 | 2017-08-01 | 財團法人金屬工業研究發展中心 | 細胞核影像輪廓擷取裝置及其方法 |
| RU2647675C1 (ru) * | 2016-10-26 | 2018-03-16 | Федеральное государственное казенное военное образовательное учреждение высшего образования "Военный учебно-научный центр Военно-воздушных сил "Военно-воздушная академия имени профессора Н.Е. Жуковского и Ю.А. Гагарина" (г. Воронеж) Министерства обороны Российской Федерации | Способ измерения морфологической мультифрактальной сигнатуры |
| CN106479880B (zh) * | 2016-11-01 | 2019-06-04 | 上海市同仁医院 | 一种人乳头瘤病毒结果判读装置 |
| JP6886306B2 (ja) * | 2017-02-02 | 2021-06-16 | オリンパス株式会社 | 位相分布算出方法、評価方法、画像処理装置、画像処理システム、プログラム |
| CN108693342A (zh) * | 2017-12-13 | 2018-10-23 | 青岛汉朗智能医疗科技有限公司 | 宫颈癌、子宫癌的检测方法及系统 |
| CN110135221A (zh) * | 2018-02-08 | 2019-08-16 | 佛山市水木联合医疗器械研究院 | 一种利用标准细胞库图像识别样本细胞的方法 |
| FR3079617B1 (fr) * | 2018-03-29 | 2023-12-22 | Office National Detude Et De Rech Aerospatiales Onera | Methode de detection de cellules presentant au moins une anomalie dans un echantillon cytologique |
| US10950016B2 (en) | 2018-06-11 | 2021-03-16 | Shanghai United Imaging Healthcare Co., Ltd. | Systems and methods for reconstructing cardiac images |
| JP7164978B2 (ja) * | 2018-06-29 | 2022-11-02 | キヤノン株式会社 | 粒子測定方法、粒子測定装置及び核酸濃度測定システム |
| CN108961249A (zh) * | 2018-07-19 | 2018-12-07 | 厦门理工学院 | 一种子宫颈癌细胞再识别诊断方法 |
| EP3611695A1 (en) * | 2018-08-15 | 2020-02-19 | Koninklijke Philips N.V. | Generating annotation data of tissue images |
| KR20210113236A (ko) * | 2018-12-18 | 2021-09-15 | 패스웨어 인코포레이티드 | 병리학 시료의 자동화된 이미징 및 분석을 위한 컴퓨터 사용 현미경 검사 기반의 시스템 및 방법 |
| CN113544490B (zh) * | 2019-03-29 | 2024-07-02 | 贝克顿·迪金森公司 | 用于颗粒辨别的参数 |
| CN110210578B (zh) * | 2019-06-19 | 2021-11-16 | 四川智动木牛智能科技有限公司 | 基于图论的宫颈癌组织病理学显微图像聚类系统 |
| CN110400281B (zh) * | 2019-08-05 | 2021-06-01 | 山东志盈医学科技有限公司 | 一种数字切片扫描仪中图像增强方法 |
| CN110853022B (zh) * | 2019-11-14 | 2020-11-06 | 腾讯科技(深圳)有限公司 | 病理切片图像的处理方法、装置、系统及存储介质 |
| CN111275191B (zh) * | 2020-02-26 | 2023-11-28 | 上海商汤智能科技有限公司 | 检测细胞的方法及装置、电子设备和存储介质 |
| CN112233060B (zh) * | 2020-09-04 | 2024-03-29 | 广州金域医学检验中心有限公司 | 数字病理图像异常样本的筛选方法、装置、设备及介质 |
| CN114428076A (zh) * | 2020-09-29 | 2022-05-03 | 中国石油化工股份有限公司 | 聚合物改性沥青的储存稳定性判定方法和质量控制方法 |
| CN112378727A (zh) * | 2020-12-14 | 2021-02-19 | 湖南莱博赛医用机器人有限公司 | 基于机器视觉的dna倍体定量分析装置及其应用方法 |
| WO2024063671A1 (ru) * | 2022-09-21 | 2024-03-28 | Ооо "Хоспитекс Диагностикс" | Система дая цитологического анализа патологии шейки матки |
| CN117787864B (zh) * | 2023-12-27 | 2024-10-15 | 石家庄博瑞迪生物技术有限公司 | 一种动物组织采样管溯源入库管理方法 |
| CN119741248B (zh) * | 2024-09-20 | 2025-11-18 | 四川大学 | 一种类器官细胞聚集实时监测及动态分析方法 |
| CN120125582A (zh) * | 2025-05-13 | 2025-06-10 | 大熊(天津)医疗科技有限公司 | 一种医学细胞检测方法 |
Family Cites Families (10)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US5740270A (en) | 1988-04-08 | 1998-04-14 | Neuromedical Systems, Inc. | Automated cytological specimen classification system and method |
| US5257182B1 (en) | 1991-01-29 | 1996-05-07 | Neuromedical Systems Inc | Morphological classification system and method |
| US6026174A (en) | 1992-10-14 | 2000-02-15 | Accumed International, Inc. | System and method for automatically detecting malignant cells and cells having malignancy-associated changes |
| WO1996009594A1 (en) | 1994-09-20 | 1996-03-28 | Neopath, Inc. | Apparatus for automated identification of thick cell groupings on a biological specimen |
| AU3586195A (en) | 1994-09-20 | 1996-04-09 | Neopath, Inc. | Apparatus for automated identification of cell groupings on a biological specimen |
| WO1996009600A1 (en) | 1994-09-20 | 1996-03-28 | Neopath, Inc. | Apparatus for identification and integration of multiple cell patterns |
| AUPP278698A0 (en) | 1998-04-03 | 1998-04-30 | University Of Queensland, The | Method of cell nuclei segmentation |
| US6379907B1 (en) * | 1999-08-05 | 2002-04-30 | The Regents Of The University Of California | Diagnostic method using expression of MN/CA9 protein in AGUS Pap smears |
| US7274809B2 (en) * | 2002-08-29 | 2007-09-25 | Perceptronix Medical, Inc. And British Columbia Cancer Agency | Computerized methods and systems related to the detection of malignancy-associated changes (MAC) to detect cancer |
| CN101059505A (zh) * | 2007-05-28 | 2007-10-24 | 宋士明 | 一种活细胞技术检查宫颈癌细胞的方法 |
-
2012
- 2012-09-11 MX MX2014002843A patent/MX346624B/es active IP Right Grant
- 2012-09-11 EP EP12787088.9A patent/EP2745111B1/en not_active Not-in-force
- 2012-09-11 US US14/343,427 patent/US9567651B2/en not_active Expired - Fee Related
- 2012-09-11 WO PCT/IB2012/054708 patent/WO2013038331A1/en not_active Ceased
- 2012-09-11 CN CN201280044762.0A patent/CN103907023B/zh not_active Expired - Fee Related
- 2012-09-11 IN IN1734CHN2014 patent/IN2014CN01734A/en unknown
Non-Patent Citations (4)
| Title |
|---|
| BOZZO J ET AL: "Red blood cell aggregability is increased by aspirin and flow stress, whereas dipyridamole induces cell shape alterations: measurements by digital image analysis.", EUROPEAN JOURNAL OF CLINICAL INVESTIGATION SEP 1996, vol. 26, no. 9, September 1996 (1996-09-01), pages 747 - 754, XP002690034, ISSN: 0014-2972 * |
| FOWLER J D ET AL: "Hydraulic permeability of immobilized bacterial cell aggregates.", APPLIED AND ENVIRONMENTAL MICROBIOLOGY JAN 1991, vol. 57, no. 1, January 1991 (1991-01-01), pages 102 - 113, XP002690036, ISSN: 0099-2240 * |
| MUNN L L ET AL: "Analysis of lymphocyte aggregation using digital image analysis", JOURNAL OF IMMUNOLOGICAL METHODS, ELSEVIER SCIENCE PUBLISHERS B.V.,AMSTERDAM, NL, vol. 166, no. 1, 5 November 1993 (1993-11-05), pages 11 - 25, XP023992808, ISSN: 0022-1759, [retrieved on 19931105], DOI: 10.1016/0022-1759(93)90324-Z * |
| SHAPIRO AMOS ET AL: "Raman molecular imaging: a novel spectroscopic technique for diagnosis of bladder cancer in urine specimens.", EUROPEAN UROLOGY JAN 2011, vol. 59, no. 1, January 2011 (2011-01-01), pages 106 - 112, XP002690035, ISSN: 1873-7560 * |
Cited By (1)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP3817652A4 (en) * | 2018-07-06 | 2021-08-25 | Enzyvant Therapeutics GmbH | DETERMINATION OF TISSUE POWER BY QUANTITATIVE HISTOMORPHOLOGICAL ANALYSIS |
Also Published As
| Publication number | Publication date |
|---|---|
| EP2745111B1 (en) | 2016-06-29 |
| US9567651B2 (en) | 2017-02-14 |
| EP2745111A1 (en) | 2014-06-25 |
| CN103907023A (zh) | 2014-07-02 |
| MX2014002843A (es) | 2014-07-09 |
| US20140227682A1 (en) | 2014-08-14 |
| MX346624B (es) | 2017-03-27 |
| IN2014CN01734A (enExample) | 2015-05-29 |
| CN103907023B (zh) | 2016-10-05 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| US9567651B2 (en) | System and method for the detection of abnormalities in a biological sample | |
| Demir et al. | Automated cancer diagnosis based on histopathological images: a systematic survey | |
| Belsare et al. | Histopathological image analysis using image processing techniques: An overview | |
| US20190042826A1 (en) | Automatic nuclei segmentation in histopathology images | |
| US9842391B2 (en) | Method and apparatus for processing an image of a tissue sample | |
| TWI379248B (en) | Methods and systems for processing biological specimens utilizing multiple wavelengths | |
| US8891850B2 (en) | System and methods for digital evaluation of cellblock preparations | |
| JP2023030033A (ja) | デジタル病理学分析結果の格納および読み出し方法 | |
| CN101167101A (zh) | 自动图像分析 | |
| WO2007119204A2 (en) | Method for processing biomedical images | |
| US7865000B2 (en) | Medical image processing apparatus for analyzing properties of living body based on image data thereof | |
| López et al. | Digital image analysis in breast cancer: an example of an automated methodology and the effects of image compression | |
| Wang et al. | Automated analysis of fluorescent in situ hybridization (FISH) labeled genetic biomarkers in assisting cervical cancer diagnosis | |
| Naghdy et al. | Cervical cancer classification using Gabor filters | |
| Shirazi et al. | Automated pathology image analysis | |
| Razavi et al. | Automatically diagnosing HER2 amplification status for breast cancer patients using large FISH images | |
| Ko et al. | A computer-aided grading system of breast carcinoma: scoring of tubule formation | |
| Schilling et al. | Towards rapid cervical cancer diagnosis: automated detection and classification of pathologic cells in phase-contrast images | |
| Forsberg et al. | Evaluating cell nuclei segmentation for use on whole-slide images in lung cytology | |
| Lu et al. | Efficient epidermis segmentation for whole slide skin histopathological images | |
| Edwards et al. | Segmentation of biological cell images for sonification | |
| Li et al. | Detection of epithelial versus mesenchymal regions in 2D images of tumor biopsies using shearlets | |
| WO2024186756A2 (en) | System and method for biomarker detection | |
| Shete et al. | Breast cancer cell detection using digital image processing | |
| Alomari et al. | Adaptive Localization of Focus Point Regions via Random Patch Probabilistic Density from Whole‐Slide, Ki‐67‐Stained Brain Tumor Tissue |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| 121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 12787088 Country of ref document: EP Kind code of ref document: A1 |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 2012787088 Country of ref document: EP |
|
| WWE | Wipo information: entry into national phase |
Ref document number: 14343427 Country of ref document: US |
|
| WWE | Wipo information: entry into national phase |
Ref document number: MX/A/2014/002843 Country of ref document: MX |
|
| NENP | Non-entry into the national phase |
Ref country code: DE |