The content of the invention
It is an object of the present invention to overcome the above mentioned problem that current cervical cell quantitative analysis and auxiliary diagnosis are present;Base
In existing cervical cytology domain knowledge, learnt by depth learning technology and extract the key feature of cervical cell, divide automatically
The cancerous region and type of cell on liquid-based smear are cut and recognized, is finally reached and is shortened scoring time, reduces wrong diagnosis and escape rate
Purpose, provides solution for cervical cell liquid-based smear artificial intelligence auxiliary diagosis technology, finally realizes that cervical cell is quantified
Change and evaluate and aid in the methodology of intelligent diagnostics to break through.
To achieve these goals, the present invention proposes a kind of cervical cell liquid-based smear artificial intelligence auxiliary diagosis system
System, the system includes:
Cell image acquisition module, for being scanned preservation cell image using smear automatic scanner eclipsed form;
Cell image pretreatment module, for being pre-processed to cell image;
Cell image detection segmentation module, carries out automatic detection, while right for the different cell components to image cell
Nucleus, cytoplasm, background are split automatically in same cell component;Using improved movable contour model and fast area
Convolutional neural networks are detected, cell characteristic is aided with again and multiple dimensioned horizontal scheduling algorithm is finely adjusted and optimized to segmentation result;
Cell rapid classification identification module, for the image after segmentation to be identified, divides into individual cells or cell
Cluster;Individual cells are distinguished using the double-current convolutional neural networks in additional knowledge field and the cell knowledge mapping of structure
Hierarchical identification is carried out, the first classification results and second of classification results are respectively obtained;Using the double-current convolution god of cell cluster
The identification of inseparable cell cluster is realized through network model;With
Interpretation and post-processing module, join for the first classification results and second of classification results to individual cells
Interpretation is closed, clash handle is carried out, obtains the classification results of individual cells;The clash handle is used to solve various features sensing not
With sentence read result when, comprehensive various factors eliminates conflict, makes clearly reliable interpretation;Then knowledge mapping and class are utilized
Active map realizes the readability of cervical cell identification process, the interpretation of cervical cell recognition result.
In above-mentioned technical proposal, the implementation process of the cell image acquisition module is:Using 40 times of amplifications of eyepiece, sweep
Path is retouched for rectangle, scan mode scans for eclipsed form so that scanning range is all covered with liquid-based smear cells location.
In above-mentioned technical proposal, the pretreatment includes:Denoising is carried out to image using two-sided filter, the wave filter is
It is made up of two functions:One function is to determine filter coefficient by geometric space distance, and another determines filter by pixel value difference
Ripple device coefficient;Then the edge of image is repaired using Morphological scale-space, filling cavity simultaneously removes thin connection, finally makes
Increase nucleus and cytoplasmic contrast with histogram equalization.
In above-mentioned technical proposal, the step that implements of the cell image detection segmentation module is:
Step S1) preceding background coarse segmentation is carried out to pretreated cell image, extract the region belonging to cell;
Step S2) to after coarse segmentation cell image carry out cell component detection split, use fast area convolution god
Different types of cell is partitioned into through network;
Step S3) detect and split cervical cell nucleus;
Step S4) nucleus is screened according to the characteristic parameter of nucleus, obtain final candidate cell core;
Step S5) judgment step S2) in obtained cell type whether be cell cluster, if it is not, then using activity
Skeleton pattern and Prior Template carry out the segmentation of cytosolic domain;Otherwise, it is transferred to step S6);
Step S6) comprehensive nucleus post-processed with cytoplasmic segmentation result and domain knowledge, the whole uterine neck of completion
Effective segmentation of cell.
In above-mentioned technical proposal, network of the fast area convolutional neural networks from the VGG16 of convolutional neural networks
Structure, the size of input picture is 515*512, and the detection classification of final cell composition falls into 5 types:Scale cell, gland cell, neck tube
Cell, metaplasia cell and background quality, the cell component in addition to scale cell and background quality are all defined as inseparable cell
Cluster.
In above-mentioned technical proposal, the step S5) in use movable contour model and Prior Template carry out cytoplasm
The detailed process of the segmentation in region is:
Improved movable contour model is employed, energy function and shape priors is added, is made iteratively profile
Optimization, obtain cytoplasmic exact boundary;
Energy function E (u) is:
E (u)=λ1Es(u)+R(u)
Wherein Es(u) it is shape prior, R (u) is regular terms, the flatness for ensureing partitioning boundary, λ1It can learn
Parameter;Shape prior Es(u) it is:
Wherein, H is Hessian matrix.
In above-mentioned technical proposal, the step that implements of the cell image detection segmentation module is:
Step 1) pretreatment operation is carried out to the cervical cell image after segmentation;
Step 2) whether judge pretreated cell image be individual cells, if it is, being transferred to step 3), otherwise, should
Image is inseparable cell cluster, is transferred to step 6);
Step 3) computable cell parameters is determined, then calculate cell parameters feature;
Step 4) cell knowledge mapping reasoning and judging model is set up, and cell parameters feature is inputted into the model, obtain list
The first classification results of individual cell;
Step 5) build additional fields knowledge double-current convolutional neural networks model, by cell parameters feature and cell image
The double-current convolutional neural networks model of input, obtains second of classification results of individual cells;
Step 6) the double-current convolutional neural networks model of cell cluster is built, and the model is used to inseparable cell cluster
The hierarchical identification of cell cluster is carried out, the classification results of cell cluster are obtained.
In above-mentioned technical proposal, the input all the way of the double-current convolutional neural networks of the additional fields knowledge is step 3)
The cell parameters feature arrived, input is individual cells image all the way in addition, and size is uniformly normalized to 256*256 pixel values, is passed through
The convolution pond composite module for crossing 5 cascades implicitly extracts the feature of cell image;Most important of which convolution operation
Convolution kernel size uses 7*7 sizes, and step-length selection size is 1, and characteristic pattern number is chosen for 96, and the convolution operation is:
In above formula, M represents the set of the input feature vector figure of selection, wijRepresent weight, bjAdd for the output of each characteristic pattern
On an additional bias, then 1096 dimensional features of extraction are spliced to plus computable 20 dimensional feature of cell field knowledge
Together, the full articulamentum and classification layer of double-current convolutional neural networks are input to.
In above-mentioned technical proposal, the input all the way of the double-current convolutional neural networks of the cell cluster is:Between nucleus
Queueing discipline feature, in addition all the way input be cell cluster corresponding with the cell parameters cervical cell, cervical cell
Input size is uniformly normalized to 512*512 pixel values, and the convolution pond composite module by 8 cascades is implicitly extracted carefully
The feature of born of the same parents' image;The convolution kernel size of most important of which convolution operation uses 5*5 sizes, and step-length selection size is 2, feature
Figure number is chosen for 108.
The beneficial effects of the invention are as follows:
1st, system of the invention has hypersensitivity for lesion cervical cell system, has height for normal cervix cell
Specificity, whole auxiliary diagosis system mitigates the labor intensity of diagosis worker significantly without manually participating in.
Embodiment
Presently preferred embodiments of the present invention is described in detail below in conjunction with the accompanying drawings, so that advantages and features of the invention energy
It is easier to be readily appreciated by one skilled in the art, apparent is clearly defined so as to be made to protection scope of the present invention.
As shown in figure 1, a kind of cervical cell liquid-based smear artificial intelligence auxiliary diagosis system, the system includes:
Cell image acquisition module, for being scanned preservation cell image using smear automatic scanner eclipsed form;
Wherein, using 40 times of amplifications of eyepiece, scanning pattern is rectangle, and scan mode scans for eclipsed form so that scanning range and liquid
Base smear cells location can all be covered;
For example, the cervical cell image after 20 scanning can be obtained for the image of a pixel of 20,000 * 20,000.
Cell image pretreatment module, for being pre-processed to cell image, including:Using two-sided filter to image
Denoising is carried out, the wave filter is made up of two functions:One function is to determine filter coefficient by geometric space distance, another
It is individual that filter coefficient is determined by pixel value difference;Then the edge of image is repaired using Morphological scale-space, filling cavity is simultaneously
Thin connection is removed, finally increases nucleus and cytoplasmic contrast using histogram equalization.
Cell image detection segmentation module, carries out automatic detection, while right for the different cell components to image cell
Nucleus, cytoplasm, background are split automatically in same cell component;Using improved movable contour model and fast area
Convolutional neural networks are detected, cell characteristic is aided with again and multiple dimensioned horizontal scheduling algorithm is finely adjusted and optimized to segmentation result;
As shown in Fig. 2 implementing step and being:
Step S1) preceding background coarse segmentation is carried out to pretreated cell image, extract the region belonging to cell;
The removal of the noise of whole cell image is carried out using 9 threshold values;Then SIFT rim detections are used and multiple dimensioned
Watershed algorithm obtains foreground area, and SIFT maintains the invariance to rotation, scaling, brightness change, to visual angle change, affine
Conversion, noise also keep a certain degree of stability;Fine setting finally is optimized for the region being partitioned into, it is poly- using K averages
Class algorithm is by neighbouring potting gum, and the cluster number selection of clustering algorithm of the present invention is 3, that is, is divided into cytoplasm, nucleus and the back of the body
Three classifications of scape.
Step S2) to after coarse segmentation cell image carry out cell component detection split, use fast area convolution god
Different classes of cell and background quality are partitioned into through network;
The cleaning for carrying out data first against training sample is arranged, then using the fast area convolution in deep learning algorithm
Neutral net carries out the detection segmentation of cell component.Its training stage selection training method end to end, model selection convolution
The VGG16 of neutral net network structure, the size of input picture is 515*512, and the detection classification of final cell composition is divided into 5
Class:By the extracellular four kinds of classifications of de-scaling in scale cell, gland cell, neck tube cell, metaplasia cell and background quality, the present invention
Cell component be all defined as inseparable cell cluster.The follow-up hierarchical identification step of diagosis is aided in view of artificial intelligence,
Inseparable cell Cluster zone is divided into gland cell, neck tube cell, metaplasia cell and the class of background quality four in detail herein, its
Middle background quality is not belonging to cell category, is not involved in follow-up hierarchical identification.
Step S3) detect and split cervical cell nucleus;
The algorithm of improved random forest is employed, point of nuclear area is carried out by extracting 5 kinds of features of nucleus
Cut, the number selection 20 set in forest, Characteristic Number selection during selection optimal characteristics is logN, the minimum of leaf node every time
Number selection is 3;
It is aided with the detection that multi-scale watershed algorithm carries out nucleus again to prevent from missing nuclear area, by choosing
5 kinds of different parameters are merged, and image to be split is divided into high and the low different scale of merging degree the cell of merging degree
Image, then both results detected are combined, it is used as the candidate region of nucleus.
Step S4) nucleus is screened according to the characteristic parameter of nucleus, obtain final candidate cell core;
According to the characteristic parameter of nucleus, comprising nucleus size, the circularity of nucleus, the depth of nucleus can be counted
Calculate feature.The parameter of the size of such as nucleus is by directly calculating the summation of the pixel in nuclear area border come table
Show, specific practice such as formula 1.
Wherein f (x, y) is the pixel value of certain point (x, y) on bianry image, and value represents that the pixel belongs to target when being 1
Region, value represents that the pixel belongs to background area when being 0, and its area is exactly to count the number of pixels that f (x, y) is 1.
Step S5) judgment step S2) in obtained cell type whether be cell cluster, if it is not, then using activity
Skeleton pattern and Prior Template carry out the segmentation of cytosolic domain;Otherwise, it is transferred to step S6);
Improved movable contour model is employed, energy function and shape priors, the carry out profile of iteration are added
Optimization, obtain cytoplasmic exact boundary;
Energy function E (u) is:
E (u)=λ1Es(u)+R(u)
Wherein Es(u) be that the present invention proposes the shape prior that uses, R (u) is regular terms, it is ensured that partitioning boundary it is smooth
Property, λ1For the parameter that can learn;Shape prior Es(u) it is:
Wherein H is Hessian matrix (Hessian Matrix).
Step S6) comprehensive nucleus post-processed with cytoplasmic segmentation result and domain knowledge, the whole uterine neck of completion
Effective segmentation of cell.
Post-processed for the segmentation result of above-mentioned steps, the main morphological operation pair using in Medical Image Processing
The edge of image is repaired, and filling cavity simultaneously removes thin connection, main using the ginseng for opening operation and closed operation, wherein template
Number is set to the methods such as the size of [3 3], and filtering and noise reduction and enters the smooth of row bound, and the wherein setting w of parameter is 2, variance
Sigma uses [2 0.1], so as to obtain final accurate boundary information.
Cell rapid classification identification module, for the image after segmentation to be identified, divides into individual cells or cell
Cluster;Individual cells are classified using the double-current convolutional neural networks in additional knowledge field and the cell knowledge mapping of structure
Identification;Using the identification of the inseparable cell cluster of double-current convolutional neural networks model realization of cell cluster;
As shown in figure 3, implementing step and being:
Step 1) pretreatment operation is carried out to the cervical cell image after segmentation;
Cervical cell region after scanning segmentation, and cell boundaries pixel value filling is carried out, by the pixel outside cell boundaries
Value is filled with 0, and then the cell image after filler pixels value is uniformly normalized to 256*256 pixel value size.
Step 2) whether judge pretreated cell image be individual cells, if it is, being transferred to step 3), otherwise, should
Image is inseparable cell cluster, is transferred to step 7);
Realized using the watershed algorithm in image procossing, if the cell nuclei in cell image is 1, judgement is single
Individual cell.
Step 3) computable cell parameters is determined, include size, depth, the shape of nucleus, cytoplasmic size, shape
Shape and karyoplasmic ratio, then calculate cell parameters feature;
By taking the size of nucleus as an example, the size parameter of nucleus is by directly calculating the picture in nuclear area border
The summation of element is represented:
Wherein f (x, y) is the pixel value of certain point (x, y) on bianry image, and value represents that the pixel belongs to target when being 1
Region, value represents that the pixel belongs to background area when being 0, and its area is exactly to count the number of pixels that f (x, y) is 1.
Step 4) cell knowledge mapping reasoning and judging model is set up, and cell parameters feature is inputted into the model, obtain thin
The first classification results of born of the same parents;
Step 5) build additional fields knowledge double-current convolutional neural networks model, by cell parameters feature and cell image
The double-current convolutional neural networks model of input, obtains second of classification results of cell;
As shown in Fig. 2 the input all the way of double-current convolutional neural networks is step 3) obtained cell parameters feature, in addition one
Road input is individual cells image, and size is uniformly normalized to 256*256 pixel values, and the convolution pondization by 5 cascades is combined
Module implicitly extracts the feature of cell image.The convolution kernel size of most important of which convolution operation uses 7*7 sizes, step
Long selection size is 1, and characteristic pattern number is chosen for 96, and the convolution operation is:
M represents the set of the input feature vector figure of selection, wijRepresent weight, bjOne added is exported for each characteristic pattern
1096 dimensional features of extraction, are then spliced together by additional bias plus computable 20 dimensional feature of cell field knowledge, defeated
Enter the full articulamentum and classification layer to double-current convolutional neural networks.According to TBS standard diagnostics, by the hierarchical identification knot of different cells
It is combined, one is divided into 9 classes.
As shown in figure 3, cytologic characteristic is completely according to TBS criterions, extraction is the language using criterion.Cell
A variety of classification can be carried out on different abstraction hierarchies, from the level with the presence or absence of lesion, cell is broadly divided into normal cell
With the major class of abnormal cell two, normal cell, including columnar cell, middle layer cells, cells of superficial layer;Abnormal cell includes slight squamous
Intraepithelial lesions cell, moderate SIL cell, severe SIL cell, epidermoid carcinoma cell.
The interpretation process and thought of diagnostic rule storehouse also completely according to diagosis doctor, such as cytoplasmic color characteristic reflect
Penetrate, for the color that cervical lesionses have interpretation meaning have blueness, pink, crocus, cell technics be commonly referred to as basophilla,
Acidophilia, the cell matter of thermophilic crocus, i.e. basophilla show as blueness, acidophic cell cytoplasm show as pink,
Thermophilic crocus cell matter shows as crocus.
Step 6) the double-current convolutional neural networks model of cell cluster is built, and the model is used to inseparable cell cluster
Carry out the hierarchical identification of cluster cell;
The input all the way of the double-current convolutional neural networks of cell cluster is:The feature of queueing discipline between nucleus, separately
Input is the cervical cell of cell cluster corresponding with the cell parameters all the way outside, and the present invention is unified by cervical cell input size
512*512 pixel values are normalized to, the convolution pond composite module by 8 cascades implicitly extracts the spy of cell image
Levy.The convolution kernel size of most important of which convolution operation uses 5*5 sizes, and step-length selection size is 2, and characteristic pattern number is chosen
For 108.
Interpretation and post-processing module, join for the first classification results and second of classification results to individual cells
Interpretation is closed, clash handle is carried out, obtains the classification results of individual cells;Utilize knowledge mapping and CAM (Class
Activation Mapping, class active map) method realize the readability of cervical cell identification process, cervical cell identification
As a result interpretation.
The first classification results and second of classification results of such as some cell are all the result of squamous cell carcinoma, then
Then the interpretation cell is squamous cell carcinoma.
When clash handle mainly solves various features sensing different sentence read results, comprehensive various factors eliminates conflict, done
Go out clearly reliable interpretation.The result that such as some cell is obtained by the first classification (double-current convolutional neural networks model) is squama
Shape cell cancer, and the result obtained by the second classification (knowledge mapping model) is low level SIL, such a feelings
Condition belongs to outcome conflict, and the processing present invention for conflict is to mark out the cell come final result can by the way of
Determined by diagosis doctor.
Above-described embodiment, has been carried out further to the purpose of the present invention, technical scheme and beneficial effect
Describe in detail, should be understood that the embodiment that the foregoing is only the present invention, be not intended to limit the present invention
Protection domain, within the spirit and principles of the invention, any modification, equivalent substitution and improvements done etc. all should be included
Within protection scope of the present invention.