CN110060235A - A kind of thyroid nodule ultrasonic image division method based on deep learning - Google Patents

A kind of thyroid nodule ultrasonic image division method based on deep learning Download PDF

Info

Publication number
CN110060235A
CN110060235A CN201910236399.6A CN201910236399A CN110060235A CN 110060235 A CN110060235 A CN 110060235A CN 201910236399 A CN201910236399 A CN 201910236399A CN 110060235 A CN110060235 A CN 110060235A
Authority
CN
China
Prior art keywords
image
thyroid
tubercle
ultrasound image
interest
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN201910236399.6A
Other languages
Chinese (zh)
Inventor
高洁
高明
牛文倩
徐天一
赵满坤
魏玺
张晟
王臣汉
刘志强
于瑞国
喻梅
尉智辉
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tianjin University
Original Assignee
Tianjin University
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tianjin University filed Critical Tianjin University
Priority to CN201910236399.6A priority Critical patent/CN110060235A/en
Publication of CN110060235A publication Critical patent/CN110060235A/en
Pending legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/12Edge-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10132Ultrasound image
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20092Interactive image processing based on input by user
    • G06T2207/20104Interactive definition of region of interest [ROI]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30096Tumor; Lesion

Landscapes

  • Engineering & Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • Theoretical Computer Science (AREA)
  • General Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Health & Medical Sciences (AREA)
  • Artificial Intelligence (AREA)
  • General Engineering & Computer Science (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Computing Systems (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computational Linguistics (AREA)
  • Data Mining & Analysis (AREA)
  • Evolutionary Computation (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Quality & Reliability (AREA)
  • Radiology & Medical Imaging (AREA)
  • Ultra Sonic Daignosis Equipment (AREA)
  • Image Processing (AREA)

Abstract

The invention discloses a kind of thyroid nodule ultrasonic image division method based on deep learning, it the described method comprises the following steps: inputting original Thyroid ultrasound image, area-of-interest prognostic chart is obtained by area-of-interest semantic segmentation model, and prognostic chart is corresponded in original Thyroid ultrasound image and extracts area-of-interest;The Thyroid ultrasound interesting image regions extracted are inputted in handmarking's identification model, and coarse positioning is carried out to the tubercle in area-of-interest;Coarse positioning image is inputted into Thyroid ultrasound image tubercle edge parted pattern, tubercle prognostic chart is obtained, draws tubercle edge.The present invention effectively overcomes the problems such as thyroid nodule ultrasound image resolution ratio is low, the more bring segmentations of interference information are difficult, accuracy rate is low, finally greatly improves the accuracy of nodule segmentation.

Description

A kind of thyroid nodule ultrasonic image division method based on deep learning
Technical field
The present invention relates to Ultrasound Image Segmentation field more particularly to a kind of thyroid nodule ultrasound figures based on deep learning As dividing method.
Background technique
Image, semantic segmentation be image is divided into different regions according to different semantemes, and by different colors come Visualization marks out the classification of object representated by these regions.Medical image segmentation is that the hot spot in image, semantic segmentation field is answered One of with.The purpose of medical image segmentation is that different parts is divided the image into according to the semantic features of image itself, to face Bed diagnosis and pathological research provide reliable basis, and the precision of segmentation not only influences other next processing steps, also The analysis of image may be influenced as a result, having an impact in turn to clinical diagnosis and research work.
The conventional method of image segmentation is broadly divided into based on region, based on edge and based on three kinds of partitioning algorithms of classification.
Algorithm based on region has watershed segmentation method, adaptive region growing method etc..Watershed segmentation method is to be based on Geodesic curve watershed principle of compositionality and the image segmentation algorithm proposed, can obtain preferable effect, but deposit in segmentation task To noise-sensitive, easy over-segmentation, profile is easy to be lost the problems such as.Adaptive region growing method is then the spy using different zones The automatic growth pattern for learning corresponding different zones of sign, achieves preferable effect on abdominal cavity CT image and brain MRI image Fruit.
Dividing method based on edge is to solve segmentation problem by detecting the edge comprising different zones, this method Difficult point is contradiction when edge detection between noise immunity and detection accuracy.To improve noise immunity, can generate profile missing inspection and Position deviation, to improve detection accuracy, the pseudo-edge that noise generates will lead to unreasonable profile.
Algorithm based on classifier has random number forest method, and random forest is made of multiple decision trees, by piece image After multiple decision tree classifications, each decision tree has a classification results, is generated by ballot mode to the final of the image Classification results.This method is the machine in normal service learning method of image, semantic segmentation, but is not applied to medical image segmentation.
In addition there are some other algorithms can be used for image segmentation.Such as based on the dividing method of statistics, this method is utilized Statistical theory carries out modeling to digital picture to be split to image object, and effectively noise can be inhibited to segmentation result Image, but be affected by initial parameter.It is sought based on the dividing method of genetic algorithm using the overall situation of genetic algorithm Excellent ability and its characteristic insensitive to initial position, can improve the performance of image segmentation, and the difficult point of this method is to adapt to Spend the selection of function and the determination of crossover probability and mutation probability.
Summary of the invention
The present invention provides a kind of thyroid nodule ultrasonic image division method based on deep learning, effective gram of the present invention The problems such as thyroid nodule ultrasound image resolution ratio is low, the more bring segmentations of interference information are difficult, accuracy rate is low has been taken, it is final big Width improves the accuracy of nodule segmentation, described below:
A kind of thyroid nodule ultrasonic image division method based on deep learning, the described method comprises the following steps:
Original Thyroid ultrasound image is inputted, area-of-interest prediction is obtained by area-of-interest semantic segmentation model Figure, and prognostic chart is corresponded in original Thyroid ultrasound image and extracts area-of-interest;
The Thyroid ultrasound interesting image regions extracted are inputted in handmarking's identification model, to area-of-interest In tubercle carry out coarse positioning;
Coarse positioning image is inputted into Thyroid ultrasound image tubercle edge parted pattern, tubercle prognostic chart is obtained, draws knot Save edge.
Wherein, the area-of-interest semantic segmentation model specifically: down-sampling with up-sample completely corresponding full convolution Neural network structure,
Web vector graphic 10 convolution sums 5 Chi Hualai guarantee that the receptive field of last pixel classifications result includes whole figure Picture;
Down-sampling carried out to characteristic pattern using a pond per convolution twice, continuous 5 times of Web vector graphic and pond layer are one by one Corresponding warp lamination up-samples characteristic pattern;
The result up-sampled every time is summed up with corresponding pond layer, is come as the input up-sampled next time gradually extensive The resolution ratio and details of complex pattern.
Further, Thyroid ultrasound image tubercle edge parted pattern specifically: full convolutional neural networks are used,
It, and successively will up-sampling result and pond using 2 times twice up-samplings when being up-sampled to down-sampling characteristic pattern Change layer pool4And pool3It sums up, using restoring image detail and resolution ratio and by result as the input up-sampled next time;
Last time up-sampling step-length be 8, be directly returned to original image resolution ratio, obtain segmentation tubercle and normal tissue it is pre- Mapping, and prognostic chart is corresponded in thyroid nodule coarse positioning image, draw tubercle edge.
The beneficial effect of the technical scheme provided by the present invention is that:
1, the present invention has preferable segmentation to hand over Thyroid ultrasound image nodule segmentation and compares, and segmentation result can be doctor Diagnosis tubercle it is good it is pernicious submit necessary information, can be improved the accuracy, objectivity and reliability of clinical diagnosis result, improve The working efficiency of doctor;
2, low for ultrasound image resolution ratio, the more brings of interference information divide the problems such as difficult, accuracy rate is low, the present invention The interference information in ultrasound image is gradually reduced by thtee-stage shiplock layer, finally increases substantially nodule segmentation accuracy.
Detailed description of the invention
Fig. 1 is a kind of flow chart of thyroid nodule ultrasonic image division method based on deep learning;
Fig. 2 is the friendship of three kinds of nodule segmentation modes and the curve graph than changing with training;
Fig. 3 is Thyroid ultrasound image tubercle edge proposed by the present invention parted pattern segmentation result and artificial segmentation result Comparison diagram.
Specific embodiment
To make the object, technical solutions and advantages of the present invention clearer, embodiment of the present invention is made below further Ground detailed description.
In recent years, with the rapid development of deep learning, Medical Image Processing is better solved using deep learning mechanism The problem research and discovery direction important as scholar and researchers.Dividing method neural network based can be solved preferably The certainly noise in image and non-uniform problem, convolutional neural networks are far super in the precision and efficiency in natural image segmentation field Conventional method.
Embodiment 1
In order to solve the problems, such as that background technique, the embodiment of the present invention propose a kind of first shape based on deep learning Gland tubercle ultrasonic image division method, referring to Fig. 1, method includes the following steps:
101: extracting area-of-interest (Region ofInterest, ROI) from original Thyroid ultrasound image;
Wherein, ultrasound image can be divided into ROI and background area, and wherein ROI is to include thyroid gland external morphology and structure Echo information region, background area is other parts in addition to ROI, comprising: ultrasound scanner model, various sweep parameters And the information that scan position etc. is unrelated with thyroid gland itself.
102: inputting the Thyroid ultrasound image ROI extracted, coarse positioning is carried out to the tubercle in ROI;
103: coarse positioning image being inputted into Thyroid ultrasound image tubercle edge parted pattern, obtains tubercle prognostic chart, is drawn Tubercle edge out.
In one embodiment, step 101 extracts ROI from original Thyroid ultrasound image, the specific steps are as follows:
Original Thyroid ultrasound image is inputted, obtains ROI prognostic chart by ROI semantic segmentation model, and by prognostic chart pair ROI should be extracted into original Thyroid ultrasound image.
Wherein, ROI semantic segmentation model uses down-sampling and up-sampling corresponding full convolutional neural networks structure completely, warp It crosses training and prediction is split to Thyroid ultrasound image.In order to learn the global information to image, Web vector graphic as far as possible 10 convolution sums, 5 Chi Hualai ensure that the receptive field of last pixel classifications result includes whole image as far as possible.Wherein, every two Secondary convolution carries out down-sampling to characteristic pattern using a pond.In order to enable neural network to acquire the edge ROI of more details Information, with the one-to-one warp lamination of pond layer up-samples characteristic pattern for Web vector graphic continuous 5 times, every time on adopt The result of sample is summed up with corresponding pond layer, gradually restore as the input up-sampled next time the resolution ratio of image with Details.
In one embodiment, step 102 carries out coarse positioning to the tubercle in ROI on the basis of step 101, specific to walk It is rapid as follows:
The Thyroid ultrasound image ROI that input step 101 extracts, using handmarking's identification model to tubercle in ROI Carry out coarse positioning.The artificial marker recognition model is using existing convolutional neural networks, and convolutional layer inputs 19 × 19 × 3 figure Picture, by connect after down-sampling twice with full articulamentum, each down-sampling is by two 3 × 3 convolution and a maximum value Pondization composition, characteristic pattern depth are 16, and full articulamentum is connect with the output layer encoded by one-hot, and output vector is [1,0] table Show that input picture is not handmarking, output vector is that [0,1] indicates that input picture belongs to handmarking.Convolutional layer with connect entirely Layer uses ReLU as activation primitive.After the completion of handmarking's identification, corresponding square is drawn according to the position of label in the roi Shape frame to carry out coarse segmentation to thyroid nodule.
Wherein, handmarking's identification model is known to those skilled in the art, and the embodiment of the present invention does not repeat them here this.
In one embodiment, step 103 divides tubercle on the basis of step 101 and step 102, draws the side of tubercle Edge, the specific steps are as follows:
Divide mould for the thyroid nodule coarse positioning image of 224 × 224 sizes as Thyroid ultrasound image tubercle edge The original image of type input carries out edge mark to original image under tumour hospital, Medical University Of Tianjin radiologist guidance Image label image as input after note using binaryzation.Thyroid ultrasound image tubercle edge parted pattern is using complete Convolutional neural networks model, but it is different from ROI parted pattern, and down-sampling layer has used for reference FCN (Fully Convolutional Networks) algorithm has used the deeper VGG19 of depth (Visual Geometry Group 19) model.Based on VGG19 points The down-sampling process of class model shares 5 down-samplings, preceding down-sampling twice using two 3 × 3 convolution kernel to input picture into The characteristic pattern of generation is used the input behind maximum value pond as down-sampling next time, twice down-sampling point by row sliding window convolution Not Wei 64 peacekeepings 128 dimension, after three times down-sampling used four 3 × 3 convolution kernels to input picture carry out sliding window convolution exist Maximum value pond is carried out, dimension is respectively 256,512,512, and saving down-sampling result is respectively pool3、pool4、pool5.? In VGG19 sorter network, characteristic pattern is next mapped as feature vector using three layers of full articulamentum will be special using softmax DUAL PROBLEMS OF VECTOR MAPPING is levied to sample labeling space, obtains classification results.In full convolutional neural networks, use and pool5Characteristic pattern is big Small identical, the increased convolution kernel of dimension is by pool5All features both map to each pixel of next layer of characteristic pattern in characteristic pattern In vector, then characteristic pattern is mapped using two 1 × 1 convolution kernels, obtains the down-sampling comprising pixel classifications information Characteristic pattern.When being up-sampled to down-sampling characteristic pattern, first using twice 2 times up-sampling and successively will up-sampling result and pool4And pool3It sums up using restoring image detail and resolution ratio and by result as the input up-sampled next time, finally Primary up-sampling step-length is 8, is directly returned to original image resolution ratio, obtains the prognostic chart of segmentation tubercle and normal tissue, and will be pre- Mapping corresponds in thyroid nodule coarse positioning image, draws tubercle edge.
In conclusion the embodiment of the present invention effectively overcomes thyroid nodule ultrasound image resolution ratio through the above steps Low, the more brings of interference information divide the problems such as difficult, accuracy rate is low, finally greatly improve the accuracy of nodule segmentation.
Embodiment 2
The scheme in embodiment 1 is further introduced below with reference to Fig. 1, specific calculation formula, it is as detailed below Description:
201: during being split to thyroid nodule ultrasound image, first having to from original thyroid nodule ultrasound figure ROI is extracted as in;
The embodiment of the present invention propose a kind of full convolutional neural networks model to carry out ROI to Thyroid ultrasound image it is semantic Segmentation.In order to learn the global information to image as far as possible, full convolutional neural networks structure has used 10 convolution sums, 5 ponds To ensure that the receptive field of last pixel classifications result includes whole image as far as possible.
202:ROI parted pattern selects cross entropy as loss function, as shown in formula (1).
Wherein, yiIt is the true tag of classification i, piIt is the probability value of the calculated classification i of softmax, k is classification number, N It is total sample number.
203:ROI parted pattern selects Adam optimizer, and definition is as shown in formula (2).
Wherein, θt+1Indicate the t+1 moment i.e. parameter of t+1 iterative model, θtIndicate the t moment i.e. ginseng of t iterative model Number, η is learning rate,For the correction value of single order momentum term,For the correction value of second order momentum term, ε is a value very little Number (generally 1e-8) is 0 to avoid denominator.
204: Thyroid ultrasound image ROI being pre-processed with Image differentiation method;
205: the handmarking that Ultrasonography doctor is added in ultrasound image tubercle part using convolutional neural networks model It is identified, because the essence identified to handmarking is two classification problems of image, each node only has negative class 0 and just 1 two kinds of possibilities of class simplify above-mentioned formula (1) so choosing target loss function of the binary cross entropy as training, Simplify shown in result such as formula (3);
Wherein, yi indicates the true tag of classification i,The probability for being 1 for current sample label.
206: after the completion of handmarking's identification, corresponding rectangle frame being drawn in the roi come to first shape according to the position of label Gland tubercle carries out coarse segmentation;
207: thyroid nodule coarse positioning image being used to input as Thyroid ultrasound image tubercle edge parted pattern Original image, to the image label image as input after original image progress edge labelling using binaryzation;
208: dividing tubercle in coarse segmentation image, choose the target loss function that cross entropy is training;It is excellent to choose Adam Change optimizer of the device as Thyroid ultrasound image tubercle edge parted pattern;
209: training after the completion of, using Thyroid ultrasound image tubercle edge parted pattern to thyroid gland coarse positioning image into The segmentation of row edge.
In conclusion 201- step 209 avoids ultrasound image background area to the embodiment of the present invention through the above steps Noise jamming, and reduce the information interference of the analogous tissue of thyroid gland areas in ROI, not only increase algorithm characteristics extraction Quality, and improve the convergence of algorithm model.
Embodiment 3
Feasibility verifying is carried out to the scheme in Examples 1 and 2 below with reference to specific calculation formula, example, is detailed in down Text description:
In order to compare influence of the different segmentation levels to segmentation result, 1000 that tumour hospital, Medical University Of Tianjin is provided Raw ultrasound image data set original image as input is opened, dept. of radiology's physician guidance under Thyroid ultrasound image original image is used Under tubercle edge mark be used as label image, 80% be used as training set, 20% be used as test set, use Thyroid ultrasound image Tubercle edge parted pattern is split.Meanwhile thyroid gland raw ultrasound image is subjected to ROI segmentation, and in radiologist Label image behind guidance lower mark tubercle edge synchronizes segmentation, obtains the nodule segmentation data set under ROI image, and 80% As training set, 20% is used as test set, is equally split using Thyroid ultrasound image tubercle edge parted pattern.
Compared with carrying out nodule segmentation directly on the original image of Thyroid ultrasound image, identical parted pattern is in first The test set that thyroid nodule is split is handed over and is compared on the tubercle coarse positioning image of shape gland ultrasound image and improves 12%;With It carries out nodule segmentation on Thyroid ultrasound ROI image to compare, test set, which is handed over and compared, improves 7.8%.And coarse positioning image point 21.6% friendship and ratio, significantly larger than other two kinds of partitioning schemes can be reached when training starts by cutting tubercle, and be restrained more Rapidly.
The experimental results showed that successively carrying out nodule segmentation to Thyroid ultrasound image can effectively improve gradient decline convergence Speed, and improve the precision of final nodule segmentation, as shown in Figure 2.
Comparison thyroid nodule coarse positioning ultrasound image is drawn under tumour hospital, Medical University Of Tianjin radiologist guidance The segmentation result of the thyroid nodule edge ultrasound image and Thyroid ultrasound image tubercle edge parted pattern produced, such as Fig. 3 It is shown, it can be seen that Thyroid ultrasound image tubercle edge segmentation result in dept. of radiology, tumour hospital, Medical University Of Tianjin The result manually drawn under physician guidance still has certain gap in fine degree and details, but can provide to diagnosis must The information wanted.
In Fig. 2, original image divides the initial friendship of tubercle and than only 3.7%, and ROI image divides the initial friendship of tubercle And than be 8.2%, coarse positioning image segmentation tubercle it is initial friendship and ratio reach 21.6%, facilitate gradient decline convergence Matter.With trained progress, it is 20 times that original image segmentation tubercle, which is handed over and compares the number of iterations when starting convergence, finally hands over and compares Stablize 75% or so.It is 15 times that ROI segmentation tubercle, which is handed over and compares the number of iterations when starting convergence, final to hand over and than stablizing 80% or so.It is 5 times that coarse positioning image segmentation tubercle, which is handed over and compares the number of iterations when starting convergence, final to hand over and than stablizing 87% or so.As shown in Figure 2, Thyroid ultrasound image tubercle edge parted pattern exists to the nodule segmentation of Thyroid ultrasound image Significant effect is promoted in precision and convergence rate.
In Fig. 3, first is classified as thyroid nodule coarse positioning ultrasound image, and second is classified as in Medical University Of Tianjin's tumour doctor The thyroid nodule edge ultrasound image drawn out under institute radiologist guidance, third are classified as Thyroid ultrasound image tubercle side The segmentation result of edge parted pattern.
From the figure 3, it may be seen that the edge of manual drawing is quicker to the variation at tubercle edge under professional radiologist guidance Sense, Fig. 3 the first row secondary series top-right part edge and the tertial model segmentation result of the first row have larger difference, model point It is more smooth to cut result.It is similar, in the second row thyroid model segmentation result in edge details with the side manually drawn Edge has a small amount of difference.But the segmentation result of Thyroid ultrasound image tubercle edge parted pattern can be with accurate description knot The morphological features such as the shape and aspect ratio of section, these are characterized in the pernicious important evidence of diagnosis Benign Thyroid Nodules, because This segmentation result can provide help for the diagnosis of doctor.
It is instructed by comparison thyroid nodule coarse positioning ultrasound image, in tumour hospital, Medical University Of Tianjin radiologist Under the thyroid nodule edge ultrasound image drawn out and thyroid nodule Accurate Segmentation model segmentation result, as shown in figure 3, As can be seen that model segmentation result can be with morphological features such as the shape of accurate description tubercle and aspect ratios, it can be for doctor's Diagnosis extends efficient help.
It will be appreciated by those skilled in the art that attached drawing is the schematic diagram of a preferred embodiment, the embodiments of the present invention Serial number is for illustration only, does not represent the advantages or disadvantages of the embodiments.
The foregoing is merely presently preferred embodiments of the present invention, is not intended to limit the invention, it is all in spirit of the invention and Within principle, any modification, equivalent replacement, improvement and so on be should all be included in the protection scope of the present invention.

Claims (3)

1. a kind of thyroid nodule ultrasonic image division method based on deep learning, which is characterized in that the method includes with Lower step:
Original Thyroid ultrasound image is inputted, area-of-interest prognostic chart is obtained by area-of-interest semantic segmentation model, and Prognostic chart is corresponded in original Thyroid ultrasound image and extracts area-of-interest;
The Thyroid ultrasound interesting image regions extracted are inputted in handmarking's identification model, in area-of-interest Tubercle carries out coarse positioning;
Coarse positioning image is inputted into Thyroid ultrasound image tubercle edge parted pattern, tubercle prognostic chart is obtained, draws tubercle side Edge.
2. a kind of thyroid nodule ultrasonic image division method based on deep learning according to claim 1, feature Be, the area-of-interest semantic segmentation model specifically: down-sampling with up-sample completely corresponding full convolutional neural networks Structure,
Web vector graphic 10 convolution sums 5 Chi Hualai guarantee that the receptive field of last pixel classifications result includes whole image;
Down-sampling carried out to characteristic pattern using a pond per convolution twice, continuous 5 times of Web vector graphic and pond layer one-to-one correspondence Warp lamination characteristic pattern is up-sampled;
The result up-sampled every time is summed up with corresponding pond layer, gradually restores to scheme as the input up-sampled next time The resolution ratio and details of picture.
3. a kind of thyroid nodule ultrasonic image division method based on deep learning according to claim 1, feature It is, Thyroid ultrasound image tubercle edge parted pattern specifically: full convolutional neural networks are used,
It, and successively will up-sampling result and pond layer using 2 times twice up-samplings when being up-sampled to down-sampling characteristic pattern pool4And pool3It sums up, using restoring image detail and resolution ratio and by result as the input up-sampled next time;
Last time up-sampling step-length is 8, is directly returned to original image resolution ratio, obtains the prediction of segmentation tubercle and normal tissue Figure, and prognostic chart is corresponded in thyroid nodule coarse positioning image, draw tubercle edge.
CN201910236399.6A 2019-03-27 2019-03-27 A kind of thyroid nodule ultrasonic image division method based on deep learning Pending CN110060235A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910236399.6A CN110060235A (en) 2019-03-27 2019-03-27 A kind of thyroid nodule ultrasonic image division method based on deep learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910236399.6A CN110060235A (en) 2019-03-27 2019-03-27 A kind of thyroid nodule ultrasonic image division method based on deep learning

Publications (1)

Publication Number Publication Date
CN110060235A true CN110060235A (en) 2019-07-26

Family

ID=67317388

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910236399.6A Pending CN110060235A (en) 2019-03-27 2019-03-27 A kind of thyroid nodule ultrasonic image division method based on deep learning

Country Status (1)

Country Link
CN (1) CN110060235A (en)

Cited By (19)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110706793A (en) * 2019-09-25 2020-01-17 天津大学 Attention mechanism-based thyroid nodule semi-supervised segmentation method
CN111161273A (en) * 2019-12-31 2020-05-15 电子科技大学 Medical ultrasonic image segmentation method based on deep learning
CN111242956A (en) * 2020-01-09 2020-06-05 西北工业大学 U-Net-based ultrasonic fetal heart and fetal lung deep learning joint segmentation method
CN111292324A (en) * 2020-03-20 2020-06-16 电子科技大学 Multi-target identification method and system for brachial plexus ultrasonic image
CN111652837A (en) * 2020-04-16 2020-09-11 上海长征医院 AI-based thyroid nodule left and right lobe positioning and ultrasonic report error correction method
CN112036395A (en) * 2020-09-04 2020-12-04 联想(北京)有限公司 Text classification identification method and device based on target detection
CN112070089A (en) * 2020-09-23 2020-12-11 西安交通大学医学院第二附属医院 Ultrasonic image-based intelligent diagnosis method and system for diffuse thyroid diseases
CN112085743A (en) * 2020-09-04 2020-12-15 厦门大学 Image segmentation method for renal tumor
CN112308065A (en) * 2020-07-09 2021-02-02 什维新智医疗科技(上海)有限公司 Method, system and electronic equipment for identifying features in ultrasonic image
CN112529894A (en) * 2020-12-22 2021-03-19 徐州医科大学 Thyroid nodule diagnosis method based on deep learning network
CN112634240A (en) * 2020-12-25 2021-04-09 南京邮电大学 Thyroid ultrasound image interference interface automatic identification and removal method based on threshold segmentation
CN113393512A (en) * 2021-05-19 2021-09-14 哈尔滨工业大学 Thyroid volume automatic estimation method and system based on two-dimensional ultrasonic image
CN113436154A (en) * 2021-06-11 2021-09-24 北京小白世纪网络科技有限公司 Thyroid nodule edge symptom classification method, device and system
CN113450326A (en) * 2021-06-28 2021-09-28 什维新智医疗科技(上海)有限公司 Blood vessel information extraction element of thyroid gland tubercle
WO2021208677A1 (en) * 2020-04-14 2021-10-21 华为技术有限公司 Eye bag detection method and device
CN113592797A (en) * 2021-07-21 2021-11-02 山东大学 Mammary nodule risk grade prediction system based on multi-data fusion and deep learning
CN113842164A (en) * 2021-09-14 2021-12-28 上海市第六人民医院 System and method for detecting BRAF-V600E mutation
CN114782676A (en) * 2022-04-02 2022-07-22 北京广播电视台 Method and system for extracting region of interest of video
CN115375854A (en) * 2022-10-25 2022-11-22 天津市肿瘤医院(天津医科大学肿瘤医院) Ultrasonic imaging equipment image processing method fused with liquid crystal device and related device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018015414A1 (en) * 2016-07-21 2018-01-25 Siemens Healthcare Gmbh Method and system for artificial intelligence based medical image segmentation
CN107680678A (en) * 2017-10-18 2018-02-09 北京航空航天大学 Based on multiple dimensioned convolutional neural networks Thyroid ultrasound image tubercle auto-check system
US20180165808A1 (en) * 2016-06-27 2018-06-14 University Of Central Florida Research Foundation, Inc. System and method for image-based quantification of white and brown adipose tissue at the whole-body, organ and body-region levels
CN108734694A (en) * 2018-04-09 2018-11-02 华南农业大学 Thyroid tumors ultrasonoscopy automatic identifying method based on faster r-cnn
CN109087327A (en) * 2018-07-13 2018-12-25 天津大学 A kind of thyroid nodule ultrasonic image division method cascading full convolutional neural networks

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20180165808A1 (en) * 2016-06-27 2018-06-14 University Of Central Florida Research Foundation, Inc. System and method for image-based quantification of white and brown adipose tissue at the whole-body, organ and body-region levels
WO2018015414A1 (en) * 2016-07-21 2018-01-25 Siemens Healthcare Gmbh Method and system for artificial intelligence based medical image segmentation
CN107680678A (en) * 2017-10-18 2018-02-09 北京航空航天大学 Based on multiple dimensioned convolutional neural networks Thyroid ultrasound image tubercle auto-check system
CN108734694A (en) * 2018-04-09 2018-11-02 华南农业大学 Thyroid tumors ultrasonoscopy automatic identifying method based on faster r-cnn
CN109087327A (en) * 2018-07-13 2018-12-25 天津大学 A kind of thyroid nodule ultrasonic image division method cascading full convolutional neural networks

Non-Patent Citations (3)

* Cited by examiner, † Cited by third party
Title
RUIGUO YU,ET AL: "Localization of Thyroid Nodules in Ultrasonic Images" *
XIANG YING, ET AL: "Thyroid Nodule Segmentation in Ultrasound Images Based on Cascaded Convolutional Neural Network" *
XIANG YING, ET AL: "Thyroid Nodule Segmentation in Ultrasound Images Based on Cascaded Convolutional Neural Network", 《INTERNATIONAL CONFERENCE ON NEURAL INFORMATION PROCESSING ICONIP 2018: NEURAL INFORMATION PROCESSING》 *

Cited By (29)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110706793A (en) * 2019-09-25 2020-01-17 天津大学 Attention mechanism-based thyroid nodule semi-supervised segmentation method
CN111161273A (en) * 2019-12-31 2020-05-15 电子科技大学 Medical ultrasonic image segmentation method based on deep learning
CN111161273B (en) * 2019-12-31 2023-03-21 电子科技大学 Medical ultrasonic image segmentation method based on deep learning
CN111242956A (en) * 2020-01-09 2020-06-05 西北工业大学 U-Net-based ultrasonic fetal heart and fetal lung deep learning joint segmentation method
CN111292324A (en) * 2020-03-20 2020-06-16 电子科技大学 Multi-target identification method and system for brachial plexus ultrasonic image
CN111292324B (en) * 2020-03-20 2022-03-01 电子科技大学 Multi-target identification method and system for brachial plexus ultrasonic image
WO2021208677A1 (en) * 2020-04-14 2021-10-21 华为技术有限公司 Eye bag detection method and device
CN113536834A (en) * 2020-04-14 2021-10-22 华为技术有限公司 Pouch detection method and device
CN111652837A (en) * 2020-04-16 2020-09-11 上海长征医院 AI-based thyroid nodule left and right lobe positioning and ultrasonic report error correction method
CN111652837B (en) * 2020-04-16 2022-09-09 上海长征医院 AI-based thyroid nodule left and right lobe positioning and ultrasonic report error correction method
CN112308065B (en) * 2020-07-09 2024-05-24 什维新智医疗科技(上海)有限公司 Method, system and electronic equipment for identifying characteristics in ultrasonic image
CN112308065A (en) * 2020-07-09 2021-02-02 什维新智医疗科技(上海)有限公司 Method, system and electronic equipment for identifying features in ultrasonic image
CN112085743A (en) * 2020-09-04 2020-12-15 厦门大学 Image segmentation method for renal tumor
CN112036395B (en) * 2020-09-04 2024-05-28 联想(北京)有限公司 Text classification recognition method and device based on target detection
CN112036395A (en) * 2020-09-04 2020-12-04 联想(北京)有限公司 Text classification identification method and device based on target detection
CN112070089A (en) * 2020-09-23 2020-12-11 西安交通大学医学院第二附属医院 Ultrasonic image-based intelligent diagnosis method and system for diffuse thyroid diseases
CN112529894A (en) * 2020-12-22 2021-03-19 徐州医科大学 Thyroid nodule diagnosis method based on deep learning network
CN112634240B (en) * 2020-12-25 2022-09-23 南京邮电大学 Thyroid ultrasound image interference interface automatic identification and removal method based on threshold segmentation
CN112634240A (en) * 2020-12-25 2021-04-09 南京邮电大学 Thyroid ultrasound image interference interface automatic identification and removal method based on threshold segmentation
CN113393512A (en) * 2021-05-19 2021-09-14 哈尔滨工业大学 Thyroid volume automatic estimation method and system based on two-dimensional ultrasonic image
CN113436154A (en) * 2021-06-11 2021-09-24 北京小白世纪网络科技有限公司 Thyroid nodule edge symptom classification method, device and system
CN113450326A (en) * 2021-06-28 2021-09-28 什维新智医疗科技(上海)有限公司 Blood vessel information extraction element of thyroid gland tubercle
CN113592797A (en) * 2021-07-21 2021-11-02 山东大学 Mammary nodule risk grade prediction system based on multi-data fusion and deep learning
CN113842164A (en) * 2021-09-14 2021-12-28 上海市第六人民医院 System and method for detecting BRAF-V600E mutation
CN113842164B (en) * 2021-09-14 2024-02-20 上海市第六人民医院 Systems and methods for detecting BRAF-V600E mutations
CN114782676A (en) * 2022-04-02 2022-07-22 北京广播电视台 Method and system for extracting region of interest of video
CN114782676B (en) * 2022-04-02 2023-01-06 北京广播电视台 Method and system for extracting region of interest of video
CN115375854A (en) * 2022-10-25 2022-11-22 天津市肿瘤医院(天津医科大学肿瘤医院) Ultrasonic imaging equipment image processing method fused with liquid crystal device and related device
CN115375854B (en) * 2022-10-25 2022-12-20 天津市肿瘤医院(天津医科大学肿瘤医院) Ultrasonic image equipment image processing method fused with liquid crystal device and related device

Similar Documents

Publication Publication Date Title
CN110060235A (en) A kind of thyroid nodule ultrasonic image division method based on deep learning
CN111192245B (en) Brain tumor segmentation network and method based on U-Net network
EP3432263B1 (en) Semantic segmentation for cancer detection in digital breast tomosynthesis
Wang et al. CT male pelvic organ segmentation using fully convolutional networks with boundary sensitive representation
CN105957066B (en) CT image liver segmentation method and system based on automatic context model
CN102324109B (en) Method for three-dimensionally segmenting insubstantial pulmonary nodule based on fuzzy membership model
CN110337669A (en) Multiclass image partition method
CN104933709B (en) Random walk CT lung tissue image automatic segmentation methods based on prior information
CN109215033A (en) The method and system of image segmentation
CN109493317A (en) The more vertebra dividing methods of 3D based on concatenated convolutional neural network
CN102385751B (en) Liver tumor region segmentation method based on watershed transform and classification through support vector machine
CN103473767B (en) The method and system that a kind of soft tissues of abdomen nuclear-magnetism image is cut apart
CN103824295A (en) Segmentation method of adhesion vascular pulmonary nodules in lung CT (computed tomography) image
CN107977952A (en) Medical image cutting method and device
CN104899851A (en) Lung nodule image segmentation method
Tan et al. Analysis of segmentation of lung parenchyma based on deep learning methods
CN106204600A (en) Cerebral tumor image partition method based on multisequencing MR image related information
CN112734755A (en) Lung lobe segmentation method based on 3D full convolution neural network and multitask learning
CN112767411B (en) Synchronous segmentation method for multiple organs of lung
Liu et al. Automatic segmentation algorithm of ultrasound heart image based on convolutional neural network and image saliency
CN112862783A (en) Thyroid CT image nodule automatic diagnosis system based on neural network
CN111784713A (en) Attention mechanism-introduced U-shaped heart segmentation method
Kitrungrotsakul et al. Interactive deep refinement network for medical image segmentation
CN114581474A (en) Automatic clinical target area delineation method based on cervical cancer CT image
Zhou et al. HAUNet-3D: a novel hierarchical attention 3D UNet for lung nodule segmentation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
RJ01 Rejection of invention patent application after publication

Application publication date: 20190726

RJ01 Rejection of invention patent application after publication