CN113223003A - Bile duct image segmentation method based on deep learning - Google Patents

Bile duct image segmentation method based on deep learning Download PDF

Info

Publication number
CN113223003A
CN113223003A CN202110493746.0A CN202110493746A CN113223003A CN 113223003 A CN113223003 A CN 113223003A CN 202110493746 A CN202110493746 A CN 202110493746A CN 113223003 A CN113223003 A CN 113223003A
Authority
CN
China
Prior art keywords
image
data set
bile duct
intrahepatic
abdomen
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110493746.0A
Other languages
Chinese (zh)
Inventor
王博
赵威
申建虎
张伟
徐正清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing precision diagnosis Medical Technology Co.,Ltd.
Original Assignee
Xi'an Zhizhen Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xi'an Zhizhen Intelligent Technology Co ltd filed Critical Xi'an Zhizhen Intelligent Technology Co ltd
Priority to CN202110493746.0A priority Critical patent/CN113223003A/en
Publication of CN113223003A publication Critical patent/CN113223003A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T3/00Geometric image transformations in the plane of the image
    • G06T3/40Scaling of whole images or parts thereof, e.g. expanding or contracting
    • G06T3/4046Scaling of whole images or parts thereof, e.g. expanding or contracting using neural networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/50Image enhancement or restoration using two or more images, e.g. averaging or subtraction
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T5/00Image enhancement or restoration
    • G06T5/70Denoising; Smoothing
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20081Training; Learning
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30056Liver; Hepatic

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Evolutionary Computation (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • General Engineering & Computer Science (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Computational Linguistics (AREA)
  • Software Systems (AREA)
  • Mathematical Physics (AREA)
  • Health & Medical Sciences (AREA)
  • Biomedical Technology (AREA)
  • Biophysics (AREA)
  • Computing Systems (AREA)
  • General Health & Medical Sciences (AREA)
  • Molecular Biology (AREA)
  • Evolutionary Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Image Analysis (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

The invention discloses a bile duct image segmentation method based on deep learning, which comprises the steps of firstly, obtaining an abdomen CT image, and labeling an intrahepatic bile duct expansion image in the abdomen CT image to obtain a data set; preprocessing the data set, including setting upper and lower threshold values of the gray value of the data set, calculating to obtain the mean value and the variance of the gray value of the data set, and normalizing the gray value of the data set according to the obtained mean value and variance; and then constructing an intrahepatic expanded bile duct segmentation model based on 3D U-Net, and training by using a data set, wherein the training process comprises training and correcting the intrahepatic expanded bile duct segmentation model, and finally processing an abdominal CT image to be segmented by using the trained intrahepatic expanded bile duct segmentation model to obtain an intrahepatic expanded bile duct image segmentation result.

Description

Bile duct image segmentation method based on deep learning
Technical Field
The invention belongs to the field of medical image processing, and particularly relates to a bile duct image segmentation method based on deep learning.
Background
Hepatobiliary lithiasis is an important cause of death of benign biliary tract diseases in China. The operation of hepatobiliary calculus is complex, even if regular hepatectomy and choledochoscope in operation are matched, the calculus residue rate after operation is still up to 30%, and part of patients need to carry out twice or even multiple times of biliary tract operation treatment, so that the segmentation and reconstruction of the bile duct image can be intuitively carried out by doctors, and the diagnosis and treatment method has important significance.
In recent years, with the increasing degree of social modernization and information, a large number of researchers have studied image segmentation techniques in CT. Although the medical image segmentation of the biliary duct system is relatively small, in the current image segmentation research of other tissues and organs, the bile duct image segmentation is generally performed by adopting a threshold segmentation method and a region growing segmentation method.
The threshold segmentation is a segmentation technology based on regions, when the gray level ranges of a target region and a background region are different, the image segmentation effect is obvious, however, the threshold segmentation method is sensitive to noise and poor in accuracy, the segmentation result is excessively dependent on the gray level range of the region to be segmented, the region growing segmentation method needs to manually select seed points, automatic segmentation cannot be achieved, and the segmentation efficiency is low.
Disclosure of Invention
In order to solve the above problems in the prior art, the invention provides a bile duct image segmentation method based on deep learning, which solves the problems of noise sensitivity and low efficiency and the like in the prior art through preprocessing operation, preprocessing neural network and post-processing operation, and adopts the following technical scheme:
a bile duct image segmentation method based on deep learning is characterized by comprising the following steps:
s1, acquiring an abdomen CT image, and labeling an intrahepatic dilated bile duct image in the abdomen CT image to obtain a data set;
s2, preprocessing the data set; the preprocessing operation comprises the following steps: setting upper and lower thresholds of a gray value of the data set, calculating to obtain a mean value and a variance of the gray value of the data set, and performing normalization operation on the gray value of the data set according to the obtained mean value and variance; the normalization operation specifically includes:
Figure BDA0003053449290000021
wherein y is the normalized data set image, x is the data set image before normalization, mu is the mean value of the grey values of the data set, and sigma is the variance of the grey values of the data set;
s3, constructing a 3 DU-Net-based intrahepatic bile duct expansion segmentation model, and training by using the data set to obtain a trained intrahepatic bile duct expansion segmentation model;
the training process specifically comprises: dividing the data set into a training set and a test set; training the intrahepatic expansion bile duct segmentation model by using the training set, wherein a Dice function is used as a loss function of the network, an Adam optimizer is adopted, and the initial learning rate is set to be 1 x 10-4(ii) a Performing model correction on the intrahepatic bile duct dilation segmentation model by using the test set, wherein a Focalloss function is used as a loss function, an SGD (generalized regression) function is used as an optimizer, and the initial learning rate is set to be 1 x 10-5
S4, acquiring an abdomen CT image to be segmented, preprocessing the abdomen CT image to be segmented, and inputting the preprocessed abdomen CT image to be segmented into the trained intrahepatic cholangiodilation segmentation model to obtain an intrahepatic cholangiodilation image segmentation result.
Further, the pre-processing operation further comprises scaling an image resolution of the data set.
Further, the Dice function is used to characterize the degree of similarity of two contour regions.
The invention has the beneficial effects that:
through preprocessing operation, preprocessing neural network and post-processing operation, the problems of sensitive noise, low efficiency and the like of the existing intrahepatic expanded bile duct segmentation technology are solved, and the segmentation efficiency and accuracy are improved.
Drawings
FIG. 1 is a schematic flow chart of a bile duct image segmentation method based on deep learning according to the invention;
fig. 2 is a structural diagram of a 3D intrahepatic bile duct dilation segmentation model of the present invention.
Detailed Description
The technical scheme of the invention is further described by combining the drawings and the embodiment:
the embodiment provides a bile duct image segmentation method based on deep learning, which comprises the following steps:
step 1, obtaining an abdomen CT image, and labeling an intrahepatic bile duct dilation image in the abdomen CT image to obtain a data set.
In the embodiment of the application, the intrahepatic dilated bile duct image in the abdominal CT image is labeled in an artificial labeling mode, so that an abdominal CT image data set with intrahepatic dilated bile duct image labeling is obtained.
And 2, preprocessing the data set.
In an embodiment of the present application, the preprocessing operation includes: setting upper and lower thresholds of a gray value of a data set, calculating to obtain a mean value and a variance of the gray value of the data set, and performing normalization operation on the gray value of the data set according to the obtained mean value and variance, wherein the normalization operation specifically comprises the following steps:
Figure BDA0003053449290000031
wherein y is the normalized data set image, x is the data set image before normalization, μ is the mean value of the grey scale values of the data set, and σ is the variance of the grey scale values of the data set.
The pre-processing operation may also include a scaling operation on the image size of the data set to set the image resolution in all data sets to 256 × 256 × 256.
Step 3, constructing a 3 DU-Net-based intrahepatic bile duct expansion segmentation model, and training by using a data set to obtain a trained intrahepatic bile duct expansion segmentation model;
the intrahepatic bile duct dilation segmentation model comprises a coding part and a decoding part, wherein the coding part is used for extracting and analyzing the features of an input image, and the decoding part is used for restoring the extracted features of the input image.
In the embodiment of the present application, the intrahepatic dilating bile duct segmentation model may adopt a 3DU-Net network, which includes 3 downsampling layers and 3 upsampling layers as shown in fig. 2, wherein the convolution kernel in the sampling layer is 3 × 3.
The training process specifically comprises: dividing a data set into a training set and a testing set; specifically, a training set in an abdominal CT image data set with intrahepatic expansion bile duct image labels is input into the intrahepatic expansion bile duct segmentation model, and feature extraction is carried out on the first convolution layer to obtain a first feature map;
the first feature map is zoomed through a first downsampling layer and is convolved on a second convolution layer to obtain a second feature map;
the second feature map is zoomed through a second downsampling layer and is convolved on a third convolution layer to obtain a third feature map;
the third feature map is scaled through a third downsampling layer and is convolved on a fourth convolution layer to obtain a fourth feature map, and the fourth feature is a bottom feature;
the fourth feature map is subjected to upsampling, fused with the third feature map and subjected to feature recovery in the first deconvolution layer to obtain a fifth feature map;
the fifth feature map is subjected to upsampling, fused with the second feature map and subjected to feature recovery in the second deconvolution layer to obtain a sixth feature map;
and the sixth feature map is subjected to upsampling, fused with the first feature map and subjected to feature recovery in the third deconvolution layer to obtain a model segmentation result.
Using Dice function as loss function of network, adopting Adam optimizer, setting initial learning rate to 1 × 10-4Where the Dice function is understood to be the similarity between two outline regions, A, B represents the point set included in the two outline regions, and is defined as:
Figure BDA0003053449290000051
obtaining a liver internal expansion bile duct segmentation model which is trained by a training set, and performing model correction on the liver internal expansion bile duct segmentation model by using a testing set, namely retraining, wherein a Focal loss function is used as a loss function, an SGD (generalized partial decomposition) is used as an optimizer, the initial learning rate is set to be 1 multiplied by 10-5Wherein the Focal loss function is specifically as follows:
Figure BDA0003053449290000052
wherein N is the number of images in the test set, i is the ith image in the test set, and yiLabel class, p, representing the ith image of the test setiIndicates the probability that the ith image is of a real category (i.e. y is 1), α is a weight parameter, logpiAs an initial cross-entropy loss function, (1-p)i)γGamma is the focusing parameter for the sample adjustment factor.
S4, acquiring an abdomen CT image to be segmented, preprocessing the abdomen CT image to be segmented, inputting the preprocessed abdomen CT image to be segmented into the trained intrahepatic bile duct expansion segmentation model, and obtaining an intrahepatic bile duct expansion image segmentation result.
In the implementation of the method, the phenomena of impurity points and missing segmentation of the expanded bile duct in the liver segmented by the existing algorithm can be avoided.
It is to be understood that the invention is not limited to the examples described above, but that modifications and variations may be effected thereto by those of ordinary skill in the art in light of the foregoing description, and that all such modifications and variations are intended to be within the scope of the invention as defined by the appended claims.

Claims (3)

1. A bile duct image segmentation method based on deep learning is characterized by comprising the following steps:
s1, acquiring an abdomen CT image, and labeling an intrahepatic dilated bile duct image in the abdomen CT image to obtain a data set;
s2, preprocessing the data set; the preprocessing operation comprises the following steps: setting upper and lower thresholds of a gray value of the data set, calculating to obtain a mean value and a variance of the gray value of the data set, and performing normalization operation on the gray value of the data set according to the obtained mean value and variance; the normalization operation specifically includes:
Figure FDA0003053449280000011
wherein y is the normalized data set image, x is the data set image before normalization, mu is the mean value of the grey values of the data set, and sigma is the variance of the grey values of the data set;
s3, constructing a 3D U-Net-based intrahepatic bile duct expansion segmentation model, and training by using the data set to obtain a trained intrahepatic bile duct expansion segmentation model;
the training process specifically comprises: dividing the data set into a training set and a test set; training the intrahepatic expansion bile duct segmentation model by using the training set, wherein a Dice function is used as a loss function of the network, an Adam optimizer is adopted, and the initial learning rate is set to be 1 x 10-4(ii) a Performing model correction on the intrahepatic bile duct dilation segmentation model by using the test set, wherein a Focalloss function is used as a loss function, an SGD (generalized regression) function is used as an optimizer, and the initial learning rate is set to be 1 x 10-5
S4, acquiring an abdomen CT image to be segmented, preprocessing the abdomen CT image to be segmented, and inputting the preprocessed abdomen CT image to be segmented into the trained intrahepatic cholangiodilation segmentation model to obtain an intrahepatic cholangiodilation image segmentation result.
2. The method of claim 1, wherein the preprocessing operation further comprises scaling an image resolution of the data set.
3. The method of claim 1, wherein the Dice function is used to characterize the degree of similarity of two contour regions.
CN202110493746.0A 2021-05-07 2021-05-07 Bile duct image segmentation method based on deep learning Pending CN113223003A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110493746.0A CN113223003A (en) 2021-05-07 2021-05-07 Bile duct image segmentation method based on deep learning

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110493746.0A CN113223003A (en) 2021-05-07 2021-05-07 Bile duct image segmentation method based on deep learning

Publications (1)

Publication Number Publication Date
CN113223003A true CN113223003A (en) 2021-08-06

Family

ID=77091272

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110493746.0A Pending CN113223003A (en) 2021-05-07 2021-05-07 Bile duct image segmentation method based on deep learning

Country Status (1)

Country Link
CN (1) CN113223003A (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116188786A (en) * 2023-05-04 2023-05-30 潍坊医学院附属医院 Image segmentation system for hepatic duct and biliary tract calculus

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110084796A (en) * 2019-04-24 2019-08-02 徐州云联医疗科技有限公司 A kind of analysis method of complex texture CT image
CN110428432A (en) * 2019-08-08 2019-11-08 梅礼晔 The deep neural network algorithm of colon body of gland Image Automatic Segmentation
CN111192245A (en) * 2019-12-26 2020-05-22 河南工业大学 Brain tumor segmentation network and method based on U-Net network
CN111784653A (en) * 2020-06-28 2020-10-16 西安电子科技大学 Multi-scale network MRI pancreas contour positioning method based on shape constraint
CN112348830A (en) * 2020-11-05 2021-02-09 上海应用技术大学 Multi-organ segmentation method based on improved 3D U-Net

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110084796A (en) * 2019-04-24 2019-08-02 徐州云联医疗科技有限公司 A kind of analysis method of complex texture CT image
CN110428432A (en) * 2019-08-08 2019-11-08 梅礼晔 The deep neural network algorithm of colon body of gland Image Automatic Segmentation
CN111192245A (en) * 2019-12-26 2020-05-22 河南工业大学 Brain tumor segmentation network and method based on U-Net network
CN111784653A (en) * 2020-06-28 2020-10-16 西安电子科技大学 Multi-scale network MRI pancreas contour positioning method based on shape constraint
CN112348830A (en) * 2020-11-05 2021-02-09 上海应用技术大学 Multi-organ segmentation method based on improved 3D U-Net

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
周茂: "基于深度学习的医学CT图像分割技术研究", 《知网》 *

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN116188786A (en) * 2023-05-04 2023-05-30 潍坊医学院附属医院 Image segmentation system for hepatic duct and biliary tract calculus

Similar Documents

Publication Publication Date Title
CN112950651B (en) Automatic delineation method of mediastinal lymph drainage area based on deep learning network
CN109949276B (en) Lymph node detection method for improving SegNet segmentation network
CN107516316B (en) Method for segmenting static human body image by introducing focusing mechanism into FCN
Xing et al. Zoom in lesions for better diagnosis: Attention guided deformation network for wce image classification
CN110706225B (en) Tumor identification system based on artificial intelligence
CN113420826B (en) Liver focus image processing system and image processing method
CN113205509B (en) Blood vessel plaque CT image segmentation method based on position convolution attention network
WO2021042690A1 (en) Deep convolution neural network-based breast cancer auxiliary diagnosis method and apparatus
CN102831614B (en) Sequential medical image quick segmentation method based on interactive dictionary migration
CN113539402B (en) Multi-mode image automatic sketching model migration method
Ryu et al. SegR-Net: A deep learning framework with multi-scale feature fusion for robust retinal vessel segmentation
CN113284136A (en) Medical image classification method of residual error network and XGboost of double-loss function training
CN113269230A (en) Multi-pneumonia CT classification method and device based on time sequence high-dimensional feature extraction
CN108230341B (en) Eyeground image blood vessel segmentation method based on layered matting algorithm
CN117409002A (en) Visual identification detection system for wounds and detection method thereof
LU500798B1 (en) Full-Automatic Segmentation Method for Coronary Artery Calcium Lesions Based on Non-Contrast Chest CT
CN113223003A (en) Bile duct image segmentation method based on deep learning
CN114549452A (en) New coronary pneumonia CT image analysis method based on semi-supervised deep learning
CN114565557A (en) Contrast enhancement energy spectrum photography classification method and device based on coordinate attention
CN109785325A (en) A method of the Multimodal medical image based on deep learning
CN114066908A (en) Method and system for brain tumor image segmentation
CN111339993A (en) X-ray image metal detection method and system
CN108597602A (en) A kind of label correction method towards dermatology data
Wang et al. PCRTAM-Net: A novel pre-activated convolution residual and triple attention mechanism network for retinal vessel segmentation
CN113936165B (en) CT image processing method, terminal and computer storage medium

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210918

Address after: 102629 Room 401, building 1, 38 Yongda Road, Daxing biomedical industrial base, Zhongguancun Science and Technology Park, Daxing District, Beijing

Applicant after: Beijing precision diagnosis Medical Technology Co.,Ltd.

Address before: Room 102, block B2, phase II, software new town, tianguba Road, Yuhua Street office, high tech Zone, Xi'an, Shaanxi 710000

Applicant before: Xi'an Zhizhen Intelligent Technology Co.,Ltd.

WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20210806