CN113160208A - Liver lesion image segmentation method based on cascade hybrid network - Google Patents

Liver lesion image segmentation method based on cascade hybrid network Download PDF

Info

Publication number
CN113160208A
CN113160208A CN202110493903.8A CN202110493903A CN113160208A CN 113160208 A CN113160208 A CN 113160208A CN 202110493903 A CN202110493903 A CN 202110493903A CN 113160208 A CN113160208 A CN 113160208A
Authority
CN
China
Prior art keywords
liver
neural network
image
convolutional neural
network
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN202110493903.8A
Other languages
Chinese (zh)
Inventor
王博
赵威
申建虎
张伟
徐正清
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Beijing precision diagnosis Medical Technology Co.,Ltd.
Original Assignee
Xi'an Zhizhen Intelligent Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Xi'an Zhizhen Intelligent Technology Co ltd filed Critical Xi'an Zhizhen Intelligent Technology Co ltd
Priority to CN202110493903.8A priority Critical patent/CN113160208A/en
Publication of CN113160208A publication Critical patent/CN113160208A/en
Pending legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/04Architecture, e.g. interconnection topology
    • G06N3/045Combinations of networks
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06NCOMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
    • G06N3/00Computing arrangements based on biological models
    • G06N3/02Neural networks
    • G06N3/08Learning methods
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20021Dividing image into blocks, subimages or windows
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30056Liver; Hepatic

Landscapes

  • Engineering & Computer Science (AREA)
  • Theoretical Computer Science (AREA)
  • Physics & Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • General Health & Medical Sciences (AREA)
  • Health & Medical Sciences (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Biophysics (AREA)
  • Software Systems (AREA)
  • Evolutionary Computation (AREA)
  • Computational Linguistics (AREA)
  • Molecular Biology (AREA)
  • Computing Systems (AREA)
  • General Engineering & Computer Science (AREA)
  • Biomedical Technology (AREA)
  • Mathematical Physics (AREA)
  • Data Mining & Analysis (AREA)
  • Artificial Intelligence (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Medical Informatics (AREA)
  • Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
  • Radiology & Medical Imaging (AREA)
  • Quality & Reliability (AREA)
  • Apparatus For Radiation Diagnosis (AREA)

Abstract

The invention discloses a liver lesion image segmentation method based on a cascade hybrid network, which comprises the steps of firstly processing an obtained abdominal CT image through a 2D convolutional neural network to obtain a liver region image with a training set and a test set; constructing a mixed network image segmentation model which comprises a 2D convolutional neural network for segmenting large lesions in a liver CT image and a 3D convolutional neural network for segmenting small lesions in the liver; preprocessing a training set in the liver CT image, training the mixed network image segmentation model to obtain a trained mixed network image segmentation model, and testing to obtain a liver lesion image segmentation result. The method combines the advantages of low calculation time and memory cost of the 2D neural network during image segmentation and high precision of the 3D neural network during image segmentation, and achieves the purpose of greatly reducing the calculation time and the memory cost on the premise of ensuring the precision.

Description

Liver lesion image segmentation method based on cascade hybrid network
Technical Field
The invention belongs to the field of medical image processing, and particularly relates to a liver lesion image segmentation method based on a cascade hybrid network.
Background
Liver cancer is one of the leading causes of cancer death worldwide, and for screening of liver cancer, Computed Tomography (CT) is the most common imaging tool, where morphological and textural abnormalities of the liver and visible lesions are important markers of disease progression in primary and secondary liver tumor diseases. Clinically, although manual and semi-manual techniques exist, these methods are subjective, heavily operator dependent and very time consuming. Computer-assisted methods have been developed in the past to improve radiologists' productivity, however, automated liver and its lesion segmentation remains a very challenging problem due to the low contrast of the liver and its lesions, the different types of contrast, abnormalities in the tissue (metastatic resection), the size and number of lesions that vary.
In the prior art, a liver tumor automatic segmentation method based on a 2D Convolutional Neural Network (Convolutional Neural Network) or a 3D Convolutional Neural Network is usually adopted, the 2D Convolutional Neural Network has a poor effect on processing a small lesion, and the problem of false positive in a liver lesion segmentation result also exists, while the 3D Convolutional Neural Network ensures accuracy, but has the problems of long calculation time and high memory cost.
Disclosure of Invention
In order to solve the above problems in the prior art, the present invention provides a liver lesion image segmentation method based on a cascade hybrid network, which greatly reduces the calculation time and the memory cost without sacrificing the precision, and in order to achieve the purpose, the technical scheme of the present invention is as follows:
a liver lesion image segmentation method based on a cascade hybrid network, the method comprising:
s1, acquiring an abdomen CT image, and processing the abdomen CT image through a 2D convolutional neural network to obtain a liver region image, wherein the liver region image comprises a training set and a testing set;
s2, constructing a hybrid network image segmentation model, wherein the hybrid network image segmentation model comprises a 2D convolutional neural network for segmenting large lesions in a liver CT image and a 3D convolutional neural network for segmenting small lesions in the liver; the large focus is a liver lesion larger than a preset threshold value in a liver CT image, and the small focus is a liver lesion smaller than the preset threshold value in the liver CT image;
s3, preprocessing a training set in the acquired liver region image to obtain a 2D network training set of the 2D convolutional neural network and a 3D network training set of the 3D convolutional neural network; the preprocessing comprises histogram equalization processing on the liver region image;
s4, inputting the preprocessed 2D network training set into a 2D convolutional neural network for training, and inputting the preprocessed 3D network training set into a 3D convolutional neural network for training to obtain a trained 2D convolutional neural network and a trained 3D convolutional neural network;
and S5, inputting the test set in the liver region image into the trained hybrid network segmentation model to complete liver lesion image segmentation.
Further, the 2D convolutional neural network and the 3D convolutional neural network adopt a Unet neural network structure.
Further, the encoder in the 2D convolutional neural network is composed of two convolutional layers, and the filter size of each convolutional layer is 3 × 3.
Further, the encoder in the 3D convolutional neural network is composed of 3D convolutional blocks.
Further, the resolution of each slice of the abdominal CT image is 512 × 512, and the preset threshold is 32 × 32.
Further, preprocessing the training set in the acquired liver CT image further comprises positioning a lesion center by using a component label, and setting a 3D network training set according to the lesion center.
The invention has the beneficial effects that:
(1) compared with the method for segmenting the liver CT by using the 2D convolutional neural network, the method has better segmentation effect on the kitchen range for treating the small diseases in the liver;
(2) compared with the method for segmenting the liver CT by using the 3D convolutional neural network, the method is more efficient in the aspects of computing time and memory cost.
Drawings
FIG. 1 is a schematic flow chart of a CT image segmentation method for liver lesion according to the present invention;
FIG. 2 is a block diagram of a CT image segmentation method for liver lesion according to the present invention;
FIG. 3 is a schematic diagram of a 2D convolutional neural network of the present invention;
FIG. 4 is a schematic diagram of a 3D convolutional neural network of the present invention;
FIG. 5 is an original abdominal CT image with image segmentation according to the present invention;
FIG. 6 is a liver CT image obtained by processing an original abdominal CT image according to the present invention;
FIG. 7 is a processed image of a large lesion in a hybrid network image segmentation model of the present invention;
FIG. 8 is a processed image of a lesion in a hybrid network image segmentation model of the present invention;
FIG. 9 is an image processed by the hybrid network image segmentation model of the present invention.
Detailed Description
The technical scheme of the invention is further described by combining the drawings and the embodiment:
the embodiment provides a liver lesion image segmentation method based on a cascade hybrid network, as shown in fig. 1, the process includes the following steps:
step 1, acquiring an abdominal CT image, and processing the abdominal CT image through a 2D convolutional neural network to obtain a liver region image, wherein in this embodiment, a common liver tumor segmentation data set (LiTS) is used as a training set and a test set, wherein the common liver tumor segmentation data set comprises 19163 2D slices, each slice comprises 11503 samples containing small lesions, the resolution of each slice is 512 × 512, and the set size of the small lesion samples is 32 × 32 × 32;
and 2, constructing a hybrid network image segmentation model as shown in fig. 2, wherein the hybrid network image segmentation model comprises a 2D convolutional neural network for segmenting large lesions in the CT image of the liver and a 3D convolutional neural network for segmenting small lesions in the liver.
As shown in fig. 3, the encoder of the segmentation and reconstruction part in the 2D convolutional neural network model constructed in this embodiment is composed of a plurality of blocks of two convolutional layers, and then a batch normalization layer, all convolutional layers use a filter size of 3 × 3, the number of filters in the blocks is sequentially set to 16, 32, 64, 128 and a transition block 256, an encoder in which a pooling layer is provided after each block, and a decoder branches to merge layers and is replaced by a 2D transposed convolutional layer.
As shown in fig. 4, the encoder of the segmentation and reconstruction part of the constructed 3D convolutional neural network model is composed of three 3D convolutional blocks. Each block consists of 32, 64 and 128 feature maps, respectively, each followed by a 3D merge layer with a pool size of (2, 2). The transform block has 256 feature maps and the decoder bramble mirror encoder bramble pool layers to be replaced with 3D transposed convolutional layers.
Step 3, preprocessing a training set in the obtained liver CT image to obtain a 2D network training set of a 2D convolutional neural network and a 3D network training set of a 3D convolutional neural network;
in the preprocessing stage in this embodiment, a histogram-based thresholding method is used to process the liver CT scan, and a histogram equalization algorithm is used to generate an enhanced image.
The method sets the resolution ratio larger than 32 multiplied by 32 as the liver large focus, and the 2D network training set only extracts the focus larger than 32 multiplied by 32 for each CT slice, and deletes all the focuses with the horizontal and vertical sizes smaller than or equal to 32.
Whereas for a 3D network training set, the method uses component labels to locate the center of the lesion and estimates its size on 2D slices, leaving lesions on 2D slices with horizontal and vertical dimensions less than or equal to 32, since a small lesion usually occupies only a few CT slices, a 32 x 32 cube is selected to cover the lesion, i.e., around the center of the lesion on the slice, the 15 CT slices above the CT slice and the 16 CT slices below the CT slice are selected to create the 3D network training set.
Step 4, inputting the 2D network training set obtained by preprocessing into a 2D convolutional neural network for training, and inputting the 3D network training set obtained by preprocessing into a 3D convolutional neural network for training to obtain a trained 2D convolutional neural network and a trained 3D convolutional neural network;
in this example, a 3D sliding cube was used to predict within a trained 3D network liver volume, with 8 voxels as the stride, using the average of all predictions over that voxel, and setting a value greater than 0.5 as 1 as the final prediction. And the learning rate of the network using Adam optimizer is 1e-5 while setting 300 maximum training epochs, and furthermore, using L2 regularization of parameters 1e-5 and a loss rate of 0.5 after all pooling and upsampling layers to mitigate overfitting.
And 5, inputting the test set in the liver region image into the trained hybrid network segmentation model to complete liver lesion image segmentation.
It is to be understood that the invention is not limited to the examples described above, but that modifications and variations may be effected thereto by those of ordinary skill in the art in light of the foregoing description, and that all such modifications and variations are intended to be within the scope of the invention as defined by the appended claims.

Claims (6)

1. A liver lesion image segmentation method based on a cascade hybrid network is characterized by comprising the following steps:
s1, acquiring an abdomen CT image, and processing the abdomen CT image through a 2D convolutional neural network to obtain a liver region image, wherein the liver region image comprises a training set and a testing set;
s2, constructing a hybrid network image segmentation model, wherein the hybrid network image segmentation model comprises a 2D convolutional neural network for segmenting large lesions in a liver CT image and a 3D convolutional neural network for segmenting small lesions in the liver; the large focus is a liver lesion larger than a preset threshold value in a liver CT image, and the small focus is a liver lesion smaller than the preset threshold value in the liver CT image;
s3, preprocessing a training set in the acquired liver region image to obtain a 2D network training set of the 2D convolutional neural network and a 3D network training set of the 3D convolutional neural network; the preprocessing comprises histogram equalization processing on the liver region image;
s4, inputting the preprocessed 2D network training set into a 2D convolutional neural network for training, and inputting the preprocessed 3D network training set into a 3D convolutional neural network for training to obtain a trained 2D convolutional neural network and a trained 3D convolutional neural network;
and S5, inputting the test set in the liver region image into the trained hybrid network segmentation model to complete liver lesion image segmentation.
2. The method of claim 1, wherein the 2D convolutional neural network and the 3D convolutional neural network are in a net neural network structure.
3. The method of claim 1, wherein the encoder in the 2D convolutional neural network is composed of two convolutional layers, and the filter size of each convolutional layer is 3 x 3.
4. The method according to claim 1, wherein the encoder in the 3D convolutional neural network is composed of 3D convolutional blocks.
5. The method of claim 1, wherein the abdominal CT image has a resolution of 512 x 512 per slice, and the predetermined threshold is 32 x 32.
6. The method of claim 1, wherein preprocessing the training set in the acquired CT images of the liver further comprises locating a lesion center using component labels, and wherein the 3D network training set is configured according to the lesion center.
CN202110493903.8A 2021-05-07 2021-05-07 Liver lesion image segmentation method based on cascade hybrid network Pending CN113160208A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN202110493903.8A CN113160208A (en) 2021-05-07 2021-05-07 Liver lesion image segmentation method based on cascade hybrid network

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN202110493903.8A CN113160208A (en) 2021-05-07 2021-05-07 Liver lesion image segmentation method based on cascade hybrid network

Publications (1)

Publication Number Publication Date
CN113160208A true CN113160208A (en) 2021-07-23

Family

ID=76873770

Family Applications (1)

Application Number Title Priority Date Filing Date
CN202110493903.8A Pending CN113160208A (en) 2021-05-07 2021-05-07 Liver lesion image segmentation method based on cascade hybrid network

Country Status (1)

Country Link
CN (1) CN113160208A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115018862A (en) * 2022-05-26 2022-09-06 杭州深睿博联科技有限公司 Liver tumor segmentation method and device based on hybrid neural network
CN116503607A (en) * 2023-06-28 2023-07-28 天津市中西医结合医院(天津市南开医院) CT image segmentation method and system based on deep learning

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109035255A (en) * 2018-06-27 2018-12-18 东南大学 A kind of sandwich aorta segmentation method in the CT image based on convolutional neural networks
CN110910335A (en) * 2018-09-15 2020-03-24 北京市商汤科技开发有限公司 Image processing method, image processing device and computer readable storage medium
CN110942464A (en) * 2019-11-08 2020-03-31 浙江工业大学 PET image segmentation method fusing 2-dimensional and 3-dimensional models
CN112489060A (en) * 2020-12-07 2021-03-12 北京医准智能科技有限公司 System and method for pneumonia focus segmentation
CN112561868A (en) * 2020-12-09 2021-03-26 深圳大学 Cerebrovascular segmentation method based on multi-view cascade deep learning network

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN109035255A (en) * 2018-06-27 2018-12-18 东南大学 A kind of sandwich aorta segmentation method in the CT image based on convolutional neural networks
CN110910335A (en) * 2018-09-15 2020-03-24 北京市商汤科技开发有限公司 Image processing method, image processing device and computer readable storage medium
CN110942464A (en) * 2019-11-08 2020-03-31 浙江工业大学 PET image segmentation method fusing 2-dimensional and 3-dimensional models
CN112489060A (en) * 2020-12-07 2021-03-12 北京医准智能科技有限公司 System and method for pneumonia focus segmentation
CN112561868A (en) * 2020-12-09 2021-03-26 深圳大学 Cerebrovascular segmentation method based on multi-view cascade deep learning network

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
RAUNAK DEY ET AL.: "hybrid cascaded neural network for liver lesion segmentation", 《ARXIV》 *
贺宝春等: "基于组合U-Net网络的CT图像头颈放疗危及器官自动分割", 《集成技术》 *

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN115018862A (en) * 2022-05-26 2022-09-06 杭州深睿博联科技有限公司 Liver tumor segmentation method and device based on hybrid neural network
CN116503607A (en) * 2023-06-28 2023-07-28 天津市中西医结合医院(天津市南开医院) CT image segmentation method and system based on deep learning
CN116503607B (en) * 2023-06-28 2023-09-19 天津市中西医结合医院(天津市南开医院) CT image segmentation method and system based on deep learning

Similar Documents

Publication Publication Date Title
CN109035255B (en) Method for segmenting aorta with interlayer in CT image based on convolutional neural network
CN109035197B (en) CT radiography image kidney tumor segmentation method and system based on three-dimensional convolution neural network
CN111798462B (en) Automatic delineation method of nasopharyngeal carcinoma radiotherapy target area based on CT image
CN108010021B (en) Medical image processing system and method
CN108364294B (en) Multi-organ segmentation method for abdominal CT image based on superpixels
CN108053417B (en) lung segmentation device of 3D U-Net network based on mixed rough segmentation characteristics
CN104933711B (en) A kind of automatic fast partition method of cancer pathology image
CN104933709B (en) Random walk CT lung tissue image automatic segmentation methods based on prior information
DE69517524T2 (en) AUTOMATIC DETECTION OF LESIONS IN COMPUTER TOMOGRAPHY
CN109102506B (en) Automatic segmentation method for abdominal CT liver lesion image based on three-level cascade network
CN109064470B (en) Image segmentation method and device based on self-adaptive fuzzy clustering
CN109934235A (en) A kind of unsupervised abdominal CT sequence image multiple organ automatic division method simultaneously
Kumar et al. Robust and automated lung nodule diagnosis from CT images based on fuzzy systems
Fan et al. Lung nodule detection based on 3D convolutional neural networks
Casiraghi et al. Automatic abdominal organ segmentation from CT images
CN113160208A (en) Liver lesion image segmentation method based on cascade hybrid network
Melloul et al. Segmentation of microcalcification in X-ray mammograms using entropy thresholding
CN113223004A (en) Liver image segmentation method based on deep learning
CN111784701A (en) Ultrasonic image segmentation method and system combining boundary feature enhancement and multi-scale information
CN114092450A (en) Real-time image segmentation method, system and device based on gastroscopy video
CN104637056A (en) Method for segmenting adrenal tumor of medical CT (computed tomography) image based on sparse representation
CN113706486A (en) Pancreas tumor image segmentation method based on dense connection network migration learning
CN112950611A (en) Liver blood vessel segmentation method based on CT image
CN116883341A (en) Liver tumor CT image automatic segmentation method based on deep learning
CN115619693A (en) Space-time fusion model based on nested multi-scale transformation

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
TA01 Transfer of patent application right
TA01 Transfer of patent application right

Effective date of registration: 20210918

Address after: 102629 Room 401, building 1, 38 Yongda Road, Daxing biomedical industrial base, Zhongguancun Science and Technology Park, Daxing District, Beijing

Applicant after: Beijing precision diagnosis Medical Technology Co.,Ltd.

Address before: Room 102, block B2, phase II, software new town, tianguba Road, Yuhua Street office, high tech Zone, Xi'an, Shaanxi 710000

Applicant before: Xi'an Zhizhen Intelligent Technology Co.,Ltd.

WD01 Invention patent application deemed withdrawn after publication
WD01 Invention patent application deemed withdrawn after publication

Application publication date: 20210723