WO2020238044A1 - Method and device for constructing 3d unet network model for tumor detection, and storage medium - Google Patents

Method and device for constructing 3d unet network model for tumor detection, and storage medium Download PDF

Info

Publication number
WO2020238044A1
WO2020238044A1 PCT/CN2019/117323 CN2019117323W WO2020238044A1 WO 2020238044 A1 WO2020238044 A1 WO 2020238044A1 CN 2019117323 W CN2019117323 W CN 2019117323W WO 2020238044 A1 WO2020238044 A1 WO 2020238044A1
Authority
WO
WIPO (PCT)
Prior art keywords
tumor
network model
data set
unet network
image
Prior art date
Application number
PCT/CN2019/117323
Other languages
French (fr)
Chinese (zh)
Inventor
齐守良
曾威
姚育东
钱唯
郑斌
高伟明
葛新科
张红治
Original Assignee
深圳市前海安测信息技术有限公司
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by 深圳市前海安测信息技术有限公司 filed Critical 深圳市前海安测信息技术有限公司
Publication of WO2020238044A1 publication Critical patent/WO2020238044A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/21Design or setup of recognition systems or techniques; Extraction of features in feature space; Blind source separation
    • G06F18/214Generating training patterns; Bootstrap methods, e.g. bagging or boosting
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/26Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/20Image preprocessing
    • G06V10/26Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion
    • G06V10/267Segmentation of patterns in the image field; Cutting or merging of image elements to establish the pattern region, e.g. clustering-based techniques; Detection of occlusion by performing operations on regions, e.g. growing, shrinking or watersheds
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10072Tomographic images
    • G06T2207/10081Computed x-ray tomography [CT]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/20Special algorithmic details
    • G06T2207/20084Artificial neural networks [ANN]
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30096Tumor; Lesion

Definitions

  • the present invention relates to the technical field of tumor image processing, in particular to a method, device and computer readable storage medium for constructing a 3D UNet network model for tumor detection.
  • tumor CT images are blurred, and it is difficult to find all tumor regions in all tumor CT images.
  • the accuracy and low efficiency of tumor detection make it difficult to locate the tumor. Therefore, it is urgent to realize the automatic detection of the tumor area in clinical practice, accurately locate the tumor location, and provide guidance for the diagnosis and treatment of the tumor has become the research focus of the industry.
  • the main purpose of the present invention is to provide a method, device and computer readable storage medium for constructing a 3D UNet network model for tumor detection, aiming to solve the problem that the existing tumor detection methods are limited by individual lung morphological differences, resulting in low tumor detection efficiency And the technical problem of low accuracy.
  • the present invention provides a 3D UNet network model construction method for detecting tumors.
  • the method includes the following steps: obtaining LIDC data sets from a medical imaging database, the LIDC data sets including tumor CT images and tumors in xml format Region annotation; convert the tumor area annotation in xml format into mask tumor area annotation; divide the transformed LIDC data set into training data set and validation data set; preprocess the training data set and the validation data set, and perform CT of the tumor Image pixel value normalization processing; build 3D based on keras framework Unet network model; use the training data set to train the constructed 3D Unet network model to obtain the weight of the 3D Unet network model; use the validation data set to construct the 3D The validity of the Unet network model is verified.
  • the step of preprocessing the training data set and the verification data set includes the following steps: set the interval between the pixels in the training data set and the verification data set to 1, so that the data input to the 3D Unet network model has Uniform interval; for the tumor CT images and mask tumor area annotations in the training data set, the following steps are performed: obtain the center point of the mask tumor area annotation, and use the center point as the center point of the 96 ⁇ 96 ⁇ 32 matrix according to 96 ⁇ 96 ⁇ 32 size Randomly crop the tumor area, randomly zoom in and out, randomly rotate the angle, randomly flip up and down, and generate diversified training data; perform the following steps for the tumor CT image and mask tumor area labeling in the validation data set: Get mask The center point of the tumor area, using the center point as the center point of the 96 ⁇ 96 ⁇ 32 matrix, crop the tumor area according to the size of 96 ⁇ 96 ⁇ 32, and save the cropped tumor CT image and mask the tumor area.
  • the step of normalizing the pixel value of the tumor CT image includes the following steps: setting the pixel value greater than 0 in the tumor CT image to 0, and setting the pixel value less than -1200 in the tumor CT image to -1200 , Leave the other pixels unchanged, and then normalize the pixel value of the tumor CT image to the value range of [0, -1200] to exclude the non-tumor area in the tumor CT image.
  • the size of the annotation of the mask tumor area is the same as the size of the tumor CT image, and the pixel value of the tumor area in the tumor CT image is set to 1, and the pixel value of the non-tumor area is set to 0, thereby forming the mask matrix format Mask tumor area marking.
  • the LIDC data set is divided into multiple training data sets and multiple verification data sets according to the ratio of the training data set to the verification data set of 9:1, and each training data set and each verification data set includes one Tumor CT image and a corresponding mask tumor area annotation.
  • the 3D Unet network model is composed of an input layer, an output layer, a 3D convolutional layer, a batch regularization layer, an activation layer, a deconvolution layer, and a maximum pooling layer, wherein the input layer size is 96 ⁇ 96 ⁇ 32, the model maximum pooling layer is composed of 3 layers of downsampling, the deconvolution layer is composed of 3 layers of upsampling, and the size of the output layer is 96 ⁇ 96 ⁇ 32.
  • the method for constructing a 3D UNet network model for tumor detection further includes: using an Adam optimizer to optimize the parameters of each layer of the 3D Unet network model; and using a DiceLoss loss function to evaluate the loss generated by the 3D Unet network model.
  • the method for constructing a 3D UNet network model for detecting tumors further includes: acquiring CT images to be detected from an image scanning device; and inputting the CT images to be detected into the 3D Unet network model for detection to detect various defects. Regular tumor lesion area, and display the tumor lesion area on the monitor.
  • the present invention also provides a 3D UNet network model construction device for detecting tumors, which includes a processor suitable for implementing various computer program instructions and a memory suitable for storing multiple computer program instructions.
  • the instructions are loaded by the processor and executed as described above for 3D tumor detection The method steps of the UNet network model construction method.
  • the present invention also provides a computer-readable storage medium that stores a plurality of computer program instructions, wherein the computer program instructions are loaded by the processor of the computer device and executed as described above.
  • 3D for tumor detection The method steps of the UNet network model construction method.
  • the 3D UNet network model construction method, device and computer-readable storage medium for detecting tumors of the present invention can construct 3D accurate tumor segmentation UNet network model, through the 3D UNet network model to effectively segment various irregular tumor regions, improve the accuracy and speed of tumor detection, and the effectiveness of tumor detection is not limited to individual lung morphological differences, so as to quickly and accurately locate Tumor location provides medical guidance for doctors on tumor diagnosis and treatment.
  • Fig. 1 is a schematic block diagram of a preferred embodiment of a 3D UNet network model construction device for tumor detection according to the present invention
  • Fig. 2 is a method flowchart of a preferred embodiment of a method for constructing a 3D UNet network model for tumor detection according to the present invention.
  • Fig. 1 is a schematic structural diagram of a preferred embodiment of a 3D UNet network model construction device for detecting tumors of the present invention.
  • the 3D UNet network model construction device 1 for tumor detection includes, but is not limited to, a memory 11 suitable for storing various computer program instructions, a processor 12 for executing various computer program instructions, and a display 13. Both the memory 11 and the display 13 are electrically connected to the processor 12 through an electrical connection line, and are connected to the processor 12 through a data bus for data transmission.
  • the processor 12 can call the 3D UNet network model construction program 10 for detecting tumors stored in the memory 11, and execute the 3D UNet network model construction program 10 to input tumor CT images from the image scanning device 3, and Using UNet network to segment lung lobes based on tumor CT image data.
  • the 3D UNet network model construction device 1 may be a personal computer, a notebook computer, a server, and other computer devices installed with the 3D UNet network model construction program 10 of the present invention.
  • the 3D UNet network model construction device 1 is connected to a medical image database 2 and an image scanning device 3.
  • the medical imaging database 2 stores LIDC data sets of multiple tumor cases as samples.
  • the medical imaging database 2 stores 1000 LIDC data sets, and each LIDC data set includes tumor CT images and tumor area annotations in xml format.
  • the image scanning device 3 may be a CT scanner, which can scan the lungs of patients to obtain CT images of tumors.
  • the 3D The UNet network model construction device 1 executes the 3D UNet network model construction program 10 through the processor 12 to obtain multiple LIDC data sets from the medical imaging database 2, construct a 3D UNet network model from the LIDC data set, and obtain the patient’s tumor from the image scanning device 3
  • the CT images are input to the 3D UNet network model, and the 3D UNet network model is used to quickly and accurately detect the tumor lesion area on the input tumor CT image.
  • the memory 11 includes at least one type of readable storage medium.
  • the readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), and magnetic memory. , Disks, CDs, etc.
  • the memory 11 may be an internal storage unit of the 3D UNet network model construction device 1 for tumor detection, such as the hard disk and read-only memory of the 3D UNet network model construction device 1 for tumor detection.
  • ROM random access memory RAM, electrically erasable memory EEPROM, flash memory FLASH or optical disc, etc.
  • the memory 11 may also be 3D for detecting tumors.
  • the external storage device of the UNet network model construction device 1 such as the 3D
  • the memory 11 may also include both an internal storage unit of the 3D UNet network model construction device 1 and an external storage device.
  • the memory 11 can not only be used to store the 3D Application software and various data of UNet network model construction device 1, such as storage for 3D
  • the program code of the UNet network model construction program 10, etc. can also be used to temporarily store the tumor lesion area that has been output or will be output.
  • the processor 12 may be a central processing unit (Central Processing Unit) in some embodiments.
  • Central Processing Unit CPU
  • controller microcontroller
  • microprocessor or other data processing chip, used to call and run the program code or processing data stored in the memory 11, for example, execute the 3D UNet network model construction program 10, etc.
  • the display 13 may be a touch display screen or a general LED display screen, which can display the detected tumor lesion area.
  • the 3D UNet network model construction program 10 for tumor detection can also be divided into one or more modules, one or more modules are stored in the memory 11, and are composed of one Or multiple processors (processor 12 in this embodiment) are executed to complete the present invention.
  • the module referred to in the present invention refers to a series of computer program instruction segments that can complete specific functions, and is used to describe the 3D UNet network model construction program 10 The execution process in the UNet network construction device 1.
  • the 3D UNet network model building program 10 for tumor detection is composed of program modules composed of multiple computer program instructions, including but not limited to, an image data acquisition module 101, an image data processing module 102, The network model construction module 103, the network model training module 104, and the tumor detection module 105.
  • the module referred to in the present invention refers to a series of computer program instruction segments that can be executed by the processor 12 of the 3D UNet network model construction device 1 and can complete fixed functions, and are stored in the memory 11.
  • the image data acquisition module 101 is used to acquire a LIDC data set from the medical image database 2, and the LIDC data set includes tumor CT images and tumor region annotations in xml format.
  • the medical imaging database 2 stores LIDC data sets of multiple tumor cases.
  • the medical imaging database 2 stores LIDC data sets of 1000 tumor cases.
  • the image data processing module 102 is used to convert the tumor area annotation in xml format into a mask tumor area annotation; in this embodiment, the image data processing module 102 converts the tumor area annotation in xml format into a tumor area in mask format Labeling (referred to as mask tumor area labeling); where the size of the mask tumor area label is the same as the size of the tumor CT image, the pixel value of the tumor area in the tumor CT image is set to 1, and the pixel value of the non-tumor area is set to 0. This constitutes the mask tumor area label in the mask matrix format.
  • mask tumor area labeling referred to as mask tumor area Labeling
  • the image data processing module 102 is also used to divide the transformed LIDC data set into a training data set and a verification data set; in this embodiment, each training data set and each verification data set includes a tumor CT image And a corresponding mask tumor area label. Assuming that a total of 1000 LIDC data sets are input, the LIDC data set is divided according to the ratio of the training data set to the verification data set of 9:1, the training data set has 900 cases, and the verification data set has 100 cases.
  • the image data processing module 102 is also used to preprocess the training data set and the verification data set, and normalize the pixel values of the tumor CT images.
  • the preprocessing of the training data set and the verification data set includes the following steps: the interval between the pixels in the training data set and the verification data set is set to 1, so that the data of the 3D Unet network model is input Have a uniform interval; perform the following steps for the tumor CT image and mask tumor area annotation in the training data set: obtain the center point of the mask tumor area annotation, and use the center point as the center point of the 96 ⁇ 96 ⁇ 32 matrix according to 96 ⁇ 96 ⁇ 32 size Randomly crop the tumor area, randomly zoom in and out, randomly rotate a certain angle, the angle can be 90, 180 or 270 degrees, randomly flip up and down, and generate diversified training data to enhance the robustness of the 3D Unet network model Great; perform the following steps for the tumor CT image and mask tumor area of the validation data set: Obtain the center point of the mask tumor area, and use the center point as the center point
  • the normalization processing of the pixel value of the tumor CT image includes the steps: setting the pixel value greater than 0 in the tumor CT image to 0, and setting the pixel value less than -1200 in the tumor CT image to -1200 , Other pixels remain unchanged, that is, the pixel values of tumor CT images are normalized to the numerical range of [0, -1200] to exclude most non-tumor areas.
  • the network model construction module 103 is used to construct a 3D Unet network model based on the keras framework.
  • the Keras framework is a Python API based on deep learning neural networks, written in Python language, and is a highly modular neural network library.
  • the 3D Unet network model is composed of an input layer, an output layer, a 3D convolution layer, a batch regularization layer, an activation layer, a deconvolution layer, and a maximum pooling layer.
  • the input layer size is 96 ⁇ 96 ⁇ 32
  • the model has 3 layers of downsampling (maximum pooling layer), 3 layers of upsampling (deconvolution layer), and the output layer size is 96 ⁇ 96 ⁇ 32.
  • the network model building module 103 is also used to optimize the parameters of each layer of the 3D Unet network model by using the Adam optimizer, and to use the DiceLoss loss function to optimize the 3D Unet network model to assess the loss.
  • the Adam optimizer is an extension of the stochastic gradient descent optimization algorithm, and is widely used in deep learning neural network applications, especially tasks such as computer vision and natural language processing.
  • the DiceLoss loss function is a network model that uses the dice coefficient as the loss function to evaluate the loss when using deep learning for medical image segmentation.
  • the network model training module 104 is used to train the 3D Unet network model by using the training data set to obtain the weight of the 3D Unet network model.
  • the network model training module 104 inputs the tumor CT images and mask tumor region annotations of the training data set into the 3D Unet network model for training according to a preset amount of data. For example, the input data amount of each round (batchsize ) Set to 12 batches, the total number of rounds (epoch) is set to 200 rounds; each round of training the 3D Unet network model will generate weights, save the weight of the lowest loss (loss) of the 3D Unet network model, and get the most optimized 3D Unet Network model.
  • the network model training module 104 is also used to verify the effectiveness of the 3D Unet network model using the verification data set to verify whether the constructed 3D Unet network model can be used as a subsequent effective and accurate detection of the tumor area.
  • the tumor CT image of the verification data set is input into the 3D Unet network model to output the mask label of the tumor area, and the output mask label of the tumor area is compared with the mask tumor area label in the verification data set. If both Basically the same, it indicates that the constructed 3D Unet network model is effective and can be used as follow-up tumor detection; if the difference between the two is large, it indicates that the constructed 3D The Unet network model is invalid, and a valid 3D Unet network model needs to be reconstructed.
  • the tumor detection module 105 is used to obtain CT images to be detected from the image scanning device 3, and input the CT images to be detected into the 3D Unet network model for detection, and then detect various irregular tumor focus areas, and The tumor lesion area is displayed on the display 13, so as to help the doctor provide more comprehensive guidance for the planning of adjuvant radiotherapy and chemotherapy before the tumor operation and the evaluation of the effect of postoperative radiotherapy and chemotherapy.
  • FIG. 2 it is a flowchart of a preferred embodiment of a method for constructing a 3D UNet network model for tumor detection in the present invention.
  • the various method steps of the 3D UNet network model construction method are implemented by a computer software program, and the computer software program is stored in a computer-readable storage medium (such as the memory 11) in the form of computer program instructions,
  • the computer program instructions can be loaded by a processor (for example, the processor 12) and execute the following steps:
  • a LIDC data set is obtained from the medical image database 2.
  • the LIDC data set includes tumor CT images and tumor region annotations in xml format.
  • the medical imaging database 2 stores LIDC data sets of multiple tumor cases. For example, the medical imaging database 2 stores LIDC data sets of 1000 tumor cases.
  • the tumor area annotation in xml format is converted into a mask tumor area annotation; in this embodiment, the tumor area annotation in xml format is converted into a tumor area annotation in mask format (referred to as mask tumor area annotation); wherein, The size of the mask tumor area annotation is the same as that of the tumor CT image.
  • the pixel value of the tumor area in the tumor CT image is set to 1, and the pixel value of the non-tumor area is set to 0, thereby forming the mask tumor area annotation in the mask matrix format.
  • Step S23 Divide the transformed LIDC data set into a training data set and a verification data set; in this embodiment, each training data set and each verification data set includes a tumor CT image and a corresponding mask tumor area Label. Assuming that a total of 1000 LIDC data sets are input, the LIDC data set is divided according to the ratio of the training data set to the verification data set of 9:1, the training data set has 900 cases, and the verification data set has 100 cases.
  • step S24 the training data set and the verification data set are preprocessed, and the pixel value of the tumor CT image is normalized.
  • the preprocessing of the training data set and the verification data set includes the following steps: the interval between the pixels in the training data set and the verification data set is set to 1, so that the data of the 3D Unet network model is input Have a uniform interval; perform the following steps for the tumor CT image and mask tumor area annotation in the training data set: obtain the center point of the mask tumor area annotation, and use the center point as the center point of the 96 ⁇ 96 ⁇ 32 matrix according to 96 ⁇ 96 ⁇ 32 size Randomly crop the tumor area, randomly zoom in and out, randomly rotate a certain angle, the angle can be 90, 180 or 270 degrees, randomly flip up and down, and generate diversified training data to enhance the robustness of the 3D Unet network model Great; perform the following steps for the tumor CT image and mask tumor area annotation of the validation data set: obtain the center point of the mask tumor area, and use the center point as the center point of the
  • the normalization processing of the pixel value of the tumor CT image includes the steps: setting the pixel value greater than 0 in the tumor CT image to 0, and setting the pixel value less than -1200 in the tumor CT image to -1200 , Other pixels remain unchanged, that is, the pixel values of tumor CT images are normalized to the numerical range of [0, -1200] to exclude most of the non-tumor areas in tumor CT images.
  • Step S25 build a 3D Unet network model based on the keras framework.
  • the Keras framework is a Python API based on deep learning neural networks, written in Python language, and is a highly modular neural network library.
  • the 3D Unet network model is composed of an input layer, an output layer, a 3D convolution layer, a batch regularization layer, an activation layer, a deconvolution layer, and a maximum pooling layer.
  • the input layer size is 96 ⁇ 96 ⁇ 32
  • the model has 3 layers of downsampling (maximum pooling layer), 3 layers of upsampling (deconvolution layer), and the output layer size is 96 ⁇ 96 ⁇ 32.
  • the Adam optimizer is used to optimize the parameters of each layer of the 3D Unet network model, and the DiceLoss loss function is used to evaluate the loss generated by the 3D Unet network model.
  • the Adam optimizer is an extension of the stochastic gradient descent optimization algorithm, and is widely used in deep learning neural network applications, especially tasks such as computer vision and natural language processing.
  • the DiceLoss loss function is a network model that uses the dice coefficient as the loss function to evaluate the loss when using deep learning for medical image segmentation.
  • Step S27 Use the training data set to train the 3D Unet network model to obtain the weight of the 3D Unet network model.
  • the tumor CT images and mask tumor area annotations of the training data set are input into 3D according to the preset data amount.
  • Unet network model training for example, set the input data size (batchsize) of each round to 12 batches, and the total number of rounds (epoch) is set to 200 rounds; each round of training 3D Unet network model will generate weights and save 3D The weight of the lowest loss (loss) of the Unet network model obtains the optimized 3D Unet network model.
  • step S28 the validity of the 3D Unet network model is verified by using the verification data set to verify whether the constructed 3D Unet network model can be used as a follow-up effective and accurate detection of the tumor area.
  • the tumor CT image of the verification data set is input into the 3D Unet network model to output the mask label of the tumor area, and the output mask label of the tumor area is compared with the mask tumor area label in the verification data set. If both Basically the same, it indicates that the constructed 3D Unet network model is effective and can be used as follow-up tumor detection; if the difference between the two is large, it indicates that the constructed 3D The Unet network model is invalid, and a valid 3D Unet network model needs to be reconstructed.
  • Step S29 Obtain the CT image to be detected from the image scanning device 3, and input the CT image to be detected into the 3D Unet network model for detection, and then detect various irregular tumor lesion areas, and display the tumor lesion area in The display 13 is thus helpful for doctors to provide more comprehensive medical guidance for the formulation of preoperative adjuvant radiotherapy and chemotherapy programs for tumors and the evaluation of the effects of postoperative radiotherapy and chemotherapy.
  • the present invention also provides a computer-readable storage medium that stores a plurality of computer program instructions, and the computer program instructions are loaded by a processor of a computer device and execute the 3D method for detecting tumors of the present invention.
  • the steps of the UNet network model construction method Those skilled in the art can understand that all or part of the steps of the various methods in the foregoing embodiments can be completed by related program instructions.
  • the program can be stored in a computer-readable storage medium.
  • the storage medium may include: read-only memory, random access memory, Disk or CD, etc.
  • the 3D UNet network model construction method, device and computer-readable storage medium for detecting tumors of the present invention can construct 3D precise tumor segmentation UNet network model, through the 3D UNet network model to effectively segment various irregular tumor regions, improve the accuracy and speed of tumor detection, and the effectiveness of tumor detection is not limited to individual lung morphological differences, so as to quickly and accurately locate Tumor location provides medical guidance for doctors on tumor diagnosis and treatment.
  • the 3D UNet network model construction method, device and computer-readable storage medium for detecting tumors of the present invention can construct 3D accurate tumor segmentation UNet network model, through the 3D UNet network model to effectively segment various irregular tumor regions, improve the accuracy and speed of tumor detection, and the effectiveness of tumor detection is not limited to individual lung morphological differences, so as to quickly and accurately locate Tumor location provides medical guidance for doctors on tumor diagnosis and treatment.

Abstract

The invention provides a method and device for constructing a 3D UNet network model for tumor detection, and a computer-readable storage medium. The method comprises: acquiring an LIDC data set from a medical image database, wherein the LIDC data set comprises a tumor CT image and a tumor region annotation in an xml format; converting the tumor region annotation in the xml format into a tumor region annotation in a mask format; dividing the converted LIDC data set into a training data set and a verification data set; preprocessing the training data set and the verification data set, and normalizing pixel values of the tumor CT image; constructing a 3D Unet network model on the basis of a keras framework; using the training data set to train the 3D Unet network model so as to acquire a weight of the 3D Unet network model; and using the verification data set to verify the validity of the 3D Unet network model. In the invention, a 3D Unet network is constructed, thereby quickly and accurately detecting a tumor focus region, and improving the efficiency and accuracy of tumor detection.

Description

用于检测肿瘤的3D UNet网络模型构建方法、装置及存储介质3D UNet network model construction method, device and storage medium for detecting tumor 技术领域Technical field
本发明涉及肿瘤影像处理的技术领域,尤其涉及一种用于检测肿瘤的3D UNet网络模型构建方法、装置及计算机可读存储介质。The present invention relates to the technical field of tumor image processing, in particular to a method, device and computer readable storage medium for constructing a 3D UNet network model for tumor detection.
背景技术Background technique
随着CT的应用普及,为肿瘤的早期筛查提供了便利。近年来的统计发现,肺癌的发病率越来越高,同时也是癌症致死率的首要原因,精确地从CT 图形中分割出肿瘤病灶区域,对术前新辅助放化疗的计划制定,以及术后放化疗疗效果评估意义重大。然而,人工勾画肿瘤区域是一项耗时长,工作量极大的工作。此外,不同的放射科医生对肿瘤区域的勾画结果受其主观经验,环境等诸多因素的影响,其勾画结果是不可重复的。此外,由于不同个体肺部形态差异造成肿瘤CT影像模糊不清,很难找全所有肿瘤CT影像中的肿瘤区域,肿瘤检测准确度不高且效率低造成肿瘤位置定位困难。因此,临床上急需实现肿瘤区域的自动检测,准确定位肿瘤位置,为肿瘤的诊断治疗提供指导成为业界的研究重点。With the popularization of CT applications, it provides convenience for early tumor screening. Statistics in recent years have found that the incidence of lung cancer is getting higher and higher, and it is also the primary cause of cancer mortality. The tumor lesion area is accurately segmented from the CT image, and the plan for preoperative neoadjuvant radiotherapy and chemotherapy, and postoperative Evaluation of the effect of radiotherapy and chemotherapy is of great significance. However, manually delineating the tumor area is a time-consuming and labor-intensive task. In addition, the delineation results of different radiologists on the tumor area are affected by their subjective experience, environment and many other factors, and their delineation results are not repeatable. In addition, due to differences in lung morphology of different individuals, tumor CT images are blurred, and it is difficult to find all tumor regions in all tumor CT images. The accuracy and low efficiency of tumor detection make it difficult to locate the tumor. Therefore, it is urgent to realize the automatic detection of the tumor area in clinical practice, accurately locate the tumor location, and provide guidance for the diagnosis and treatment of the tumor has become the research focus of the industry.
技术问题technical problem
本发明的主要目的在于提供一种用于检测肿瘤的3D UNet网络模型构建方法、装置及计算机可读存储介质,旨在解决现有肿瘤检测方法受限于个体肺部形态差异造成肿瘤检测效率低且准确度低的技术问题。The main purpose of the present invention is to provide a method, device and computer readable storage medium for constructing a 3D UNet network model for tumor detection, aiming to solve the problem that the existing tumor detection methods are limited by individual lung morphological differences, resulting in low tumor detection efficiency And the technical problem of low accuracy.
技术解决方案Technical solutions
为实现上述目的,本发明提供一种用于检测肿瘤的3D UNet网络模型构建方法,该方法包括如下步骤:从医疗影像数据库获取LIDC数据集,该LIDC数据集包括肿瘤CT影像和xml格式的肿瘤区域标注;将xml格式的肿瘤区域标注转化为mask肿瘤区域标注;将转化后的LIDC数据集划分为训练数据集和验证数据集;将训练数据集和验证数据集进行预处理,并将肿瘤CT影像的像素值归一化处理;基于keras框架构建3D Unet网络模型;利用训练数据集对构建出的3D Unet网络模型进行训练得到3D Unet网络模型的权重;利用验证数据集对构建出的3D Unet网络模型的有效性进行验证。In order to achieve the above objective, the present invention provides a 3D UNet network model construction method for detecting tumors. The method includes the following steps: obtaining LIDC data sets from a medical imaging database, the LIDC data sets including tumor CT images and tumors in xml format Region annotation; convert the tumor area annotation in xml format into mask tumor area annotation; divide the transformed LIDC data set into training data set and validation data set; preprocess the training data set and the validation data set, and perform CT of the tumor Image pixel value normalization processing; build 3D based on keras framework Unet network model; use the training data set to train the constructed 3D Unet network model to obtain the weight of the 3D Unet network model; use the validation data set to construct the 3D The validity of the Unet network model is verified.
优选地,所述对训练数据集和验证数据集进行预处理的步骤包括如下步骤:对训练数据集和验证数据集中像素点之间的间隔均置为1,使输入3D Unet网络模型的数据拥有统一的间隔;针对训练数据集中的肿瘤CT影像和mask肿瘤区域标注均执行如下步骤:获取mask肿瘤区域标注的中心点,以该中心点作为96×96×32矩阵的中心点,按照96×96×32大小对肿瘤区域进行随机裁剪,随机放大缩小,随机旋转角度,随机上下左右翻转,生成多样化的训练数据;针对验证数据集的肿瘤CT影像和mask肿瘤区域标注均执行如下步骤:获取mask肿瘤区域的中心点,以该中心点作为96×96×32矩阵的中心点,按照96×96×32大小对肿瘤区域进行裁剪,并保存裁剪得到的肿瘤CT影像和mask肿瘤区域。Preferably, the step of preprocessing the training data set and the verification data set includes the following steps: set the interval between the pixels in the training data set and the verification data set to 1, so that the data input to the 3D Unet network model has Uniform interval; for the tumor CT images and mask tumor area annotations in the training data set, the following steps are performed: obtain the center point of the mask tumor area annotation, and use the center point as the center point of the 96×96×32 matrix according to 96×96 ×32 size Randomly crop the tumor area, randomly zoom in and out, randomly rotate the angle, randomly flip up and down, and generate diversified training data; perform the following steps for the tumor CT image and mask tumor area labeling in the validation data set: Get mask The center point of the tumor area, using the center point as the center point of the 96×96×32 matrix, crop the tumor area according to the size of 96×96×32, and save the cropped tumor CT image and mask the tumor area.
优选地,所述将肿瘤CT影像的像素值归一化处理的步骤包括如下步骤:将肿瘤CT影像中大于0的像素值置为0,将肿瘤CT影像中小于-1200像素值置为-1200,其它像素置不变,进而将肿瘤CT影像的像素值归一化到[0,-1200]这个数值区间,以排除肿瘤CT影像中的非肿瘤区域。Preferably, the step of normalizing the pixel value of the tumor CT image includes the following steps: setting the pixel value greater than 0 in the tumor CT image to 0, and setting the pixel value less than -1200 in the tumor CT image to -1200 , Leave the other pixels unchanged, and then normalize the pixel value of the tumor CT image to the value range of [0, -1200] to exclude the non-tumor area in the tumor CT image.
优选地,所述mask肿瘤区域标注的大小和肿瘤CT影像的大小相同,将肿瘤CT影像中的肿瘤区域的像素值置为1,非肿瘤区域的像素值置为0,从而构成mask矩阵格式的mask肿瘤区域标注。Preferably, the size of the annotation of the mask tumor area is the same as the size of the tumor CT image, and the pixel value of the tumor area in the tumor CT image is set to 1, and the pixel value of the non-tumor area is set to 0, thereby forming the mask matrix format Mask tumor area marking.
优选地,所述LIDC数据集按照训练数据集与验证数据集的比例为9:1划分为多个训练数据集和多个验证数据集,每个训练数据集和每个验证数据集均包括一个肿瘤CT影像及一个对应的mask肿瘤区域标注。Preferably, the LIDC data set is divided into multiple training data sets and multiple verification data sets according to the ratio of the training data set to the verification data set of 9:1, and each training data set and each verification data set includes one Tumor CT image and a corresponding mask tumor area annotation.
优选地,所述3D Unet网络模型由输入层、输出层、3D卷积层、批正则化层、激活层、反卷积层和最大池化层构成,其中,所述输入层大小为96×96×32,所述模型最大池化层由3层降采样构成、所述反卷积层由3层上采样构成,所述输出层大小为96×96×32。Preferably, the 3D Unet network model is composed of an input layer, an output layer, a 3D convolutional layer, a batch regularization layer, an activation layer, a deconvolution layer, and a maximum pooling layer, wherein the input layer size is 96× 96×32, the model maximum pooling layer is composed of 3 layers of downsampling, the deconvolution layer is composed of 3 layers of upsampling, and the size of the output layer is 96×96×32.
优选地,所述用于检测肿瘤的3D UNet网络模型构建方法还包括:采用Adam优化器对3D Unet网络模型各层的参数进行优化;采用DiceLoss损失函数对3D Unet网络模型产生的损失进行评估。Preferably, the method for constructing a 3D UNet network model for tumor detection further includes: using an Adam optimizer to optimize the parameters of each layer of the 3D Unet network model; and using a DiceLoss loss function to evaluate the loss generated by the 3D Unet network model.
优选地,所述用于检测肿瘤的3D UNet网络模型构建方法还包括:从影像扫描设备获取待检测的CT影像;将待检测的CT影像输入至3D Unet网络模型进行检测以检测出各种不规则的肿瘤病灶区域,并将肿瘤病灶区域显示在显示器上。Preferably, the method for constructing a 3D UNet network model for detecting tumors further includes: acquiring CT images to be detected from an image scanning device; and inputting the CT images to be detected into the 3D Unet network model for detection to detect various defects. Regular tumor lesion area, and display the tumor lesion area on the monitor.
另一方面,本发明还提供一种用于检测肿瘤的3D UNet网络模型构建装置,包括适于实现各种计算机程序指令的处理器以及适于存储多条计算机程序指令的存储器,所述计算机程序指令由处理器加载并执行如前述所述用于检测肿瘤的3D UNet网络模型构建方法的各项方法步骤。On the other hand, the present invention also provides a 3D UNet network model construction device for detecting tumors, which includes a processor suitable for implementing various computer program instructions and a memory suitable for storing multiple computer program instructions. The instructions are loaded by the processor and executed as described above for 3D tumor detection The method steps of the UNet network model construction method.
再一方面,本发明还提供一种计算机可读存储介质,该计算机可读存储介质存储多条计算机程序指令,其特征在于,所述计算机程序指令由计算机装置的处理器加载并执行如前述所述用于检测肿瘤的3D UNet网络模型构建方法的各项方法步骤。In another aspect, the present invention also provides a computer-readable storage medium that stores a plurality of computer program instructions, wherein the computer program instructions are loaded by the processor of the computer device and executed as described above. 3D for tumor detection The method steps of the UNet network model construction method.
有益效果Beneficial effect
相较于现有技术,本发明所述用于检测肿瘤的3D UNet网络模型构建方法、装置及计算机可读存储介质能够构建出肿瘤精准分割的3D UNet网络模型,通过该3D UNet网络模型有效分割各种不规则的肿瘤区域,提高肿瘤检测准确度和速度,且肿瘤检测的有效性不受限于个体肺部形态差异,从而快速、准确地定位肿瘤位置,为医生对肿瘤的诊断治疗提供医学指导。Compared with the prior art, the 3D UNet network model construction method, device and computer-readable storage medium for detecting tumors of the present invention can construct 3D accurate tumor segmentation UNet network model, through the 3D UNet network model to effectively segment various irregular tumor regions, improve the accuracy and speed of tumor detection, and the effectiveness of tumor detection is not limited to individual lung morphological differences, so as to quickly and accurately locate Tumor location provides medical guidance for doctors on tumor diagnosis and treatment.
附图说明Description of the drawings
图1是本发明用于检测肿瘤的3D UNet网络模型构建装置的较佳实施例的结构方框示意图;Fig. 1 is a schematic block diagram of a preferred embodiment of a 3D UNet network model construction device for tumor detection according to the present invention;
图2是本发明用于检测肿瘤的3D UNet网络模型构建方法较佳实施例的方法流程图。Fig. 2 is a method flowchart of a preferred embodiment of a method for constructing a 3D UNet network model for tumor detection according to the present invention.
本发明目的的实现、功能特点及优点将结合实施例,参照附图做进一步说明。The realization of the objectives, functional characteristics and advantages of the present invention will be further described in conjunction with the embodiments and with reference to the accompanying drawings.
本发明的实施方式Embodiments of the invention
为更进一步阐述本发明为达成预定发明目的所采取的技术手段及功效,以下结合附图及较佳实施例,对本发明的具体实施方式、结构、特征及其功效,详细说明如下。应当理解,此处所描述的具体实施例仅仅用以解释本发明,并不用于限定本发明。In order to further explain the technical means and effects of the present invention to achieve the intended purpose of the invention, the specific implementation, structure, features and effects of the present invention will be described in detail below with reference to the drawings and preferred embodiments. It should be understood that the specific embodiments described here are only used to explain the present invention, but not to limit the present invention.
参照图1所示,图1是本发明用于检测肿瘤的3D UNet网络模型构建装置的较佳实施例的结构示意图。在本实施例中,所述用于检测肿瘤的3D UNet网络模型构建装置1包括,但不仅限于,适于存储各种计算机程序指令的存储器11、执行各种计算机程序指令的处理器12以及显示器13。所述存储器11和显示器13均通过电连接线与所述处理器12进行电气连接,并通过数据总线与处理器12进行数据传输连接。所述处理器12能够调用存储在所述存储器11中的用于检测肿瘤的3D UNet网络模型构建程序10,并执行该3D UNet网络模型构建程序10从影像扫描设备3输入的肿瘤CT影像,并利用UNet网络基于肿瘤CT影像数据对肺叶进行分割。所述3D UNet网络模型构建装置1可以为安装有本发明所述3D UNet网络模型构建程序10的个人计算机、笔记本电脑、服务器等计算机装置。Referring to Fig. 1, Fig. 1 is a schematic structural diagram of a preferred embodiment of a 3D UNet network model construction device for detecting tumors of the present invention. In this embodiment, the 3D UNet network model construction device 1 for tumor detection includes, but is not limited to, a memory 11 suitable for storing various computer program instructions, a processor 12 for executing various computer program instructions, and a display 13. Both the memory 11 and the display 13 are electrically connected to the processor 12 through an electrical connection line, and are connected to the processor 12 through a data bus for data transmission. The processor 12 can call the 3D UNet network model construction program 10 for detecting tumors stored in the memory 11, and execute the 3D UNet network model construction program 10 to input tumor CT images from the image scanning device 3, and Using UNet network to segment lung lobes based on tumor CT image data. The 3D UNet network model construction device 1 may be a personal computer, a notebook computer, a server, and other computer devices installed with the 3D UNet network model construction program 10 of the present invention.
在本实施例中,所述3D UNet网络模型构建装置1连接有医疗影像数据库2以及影像扫描设备3。所述医疗影像数据库2存储有多个肿瘤病例的LIDC数据集作为样本,例如医疗影像数据库2存储有1000例LIDC数据集,每一例LIDC数据集包括肿瘤CT影像和xml格式的肿瘤区域标注。所述影像扫描设备3可以为CT扫描仪,能够扫描患者的肺部得到肿瘤CT影像。所述3D UNet网络模型构建装置1通过处理器12执行3D UNet网络模型构建程序10能够从医疗影像数据库2获取多个LIDC数据集,根据LIDC数据集构建3D UNet网络模型,从影像扫描设备3获取患者的肿瘤CT影像并输入至3D UNet网络模型,利用3D UNet网络模型对输入的肿瘤CT影像快速准确地检测出肿瘤病灶区域。In this embodiment, the 3D UNet network model construction device 1 is connected to a medical image database 2 and an image scanning device 3. The medical imaging database 2 stores LIDC data sets of multiple tumor cases as samples. For example, the medical imaging database 2 stores 1000 LIDC data sets, and each LIDC data set includes tumor CT images and tumor area annotations in xml format. The image scanning device 3 may be a CT scanner, which can scan the lungs of patients to obtain CT images of tumors. The 3D The UNet network model construction device 1 executes the 3D UNet network model construction program 10 through the processor 12 to obtain multiple LIDC data sets from the medical imaging database 2, construct a 3D UNet network model from the LIDC data set, and obtain the patient’s tumor from the image scanning device 3 The CT images are input to the 3D UNet network model, and the 3D UNet network model is used to quickly and accurately detect the tumor lesion area on the input tumor CT image.
在本实施例中,所述存储器11至少包括一种类型的可读存储介质,所述可读存储介质包括闪存、硬盘、多媒体卡、卡型存储器(例如,SD或DX存储器等)、磁性存储器、磁盘、光盘等。所述存储器11在一些实施例中可以是所述用于检测肿瘤的3D UNet网络模型构建装置1的内部存储单元,例如该用于检测肿瘤的3D UNet网络模型构建装置1的硬盘、只读存储器ROM,随机存储器RAM、电可擦写存储器EEPROM、快闪存储器FLASH或光盘等。所述存储器11在另一些实施例中也可以是用于检测肿瘤的3D UNet网络模型构建装置1的外部存储设备,例如该3D UNet网络模型构建装置1上配备的插接式硬盘,智能存储卡(Smart Media Card, SMC),安全数字(Secure Digital, SD)卡,闪存卡(Flash Card)等。进一步地,所述存储器11还可以既包括3D UNet网络模型构建装置1的内部存储单元也包括外部存储设备。所述存储器11不仅可以用于存储安装于3D UNet网络模型构建装置1的应用软件及各类数据,例如存储用于3D UNet网络模型构建程序10的程序代码等,还可以用于暂时地存储已经输出或者将要输出的肿瘤病灶区域。In this embodiment, the memory 11 includes at least one type of readable storage medium. The readable storage medium includes flash memory, hard disk, multimedia card, card-type memory (for example, SD or DX memory, etc.), and magnetic memory. , Disks, CDs, etc. In some embodiments, the memory 11 may be an internal storage unit of the 3D UNet network model construction device 1 for tumor detection, such as the hard disk and read-only memory of the 3D UNet network model construction device 1 for tumor detection. ROM, random access memory RAM, electrically erasable memory EEPROM, flash memory FLASH or optical disc, etc. In other embodiments, the memory 11 may also be 3D for detecting tumors. The external storage device of the UNet network model construction device 1, such as the 3D The plug-in hard disk, smart memory card (Smart memory card) equipped on the UNet network model building device 1 Media Card, SMC), Secure Digital (Secure Digital, SD) card, flash card (Flash Card), etc. Further, the memory 11 may also include both an internal storage unit of the 3D UNet network model construction device 1 and an external storage device. The memory 11 can not only be used to store the 3D Application software and various data of UNet network model construction device 1, such as storage for 3D The program code of the UNet network model construction program 10, etc., can also be used to temporarily store the tumor lesion area that has been output or will be output.
在本实施例中,所述处理器12在一些实施例中可以是一中央处理器(Central Processing Unit, CPU)、控制器、微控制器、微处理器或其他数据处理芯片,用于调用并运行存储器11中存储的程序代码或处理数据,例如执行3D UNet网络模型构建程序10等。所述显示器13可以为触摸显示屏也可以为通用的LED显示屏,能够显示检测出的肿瘤病灶区域。In this embodiment, the processor 12 may be a central processing unit (Central Processing Unit) in some embodiments. Processing Unit (CPU), controller, microcontroller, microprocessor or other data processing chip, used to call and run the program code or processing data stored in the memory 11, for example, execute the 3D UNet network model construction program 10, etc. The display 13 may be a touch display screen or a general LED display screen, which can display the detected tumor lesion area.
可选地,在其他实施例中,所述用于检测肿瘤的3D UNet网络模型构建程序10还可以被划分为一个或者多个模块,一个或者多个模块被存储于存储器11中,并由一个或多个处理器(本实施例为处理器12)所执行以完成本发明,本发明所称的模块是指能够完成特定功能的一系列计算机程序指令段,用于描述3D UNet网络模型构建程序10在所述UNet网络构建装置1中的执行过程。Optionally, in other embodiments, the 3D UNet network model construction program 10 for tumor detection can also be divided into one or more modules, one or more modules are stored in the memory 11, and are composed of one Or multiple processors (processor 12 in this embodiment) are executed to complete the present invention. The module referred to in the present invention refers to a series of computer program instruction segments that can complete specific functions, and is used to describe the 3D UNet network model construction program 10 The execution process in the UNet network construction device 1.
在本实施例中,所述用于检测肿瘤的3D UNet网络模型构建程序10由多条计算机程序指令组成的程序模块组成,包括但不局限于,影像数据获取模块101、影像数据处理模块102、网络模型构建模块103、网络模型训练模块104以及肿瘤检测模块105。本发明所称的模块是指一种能够被3D UNet网络模型构建装置1的处理器12执行并且能够完成固定功能的一系列计算机程序指令段,其存储在存储器11中。In this embodiment, the 3D UNet network model building program 10 for tumor detection is composed of program modules composed of multiple computer program instructions, including but not limited to, an image data acquisition module 101, an image data processing module 102, The network model construction module 103, the network model training module 104, and the tumor detection module 105. The module referred to in the present invention refers to a series of computer program instruction segments that can be executed by the processor 12 of the 3D UNet network model construction device 1 and can complete fixed functions, and are stored in the memory 11.
所述影像数据获取模块101用于从医疗影像数据库2获取LIDC数据集,该LIDC数据集包括肿瘤CT影像和xml格式的肿瘤区域标注。在本实施例中,所述医疗影像数据库2存储有多个肿瘤病例的LIDC数据集,例如医疗影像数据库2存储有1000例肿瘤病例的LIDC数据集。The image data acquisition module 101 is used to acquire a LIDC data set from the medical image database 2, and the LIDC data set includes tumor CT images and tumor region annotations in xml format. In this embodiment, the medical imaging database 2 stores LIDC data sets of multiple tumor cases. For example, the medical imaging database 2 stores LIDC data sets of 1000 tumor cases.
所述影像数据处理模块102用于将xml格式的肿瘤区域标注转化为mask肿瘤区域标注;在本实施例中,所述影像数据处理模块102将xml格式的肿瘤区域标注转化为mask格式的肿瘤区域标注(简称mask肿瘤区域标注);其中,mask肿瘤区域标注的大小和肿瘤CT影像的大小一样,将肿瘤CT影像中的肿瘤区域的像素值置为1,非肿瘤区域的像素值置为0,从而构成mask矩阵格式的mask肿瘤区域标注。The image data processing module 102 is used to convert the tumor area annotation in xml format into a mask tumor area annotation; in this embodiment, the image data processing module 102 converts the tumor area annotation in xml format into a tumor area in mask format Labeling (referred to as mask tumor area labeling); where the size of the mask tumor area label is the same as the size of the tumor CT image, the pixel value of the tumor area in the tumor CT image is set to 1, and the pixel value of the non-tumor area is set to 0. This constitutes the mask tumor area label in the mask matrix format.
所述影像数据处理模块102还用于将转化后的LIDC数据集划分为训练数据集和验证数据集;在本实施例中,每个训练数据集和每个验证数据集均包括一个肿瘤CT影像及一个对应的mask肿瘤区域标注。假设总共输入1000例LIDC数据集,所述LIDC数据集按照训练数据集与验证数据集的比例为9:1进行划分,训练数据集有900例,验证数据集有100例。The image data processing module 102 is also used to divide the transformed LIDC data set into a training data set and a verification data set; in this embodiment, each training data set and each verification data set includes a tumor CT image And a corresponding mask tumor area label. Assuming that a total of 1000 LIDC data sets are input, the LIDC data set is divided according to the ratio of the training data set to the verification data set of 9:1, the training data set has 900 cases, and the verification data set has 100 cases.
所述影像数据处理模块102还用于对训练数据集和验证数据集进行预处理,并将肿瘤CT影像的像素值归一化处理。在本实施例中,所述对训练数据集和验证数据集进行预处理包括如下步骤:对训练数据集和验证数据集中像素点之间的间隔均置为1,使输入3D Unet网络模型的数据拥有统一的间隔;针对训练数据集中的肿瘤CT影像和mask肿瘤区域标注执行如下步骤:获取mask肿瘤区域标注的中心点,以该中心点作为96×96×32矩阵的中心点,按照96×96×32大小对肿瘤区域进行随机裁剪,随机放大缩小,随机旋转一定角度,该角度可以为90、180或270度,随机上下左右翻转,生成多样化的训练数据,以增强3D Unet网络模型的鲁棒性;针对验证数据集的肿瘤CT影像和mask肿瘤区域执行如下步骤:获取mask肿瘤区域的中心点,以该中心点作为96×96×32矩阵的中心点,按照96×96×32大小对肿瘤区域进行裁剪,并保存裁剪得到的肿瘤CT影像和mask肿瘤区域数据作为后续验证3D Unet网络模型的有效性。在本实施例中,所述将肿瘤CT影像的像素值归一化处理包括步骤:将肿瘤CT影像中大于0的像素值置为0,将肿瘤CT影像中小于-1200像素值置为-1200,其它像素置不变,即将肿瘤CT影像的像素值归一化到[0,-1200]这个数值区间,以排除大部分非肿瘤区域。The image data processing module 102 is also used to preprocess the training data set and the verification data set, and normalize the pixel values of the tumor CT images. In this embodiment, the preprocessing of the training data set and the verification data set includes the following steps: the interval between the pixels in the training data set and the verification data set is set to 1, so that the data of the 3D Unet network model is input Have a uniform interval; perform the following steps for the tumor CT image and mask tumor area annotation in the training data set: obtain the center point of the mask tumor area annotation, and use the center point as the center point of the 96×96×32 matrix according to 96×96 ×32 size Randomly crop the tumor area, randomly zoom in and out, randomly rotate a certain angle, the angle can be 90, 180 or 270 degrees, randomly flip up and down, and generate diversified training data to enhance the robustness of the 3D Unet network model Great; perform the following steps for the tumor CT image and mask tumor area of the validation data set: Obtain the center point of the mask tumor area, and use the center point as the center point of the 96×96×32 matrix, according to the size of 96×96×32 The tumor area is cropped, and the cropped tumor CT image and mask tumor area data are saved for subsequent verification of the effectiveness of the 3D Unet network model. In this embodiment, the normalization processing of the pixel value of the tumor CT image includes the steps: setting the pixel value greater than 0 in the tumor CT image to 0, and setting the pixel value less than -1200 in the tumor CT image to -1200 , Other pixels remain unchanged, that is, the pixel values of tumor CT images are normalized to the numerical range of [0, -1200] to exclude most non-tumor areas.
所述网络模型构建模块103用于基于keras框架构建3D Unet网络模型。本领域技术人员可知,所述Keras框架是一个基于深度学习神经网路的Python API,采用Python语言编写,是一个高度模块化的神经网络库。在本实施例中,所述3D Unet网络模型由输入层、输出层、3D卷积层、批正则化层、激活层、反卷积层和最大池化层构成,输入层大小为96×96×32,该模型有3层降采样(最大池化层)、3层上采样(反卷积层),输出层大小为96×96×32。所述网络模型构建模块103还用于采用Adam优化器对3D Unet网络模型各层的参数进行优化,并采用DiceLoss损失函数对3D Unet网络模型产生的损失进行评估。本领域技术人员可知,所述Adam优化器是随机梯度下降优化算法的扩展式,广泛用于深度学习神经网路应用中,尤其是计算机视觉和自然语言处理等任务。所述DiceLoss损失函数是一种将dice系数作为损失函数,在使用深度学习做医学图像分割时对损失进行评估的网络模型。The network model construction module 103 is used to construct a 3D Unet network model based on the keras framework. Those skilled in the art can know that the Keras framework is a Python API based on deep learning neural networks, written in Python language, and is a highly modular neural network library. In this embodiment, the 3D Unet network model is composed of an input layer, an output layer, a 3D convolution layer, a batch regularization layer, an activation layer, a deconvolution layer, and a maximum pooling layer. The input layer size is 96×96 ×32, the model has 3 layers of downsampling (maximum pooling layer), 3 layers of upsampling (deconvolution layer), and the output layer size is 96×96×32. The network model building module 103 is also used to optimize the parameters of each layer of the 3D Unet network model by using the Adam optimizer, and to use the DiceLoss loss function to optimize the 3D Unet network model to assess the loss. Those skilled in the art can know that the Adam optimizer is an extension of the stochastic gradient descent optimization algorithm, and is widely used in deep learning neural network applications, especially tasks such as computer vision and natural language processing. The DiceLoss loss function is a network model that uses the dice coefficient as the loss function to evaluate the loss when using deep learning for medical image segmentation.
所述网络模型训练模块104用于利用训练数据集对3D Unet网络模型进行训练得到3D Unet网络模型的权重。在本实施例中,网络模型训练模块104将训练数据集的肿瘤CT影像和mask肿瘤区域标注按照预设的数据量输入3D Unet网络模型进行训练,例如,将每轮输入的数据量大小(batchsize)设为12批,总共轮数(epoch)设置为200轮;每一轮训练3D Unet网络模型均会产生权重,保存3D Unet网络模型的最低损失(loss)的权重,得到最优化的3D Unet网络模型。The network model training module 104 is used to train the 3D Unet network model by using the training data set to obtain the weight of the 3D Unet network model. In this embodiment, the network model training module 104 inputs the tumor CT images and mask tumor region annotations of the training data set into the 3D Unet network model for training according to a preset amount of data. For example, the input data amount of each round (batchsize ) Set to 12 batches, the total number of rounds (epoch) is set to 200 rounds; each round of training the 3D Unet network model will generate weights, save the weight of the lowest loss (loss) of the 3D Unet network model, and get the most optimized 3D Unet Network model.
所述网络模型训练模块104还用于利用验证数据集对3D Unet网络模型的有效性进行验证,以验证构建出的3D Unet网络模型是否可以作为后续有效并且准确地检测出肿瘤区域。在本实施例中,将验证数据集的肿瘤CT影像输入3D Unet网络模型输出肿瘤区域的mask标注,并将输出的肿瘤区域的mask标注与验证数据集中的mask肿瘤区域标注进行比较,若两者基本相同,则表明构建了有效的3D Unet网络模型有效,可作为后续肿瘤检测;若两者相差较大,则表明构建出的3D Unet网络模型无效,需重新构建有效的3D Unet网络模型。The network model training module 104 is also used to verify the effectiveness of the 3D Unet network model using the verification data set to verify whether the constructed 3D Unet network model can be used as a subsequent effective and accurate detection of the tumor area. In this embodiment, the tumor CT image of the verification data set is input into the 3D Unet network model to output the mask label of the tumor area, and the output mask label of the tumor area is compared with the mask tumor area label in the verification data set. If both Basically the same, it indicates that the constructed 3D Unet network model is effective and can be used as follow-up tumor detection; if the difference between the two is large, it indicates that the constructed 3D The Unet network model is invalid, and a valid 3D Unet network model needs to be reconstructed.
所述肿瘤检测模块105用于从影像扫描设备3获取待检测的CT影像,并将待检测的CT影像输入至3D Unet网络模型进行检测,进而检测出各种不规则的肿瘤病灶区域,并将肿瘤病灶区域显示在显示器13上,从而有助于供医生对肿瘤术前辅助放化疗的计划制定,以及术后放化疗疗效果评估提供更加全面的指导。The tumor detection module 105 is used to obtain CT images to be detected from the image scanning device 3, and input the CT images to be detected into the 3D Unet network model for detection, and then detect various irregular tumor focus areas, and The tumor lesion area is displayed on the display 13, so as to help the doctor provide more comprehensive guidance for the planning of adjuvant radiotherapy and chemotherapy before the tumor operation and the evaluation of the effect of postoperative radiotherapy and chemotherapy.
参考图2所示,是本发明用于检测肿瘤的3D UNet网络模型构建方法较佳实施例的流程图。在本实施例中,所述3D UNet网络模型构建方法的各种方法步骤通过计算机软件程序来实现,该计算机软件程序以计算机程序指令的形式存储于计算机可读存储介质(例如存储器11)中,所述计算机程序指令能够被处理器(例如处理器12)加载并执行如下步骤:Referring to FIG. 2, it is a flowchart of a preferred embodiment of a method for constructing a 3D UNet network model for tumor detection in the present invention. In this embodiment, the various method steps of the 3D UNet network model construction method are implemented by a computer software program, and the computer software program is stored in a computer-readable storage medium (such as the memory 11) in the form of computer program instructions, The computer program instructions can be loaded by a processor (for example, the processor 12) and execute the following steps:
步骤S21,从医疗影像数据库2获取LIDC数据集,该LIDC数据集包括肿瘤CT影像和xml格式的肿瘤区域标注。在本实施例中,所述医疗影像数据库2存储有多个肿瘤病例的LIDC数据集,例如医疗影像数据库2存储有1000例肿瘤病例的LIDC数据集。In step S21, a LIDC data set is obtained from the medical image database 2. The LIDC data set includes tumor CT images and tumor region annotations in xml format. In this embodiment, the medical imaging database 2 stores LIDC data sets of multiple tumor cases. For example, the medical imaging database 2 stores LIDC data sets of 1000 tumor cases.
步骤S22,将xml格式的肿瘤区域标注转化为mask肿瘤区域标注;在本实施例中,将xml格式的肿瘤区域标注转化为mask格式的肿瘤区域标注(简称mask肿瘤区域标注);其中,所述mask肿瘤区域标注的大小和肿瘤CT影像的大小相同,将肿瘤CT影像中的肿瘤区域的像素值置为1,非肿瘤区域的像素值置为0,从而构成mask矩阵格式的mask肿瘤区域标注。In step S22, the tumor area annotation in xml format is converted into a mask tumor area annotation; in this embodiment, the tumor area annotation in xml format is converted into a tumor area annotation in mask format (referred to as mask tumor area annotation); wherein, The size of the mask tumor area annotation is the same as that of the tumor CT image. The pixel value of the tumor area in the tumor CT image is set to 1, and the pixel value of the non-tumor area is set to 0, thereby forming the mask tumor area annotation in the mask matrix format.
步骤S23,将转化后的LIDC数据集划分为训练数据集和验证数据集;在本实施例中,每个训练数据集和每个验证数据集均包括一个肿瘤CT影像和一个对应的mask肿瘤区域标注。假设总共输入1000例LIDC数据集,所述LIDC数据集按照训练数据集与验证数据集的比例为9:1进行划分,训练数据集有900例,验证数据集有100例。Step S23: Divide the transformed LIDC data set into a training data set and a verification data set; in this embodiment, each training data set and each verification data set includes a tumor CT image and a corresponding mask tumor area Label. Assuming that a total of 1000 LIDC data sets are input, the LIDC data set is divided according to the ratio of the training data set to the verification data set of 9:1, the training data set has 900 cases, and the verification data set has 100 cases.
步骤S24,将训练数据集和验证数据集进行预处理,并将肿瘤CT影像的像素值归一化处理。在本实施例中,所述对训练数据集和验证数据集进行预处理包括如下步骤:对训练数据集和验证数据集中像素点之间的间隔均置为1,使输入3D Unet网络模型的数据拥有统一的间隔;针对训练数据集中的肿瘤CT影像和mask肿瘤区域标注执行如下步骤:获取mask肿瘤区域标注的中心点,以该中心点作为96×96×32矩阵的中心点,按照96×96×32大小对肿瘤区域进行随机裁剪,随机放大缩小,随机旋转一定角度,该角度可以为90、180或270度,随机上下左右翻转,生成多样化的训练数据,以增强3D Unet网络模型的鲁棒性;针对验证数据集的肿瘤CT影像和mask肿瘤区域标注执行如下步骤:获取mask肿瘤区域的中心点,以该中心点作为96×96×32矩阵的中心点,按照96×96×32大小对肿瘤区域进行裁剪,并保存裁剪得到的肿瘤CT影像和mask肿瘤区域数据作为后续验证3D Unet网络模型的有效性。在本实施例中,所述将肿瘤CT影像的像素值归一化处理包括步骤:将肿瘤CT影像中大于0的像素值置为0,将肿瘤CT影像中小于-1200像素值置为-1200,其它像素置不变,即将肿瘤CT影像的像素值归一化到[0,-1200]这个数值区间,以排除肿瘤CT影像中的大部分非肿瘤区域。In step S24, the training data set and the verification data set are preprocessed, and the pixel value of the tumor CT image is normalized. In this embodiment, the preprocessing of the training data set and the verification data set includes the following steps: the interval between the pixels in the training data set and the verification data set is set to 1, so that the data of the 3D Unet network model is input Have a uniform interval; perform the following steps for the tumor CT image and mask tumor area annotation in the training data set: obtain the center point of the mask tumor area annotation, and use the center point as the center point of the 96×96×32 matrix according to 96×96 ×32 size Randomly crop the tumor area, randomly zoom in and out, randomly rotate a certain angle, the angle can be 90, 180 or 270 degrees, randomly flip up and down, and generate diversified training data to enhance the robustness of the 3D Unet network model Great; perform the following steps for the tumor CT image and mask tumor area annotation of the validation data set: obtain the center point of the mask tumor area, and use the center point as the center point of the 96×96×32 matrix, according to the size of 96×96×32 The tumor area is cropped, and the cropped tumor CT image and mask tumor area data are saved for subsequent verification of the effectiveness of the 3D Unet network model. In this embodiment, the normalization processing of the pixel value of the tumor CT image includes the steps: setting the pixel value greater than 0 in the tumor CT image to 0, and setting the pixel value less than -1200 in the tumor CT image to -1200 , Other pixels remain unchanged, that is, the pixel values of tumor CT images are normalized to the numerical range of [0, -1200] to exclude most of the non-tumor areas in tumor CT images.
步骤S25,基于keras框架构建3D Unet网络模型。本领域技术人员可知,所述Keras框架是一个基于深度学习神经网路的Python API,采用Python语言编写,是一个高度模块化的神经网络库。在本实施例中,所述3D Unet网络模型由输入层、输出层、3D卷积层、批正则化层、激活层、反卷积层和最大池化层构成,输入层大小为96×96×32,该模型有3层降采样(最大池化层)、3层上采样(反卷积层),输出层大小为96×96×32。Step S25, build a 3D Unet network model based on the keras framework. Those skilled in the art can know that the Keras framework is a Python API based on deep learning neural networks, written in Python language, and is a highly modular neural network library. In this embodiment, the 3D Unet network model is composed of an input layer, an output layer, a 3D convolution layer, a batch regularization layer, an activation layer, a deconvolution layer, and a maximum pooling layer. The input layer size is 96×96 ×32, the model has 3 layers of downsampling (maximum pooling layer), 3 layers of upsampling (deconvolution layer), and the output layer size is 96×96×32.
步骤S26,采用Adam优化器对3D Unet网络模型各层的参数进行优化,并采用DiceLoss损失函数对3D Unet网络模型产生的损失进行评估。本领域技术人员可知,所述Adam优化器是随机梯度下降优化算法的扩展式,广泛用于深度学习神经网路应用中,尤其是计算机视觉和自然语言处理等任务。所述DiceLoss损失函数是一种将dice系数作为损失函数,在使用深度学习做医学图像分割时对损失进行评估的网络模型。In step S26, the Adam optimizer is used to optimize the parameters of each layer of the 3D Unet network model, and the DiceLoss loss function is used to evaluate the loss generated by the 3D Unet network model. Those skilled in the art can know that the Adam optimizer is an extension of the stochastic gradient descent optimization algorithm, and is widely used in deep learning neural network applications, especially tasks such as computer vision and natural language processing. The DiceLoss loss function is a network model that uses the dice coefficient as the loss function to evaluate the loss when using deep learning for medical image segmentation.
步骤S27,利用训练数据集对3D Unet网络模型进行训练得到3D Unet网络模型的权重。在本实施例中,将训练数据集的肿瘤CT影像和mask肿瘤区域标注按照预设的数据量输入3D Unet网络模型进行训练,例如,将每轮输入的数据量大小(batchsize)设为12批,总共轮数(epoch)设置为200轮;每一轮训练3D Unet网络模型均会产生权重,保存3D Unet网络模型的最低损失(loss)的权重,得到最优化的3D Unet网络模型。Step S27: Use the training data set to train the 3D Unet network model to obtain the weight of the 3D Unet network model. In this embodiment, the tumor CT images and mask tumor area annotations of the training data set are input into 3D according to the preset data amount. Unet network model training, for example, set the input data size (batchsize) of each round to 12 batches, and the total number of rounds (epoch) is set to 200 rounds; each round of training 3D Unet network model will generate weights and save 3D The weight of the lowest loss (loss) of the Unet network model obtains the optimized 3D Unet network model.
步骤S28,利用验证数据集对3D Unet网络模型的有效性进行验证,以验证构建出的3D Unet网络模型是否可以作为后续有效并且准确地检测出肿瘤区域。在本实施例中,将验证数据集的肿瘤CT影像输入3D Unet网络模型输出肿瘤区域的mask标注,并将输出的肿瘤区域的mask标注与验证数据集中的mask肿瘤区域标注进行比较,若两者基本相同,则表明构建了有效的3D Unet网络模型有效,可作为后续肿瘤检测;若两者相差较大,则表明构建出的3D Unet网络模型无效,需重新构建有效的3D Unet网络模型。In step S28, the validity of the 3D Unet network model is verified by using the verification data set to verify whether the constructed 3D Unet network model can be used as a follow-up effective and accurate detection of the tumor area. In this embodiment, the tumor CT image of the verification data set is input into the 3D Unet network model to output the mask label of the tumor area, and the output mask label of the tumor area is compared with the mask tumor area label in the verification data set. If both Basically the same, it indicates that the constructed 3D Unet network model is effective and can be used as follow-up tumor detection; if the difference between the two is large, it indicates that the constructed 3D The Unet network model is invalid, and a valid 3D Unet network model needs to be reconstructed.
步骤S29,从影像扫描设备3获取待检测的CT影像,并将待检测的CT影像输入至3D Unet网络模型进行检测,进而检测出各种不规则的肿瘤病灶区域,并将肿瘤病灶区域显示在显示器13上,从而有助于供医生对肿瘤术前辅助放化疗方案的制定,以及术后放化疗疗效果的评估提供更加全面的医学指导。Step S29: Obtain the CT image to be detected from the image scanning device 3, and input the CT image to be detected into the 3D Unet network model for detection, and then detect various irregular tumor lesion areas, and display the tumor lesion area in The display 13 is thus helpful for doctors to provide more comprehensive medical guidance for the formulation of preoperative adjuvant radiotherapy and chemotherapy programs for tumors and the evaluation of the effects of postoperative radiotherapy and chemotherapy.
本发明还一种计算机可读存储介质,该计算机可读存储介质存储多条计算机程序指令,所述计算机程序指令由计算机装置的处理器加载并执行本发明所述用于检测肿瘤的3D UNet网络模型构建方法的各个步骤。本领域技术人员可以理解,上述实施方式中各种方法的全部或部分步骤可以通过相关程序指令完成,该程序可以存储于计算机可读存储介质中,存储介质可以包括:只读存储器、随机存储器、磁盘或光盘等。The present invention also provides a computer-readable storage medium that stores a plurality of computer program instructions, and the computer program instructions are loaded by a processor of a computer device and execute the 3D method for detecting tumors of the present invention. The steps of the UNet network model construction method. Those skilled in the art can understand that all or part of the steps of the various methods in the foregoing embodiments can be completed by related program instructions. The program can be stored in a computer-readable storage medium. The storage medium may include: read-only memory, random access memory, Disk or CD, etc.
本发明所述用于检测肿瘤的3D UNet网络模型构建方法、装置及计算机可读存储介质能够构建出肿瘤精准分割的3D UNet网络模型,通过该3D UNet网络模型有效分割各种不规则的肿瘤区域,提高肿瘤检测准确度和速度,且肿瘤检测的有效性不受限于个体肺部形态差异,从而快速、准确地定位肿瘤位置,为医生对肿瘤的诊断治疗提供医学指导。The 3D UNet network model construction method, device and computer-readable storage medium for detecting tumors of the present invention can construct 3D precise tumor segmentation UNet network model, through the 3D UNet network model to effectively segment various irregular tumor regions, improve the accuracy and speed of tumor detection, and the effectiveness of tumor detection is not limited to individual lung morphological differences, so as to quickly and accurately locate Tumor location provides medical guidance for doctors on tumor diagnosis and treatment.
以上仅为本发明的较佳实施例,并非因此限制本发明的专利范围,凡是利用本发明说明书及附图内容所作的等效结构或等效流程变换,或直接或间接运用在其他相关的技术领域,均同理包括在本发明的专利保护范围内。The above are only preferred embodiments of the present invention, and do not limit the scope of the present invention. Any equivalent structure or equivalent process transformation made by using the contents of the description and drawings of the present invention, or directly or indirectly applied to other related technologies In the same way, all fields are included in the scope of patent protection of the present invention.
工业实用性Industrial applicability
相较于现有技术,本发明所述用于检测肿瘤的3D UNet网络模型构建方法、装置及计算机可读存储介质能够构建出肿瘤精准分割的3D UNet网络模型,通过该3D UNet网络模型有效分割各种不规则的肿瘤区域,提高肿瘤检测准确度和速度,且肿瘤检测的有效性不受限于个体肺部形态差异,从而快速、准确地定位肿瘤位置,为医生对肿瘤的诊断治疗提供医学指导。Compared with the prior art, the 3D UNet network model construction method, device and computer-readable storage medium for detecting tumors of the present invention can construct 3D accurate tumor segmentation UNet network model, through the 3D UNet network model to effectively segment various irregular tumor regions, improve the accuracy and speed of tumor detection, and the effectiveness of tumor detection is not limited to individual lung morphological differences, so as to quickly and accurately locate Tumor location provides medical guidance for doctors on tumor diagnosis and treatment.

Claims (10)

  1. 一种用于检测肿瘤的3D UNet网络模型构建方法,其特征在于,该方法包括如下步骤:A method for constructing a 3D UNet network model for tumor detection is characterized in that the method includes the following steps:
    从医疗影像数据库获取LIDC数据集,该LIDC数据集包括肿瘤CT影像和xml格式的肿瘤区域标注;Obtain the LIDC data set from the medical imaging database, the LIDC data set includes tumor CT images and tumor area annotations in xml format;
    将xml格式的肿瘤区域标注转化为mask肿瘤区域标注;Convert the tumor area annotation in xml format into mask tumor area annotation;
    将转化后的LIDC数据集划分为训练数据集和验证数据集;Divide the transformed LIDC data set into training data set and validation data set;
    将训练数据集和验证数据集进行预处理,并将肿瘤CT影像的像素值归一化处理;Preprocess the training data set and validation data set, and normalize the pixel values of tumor CT images;
    基于keras框架构建3D Unet网络模型;Build a 3D Unet network model based on the keras framework;
    利用训练数据集对构建出的3D Unet网络模型进行训练得到3D Unet网络模型的权重;3D constructed using training data set pairs The Unet network model is trained to obtain the weight of the 3D Unet network model;
    利用验证数据集对构建出的3D Unet网络模型的有效性进行验证。The 3D constructed using the verification data set The validity of the Unet network model is verified.
  2. 如权利要求1所述的用于检测肿瘤的3D UNet网络模型构建方法,其特征在于,所述对训练数据集和验证数据集进行预处理的步骤包括:The 3D UNet network model construction method for tumor detection according to claim 1, wherein the step of preprocessing the training data set and the verification data set comprises:
    对训练数据集和验证数据集中像素点之间的间隔均置为1,使输入3D Unet网络模型的数据拥有统一的间隔;Set the interval between the pixels in the training data set and the verification data set to 1, so that the data input to the 3D Unet network model has a uniform interval;
    针对训练数据集中的肿瘤CT影像和mask肿瘤区域标注均执行如下步骤:获取mask肿瘤区域标注的中心点,以该中心点作为96×96×32矩阵的中心点,按照96×96×32大小对肿瘤区域进行随机裁剪,随机放大缩小,随机旋转角度,随机上下左右翻转,生成多样化的训练数据;For the tumor CT images and mask tumor region annotations in the training data set, the following steps are performed: Obtain the center point of the mask tumor region annotation, and use the center point as the center point of the 96×96×32 matrix, according to the size of 96×96×32 Randomly crop the tumor area, randomly zoom in and out, randomly rotate the angle, and randomly flip up and down to generate diverse training data;
    针对验证数据集的肿瘤CT影像和mask肿瘤区域标注均执行如下步骤:获取mask肿瘤区域的中心点,以该中心点作为96×96×32矩阵的中心点,按照96×96×32大小对肿瘤区域进行裁剪,并保存裁剪得到的肿瘤CT影像和mask肿瘤区域。For the tumor CT image and mask tumor area annotation of the validation data set, the following steps are performed: Obtain the center point of the mask tumor area, and use the center point as the center point of the 96×96×32 matrix, and the tumor according to the size of 96×96×32 The area is cropped, and the cropped tumor CT image and mask tumor area are saved.
  3. 如权利要求2所述的用于检测肿瘤的3D UNet网络模型构建方法,其特征在于,所述将肿瘤CT影像的像素值归一化处理的步骤包括:The method for constructing a 3D UNet network model for detecting tumors according to claim 2, wherein the step of normalizing the pixel values of CT images of tumors comprises:
    将肿瘤CT影像中大于0的像素值置为0,将肿瘤CT影像中小于-1200像素值置为-1200,其它像素置不变,进而将肿瘤CT影像的像素值归一化到[0,-1200]这个数值区间,以排除肿瘤CT影像中的非肿瘤区域。Set the pixel value greater than 0 in the tumor CT image to 0, set the pixel value less than -1200 in the tumor CT image to -1200, and leave the other pixels unchanged, and then normalize the pixel value of the tumor CT image to [0, -1200] This numerical interval is used to exclude non-tumor areas in tumor CT images.
  4. 如权利要求1所述的用于检测肿瘤的3D UNet网络模型构建方法,其特征在于,所述mask肿瘤区域标注的大小和肿瘤CT影像的大小相同,将肿瘤CT影像中的肿瘤区域的像素值置为1,非肿瘤区域的像素值置为0,从而构成mask矩阵格式的mask肿瘤区域标注。The method for constructing a 3D UNet network model for detecting tumors according to claim 1, wherein the size of the mask tumor area annotation is the same as the tumor CT image size, and the pixel value of the tumor area in the tumor CT image Set to 1, the pixel value of the non-tumor area is set to 0, thereby forming the mask tumor area label in the mask matrix format.
  5. 如权利要求1所述的用于检测肿瘤的3D UNet网络模型构建方法,其特征在于,所述LIDC数据集按照训练数据集与验证数据集的比例为9:1划分为多个训练数据集和多个验证数据集,每个训练数据集和每个验证数据集均包括一个肿瘤CT影像及一个对应的mask肿瘤区域标注。The method for constructing a 3D UNet network model for tumor detection according to claim 1, wherein the LIDC data set is divided into a plurality of training data sets and a training data set according to the ratio of the training data set to the verification data set of 9:1. Multiple verification data sets, each training data set and each verification data set include a tumor CT image and a corresponding mask tumor area annotation.
  6. 如权利要求1所述的用于检测肿瘤的3D UNet网络模型构建方法,其特征在于,所述3D Unet网络模型由输入层、输出层、3D卷积层、批正则化层、激活层、反卷积层和最大池化层构成,其中,所述输入层大小为96×96×32,所述模型最大池化层由3层降采样构成、所述反卷积层由3层上采样构成,所述输出层大小为96×96×32。The method for constructing a 3D UNet network model for tumor detection according to claim 1, wherein the 3D Unet network model is composed of an input layer, an output layer, a 3D convolution layer, a batch regularization layer, an activation layer, and an inverse layer. The convolutional layer and the maximum pooling layer are composed of, wherein the input layer size is 96×96×32, the model maximum pooling layer is composed of 3 layers of downsampling, and the deconvolution layer is composed of 3 layers of upsampling , The size of the output layer is 96×96×32.
  7. 如权利要求1所述的用于检测肿瘤的3D UNet网络模型构建方法,其特征在于,该方法还包括如下步骤:The method for constructing a 3D UNet network model for tumor detection according to claim 1, wherein the method further comprises the following steps:
    采用Adam优化器对3D Unet网络模型各层的参数进行优化;Use Adam optimizer to optimize the parameters of each layer of the 3D Unet network model;
    采用DiceLoss损失函数对3D Unet网络模型产生的损失进行评估。The DiceLoss loss function is used to evaluate the loss generated by the 3D Unet network model.
  8. 如权利要求1所述的用于检测肿瘤的3D UNet网络模型构建方法,其特征在于,该方法还包括如下步骤:The method for constructing a 3D UNet network model for tumor detection according to claim 1, wherein the method further comprises the following steps:
    从影像扫描设备获取待检测的CT影像;Obtain CT images to be detected from image scanning equipment;
    将待检测的CT影像输入至3D Unet网络模型进行检测以检测出各种不规则的肿瘤病灶区域,并将肿瘤病灶区域显示在显示器上。Input the CT image to be detected into the 3D Unet network model for detection to detect various irregular tumor lesion areas, and display the tumor lesion area on the display.
  9. 一种用于检测肿瘤的3D UNet网络模型构建装置,包括适于实现各种计算机程序指令的处理器以及适于存储多条计算机程序指令的存储器,其特征在于,所述计算机程序指令由处理器加载并执行如权利要求1至8任一项所述用于检测肿瘤的3D UNet网络模型构建方法的各项方法步骤。A 3D UNet network model construction device for detecting tumors, comprising a processor suitable for realizing various computer program instructions and a memory suitable for storing multiple computer program instructions, characterized in that the computer program instructions are executed by the processor Load and execute each method step of the 3D UNet network model construction method for tumor detection according to any one of claims 1 to 8.
  10. 一种计算机可读存储介质,该计算机可读存储介质存储多条计算机程序指令,其特征在于,所述计算机程序指令由计算机装置的处理器加载并执行如权利要求1至8任一项所述用于检测肿瘤的3D UNet网络模型构建方法的各项方法步骤。A computer-readable storage medium storing a plurality of computer program instructions, wherein the computer program instructions are loaded by a processor of a computer device and executed as described in any one of claims 1 to 8 Various method steps of the 3D UNet network model construction method for detecting tumors.
PCT/CN2019/117323 2019-05-31 2019-11-12 Method and device for constructing 3d unet network model for tumor detection, and storage medium WO2020238044A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
CN201910470150.1 2019-05-31
CN201910470150.1A CN112102221A (en) 2019-05-31 2019-05-31 3D UNet network model construction method and device for detecting tumor and storage medium

Publications (1)

Publication Number Publication Date
WO2020238044A1 true WO2020238044A1 (en) 2020-12-03

Family

ID=73553458

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/CN2019/117323 WO2020238044A1 (en) 2019-05-31 2019-11-12 Method and device for constructing 3d unet network model for tumor detection, and storage medium

Country Status (2)

Country Link
CN (1) CN112102221A (en)
WO (1) WO2020238044A1 (en)

Cited By (11)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112967295A (en) * 2021-03-10 2021-06-15 中国科学院深圳先进技术研究院 Image processing method and system based on residual error network and attention mechanism
CN113284093A (en) * 2021-04-29 2021-08-20 安徽省皖北煤电集团有限责任公司 Satellite image cloud detection method based on improved D-LinkNet
CN113379735A (en) * 2021-07-09 2021-09-10 中山大学 Method and system for labeling contents in CT colon image
CN113689419A (en) * 2021-09-03 2021-11-23 电子科技大学长三角研究院(衢州) Image segmentation processing method based on artificial intelligence
CN113724266A (en) * 2021-07-26 2021-11-30 山东师范大学 Glioma segmentation method and system
CN113838020A (en) * 2021-09-17 2021-12-24 上海仰和华健人工智能科技有限公司 Molybdenum target image-based lesion area quantification method
CN114022491A (en) * 2021-10-27 2022-02-08 安徽医科大学 Small data set esophageal cancer target area image automatic delineation method based on improved spatial pyramid model
CN114708255A (en) * 2022-04-29 2022-07-05 浙江大学 Multi-center children X-ray chest image lung segmentation method based on TransUNet model
CN115131345A (en) * 2022-08-29 2022-09-30 杭州堃博生物科技有限公司 CT image-based focus detection method and device and computer-readable storage medium
CN115953393A (en) * 2023-03-10 2023-04-11 济南市人民医院 Intracranial aneurysm detection system, equipment and storage medium based on multitask learning
CN116109605A (en) * 2023-02-13 2023-05-12 北京医智影科技有限公司 Medical image tumor segmentation system, training set construction method and model training method

Families Citing this family (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112991266A (en) * 2021-02-07 2021-06-18 复旦大学 Semantic segmentation method and system for small sample medical image
CN113017670A (en) * 2021-03-01 2021-06-25 北京小白世纪网络科技有限公司 Mediastinal lump identification method and device based on 3D UNet and storage medium
CN113628325B (en) * 2021-08-10 2024-03-26 海盐县南北湖医学人工智能研究院 Model building method for small organ tumor evolution and computer readable storage medium
CN113706539A (en) * 2021-10-29 2021-11-26 南京裕隆生物医学发展有限公司 Artificial intelligence auxiliary system for identifying tumors
CN116386043A (en) * 2023-03-27 2023-07-04 北京市神经外科研究所 Method and system for rapidly marking glioma area of brain nerve medical image

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018140596A2 (en) * 2017-01-27 2018-08-02 Arterys Inc. Automated segmentation utilizing fully convolutional networks
CN108765408A (en) * 2018-05-31 2018-11-06 杭州同绘科技有限公司 Build the method in cancer pathology image virtual case library and the multiple dimensioned cancer detection system based on convolutional neural networks
WO2018222755A1 (en) * 2017-05-30 2018-12-06 Arterys Inc. Automated lesion detection, segmentation, and longitudinal identification
CN109685776A (en) * 2018-12-12 2019-04-26 华中科技大学 A kind of pulmonary nodule detection method based on ct images and system

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2018140596A2 (en) * 2017-01-27 2018-08-02 Arterys Inc. Automated segmentation utilizing fully convolutional networks
WO2018222755A1 (en) * 2017-05-30 2018-12-06 Arterys Inc. Automated lesion detection, segmentation, and longitudinal identification
CN108765408A (en) * 2018-05-31 2018-11-06 杭州同绘科技有限公司 Build the method in cancer pathology image virtual case library and the multiple dimensioned cancer detection system based on convolutional neural networks
CN109685776A (en) * 2018-12-12 2019-04-26 华中科技大学 A kind of pulmonary nodule detection method based on ct images and system

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN112967295A (en) * 2021-03-10 2021-06-15 中国科学院深圳先进技术研究院 Image processing method and system based on residual error network and attention mechanism
CN112967295B (en) * 2021-03-10 2024-04-05 中国科学院深圳先进技术研究院 Image processing method and system based on residual network and attention mechanism
CN113284093A (en) * 2021-04-29 2021-08-20 安徽省皖北煤电集团有限责任公司 Satellite image cloud detection method based on improved D-LinkNet
CN113379735B (en) * 2021-07-09 2023-05-12 中山大学 Labeling method and system for CT colon image content
CN113379735A (en) * 2021-07-09 2021-09-10 中山大学 Method and system for labeling contents in CT colon image
CN113724266A (en) * 2021-07-26 2021-11-30 山东师范大学 Glioma segmentation method and system
CN113724266B (en) * 2021-07-26 2022-12-20 山东师范大学 Glioma segmentation method and system
CN113689419A (en) * 2021-09-03 2021-11-23 电子科技大学长三角研究院(衢州) Image segmentation processing method based on artificial intelligence
CN113838020A (en) * 2021-09-17 2021-12-24 上海仰和华健人工智能科技有限公司 Molybdenum target image-based lesion area quantification method
CN114022491A (en) * 2021-10-27 2022-02-08 安徽医科大学 Small data set esophageal cancer target area image automatic delineation method based on improved spatial pyramid model
CN114708255A (en) * 2022-04-29 2022-07-05 浙江大学 Multi-center children X-ray chest image lung segmentation method based on TransUNet model
CN114708255B (en) * 2022-04-29 2022-11-01 浙江大学 Multi-center children X-ray chest image lung segmentation method based on TransUNet model
CN115131345A (en) * 2022-08-29 2022-09-30 杭州堃博生物科技有限公司 CT image-based focus detection method and device and computer-readable storage medium
CN115131345B (en) * 2022-08-29 2023-02-03 杭州堃博生物科技有限公司 CT image-based focus detection method and device and computer-readable storage medium
CN116109605A (en) * 2023-02-13 2023-05-12 北京医智影科技有限公司 Medical image tumor segmentation system, training set construction method and model training method
CN116109605B (en) * 2023-02-13 2024-04-02 北京医智影科技有限公司 Medical image tumor segmentation system, training set construction method and model training method
CN115953393A (en) * 2023-03-10 2023-04-11 济南市人民医院 Intracranial aneurysm detection system, equipment and storage medium based on multitask learning

Also Published As

Publication number Publication date
CN112102221A (en) 2020-12-18

Similar Documents

Publication Publication Date Title
WO2020238044A1 (en) Method and device for constructing 3d unet network model for tumor detection, and storage medium
Tran et al. Computational radiology in breast cancer screening and diagnosis using artificial intelligence
CN111047609B (en) Pneumonia focus segmentation method and device
CN110969245B (en) Target detection model training method and device for medical image
JP2019530488A (en) Computer-aided diagnostic system for medical images using deep convolutional neural networks
WO2021073120A1 (en) Method and device for marking lung area shadows in medical image, server, and storage medium
WO2022089257A1 (en) Medical image processing method, apparatus, device, storage medium, and product
WO2020238043A1 (en) Unet network-based lung lobe segmentation method and apparatus, computer readable storage medium
WO2021169126A1 (en) Lesion classification model training method and apparatus, computer device, and storage medium
US11094059B2 (en) Vulnerable plaque identification method, application server thereof, and computer readable medium
CN114092475B (en) Focal length determining method, image labeling method, device and computer equipment
CN111667474A (en) Fracture identification method, apparatus, device and computer readable storage medium
CN111275707A (en) Pneumonia focus segmentation method and device
CN110570425B (en) Pulmonary nodule analysis method and device based on deep reinforcement learning algorithm
CN114092465A (en) Lung cancer auxiliary diagnosis and treatment system and method based on deep learning
CN113888566A (en) Target contour curve determining method and device, electronic equipment and storage medium
WO2020137092A1 (en) Region identification device, method, and program
CN115578370B (en) Brain image-based metabolic region abnormality detection method and device
CN114240935B (en) Space-frequency domain feature fusion medical image feature identification method and device
CN117045273B (en) CT scanning radiation dose determination method, device, equipment and storage medium
WO2023158118A1 (en) Method for classifying uric acid content of urinary stone by using radiomics parameter of computed tomography image, and analysis device therefor
CN112950582B (en) 3D lung focus segmentation method and device based on deep learning
US20220405916A1 (en) Method for detecting the presence of pneumonia area in medical images of patients, detecting system, and electronic device employing method
Jan et al. Automated patient localization in challenging hospital environments
CN116824610A (en) Fetal heart monitoring data input method, fetal heart monitoring data input device, computer equipment and storage medium

Legal Events

Date Code Title Description
121 Ep: the epo has been informed by wipo that ep was designated in this application

Ref document number: 19930326

Country of ref document: EP

Kind code of ref document: A1

NENP Non-entry into the national phase

Ref country code: DE

122 Ep: pct application non-entry in european phase

Ref document number: 19930326

Country of ref document: EP

Kind code of ref document: A1