CN111709953B - Output method and device in lung lobe segment segmentation of CT (computed tomography) image - Google Patents
Output method and device in lung lobe segment segmentation of CT (computed tomography) image Download PDFInfo
- Publication number
- CN111709953B CN111709953B CN202010540968.9A CN202010540968A CN111709953B CN 111709953 B CN111709953 B CN 111709953B CN 202010540968 A CN202010540968 A CN 202010540968A CN 111709953 B CN111709953 B CN 111709953B
- Authority
- CN
- China
- Prior art keywords
- lung
- segmentation
- image
- blood vessel
- lobe
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/04—Architecture, e.g. interconnection topology
- G06N3/045—Combinations of networks
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06N—COMPUTING ARRANGEMENTS BASED ON SPECIFIC COMPUTATIONAL MODELS
- G06N3/00—Computing arrangements based on biological models
- G06N3/02—Neural networks
- G06N3/08—Learning methods
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T17/00—Three dimensional [3D] modelling, e.g. data description of 3D objects
- G06T17/005—Tree description, e.g. octree, quadtree
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/187—Segmentation; Edge detection involving region growing; involving region merging; involving connected component labelling
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30061—Lung
Abstract
The invention relates to a method, a device, a system, a storage medium and equipment for segmenting lung lobe segments of a CT image, wherein the method comprises the following steps: detecting, namely detecting and outputting a lung contour in the CT image, wherein the lung contour comprises an intrapulmonary area and an extrapulmonary area; a screening step, in the lung contour, selecting a machine segmentation mode to screen out an area in the lung, and taking the area as a candidate area; a segmentation step, in a 3D layer of the candidate region, simultaneously performing blood vessel segmentation and lung fissure segmentation on the lung segment and the lung lobe; a construction step, namely constructing a blood vessel tree according to a blood vessel segmentation result to obtain three-dimensional blood vessel distribution of the lung; and an integration step, namely combining the blood vessel tree and the lung fissure segmentation result, and performing lung lobe segmentation to obtain a final segmentation result of the candidate region. The method, the device, the system, the storage medium and the equipment for segmenting the lung lobe sections of the CT image based on the deep learning effectively reduce errors and improve the diagnosis rate and the accuracy rate, and are not limited by individual lung morphological differences.
Description
The application is a divisional application of Chinese invention patent application with the application number of 201711070729.6, the application date of 2017, 11 and 03, and the invention and creation name of a method and a device for segmenting lung lobe sections of CT images based on deep learning.
Technical Field
The present invention relates to the field of image segmentation, and in particular, to a method, an apparatus, a system, a storage medium, and a device for segmenting lung lobe segments of CT images.
Background
Currently, lung cancer is the cancer with the highest mortality rate among all cancers. The lung nodules are image representation forms of lung cancer, are represented by shadows with increased density in CT imaging, and have important significance for early screening and evaluation of the lung cancer through detection and segmentation of the lung nodules in lung lobes and lung segments in the CT images. In the existing detection, 3D CT (Emmenlauer, m., etc.: free, fast and reliable fixing of large 3D databases, J microscopi, 233, no.1, pp.42-60, 2009) has a large image data volume and large individual difference, which brings certain difficulty to the segmentation technology of the lung lobes and the lung segments.
Unlike generalized computer vision technology applications, in order to reduce the complexity of Deep Convolutional Neural Network (DCNN) computation and efficiently utilize limited training data, the prior art employs segmentation combining medical background information with deep learning, e.g., 1) the best technique for segmenting lung lobes and lung segments today is a progressive segmentation method (k.hayashi, etc.: "Radiographics and CT apparants of the major fisurs," Radiographics, vol.21, no.4, pp.861-874, 2001 "), first detect and locate the lung contour, then segment the lung lobes by means of deep learning (s.hu, etc.: "Automatic segmentation for acquisition of volumetric X-ray CT images," IEEE trans. Med.image., vol.20, no.6, pp.490-498, jun.2001 "), segmenting a lung segment by characterizing its point coordinates (e.m. van rikxort, etc.: "Supervised enhancing filters: application to firm detection in chest CT scanners, "IEEE trans. Med. Imag., vol.27, no.1, pp.1-10, jan.2008"). This approach ignores the difference in lung structure between different patients, with uncertainty in the detection results (I.C. Sluimer, etc.: for "duration automated segmentation of the clinical Lung in CT," IEEE trans. Med. Imag., vol.24, no.8, pp.1025-1038, aug.2005.). 2) A water-wash deformation is established by analysis of the trachea and vessels, which works well for visible fissures but poorly for partially invisible columnar segmentations (e.van Rikxoort, etc.: "IEEE Transactions on Medical Imaging, vol.29, no.6, pp.1286-1296, 2010."). The methods are tested on a large amount of data, and the segmentation effect is poor.
Chinese patent document CN103035009A discloses a reconstruction and segmentation method based on CT image pulmonary nodule edges, which first performs spatial transformation on an image by using a transformation mode having sparse representation capability on gradient features; and then establishing a CT image segmentation algorithm evaluation system, mainly amplifying edge information and reconstructing the edges of the lung nodules.
Although the above patent improves the accuracy of the detection and segmentation of the pulmonary nodule edge in the CT image, before the detection of the edge of the image is started, the detection needs to be compared with an initially set threshold value, and the detection can be started only when the condition is met, otherwise, the image needs to be reprocessed.
As a latest technology LDCT (low-dose helical CT) for Screening Lung cancer, the LDCT radiation dose is lower, is reduced by 75-90% compared with the conventional CT dose, does not influence Lung imaging, has the sensitivity of CT, and has the advantages that after the diagnosis rate of early Lung cancer can be improved by LDCT and the death rate of Lung cancer is effectively reduced by data of National Lung Screening Trial (NLST) in 2011, all clinical researches related to Lung cancer Screening give out results of revivifying people successively, and the application of LDCT in Lung cancer Screening is effectively popularized. Therefore, how to fully activate and utilize the nearly silence stored large data of the breast LDCT is one of the problems that those skilled in the art need to solve.
In summary, one of the problems to be solved by those skilled in the art is how to improve the accuracy and precision of detecting and segmenting lung nodules in CT images, and how to fully utilize and activate the big data of CT images.
Disclosure of Invention
In order to solve the above problems, the present invention provides a method, an apparatus, a system, a storage medium and a device for segmenting a lung lobe segment of a CT image based on deep learning.
In order to achieve the above object, a first aspect of the present invention provides a method for segmenting lung segments of a CT image, the method comprising the steps of:
detecting, namely detecting and outputting a lung contour in the CT image, wherein the lung contour comprises an intra-lung region and an extra-lung region;
screening, namely screening out an area in the lung by selecting a machine segmentation mode in the lung contour, and taking the area in the lung as a candidate area;
a segmentation step, in a 3D layer of the candidate region, simultaneously performing blood vessel segmentation and lung lobe segmentation on the lung segment and the lung lobe;
a construction step, namely constructing a blood vessel tree according to a blood vessel segmentation result to obtain three-dimensional blood vessel distribution of the lung;
and an integration step, combining the vessel tree and the lung fissure segmentation result by adopting a lung lobe segmentation algorithm, and performing lung lobe segmentation to obtain a final segmentation result of the candidate region.
Furthermore, in the detection step, the FCN network which takes the multilayer convolution layer as a main structure is adopted for detection and output.
Specifically, in the segmentation step, the 3D U-net is adopted to perform the blood vessel segmentation and the lung lobe segmentation on the lung section and the lung lobe respectively along two branches.
Further, in the constructing step, the trachea distribution is deduced according to the three-dimensional blood vessel distribution, so that the bronchial tree is obtained.
Specifically, in the integration step, the lung lobe segmentation algorithm integrates the vessel tree and the lung fissure segmentation result by inputting the lung lobe classification model, and outputs the final segmentation result.
The invention provides a lung lobe segment segmentation device based on CT image in second aspect, the device includes:
the detection module is used for detecting and outputting a lung contour in the CT image, wherein the lung contour comprises an intra-lung region and an extra-lung region;
the screening module is used for screening out the area in the lung in a machine segmentation mode in the lung contour, and taking the area in the lung as a candidate area;
the segmentation module is used for simultaneously performing blood vessel segmentation and lung fissure segmentation on the lung segment and the lung lobe in a 3D layer of the candidate region;
the construction module is used for constructing a blood vessel tree according to the blood vessel segmentation result to obtain the three-dimensional blood vessel distribution of the lung;
and the integration module is used for combining the blood vessel tree and the lung fissure segmentation result by adopting a lung lobe segmentation algorithm, and performing lung lobe segmentation to obtain a final segmentation result of the candidate region.
Furthermore, the detection module adopts the FCN network which takes the multilayer convolution layer as a main structure to carry out detection and output.
Specifically, in the segmentation module, the 3D U-net is adopted to perform blood vessel segmentation and lung fissure segmentation on the lung segment and the lung lobe along two branches respectively.
Further, in the construction module, the trachea distribution is deduced according to the three-dimensional blood vessel distribution, and the bronchial tree is obtained.
Specifically, in the integration module, the lung lobe segmentation algorithm integrates the vessel tree and the lung fissure segmentation result by inputting the lung lobe classification model, and outputs the final segmentation result.
The invention provides a system for realizing the segmentation of the lung lobe segment based on the CT image in a third aspect, which comprises the lung lobe segment segmentation device based on the CT image in any one of the second aspect.
A fourth aspect of the present invention provides a non-volatile storage medium having instructions stored therein, which when executed, cause a processor to perform a method for CT image-based lung segment segmentation, the instructions comprising:
detecting and outputting a lung contour in the CT image, wherein the lung contour comprises an intrapulmonary area and an extrapulmonary area;
screening instructions, selecting a machine segmentation mode to screen out an area in the lung contour, and taking the area in the lung as a candidate area;
a segmentation instruction, which is used for simultaneously carrying out blood vessel segmentation and lung fissure segmentation on the lung segment and the lung lobe in a 3D layer of the candidate region;
constructing an instruction, namely constructing a blood vessel tree according to a blood vessel segmentation result to obtain the three-dimensional blood vessel distribution of the lung;
and integrating the instruction, combining the blood vessel tree and the lung fissure segmentation result by adopting a lung lobe segmentation algorithm, and segmenting the lung lobes to obtain a final segmentation result of the candidate region.
A fifth aspect of the invention provides an apparatus comprising a memory storing computer executable instructions and a processor configured to execute the instructions to perform a process for CT image based segmentation of lung lobes, the process comprising:
detecting, namely detecting and outputting a lung contour in the CT image, wherein the lung contour comprises an intrapulmonary area and an extrapulmonary area;
a screening step, in the lung contour, selecting a machine segmentation mode to screen out an area in the lung, and taking the area in the lung as a candidate area;
a segmentation step, in a 3D layer of the candidate region, simultaneously performing blood vessel segmentation and lung fissure segmentation on the lung segment and the lung lobe;
a construction step, namely constructing a blood vessel tree according to a blood vessel segmentation result to obtain three-dimensional blood vessel distribution of the lung;
and an integration step, combining the vessel tree and the lung fissure segmentation result by adopting a lung lobe segmentation algorithm, and performing lung lobe segmentation to obtain a final segmentation result of the candidate region.
The invention provides a CT image lung lobe segment segmentation method, a device, a system, a storage medium and equipment, which adopt a plurality of layers of convolution layers as an FCN network of a main body structure to accurately detect and output a lung contour in a CT image; secondly, screening candidate regions and selecting 3D U-net expansion to carry out blood vessel segmentation and lung fissure segmentation on lung sections and lung lobes, constructing a blood vessel tree according to a blood vessel segmentation result, and deducing the distribution condition of the trachea according to three-dimensional blood vessel distribution; the method can efficiently control the precision and speed of the segmentation process, the accuracy of the finally obtained segmentation result is high, errors which are easy to exist in the traditional segmentation mode are greatly reduced, the diagnosis rate is improved, and the method is not limited by individual lung morphological differences.
Drawings
Fig. 1 is a flowchart of a lung lobe segmentation method based on CT images according to the present invention;
FIG. 2 is a block diagram of a lung lobe segmentation apparatus based on CT image according to the present invention;
fig. 3 is a schematic diagram illustrating a flow of lung lobe segmentation based on a CT image according to the present invention.
Detailed Description
The following description of the embodiments of the present invention is provided for illustrative purposes, and other advantages and effects of the present invention will become apparent to those skilled in the art from the present disclosure. While the invention will be described in conjunction with the preferred embodiments, it is not intended that the features of the invention be limited to that embodiment. Rather, the invention has been described in connection with embodiments thereof for the purpose of covering all alternatives and modifications which may fall within the scope of the invention as defined by the appended claims. In the following description, numerous specific details are included to provide a thorough understanding of the invention. The invention may be practiced without these particulars. Moreover, some of the specific details have been left out of the description in order to avoid obscuring or obscuring the focus of the present invention.
Deep learning is a new area in machine learning research, with the motivation to build, simulate, human brain neural networks for analytical learning, which mimic the mechanisms of the human brain to interpret data such as images, sounds, and text ("what can deep learning be done. The invention provides a CT image lung lobe segmentation method, a device, a system, a storage medium and equipment based on deep learning.
The embodiment of the invention provides a CT image lung lobe segment segmentation method, as shown in fig. 1, the method comprises a detection step 1, a screening step 2, a segmentation step 3, a construction step 4 and an integration step 5. Specifically, in the detection step 1, CT image data is input, and a lung contour in the CT image is detected and output, where the output lung contour includes an intrapulmonary area and an extrapulmonary area; in the screening step 2, the lung contour is input, the lung region is screened out by adopting a machine segmentation mode, and the lung region is used as a candidate region; in the segmentation step 3, performing blood vessel segmentation and lung fissure segmentation on lung segments and lung lobes of the candidate region on a 3D level to obtain blood vessel segmentation and lung fissure segmentation results, wherein the specific format is a three-dimensional lattice which corresponds to a three-dimensional position in the CT image, and each element value in the lattice represents whether the lattice is judged as a blood vessel/lung fissure by a blood vessel/lung fissure algorithm; in the construction step 4, according to the blood vessel segmentation result, a blood vessel tree is constructed to obtain the three-dimensional blood vessel distribution of the lung; in the integration step 5, the vessel tree and the lung fissure segmentation result are combined by adopting a lung lobe segmentation algorithm, and the lung lobe segment is segmented to obtain a final segmentation result of the candidate region. The invention adopts layer-by-layer segmentation, efficiently controls the accuracy and speed of segmentation, improves the segmentation efficiency and is not limited by the individual lung morphological difference.
In recent years, image segmentation techniques based on deep learning (harihanan, b., arbel _ aez, p., girshick, r., malik, j.: hypercolumns for object segmentation and _ ne-quantized localization. In: proc.cvpr.pp.447-456 (2015)) have been extensively used in various international memories, and in general Deep Convolutional Neural Networks (DCNN), several fully connected layers are usually added after the convolutional network so that the features of the convolutional network can be mapped into vectors of fixed length (Io _ e, s., szegdy, c.: batch networking: accurate computing device by reducing the internal coefficients/shifts.67 (1502)), and finally utilized. <xnotran> FCN (Long, J., shelhamer, E., darrell, T.: fully convolutional networks for semantic segmentation.In: proc.CVPR.pp.3431-3440 (2015)) U-net (Ronneberger, O., fischer, P., brox.T.: U-net: convolutional networks for biomedical image segmentation.In: MICCAI.LNCS, vol.9351, pp.234-241.Springer (2015)), (Milletari, F., ahmadi, S., etc.: hough-cnn: deep learning for segmentation of deep brain regions in MRI and ultrasound.CoRR abs/1601.07014 (2016)). FCN , , , (Tran, D., bourdev, L.D., fergus, R., torresani, L., paluri, M.: deep end2end voxel2voxel prediction.CoRR abs/1511.06681 (2015)) (Seyedhosseini, M., sajjadi, M., tasdizen, T.: image segmentation with cascaded hierarchical models and logistic disjunctive normal networks.In: proc.ICCV.pp.2168-2175 (2013)), , . </xnotran> U-net is also one of the more common image segmentation networks, and in medical images, especially lung lobes, lung segment segmentation has great advantages: first, U-net can be converted into 3-D (Fedorov, A., beichel, R., et al: 3D slicer as an image computing platform for the quantitative Imaging network J. Magn Reson Imaging 30 (9), 1323-1341 (2012)) on the image segmentation level (Kleesiek, J., urban, G., hubert, A., schwarz, D., maier-Hein, K., bendszus, M., biller, A.: deep blood circulation: A. D connected volumetric neural work for skin stretching segmentation. Neuro segmentation (2016)), while U-net has shown huge lesions in the medical field, such as detection of retinal products, etc. By using the image segmentation algorithm in the deep learning field, errors can be greatly reduced, and the diagnosis efficiency and accuracy are improved.
Specifically, those skilled in the art will appreciate that the conventional segmentation method is a classical Lung segmentation procedure, i.e. grayscale thresholding, connectivity analysis, left and right Lung separation, morphological closing of high density structures in the Lung, initiated by Hu Shiying et al (Huffman E A, reinhardt J M. Automatic segmentation for obtaining quantification of volume X-ray CT images [ J ]. IEEE Trans on Medical Imaging,2001, 20 (6): 490-498). The flow adopts an iterative threshold optimization method, then the maximum two connected components are searched, and the two connected components are separated by a method of continuous morphological erosion when the lung is adhered, and the method is called as a classical lung segmentation method. In the detection step 1, a full Convolutional Neural Network (FCN) different from a classical segmentation method is adopted, and compared with a traditional method of segmenting a Convolutional Neural Network (CNN) image, the FCN has obvious advantages: (1) Any size of input image can be accepted without requiring all training images and test images to be the same size; (2) More efficient because the problems of repeated storage and computation of convolutions due to the use of pixel blocks are avoided. The invention adopts a mature FCN network for segmentation, wherein a plurality of convolutional layers are used as a main structure of the FCN network, and a traditional neural network full link layer is replaced by the convolutional layers, so that the whole network is ensured to be a full convolutional network structure.
In order to ensure that the resolution of an output result is consistent with that of an input image, the output characteristic diagram of the network is expanded to be consistent with that of the input image through the last several layers of the scrolling layers. In addition, the invention performs retraining or fine-tuning on the lung CT image to improve the segmentation accuracy through the following aspects: (1) Taking a section of the lung CT image in the XY direction (shown in figure 3) as a training image, and marking out an area in the lung as a training label; (2) training data volume: randomly sampling from 10K-magnitude CT to generate a 100K-magnitude CT sectional image; (3) marking accuracy: the training marking error is required to be guaranteed to be within 3 mm; (4) The data volume of a specific CT region (lung apex, septum, extrapulmonary) needs to be guaranteed on a targeted basis; (5) The distribution of specific CT types (different ages, symptoms, CT doses and the like of patients) needs to be ensured so as to output the lung contour efficiently, and the process of the detection step 1 is very fast due to the high similarity of the distribution structure of the human body and the relatively clear lung contour in the CT image.
And then in a screening step 2, selecting a machine segmentation mode to screen out the lung region, wherein the machine segmentation is automatic lung segmentation based on machine learning, and the lung region is used as a candidate region for key screening of subsequent further segmentation, so that the noise is effectively reduced, and the detection speed is accelerated. The machine learning is a multi-field cross subject and relates to a plurality of subjects such as probability theory, statistics, approximation theory, convex analysis and algorithm complexity theory. The special research on how a computer simulates or realizes the learning behavior of human beings so as to acquire new knowledge or skills and reorganize the existing knowledge structure to continuously improve the performance of the computer.
Further, in the segmentation step 3, the lung segment and the lung lobe are respectively subjected to blood vessel segmentation and lung fissure segmentation by adopting 3D U-net along two branch lines. Two of the branches are obtained by screening the candidate region (the lung interior region), i.e. the edges of the candidate region. Those skilled in the art will appreciate that the encoder gradually reduces the spatial dimensions of the pooling layer and the decoder gradually restores the details and spatial dimensions of the object. There is usually a fast connection between the encoder and the decoder, thus helping the decoder to better repair the details of the target. U-Net is the most commonly used structure in this approach. The 3D U-net is a kind of full-convolution deep neural network, and for an implementation of a traditional FCN, a top-down network and a bottom-up network are connected through Skip connection (SKIP connection) to ensure that a final output layer can simultaneously obtain high-order semantics and low-order local texture information. The vessel segmentation and the lung fissure segmentation are segmented by adopting 3D U-net, the two segments adopt the same algorithm framework and network structure, and the difference is that the labeling semantics input in the training process are different, the former needs to label a vessel, and the latter needs to label the lung fissure. The lung segments and the lung lobes are segmented by 3D U-net to obtain the blood vessel distribution in the lung segments and 5 independent spaces (namely the lung lobes) and diaphragms.
Specifically, in the constructing step 4, on the basis of the blood vessel segmentation result, a blood vessel tree is constructed to obtain the three-dimensional blood vessel distribution inside the lung segment, and since the 3D U-net is a 3D segmentation model (as shown in fig. 3), the input is a segmentation result of a 3D space, that is, the confidence of whether each point in the 3D space is a blood vessel. When constructing the blood vessel tree, firstly, the segmentation result is binarized according to a fixed threshold value, smoothing is carried out, then, the maximum connected component of the blood vessel region is worked out through a flood fill algorithm to be used as the constructed blood vessel tree, namely, the final blood vessel segmentation result is produced, and binarization processing is carried out based on the confidence coefficient of a 3D space point to specifically determine where the blood vessel is. According to the anatomical structure in the lung, the trend of pulmonary blood vessels and tracheas in the lung has strong consistency, and blood vessels are often accompanied near the bronchi of all levels of the lung. However, in the lung CT imaging, the pulmonary vessels are more visually significant, so the algorithm is to extract characteristic information such as the distribution and shape of the pulmonary bronchial tree by detecting the vessel tree and obtaining the pulmonary bronchial distribution approximately according to the position of the vessels, so as to be used for information integration in the subsequent steps. The flood fill algorithm is a classic algorithm for extracting a plurality of connected points from one area and distinguishing the connected points from other adjacent areas (or respectively dyeing the connected points into different colors), and is named because the idea of the flood fill algorithm is similar to that of flood water spreading from one area to all reachable areas.
Further, in the integration step 5, the lung lobe segmentation algorithm is a neural network based classification model. The algorithm inputs vector (position + distance) information characterized by the relative position of a specific point in the lung (as shown in fig. 3, the relative proportion of the region in XYZ directions is calculated based on the lung segmentation results), the blood vessel and lung fissure results in the vicinity of the region (represented by a 64 × 64 × 64 cube), and the distance to the nearest lung fissure and blood vessel. The algorithm trains a lung lobe segment classification model by learning the input, so that a blood vessel tree and a lung fissure segmentation result are combined. The algorithm outputs the classification result of the lung lobes and the lung segments at the position. The invention can accurately control the accuracy and speed of the segmentation process, for example, the training data volume and the marking accuracy need to be ensured, the training data volume needs to ensure 100K-magnitude lung interior points (marking the lung lobes and the lung segments to which the data belong), and ensure CT data from 10K-magnitude and CT type distribution (different age groups of patients, diseases, CT dosage and the like); the marking precision is required to be ensured to be more than 95%. Acceleration can be achieved by employing a suitably reduced network structure (reduced convolutional layer depth and width), operating with shared neighborhood features to reduce the amount of computation.
For the CT type distribution, before the lung lobe segmentation of the CT image, the patient should be classified according to the age, disease condition, and CT dose (such as conventional CT and LDCT); and secondly, the same CT type is segmented, so that errors caused by different CT types can be effectively reduced, data statistics can be performed in a targeted manner, and a valuable reference basis is provided for diagnosing related diseases (such as metastatic tumors, mesotheliomas, lung nodules and the like).
As shown in fig. 3, the preferred embodiment of the present invention firstly inputs CT image data, and detects and outputs the lung contour in the CT image by using the FCN network, where the output lung contour includes the lung inside region and the lung outside region; secondly, screening out an area in the lung as a candidate area by adopting a machine segmentation mode; thirdly, on a 3D level, respectively performing vessel segmentation and lung fissure segmentation on the lung segment and the lung lobe of the candidate region by adopting 3DU-net to respectively obtain 5 independent spaces (namely the lung lobe), a diaphragm and vessel distribution in the lung segment, and constructing a vessel tree according to the vessel distribution result in the lung segment; and finally, combining the blood vessel segmentation result with the lung fissure segmentation result and carrying out lung lobe segmentation by using a lung lobe segmentation algorithm, wherein the lung lobe segmentation algorithm is a classification model based on a neural network, and the lung lobe classification model is trained by learning the input by the algorithm, so that the blood vessel tree and the lung fissure segmentation result are combined. The algorithm outputs the classification result of the lung lobes and the lung segments at the position, and the result with a plurality of segmentation regions (such as regions 1, 3, 4 and the like in fig. 3) is obtained accurately and quickly.
Therefore, the lung lobe segment segmentation method for the CT image provided by the invention adopts a layer-by-layer segmentation mode, and introduces the FCN and the 3D U-net to perform segmentation respectively, so that the finally obtained segmentation result has high accuracy, errors which easily exist in the traditional segmentation mode are greatly reduced, and the diagnosis rate is improved.
The embodiment of the invention provides a lung lobe segmentation device based on a deep learning CT image, and as shown in FIG. 2, the device comprises a detection module 10, a screening module 20, a segmentation module 30, a construction module 40 and an integration module 50.
A detecting module 10, configured to detect and output a lung contour in the CT image, where the lung contour includes an intra-lung region and an extra-lung region;
the screening module 20 is configured to select an intra-lung region in the lung contour by using a machine segmentation method, and use the intra-lung region as a candidate region;
a segmentation module 30, configured to perform vessel segmentation and lung segmentation on lung lobes and lung segments simultaneously in a 3D level of the candidate region;
a construction module 40, configured to construct a blood vessel tree according to the blood vessel segmentation result, so as to obtain three-dimensional blood vessel distribution of the lung;
and the integration module 50 is configured to combine the vessel tree and the lung fissure segmentation result by using a lung lobe segmentation algorithm, and perform lung lobe segmentation to obtain a final segmentation result of the candidate region.
Further, in the detection module 10, a mature FCN network is used for segmentation, wherein the multi-convolution layer is used as a main structure of the FCN network, and the conventional neural network full link layer is replaced with the convolution layer, so that the whole network is guaranteed to be a full convolution network structure, and the lung contour in the CT image is efficiently and quickly output.
In the screening step 2, the intra-pulmonary region is screened out by selecting the machine segmentation mode, and the intra-pulmonary region is used as a candidate region for the key screening of the subsequent further segmentation.
Further, in the segmentation module 30, the vessel segmentation and the fissure segmentation are performed on the lung segment and the lung lobe along two branch lines by using 3D U-net. That is, in the 3D layer of the candidate region, the lung segment and the lung lobes are segmented by 3D U-net to obtain the blood vessel distribution in the lung segment and 5 independent spaces (i.e. lung lobes) and diaphragms.
Further, in the construction module 40, based on the result of the vessel segmentation, a vessel tree is constructed to obtain the three-dimensional vessel distribution inside the lung segment. According to the anatomical structure in the lung, the trend of pulmonary blood vessels and tracheas in the lung has strong consistency, and blood vessels are often accompanied near the bronchi of all levels of the lung. However, in pulmonary CT imaging, the pulmonary vessels are more visually prominent, so the algorithm is to detect the vessel tree and approximate the pulmonary bronchial distribution according to the position of the vessels.
Further, in the integration module 50, the lung lobe segmentation algorithm is a neural network based classification model. The algorithm inputs vector (position + distance) information characterized by the relative position of a specific point in the lung (as shown in fig. 3, the relative proportion of the region in XYZ direction is calculated based on the lung segmentation result), the blood vessel and lung fissure result (represented by a 64 × 64 × 64 cube) in the vicinity of the region, and the distance to the nearest lung fissure and blood vessel. The algorithm trains a lung lobe segment classification model by learning the input, so that a blood vessel tree and a lung fissure segmentation result are combined. And the algorithm outputs the classification result of the lung lobes and the lung segments at the position.
Therefore, the lung lobe segment segmentation device based on the CT image adopts a layer-by-layer segmentation mode, and the FCN and the 3D U-net are introduced for segmentation respectively, so that the finally obtained segmentation result is high in accuracy, errors which easily exist in a traditional segmentation mode are greatly reduced, and the diagnosis rate is improved.
The embodiment of the invention also provides a system for realizing the lung lobe segmentation based on the CT image, which comprises the lung lobe segmentation device based on the CT image in the embodiment.
An embodiment of the present invention further provides a non-volatile storage medium having instructions stored therein, where the instructions, when executed, cause a processor to execute a CT image-based lung segment segmentation method, where the instructions include:
detecting and outputting a lung contour in the CT image, wherein the lung contour comprises an intrapulmonary area and an extrapulmonary area;
screening instructions, selecting a machine segmentation mode to screen out an area in the lung contour, and taking the area in the lung as a candidate area;
a segmentation instruction, in a 3D layer of the candidate region, simultaneously performing blood vessel segmentation and lung fissure segmentation on the lung lobe and the lung segment;
constructing an instruction, namely constructing a blood vessel tree according to a blood vessel segmentation result to obtain the three-dimensional blood vessel distribution of the lung;
and integrating the instructions, combining the blood vessel tree and the lung fissure segmentation result by adopting a lung lobe segment segmentation algorithm, and performing lung lobe segment segmentation to obtain a final segmentation result of the candidate region.
An embodiment of the present invention also provides an apparatus, including a memory storing computer executable instructions and a processor configured to execute the instructions to perform a process for CT image-based lung lobe segmentation, the process including:
detecting, namely detecting and outputting a lung contour in the CT image, wherein the lung contour comprises an intra-lung region and an extra-lung region;
screening, namely screening out an area in the lung by selecting a machine segmentation mode in the lung contour, and taking the area in the lung as a candidate area;
a segmentation step, in a 3D layer of the candidate region, simultaneously performing blood vessel segmentation and lung fissure segmentation on lung lobes and lung segments;
a construction step, namely constructing a blood vessel tree according to a blood vessel segmentation result to obtain three-dimensional blood vessel distribution of the lung;
and an integration step, combining the vessel tree and the lung fissure segmentation result by adopting a lung lobe segmentation algorithm, and performing lung lobe segmentation to obtain a final segmentation result of the candidate region.
In summary, according to the method, the apparatus, the system, the storage medium and the device for segmenting the lung lobe segment of the CT image based on the deep learning provided by the present invention, the FCN network with the multi-layered convolution layer as the main structure is adopted to accurately detect and output the lung contour in the CT image; secondly, screening candidate regions and selecting 3D U-net expansion to carry out blood vessel segmentation and lung fissure segmentation on lung sections and lung lobes, constructing a blood vessel tree according to a blood vessel segmentation result, and deducing the distribution condition of the trachea through blood vessel distribution; the method can efficiently control the precision and speed of the segmentation process, the accuracy of the finally obtained segmentation result is high, errors which are easy to exist in the traditional segmentation mode are greatly reduced, the diagnosis rate is improved, and the method is not limited by individual lung morphological differences.
The foregoing embodiments are merely illustrative of the principles and utilities of the present invention and are not intended to limit the invention. Those skilled in the art can modify or change the above-described embodiments without departing from the spirit and scope of the present invention. Accordingly, it is intended that all equivalent modifications or changes which can be made by those skilled in the art without departing from the spirit and technical spirit of the present invention be covered by the claims of the present invention.
Claims (10)
1. An output method in lung lobe segmentation of a CT image, the method comprising the steps of:
detecting and outputting a lung contour in the CT image, wherein the lung contour is used for segmenting an intra-lung region and an extra-lung region;
a screening step, in the lung contour, selecting the lung region by a machine segmentation mode, and taking the lung region as a candidate region;
a segmentation step, in the 3D layer of the candidate region, simultaneously performing blood vessel segmentation and lung fissure segmentation on the lung segment and the lung lobe;
a construction step, namely constructing a blood vessel tree according to the blood vessel segmentation result to obtain the three-dimensional blood vessel distribution of the lung;
an integration step, combining the vessel tree and the lung fissure segmentation result by adopting a lung lobe segmentation algorithm, and performing lung lobe segmentation to obtain a final segmentation result of the candidate region,
in the detection step, a section of the lung CT image in the XY direction is used as a training image, and an area in the lung is marked out to be used as a training mark; training data volume; and (5) marking accuracy.
2. The method as claimed in claim 1, wherein the step of detecting comprises detecting and outputting using an FCN network with a plurality of convolution layers as a main structure.
3. The method for outputting in lung lobe segmentation of CT image according to claim 1, wherein in the segmentation step, the vessel segmentation and the fissure segmentation are performed on the lung segment and the lung lobe respectively along two branch lines using 3D U-net.
4. The method as claimed in claim 1, wherein the step of constructing estimates a distribution of a trachea from the three-dimensional vessel distribution to obtain a bronchial tree.
5. The method as claimed in claim 1, wherein in the step of integrating, the lung segmentation algorithm integrates the vessel tree and the fissure segmentation result by inputting a lung segmentation classification model, and outputs a final segmentation result.
6. An output device for use in segmentation of lung lobe segments in a CT image, the device comprising:
the detection module is used for detecting and outputting a lung contour in the CT image, wherein the lung contour is used for segmenting an intra-lung region and an extra-lung region;
the screening module is used for screening the lung region in the lung contour by adopting a machine segmentation mode and taking the lung region as a candidate region;
the segmentation module is used for simultaneously performing blood vessel segmentation and lung fissure segmentation on the lung segment and the lung lobe in the 3D layer of the candidate region;
the construction module is used for constructing a blood vessel tree according to the blood vessel segmentation result to obtain the three-dimensional blood vessel distribution of the lung;
an integration module for combining the vessel tree and the lung fissure segmentation result by adopting a lung lobe segmentation algorithm and performing lung lobe segmentation to obtain a final segmentation result of the candidate region,
in the detection step, a lung CT image XY direction section is used as a training image, and an area in the lung is marked as a training mark; training data volume; and (5) marking accuracy.
7. The output device for use in segmentation of lung segments according to claim 6, wherein the detection module employs an FCN network having a plurality of convolutional layers as a main structure for detection and output.
8. The output device for lung lobe segment segmentation of CT images as claimed in claim 6, wherein the segmentation module performs the vessel segmentation and the fissure segmentation on the lung segment and the lung lobe along two branches using 3D U-net.
9. The output device for use in segmentation of lung segments according to claim 6, wherein the bronchial tree is obtained in the construction module by inferring a distribution of a trachea from the three-dimensional vessel distribution.
10. The output device for lung segment segmentation of CT image as claimed in claim 6, wherein in the integration module, the lung segment segmentation algorithm integrates the vessel tree and the lung fissure segmentation result by inputting a lung segment classification model, and outputs a final segmentation result.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010540968.9A CN111709953B (en) | 2017-11-03 | 2017-11-03 | Output method and device in lung lobe segment segmentation of CT (computed tomography) image |
Applications Claiming Priority (2)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN201711070729.6A CN107909581B (en) | 2017-11-03 | 2017-11-03 | Lobe of the lung section dividing method, device, system, storage medium and the equipment of CT images |
| CN202010540968.9A CN111709953B (en) | 2017-11-03 | 2017-11-03 | Output method and device in lung lobe segment segmentation of CT (computed tomography) image |
Related Parent Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201711070729.6A Division CN107909581B (en) | 2017-11-03 | 2017-11-03 | Lobe of the lung section dividing method, device, system, storage medium and the equipment of CT images |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111709953A CN111709953A (en) | 2020-09-25 |
| CN111709953B true CN111709953B (en) | 2023-04-07 |
Family
ID=61843485
Family Applications (5)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811505220.4A Active CN109615636B (en) | 2017-11-03 | 2017-11-03 | Blood vessel tree construction method and device in lung lobe segment segmentation of CT (computed tomography) image |
| CN201711070729.6A Active CN107909581B (en) | 2017-11-03 | 2017-11-03 | Lobe of the lung section dividing method, device, system, storage medium and the equipment of CT images |
| CN201811505228.0A Active CN109584252B (en) | 2017-11-03 | 2017-11-03 | Lung lobe segment segmentation method and device of CT image based on deep learning |
| CN201811506463.XA Active CN109636811B (en) | 2017-11-03 | 2017-11-03 | Integration method and device for lung lobe segment segmentation of CT (computed tomography) image |
| CN202010540968.9A Active CN111709953B (en) | 2017-11-03 | 2017-11-03 | Output method and device in lung lobe segment segmentation of CT (computed tomography) image |
Family Applications Before (4)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN201811505220.4A Active CN109615636B (en) | 2017-11-03 | 2017-11-03 | Blood vessel tree construction method and device in lung lobe segment segmentation of CT (computed tomography) image |
| CN201711070729.6A Active CN107909581B (en) | 2017-11-03 | 2017-11-03 | Lobe of the lung section dividing method, device, system, storage medium and the equipment of CT images |
| CN201811505228.0A Active CN109584252B (en) | 2017-11-03 | 2017-11-03 | Lung lobe segment segmentation method and device of CT image based on deep learning |
| CN201811506463.XA Active CN109636811B (en) | 2017-11-03 | 2017-11-03 | Integration method and device for lung lobe segment segmentation of CT (computed tomography) image |
Country Status (1)
| Country | Link |
|---|---|
| CN (5) | CN109615636B (en) |
Families Citing this family (44)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN108765369B (en) * | 2018-04-20 | 2023-05-02 | 平安科技（深圳）有限公司 | Method, apparatus, computer device and storage medium for detecting lung nodule |
| CN108764241A (en) * | 2018-04-20 | 2018-11-06 | 平安科技（深圳）有限公司 | Divide method, apparatus, computer equipment and the storage medium of near end of thighbone |
| CN109949300B (en) * | 2018-06-03 | 2020-07-17 | 北京昆仑医云科技有限公司 | Method, system and computer readable medium for anatomical tree structure analysis |
| CN108765422A (en) * | 2018-06-13 | 2018-11-06 | 云南大学 | A kind of retinal images blood vessel automatic division method |
| CN109035284B (en) * | 2018-06-28 | 2022-05-06 | 深圳先进技术研究院 | Heart CT image segmentation method, device, equipment and medium based on deep learning |
| CN109003299A (en) * | 2018-07-05 | 2018-12-14 | 北京推想科技有限公司 | A method of the calculating cerebral hemorrhage amount based on deep learning |
| CN109146854B (en) * | 2018-08-01 | 2021-10-01 | 东北大学 | Analysis method for association relationship between pulmonary nodule and pulmonary blood vessel |
| CN109345538B (en) * | 2018-08-30 | 2021-08-10 | 华南理工大学 | Retinal vessel segmentation method based on convolutional neural network |
| CN109255782A (en) * | 2018-09-03 | 2019-01-22 | 图兮深维医疗科技（苏州）有限公司 | A kind of processing method, device, equipment and the storage medium of Lung neoplasm image |
| CN109492519A (en) * | 2018-09-12 | 2019-03-19 | 浙江浙大列车智能化工程技术研究中心有限公司 | The generation method of training dataset mark for the identification of deep learning underground railway track |
| CN109308695A (en) * | 2018-09-13 | 2019-02-05 | 镇江纳兰随思信息科技有限公司 | Based on the cancer cell identification method for improving U-net convolutional neural networks model |
| CN109410170B (en) * | 2018-09-14 | 2022-09-02 | 东软医疗系统股份有限公司 | Image data processing method, device and equipment |
| CN109685787A (en) * | 2018-12-21 | 2019-04-26 | 杭州依图医疗技术有限公司 | Output method, device in the lobe of the lung section segmentation of CT images |
| CN109727251A (en) * | 2018-12-29 | 2019-05-07 | 上海联影智能医疗科技有限公司 | The system that lung conditions are divided a kind of quantitatively, method and apparatus |
| US11436720B2 (en) | 2018-12-28 | 2022-09-06 | Shanghai United Imaging Intelligence Co., Ltd. | Systems and methods for generating image metric |
| CN109870730B (en) * | 2018-12-28 | 2020-11-20 | 中国科学院重庆绿色智能技术研究院 | Method and system for regular inspection of X-ray machine image resolution test body |
| CN109886967A (en) * | 2019-01-16 | 2019-06-14 | 成都蓝景信息技术有限公司 | Lung anatomy position location algorithms based on depth learning technology |
| CN110084816B (en) * | 2019-03-21 | 2021-04-06 | 深圳大学 | Object segmentation method, device, computer-readable storage medium and computer equipment |
| CN109961446B (en) * | 2019-03-27 | 2021-06-01 | 深圳视见医疗科技有限公司 | CT/MR three-dimensional image segmentation processing method, device, equipment and medium |
| CN111784700B (en) * | 2019-04-04 | 2022-07-22 | 阿里巴巴集团控股有限公司 | Lung lobe segmentation, model training, model construction and segmentation method, system and equipment |
| CN110101401B (en) * | 2019-04-18 | 2023-04-07 | 浙江大学山东工业技术研究院 | Liver contrast agent digital subtraction angiography method |
| CN110060262A (en) * | 2019-04-18 | 2019-07-26 | 北京市商汤科技开发有限公司 | A kind of image partition method and device, electronic equipment and storage medium |
| US11424021B2 (en) | 2019-05-10 | 2022-08-23 | National Taiwan University | Medical image analyzing system and method thereof |
| TWI745940B (en) * | 2019-05-10 | 2021-11-11 | 國立臺灣大學 | Medical image analyzing system and method thereof |
| CN110136119A (en) * | 2019-05-16 | 2019-08-16 | 杭州健培科技有限公司 | A kind of lung based on deep learning splits the method and system of segmentation and integrity assessment |
| CN110197712B (en) * | 2019-06-05 | 2023-09-15 | 桂林电子科技大学 | Medical image storage system and storage method |
| CN110887707B (en) * | 2019-08-28 | 2022-03-22 | 江苏大学 | Real-time monitoring system and method for impurity-containing crushing state of grains based on U-Net network |
| CN111242874B (en) * | 2020-02-11 | 2023-08-29 | 北京百度网讯科技有限公司 | Image restoration method, device, electronic equipment and storage medium |
| CN111260669A (en) * | 2020-02-17 | 2020-06-09 | 北京推想科技有限公司 | Lung lobe segmentation method and device based on CT image |
| CN111275722A (en) * | 2020-02-18 | 2020-06-12 | 广州柏视医疗科技有限公司 | Lung segment and liver segment segmentation method and system |
| CN112561884A (en) * | 2020-02-24 | 2021-03-26 | 广州柏视医疗科技有限公司 | Segmental naming system for pulmonary trachea and blood vessels |
| CN111062955A (en) * | 2020-03-18 | 2020-04-24 | 天津精诊医疗科技有限公司 | Lung CT image data segmentation method and system |
| CN111539918B (en) * | 2020-04-15 | 2023-05-02 | 复旦大学附属肿瘤医院 | Ground glass pulmonary nodule risk layered prediction system based on deep learning |
| CN111260671A (en) * | 2020-05-07 | 2020-06-09 | 北京精诊医疗科技有限公司 | Lung leaf segmentation method and system for CT image |
| CN113870167A (en) | 2020-06-11 | 2021-12-31 | 通用电气精准医疗有限责任公司 | Method, system and storage medium for segmenting lung images |
| CN112164074B (en) * | 2020-09-22 | 2021-08-10 | 江南大学 | 3D CT bed fast segmentation method based on deep learning |
| CN112950554B (en) * | 2021-02-05 | 2021-12-21 | 慧影医疗科技（北京）有限公司 | Lung lobe segmentation optimization method and system based on lung segmentation |
| CN112489047B (en) * | 2021-02-05 | 2021-06-01 | 四川大学 | Deep learning-based pelvic bone and arterial vessel multi-level segmentation method thereof |
| CN113160186B (en) * | 2021-04-27 | 2022-10-25 | 青岛海信医疗设备股份有限公司 | Lung lobe segmentation method and related device |
| CN113222006B (en) * | 2021-05-08 | 2021-10-08 | 推想医疗科技股份有限公司 | Method, device, equipment and storage medium for grading segmental bronchus |
| CN113516669B (en) * | 2021-06-23 | 2023-04-25 | 湖北英库科技有限公司 | CT image-based trachea extraction method, device, equipment and storage medium |
| CN114092470B (en) * | 2021-12-08 | 2022-08-09 | 之江实验室 | Deep learning-based automatic detection method and device for pulmonary fissure |
| CN115147359B (en) * | 2022-06-06 | 2023-04-07 | 北京医准智能科技有限公司 | Lung lobe segmentation network model training method and device, electronic equipment and storage medium |
| CN117078698B (en) * | 2023-08-22 | 2024-03-05 | 山东第一医科大学第二附属医院 | Peripheral blood vessel image auxiliary segmentation method and system based on deep learning |
Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003070102A2 (en) * | 2002-02-15 | 2003-08-28 | The Regents Of The University Of Michigan | Lung nodule detection and classification |
| JP2008142481A (en) * | 2006-12-13 | 2008-06-26 | Med Solution Kk | Apparatus and program for carrying out segmentation of lungs to units of pulmonary segment automatically |
| KR101472558B1 (en) * | 2013-10-04 | 2014-12-16 | 원광대학교산학협력단 | The system and method for automatic segmentation of lung, bronchus, pulmonary vessels images from thorax ct images |
| CN104751178A (en) * | 2015-03-31 | 2015-07-01 | 上海理工大学 | Pulmonary nodule detection device and method based on shape template matching and combining classifier |
| CN106097305A (en) * | 2016-05-31 | 2016-11-09 | 上海理工大学 | The intratracheal tree dividing method that two-pass region growing combining form is rebuild |
| CN106780460A (en) * | 2016-12-13 | 2017-05-31 | 杭州健培科技有限公司 | A kind of Lung neoplasm automatic checkout system for chest CT image |
| CN107016665A (en) * | 2017-02-16 | 2017-08-04 | 浙江大学 | A kind of CT pulmonary nodule detection methods based on depth convolutional neural networks |
| CN107103187A (en) * | 2017-04-10 | 2017-08-29 | 四川省肿瘤医院 | The method and system of Lung neoplasm detection classification and management based on deep learning |
Family Cites Families (14)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| EP2086399B1 (en) * | 2006-11-10 | 2017-08-09 | Covidien LP | Adaptive navigation technique for navigating a catheter through a body channel or cavity |
| CN101763644B (en) * | 2010-03-10 | 2011-11-30 | 华中科技大学 | Pulmonary nodule three-dimensional segmentation and feature extraction method and system thereof |
| CN102254097A (en) * | 2011-07-08 | 2011-11-23 | 普建涛 | Method for identifying fissure on lung CT (computed tomography) image |
| US9014445B2 (en) * | 2012-10-11 | 2015-04-21 | Vida Diagnostics, Inc. | Visualization and characterization of pulmonary lobar fissures |
| BR112015012373A2 (en) * | 2012-12-03 | 2017-07-11 | Koninklijke Philips Nv | image processing device, image processing method, and computer program |
| CN103136788B (en) * | 2013-03-04 | 2016-01-20 | 重庆大学 | The visual method for reconstructing of a kind of three-dimensional blood vessel bifurcation |
| CN103886599B (en) * | 2014-03-26 | 2017-10-13 | 北京工业大学 | A kind of blood vessel ROI dividing methods based on ivus image |
| US20150305612A1 (en) * | 2014-04-23 | 2015-10-29 | Mark Hunter | Apparatuses and methods for registering a real-time image feed from an imaging device to a steerable catheter |
| CN104574413B (en) * | 2015-01-22 | 2017-04-12 | 深圳大学 | Blood vessel bifurcation extracting method and system of lung CT picture |
| US10078895B2 (en) * | 2015-12-30 | 2018-09-18 | Case Western Reserve University | Prediction of recurrence of non-small cell lung cancer with tumor infiltrating lymphocyte (TIL) graphs |
| CN106529555B (en) * | 2016-11-04 | 2019-12-06 | 四川大学 | DR (digital radiography) sheet lung contour extraction method based on full convolution network |
| CN106875379A (en) * | 2017-01-10 | 2017-06-20 | 陕西渭南神州德信医学成像技术有限公司 | Lung splits integrity degree appraisal procedure, device and system |
| CN107203989A (en) * | 2017-04-01 | 2017-09-26 | 南京邮电大学 | End-to-end chest CT image dividing method based on full convolutional neural networks |
| CN107230204B (en) * | 2017-05-24 | 2019-11-22 | 东北大学 | A kind of method and device for extracting the lobe of the lung from chest CT image |
-
2017
- 2017-11-03 CN CN201811505220.4A patent/CN109615636B/en active Active
- 2017-11-03 CN CN201711070729.6A patent/CN107909581B/en active Active
- 2017-11-03 CN CN201811505228.0A patent/CN109584252B/en active Active
- 2017-11-03 CN CN201811506463.XA patent/CN109636811B/en active Active
- 2017-11-03 CN CN202010540968.9A patent/CN111709953B/en active Active
Patent Citations (8)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| WO2003070102A2 (en) * | 2002-02-15 | 2003-08-28 | The Regents Of The University Of Michigan | Lung nodule detection and classification |
| JP2008142481A (en) * | 2006-12-13 | 2008-06-26 | Med Solution Kk | Apparatus and program for carrying out segmentation of lungs to units of pulmonary segment automatically |
| KR101472558B1 (en) * | 2013-10-04 | 2014-12-16 | 원광대학교산학협력단 | The system and method for automatic segmentation of lung, bronchus, pulmonary vessels images from thorax ct images |
| CN104751178A (en) * | 2015-03-31 | 2015-07-01 | 上海理工大学 | Pulmonary nodule detection device and method based on shape template matching and combining classifier |
| CN106097305A (en) * | 2016-05-31 | 2016-11-09 | 上海理工大学 | The intratracheal tree dividing method that two-pass region growing combining form is rebuild |
| CN106780460A (en) * | 2016-12-13 | 2017-05-31 | 杭州健培科技有限公司 | A kind of Lung neoplasm automatic checkout system for chest CT image |
| CN107016665A (en) * | 2017-02-16 | 2017-08-04 | 浙江大学 | A kind of CT pulmonary nodule detection methods based on depth convolutional neural networks |
| CN107103187A (en) * | 2017-04-10 | 2017-08-29 | 四川省肿瘤医院 | The method and system of Lung neoplasm detection classification and management based on deep learning |
Non-Patent Citations (4)
| Title |
|---|
| Bianca Lassen等;Lung and Lung Lobe Segmentation Methods by Fraunhofer MEVIS;《http://www.mevis.fraunhofer.de》;第1-15页 * |
| 基于CT图像的肺气管树3D分割方法的研究;李翠芳等;《中国医学物理学杂志》(第05期);第39-43页 * |
| 基于CT影像的肺组织分割方法综述;耿欢等;《计算机应用研究》(第07期);第15-21页 * |
| 基于U-Net网络的肺部CT图像分割算法;袁甜等;《自动化与仪器仪表》(第06期);第65-67页 * |
Also Published As
| Publication number | Publication date |
|---|---|
| CN109636811B (en) | 2020-06-12 |
| CN109636811A (en) | 2019-04-16 |
| CN109584252A (en) | 2019-04-05 |
| CN109584252B (en) | 2020-08-14 |
| CN109615636A (en) | 2019-04-12 |
| CN111709953A (en) | 2020-09-25 |
| CN109615636B (en) | 2020-06-12 |
| CN107909581A (en) | 2018-04-13 |
| CN107909581B (en) | 2019-01-29 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| CN111709953B (en) | Output method and device in lung lobe segment segmentation of CT (computed tomography) image | |
| Punn et al. | Modality specific U-Net variants for biomedical image segmentation: a survey | |
| Haque et al. | Deep learning approaches to biomedical image segmentation | |
| Domingues et al. | Using deep learning techniques in medical imaging: a systematic review of applications on CT and PET | |
| Skourt et al. | Lung CT image segmentation using deep neural networks | |
| Li et al. | Dilated-inception net: multi-scale feature aggregation for cardiac right ventricle segmentation | |
| JP2022525198A (en) | Deep convolutional neural network for tumor segmentation using positron emission tomography | |
| CN110910405B (en) | Brain tumor segmentation method and system based on multi-scale cavity convolutional neural network | |
| Lei et al. | Deep learning in multi-organ segmentation | |
| Li et al. | DenseX-net: an end-to-end model for lymphoma segmentation in whole-body PET/CT images | |
| CN109978037A (en) | Image processing method, model training method, device and storage medium | |
| CN109300136B (en) | Automatic segmentation method for organs at risk based on convolutional neural network | |
| Zhang et al. | Mesenteric vasculature-guided small bowel segmentation on 3-D CT | |
| CN109685787A (en) | Output method, device in the lobe of the lung section segmentation of CT images | |
| CN111553892A (en) | Lung nodule segmentation calculation method, device and system based on deep learning | |
| Tan et al. | An approach for pulmonary vascular extraction from chest CT images | |
| Chen et al. | Alzheimer's disease diagnosis with brain structural mri using multiview-slice attention and 3D convolution neural network | |
| Li et al. | Automatic quantification of epicardial adipose tissue volume | |
| Rehman et al. | Liver lesion segmentation using deep learning models | |
| Lu et al. | Automatic tumor segmentation by means of deep convolutional U-Net with pre-trained encoder in PET images | |
| Davamani et al. | Biomedical image segmentation by deep learning methods | |
| Dong et al. | A novel end‐to‐end deep learning solution for coronary artery segmentation from CCTA | |
| Yang et al. | Dual-path network for liver and tumor segmentation in CT images using Swin Transformer encoding approach | |
| Yang | A novel brain image segmentation method using an improved 3D U-net model | |
| Lu et al. | AugMS-Net: Augmented multiscale network for small cervical tumor segmentation from MRI volumes |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| GR01 | Patent grant | ||
| GR01 | Patent grant |