WO2019201204A1 - Method and device for detecting nodule in image - Google Patents
Method and device for detecting nodule in image Download PDFInfo
- Publication number
- WO2019201204A1 WO2019201204A1 PCT/CN2019/082677 CN2019082677W WO2019201204A1 WO 2019201204 A1 WO2019201204 A1 WO 2019201204A1 CN 2019082677 W CN2019082677 W CN 2019082677W WO 2019201204 A1 WO2019201204 A1 WO 2019201204A1
- Authority
- WO
- WIPO (PCT)
- Prior art keywords
- nodule
- candidate
- nodules
- image
- roi
- Prior art date
Links
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20092—Interactive image processing based on input by user
- G06T2207/20104—Interactive definition of region of interest [ROI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
Definitions
- Embodiments of the present invention relate to the field of machine learning technologies, and in particular, to a method and an apparatus for detecting image nodules.
- nodules have caused widespread concern, such as pulmonary nodules, thyroid nodules, etc.
- doctors generally observe the patient's nodules through medical imaging.
- the patient's nodules may change over time, for example, increase, decrease, or grow new nodules and the like.
- the way to find nodules from medical images is mainly to find the corresponding nodules in the medical images by doctors manually observing the medical images, but this situation will lead to the accuracy of the found nodules, and also It takes a lot of time and is subjective.
- Embodiments of the present invention provide a method and apparatus for detecting image nodules, which are used to improve the efficiency of nodule detection and improve the accuracy of nodule detection.
- ROI Region of Interest
- the convolutional neural network is used to train the nodule image of the marked nodule region to obtain the nodule detection model
- the ROI can be directly input to the nodule detection model to obtain the confidence of the corresponding candidate nodule, and the improved knot
- the efficiency of the section detection, and the false-positive nodules are filtered out after the nodules are detected, thereby improving the accuracy of the nodule detection.
- determining, according to the three-dimensional coordinates of the candidate nodule, the ROI of the candidate nodule from the nodule image including:
- a spatial information channel is added to each pixel of the pixel cube to determine the ROI, and the spatial information channel is a distance between the pixel and the three-dimensional coordinates of the nodule.
- the input value input to the nodule detection model can be obtained by the determined ROI, so that the input of the nodule detection model is applied, and the uniformity of the input values is improved.
- the determining, according to the ROI and the nodule detection model, the confidence that the candidate nodule is included including:
- the ROI is sequentially extracted by the M 3D convolution feature extraction modules to extract the feature image of the ROI, where M is greater than 0;
- the extracted feature image of the ROI is input to the fully connected module, and the confidence of the candidate nodule is determined.
- the confidence of the candidate nodule is detected by the nodule detection model, thereby improving the efficiency of nodule detection.
- the candidate nodule according to the confidence level greater than the threshold, the segmentation result of the body part where the candidate nodule is located, and the three-dimensional coordinates and radius of the candidate nodule are filtered out, and the candidate nodule with the confidence greater than the threshold is filtered out.
- Candidate nodules for false positives including:
- the candidate nodule of the mediastinal false positive in the candidate nodule with the confidence greater than the threshold is filtered out.
- the using the convolutional neural network to train the plurality of nodule effects of the labeled nodule region to determine the nodule detection model comprises:
- Data enhancement is performed on candidate nodules in the candidate nodule set to obtain an enhanced candidate nodule set
- the ROI of each candidate nodule in the enhanced candidate nodule set is trained by a preset 3D convolutional neural network model to obtain the nodule detection model.
- the embodiment of the invention further provides an apparatus for detecting image nodules, comprising:
- An acquiring unit configured to acquire a nodule image and three-dimensional coordinates of candidate nodules in the nodule image
- a determining unit configured to determine, from the nodule image, an ROI including the candidate nodule according to the three-dimensional coordinates of the candidate nodule;
- a detecting unit configured to determine a confidence level of the candidate nodule according to the ROI and a nodule detection model, wherein the nodule detection model uses a convolutional neural network to perform influence on multiple nodules of the labeled nodule region Determined after training;
- a filtering unit configured to filter out false positives in the candidate nodules whose confidence is greater than a threshold according to a candidate nodule with a confidence greater than a threshold, a segmentation result of a body part where the candidate nodule is located, and a three-dimensional coordinate of the candidate nodule
- Candidate nodules determine the nodules in the nodule image and the confidence level corresponding to the nodules.
- the determining unit is specifically configured to:
- a spatial information channel is added to each pixel of the pixel cube to determine the ROI, and the spatial information channel is a distance between the pixel and the three-dimensional coordinates of the nodule.
- the detecting unit is specifically configured to:
- the ROI is sequentially extracted by the M 3D convolution feature extraction modules to extract the feature image of the ROI, where M is greater than 0;
- the extracted feature image of the ROI is input to the fully connected module, and the confidence of the candidate nodule is determined.
- the filtering unit is specifically configured to:
- the candidate nodule of the mediastinal false positive in the candidate nodule with the confidence greater than the threshold is filtered out.
- the detecting unit is specifically configured to:
- Data enhancement is performed on candidate nodules in the candidate nodule set to obtain an enhanced candidate nodule set
- the ROI of each candidate nodule in the enhanced candidate nodule set is trained by a preset 3D convolutional neural network model to obtain the nodule detection model.
- an embodiment of the present invention further provides a computer device, including:
- a memory for storing program instructions
- a processor configured to invoke a program instruction stored in the memory, and execute the method for detecting the image nodule according to the obtained program.
- the embodiment of the present invention further provides a computer readable non-volatile storage medium, comprising computer readable instructions, when the computer device reads and executes the computer readable instructions, causing the computer device to execute the image image Method of section detection.
- an embodiment of the present invention further provides a computer program product, the computer program product comprising a computer program stored on a computer readable non-volatile storage medium, the computer program comprising program instructions, when the program When the instructions are executed by the computer device, the computer device is caused to perform the method of image nodule detection described above.
- the convolutional neural network is used to train the nodule image of the marked nodule region to obtain a nodule detection model, thereby directly inputting the ROI into the nodule detection model to obtain a confidence of the corresponding candidate nodule. Degree, improved efficiency of nodule detection, and filtering out false positive nodules after detection of nodules, thereby improving the accuracy of nodule detection.
- FIG. 1 is a schematic diagram of a system architecture according to an embodiment of the present invention
- FIG. 2 is a schematic flowchart of a method for detecting image nodules according to an embodiment of the present invention
- FIG. 3 is a schematic diagram of a nodule image according to an embodiment of the present invention.
- FIG. 4 is a schematic flowchart of an apparatus for detecting image nodules according to an embodiment of the present invention.
- FIG. 5 is a schematic structural diagram of a computer device according to an embodiment of the present invention.
- FIG. 1 is a system architecture applicable to a method for detecting image nodules according to an embodiment of the present invention.
- the system architecture can be server 100, including processor 110, communication interface 120, and memory 130.
- the communication interface 120 is used for communication by a terminal device applied by a doctor, and transmits and receives information transmitted by the terminal device to implement communication.
- the processor 110 is a control center of the server 100 that connects various portions of the entire server 100 using various interfaces and lines, by running or executing software programs and/or modules stored in the memory 130, and recalling data stored in the memory 130, Various functions and processing data of the server 100 are executed.
- processor 110 may include one or more processing units.
- the memory 130 can be used to store software programs and modules, and the processor 110 executes various functional applications and data processing by running software programs and modules stored in the memory 130.
- the memory 130 may mainly include a storage program area and a storage data area, wherein the storage program area may store an operating system, an application required for at least one function, and the like; the storage data area may store data created according to business processing and the like.
- memory 130 can include high speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, flash memory device, or other volatile solid state storage device.
- FIG. 1 is only an example, which is not limited by the embodiment of the present invention.
- FIG. 2 exemplarily shows a flow of image nodule detection provided by an embodiment of the present invention, which may be performed by a device for detecting image nodules.
- the process specifically includes:
- Step 201 Acquire a nodule image and three-dimensional coordinates of candidate nodules in the nodule image.
- the nodule image is a three-dimensional image, and the three-dimensional coordinates of the candidate nodule may be the three-dimensional coordinates of the point within the candidate nodule (such as the three-dimensional coordinates of the nodule center point), or may be the three-dimensional coordinates of the point of the candidate nodule surface.
- candidate nodules include, but are not limited to, pulmonary nodules, thyroid nodules, and breast nodules.
- the nodule image may be a Computed Tomography (CT) image, a Magnetic Resonance Imaging (MRI) image, or the like.
- CT Computed Tomography
- MRI Magnetic Resonance Imaging
- Step 202 Determine an ROI of the candidate nodule from the nodule image according to the three-dimensional coordinates of the candidate nodule.
- the preset distance may be extended to the periphery by using the three-dimensional coordinates of the candidate nodule as a center, and the pixel cube including the candidate nodule is determined, wherein the preset distance is a preset multiple of the radius of the candidate nodule, such as a candidate.
- the radius of the nodule is 1.25 times.
- a spatial information channel is added to each pixel in the pixel cube to output an ROI, and the spatial information channel is the distance between the pixel cube and the three-dimensional coordinates of the candidate nodule.
- Step 203 Determine a confidence level of the candidate nodule according to the ROI and the nodule detection model.
- the nodule detection model is obtained by using a convolutional neural network to train a plurality of nodules in the marked nodule region, and specifically: obtaining a candidate for filtering a false positive result first.
- the nodule set and the doctor determine the candidate nodules in the candidate nodule set, and the candidate nodule set of the false positive result to be filtered is obtained by collecting a large number of chest CT images and using other programs, and then passing through multiple doctors.
- the candidate nodules in the candidate nodule set are determined to determine whether it is a nodule.
- the candidate nodules in the candidate nodule set are then data enhanced to obtain an enhanced candidate nodule set.
- the amount of data can be increased to the previous K times.
- the possible way is to enhance the data amount by random horizontal mirroring, random rotation of arbitrary angles, random up and down and left and right translation of 0 to 5 pixels, and randomization of 0.85 to 1.15 times. K times before.
- the ROI of each candidate nodule in the enhanced candidate nodule set is determined from the nodule image according to the enhanced candidate nodule set and the three-dimensional coordinates of each candidate nodule. For the specific determination method, refer to step 203. Narration.
- the ROI of each candidate nodule in the enhanced candidate nodule set is trained by a preset 3D convolutional neural network model to obtain a nodule detection model.
- the nod confidence of the 3D convolutional neural network model output and the label of the training sample can be cross-entropy as a loss function, and trained by the back propagation method.
- the training optimization algorithm is SGD.
- the nodule detection model obtained by the above steps includes M 3D convolution feature extraction models and a fully connected module.
- Each 3D convolution feature extraction model also includes a 3D convolutional layer of J*J*J and a max_pool layer of H*H*H.
- a fully connected model can include two fully connected layers.
- the ROI obtained in the above step 202 may be sequentially extracted by the M 3D convolution feature extraction module to extract the feature image of the ROI, and then the extracted ROI feature image is input to the fully connected module to determine the candidate.
- Step 204 Filter out candidate for false positive in the candidate nodule with the confidence greater than the threshold according to the candidate nodule with the confidence greater than the threshold, the segmentation result of the body part where the candidate nodule is located, and the three-dimensional coordinate of the candidate nodule Nodule.
- the body part may be a body part such as a lung, a thyroid gland, a breast, or the like, which is not limited in the embodiment of the present invention.
- the candidate nodules of the skeleton-like false positives in the candidate nodules whose confidence is greater than the threshold may be filtered according to the three-dimensional coordinates of the candidate nodules and the pixels in the preset region where the candidate nodules are located.
- This threshold can be set empirically. For example, three-dimensional coordinates from the beginning of the nodule candidate, Imm extended to the surrounding area, a total area I * I * Imm 3 a. Then, the pixels with CT values greater than 400 in the statistical region can be regarded as candidate nodules of false positives of the bones if they occupy a larger proportion than the first threshold, so that they can be filtered out.
- the candidate nodules of the diaphragmatic false positives in the candidate nodules with confidence greater than the threshold may also be filtered according to the three-dimensional coordinates and radius of the candidate nodules and the segmentation results of the body parts where the candidate nodules are located. For example, starting from the three-dimensional coordinates of the candidate nodule, the area block of the diameter is expanded to the periphery, and the number of pixels in the lung and the lung outside the block is counted, if the number of pixels in the lung and the number of pixels outside the lung are in the nodule image. The proportions occupied are similar, and basically in the middle of the image, it can be regarded as a candidate nodule of the diaphragmatic false positive, which can be filtered out.
- Candidate nodules of mediastinal false positives in candidate nodules with confidence greater than the threshold can also be filtered out according to the three-dimensional coordinates of the candidate nodules and the segmentation results of the body parts where the candidate nodules are located. For example, if the center of the candidate nodule is outside the lung, and the vertical direction does not exceed the lung range, and the central position, it can be said that the relative position on the X-axis is between 0.45 and 0.55, then it can be regarded as a mediastinum. Positive candidate nodule.
- the above embodiment shows that by acquiring the nodule image and the three-dimensional coordinates of the candidate nodule in the nodule image, the ROI containing the candidate nodule is determined from the nodule image according to the three-dimensional coordinates of the candidate nodule, and is determined according to the ROI and the nodule detection model. Based on the confidence of the candidate nodule, the nodule detection model is determined by using a convolutional neural network to train the effects of multiple nodules in the labeled nodule region. According to the candidate nodule with the confidence greater than the threshold, the candidate nodule is located.
- the segmentation result of the body part and the three-dimensional coordinates of the candidate nodule filtering out the candidate nodule of the false positive in the candidate nodule with the confidence greater than the threshold, determining the nodule in the nodule image and the confidence corresponding to the nodule . Since the convolutional neural network is used to train the nodule image of the marked nodule region to obtain the nodule detection model, the ROI can be directly input to the nodule detection model to obtain the confidence of the corresponding candidate nodule, and the improved knot The efficiency of the section detection, and the false-positive nodules are filtered out after the nodules are detected, thereby improving the accuracy of the nodule detection.
- FIG. 4 exemplarily shows an apparatus for detecting image nodules according to an embodiment of the present invention, which can perform a process of image nodule detection.
- the device specifically includes:
- An obtaining unit 401 configured to acquire a nodule image and three-dimensional coordinates of candidate nodules in the nodule image
- a determining unit 402 configured to determine, according to the three-dimensional coordinates of the candidate nodule, an ROI including the candidate nodule from the nodule image;
- a detecting unit 403 configured to determine a confidence level of the candidate nodule according to the ROI and a nodule detection model, wherein the nodule detection model uses a convolutional neural network to affect multiple nodules of the labeled nodule region Determined after training;
- the filtering unit 404 is configured to filter out the false candidate in the candidate nodule with the confidence greater than the threshold according to the candidate nodule with the confidence greater than the threshold, the segmentation result of the body part where the candidate nod is located, and the three-dimensional coordinate of the candidate nodule A positive candidate nodule determines the nodule in the nodule image and the confidence level corresponding to the nodule.
- the determining unit 402 is specifically configured to:
- a spatial information channel is added to each pixel of the pixel cube to determine the ROI, and the spatial information channel is a distance between the pixel and the three-dimensional coordinates of the nodule.
- the detecting unit 403 is specifically configured to:
- the ROI is sequentially extracted by the M 3D convolution feature extraction modules to extract the feature image of the ROI, where M is greater than 0;
- the extracted feature image of the ROI is input to the fully connected module, and the confidence of the candidate nodule is determined.
- the filtering unit 404 is specifically configured to:
- the candidate nodule of the mediastinal false positive in the candidate nodule with the confidence greater than the threshold is filtered out.
- the detecting unit 403 is specifically configured to:
- Data enhancement is performed on candidate nodules in the candidate nodule set to obtain an enhanced candidate nodule set
- the ROI of each candidate nodule in the enhanced candidate nodule set is trained by a preset 3D convolutional neural network model to obtain the nodule detection model.
- an embodiment of the present invention further provides a computer device, as shown in FIG. 5, including:
- a memory 501 configured to store program instructions
- the processor 502 is configured to invoke a program instruction stored in the memory 501, and execute the method for detecting the image nodule according to the obtained program.
- an embodiment of the present invention further provides a computer readable non-volatile storage medium, comprising computer readable instructions, when the computer device reads and executes the computer readable instructions, causing the computer device to execute The above method of image nodule detection.
- an embodiment of the present invention further provides a computer program product, the computer program product comprising a computer program stored on a computer readable non-volatile storage medium, the computer program comprising program instructions The method of causing the computer device to perform the image nodule detection described above when the program instructions are executed by a computer device.
- the computer program instructions can also be stored in a computer readable memory that can direct a computer or other programmable data processing device to operate in a particular manner, such that the instructions stored in the computer readable memory produce an article of manufacture comprising the instruction device.
- the apparatus implements the functions specified in one or more blocks of a flow or a flow and/or block diagram of the flowchart.
- These computer program instructions can also be loaded onto a computer or other programmable data processing device such that a series of operational steps are performed on a computer or other programmable device to produce computer-implemented processing for execution on a computer or other programmable device.
- the instructions provide steps for implementing the functions specified in one or more of the flow or in a block or blocks of a flow diagram.
Landscapes
- Engineering & Computer Science (AREA)
- Quality & Reliability (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Health & Medical Sciences (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Image Analysis (AREA)
- Apparatus For Radiation Diagnosis (AREA)
Abstract
Description
Claims (13)
- 一种影像结节检测的方法,其特征在于,包括:A method for detecting image nodules, comprising:获取结节影像以及所述结节影像中候选结节的三维坐标;Obtaining a nodule image and three-dimensional coordinates of candidate nodules in the nodule image;根据所述候选结节的三维坐标从所述结节影像中确定包含所述候选结节的感兴趣区域ROI;Determining a region of interest ROI including the candidate nodule from the nodule image according to the three-dimensional coordinates of the candidate nodule;根据所述ROI以及结节检测模型确定出所述候选结节的置信度,所述结节检测模型是采用卷积神经网络对已标记结节区域的多个结节影响进行训练后确定的;Determining a confidence level of the candidate nodule according to the ROI and a nodule detection model, wherein the nodule detection model is determined by using a convolutional neural network to train a plurality of nodule effects of the labeled nodule region;根据置信度大于阈值的候选结节、候选结节所在身体部位的分割结果和所述候选结节的三维坐标,过滤掉所述置信度大于阈值的候选结节中的假阳性的候选结节,确定出所述结节影像中的结节以及所述结节对应的置信度。Filtering the candidate nodules of the false positives in the candidate nodules whose confidence is greater than the threshold according to the candidate nodules whose confidence is greater than the threshold, the segmentation result of the body part where the candidate nodule is located, and the three-dimensional coordinates of the candidate nodules, A nodule in the nodule image and a confidence level corresponding to the nodule are determined.
- 如权利要求1所述的方法,其特征在于,所述根据所述候选结节的三维坐标从所述结节影像中确定包含所述候选结节的ROI,包括:The method of claim 1, wherein the determining, based on the three-dimensional coordinates of the candidate nodule, the ROI including the candidate nodule from the nodule image comprises:以所述候选结节的三维坐标为中心,向周围扩展预设距离,确定包含所述候选结节的像素立方体,所述预设距离为所述候选结节的半径的预设倍数;Centering on the three-dimensional coordinates of the candidate nodule, extending a preset distance to the periphery to determine a pixel cube including the candidate nodule, the preset distance being a preset multiple of a radius of the candidate nodule;对所述像素立方体中每一个像素附加一个空间信息通道,确定所述ROI,所述空间信息通道为所述像素与所述结节的三维坐标之间的距离。A spatial information channel is added to each pixel of the pixel cube to determine the ROI, and the spatial information channel is a distance between the pixel and the three-dimensional coordinates of the nodule.
- 如权利要求1所述的方法,其特征在于,所述根据所述ROI以及结节检测模型确定出所述候选结节的置信度,包括:The method of claim 1, wherein the determining the confidence of the candidate nodule based on the ROI and the nodule detection model comprises:将所述ROI依次通过M个3D卷积特征提取模块提取所述ROI的特征图像,M大于0;The ROI is sequentially extracted by the M 3D convolution feature extraction modules to extract the feature image of the ROI, where M is greater than 0;将提取的所述ROI的特征图像输入至全连接模块,确定出所述候选结节的置信度。The extracted feature image of the ROI is input to the fully connected module, and the confidence of the candidate nodule is determined.
- 如权利要求1所述的方法,其特征在于,所述根据置信度大于阈值的候选结节、候选结节所在身体部位的分割结果和所述候选结节的三维坐标及半径,过滤掉所述置信度大于阈值的候选结节中的假阳性的候选结节,包括:The method according to claim 1, wherein said filtering is performed according to a candidate nodule having a confidence greater than a threshold, a segmentation result of a body part where the candidate nodule is located, and a three-dimensional coordinate and radius of said candidate nodule Candidate nodules for false positives in candidate nodules with confidence greater than the threshold, including:根据所述候选结节的三维坐标和所述候选结节所在预设区域内的像素,过滤掉所述置信度大于阈值的候选结节中的骨骼类假阳性的候选结节;或Filtering out candidate nodules of skeletal false positives in the candidate nodules whose confidence is greater than a threshold according to the three-dimensional coordinates of the candidate nodule and the pixels in the preset region where the candidate nodule is located; or根据所述候选结节的三维坐标及半径、所述候选结节所在身体部位的分割结果,过滤掉所述置信度大于阈值的候选结节中膈肌类假阳性的候选结节;或Filtering off the candidate nodules of the diaphragmatic pseudo-positive in the candidate nodules with the confidence greater than the threshold according to the three-dimensional coordinates and radius of the candidate nodule, and the segmentation result of the body part where the candidate nodule is located; or根据所述候选结节的三维坐标和所述候选结节所在身体部位的分割结果,过滤掉所述置信度大于阈值的候选结节中纵膈类假阳性的候选结节。According to the three-dimensional coordinates of the candidate nodule and the segmentation result of the body part where the candidate nodule is located, the candidate nodule of the mediastinal false positive in the candidate nodule with the confidence greater than the threshold is filtered out.
- 如权利要求1所述的方法,其特征在于,所述采用卷积神经网络对已标记结节区域的多个结节影响进行训练后确定所述结节检测模型,包括:The method of claim 1 wherein said convolutional neural network is used to train a plurality of nodule effects of the labeled nodule region to determine said nodule detection model, comprising:获取待过滤掉假阳性结果的候选结节集和医生对所述候选结节集中各候选结节的判定结果;Obtaining a candidate nodule set to be filtered out of the false positive result and a determination result of the doctor for each candidate nodule in the candidate nodule set;对所述候选结节集中的候选结节进行数据增强,得到增强后的候选结节集;Data enhancement is performed on candidate nodules in the candidate nodule set to obtain an enhanced candidate nodule set;根据增强后的候选结节集以及各候选结节的三维坐标,从结节影像中确定所述增强后的候选结节集中各候选结节的ROI;Determining an ROI of each candidate nodule in the enhanced candidate nodule set from the nodule image according to the enhanced candidate nodule set and the three-dimensional coordinates of each candidate nodule;将所述增强后的候选结节集中各候选结节的ROI通过预设的3D卷积神经网络模型进行训练,得到所述结节检测模型。The ROI of each candidate nodule in the enhanced candidate nodule set is trained by a preset 3D convolutional neural network model to obtain the nodule detection model.
- 一种影像结节检测的装置,其特征在于,包括:An apparatus for detecting image nodules, comprising:获取单元,用于获取结节影像以及所述结节影像中候选结节的三维坐标;An acquiring unit, configured to acquire a nodule image and three-dimensional coordinates of candidate nodules in the nodule image;确定单元,用于根据所述候选结节的三维坐标从所述结节影像中确定包含所述候选结节的感兴趣区域ROI;a determining unit, configured to determine, from the nodule image, a region of interest ROI including the candidate nodule according to the three-dimensional coordinates of the candidate nodule;检测单元,用于根据所述ROI以及结节检测模型确定出所述候选结节的置信度,所述结节检测模型是采用卷积神经网络对已标记结节区域的多个结节影响进行训练后确定的;a detecting unit, configured to determine a confidence level of the candidate nodule according to the ROI and a nodule detection model, wherein the nodule detection model uses a convolutional neural network to perform influence on multiple nodules of the labeled nodule region Determined after training;过滤单元,用于根据置信度大于阈值的候选结节、候选结节所在身体部位的分割结果和所述候选结节的三维坐标,过滤掉所述置信度大于阈值的候选结节中的假阳性的候选结节,确定出所述结节影像中的结节以及所述结节 对应的置信度。a filtering unit, configured to filter out false positives in the candidate nodules whose confidence is greater than a threshold according to a candidate nodule with a confidence greater than a threshold, a segmentation result of a body part where the candidate nodule is located, and a three-dimensional coordinate of the candidate nodule Candidate nodules determine the nodules in the nodule image and the confidence level corresponding to the nodules.
- 如权利要求6所述的装置,其特征在于,所述确定单元具体用于:The device according to claim 6, wherein the determining unit is specifically configured to:以所述候选结节的三维坐标为中心,向周围扩展预设距离,确定包含所述候选结节的像素立方体,所述预设距离为所述候选结节的半径的预设倍数;Centering on the three-dimensional coordinates of the candidate nodule, extending a preset distance to the periphery to determine a pixel cube including the candidate nodule, the preset distance being a preset multiple of a radius of the candidate nodule;对所述像素立方体中每一个像素附加一个空间信息通道,确定所述ROI,所述空间信息通道为所述像素与所述结节的三维坐标之间的距离。A spatial information channel is added to each pixel of the pixel cube to determine the ROI, and the spatial information channel is a distance between the pixel and the three-dimensional coordinates of the nodule.
- 如权利要求6所述的装置,其特征在于,所述检测单元具体用于:The device according to claim 6, wherein the detecting unit is specifically configured to:将所述ROI依次通过M个3D卷积特征提取模块提取所述ROI的特征图像,M大于0;The ROI is sequentially extracted by the M 3D convolution feature extraction modules to extract the feature image of the ROI, where M is greater than 0;将提取的所述ROI的特征图像输入至全连接模块,确定出所述候选结节的置信度。The extracted feature image of the ROI is input to the fully connected module, and the confidence of the candidate nodule is determined.
- 如权利要求6所述的装置,其特征在于,所述过滤单元具体用于:The device according to claim 6, wherein the filtering unit is specifically configured to:根据所述候选结节的三维坐标和所述候选结节所在预设区域内的像素,过滤掉所述置信度大于阈值的候选结节中的骨骼类假阳性的候选结节;或Filtering out candidate nodules of skeletal false positives in the candidate nodules whose confidence is greater than a threshold according to the three-dimensional coordinates of the candidate nodule and the pixels in the preset region where the candidate nodule is located; or根据所述候选结节的三维坐标及半径、所述候选结节所在身体部位的分割结果,过滤掉所述置信度大于阈值的候选结节中膈肌类假阳性的候选结节;或Filtering off the candidate nodules of the diaphragmatic pseudo-positive in the candidate nodules with the confidence greater than the threshold according to the three-dimensional coordinates and radius of the candidate nodule, and the segmentation result of the body part where the candidate nodule is located; or根据所述候选结节的三维坐标和所述候选结节所在身体部位的分割结果,过滤掉所述置信度大于阈值的候选结节中纵膈类假阳性的候选结节。According to the three-dimensional coordinates of the candidate nodule and the segmentation result of the body part where the candidate nodule is located, the candidate nodule of the mediastinal false positive in the candidate nodule with the confidence greater than the threshold is filtered out.
- 如权利要求6所述的装置,其特征在于,所述检测单元具体用于:The device according to claim 6, wherein the detecting unit is specifically configured to:获取待过滤掉假阳性结果的候选结节集和医生对所述候选结节集中各候选结节的判定结果;Obtaining a candidate nodule set to be filtered out of the false positive result and a determination result of the doctor for each candidate nodule in the candidate nodule set;对所述候选结节集中的候选结节进行数据增强,得到增强后的候选结节集;Data enhancement is performed on candidate nodules in the candidate nodule set to obtain an enhanced candidate nodule set;根据增强后的候选结节集以及各候选结节的三维坐标,从结节影像中确定所述增强后的候选结节集中各候选结节的ROI;Determining an ROI of each candidate nodule in the enhanced candidate nodule set from the nodule image according to the enhanced candidate nodule set and the three-dimensional coordinates of each candidate nodule;将所述增强后的候选结节集中各候选结节的ROI通过预设的3D卷积神 经网络模型进行训练,得到所述结节检测模型。The ROI of each candidate nodule in the enhanced candidate nodule set is trained by a preset 3D convolutional neural network model to obtain the nodule detection model.
- 一种计算机设备,其特征在于,包括:A computer device, comprising:存储器,用于存储程序指令;a memory for storing program instructions;处理器,用于调用所述存储器中存储的程序指令,按照获得的程序执行权利要求1至5任一项所述的方法。And a processor, configured to invoke the program instructions stored in the memory, and execute the method according to any one of claims 1 to 5 according to the obtained program.
- 一种计算机可读非易失性存储介质,其特征在于,包括计算机可读指令,当计算机设备读取并执行所述计算机可读指令时,使得计算机设备执行如权利要求1至5任一项所述的方法。A computer readable non-volatile storage medium, comprising computer readable instructions for causing a computer device to perform any one of claims 1 to 5 when the computer device reads and executes the computer readable instructions Said method.
- 一种计算机程序产品,其特征在于,包括存储在计算机可读非易失性存储介质上的计算机程序,所述计算机程序包括程序指令,当所述程序指令被计算机设备执行时,使所述计算机设备执行如权利要求1至5任一项所述的方法。A computer program product, comprising: a computer program stored on a computer readable non-volatile storage medium, the computer program comprising program instructions, when the program instructions are executed by a computer device, causing the computer The apparatus performs the method of any one of claims 1 to 5.
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201810345297.3 | 2018-04-17 | ||
CN201810345297.3A CN108648178A (en) | 2018-04-17 | 2018-04-17 | A kind of method and device of image nodule detection |
Publications (1)
Publication Number | Publication Date |
---|---|
WO2019201204A1 true WO2019201204A1 (en) | 2019-10-24 |
Family
ID=63746380
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
PCT/CN2019/082677 WO2019201204A1 (en) | 2018-04-17 | 2019-04-15 | Method and device for detecting nodule in image |
Country Status (2)
Country | Link |
---|---|
CN (1) | CN108648178A (en) |
WO (1) | WO2019201204A1 (en) |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN108648178A (en) * | 2018-04-17 | 2018-10-12 | 杭州依图医疗技术有限公司 | A kind of method and device of image nodule detection |
CN109363698B (en) * | 2018-10-16 | 2022-07-12 | 杭州依图医疗技术有限公司 | Method and device for identifying mammary gland image signs |
CN109492547B (en) * | 2018-10-24 | 2022-03-08 | 腾讯科技(深圳)有限公司 | Nodule identification method and device and storage medium |
CN109816655B (en) * | 2019-02-01 | 2021-05-28 | 华院计算技术(上海)股份有限公司 | Pulmonary nodule image feature detection method based on CT image |
CN110136253B (en) * | 2019-05-22 | 2022-08-23 | 珠海横琴圣澳云智科技有限公司 | Three-dimensional display device and equipment for nodules |
CN111062947B (en) * | 2019-08-14 | 2023-04-25 | 深圳市智影医疗科技有限公司 | X-ray chest radiography focus positioning method and system based on deep learning |
CN110580948A (en) * | 2019-09-12 | 2019-12-17 | 杭州依图医疗技术有限公司 | Medical image display method and display equipment |
CN111179247A (en) * | 2019-12-27 | 2020-05-19 | 上海商汤智能科技有限公司 | Three-dimensional target detection method, training method of model thereof, and related device and equipment |
CN111513765B (en) * | 2020-04-26 | 2022-08-09 | 深圳华声医疗技术股份有限公司 | Ultrasonic measurement method and device for respiratory muscle tissue and storage medium |
CN111951293A (en) * | 2020-06-30 | 2020-11-17 | 杭州依图医疗技术有限公司 | Method and computing device for displaying nodules according to confidence degrees |
CN111768845B (en) * | 2020-06-30 | 2023-08-11 | 重庆大学 | Pulmonary nodule auxiliary detection method based on optimal multi-scale perception |
CN112002406A (en) * | 2020-07-10 | 2020-11-27 | 杭州依图医疗技术有限公司 | Nodule display method based on confidence coefficient and computing equipment |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8224057B2 (en) * | 2007-10-18 | 2012-07-17 | Siemens Aktiengesellschaft | Method and system for nodule feature extraction using background contextual information in chest x-ray images |
CN106504232A (en) * | 2016-10-14 | 2017-03-15 | 北京网医智捷科技有限公司 | A kind of pulmonary nodule automatic testing method based on 3D convolutional neural networks |
CN107016665A (en) * | 2017-02-16 | 2017-08-04 | 浙江大学 | A kind of CT pulmonary nodule detection methods based on depth convolutional neural networks |
CN107480677A (en) * | 2017-08-07 | 2017-12-15 | 北京深睿博联科技有限责任公司 | The method and device of area-of-interest in a kind of identification three-dimensional CT image |
CN108648178A (en) * | 2018-04-17 | 2018-10-12 | 杭州依图医疗技术有限公司 | A kind of method and device of image nodule detection |
Family Cites Families (8)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6125194A (en) * | 1996-02-06 | 2000-09-26 | Caelum Research Corporation | Method and system for re-screening nodules in radiological images using multi-resolution processing, neural network, and image processing |
CN100562291C (en) * | 2006-11-08 | 2009-11-25 | 沈阳东软医疗系统有限公司 | A kind of at CT treatment of picture device, method and system |
US20100266173A1 (en) * | 2007-11-14 | 2010-10-21 | Koninklijke Philips Electronics N.V. | Computer-aided detection (cad) of a disease |
CN105513036B (en) * | 2014-09-26 | 2019-05-31 | 上海联影医疗科技有限公司 | The dividing method and device of three-dimensional CT image |
CN105912831B (en) * | 2015-02-19 | 2021-08-20 | 松下知识产权经营株式会社 | Control method of information terminal |
CN104751178B (en) * | 2015-03-31 | 2018-04-03 | 上海理工大学 | Lung neoplasm detection means and method based on shape template matching combining classification device |
CN106940816B (en) * | 2017-03-22 | 2020-06-09 | 杭州健培科技有限公司 | CT image pulmonary nodule detection system based on 3D full convolution neural network |
CN107154043B (en) * | 2017-06-05 | 2020-03-24 | 杭州健培科技有限公司 | Pulmonary nodule false positive sample inhibition method based on 3DCNN |
-
2018
- 2018-04-17 CN CN201810345297.3A patent/CN108648178A/en active Pending
-
2019
- 2019-04-15 WO PCT/CN2019/082677 patent/WO2019201204A1/en active Application Filing
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8224057B2 (en) * | 2007-10-18 | 2012-07-17 | Siemens Aktiengesellschaft | Method and system for nodule feature extraction using background contextual information in chest x-ray images |
CN106504232A (en) * | 2016-10-14 | 2017-03-15 | 北京网医智捷科技有限公司 | A kind of pulmonary nodule automatic testing method based on 3D convolutional neural networks |
CN107016665A (en) * | 2017-02-16 | 2017-08-04 | 浙江大学 | A kind of CT pulmonary nodule detection methods based on depth convolutional neural networks |
CN107480677A (en) * | 2017-08-07 | 2017-12-15 | 北京深睿博联科技有限责任公司 | The method and device of area-of-interest in a kind of identification three-dimensional CT image |
CN108648178A (en) * | 2018-04-17 | 2018-10-12 | 杭州依图医疗技术有限公司 | A kind of method and device of image nodule detection |
Also Published As
Publication number | Publication date |
---|---|
CN108648178A (en) | 2018-10-12 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
WO2019201204A1 (en) | Method and device for detecting nodule in image | |
US10846853B2 (en) | Medical image processing apparatus, medical image processing method, and medical image processing program | |
US10878573B2 (en) | System and method for segmentation of lung | |
US10980493B2 (en) | Medical image display device, method, and program | |
CN109685060B (en) | Image processing method and device | |
WO2020182036A1 (en) | Image processing method and apparatus, server, and storage medium | |
US20180247154A1 (en) | Image classification apparatus, method, and program | |
US10748282B2 (en) | Image processing system, apparatus, method and storage medium | |
JP2017174039A (en) | Image classification device, method, and program | |
US11741598B2 (en) | Method for aiding visualization of lesions in medical imagery and apparatus using the same | |
US20210056337A1 (en) | Recognition processing device, recognition processing method, and program | |
US12106533B2 (en) | Method and system for segmenting interventional device in image | |
TWI714025B (en) | Image identifying method and image identifying device | |
CN114332132A (en) | Image segmentation method and device and computer equipment | |
CN110992310A (en) | Method and device for determining partition where mediastinal lymph node is located | |
CN108597589B (en) | Model generation method, target detection method and medical imaging system | |
CN112446911A (en) | Centerline extraction, interface interaction and model training method, system and equipment | |
CN108681731A (en) | A kind of thyroid cancer ultrasound picture automatic marking method and system | |
CN106558057B (en) | A kind of medical image cutting method | |
JP7321671B2 (en) | Information processing device, information processing method, information processing system and program | |
CN114092470B (en) | Deep learning-based automatic detection method and device for pulmonary fissure | |
CN112712507A (en) | Method and device for determining calcified area of coronary artery | |
JP6634186B2 (en) | Image processing system and image processing method | |
CN111353975A (en) | Network model training method and device and focus positioning method and device | |
JP5403431B2 (en) | Tomographic image processing method and apparatus |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
121 | Ep: the epo has been informed by wipo that ep was designated in this application |
Ref document number: 19787871 Country of ref document: EP Kind code of ref document: A1 |
|
NENP | Non-entry into the national phase |
Ref country code: DE |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19787871 Country of ref document: EP Kind code of ref document: A1 |
|
32PN | Ep: public notification in the ep bulletin as address of the adressee cannot be established |
Free format text: NOTING OF LOSS OF RIGHTS PURSUANT TO RULE 112(1) EPC (EPO FORM 1205A DATED 10.03.2021) |
|
122 | Ep: pct application non-entry in european phase |
Ref document number: 19787871 Country of ref document: EP Kind code of ref document: A1 |