CN111815613B - A method for identifying liver cirrhosis disease stages based on the analysis of envelope line morphological features - Google Patents
A method for identifying liver cirrhosis disease stages based on the analysis of envelope line morphological features Download PDFInfo
- Publication number
- CN111815613B CN111815613B CN202010692369.9A CN202010692369A CN111815613B CN 111815613 B CN111815613 B CN 111815613B CN 202010692369 A CN202010692369 A CN 202010692369A CN 111815613 B CN111815613 B CN 111815613B
- Authority
- CN
- China
- Prior art keywords
- slope
- liver
- segment
- membrane
- capsule
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Active
Links
- 238000000034 method Methods 0.000 title claims abstract description 51
- 208000019425 cirrhosis of liver Diseases 0.000 title claims abstract description 33
- 230000000877 morphologic effect Effects 0.000 title claims abstract description 19
- 238000004458 analytical method Methods 0.000 title claims abstract description 16
- 208000037265 diseases, disorders, signs and symptoms Diseases 0.000 title claims abstract description 14
- 210000004185 liver Anatomy 0.000 claims abstract description 97
- 239000002775 capsule Substances 0.000 claims abstract description 76
- 239000012528 membrane Substances 0.000 claims abstract description 61
- 206010016654 Fibrosis Diseases 0.000 claims abstract description 10
- 230000007882 cirrhosis Effects 0.000 claims abstract description 10
- 230000008569 process Effects 0.000 claims description 29
- 238000002790 cross-validation Methods 0.000 claims description 6
- 238000003064 k means clustering Methods 0.000 claims description 4
- 238000012706 support-vector machine Methods 0.000 claims description 4
- 238000002604 ultrasonography Methods 0.000 description 38
- 206010003445 Ascites Diseases 0.000 description 18
- 230000002440 hepatic effect Effects 0.000 description 14
- 230000006872 improvement Effects 0.000 description 9
- 238000012545 processing Methods 0.000 description 6
- 238000003745 diagnosis Methods 0.000 description 5
- 238000010586 diagram Methods 0.000 description 5
- 238000001514 detection method Methods 0.000 description 3
- 230000014509 gene expression Effects 0.000 description 3
- 238000011161 development Methods 0.000 description 2
- 230000000694 effects Effects 0.000 description 2
- 230000003628 erosive effect Effects 0.000 description 2
- 208000019423 liver disease Diseases 0.000 description 2
- 210000000056 organ Anatomy 0.000 description 2
- 238000010845 search algorithm Methods 0.000 description 2
- 238000012935 Averaging Methods 0.000 description 1
- 206010057573 Chronic hepatic failure Diseases 0.000 description 1
- 208000010334 End Stage Liver Disease Diseases 0.000 description 1
- 206010067125 Liver injury Diseases 0.000 description 1
- 230000003044 adaptive effect Effects 0.000 description 1
- 230000002411 adverse Effects 0.000 description 1
- 210000003567 ascitic fluid Anatomy 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000008859 change Effects 0.000 description 1
- 230000001684 chronic effect Effects 0.000 description 1
- 208000011444 chronic liver failure Diseases 0.000 description 1
- 231100000012 chronic liver injury Toxicity 0.000 description 1
- 238000013145 classification model Methods 0.000 description 1
- 238000003759 clinical diagnosis Methods 0.000 description 1
- 238000004195 computer-aided diagnosis Methods 0.000 description 1
- 230000007547 defect Effects 0.000 description 1
- 238000002059 diagnostic imaging Methods 0.000 description 1
- 230000010339 dilation Effects 0.000 description 1
- 201000010099 disease Diseases 0.000 description 1
- 230000006870 function Effects 0.000 description 1
- 238000010801 machine learning Methods 0.000 description 1
- 239000011159 matrix material Substances 0.000 description 1
- 238000005259 measurement Methods 0.000 description 1
- 238000000409 membrane extraction Methods 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 208000007232 portal hypertension Diseases 0.000 description 1
- 230000000750 progressive effect Effects 0.000 description 1
- 238000004445 quantitative analysis Methods 0.000 description 1
- 230000001172 regenerating effect Effects 0.000 description 1
- 238000010187 selection method Methods 0.000 description 1
- 230000009466 transformation Effects 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/23—Clustering techniques
- G06F18/232—Non-hierarchical techniques
- G06F18/2321—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
- G06F18/23213—Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06F—ELECTRIC DIGITAL DATA PROCESSING
- G06F18/00—Pattern recognition
- G06F18/20—Analysing
- G06F18/24—Classification techniques
- G06F18/241—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches
- G06F18/2411—Classification techniques relating to the classification model, e.g. parametric or non-parametric approaches based on the proximity to a decision surface, e.g. support vector machines
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06Q—INFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
- G06Q10/00—Administration; Management
- G06Q10/04—Forecasting or optimisation specially adapted for administrative or management purposes, e.g. linear programming or "cutting stock problem"
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/90—Determination of colour characteristics
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10132—Ultrasound image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20081—Training; Learning
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/20—Special algorithmic details
- G06T2207/20084—Artificial neural networks [ANN]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30056—Liver; Hepatic
-
- Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
- Y02—TECHNOLOGIES OR APPLICATIONS FOR MITIGATION OR ADAPTATION AGAINST CLIMATE CHANGE
- Y02A—TECHNOLOGIES FOR ADAPTATION TO CLIMATE CHANGE
- Y02A90/00—Technologies having an indirect contribution to adaptation to climate change
- Y02A90/10—Information and communication technologies [ICT] supporting adaptation to climate change, e.g. for weather forecasting or climate simulation
Landscapes
- Engineering & Computer Science (AREA)
- Theoretical Computer Science (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Data Mining & Analysis (AREA)
- Business, Economics & Management (AREA)
- Economics (AREA)
- Human Resources & Organizations (AREA)
- Evolutionary Biology (AREA)
- Evolutionary Computation (AREA)
- General Engineering & Computer Science (AREA)
- Bioinformatics & Cheminformatics (AREA)
- Artificial Intelligence (AREA)
- Life Sciences & Earth Sciences (AREA)
- Quality & Reliability (AREA)
- Bioinformatics & Computational Biology (AREA)
- Strategic Management (AREA)
- Entrepreneurship & Innovation (AREA)
- General Business, Economics & Management (AREA)
- Probability & Statistics with Applications (AREA)
- Marketing (AREA)
- Operations Research (AREA)
- Development Economics (AREA)
- Tourism & Hospitality (AREA)
- Game Theory and Decision Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Image Analysis (AREA)
- Image Processing (AREA)
Abstract
本发明提供了一种基于包膜线形态特征分析的肝硬化疾病分期识别方法,其包括:根据超声波图像获取肝包膜的预测膜和真实膜;从预测膜中获取分段斜率的方差VoS、相邻段斜率差的变异系数CV、波动变化的次数NoF;并从真实膜中获取线段的数量NoL;初步预测中,将VoS、NoF以及CV作为输入特征输入以识别“正常‑前期”和“中期‑后期”两种情况;若初步识别的结果为“正常‑前期”,将NoL以及CV作为特征输入轻度识别模型,以判断正常和轻度肝硬化;若初步识别的结果为“中期‑后期”,将NoL以及VoS作为特征输入中后期识别模型,以识别中度肝硬化和重度肝硬化。本发明结合肝包膜预测膜和真实膜两种形态下的特征进行分析,可以对肝包膜形态特征进行充分展示。
The present invention provides a liver cirrhosis disease stage recognition method based on the analysis of envelope line morphological characteristics, which comprises: obtaining the predicted membrane and the real membrane of the liver capsule according to the ultrasonic image; obtaining the variance VoS of the segmental slope from the predicted membrane, The coefficient of variation CV of the slope difference of adjacent segments, the number of fluctuations NoF; and the number of line segments NoL is obtained from the real film; in the preliminary prediction, VoS, NoF and CV are input as input features to identify "normal-early" and " mid-late stage”; if the preliminary identification result is “normal-early”, input NoL and CV as features into the mild recognition model to judge normal and mild liver cirrhosis; if the preliminary identification result is “mid-term- Late stage”, NoL and VoS are input as features into the mid-late stage recognition model to identify moderate cirrhosis and severe cirrhosis. The present invention combines the characteristics of the predicted membrane and the real membrane of the liver capsule for analysis, and can fully display the morphological characteristics of the liver capsule.
Description
技术领域technical field
本发明涉及医疗影像领域,具体地,涉及一种基于包膜线形态特征分析的肝硬化疾病分期识别方法。The invention relates to the field of medical imaging, in particular to a method for identifying liver cirrhosis disease stages based on the analysis of envelope line morphological characteristics.
背景技术Background technique
肝硬化是一种临床常见的慢性进行性肝病,具体被定义为慢性肝损伤引起的再生结节周围纤维带的组织学发展,而随着肝硬化的进一步发展,可导致门脉高压和终末期肝病,具有较高的死亡率,对于肝硬化早期的检测及治疗是十分有必要的。目前临床上对于肝硬化的诊断主要依靠医生的主观人工判断,由于经验等客观因素的影响,可能会导致个体诊断存在很大的差异性,因此,基于定量分析的计算机辅助诊断肝硬化系统是十分有必要的。Cirrhosis is a clinically common chronic progressive liver disease, specifically defined as the histological development of fibrous bands around regenerative nodules caused by chronic liver injury, and with the further development of cirrhosis, it can lead to portal hypertension and end-stage Liver disease has a high mortality rate, and it is very necessary for early detection and treatment of liver cirrhosis. At present, the clinical diagnosis of liver cirrhosis mainly depends on the subjective manual judgment of doctors. Due to the influence of objective factors such as experience, there may be great differences in individual diagnosis. Therefore, the computer-aided diagnosis system for liver cirrhosis based on quantitative analysis is very important. Necessary.
传统的基于肝包膜图像的肝硬化辅助诊断方法,主要根据单一的真实膜或者单一的预测膜,然后基于机器学习算法实现其特征的分类鉴别,此类方法可能会导致部分特征的丢失,从而使得特征的分类识别精度较低,无法准确地判断疾病分期,对临床的辅助诊断产生不利的影响。因此,不能满足于当下临床辅助诊断的需求。The traditional method of auxiliary diagnosis of liver cirrhosis based on liver capsule images is mainly based on a single real membrane or a single predicted membrane, and then realizes the classification and identification of its features based on machine learning algorithms. Such methods may lead to the loss of some features, thus As a result, the accuracy of feature classification and recognition is low, and the disease stage cannot be accurately judged, which has an adverse effect on clinical auxiliary diagnosis. Therefore, it cannot meet the needs of the current clinical auxiliary diagnosis.
发明内容Contents of the invention
针对现有技术中的缺陷,本发明的目的是提供一种基于包膜线形态特征分析的肝硬化疾病分期识别方法,从超声图像中获取肝包膜的预测膜和真实膜,并从中获取识别特征,实现了肝硬化的分期识别。In view of the defects in the prior art, the purpose of the present invention is to provide a method for identifying liver cirrhosis disease stages based on the analysis of capsule line morphological characteristics, which can obtain the predicted membrane and real membrane of the liver capsule from the ultrasound image, and obtain the recognition method therefrom. Features, realizing the staging recognition of liver cirrhosis.
本发明提供的技术方案是:The technical scheme provided by the invention is:
一种基于包膜线形态特征分析的肝硬化疾病分期识别方法,其包括:A method for identifying liver cirrhosis disease stages based on the analysis of envelope line morphological characteristics, comprising:
(S1)根据超声波图像获取肝包膜的预测膜和真实膜;(S1) Obtain the predicted membrane and real membrane of the liver capsule according to the ultrasonic image;
(S2)从预测膜中获取肝包膜的分段斜率的方差VoS、相邻段斜率差的变异系数CV、波动变化的次数NoF;并从真实膜中获取肝包膜的线段的数量NoL;(S2) Obtain the variance VoS of the subsection slope of the liver capsule, the coefficient of variation CV of the slope difference of adjacent segments, the number of times NoF of fluctuation changes from the predicted film; and obtain the number NoL of the line segments of the liver capsule from the real film;
(S3)将分段斜率的方差VoS、波动变化的次数NoF以及邻段斜率差的变异系数CV作为输入特征输入到初步识别模型中,初步识别模型输出的两种判断类型为“正常-前期”和“中期-后期”;(S3) The variance VoS of the segmental slope, the number of fluctuations NoF and the coefficient of variation CV of the slope difference of adjacent segments are input into the preliminary identification model as input features, and the two judgment types output by the preliminary identification model are "normal-early stage" and "mid-late";
(S4)根据初步识别的结果进行二次分类;在二次分类中,(S4) carry out secondary classification according to the result of primary recognition; In secondary classification,
若初步识别的结果为“正常-前期”,将线段的数量NoL以及邻段斜率差的变异系数CV作为特征输入轻度识别模型,所述轻度识别模型输出的两种识别类型为“正常”和“轻度肝硬化”;If the result of preliminary recognition is "normal-early stage", the number of line segments NoL and the coefficient of variation CV of the slope difference of adjacent segments are input into the light recognition model as features, and the two recognition types output by the light recognition model are "normal". and "mild cirrhosis";
若初步识别的结果为“中期-后期”,将线段的数量NoL以及分段斜率的方差VoS作为特征输入中后期识别模型,所述中轻度识别模型输出的两种识别类型为“中度肝硬化”和“重度肝硬化”。If the result of the preliminary recognition is "middle-late stage", the number of line segments NoL and the variance VoS of the segmental slope are input into the mid-late stage recognition model as features, and the two recognition types output by the moderate and mild recognition model are "moderate liver cirrhosis ” and “severe cirrhosis”.
本发明的进一步改进在于,获取线段的数量NoL的过程中,统计真实膜中的断点数量,并根据断点数量确定肝包膜的线段的数量NoL。A further improvement of the present invention is that in the process of obtaining the number NoL of line segments, the number of breakpoints in the real membrane is counted, and the number NoL of line segments of the liver envelope is determined according to the number of breakpoints.
本发明的进一步改进在于,获取肝包膜的分段斜率的方差VoS时,将肝包膜的预测膜按照预定间隔分割为若干分段,分别计算每一分段的斜率,并计算各分段斜率的方差,以得到分段斜率的方差VoS。A further improvement of the present invention is that when obtaining the variance VoS of the segmental slope of the liver capsule, the predicted membrane of the liver capsule is divided into several segments according to a predetermined interval, the slope of each segment is calculated separately, and the The variance of the slope to get the variance VoS of the segmented slope.
本发明的进一步改进在于,获取相邻段斜率差的变异系数CV的过程中,计算预测膜的各相邻分段之间的斜率差,并求得各斜率差的均值以及标准差STDKd;将标准差STDKd处以均值/>即可得到相邻段斜率差的变异系数CV。The further improvement of the present invention is that in the process of obtaining the coefficient of variation CV of the slope difference of adjacent segments, the slope difference between each adjacent segment of the predicted film is calculated, and the mean value of each slope difference is obtained And the standard deviation STD Kd ; put the standard deviation STD Kd at the mean value /> The coefficient of variation CV of the slope difference of adjacent segments can be obtained.
本发明的进一步改进在于,获取波动变化的次数NoF的过程中,计算各相邻分段之间的斜率差的绝对值,并统计斜率差的绝对值大于波动阈值的次数并以此作为波动变化的次数NoF。A further improvement of the present invention is that in the process of obtaining the number of fluctuations NoF, the absolute value of the slope difference between each adjacent segment is calculated, and the number of times the absolute value of the slope difference is greater than the fluctuation threshold is counted as the fluctuation change The number of times NoF.
本发明的进一步改进在于,分隔所述肝包膜的预测膜的过程中,每个分段具有相同数量的像素;计算分段的斜率时,采用分段的两个端点之间的斜率作为分段斜率,或者采用分段中各像素拟合后的直线的斜率作为分段斜率。A further improvement of the present invention is that, in the process of separating the predicted membrane of the liver envelope, each segment has the same number of pixels; when calculating the slope of the segment, the slope between the two endpoints of the segment is used as the segment. Segment slope, or use the slope of the line fitted by each pixel in the segment as the segment slope.
本发明的进一步改进在于,所述超声波图像为肝脏浅表切面图像,其包括肝脏上缘的肝包膜。A further improvement of the present invention is that the ultrasonic image is a superficial section image of the liver, which includes the liver capsule at the upper edge of the liver.
本发明的进一步改进在于,所述初步识别模型为支持向量机模型,采用十次五折交叉验证的方式训练得到。A further improvement of the present invention lies in that the preliminary recognition model is a support vector machine model, which is trained by ten times of five-fold cross-validation.
本发明的进一步改进在于,所述轻度识别模型以及所述中后期识别模型均为K均值聚类模型,采用十次五折交叉验证的方式训练得到。A further improvement of the present invention is that the mild recognition model and the mid-late recognition model are both K-means clustering models, which are trained by ten times of 50-fold cross-validation.
与现有技术相比,本发明具有如下的有益效果:Compared with the prior art, the present invention has the following beneficial effects:
1)结合肝包膜预测膜和真实膜两种形态下的特征进行分析,可以对肝包膜形态特征进行充分展示。1) Combined with the analysis of the characteristics of the predicted membrane and the real membrane of the liver capsule, the morphological characteristics of the liver capsule can be fully displayed.
2)利用支持向量机和K均值聚类的两阶段分类模型,提升了分类精度,为临床辅助诊断提供了可靠保障。2) Using the two-stage classification model of support vector machine and K-means clustering, the classification accuracy is improved, which provides a reliable guarantee for clinical auxiliary diagnosis.
附图说明Description of drawings
通过阅读参照以下附图对非限制性实施例所作的详细描述,本发明的其它特征、目的和优点将会变得更明显:Other characteristics, objects and advantages of the present invention will become more apparent by reading the detailed description of non-limiting embodiments made with reference to the following drawings:
图1为基于包膜线形态特征分析的肝硬化疾病分期识别方法的流程图;Fig. 1 is the flow chart of the identification method of liver cirrhosis disease stage based on envelope line morphological feature analysis;
图2为本发明中采用的识别模型的原理图;Fig. 2 is the schematic diagram of the recognition model adopted in the present invention;
图3为基于数字图像处理技术的肝硬化超声图像肝包膜提取方法的流程图;3 is a flow chart of a method for extracting liver capsule from an ultrasound image of liver cirrhosis based on digital image processing technology;
图4为滑动窗口检测原理示意图;Fig. 4 is a schematic diagram of the principle of sliding window detection;
图5为无腹水图像肝包膜遍历搜索算法原理示意图;Figure 5 is a schematic diagram of the principle of the liver capsule traversal search algorithm for images without ascites;
图6为有腹水图像肝包膜遍历搜索算法原理示意图;Fig. 6 is a schematic diagram of the principles of the liver capsule traversal search algorithm for images with ascites;
图7为真实膜提取过程的示意图。Figure 7 is a schematic diagram of the real membrane extraction process.
具体实施方式Detailed ways
下面结合具体实施例对本发明进行详细说明。以下实施例将有助于本领域的技术人员进一步理解本发明,但不以任何形式限制本发明。应当指出的是,对本领域的普通技术人员来说,在不脱离本发明构思的前提下,还可以做出若干变化和改进。这些都属于本发明的保护范围。The present invention will be described in detail below in conjunction with specific embodiments. The following examples will help those skilled in the art to further understand the present invention, but do not limit the present invention in any form. It should be noted that those skilled in the art can make several changes and improvements without departing from the concept of the present invention. These all belong to the protection scope of the present invention.
如图1所示,本发明的实施例包括一种基于包膜线形态特征分析的肝硬化疾病分期识别方法,该方法包括以下步骤:As shown in Figure 1, the embodiment of the present invention includes a method for identifying liver cirrhosis disease stages based on the analysis of envelope line morphological characteristics, the method includes the following steps:
(S1)根据超声波图像获取肝包膜的预测膜和真实膜。本实施例中采用的超声波图像为肝脏浅表切面图像,该超声波图像肝脏上缘的肝包膜。如图5所示,肝脏浅表切面图像的下半部分为肝实质,上半部分为其他器官,肝包膜位于图像中部。预测膜中包含了肝包膜的趋势信息,而预测膜中包含了肝包膜的波动情况,具有丰富的细节;预测膜与真实膜相结合,可以为下游的肝病自动判断提供了丰富的特征。(S1) Obtain the predicted and real membranes of the liver capsule from the ultrasound image. The ultrasound image used in this embodiment is a superficial slice image of the liver, and the ultrasound image is the liver capsule at the upper edge of the liver. As shown in Figure 5, the lower half of the liver superficial section image is the liver parenchyma, the upper half is other organs, and the liver capsule is located in the middle of the image. The prediction film contains the trend information of the liver capsule, and the prediction film contains the fluctuation of the liver capsule, which has rich details; the combination of the prediction film and the real film can provide rich features for the automatic judgment of downstream liver diseases .
(S2)从预测膜中获取肝包膜的分段斜率的方差VoS、相邻段斜率差的变异系数CV、波动变化的次数NoF;并从真实膜中获取肝包膜的线段的数量NoL。上述特征用于作为后续的识别任务的输入特征。(S2) Obtain the variance VoS of the segmental slope of the liver capsule, the coefficient of variation CV of the slope difference between adjacent segments, and the number of fluctuations NoF from the predicted film; and obtain the number NoL of the line segments of the liver capsule from the real film. The above features are used as input features for subsequent recognition tasks.
具体的,肝包膜的预测膜是从超声图像中获得的肝包膜的初步识别结果,肝包膜的线段的数量NoL从预测膜中计算得到,用于表示肝包膜的连续性。获取线段的数量(Number of Line,NoL)的过程中,统计真实膜中的断点数量,并根据断点数量确定肝包膜的线段的数量NoL。其表达式为:Specifically, the predicted membrane of the liver capsule is a preliminary identification result of the liver capsule obtained from the ultrasound image, and the number NoL of line segments of the liver capsule is calculated from the predicted membrane, and is used to represent the continuity of the liver capsule. In the process of obtaining the number of line segments (Number of Line, NoL), the number of breakpoints in the real membrane is counted, and the number of line segments NoL of the liver envelope is determined according to the number of breakpoints. Its expression is:
NoL=kNoL=k
L={li|i=1,......,k} (1)L={l i |i=1,...,k} (1)
L{li|i1,......,k}表示构成整个肝包膜的线段的集合。本实施例中,“线段的数量NoL”中的“线段”并非是几何学中两点之间的直线,本实施例中的“线段”指的是两点肝包膜的真实膜中的分段,其可以是直线也可以是曲线。L{l i |i1,...,k} represents a collection of line segments constituting the entire liver capsule. In this embodiment, the "line segment" in "the number of line segments NoL" is not a straight line between two points in geometry, and the "line segment" in this embodiment refers to the points in the real membrane of the liver capsule. Segments, which can be straight or curved.
肝包膜的分段斜率的方差(Variance of slope,VoS)以及相邻段斜率差的变异系数CV用于表示肝包膜的平滑性。平滑性主要描述了肝包膜的波动情况,可有效地描述肝包膜的整体走向趋势及波动情况。由于不同分期下肝包膜存在着断续的情况,为了避免间断区域对特征分析的影响,本实施例在各分段中分别采用相同间距(相同像素数量)进行分段划分,然后通过对各分段中分段斜率进行综合分析,从而得到整体的肝包膜特征。The variance of the segmental slope of the liver capsule (Variance of slope, VoS) and the coefficient of variation CV of the slope difference between adjacent segments were used to represent the smoothness of the liver capsule. Smoothness mainly describes the fluctuation of the liver capsule, which can effectively describe the overall trend and fluctuation of the liver capsule. Due to the discontinuity of the liver capsule at different stages, in order to avoid the influence of the discontinuous area on the feature analysis, this embodiment adopts the same spacing (same number of pixels) in each segment to divide the segments, and then divides each segment by The segmental slope in the segment is analyzed comprehensively, so as to obtain the overall liver capsule characteristics.
获取肝包膜的分段斜率的方差VoS时,将肝包膜的预测膜按照预定间隔分割为若干分段,分别计算每一分段的斜率,并计算各分段斜率的方差,以得到分段斜率的方差VoS。When obtaining the variance VoS of the segmental slope of the liver capsule, the predicted membrane of the liver capsule is divided into several segments according to a predetermined interval, and the slope of each segment is calculated separately, and the variance of the slope of each segment is calculated to obtain the score The variance VoS of the segment slope.
具体的,假设肝包膜的图像存在断点,预测膜由于断点分成m段,其中m=(1,2,...,i),将预测膜的段以相同间隔P分成n个分段,其中n=(1,2,...,j),则整条肝包膜图像中存在NL条分段数。Specifically, assuming that there is a breakpoint in the image of the liver capsule, the predicted membrane is divided into m segments due to the breakpoint, where m=(1,2,...,i), the segment of the predicted membrane is divided into n segments at the same interval P Segments, where n=(1,2,...,j), then there are N L segments in the whole liver capsule image.
式中ni表示预测膜第i段中分段的数量。从而可知每段中各分段的斜率如公式3所示,而最终整条肝包膜的斜率方差如式4所示。where n i represents the number of segments in the i-th segment of the predicted membrane. Therefore, it can be known that the slope of each segment in each segment is shown in formula 3, and the final slope variance of the entire liver capsule is shown in formula 4.
式中Kij表示第i段中第j分段的斜率,(xEij,yEij)和(xFij,yFij)分别表示每个分段首尾像素点的坐标,表示整条肝包膜中所有分段斜率的平均值。本实施例中,计算分段的斜率时,采用分段的两个端点之间的斜率作为分段斜率,在具体实施过程中,也可采用分段中各像素拟合后的直线的斜率作为分段斜率。In the formula, K ij represents the slope of the j-th segment in the i-th segment, (x Eij , y Eij ) and (x Fij , y Fij ) represent the coordinates of the first and last pixels of each segment, respectively, Indicates the average of the slopes of all segments in the entire liver capsule. In this embodiment, when calculating the slope of the segment, the slope between the two endpoints of the segment is used as the segment slope. In the specific implementation process, the slope of the straight line fitted by each pixel in the segment can also be used as the Segment slope.
变异系数是衡量指标中各观测值变异程度的一个统计量,因此,本实施例在得到各分段斜率的基础上,通过分析相邻段斜率差值的变异程度,从而更好地实现对肝包膜波动性的描述。The coefficient of variation is a statistic of the degree of variation of each observed value in the measurement index. Therefore, on the basis of obtaining the slope of each segment, this embodiment analyzes the degree of variation of the difference between the slopes of adjacent segments, so as to better realize the liver Description of envelope volatility.
计算相邻段斜率差的变异系数CV的过程中,计算预测膜的各相邻分段之间的斜率差,并求得各斜率差的均值以及标准差STDKd;将标准差STDKd处以均值/>即可得到相邻段斜率差的变异系数CV。相邻段斜率差的变异系数CV如公式6所示。In the process of calculating the coefficient of variation CV of the slope difference of adjacent segments, the slope difference between each adjacent segment of the predicted film is calculated, and the average value of each slope difference is obtained And the standard deviation STD Kd ; put the standard deviation STD Kd at the mean value /> The coefficient of variation CV of the slope difference of adjacent segments can be obtained. The coefficient of variation CV of the slope difference between adjacent segments is shown in Equation 6.
式中Kd表示相邻小线段的斜率差,STDKd表示斜率差的标准差,表示斜率差的均值。In the formula , Kd represents the slope difference of adjacent small line segments, STD Kd represents the standard deviation of the slope difference, Indicates the mean of the slope differences.
获取波动变化的次数NoF的过程中,计算各相邻分段之间的斜率差的绝对值,并统计斜率差的绝对值大于波动阈值的次数并以此作为波动变化的次数NoF。本实施例中,波动阈值为0.3。相邻分段之间的Kd的绝对值|Kd|,大于0.3时,将其视为一次波动。预测膜中波动的总数为波动变化的次数(Number of fluctuations,NoF)。In the process of obtaining the number of fluctuations NoF, the absolute value of the slope difference between adjacent segments is calculated, and the number of times the absolute value of the slope difference is greater than the fluctuation threshold is counted as the number of fluctuations NoF. In this embodiment, the fluctuation threshold is 0.3. When the absolute value |K d | of K d between adjacent segments is greater than 0.3, it is regarded as a fluctuation. The total number of fluctuations in the predicted membrane is the number of fluctuations (NoF).
(S3)将分段斜率的方差VoS、波动变化的次数NoF以及邻段斜率差的变异系数CV作为输入特征输入到初步识别模型中,初步识别模型输出的两种判断类型为“正常-前期”和“中期-后期”。(S3) The variance VoS of the segmental slope, the number of fluctuations NoF and the coefficient of variation CV of the slope difference of adjacent segments are input into the preliminary identification model as input features, and the two judgment types output by the preliminary identification model are "normal-early stage" and "mid-late".
如图2所示,在具体实施过程中,将分段斜率的方差VoS、波动变化的次数NoF以及邻段斜率差的变异系数CV三个特征组成一个三维向量,输入至初步识别模型中,初步识别模型为支持向量机模型,采用十次五折交叉验证的方式训练得到,该模型可以得到“正常-前期”和“中期-后期”两大类鉴别结果。将这两大类的鉴别结果求平均值,可以得到该模型的识别精度。As shown in Figure 2, in the specific implementation process, the three characteristics of the variance VoS of the segmental slope, the number of fluctuations NoF, and the coefficient of variation CV of the slope difference of adjacent segments form a three-dimensional vector, which is input into the preliminary identification model. The identification model is a support vector machine model, which is trained by ten times of five-fold cross-validation. The model can obtain two types of identification results: "normal-early" and "middle-late". The identification accuracy of the model can be obtained by averaging the identification results of these two categories.
(S4)根据初步识别的结果进行二次分类。如图2所示,在二次分类中,需要考虑根据初步识别的结果确定相应的模型,具体的:(S4) Carry out secondary classification according to the result of the primary recognition. As shown in Figure 2, in the secondary classification, it is necessary to consider determining the corresponding model based on the results of the preliminary identification, specifically:
若初步识别的结果为“正常-前期”,将线段的数量NoL以及邻段斜率差的变异系数CV作为特征输入轻度识别模型,所述轻度识别模型输出的两种识别类型为“正常”和“轻度肝硬化”。轻度识别模型可以分析肝包膜的连续性及平滑性,得到最终的识别结果。If the result of preliminary recognition is "normal-early stage", the number of line segments NoL and the coefficient of variation CV of the slope difference of adjacent segments are input into the light recognition model as features, and the two recognition types output by the light recognition model are "normal". and "mild cirrhosis". The mild recognition model can analyze the continuity and smoothness of the liver capsule to obtain the final recognition result.
若初步识别的结果为“中期-后期”,将线段的数量NoL以及分段斜率的方差VoS作为特征输入中后期识别模型,所述中轻度识别模型输出的两种识别类型为“中度肝硬化”和“重度肝硬化”。If the result of the preliminary recognition is "middle-late stage", the number of line segments NoL and the variance VoS of the segmental slope are input into the mid-late stage recognition model as features, and the two recognition types output by the moderate and mild recognition model are "moderate liver cirrhosis ” and “severe cirrhosis”.
上述的轻度识别模型以及所述中后期识别模型均为K均值聚类模型,采用十次五折交叉验证的方式训练得到。上述模型的识别结果取其平均值可作为识别精度。The above-mentioned mild recognition model and the mid-late recognition model are both K-means clustering models, which are trained by ten times of five-fold cross-validation. The average value of the recognition results of the above models can be taken as the recognition accuracy.
本实施例的步骤(S1)用于对肝脏浅表切面图像进行处理,肝脏浅表切面图像是在患者特定位置获取的超声波图像。肝脏浅表切面图像如图5所示,该图包括了肝脏上缘的肝包膜,图像的下半部分为肝实质,上半部分为其他器官。The step (S1) of this embodiment is used to process the image of the superficial section of the liver, and the image of the superficial section of the liver is an ultrasonic image acquired at a specific position of the patient. The superficial section image of the liver is shown in Figure 5, which includes the liver capsule at the upper edge of the liver, the lower half of the image is the liver parenchyma, and the upper half is other organs.
如图3所示,本实施例步骤(S1)中,提取肝包膜的预测膜和真实膜包括以下步骤:As shown in Figure 3, in the step (S1) of this embodiment, extracting the predicted membrane and the real membrane of the liver envelope includes the following steps:
(S11)利用滑动窗口算法对超声图像的上部进行遍历,以识别所述超声图像中是否有肝腹水区域。本步骤具体包括:(S11) Traversing the upper part of the ultrasound image by using a sliding window algorithm to identify whether there is a hepatic ascites area in the ultrasound image. This step specifically includes:
(S111)采用采用一个L×L的方形窗口并以步长L在超声图像上半部分自左向右、自上向下滑动,从而遍历超声图像的上半部分;遍历过程中,求取每个窗口的平均灰度,并将平均灰度与窗口阈值进行比较,若平均灰度小于所述窗口阈值,则判断该窗口中存在肝腹水特征;滑动窗口检测原理如图4所示。(S111) Adopt a L×L square window and slide from left to right and from top to bottom in the upper half of the ultrasonic image with a step size L, thereby traversing the upper half of the ultrasonic image; during the traversal process, each The average grayscale of each window, and compare the average grayscale with the window threshold, if the average grayscale is less than the window threshold, it is judged that there is hepatic ascites feature in this window; the sliding window detection principle is shown in Figure 4.
具体的,如果超声图像大小为M×N,则滑动窗口遍历区域(超声图像的上半部分)大小为M×N/2,从而可知窗口按步长L遍历一行或者一列时,分别可以得到如公式7所示的窗口数量,遍历整个超声图像上半部分时可以得到公式8所示的总体窗口数量。Specifically, if the size of the ultrasound image is M×N, the size of the sliding window traversal area (the upper half of the ultrasound image) is M×N/2, so it can be seen that when the window traverses a row or a column according to the step size L, the following can be obtained respectively: The number of windows shown in Equation 7 can be used to obtain the total number of windows shown in Equation 8 when traversing the entire upper half of the ultrasound image.
Sr=M/L; Sr = M/L;
Sc=(N/2)/L (7) Sc = (N/2)/L (7)
Sa=Sr×Sc (8)S a =S r ×S c (8)
式中Sr,Sc,Sa分别表示超声图像中一行、一列和整个上半部分的滑动窗口数量。判断各窗口中存在肝腹水特征时,采用的窗口阈值为60。where S r , S c , S a represent the number of sliding windows in one row, one column and the entire upper half of the ultrasound image, respectively. When judging the presence of hepatic ascites features in each window, the window threshold used was 60.
(S112)统计含有肝腹水特征窗口的数量Sf,将其除以超声图像上半部分中的窗口数量Sa,得到肝腹水特征系数;当肝腹水特征系数大于固定阈值P时,判断超声图像中包括肝腹水区域。是否包括肝腹水区域的判别规则如表1所示。(S112) Count the number S f of windows containing hepatic ascites features, and divide it by the number of windows S a in the upper part of the ultrasound image to obtain the characteristic coefficient of hepatic ascites; when the characteristic coefficient of hepatic ascites is greater than the fixed threshold P, judge the ultrasound image including the hepatic ascites area. The rules for judging whether to include the hepatic ascites area are shown in Table 1.
表1超声图像中是否有腹水区域的鉴别标准Table 1 Criteria for identifying ascites areas in ultrasound images
(S12)利用高斯模糊算法对超声图像进行处理,以降低图像噪声以及细节层次。(S12) Process the ultrasonic image by using a Gaussian blur algorithm to reduce image noise and detail level.
本步骤中利用高斯模糊滤波器对超声图像进行处理,其定义如公式(9)所示。In this step, the Gaussian blur filter is used to process the ultrasonic image, and its definition is shown in formula (9).
式中r是模糊半径,σ是正态分布的标准偏差。在二维空间中,分布不为零的像素组成的卷积矩阵与原始图像做变换,每个像素的值都是周围相邻像素值的加权平均。原始像素的值有最大的高斯分布值,所以有最大的权重,相邻像素随着距离原始像素越来越远,其权重也越来越小,从而在保留边缘效果的基础上,实现了超声图像的去噪。where r is the blur radius and σ is the standard deviation of the normal distribution. In two-dimensional space, the convolution matrix composed of pixels whose distribution is not zero is transformed with the original image, and the value of each pixel is the weighted average of the surrounding adjacent pixel values. The value of the original pixel has the largest Gaussian distribution value, so it has the largest weight. As the adjacent pixels get farther and farther away from the original pixel, their weights are getting smaller and smaller, so that on the basis of retaining the edge effect, the ultrasonic Image denoising.
(S13)对高斯模糊处理后的超声图像使用多尺度细节增强与模糊集合变换方法进行先局部后整体的图像增强。本步骤具体包括:(S13) Using the method of multi-scale detail enhancement and fuzzy set transformation on the Gaussian-blurred ultrasonic image to perform local image enhancement first and then global image enhancement. This step specifically includes:
(S131)利用三个不同尺度的高斯核函数分别与高斯模糊处理后的超声图像I进行卷积运算,得到三个高斯模糊图像B1,B2,B3,其表达式为:(S131) Using three Gaussian kernel functions of different scales to perform convolution operation with the Gaussian blurred ultrasonic image I to obtain three Gaussian blurred images B 1 , B 2 , B 3 , the expressions of which are:
B1=G1*I,B2=G2*I,B3=G3-I (10)B 1 =G 1 *I, B 2 =G 2 *I, B 3 =G 3 -I (10)
其中,G1,G2,G3分别为标准差为1,2,4的高斯核;Among them, G 1 , G 2 , and G 3 are Gaussian kernels with standard deviations of 1, 2, and 4 respectively;
(S132)将超声图像I分别与三个高斯模糊图像B1,B2,B3相减,得到三个细节图像D1,D2,D3,其表达式为:(S132) Subtract the ultrasonic image I from the three Gaussian blurred images B 1 , B 2 , B 3 respectively to obtain three detail images D 1 , D 2 , D 3 , the expression of which is:
D1=I-B1,D2=B1-B2,D3=B2-B3 (11)D 1 =IB 1 , D 2 =B 1 -B 2 , D 3 =B 2 -B 3 (11)
(S133)设置不同权重将各细节图像整合成最终的细节图像D',其表示为:(S133) Setting different weights to integrate each detail image into a final detail image D', which is expressed as:
D′=(1-ω1×sgn(D1))×D1+ω2×D2+ω3×D3 D′=(1-ω 1 ×sgn(D 1 ))×D 1 +ω 2 ×D 2 +ω 3 ×D 3
(12) (12)
其中,ω1,ω2,ω3分别为权重;通常情况下,ω1,ω2,ω3分别设置为0.5、0.5、0.25。Among them, ω 1 , ω 2 , ω 3 are weights respectively; usually, ω 1 , ω 2 , ω 3 are set to 0.5, 0.5, 0.25 respectively.
(S133)采用模糊结合对细节增强后的图像进行整体增强。通过该算法,可以使得图像中暗的像素更暗,亮的像素更亮,这也恰好适合于肝超声图像的全局增强处理,能够更好地满足后续形态学处理的需求。(S133) Perform overall enhancement on the detail-enhanced image by using fuzzy combination. Through this algorithm, the dark pixels in the image can be made darker and the bright pixels brighter, which is also just suitable for the global enhancement processing of liver ultrasound images, and can better meet the needs of subsequent morphological processing.
(S14)对图像增强后的超声图像进行二值化处理,并运用孤岛移除算法去除二值图像中的孤立噪声点,得到二值超声图像。(S14) Binarize the enhanced ultrasonic image, and use an island removal algorithm to remove isolated noise points in the binary image to obtain a binary ultrasonic image.
本步骤中,首先利用自适应阈值算法对去噪及增强之后的超声图像进行二值化处理,由于肝实质中存在的条索可能会导致二值化后的图像中含有部分孤立噪声点,因此,在进行形态学处理之前,则需要通过面积法设置一定的阈值,对于小于该阈值的孤立噪声区域进行去除,从而得到更加简洁的二值超声图像。In this step, first use the adaptive threshold algorithm to binarize the ultrasonic image after denoising and enhancement, because the cords in the liver parenchyma may cause some isolated noise points in the binarized image, so , before the morphological processing, it is necessary to set a certain threshold by the area method, and remove the isolated noise area smaller than the threshold, so as to obtain a more concise binary ultrasound image.
(S15)利用形态学闭运算对二值超声图像进行处理;处理后二值超声图中下方为肝脏图像区域,上方为单色的独立连通区域。形态学闭运算通常包括膨胀操作和腐蚀操作。最终得到的二值超声图像如图5所示。(S15) Process the binary ultrasound image by using morphological closing operation; after processing, the lower part of the binary ultrasound image is the liver image area, and the upper part is a single-color independent connected area. Morphological closing operations usually include dilation and erosion operations. The final binary ultrasound image is shown in Figure 5.
(S16)基于遍历算法对处理后的二值超声图像进行搜索,寻找肝包膜对应的像素点集以构成肝包膜的预测膜;将预测膜融合到原始的超声图像中,采用灰度差分算法从预测膜中剔除伪膜的像素点,以得到肝包膜的真实膜。本步骤需要分为两部分:获取肝包膜的预测膜以及获取肝包膜的真实膜。获取肝包膜的预测膜需要考虑有肝腹水和没有肝腹水两种情况。具体的:(S16) Search the processed binary ultrasound image based on the traversal algorithm, find the pixel point set corresponding to the liver capsule to form the predicted membrane of the liver capsule; fuse the predicted membrane into the original ultrasound image, and use gray difference The algorithm removes the pixels of pseudomembrane from the predicted membrane to obtain the real membrane of the liver capsule. This step needs to be divided into two parts: obtaining the predicted membrane of the liver capsule and obtaining the real membrane of the liver capsule. Obtaining the predicted membrane of the liver capsule needs to consider both the presence of hepatic ascites and the absence of hepatic ascites. specific:
如图5所示,在没有肝腹水的超声图像中寻找与肝包膜对应的像素点包括以下步骤:As shown in Figure 5, searching for pixels corresponding to the liver capsule in an ultrasound image without hepatic ascites includes the following steps:
(S1601)在所述二值超声图像的顶部选取多数量的起点;(S1601) Select a plurality of starting points on the top of the binary ultrasound image;
(S1602)从各起点向下搜索,寻找与二值超声图像顶部的单色的独立连通区域颜色相反的像素点,并将该像素点作为与肝包膜对应的像素点。(S1602) Search downward from each starting point to find a pixel point opposite in color to the monochromatic independently connected region at the top of the binary ultrasound image, and use this pixel point as a pixel point corresponding to the liver capsule.
在二值超声图像中,图像下方肝实质的像素值为0,图像上方的单连通区域的像素值为1。在具体实施的过程中,将二值超声图像的顶部边缘的每个像素点均作为起点依次进行遍历。对某个起点遍历过程中,沿着纵坐标正方向遍历搜索,当检测到像素灰度值为0时,停止该列的搜索,并将该点定义为肝包膜的“预测膜”上一点P1 *。然后,将点P1从初始位置以步长1像素沿x轴平移,依次得到P1,P2,P3,……,Pm共m个像素点,并以它们为起点重复上述的遍历搜索方法,即可得到最终组成肝包膜“预测膜”的m个像素点P1 *,P2 *,P3 *,……,Pm *。In the binary ultrasound image, the pixel value of the liver parenchyma below the image is 0, and the pixel value of the simply connected region above the image is 1. In a specific implementation process, each pixel point on the top edge of the binary ultrasound image is used as a starting point to traverse sequentially. During the traversal process for a certain starting point, traverse and search along the positive direction of the ordinate, when the gray value of the pixel is detected to be 0, stop the search of this column, and define this point as a point on the "predicted membrane" of the liver capsule P1 * . Then, the point P 1 is translated from the initial position along the x-axis with a step size of 1 pixel, and a total of m pixels of P 1 , P 2 , P 3 ,...,P m are sequentially obtained, and the above-mentioned traversal is repeated using them as the starting point According to the search method, the m pixel points P 1 * , P 2 * , P 3 * ,...,P m * that finally constitute the "predicted membrane" of the liver envelope can be obtained.
如图6所示,对于有肝腹水的超声图像,寻找与肝包膜对应的像素点包括以下步骤:As shown in Figure 6, for an ultrasound image with hepatic ascites, finding the pixel corresponding to the liver capsule includes the following steps:
(S1611)在所述二值超声图像的顶部选取多数量的起点;(S1611) Select a plurality of starting points at the top of the binary ultrasound image;
(S1612)从各起点向下搜索,以寻找与肝包膜对应的像素点;(S1612) Search downward from each starting point to find the pixel corresponding to the liver capsule;
从某个起点向下搜索的过程中,寻找第一个与二值超声图像顶部的单色的独立连通区域颜色相反的像素点,并继续向下搜索,直到找到与超声图像顶部的单色的独立连通区域颜色相同的像素点,并将该像素点作为与肝包膜对应的像素点,若没有找到该像素点,则跳过该起点。In the process of searching downward from a certain starting point, look for the first pixel that is opposite in color to the monochromatic independently connected region at the top of the binary ultrasound image, and continue to search downward until it finds the pixel point that is opposite to the monochromatic independently connected region at the top of the ultrasound image. The pixel points with the same color in the independently connected regions are used as the pixel point corresponding to the liver capsule, and if the pixel point is not found, the starting point is skipped.
有肝腹水的情况下,各起点的选择方式与没有肝腹水的情况相同。二者区别在于对每列像素进行遍历的过程。在具体实施的过程中,在每一列进行遍历搜索时,起点以及其所在的单连通区域的像素灰度为1,当检测到像素灰度值为0时,继续演y轴方向进行搜索,直到再次检测到灰度值为1的像素点,即可将该像素点定义为肝包膜上像素点,最后保存所有检索到的像素点Pf1 *,Pf2 *,Pf3 *,……,Pfm *即可组成有腹水超声图像的肝包膜“预测膜”。此外,由于有腹水情况下的肝包膜通常情况下存在断裂点,因此当检测到断裂部分所在列时,由于在检测到灰度值为0的像素后无法再次检测到灰度值为1的像素点,则直接跳过该列继续进行下一列的遍历搜索,这种情况下该列不存在预测膜的像素点。In the case of hepatic ascites, the selection method of each starting point is the same as that of the case without hepatic ascites. The difference between the two lies in the process of traversing each column of pixels. In the process of specific implementation, when performing traversal search in each column, the pixel gray level of the starting point and the simply connected region where it is located is 1. When the gray value of the pixel is detected to be 0, continue to search in the y-axis direction until If a pixel with a gray value of 1 is detected again, the pixel can be defined as a pixel on the liver capsule, and finally all retrieved pixels P f1 * , P f2 * , P f3 * ,..., P fm * constitutes the "predictive membrane" of the liver capsule with ultrasound images of ascitic fluid. In addition, because the liver capsule in the case of ascites usually has a break point, when the column where the break part is located is detected, the pixel with a gray value of 1 cannot be detected again after the pixel with a gray value of 0 is detected. pixel, then directly skip this column and continue the traversal search of the next column. In this case, there is no pixel of the predicted membrane in this column.
如图7所示,肝包膜的预测膜的获取过程中,图像经过了复杂的处理,特别是经过膨胀腐蚀之后,原本超声图像上间断不连续的肝包膜变得连续,从而在间断处形成图7c所示的伪膜,因此在获取真实膜的过程中,需要将预测膜中伪膜的像素点剔除,并将剩余的像素点作为真实膜的像素点,其具体包括以下步骤:As shown in Figure 7, during the acquisition process of the prediction membrane of the liver capsule, the image has undergone complex processing, especially after expansion and erosion, the liver capsule that was originally discontinuous on the ultrasound image becomes continuous, so that the discontinuous liver capsule in the discontinuous place Form the pseudo-membrane shown in Figure 7c, so in the process of obtaining the real film, it is necessary to remove the pixels of the pseudo-membrane in the predicted film, and use the remaining pixels as the pixels of the real film, which specifically includes the following steps:
(S1621)将膨胀后的预测膜的各像素点融合到原始的超声图像中;(S1621) Fusing each pixel of the expanded prediction membrane into the original ultrasound image;
(S1622)在融合后的图像中,遍历预测膜的各列的像素点;对预测膜的某个列的像素点进行遍历过程中,计算该列像素点在竖直方向肝包膜预测膜范围内的若干个像素点的平均值;若平均值小于伪膜阈值,则该预测膜的像素点为真实膜的像素点,否则将该预测膜的像素点不是真实膜的像素点。本实施例中,(S1622) In the fused image, traverse the pixels of each column of the predicted membrane; during the process of traversing the pixels of a certain column of the predicted membrane, calculate the range of the predicted membrane of the liver capsule in the vertical direction of the pixel of this column The average value of several pixels within; if the average value is less than the false film threshold, the pixel point of the predicted film is the pixel point of the real film, otherwise the pixel point of the predicted film is not the pixel point of the real film. In this example,
在具体实施过程中,请参阅图7,假设膨胀后的“预测膜”区域像素点坐标为(x,y),其中x∈(1,m),当膨胀之后的“预测膜”融合到原始超声图像上后,依次从第一列开始逐列查找“伪膜”的存在。经过膨胀后,预测膜的在竖直方向会占据一定的范围,膨胀后的线条宽度为遍历过程中求取像素平均值的范围。根据公式13原理,如果原始超声图像中每一列在“预测膜”的y值范围内像素值平均值大于阈值P,则证明此处为真实肝包膜,从而保存“预测膜”中此列的原始像素值;相反,如果其范围内平均值小于伪膜阈值P,则证明此处预测的肝包膜为“伪膜”,因此应该将“预测膜”中此列的像素值设为0。对整幅图像所有列遍历结束之后,“预测膜”中剩余的像素点即可组成最终所需要的反应原始超声图像的真实的肝包膜。In the specific implementation process, please refer to Figure 7, assuming that the pixel coordinates of the expanded "predicted membrane" area are (x, y), where x∈(1,m), when the expanded "predicted membrane" is fused to the original After the ultrasound image is on, look for the presence of "pseudomembrane" column by column sequentially starting from the first column. After expansion, it is predicted that the film will occupy a certain range in the vertical direction, and the expanded line width is the range of calculating the average value of pixels during the traversal process. According to the principle of formula 13, if the average pixel value of each column in the original ultrasound image within the y-value range of the "predicted membrane" is greater than the threshold value P, it proves that this is the real liver capsule, thereby saving the value of this column in the "predicted membrane" The original pixel value; on the contrary, if the average value in the range is less than the pseudo-membrane threshold P, it proves that the predicted liver capsule here is a "pseudo-membrane", so the pixel value of this column in "Predicted Membrane" should be set to 0. After traversing all columns of the entire image, the remaining pixels in the "predicted membrane" can form the final real liver capsule that reflects the original ultrasound image.
式中G1(i,j)表示“预测膜”图像中坐标为(i,j)时的肝包膜像素灰度值,G2(x,y)表示原始超声图像在坐标为(x,y)像素点处的灰度值,G3(i,j)表示真实肝包膜中坐标为(i,j)时的像素灰度值。In the formula, G 1 (i, j) represents the gray value of the liver capsule pixel at coordinates (i, j) in the “predicted membrane” image, and G 2 (x, y) represents the original ultrasound image at coordinates (x, y) The gray value at the pixel point, G 3 (i, j) represents the gray value of the pixel at the coordinate (i, j) in the real liver capsule.
在本申请的描述中,需要理解的是,术语“上”、“下”、“前”、“后”、“左”、“右”、“竖直”、“水平”、“顶”、“底”、“内”、“外”等指示的方位或位置关系为基于附图所示的方位或位置关系,仅是为了便于描述本申请和简化描述,而不是指示或暗示所指的装置或元件必须具有特定的方位、以特定的方位构造和操作,因此不能理解为对本申请的限制。In the description of this application, it should be understood that the terms "upper", "lower", "front", "rear", "left", "right", "vertical", "horizontal", "top", The orientation or positional relationship indicated by "bottom", "inner", "outer", etc. is based on the orientation or positional relationship shown in the drawings, and is only for the convenience of describing the application and simplifying the description, rather than indicating or implying the referred device Or elements must have a certain orientation, be constructed and operate in a certain orientation, and thus should not be construed as limiting the application.
以上对本发明的具体实施例进行了描述。需要理解的是,本发明并不局限于上述特定实施方式,本领域技术人员可以在权利要求的范围内做出各种变化或修改,这并不影响本发明的实质内容。在不冲突的情况下,本申请的实施例和实施例中的特征可以任意相互组合。Specific embodiments of the present invention have been described above. It should be understood that the present invention is not limited to the specific embodiments described above, and those skilled in the art may make various changes or modifications within the scope of the claims, which do not affect the essence of the present invention. In the case of no conflict, the embodiments of the present application and the features in the embodiments can be combined with each other arbitrarily.
Claims (6)
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010692369.9A CN111815613B (en) | 2020-07-17 | 2020-07-17 | A method for identifying liver cirrhosis disease stages based on the analysis of envelope line morphological features |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN202010692369.9A CN111815613B (en) | 2020-07-17 | 2020-07-17 | A method for identifying liver cirrhosis disease stages based on the analysis of envelope line morphological features |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111815613A CN111815613A (en) | 2020-10-23 |
CN111815613B true CN111815613B (en) | 2023-06-27 |
Family
ID=72866103
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN202010692369.9A Active CN111815613B (en) | 2020-07-17 | 2020-07-17 | A method for identifying liver cirrhosis disease stages based on the analysis of envelope line morphological features |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111815613B (en) |
Families Citing this family (1)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN113436728B (en) * | 2021-07-05 | 2022-10-28 | 复旦大学附属儿科医院 | Method and equipment for automatically analyzing electroencephalogram of clinical video of neonate |
Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101458223A (en) * | 2008-12-26 | 2009-06-17 | 江南大学 | Preparation of quantitative rapid detecting sensor of microcapsule algae toxin and applications |
KR101162605B1 (en) * | 2011-03-21 | 2012-07-05 | 인하대학교 산학협력단 | Texture feature extraction method in ct images |
WO2014011925A2 (en) * | 2012-07-11 | 2014-01-16 | University Of Mississippi Medical Center | Method for the detection and staging of liver fibrosis from image acquired data |
CN103561659A (en) * | 2011-05-24 | 2014-02-05 | 株式会社东芝 | Ultrasound diagnostic apparatus and image processing apparatus |
CN105631885A (en) * | 2016-01-06 | 2016-06-01 | 复旦大学 | Method for extracting glisson's capsule line and describing characteristics based on superficial tangent plane ultrasonic image |
CN107292312A (en) * | 2017-06-19 | 2017-10-24 | 中国科学院苏州生物医学工程技术研究所 | Tumour recognition methods |
CN108038513A (en) * | 2017-12-26 | 2018-05-15 | 北京华想联合科技有限公司 | A kind of tagsort method of liver ultrasonic |
CN108154517A (en) * | 2017-12-26 | 2018-06-12 | 北京华想联合科技有限公司 | A kind of Glisson's capsule line extraction method based on liver ultrasonic |
WO2018208091A2 (en) * | 2017-05-10 | 2018-11-15 | 서울대학교산학협력단 | Biomarker for monitoring or diagnosing onset of liver cancer in high-risk group for liver cancer and use thereof |
CN109754007A (en) * | 2018-12-27 | 2019-05-14 | 武汉唐济科技有限公司 | Peplos intelligent measurement and method for early warning and system in operation on prostate |
CN110555827A (en) * | 2019-08-06 | 2019-12-10 | 上海工程技术大学 | Ultrasonic imaging information computer processing system based on deep learning drive |
-
2020
- 2020-07-17 CN CN202010692369.9A patent/CN111815613B/en active Active
Patent Citations (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN101458223A (en) * | 2008-12-26 | 2009-06-17 | 江南大学 | Preparation of quantitative rapid detecting sensor of microcapsule algae toxin and applications |
KR101162605B1 (en) * | 2011-03-21 | 2012-07-05 | 인하대학교 산학협력단 | Texture feature extraction method in ct images |
CN103561659A (en) * | 2011-05-24 | 2014-02-05 | 株式会社东芝 | Ultrasound diagnostic apparatus and image processing apparatus |
WO2014011925A2 (en) * | 2012-07-11 | 2014-01-16 | University Of Mississippi Medical Center | Method for the detection and staging of liver fibrosis from image acquired data |
CN105631885A (en) * | 2016-01-06 | 2016-06-01 | 复旦大学 | Method for extracting glisson's capsule line and describing characteristics based on superficial tangent plane ultrasonic image |
WO2018208091A2 (en) * | 2017-05-10 | 2018-11-15 | 서울대학교산학협력단 | Biomarker for monitoring or diagnosing onset of liver cancer in high-risk group for liver cancer and use thereof |
CN107292312A (en) * | 2017-06-19 | 2017-10-24 | 中国科学院苏州生物医学工程技术研究所 | Tumour recognition methods |
CN108038513A (en) * | 2017-12-26 | 2018-05-15 | 北京华想联合科技有限公司 | A kind of tagsort method of liver ultrasonic |
CN108154517A (en) * | 2017-12-26 | 2018-06-12 | 北京华想联合科技有限公司 | A kind of Glisson's capsule line extraction method based on liver ultrasonic |
CN109754007A (en) * | 2018-12-27 | 2019-05-14 | 武汉唐济科技有限公司 | Peplos intelligent measurement and method for early warning and system in operation on prostate |
CN110555827A (en) * | 2019-08-06 | 2019-12-10 | 上海工程技术大学 | Ultrasonic imaging information computer processing system based on deep learning drive |
Non-Patent Citations (3)
Title |
---|
Computer-aided cirrhosis diagnosis via automatic liver capsule extraction and combined geometry-texture features;Xiang Liu等;《2017 IEEE International Conference on Multimedia and Expo (ICME)》;第865-870页 * |
基于超声图像特征的肝硬化分析系统;周国辉 等;《声学技术》(第4期);第288-291页 * |
高频超声影像肝脏包膜几何特征定量评价患者肝硬化程度;宋家琳 等;《中国医学影像技术》;第31卷(第12期);第1907-1910页 * |
Also Published As
Publication number | Publication date |
---|---|
CN111815613A (en) | 2020-10-23 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
JP6710135B2 (en) | Cell image automatic analysis method and system | |
Yin et al. | Accurate image analysis of the retina using hessian matrix and binarisation of thresholded entropy with application of texture mapping | |
Calvo et al. | Automatic detection and characterisation of retinal vessel tree bifurcations and crossovers in eye fundus images | |
Zhang et al. | Segmentation of cytoplasm and nuclei of abnormal cells in cervical cytology using global and local graph cuts | |
US10121245B2 (en) | Identification of inflammation in tissue images | |
WO2017020723A1 (en) | Character segmentation method and device and electronic device | |
JP5926937B2 (en) | Image processing apparatus, image processing method, and image processing program | |
WO2019114036A1 (en) | Face detection method and device, computer device, and computer readable storage medium | |
US20110081081A1 (en) | Method for recognizing objects in images | |
Chen et al. | Segmentation of overlapping cervical cells with mask region convolutional neural network | |
Yao et al. | Automated detection of non-informative frames for colonoscopy through a combination of deep learning and feature extraction | |
Wang et al. | Segmenting retinal vessels with revised top-bottom-hat transformation and flattening of minimum circumscribed ellipse | |
Boubakar Khalifa Albargathe et al. | Blood vessel segmentation and extraction using H-minima method based on image processing techniques | |
CN114271763A (en) | Mask RCNN-based gastric cancer early identification method, system and device | |
Abujayyab et al. | Integrating object-based and pixel-based segmentation for building footprint extraction from satellite images | |
CN111815613B (en) | A method for identifying liver cirrhosis disease stages based on the analysis of envelope line morphological features | |
Kim et al. | Deep learning-based fully automated grading system for dry eye disease severity | |
CN119048521B (en) | Method, device and computer equipment for counting milk somatic cells | |
Badeka et al. | Evaluation of LBP variants in retinal blood vessels segmentation using machine learning | |
Schüffler et al. | Overcoming an annotation hurdle: Digitizing pen annotations from whole slide images | |
CN113850762A (en) | Eye disease identification method, device, device and storage medium based on anterior segment image | |
CN114387226A (en) | Rice grading method, device, equipment and storage medium | |
CN109460768A (en) | A kind of text detection and minimizing technology for histopathology micro-image | |
CN116682109B (en) | Pathological microscopic image analysis method, device, equipment and storage medium | |
CN118710661A (en) | A system and method for segmenting three-level lymphatic structure instances in lung cancer pathology images |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |