CN111429404A - Imaging system and method for detecting cardiovascular and cerebrovascular vessels - Google Patents
Imaging system and method for detecting cardiovascular and cerebrovascular vessels Download PDFInfo
- Publication number
- CN111429404A CN111429404A CN202010140859.8A CN202010140859A CN111429404A CN 111429404 A CN111429404 A CN 111429404A CN 202010140859 A CN202010140859 A CN 202010140859A CN 111429404 A CN111429404 A CN 111429404A
- Authority
- CN
- China
- Prior art keywords
- image
- blood vessel
- segmentation
- layer
- module
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 238000003384 imaging method Methods 0.000 title claims abstract description 35
- 230000002526 effect on cardiovascular system Effects 0.000 title claims abstract description 29
- 238000000034 method Methods 0.000 title claims abstract description 24
- 210000004204 blood vessel Anatomy 0.000 claims abstract description 151
- 230000011218 segmentation Effects 0.000 claims abstract description 88
- 238000003709 image segmentation Methods 0.000 claims abstract description 32
- 238000009826 distribution Methods 0.000 claims abstract description 29
- 238000006243 chemical reaction Methods 0.000 claims abstract description 18
- 239000000284 extract Substances 0.000 claims abstract description 11
- 238000001914 filtration Methods 0.000 claims abstract description 7
- 208000024172 Cardiovascular disease Diseases 0.000 claims description 10
- 208000026106 cerebrovascular disease Diseases 0.000 claims description 9
- 238000001514 detection method Methods 0.000 claims description 7
- 239000000203 mixture Substances 0.000 claims description 5
- 230000002792 vascular Effects 0.000 claims description 2
- 230000009466 transformation Effects 0.000 claims 1
- 238000002059 diagnostic imaging Methods 0.000 abstract description 2
- 210000001519 tissue Anatomy 0.000 description 10
- 238000002591 computed tomography Methods 0.000 description 5
- 210000000577 adipose tissue Anatomy 0.000 description 4
- 238000002583 angiography Methods 0.000 description 4
- 238000003745 diagnosis Methods 0.000 description 4
- 230000000694 effects Effects 0.000 description 4
- 239000008280 blood Substances 0.000 description 3
- 210000004369 blood Anatomy 0.000 description 3
- 210000004556 brain Anatomy 0.000 description 3
- 238000010276 construction Methods 0.000 description 3
- 238000012360 testing method Methods 0.000 description 3
- 230000008321 arterial blood flow Effects 0.000 description 2
- 210000000988 bone and bone Anatomy 0.000 description 2
- 210000005013 brain tissue Anatomy 0.000 description 2
- 210000001175 cerebrospinal fluid Anatomy 0.000 description 2
- 238000000605 extraction Methods 0.000 description 2
- 210000004884 grey matter Anatomy 0.000 description 2
- 238000002595 magnetic resonance imaging Methods 0.000 description 2
- 239000011159 matrix material Substances 0.000 description 2
- 230000002093 peripheral effect Effects 0.000 description 2
- 230000003068 static effect Effects 0.000 description 2
- 238000012549 training Methods 0.000 description 2
- 238000012546 transfer Methods 0.000 description 2
- 210000004885 white matter Anatomy 0.000 description 2
- NAWXUBYGYWOOIX-SFHVURJKSA-N (2s)-2-[[4-[2-(2,4-diaminoquinazolin-6-yl)ethyl]benzoyl]amino]-4-methylidenepentanedioic acid Chemical compound C1=CC2=NC(N)=NC(N)=C2C=C1CCC1=CC=C(C(=O)N[C@@H](CC(=C)C(O)=O)C(O)=O)C=C1 NAWXUBYGYWOOIX-SFHVURJKSA-N 0.000 description 1
- 206010002329 Aneurysm Diseases 0.000 description 1
- 206010003210 Arteriosclerosis Diseases 0.000 description 1
- 201000001320 Atherosclerosis Diseases 0.000 description 1
- 208000004434 Calcinosis Diseases 0.000 description 1
- 206010008111 Cerebral haemorrhage Diseases 0.000 description 1
- 241000282414 Homo sapiens Species 0.000 description 1
- 206010020772 Hypertension Diseases 0.000 description 1
- 208000031662 Noncommunicable disease Diseases 0.000 description 1
- 208000031481 Pathologic Constriction Diseases 0.000 description 1
- 208000011775 arteriosclerosis disease Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 230000017531 blood circulation Effects 0.000 description 1
- 230000002308 calcification Effects 0.000 description 1
- 230000001684 chronic effect Effects 0.000 description 1
- 208000029078 coronary artery disease Diseases 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 230000036541 health Effects 0.000 description 1
- 125000004435 hydrogen atom Chemical group [H]* 0.000 description 1
- 230000005865 ionizing radiation Effects 0.000 description 1
- 208000010125 myocardial infarction Diseases 0.000 description 1
- 238000013421 nuclear magnetic resonance imaging Methods 0.000 description 1
- 230000036285 pathological change Effects 0.000 description 1
- 231100000915 pathological change Toxicity 0.000 description 1
- 238000007781 pre-processing Methods 0.000 description 1
- 238000012545 processing Methods 0.000 description 1
- 230000009467 reduction Effects 0.000 description 1
- 230000004044 response Effects 0.000 description 1
- 229920006395 saturated elastomer Polymers 0.000 description 1
- 238000011524 similarity measure Methods 0.000 description 1
- 208000037804 stenosis Diseases 0.000 description 1
- 230000036262 stenosis Effects 0.000 description 1
- 230000008719 thickening Effects 0.000 description 1
- 238000012795 verification Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10068—Endoscopic image
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10081—Computed x-ray tomography [CT]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/10—Image acquisition modality
- G06T2207/10072—Tomographic images
- G06T2207/10088—Magnetic resonance imaging [MRI]
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
Landscapes
- Engineering & Computer Science (AREA)
- Computer Vision & Pattern Recognition (AREA)
- Physics & Mathematics (AREA)
- General Physics & Mathematics (AREA)
- Theoretical Computer Science (AREA)
- Health & Medical Sciences (AREA)
- General Health & Medical Sciences (AREA)
- Medical Informatics (AREA)
- Nuclear Medicine, Radiotherapy & Molecular Imaging (AREA)
- Radiology & Medical Imaging (AREA)
- Quality & Reliability (AREA)
- Magnetic Resonance Imaging Apparatus (AREA)
Abstract
The invention provides an imaging system and method for detecting cardiovascular and cerebrovascular vessels, and belongs to the technical field of medical imaging. The imaging system comprises an image acquisition module, an image pre-segmentation module, an image secondary segmentation module, an image conversion module and a display module which are sequentially connected. The image pre-segmentation module pre-segments the two-dimensional image of the cross section of the blood vessel by adopting a finite mixed normal distribution image pre-segmentation model, and preliminarily extracts a blood vessel signal of each layer; secondly, performing secondary segmentation on the blood vessel signal of each layer by an image segmentation model by an image secondary segmentation module, and filtering interference signals to obtain a blood vessel image of each layer; and finally, the image conversion module converts the blood vessel image of each layer into a blood vessel three-dimensional image by adopting a maximum density projection method. The invention combines image pre-segmentation and secondary segmentation, gradually filters interference signals except blood vessels, and can obtain high-precision blood vessel three-dimensional images.
Description
Technical Field
The invention belongs to the technical field of medical imaging, and relates to an imaging system and method for cardiovascular and cerebrovascular detection.
Background
Common morbidity modes of cardiovascular diseases include hypertension, coronary heart disease, myocardial infarction, cerebral hemorrhage and the like. Among them, most of the cardiovascular and cerebrovascular diseases are based on the distortion of the blood vessel wall. Atherosclerosis and high-pressure arteriosclerosis cause thickening and hardening of blood vessel walls, loss of elasticity, reduction of lumen, complete occlusion, pathological changes and cardiovascular and cerebrovascular diseases. Cardiovascular and cerebrovascular diseases have the characteristics of high morbidity, high mortality, high disability rate and the like, and are main chronic non-infectious diseases affecting the life health of human beings. Therefore, it is necessary to prevent the occurrence or recurrence of cardiovascular and cerebrovascular diseases by detecting and diagnosing risk factors in blood vessels in advance, thereby achieving the purpose of reducing the mortality.
Diagnosis of morphology of blood vessels as one of the methods of diagnosis of blood vessels, it is necessary to detect and image blood vessels by means of devices and methods such as CT (computed tomography), MRA (magnetic resonance angiography), angiography, or angioscope before diagnosis. When the device is used for detecting and imaging the blood vessel, the obtained initial image not only contains the blood vessel, but also contains other tissues around the blood vessel and interference signals. Since the blood vessel is surrounded by other surrounding tissues and the surrounding tissue images may affect the observation of the blood vessel tissue by the doctor, the initial image needs to be processed and segmented by a large number of image processing means to separate the blood vessel signals and reconstruct the blood vessel signals into the blood vessel image. The target region of the blood vessel image segmentation is a blood vessel signal, and other parts are all regarded as background regions. The effective segmentation method aims to distinguish blood vessels from surrounding tissues, and blood vessels can be observed more clearly after interference is removed, so that diagnosis can be performed more accurately. And after the blood vessel is segmented, the parameters such as the sectional area of the blood vessel and the like can be more conveniently and quantitatively measured. Therefore, accurate segmentation of blood vessels is of great significance for three-dimensional imaging of blood vessels.
The Chinese invention patent with the application number of 201710775038.X provides a blood vessel image segmentation method and a nuclear magnetic resonance imaging system based on centerline extraction. The method comprises the steps of preprocessing brain blood vessel data by adopting vesselness filtering based on a Hessian matrix, extracting a blood vessel central line by adopting a topology thinning method, carrying out edge expansion on an original image, extracting the characteristics of a training sample and a test sample by taking the central line as a positive sample and taking a non-blood vessel point as a negative sample, and training an SVM model to obtain a blood vessel segmentation result. The method does not need to manually calibrate the target and the background, and realizes full-automatic blood vessel segmentation.
However, since the cardiovascular and cerebrovascular vessels have extremely complicated structures, the sizes and curvatures thereof are variable, there are multi-level branches in a small range, the branches at the ends are very fine, and the appearance and the geometric features of the diseased vessels are affected by the conditions of vessel expansion, calcification, aneurysm, stenosis, etc., resulting in increased difficulty of vessel segmentation based on centerline extraction and low segmentation accuracy.
Disclosure of Invention
In view of the above-mentioned drawbacks of the prior art, it is an object of the present invention to provide an imaging system and method for cardiovascular and cerebrovascular detection. The imaging system pre-divides the two-dimensional image of the cross section of the blood vessel through an image pre-dividing module, preliminarily extracts the blood vessel signal of each layer, then performs secondary division on the blood vessel signal of each layer through an image secondary dividing module, filters interference signals to obtain the blood vessel image of each layer, and finally performs three-dimensional conversion to obtain the three-dimensional image of the blood vessel. The invention combines image pre-segmentation and secondary segmentation, gradually filters interference signals except blood vessels, and finally obtains a high-precision blood vessel three-dimensional image.
In order to achieve the purpose, the technical scheme adopted by the invention is as follows:
an imaging system for cardiovascular and cerebrovascular detection comprises an image acquisition module, an image pre-segmentation module, an image secondary segmentation module, an image conversion module and a display module which are sequentially connected;
the image acquisition module is used for receiving or acquiring two-dimensional images of the cross section of the blood vessel of different layers;
the image pre-segmentation module is used for pre-segmenting the two-dimensional image of the cross section of the blood vessel and preliminarily extracting a blood vessel signal of each layer;
the image secondary segmentation module is used for carrying out secondary segmentation on the blood vessel signals of each layer, filtering interference signals and obtaining blood vessel images of each layer;
the image conversion module is used for converting the blood vessel image of each layer into a blood vessel three-dimensional image;
the display module is used for displaying the blood vessel three-dimensional image.
Furthermore, the image pre-segmentation module pre-segments the two-dimensional image of the cross section of the blood vessel through a finite mixed normal distribution image pre-segmentation model.
Further, the finite mixture normal distribution image pre-segmentation model solves model parameters through an expected maximization algorithm.
Further, the secondary segmentation adopts an image segmentation model to perform secondary segmentation on the blood vessel signal of each slice, where the image segmentation model is expressed as follows:
in the formula, I represents the set of all superpixels, omega represents the set of all neighborhood superpixel pairs in the same superpixel layer, C represents the set of corresponding superpixel pairs between different superpixel layers, and Di(fi) Is a super pixel i and its label fiλ and φ are balance parameters, Bmn(fm，fn) Is a penalty function, S, between the neighbourhood superpixels m and n in the same superpixel layerpq(fp，fq) A function is measured for similarity of corresponding superpixel pairs between different superpixel layers.
Further, the construction method of the image segmentation model is as follows:
(1) generating three layers of super pixels with different scales of the blood vessel signal by using a super pixel segmentation algorithm;
(2) extracting the characteristics of the superpixels in the step (1) and acquiring the structural information of the superpixels;
(3) introducing the structural information of the superpixel in the step (2) into an image segmentation model based on graph segmentation to obtain the image segmentation model; the graph cut-based image segmentation model is shown as follows:
where I represents the set of all superpixels, ω represents the set of all neighborhood superpixel pairs within the same superpixel layer, Di(fi) Is a super pixel i and its label fiλ is a balance parameter, Bmn(fm，fn) For penalty function between adjacent superpixels m and n in the same superpixel layer。
Further, in the step (1), the number of the super pixels with different three-layer dimensions is respectively 300-.
Further, in step (2), the structural information of the super-pixel includes a mean and a covariance of the pixel characteristics.
Further, the image conversion module stacks the blood vessel images of each slice by a maximum intensity projection method to obtain the blood vessel three-dimensional image.
Further, the image acquisition module acquires two-dimensional images of cross sections of the blood vessels of different layers through CT equipment or magnetic resonance equipment.
An imaging method of the imaging system for detecting the cardiovascular and cerebrovascular vessels comprises the following steps:
s1, the image acquisition module acquires two-dimensional images of cross sections of blood vessels on different layers;
s2, the image pre-segmentation module pre-segments the two-dimensional image of the cross section of the blood vessel of each layer in the step S1 respectively, and preliminarily extracts a blood vessel signal of each layer to obtain an initial blood vessel image of each layer;
s3, performing secondary segmentation on the initial blood vessel image of each layer in the step S2 by the image secondary segmentation module to obtain a blood vessel image of each layer;
and S4, the image conversion module stacks the blood vessel images of each layer in the step S3 in sequence to obtain a blood vessel three-dimensional image, and the blood vessel three-dimensional image is displayed through the display module.
Advantageous effects
Compared with the prior art, the imaging system and the method for detecting the cardiovascular and cerebrovascular vessels have the following beneficial effects:
(1) the imaging system for detecting the cardiovascular and cerebrovascular vessels comprises an image acquisition module, an image pre-segmentation module, an image secondary segmentation module, an image conversion module and a display module which are sequentially connected. The image pre-segmentation module pre-segments the two-dimensional image of the cross section of the blood vessel by adopting a finite mixed normal distribution image pre-segmentation model, and preliminarily extracts a blood vessel signal of each layer; secondly, performing secondary segmentation on the blood vessel signal of each layer by an image segmentation model by an image secondary segmentation module, and filtering interference signals to obtain a blood vessel image of each layer; and finally, the image conversion module converts the blood vessel image of each layer into a blood vessel three-dimensional image by adopting a maximum density projection method, so that the three-dimensional imaging of the cardiovascular and cerebrovascular is realized. According to the program system, the invention combines image pre-segmentation and secondary segmentation to gradually filter out interference signals except blood vessels, wherein the image pre-segmentation model adopts finite mixed normal distribution to obtain blood vessel data through preliminary segmentation, the image segmentation model extracts three superpixels with different scales of the blood vessel data through preliminary segmentation, interference signals (such as adipose tissues) similar to the gray scale of the blood vessel are further filtered, and finally a high-precision blood vessel three-dimensional image is obtained.
(2) The image pre-segmentation module adopts a finite mixed normal distribution image pre-segmentation model, and the construction of the model is realized by assuming that a medium brightness area in a gray distribution histogram of a two-dimensional image of a cross section of a blood vessel is formed by two normal distributions and a total distribution curve is formed by four components. The gray distribution histogram of the two-dimensional image of the cross section of the blood vessel can be divided into three main component brightness levels, the lowest level brightness is a noise signal, cerebrospinal fluid and bone tissues; the medium luminance signal is a signal of brain tissue, including signals of gray and white matter; the highest brightness signal component is mainly the signal of arterial blood flow and adipose tissue around the brain. Verification shows that the assumption accords with the true condition of blood vessel image distribution, and blood vessel signal components can be well separated from mixed components, so that the purpose of preliminarily segmenting the blood vessel image is achieved.
(3) The image segmentation module firstly extracts the superpixels of three different scales of the blood vessel signals obtained by primary segmentation, then extracts the mean value and covariance of the pixel characteristics of the superpixels as the structural information of the superpixels, and finally introduces the superpixel structural information into an image segmentation model based on image segmentation to obtain the image segmentation model. According to the image segmentation model, the superpixel information of three different scales is introduced into the model, the small-scale superpixel can store the local information of the image, and local adjacent constraint can be provided to overcome over-segmentation; the large-scale superpixel can store the macrostructure information of the image, and can provide the regional connectivity constraint of the long range of the image to overcome under-segmentation; the super-pixel of the medium-dimensional scale can transfer image global information. By fusing the three scales of super-pixel information, the quality of the segmentation of the blood vessel image is further improved, so that a high-precision blood vessel three-dimensional image is obtained.
Drawings
FIG. 1 is a block diagram of an imaging system for cardiovascular and cerebrovascular testing according to the present invention;
fig. 2 is a flowchart of an imaging method of the imaging system for detecting cardiovascular and cerebrovascular vessels according to the present invention.
Detailed Description
The technical solutions of the embodiments of the present invention will be described clearly and completely below, and it is obvious that the described embodiments are only a part of the embodiments of the present invention, and not all embodiments; all other embodiments, which can be derived by a person skilled in the art from the embodiments of the present invention without any inventive step, are within the scope of the present invention.
Referring to fig. 1, the imaging system for detecting cardiovascular and cerebrovascular diseases provided by the present invention includes an image acquisition module, an image pre-segmentation module, an image secondary segmentation module, an image conversion module and a display module, which are connected in sequence.
The image acquisition module is used for receiving or acquiring the two-dimensional images of the cross section of the blood vessel of different layers.
Preferably, the image acquisition module acquires two-dimensional images of cross sections of the blood vessels of different layers through a CT device or a magnetic resonance device. Taking magnetic resonance blood vessel imaging equipment as an example, magnetic resonance imaging is a common diagnostic means, and has the advantages of good tissue contrast, no ionizing radiation and the like. In clinic, a patient is placed in the center of a magnet, hydrogen atoms (common condition) in the body of the patient are subjected to space encoding by controlling gradient pulses and radio frequency pulses, signals are collected to obtain k-space data, and then the k-space data are subjected to two-dimensional Fourier transform to obtain a magnetic resonance image. Magnetic resonance angiography mainly utilizes a saturation effect, an inflow enhancement effect and a flow dephasing effect. The magnetic resonance blood vessel acquisition principle is as follows: and transmitting a pulse signal to a certain layer for multiple times to enable the tissue of the layer to reach a saturation state, and acquiring an image of the layer after a period of time TR. The static tissue is in a saturated state, the signal is low, the blood in the blood vessel is in a flowing state, the blood at the layer surface position flows in from other positions, and the high signal is presented after the saturation. Therefore, the blood and the peripheral tissue signals are contrasted to reflect that the blood vessels are highlighted on the image and the peripheral static tissues are darker, thereby realizing the acquisition of the blood vessel image. It can be seen that the initial image acquired by magnetic resonance angiography is a vessel cross-section two-dimensional image.
The image pre-segmentation module is used for pre-segmenting the two-dimensional image of the cross section of the blood vessel and preliminarily extracting the blood vessel signal of each layer.
Furthermore, the image pre-segmentation module pre-segments the two-dimensional image of the cross section of the blood vessel through a finite mixed normal distribution image pre-segmentation model. The finite mixed normal distribution image pre-segmentation model is shown as the formula (1):
in the formula, atIs ft(x) Weight of (f)t(x) Is the t-th distribution in the mixed normal distribution
T is 1,2,3,4, f4For mixed distribution of vascular components, f1，f2，f3For mixed distribution of background components,. phikIs a parameter vector of the mixed distribution density function, as shown in formula (2):
further, the limited mixture normal distribution image pre-distributionSegmenting 12 unknown parameters in a model
Solved by the expectation maximization algorithm.
Then according to the maximum posterior classification method, if formula (3) is satisfied:
namely:
then voxel x is considerediBelonging to the blood vessel.
The limited mixed normal distribution model is that in the gray distribution histogram of the two-dimensional image of the cross section of the assumed blood vessel, the medium brightness area is formed by two normal distributions, and the total distribution curve is formed by four components. The grey level distribution histogram of the two-dimensional image of the cross section of the blood vessel can be divided into three main component brightness levels. The lowest level of brightness is the noise signal, cerebrospinal fluid and bone tissue; the medium luminance signal is a signal of brain tissue, including signals of gray and white matter; the highest brightness signal component is mainly the signal of arterial blood flow and adipose tissue around the brain, and fat is high signal like blood flow due to the short T1 relaxation time of fat. Tests show that the hypothesis is relatively consistent with the real situation, and the blood vessel signal component can be well separated from the mixed component, so that the purpose of preliminarily segmenting the blood vessel image is achieved.
And the image secondary segmentation module is used for carrying out secondary segmentation on the blood vessel signals of each layer, filtering interference signals and obtaining the blood vessel image of each layer.
Further, the secondary segmentation adopts an image segmentation model to perform secondary segmentation on the blood vessel signal of each slice, and the image segmentation model is as shown in formula (5):
in the formula, I represents the set of all superpixels, omega represents the set of all neighborhood superpixel pairs in the same superpixel layer, C represents the set of corresponding superpixel pairs between different superpixel layers, and Di(fi) Is a super pixel i and its label fiλ and φ are balance parameters, Bmn(fm，fn) Is a penalty function, S, between the neighbourhood superpixels m and n in the same superpixel layerpq(fp，fq) A function is measured for similarity of corresponding superpixel pairs between different superpixel layers.
Further, the construction method of the image segmentation model is as follows:
(1) generating three layers of super pixels with different scales of the blood vessel signal by using a super pixel segmentation algorithm;
the pixel numbers of the super pixels with different three-layer scales are respectively 300-500, 800-1500 and 6000-10000; wherein the small-scale superpixel stores local information of the blood vessel image, and can provide local adjacent constraint to overcome over-segmentation; the large-scale superpixel stores the macrostructure information of the image, and can provide the regional connectivity constraint of the long range of the blood vessel image so as to overcome under-segmentation; the super-pixel of the medium-dimensional scale can transfer the global information of the blood vessel image.
(2) Extracting the characteristics of the superpixels in the step (1) and acquiring the structural information of the superpixels;
the structural information of the super-pixel comprises a mean value and a covariance of pixel characteristics; e.g. a super-pixel i can be characterized as Gi＝{μi,∑i}，μiIs the mean of the super-pixel i, ∑iIs the covariance of the superpixel i, the feature G of the superpixel mm＝{μm,∑mAnd the feature G of the super-pixel nn＝{μn,∑nThe definition of similarity between them is shown in formula (6):
where tr (-) is the trace operation of the matrix and d is the dimension of the superpixel feature.
(3) Introducing the structural information of the superpixel in the step (2) into an image segmentation model based on graph segmentation to obtain an image segmentation model shown in a formula (5); the image segmentation model based on graph cut is shown as formula (7):
where I represents the set of all superpixels, ω represents the set of all neighborhood superpixel pairs within the same superpixel layer, Di(fi) Is a super pixel i and its label fiλ is a balance parameter, Bmn(fm，fn) Is a penalty function between neighboring superpixels m and n within the same superpixel layer.
The invention adopts the component form expectation maximization Gaussian mixture algorithm to perform clustering solution on the image segmentation model, and clusters the foreground seeds and the background seeds to obtain corresponding Gaussian sets
And
where N and M are the number of classes of foreground and background, respectively. The similarity between the superpixel i and the foreground and background models is shown as equation (8) and equation (9):
Bmn(fm,fn) For the penalty function between neighboring superpixels m and n within the same superpixel layer, the following formula (10) is defined:
Bmn(fm,fn)＝exp(-ξmdis2(Gm,Gn))·(fm≠fn) (10)
in the formula (f)m≠fn) 1 if fm≠fnOtherwise, 0. adjusting parameter ξmThe method is set based on the super-pixel layers to which m and n belong, namely each super-pixel layer has respective adjusting parameter values, and the specific definition is as shown in a formula (11):
in the formula, | omegamAnd | represents the number of elements of the super-pixel layer to which m belongs. Spq(fp,fq) Defining a similarity measure function for corresponding superpixel pairs between different superpixel layers as shown in equation (12):
Spq(fp,fq)＝exp(-ξmdis2(Gp,Gq))·(fp≠fq) (12)
in the formula (f)p≠fq) 1 if fp≠fqOtherwise, it is 0. adjusting parameter value ξ of super pixel layer due to ppAnd q is the adjustment parameter value ξ of the super pixel layerqAre not equal, and therefore, the adjustment parameter ξ between different pixel superpixel layerspqThe definition is shown in formula (13):
and the image conversion module is used for converting the blood vessel image of each layer into a blood vessel three-dimensional image.
Further, the image conversion module stacks the blood vessel images of each slice by a maximum intensity projection method to obtain the blood vessel three-dimensional image. The idea of the method is to emit rays at a projection angle for each pixel in the projection plane, pass through the volume data, compare the data values on each ray, and select the largest value as the display value of the response pixel. The maximum density projection method has the main advantages of small calculated amount and high calculating speed.
The display module is used for displaying the blood vessel three-dimensional image.
Referring to fig. 2, the imaging method of the imaging system for detecting cardiovascular and cerebrovascular vessels described above includes the following steps:
s1, the image acquisition module acquires two-dimensional images of cross sections of blood vessels of different layers through CT equipment or magnetic resonance imaging equipment;
s2, the image pre-segmentation module pre-segments the two-dimensional image of the cross section of the blood vessel of each layer in the step S1 by adopting a finite mixed normal distribution image pre-segmentation model, preliminarily extracts the blood vessel signal of each layer and obtains an initial blood vessel image of each layer;
s3, the image secondary segmentation module carries out secondary segmentation on the initial blood vessel image of each layer in the step S2 by adopting an image segmentation model, and further filters interference signals to obtain a blood vessel image of each layer;
and S4, the image conversion module adopts a maximum density projection method to stack the blood vessel images of each layer in the step S3 in sequence to obtain a blood vessel three-dimensional image, and the blood vessel three-dimensional image is displayed through the display module.
In summary, the imaging system for detecting cardiovascular and cerebrovascular vessels provided by the invention comprises an image acquisition module, an image pre-segmentation module, an image secondary segmentation module, an image conversion module and a display module which are sequentially connected. The image pre-segmentation module pre-segments the two-dimensional image of the cross section of the blood vessel by adopting a finite mixed normal distribution image pre-segmentation model, and preliminarily extracts a blood vessel signal of each layer; secondly, performing secondary segmentation on the blood vessel signal of each layer by an image segmentation model by an image secondary segmentation module, and filtering interference signals to obtain a blood vessel image of each layer; and finally, the image conversion module converts the blood vessel image of each layer into a blood vessel three-dimensional image by adopting a maximum density projection method, so that the three-dimensional imaging of the cardiovascular and cerebrovascular is realized. According to the program system, the invention combines image pre-segmentation and secondary segmentation to gradually filter out interference signals except blood vessels, wherein the image pre-segmentation model adopts finite mixed normal distribution to obtain blood vessel data through preliminary segmentation, the image segmentation model extracts three superpixels with different scales of the blood vessel data through preliminary segmentation, interference signals (such as adipose tissues) similar to the gray scale of the blood vessel are further filtered, and finally a high-precision blood vessel three-dimensional image is obtained.
The above description is only for the preferred embodiment of the present invention, but the scope of the present invention is not limited thereto, and any person skilled in the art should be considered to be within the technical scope of the present invention, and the technical solutions and the inventive concepts thereof according to the present invention should be equivalent or changed within the scope of the present invention.
Claims (10)
1. An imaging system for cardiovascular and cerebrovascular detection is characterized by comprising an image acquisition module, an image pre-segmentation module, an image secondary segmentation module, an image conversion module and a display module which are sequentially connected;
the image acquisition module is used for receiving or acquiring two-dimensional images of the cross section of the blood vessel of different layers;
the image pre-segmentation module is used for pre-segmenting the two-dimensional image of the cross section of the blood vessel and preliminarily extracting a blood vessel signal of each layer;
the image secondary segmentation module is used for carrying out secondary segmentation on the blood vessel signals of each layer, filtering interference signals and obtaining blood vessel images of each layer;
the image conversion module is used for converting the blood vessel image of each layer into a blood vessel three-dimensional image;
the display module is used for displaying the blood vessel three-dimensional image.
2. The imaging system of claim 1, wherein the image pre-segmentation module pre-segments the two-dimensional image of the cross section of the blood vessel by a finite mixture normal distribution image pre-segmentation model.
3. The imaging system for cardiovascular and cerebrovascular detection according to claim 1, wherein the limited mixture normal distribution image pre-segmentation model solves the model parameters by an expectation maximization algorithm.
4. The imaging system for detecting cardiovascular and cerebrovascular diseases according to claim 1, wherein said secondary segmentation uses an image segmentation model to perform secondary segmentation on the vascular signals of each slice, said image segmentation model is represented by the following formula:
in the formula, I represents the set of all superpixels, omega represents the set of all neighborhood superpixel pairs in the same superpixel layer, C represents the set of corresponding superpixel pairs between different superpixel layers, and Di(fi) Is a super pixel i and its label fiλ and φ are balance parameters, Bmn(fm，fn) Is a penalty function, S, between the neighbourhood superpixels m and n in the same superpixel layerpq(fp，fq) A function is measured for similarity of corresponding superpixel pairs between different superpixel layers.
5. The imaging system for detecting cardiovascular and cerebrovascular diseases according to claim 4, wherein said image segmentation model is constructed by the following method:
(1) generating three layers of super pixels with different scales of the blood vessel signal by using a super pixel segmentation algorithm;
(2) extracting the characteristics of the superpixels in the step (1) and acquiring the structural information of the superpixels;
(3) introducing the structural information of the superpixel in the step (2) into an image segmentation model based on graph segmentation to obtain the image segmentation model; the graph cut-based image segmentation model is shown as follows:
where I represents the set of all superpixels, ω represents the set of all neighborhood superpixel pairs within the same superpixel layer, Di(fi) Is a super pixel i and its label fiλ is a balance parameter, Bmn(fm，fn) Is a penalty function between neighboring superpixels m and n within the same superpixel layer.
6. The imaging system for detecting cardiovascular and cerebrovascular diseases according to claim 5, wherein in step (1), the number of the super pixels with different three-layer dimensions is 300-.
7. An imaging system for cardiovascular and cerebrovascular detection as claimed in claim 5, wherein in step (2), the structural information of the superpixel includes the mean and covariance of the pixel features.
8. The imaging system of claim 1, wherein the image transformation module stacks the vessel images of each slice by maximum intensity projection to obtain the three-dimensional image of the vessel.
9. The imaging system for detecting cardiovascular and cerebrovascular diseases according to claim 1, wherein said image acquisition module acquires two-dimensional images of vessel cross-section of different layers by CT device or magnetic resonance device.
10. An imaging method of the imaging system for cardiovascular and cerebrovascular detection according to any one of claims 1 to 9, comprising the steps of:
s1, the image acquisition module acquires two-dimensional images of cross sections of blood vessels on different layers;
s2, the image pre-segmentation module pre-segments the two-dimensional image of the cross section of the blood vessel of each layer in the step S1 respectively, and preliminarily extracts a blood vessel signal of each layer to obtain an initial blood vessel image of each layer;
s3, performing secondary segmentation on the initial blood vessel image of each layer in the step S2 by the image secondary segmentation module to obtain a blood vessel image of each layer;
and S4, the image conversion module stacks the blood vessel images of each layer in the step S3 in sequence to obtain a blood vessel three-dimensional image, and the blood vessel three-dimensional image is displayed through the display module.
Priority Applications (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010140859.8A CN111429404B (en) | 2020-03-04 | 2020-03-04 | Imaging system and method for detecting cardiovascular and cerebrovascular vessels |
Applications Claiming Priority (1)
| Application Number | Priority Date | Filing Date | Title |
|---|---|---|---|
| CN202010140859.8A CN111429404B (en) | 2020-03-04 | 2020-03-04 | Imaging system and method for detecting cardiovascular and cerebrovascular vessels |
Publications (2)
| Publication Number | Publication Date |
|---|---|
| CN111429404A true CN111429404A (en) | 2020-07-17 |
| CN111429404B CN111429404B (en) | 2020-12-15 |
Family
ID=71547478
Family Applications (1)
| Application Number | Title | Priority Date | Filing Date |
|---|---|---|---|
| CN202010140859.8A Active CN111429404B (en) | 2020-03-04 | 2020-03-04 | Imaging system and method for detecting cardiovascular and cerebrovascular vessels |
Country Status (1)
| Country | Link |
|---|---|
| CN (1) | CN111429404B (en) |
Cited By (2)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112085736A (en) * | 2020-09-04 | 2020-12-15 | 厦门大学 | Mixed-dimension convolution-based renal tumor segmentation method |
| CN113160120A (en) * | 2021-02-05 | 2021-07-23 | 十堰市太和医院 | Liver blood vessel segmentation method and system based on multi-mode fusion and deep learning |
Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN103247073A (en) * | 2013-04-18 | 2013-08-14 | 北京师范大学 | Three-dimensional brain blood vessel model construction method based on tree structure |
| US20140029816A1 (en) * | 2012-07-24 | 2014-01-30 | Alan Graham | Per vessel, vessel tree modelling with shared contours |
| CN107067409A (en) * | 2017-05-09 | 2017-08-18 | 上海联影医疗科技有限公司 | A kind of blood vessel separation method and system |
| CN108399648A (en) * | 2017-11-21 | 2018-08-14 | 北京裕恒佳科技有限公司 | The method and blood vessel 3-D imaging system of three-dimensional imaging are carried out to blood vessel |
| WO2019152850A1 (en) * | 2018-02-02 | 2019-08-08 | Centerline Biomedical, Inc. | Segmentation of anatomic structures |
-
2020
- 2020-03-04 CN CN202010140859.8A patent/CN111429404B/en active Active
Patent Citations (5)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| US20140029816A1 (en) * | 2012-07-24 | 2014-01-30 | Alan Graham | Per vessel, vessel tree modelling with shared contours |
| CN103247073A (en) * | 2013-04-18 | 2013-08-14 | 北京师范大学 | Three-dimensional brain blood vessel model construction method based on tree structure |
| CN107067409A (en) * | 2017-05-09 | 2017-08-18 | 上海联影医疗科技有限公司 | A kind of blood vessel separation method and system |
| CN108399648A (en) * | 2017-11-21 | 2018-08-14 | 北京裕恒佳科技有限公司 | The method and blood vessel 3-D imaging system of three-dimensional imaging are carried out to blood vessel |
| WO2019152850A1 (en) * | 2018-02-02 | 2019-08-08 | Centerline Biomedical, Inc. | Segmentation of anatomic structures |
Cited By (3)
| Publication number | Priority date | Publication date | Assignee | Title |
|---|---|---|---|---|
| CN112085736A (en) * | 2020-09-04 | 2020-12-15 | 厦门大学 | Mixed-dimension convolution-based renal tumor segmentation method |
| CN112085736B (en) * | 2020-09-04 | 2024-02-02 | 厦门大学 | Kidney tumor segmentation method based on mixed-dimension convolution |
| CN113160120A (en) * | 2021-02-05 | 2021-07-23 | 十堰市太和医院 | Liver blood vessel segmentation method and system based on multi-mode fusion and deep learning |
Also Published As
| Publication number | Publication date |
|---|---|
| CN111429404B (en) | 2020-12-15 |
Similar Documents
| Publication | Publication Date | Title |
|---|---|---|
| Faragallah et al. | A comprehensive survey analysis for present solutions of medical image fusion and future directions | |
| Saba et al. | Image enhancement and segmentation techniques for detection of knee joint diseases: A survey | |
| Wang et al. | Threshold segmentation algorithm for automatic extraction of cerebral vessels from brain magnetic resonance angiography images | |
| EP4014201A1 (en) | Three dimensional object segmentation of medical images localized with object detection | |
| Mahapatra et al. | Automatic detection and segmentation of Crohn's disease tissues from abdominal MRI | |
| US8706188B2 (en) | Automatic segmentation of articular cartilage from MRI | |
| Gebru et al. | Detection of cerebrovascular changes using magnetic resonance angiography | |
| Vasilic et al. | A novel local thresholding algorithm for trabecular bone volume fraction mapping in the limited spatial resolution regime of in vivo MRI | |
| Gupta et al. | Cardiac MR perfusion image processing techniques: a survey | |
| Mohan et al. | Tubular surface segmentation for extracting anatomical structures from medical imagery | |
| Bandhyopadhyay et al. | Segmentation of brain MRI image–a review | |
| Compas et al. | Radial basis functions for combining shape and speckle tracking in 4D echocardiography | |
| Kumar et al. | Knee articular cartilage segmentation from MR images: A review | |
| CN110163877A (en) | A kind of method and system of MRI ventricular structure segmentation | |
| CN111429404B (en) | Imaging system and method for detecting cardiovascular and cerebrovascular vessels | |
| Wong et al. | A comparison of peripheral imaging technologies for bone and muscle quantification: a review of segmentation techniques | |
| Hameeteman et al. | Carotid wall volume quantification from magnetic resonance images using deformable model fitting and learning-based correction of systematic errors | |
| Yin et al. | Automatic breast tissue segmentation in MRIs with morphology snake and deep denoiser training via extended Stein’s unbiased risk estimator | |
| CN114119626B (en) | Cerebrovascular image segmentation method based on statistical model and multi-scale filtering | |
| Fan et al. | Magnetic-resonance image segmentation based on improved variable weight multi-resolution Markov random field in undecimated complex wavelet domain | |
| Cui et al. | 2D and 3D vascular structures enhancement via improved vesselness filter and vessel enhancing diffusion | |
| Broderick et al. | Technique for the computation of lower leg muscle bulk from magnetic resonance images | |
| Li et al. | Clinical study of diffusion-weighted imaging in the diagnosis of liver focal lesion | |
| KR102170977B1 (en) | Brain metabolite network generation method using time varying function based on MRS | |
| US20200315547A1 (en) | Vertebral artery dissection risk evaluation method, computer device, and storage medium |
Legal Events
| Date | Code | Title | Description |
|---|---|---|---|
| PB01 | Publication | ||
| PB01 | Publication | ||
| SE01 | Entry into force of request for substantive examination | ||
| SE01 | Entry into force of request for substantive examination | ||
| CB02 | Change of applicant information | ||
| CB02 | Change of applicant information |
Address after: Building 3, Golden Symphony home, No.18, East Third Ring Road, Panlong District, Kunming City, Yunnan Province Applicant after: Zhang Feng Address before: 250032 Qilu Hospital, No.107 Wenhua West Road, Lixia District, Jinan City, Shandong Province Applicant before: Zhang Feng |
|
| CB03 | Change of inventor or designer information | ||
| CB03 | Change of inventor or designer information |
Inventor after: Du Jie Inventor after: Dong Yansheng Inventor after: Zhang Feng Inventor before: Zhang Feng |
|
| TA01 | Transfer of patent application right | ||
| TA01 | Transfer of patent application right |
Effective date of registration: 20201124 Address after: B1701, building 1, phase II, Yinxing Zhijie, No. 1301-76, sightseeing Road, Xinlan community, Guanlan street, Longhua District, Shenzhen City, Guangdong Province Applicant after: Guoke Saifu (Shenzhen) new drug R & D Technology Co., Ltd Address before: Building 3, Golden Symphony home, No.18, East Third Ring Road, Panlong District, Kunming City, Yunnan Province Applicant before: Zhang Feng |
|
| GR01 | Patent grant | ||
| GR01 | Patent grant |