CN109886973B - Blood vessel extraction method and device and computer readable storage medium - Google Patents

Blood vessel extraction method and device and computer readable storage medium Download PDF

Info

Publication number
CN109886973B
CN109886973B CN201910073353.7A CN201910073353A CN109886973B CN 109886973 B CN109886973 B CN 109886973B CN 201910073353 A CN201910073353 A CN 201910073353A CN 109886973 B CN109886973 B CN 109886973B
Authority
CN
China
Prior art keywords
images
layers
image
blood vessel
layer
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CN201910073353.7A
Other languages
Chinese (zh)
Other versions
CN109886973A (en
Inventor
魏润杰
李博文
高琪
吴鹏
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Shengshi Technology Co ltd
Original Assignee
Hangzhou Shengshi Technology Co ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Hangzhou Shengshi Technology Co ltd filed Critical Hangzhou Shengshi Technology Co ltd
Priority to CN201910073353.7A priority Critical patent/CN109886973B/en
Publication of CN109886973A publication Critical patent/CN109886973A/en
Application granted granted Critical
Publication of CN109886973B publication Critical patent/CN109886973B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The embodiment of the application discloses a blood vessel extraction method, a blood vessel extraction device and a computer-readable storage medium, wherein the method comprises the following steps: acquiring N layers of slice images of a target blood vessel, wherein each layer of slice image comprises M directional velocity field images, and N and M are positive integers; preprocessing each slice image in the N layers of slice images based on an image preprocessing algorithm to obtain a first class of N layers of images; wherein the image pre-processing algorithm comprises at least one neighborhood processing algorithm; based on a preset image segmentation algorithm, segmenting a target region containing the target blood vessel from each layer of image in the first class of N layers of images to obtain a second class of N layers of images; and merging the second type N layers of images based on the image sequence of the N layers of slice images to obtain an initial three-dimensional point cloud model of the target blood vessel.

Description

Blood vessel extraction method and device and computer readable storage medium
Technical Field
The present application relates to image processing technologies, and in particular, to a method and an apparatus for extracting blood vessels, and a computer-readable storage medium.
Background
With the continuous development of computer technology, modern medical imaging technology has made many innovations and breakthroughs in the medical diagnosis field and is widely applied to clinical diagnosis. Most of the traditional image diagnosis depends on professional medical personnel to analyze, although manual operation has the advantage of high precision, the increasingly huge image data and diagnosis demand make the working intensity of the medical personnel increasingly heavier, and thus the working quality is reduced. Compared with the traditional image diagnosis mode, the auxiliary diagnosis based on the computer can greatly reduce the working intensity of a clinician, improve the diagnosis accuracy rate and avoid the phenomena of misdiagnosis and missed diagnosis. For example: CT Angiography (CTA) and Nuclear Magnetic Resonance Imaging (MRI) can provide Angiography images, and screening and diagnosis of vascular diseases are facilitated; Four-Dimensional blood Flow Magnetic Resonance Imaging (4D Flow MRI) can extract a blood Flow velocity field changing along with time in a 3-Dimensional space, and a blood Flow velocity visualization technology is favorable for screening and diagnosing vascular diseases. Therefore, the method becomes very important for the research of automatic and accurate segmentation technology of the vascular tissue in the medical image, and can greatly reduce the work of an image doctor and provide the work efficiency and the work quality.
The traditional blood vessel image segmentation algorithm has achieved good effects when applied to medical image processing. The threshold-based segmentation method can divide the histogram of the image into a plurality of classes by using one or a plurality of gray values, and the pixels of all the gray values in the same gray level in the original image are classified into the same class, so as to achieve the effect of image segmentation. However, the quality of the process usually depends on the gray threshold of the image itself, and since the same group of data of the medical image has a large difference, there are often many fluctuations (noise), and the gray scale method does not consider the spatial position information of the pixels, so it is very sensitive to the noise. The segmentation method of region growing has also advanced in medical images, which is to combine pixels with similar properties to form a region given a series of seed points in an image. However, the final segmentation result has a large relationship with the selection of the seed point, and the selection of the seed point becomes more difficult due to the influence of data instability, so that the method is sensitive to noise, and discontinuous areas may be formed due to the influence of the noise. Since the active contour model can obtain a continuous and smooth closed segmentation boundary even under the condition of high noise, the medical image segmentation technology based on the active contour model is also receiving more and more attention. The basic idea of the active contour model is to set an initial curve first, then make the initial curve shrink continuously under the effect of the image force field, and finally shrink to the target edge. Although the active contour segmentation process can resist the interference of noise, the advantages and disadvantages of the process depend on the position of the initial curve, and in addition, the determination of a proper initial curve becomes more difficult due to the existence of noise.
The traditional method obtains good segmentation effect in a certain range, but has the common points that the segmentation effect depends on experience knowledge seriously, a large amount of manual intervention is needed, the noise is very sensitive, and the segmentation efficiency is not high. Therefore, the method is difficult to realize real automation in medical image segmentation, and only medical personnel without relevant professional knowledge can use the method, so that the method is difficult to really put into clinical application.
Disclosure of Invention
In order to solve the above technical problem, embodiments of the present application are expected to provide a method, an apparatus, and a storage medium for extracting a blood vessel, which can reduce noise interference and improve accuracy of blood vessel extraction.
The technical scheme of the application is realized as follows:
in a first aspect, a method for extracting blood vessels is provided, the method comprising:
acquiring N layers of slice images of a target blood vessel, wherein each layer of slice image comprises M directional velocity field images, and N and M are positive integers;
preprocessing each slice image in the N layers of slice images based on an image preprocessing algorithm to obtain a first class of N layers of images; wherein the image pre-processing algorithm comprises at least one neighborhood processing algorithm;
based on a preset image segmentation algorithm, segmenting a target region containing the target blood vessel from each layer of image in the first class of N layers of images to obtain a second class of N layers of images;
and merging the second type N layers of images based on the image sequence of the N layers of slice images to obtain an initial three-dimensional point cloud model of the target blood vessel.
In a second aspect, there is provided a blood vessel extraction device, the device comprising:
the acquisition unit is used for acquiring N layers of slice images of a target blood vessel, wherein each layer of slice image comprises speed field images in M directions, and N and M are positive integers;
the processing unit is used for preprocessing each slice image in the N layers of slice images based on an image preprocessing algorithm to obtain a first type of N layers of images; wherein the image pre-processing algorithm comprises at least one neighborhood processing algorithm;
the processing unit is further used for segmenting a target region containing the target blood vessel from each layer of image in the first class of N layers of images based on a preset image segmentation algorithm to obtain a second class of N layers of images;
and the reconstruction unit is used for merging the second type of N layers of images based on the image sequence of the N layers of slice images to obtain an initial three-dimensional point cloud model of the target blood vessel.
In a third aspect, there is provided a blood vessel extraction device, the device comprising a processor and a memory configured to store a computer program operable on the processor,
wherein the processor is configured to perform the steps of the aforementioned method when running the computer program.
In a fourth aspect, a computer storage medium is provided, on which a computer program is stored, wherein the computer program, when executed by a processor, implements the steps of the aforementioned method.
By adopting the technical scheme, the N layers of slice images of the target blood vessel are subjected to neighborhood processing by utilizing at least one neighborhood processing algorithm, so that the interference of noise in the images can be effectively inhibited, the target blood vessel can be accurately positioned, and the accuracy of subsequent image segmentation operation can be ensured, thereby improving the extraction precision of the three-dimensional point cloud model of the target blood vessel and ensuring the quality of the three-dimensional reconstructed image of the target blood vessel.
Drawings
FIG. 1 is a schematic flow chart of a blood vessel extraction method in an embodiment of the present application;
FIGS. 2A-2C are schematic diagrams of velocity field images in three directions according to an embodiment of the present disclosure;
FIGS. 3A to 3B are schematic diagrams illustrating comparison before and after neighborhood variance processing in the embodiment of the present application;
fig. 4A to 4C are schematic diagrams illustrating the positive and negative judgment results of the neighborhood of the velocity field image in three directions in the embodiment of the present application;
fig. 5A to 5C are schematic diagrams of weighted results of positive and negative judgment of neighborhood of velocity field images in three directions in the embodiment of the present application;
fig. 6A to 6C are schematic diagrams illustrating results of merging two kinds of neighborhood processing of velocity field images in three directions in the embodiment of the present application;
FIGS. 7A-7C are schematic diagrams of the results of the three-directional velocity field image fill-in pit holes and median filtering in the present embodiment;
FIG. 8 is a diagram illustrating the merged results of three velocity field images in three directions according to an embodiment of the present disclosure;
FIG. 9 is a diagram illustrating the result of image segmentation in the embodiment of the present application;
FIG. 10 is a graph showing the results of morphological erosion of an image according to an embodiment of the present application;
FIG. 11 is a schematic diagram of an initial three-dimensional point cloud model in an embodiment of the present application;
FIG. 12 is a graphical representation of the results after morphological dilation in an embodiment of the application;
FIG. 13 is a schematic diagram of a final three-dimensional point cloud model in an embodiment of the present application;
FIG. 14 is a schematic diagram of a three-dimensional point cloud model of a region to be enhanced in the embodiment of the present application;
FIG. 15 is a schematic diagram of an enhanced three-dimensional point cloud model according to an embodiment of the present disclosure;
FIG. 16 is a schematic diagram of a three-dimensional reconstructed model of a target blood vessel in an embodiment of the present application;
fig. 17 is a schematic structural diagram of a blood vessel extraction device in an embodiment of the present application.
Detailed Description
So that the manner in which the features and elements of the present embodiments can be understood in detail, a more particular description of the embodiments, briefly summarized above, may be had by reference to embodiments, some of which are illustrated in the appended drawings.
Example one
As shown in fig. 1, the blood vessel extraction method specifically includes:
step 101: acquiring N layers of slice images of a target blood vessel, wherein each layer of slice image comprises M directional velocity field images, and N and M are positive integers;
step 102: preprocessing each slice image in the N layers of slice images based on an image preprocessing algorithm to obtain a first class of N layers of images; the image preprocessing algorithm comprises at least one neighborhood processing algorithm;
step 103: based on a preset image segmentation algorithm, segmenting a target region containing a target blood vessel from each layer of image in the first class of N layers of images to obtain a second class of N layers of images;
step 104: and combining the second type of N layers of images based on the image sequence of the N layers of slice images to obtain an initial three-dimensional point cloud model of the target blood vessel.
Here, the execution subject of steps 101 to 104 may be a processor of the blood vessel extraction device.
Here, the target blood vessel may be a variety of blood vessels, and the blood vessel includes a main blood vessel and a micro blood vessel, and the main blood vessel may be a blood vessel such as an arterial blood vessel and a venous blood vessel, or any combination thereof. Microvessels include main vessel branches as well as capillaries.
In practical application, the N-layer slice images may be N-layer two-dimensional slice images of the target blood vessel, and are obtained by scanning a digital image of the target blood vessel into a computer through a slice scanner. The scanning technology comprises the following steps: MRI, Four-Dimensional Flow Magnetic Resonance Imaging (4D Flow MRI), CTA, Magnetic Resonance Angiography (MRA), Computed Tomography (CT), and the like.
Here, the image preprocessing algorithm may include at least one neighborhood processing algorithm; the neighborhood processing algorithm comprises a neighborhood variance method, a neighborhood energy method, neighborhood positive and negative judgment and the like. For example, step 102 may specifically include: based on a first neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of slice images to obtain N template images; based on a second neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of sliced images to obtain a third type of N layers of images; performing dot product operation on the ith template image in the N template images and the speed field images in the M directions of the ith image in the third type of N layer images to obtain a first type of N layer images, wherein i is a positive integer less than or equal to N; wherein the first neighborhood processing algorithm is different from the second neighborhood processing algorithm.
Specifically, the method for obtaining N template images includes: based on a first neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of sliced images to obtain N multiplied by M neighborhood processed images, and combining the speed field images in M directions in each layer of images in the N multiplied by M images to obtain N images; determining the optimal threshold values of the N images based on the maximum inter-class variance method; and dividing each image in the N images into two partial areas based on the optimal threshold value, setting the pixel of the noise area as 0, and setting the pixels of other areas as 1 to obtain N binary images, wherein the N binary images are N template images.
Here, the first neighborhood processing algorithm may be a neighborhood variance method, which can enlarge pixel values of a noise region in the image, and reduce pixel values of a blood vessel region to achieve the purpose of distinguishing the noise region from the blood vessel region, thereby improving the effect of subsequent image binarization processing. The second neighborhood processing algorithm can judge whether the neighborhood is positive or negative, and can effectively reduce the brightness of the noise area in the image, namely, the noise area in the image is restrained. Therefore, the two neighborhood combination processing methods can effectively inhibit noise in the image and improve the denoising effect.
In practical application, obtaining the first type N layer image includes: and performing morphological filling operation and/or median filtering on the image subjected to the dot product operation to obtain a first type of N-layer image. The filling operation can fill the pits in the image, and the median filtering can eliminate the residual part of noise in the image, thereby improving the subsequent image processing effect.
In the embodiment of the present application, each of the first N-layer images includes M direction velocity field images, and each of the third N-layer images also includes M direction velocity field images.
In practical application, step 103 specifically includes: combining the speed field images of each layer of image in the first class of N layers of images in the M directions into one image to obtain N layers of images to be segmented; determining the optimal threshold value of the N layers of images to be segmented based on the maximum inter-class variance method; and segmenting a target region containing a target blood vessel from each layer of image in the N layers of images to be segmented based on the optimal threshold value to obtain a second type of N layers of images. Here, the target region of each slice image includes vessel sections of the target vessel at different dissection positions.
In the embodiment of the present application, each layer image in the second class of N layer images includes only one image.
The self-adaptive threshold segmentation based on the maximum inter-class variance is implemented in the following steps:
the blood vessels and the surrounding tissues such as liver, pancreas, body fluid and fat have difference in gray distribution, and the blood vessels can be separated from the image by adopting an adaptive threshold segmentation method based on the maximum between-class variance, and the background part can be removed. The algorithm comprises the following steps:
1. the image to be segmented is normalized and calculated to obtain a gray level histogram, namely the number of pixels with certain gray level. Assuming that the total pixel points of the image are N, and N pixel points with the gray value of i appear in total, the probability of the gray level i appearing is p (i) ═ N/N;
2. setting a threshold k divides the gray level histogram into two categories, a and B: a: p (i) ≧ k and B: p (i) < k, calculating the between-class variance of the A and B classes;
3. changing K from 1 to 255, and respectively calculating the AB between-class variance corresponding to each K value, wherein the corresponding threshold value is the optimal threshold value K when the between-class variance is maximum;
4. and (3) performing binary segmentation on the image by using the K value, namely taking pixels with the image gray level being more than or equal to K as a target area, and taking the rest as a background.
In practical application, step 104 specifically includes: performing morphological corrosion treatment on a target area of each image in the second type N layer images based on a preset morphological algorithm to obtain corroded second type N layer images; and merging the corroded second type N layers of images based on the image sequence of the N layers of sliced images to obtain an initial three-dimensional point cloud model of the target blood vessel. Here, the preset morphological algorithm is an erosion algorithm,
here, the image sequence of the N layers of sliced images is the number of each layer of sliced images after the images are sliced, for example, the number from 1 to N, when the second type of images are merged, the position of each layer of images is determined according to the image sequence, the sequence when the images are merged is consistent with the sequence when the images are sliced, and it can be ensured that an accurate three-dimensional point cloud model can be obtained after merging.
The method further comprises the following steps: and performing surface reconstruction on the target blood vessel in the initial three-dimensional point cloud model to obtain a smooth and closed three-dimensional curved surface, wherein the three-dimensional curved surface is the best fit curved surface of the three-dimensional point cloud model, and the entity contained in the three-dimensional curved surface is the reconstructed three-dimensional target blood vessel.
By adopting the technical scheme, the N layers of slice images of the target blood vessel are subjected to neighborhood processing by utilizing at least one neighborhood processing algorithm, so that the interference of noise in the images can be effectively inhibited, the target blood vessel can be accurately positioned, and the accuracy of subsequent image segmentation operation can be ensured, thereby improving the extraction precision of the three-dimensional point cloud model of the target blood vessel and ensuring the quality of the three-dimensional reconstructed image of the target blood vessel.
Example two
To further illustrate the object of the present application, on the basis of the first embodiment of the present application, the method for extracting a blood vessel specifically includes:
step 201: acquiring N layers of slice images of a target blood vessel, wherein each layer of slice image comprises M directional velocity field images, and N and M are positive integers;
step 202: based on a first neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of slice images to obtain N template images;
specifically, the method for obtaining N template images includes: based on a first neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of sliced images to obtain N multiplied by M neighborhood processed images, and combining the speed field images in M directions in each layer of images in the N multiplied by M images to obtain N images; determining the optimal threshold values of the N images based on the maximum inter-class variance method; and dividing each image in the N images into two partial areas based on the optimal threshold value, setting the pixel of the noise area as 0, and setting the pixels of other areas as 1 to obtain N binary images, wherein the N binary images are N template images.
Here, the first neighborhood processing algorithm may be a neighborhood variance method, which can enlarge pixel values of a noise region in the image, and reduce pixel values of a blood vessel region to achieve the purpose of distinguishing the noise region from the blood vessel region, thereby improving the effect of subsequent image binarization processing.
Step 203: based on a second neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of sliced images to obtain a third type of N layers of images;
here, the second neighborhood processing algorithm may determine whether the neighborhood is positive or negative, and may effectively reduce the brightness of the noise region in the image, i.e., suppress the noise region in the image. Therefore, the two neighborhood combination processing methods can effectively inhibit noise in the image and improve the denoising effect.
Step 204: performing dot product operation on the ith template image in the N template images and the speed field images in the M directions of the ith image in the third type of N layer images to obtain a first type of N layer images, wherein i is a positive integer less than or equal to N;
here, the dot multiplication is a multiplication of pixel values at the same position between images.
In practical application, obtaining the first type N layer image includes: and performing morphological filling operation and/or median filtering on the image subjected to the dot product operation to obtain a first type of N-layer image. The filling operation can fill the pits in the image, and the median filtering can eliminate the residual part of noise in the image, thereby improving the subsequent image processing effect.
In the embodiment of the present application, each of the first N-layer images includes M direction velocity field images, and each of the third N-layer images also includes M direction velocity field images.
Step 205: based on a preset image segmentation algorithm, segmenting a target region containing a target blood vessel from each layer of image in the first class of N layers of images to obtain a second class of N layers of images;
specifically, speed field images in M directions of each layer of image in the first class of N layers of images are combined into one image, and N layers of images to be segmented are obtained; determining the optimal threshold value of the N layers of images to be segmented based on the maximum inter-class variance method; and segmenting a target region containing a target blood vessel from each layer of image in the N layers of images to be segmented based on the optimal threshold value to obtain a second type of N layers of images.
In the embodiment of the present application, each layer image in the second class of N layer images includes only one image.
Step 206: merging the second type of N layers of images based on the image sequence of the N layers of sliced images to obtain an initial three-dimensional point cloud model of the target blood vessel;
here, the image sequence of the N layers of sliced images is the number of each layer of sliced images after the images are sliced, for example, the number from 1 to N, when the second type of images are merged, the position of each layer of images is determined according to the image sequence, the sequence when the images are merged is consistent with the sequence when the images are sliced, and it can be ensured that an accurate three-dimensional point cloud model can be obtained after merging.
Step 207: slicing the initial three-dimensional point cloud model to obtain N template images;
specifically, slicing an initial three-dimensional point cloud model to obtain N layers of images; and based on a preset morphological algorithm, performing morphological expansion processing on the region containing the target blood vessel in each layer of the N layers of images to obtain N template images. Here, the preset morphological algorithm is a dilation algorithm.
Here, the quality of the N template images obtained by slicing the initial three-dimensional point cloud model is higher than that of the N template images obtained in step 202, that is, in the second iteration process, the template image generated by the initial three-dimensional point cloud model obtained in the first iteration process is used to perform the blood vessel extraction operation again, so that the denoising effect and the image segmentation precision can be improved. That is, if the blood vessel detection environment is better, the image processing operation is performed once to obtain a better initial three-dimensional point cloud model, and the steps after step 206 do not need to be performed; if the blood vessel detection environment is complex and the target blood vessel is adhered to other tissues or organs in the obtained initial three-dimensional point cloud model, secondary iteration is required to be performed, i.e., step 206 to step 210 are performed, so as to remove the influence of other tissues or organs.
Step 208: performing dot product operation on the ith template image in the N template images and the speed field images in the M directions of the ith image in the third type of N layer images to obtain a first type of N layer images;
here, the N template images obtained in step 202 are regarded as a first template, and the N template images obtained in step 207 are regarded as a second template.
That is, step 208 replaces the first template in step 204 with the second template, and the third type of N-layer images, and the operation process are the same.
Step 209: based on a preset image segmentation algorithm, segmenting a target region containing a target blood vessel from each layer of image in the first class of N layers of images to obtain a second class of N layers of images;
step 210: and combining the second type of N layers of images based on the image sequence of the N layers of slice images to obtain a final three-dimensional point cloud model of the target blood vessel.
Here, the image sequence of the N layers of sliced images is the number of each layer of sliced images after the images are sliced, for example, the number from 1 to N, when the second type of images are merged, the position of each layer of images is determined according to the image sequence, the sequence when the images are merged is consistent with the sequence when the images are sliced, and it can be ensured that an accurate three-dimensional point cloud model can be obtained after merging.
The method further comprises the following steps: and performing surface reconstruction on the target blood vessel in the final three-dimensional point cloud model to obtain a smooth and closed three-dimensional curved surface, wherein the three-dimensional curved surface is the best fit curved surface of the three-dimensional point cloud model, and the entity contained in the three-dimensional curved surface is the reconstructed three-dimensional target blood vessel.
Here, the execution subject of steps 201 to 210 may be a processor of the blood vessel extraction device.
EXAMPLE III
To further illustrate the purpose of the present application, based on the first and second embodiments of the present application, the method for extracting blood vessels specifically includes:
step 301: acquiring N layers of slice images of a target blood vessel, wherein each layer of slice image comprises M directional velocity field images, and N and M are positive integers;
step 302: determining a region to be enhanced in the velocity field image in each direction in the N layers of slice images based on the user selection information; wherein at least part of the vessels in the region to be enhanced comprises the target vessel;
in practical applications, if the characteristics of a part of the region in the target blood vessel are not obvious, the blood vessel extraction method may not be used to accurately extract the regions with the unobvious characteristics, and therefore, the regions need to be enhanced.
The user may determine the region to be enhanced through manual frame selection, for example, select the region to be enhanced through a user input unit frame, where the user input unit may be a touch display unit, and circle a region to be enhanced on the touch display unit, where the region to be enhanced is based on the region circled by the user, that is, the region to be enhanced of each layer of slice image.
Step 303: based on a first neighborhood processing algorithm, neighborhood processing is carried out on a region to be enhanced in the speed field image in each direction to obtain a first class of N-layer images;
here, when processing the region to be enhanced, only one neighborhood processing algorithm needs to be adopted, and more adhesion parts can be reserved. The first neighborhood processing algorithm is adopted to amplify the pixel value of the noise area in the image and reduce the pixel value of the blood vessel area, so that the purpose of distinguishing the noise area from the blood vessel area is achieved, and the part of the area to be enhanced, which is tightly adhered to the target blood vessel, is reserved. If the second neighborhood processing algorithm and neighborhood merging processing are adopted, target blood vessels adhered to other parts in the region to be enhanced can be removed as noise, and the part of the image cannot be completely extracted.
Step 304: based on a preset image segmentation algorithm, segmenting a target region containing a target blood vessel from each layer of image in the first class of N layers of images to obtain a second class of N layers of images;
specifically, speed field images in M directions of each layer of image in the first class of N layers of images are combined into one image, and N layers of images to be segmented are obtained; determining the optimal threshold value of the N layers of images to be segmented based on the maximum inter-class variance method; and segmenting a target region containing a target blood vessel from each layer of image in the N layers of images to be segmented based on the optimal threshold value to obtain a second type of N layers of images.
In the embodiment of the present application, each layer image in the second class of N layer images includes only one image.
Step 305: and combining the second type of N layers of images based on the image sequence of the N layers of sliced images to obtain a three-dimensional point cloud model of the region to be enhanced.
Here, the image sequence of the N layers of sliced images is the number of each layer of sliced images after the images are sliced, for example, the number from 1 to N, when the second type of images are merged, the position of each layer of images is determined according to the image sequence, the sequence when the images are merged is consistent with the sequence when the images are sliced, and it can be ensured that an accurate three-dimensional point cloud model can be obtained after merging.
In practical application, the method further comprises the following steps: combining the three-dimensional point cloud model of the region to be enhanced with the initial three-dimensional point cloud model to obtain an enhanced three-dimensional point cloud model of the target blood vessel; or combining the three-dimensional point cloud model of the region to be enhanced and the final three-dimensional point cloud model to obtain the enhanced three-dimensional point cloud model of the target blood vessel.
Namely, the enhanced three-dimensional point cloud model of the target blood vessel is combined with the initial three-dimensional model or the final three-dimensional point cloud model of the target blood vessel to obtain the enhanced three-dimensional point cloud model of the target blood vessel.
The method further comprises the following steps: and performing surface reconstruction on the target blood vessel in the enhanced three-dimensional point cloud model of the target blood vessel to obtain a smooth and closed three-dimensional curved surface, wherein the three-dimensional curved surface is a best fit curved surface of the three-dimensional point cloud model, and an entity contained in the three-dimensional curved surface is the reconstructed three-dimensional target blood vessel.
Here, the execution subject of steps 301 to 305 may be a processor of the blood vessel extraction device.
Example four
To further illustrate the object of the present application, the following examples are given in the first to third embodiments of the present application. The embodiment can realize high-precision automatic identification of the artery vessel aiming at the MRI image of the aorta.
The slice image is a Four-Dimensional Flow Magnetic Resonance Imaging (4D Flow MRI) of the human thorax, the N-layer slice image is a series of MRI images of 64 continuous sagittal planes in one heartbeat cycle (total 28 moments) of the human heart region, and the resolution of each image is r0×c0(in this example r)0=512,c0512), for a total of r0×c0An image. The goal of this example is from 28 hoursIn the process, the optimal time is determined, the artery blood vessels in the nuclear magnetic images at the time are accurately segmented, then the artery blood vessels in all 64 images at the time are extracted, and the artery blood vessels are reconstructed into a high-precision three-dimensional artery blood vessel.
The method for extracting the blood vessel specifically comprises the following steps:
step 1: two-dimensional image processing
1.1 two-dimensional image slices
The velocity field data in the 4D flow MRI image is sliced in the side view direction, and 64 slice images are generated on the three direction component velocity field images, respectively, for a total of 64 × 3 images. Three velocity field images in each slice image are respectively marked as U, V and W, and the meaning of the velocity field image is that the velocity vector of a particle at a certain position in space is decomposed into three directions in a corresponding space coordinate system, and represents the velocity of the particle in the three directions of the coordinate system. Fig. 2A to 2C show decomposition effect graphs, where fig. 2A is a U-direction velocity field image in the embodiment of the present application, fig. 2B is a V-direction velocity field image in the embodiment of the present application, and fig. 2C is a W-direction velocity field image in the embodiment of the present application.
1.2 neighborhood variance method
Neighborhood variance processing is performed on the image using a Neighborhood variance method (neighborwood variance), and the formula is as follows:
Figure BDA0001957959290000131
where (x, y) is the coordinates of a point, S is the neighborhood range, m and n are the dimensions of the neighborhood S respectively (in this embodiment, m and n are o and 3, i.e., S range is 3 × 3 × 3, i.e., 26 neighborhoods), fS(x, y) is a pixel of the point (x, y),
Figure BDA0001957959290000132
is the average pixel in the neighborhood, IS(i, j) is the variance in the neighborhood centered on point (i, j).
Through a neighborhood variance method, the pixel value of a noise region in an image can be amplified, and the pixel value of a blood vessel region is reduced to achieve the purpose of distinguishing the noise region from the blood vessel region, wherein fig. 3A is the image before being processed by the neighborhood variance method in the embodiment of the application, and fig. 3B is the image after being processed by the neighborhood variance method in the embodiment of the application.
1.3 neighborhood Positive and negative judgment
The raw data is processed again using Neighborhood Positive and Negative (PN) as follows:
PNS(i,j)=|lengthS(P)-lengthS(N)|2
wherein, lengthS(P) is the positive number in the neighborhood S, lengthS(N) is the number of negative values in the neighborhood S, PNS(i, j) is the PN value in the neighborhood S.
In this embodiment, the neighborhood S range is 8 neighborhoods, so the value range of PN is 0 to 81, fig. 4A is a schematic diagram of the positive and negative judgment result of the neighborhood of the U-direction velocity field image in the embodiment of the present application, fig. 4B is a schematic diagram of the positive and negative judgment result of the neighborhood of the V-direction velocity field image in the embodiment of the present application, and fig. 4C is a schematic diagram of the positive and negative judgment result of the neighborhood of the W-direction velocity field image in the embodiment of. The larger the PN value is, the stronger the consistency of the image in the region is, the smaller the PN value is, the worse the consistency is, and the consistency of the blood vessel target region is often far greater than that of the noise region, so the PN value and the original data are subjected to dot multiplication, the brightness of the noise region in the image can be effectively and remarkably reduced, namely the noise region in the image is restrained, and the denoising effect can be achieved through judgment of the positive and negative values of the neighborhood. Fig. 5A is a schematic diagram of a weighted result of positive and negative judgment of a U-direction velocity field image neighborhood in the embodiment of the present application, fig. 5B is a schematic diagram of a weighted result of positive and negative judgment of a V-direction velocity field image neighborhood in the embodiment of the present application, and fig. 5C is a schematic diagram of a weighted result of positive and negative judgment of a neighborhood of a W-direction velocity field image in the embodiment of the present application.
1.4 merging two neighborhood processing methods
After being respectively judged by a neighborhood variance method and neighborhood positive and negative values, firstly summing the results of three direction images in each slice of the results of the step 1.2 to generate 64 combined resultsAnd (4) an image. Dividing the image into two parts by using a maximum inter-class variance method, setting the pixels of a high-brightness area, namely a noise area, as 0, and setting the pixels of other areas as 1, thus obtaining a binary image, and marking the binary image as a template I1I.e. 64 template images I1A template I corresponding to each slice image1And performing dot multiplication on the result of the step 1.3 to generate N multiplied by 3 processed images. Through template processing, the purpose of further removing noise can be achieved. Fig. 6A is a schematic diagram of a result obtained by merging two kinds of neighborhood processing of a U-direction velocity field image in the embodiment of the present application, fig. 6B is a schematic diagram of a result obtained by merging two kinds of neighborhood processing of a V-direction velocity field image in the embodiment of the present application, and fig. 6C is a schematic diagram of a result obtained by merging two kinds of neighborhood processing of a W-direction velocity field image in the embodiment of the present application.
1.5 pit filling and median filtering
And (3) performing morphological filling operation and median filtering processing on the result of the step (1.4), wherein the filling operation is to search a connected region in the image, the connected region can divide the original image into two regions, then judging whether the two regions contain the edge of the whole blood vessel image, and setting the pixel value of the region not containing the edge of the blood vessel image as a global maximum value, namely filling the background region, wherein the filling criterion is as follows:
Figure BDA0001957959290000141
if the p point is located on the boundary line, the pixel value of the p point is the original pixel value f (p) of the p point, and the pixel value of the region which does not contain the blood vessel image and is outside the boundary line is set as the global maximum value tmaxHere, the padding operation is performed on the binary image, and the maximum pixel value is 1.
According to the above criteria, the original image is subjected to the hole filling operation in a certain connected region, and the hole and other features in the two-dimensional image can be filled through the step. In this embodiment, an 8-way shim is used. By the filling operation, the pits in the image can be effectively filled.
After the pit filling is carried out on the image, the image is filtered by using a filter operator, and the result can be subjected to median filtering, so that the noise characteristic of the image residual can be eliminated. The median filtering is a nonlinear smoothing technology, which sets the gray value of each pixel point as the median of all the gray values of the pixel points in a certain neighborhood window of the point, and the median filtering formula is as follows:
Y(i,j)=MedS(f(i-m,j-n),…f(i,j),…f(i+m,j+n))
where f (i, j) is the pixel value of the point (i, j), S is the neighborhood region (where m and n are the dimensions of the neighborhood S, respectively, and m ═ n ═ 3 in this embodiment, i.e., 8 neighborhoods), and Y (i, j) is the value of the point (i, j) in the neighborhood S, which is the median value in the neighborhood.
The pit holes in the image can be filled through the morphological filling operation of the image, and the residual partial noise of the image can be eliminated through the median filtering. Fig. 7A is a schematic diagram of a result of U-direction velocity field image hole filling and median filtering in the embodiment of the present application, fig. 7B is a schematic diagram of a result of V-direction velocity field image hole filling and median filtering in the embodiment of the present application, and fig. 7C is a schematic diagram of a result of W-direction velocity field image hole filling and median filtering in the embodiment of the present application.
1.6 maximum inter-class variance thresholding
The results of step 1.5 are first combined and the three directional images of each slice image are added to generate N images as shown in fig. 8. Then, the maximum inter-class variance method is used for carrying out threshold segmentation on the image, and the image is automatically divided into two parts, wherein the high-brightness area pixel is set to be 1, and the low-brightness area pixel is set to be 0. The high-brightness region is the region where the blood vessel is considered to be. The maximum inter-class variance method (also called the Otsu method) is adopted to carry out threshold segmentation, is proposed by Otsu scholars of Japan and is a self-adaptive threshold determination method. It is to divide the image into background and object 2 parts according to the gray scale characteristics of the image. The larger the inter-class variance between the background and the object, the larger the difference of 2 parts constituting the image is. The variance formula in the maximum inter-class variance method is set as:
g=w0w101)2
wherein, w0The ratio of the number of all pixels with gray values smaller than the threshold value in the image to all pixels, w1The ratio of the number of all pixels with gray values larger than the threshold value in the image to all pixels is mu0Is the mean gray value, μ, of all pixels in the image smaller than the threshold1Is the average gray value of all pixels in the image that are larger than the threshold.
By traversing all the pixel points, the optimal threshold value for dividing the image area can be obtained, namely the gray value of the pixel point which enables the variance formula to reach the maximum value. By threshold segmentation, a blood vessel target region can be completely extracted, and fig. 9 is a schematic diagram of a result after image segmentation in the embodiment of the present application.
1.7 morphological Corrosion
The result of step 1.6 is subjected to a morphological etch that shrinks its boundaries, which can cause unwanted adhesions due to errors to be cut. The corrosion is defined as follows:
Figure BDA0001957959290000161
where A is 64 divided images and B is a structure (in this embodiment, the structure B is defined as [ 010; 111; 010 ]).
And in the corrosion process, performing convolution operation on the structural body B in the pixel data of the image A, if the intersection of the structural body B taking a certain point as the center and the image A completely belongs to the area of the A, reserving the point, and taking the set of all points meeting the condition as the result of the corrosion of the image. FIG. 10 is a graph showing the result of image erosion in the example of the present application.
1.8 creating a preliminary three-dimensional point cloud
And (3) recombining 64 images of the result of the step (1.7) into a 3-dimensional form according to the image sequence of the slice image in the step (1.1), reserving a 3-dimensional maximum communication domain, and preliminarily extracting a 3-dimensional blood vessel target region by reserving the 3-dimensional maximum communication domain to form an initial three-dimensional point cloud model of the blood vessel.
Through the steps 1.1-1.8, an initial three-dimensional point cloud model of the blood vessel can be generated preliminarily. Fig. 11 is a schematic diagram of an initial three-dimensional point cloud model in an embodiment of the present application, where a light color area in the middle of an image is an aorta to be extracted, a dark color portion adhered to the aorta is a pulmonary artery, and a part of the steps in the above steps needs to be performed again to extract the aorta, so as to separate the aorta from the pulmonary artery.
Step 2: vascular region extraction
2.1 Re-dicing Process
And (3) slicing the initial three-dimensional point cloud model extracted preliminarily in the step 1.8 again according to the image slicing mode in the step 1.1 to obtain 64 two-dimensional images.
2.2 target template fabrication
For the 64 two-dimensional images obtained in step 2.1, since in step 1.7, the morphological erosion operation is performed to avoid the two-dimensional effect map from being erroneously connected in three dimensions as much as possible, the morphological dilation operation is performed here, and the morphological dilation formula is as follows:
Figure BDA0001957959290000171
where A is the two-dimensional image obtained in step 2.1 and B is the structure (in this example, structure B is defined as [ 010; 111; 010 ]).
The expansion process is to perform convolution operation on the structure B on the structure A, if the structure B taking a certain point as the center has an overlapping area with the original data A in the moving process of the original data A, the point is reserved, and the set of all the points meeting the condition is the result of morphological expansion of the image. The morphological dilation result is used as a processing template of the blood vessel target area to be recordedThe template is I2I.e. generating 64 template images I2. As a processing template for the target area. FIG. 12 is a graphical representation of the results after morphological dilation in the examples of the present application.
2.3 generating the final point cloud by iterative operation
64 template images I obtained in step 2.22Instead of 64 template images I in step 1.41And (3) performing the retreatment of the steps 1.3-1.6 on the 64 slice images in the step 1.1, and performing the 1.8 step treatment on the final result to obtain a final three-dimensional point cloud model of the arterial vessel. Fig. 13 is a schematic diagram of a final three-dimensional point cloud model in the embodiment of the present application.
2.4 Artificial augmentation of innominate, common carotid, and subclavian arteries
And (3) adding an artificial option according to the result obtained in the step (2.3) or the step (1.8) to enhance the extraction of the innominate artery, the common carotid artery and the subclavian artery, if the three arterial branches have unobvious features in the original data, adding an artificial enhancement step, as shown in a schematic diagram in fig. 14, selecting a region to be enhanced by an artificial frame, wherein three parts protruding upwards and similar to triangles in the region to be enhanced are the innominate artery, the common carotid artery and the subclavian artery respectively, and performing the processing operations of the steps (1.1-1.2) and (1.5-1.8) on the region to be enhanced again to obtain a three-dimensional point cloud model of the region to be enhanced.
2.5, combining the three-dimensional point cloud model of the region to be enhanced obtained in the step 2.4 with the initial three-dimensional point cloud model obtained in the step 1.8 to obtain an enhanced three-dimensional point cloud model of the target blood vessel; or combining the three-dimensional point cloud model of the region to be enhanced obtained in the step 2.4 and the final three-dimensional point cloud model obtained in the step 2.3 to obtain the enhanced three-dimensional point cloud model of the target blood vessel. Fig. 15 is a schematic diagram of an enhanced three-dimensional point cloud model in an embodiment of the present application.
And step 3: three-dimensional reconstruction of blood vessels
And (3) processing the three-dimensional point cloud model obtained in the step (1.8), the step (2.3) or the step (2.4) by using a Poisson surface reconstruction algorithm to obtain a smooth and closed three-dimensional curved surface, wherein the three-dimensional curved surface is a best fit curved surface for point cloud, and an entity contained in the three-dimensional curved surface is a reconstructed three-dimensional target blood vessel. Fig. 16 is a schematic diagram of a three-dimensional reconstruction model of a target blood vessel in an embodiment of the present application.
In this embodiment, the velocity field image in the 4D flow MRI image is first processed by the neighborhood variance method. And then, carrying out neighborhood positive and negative value judgment on the image, and weighting the result after the positive and negative value judgment to the image. And then performing morphological filling operation on the image to fill the pits, and using median filtering to enable the image to be full and smoother. The image is then automatically thresholded using the maximum inter-class variance method. And then, performing morphological corrosion operation on the image, and reserving a 3-dimensional connected region as an initial three-dimensional point cloud model of the image. And carrying out slicing operation with the same direction and consistent dimension as the original slice image on the initial three-dimensional point cloud model, then carrying out morphological expansion processing, and taking the processed image as an area limiting template of the original slice image. And performing one iteration operation on the image according to the template, finally generating a final three-dimensional point cloud model of the target blood vessel, and obtaining a three-dimensional curved surface by using a Poisson surface reconstruction algorithm, wherein an entity contained in the three-dimensional curved surface is the three-dimensional reconstruction body of the target blood vessel.
The blood vessel extraction method provided in the embodiment of the application has the following advantages:
1. by adopting the extraction of two kinds of neighborhood information, the structural information of the image is effectively utilized, the noise suppression effect is improved, and the method has obvious advantages compared with a simple threshold value method or a growth method.
2. The method utilizes the maximum inter-class variance method to perform automatic threshold segmentation, well utilizes the gray information of the image, realizes complete automatic image segmentation and has better segmentation effect.
3. And 3-dimensional connected regions are reserved, so that errors caused by processing on a two-dimensional image can be effectively avoided, and the processing of 3-dimensional data is realized.
4. Manual intervention is greatly reduced, so that the extraction of the model is more stable and the efficiency is higher.
EXAMPLE five
Based on the same inventive concept, the embodiment of the application also provides a blood vessel extraction device. As shown in fig. 17, the apparatus includes:
the acquisition unit 171 is configured to acquire N layers of slice images of the target blood vessel, where each layer of slice image includes velocity field images in M directions, and N and M are positive integers;
the processing unit 172 is configured to pre-process each slice image of the N layers of slice images based on an image pre-processing algorithm to obtain a first class N layer image; wherein the image pre-processing algorithm comprises at least one neighborhood processing algorithm;
the processing unit 172 is further configured to segment a target region including the target blood vessel from each layer of image in the first class N layer of images based on a preset image segmentation algorithm to obtain a second class N layer of images;
a reconstructing unit 173, configured to merge the second class of N-layer images based on the image sequence of the N-layer slice images to obtain an initial three-dimensional point cloud model of the target blood vessel.
In some embodiments, the processing unit 172 is specifically configured to perform neighborhood processing on the velocity field image in each direction in the N layers of slice images based on a first neighborhood processing algorithm, so as to obtain N template images; based on a second neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of slice images to obtain a third type of N layers of images; performing dot product operation on the ith template image in the N template images and the speed field images in the M directions of the ith image in the third type of N layer images to obtain a first type of N layer images, wherein i is a positive integer less than or equal to N; wherein the first neighborhood processing algorithm is different from the second neighborhood processing algorithm.
In some embodiments, the reconstructing unit 173 is specifically configured to perform morphological erosion processing on the target region of each layer of the second class N layer of images based on a preset morphological algorithm, so as to obtain an eroded second class N layer of images; and merging the corroded second N layers of images based on the image sequence of the N layers of sliced images to obtain an initial three-dimensional point cloud model of the target blood vessel.
In some embodiments, after obtaining the initial three-dimensional point cloud model of the target blood vessel, the processing unit 172 is further configured to slice the initial three-dimensional point cloud model to obtain N template images; performing dot product operation on the ith template image in the N template images and the speed field images in the M directions of the ith image in the third type of N-layer images to obtain a first type of N-layer images; based on a preset image segmentation algorithm, segmenting a target region containing the target blood vessel from each layer of image in the first class of N layers of images to obtain a second class of N layers of images;
correspondingly, the reconstructing unit 173 is further configured to merge the second type N layers of images based on the image sequence of the N layers of slice images to obtain a final three-dimensional point cloud model of the target blood vessel.
In some embodiments, the processing unit 172 is specifically configured to slice the initial three-dimensional point cloud model to obtain N layers of images; and performing morphological expansion processing on the region containing the target blood vessel in each layer of the N layers of images based on a preset morphological algorithm to obtain N template images.
In some embodiments, the processing unit 172 is specifically configured to perform a morphological filling operation and/or median filtering on the image after the dot product operation, so as to obtain a first type N layer image.
In some embodiments, the processing unit 172 is further configured to determine a region to be enhanced in the velocity field image for each direction in the N-layer slice image based on the user selection information; wherein at least part of the blood vessels of the target blood vessel are included in the region to be enhanced; based on a first neighborhood processing algorithm, neighborhood processing is carried out on a region to be enhanced in the speed field image in each direction to obtain a first class of N-layer images; based on a preset image segmentation algorithm, segmenting a target region containing the target blood vessel from each layer of image in the first class of N layers of images to obtain a second class of N layers of images;
correspondingly, the reconstructing unit 173 is further configured to merge the second type N layers of images based on the image sequence of the N layers of slice images to obtain a three-dimensional point cloud model of the region to be enhanced.
In some embodiments, the reconstructing unit 173 is further configured to combine the three-dimensional point cloud model of the region to be enhanced and the initial three-dimensional point cloud model to obtain an enhanced three-dimensional point cloud model of the target blood vessel; or combining the three-dimensional point cloud model of the region to be enhanced and the final three-dimensional point cloud model to obtain the enhanced three-dimensional point cloud model of the target blood vessel.
In some embodiments, the processing unit 172 is specifically configured to combine the M-directional velocity field images of each of the first-class N-layer images into one image, so as to obtain N-layer images to be segmented; determining the optimal threshold value of the N layers of images to be segmented based on the maximum inter-class variance method; and segmenting a target region containing the target blood vessel from each layer of image in the N layers of images to be segmented based on the optimal threshold value to obtain a second class of N layers of images.
By adopting the technical scheme, the N layers of slice images of the target blood vessel are subjected to neighborhood processing by utilizing at least one neighborhood processing algorithm, so that the interference of noise in the images can be effectively inhibited, the target blood vessel can be accurately positioned, and the accuracy of subsequent image segmentation operation can be ensured, thereby improving the extraction precision of the three-dimensional point cloud model of the target blood vessel and ensuring the quality of the three-dimensional reconstructed image of the target blood vessel.
Based on the hardware implementation of each unit in the blood vessel extraction device, the embodiment of the present application further provides another blood vessel extraction device, which includes: a processor and a memory configured to store a computer program operable on the processor;
wherein the processor is configured to execute the method steps in the preceding embodiments when running the computer program.
Of course, in practice, the various components of the blood vessel extraction device are coupled together by a bus system. It will be appreciated that a bus system is used to enable communications among the components. The bus system includes a power bus, a control bus, and a status signal bus in addition to a data bus.
In practical applications, the processor may be at least one of an Application Specific Integrated Circuit (ASIC), a Digital Signal Processing Device (DSPD), a Programmable Logic Device (PLD), a Field Programmable Gate Array (FPGA), a controller, a microcontroller, and a microprocessor. It is understood that the electronic devices for implementing the above processor functions may be other devices, and the embodiments of the present application are not limited in particular.
The Memory may be a volatile Memory (volatile Memory), such as a Random-Access Memory (RAM); or a non-volatile Memory (non-volatile Memory), such as a Read-Only Memory (ROM), a flash Memory (flash Memory), a Hard Disk (HDD), or a Solid-State Drive (SSD); or a combination of the above types of memories and provides instructions and data to the processor.
In an exemplary embodiment, the present application further provides a computer readable storage medium, such as a memory, comprising a computer program, which is executable by a processor in a blood vessel extraction device to perform the aforementioned method steps.
As will be appreciated by one skilled in the art, embodiments of the present application may be provided as a method, system, or computer program product. Accordingly, the present application may take the form of a hardware embodiment, a software embodiment, or an embodiment combining software and hardware aspects. Furthermore, the present application may take the form of a computer program product embodied on one or more computer-usable storage media (including, but not limited to, disk storage, optical storage, and the like) having computer-usable program code embodied therein.
The present application is described with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the application. It will be understood that each flow and/or block of the flow diagrams and/or block diagrams, and combinations of flows and/or blocks in the flow diagrams and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, embedded processor, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions specified in the flowchart block or blocks and/or flowchart block or blocks.
These computer program instructions may also be stored in a computer-readable memory that can direct a computer or other programmable data processing apparatus to function in a particular manner, such that the instructions stored in the computer-readable memory produce an article of manufacture including instruction means which implement the function specified in the flowchart block or blocks.
These computer program instructions may also be loaded onto a computer or other programmable data processing apparatus to cause a series of operational steps to be performed on the computer or other programmable apparatus to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide steps for implementing the functions specified in the flowchart block or blocks and/or flowchart block or blocks.
The above description is only a preferred embodiment of the present application, and is not intended to limit the scope of the present application.

Claims (12)

1. A method of blood vessel extraction, the method comprising:
acquiring N layers of slice images of a target blood vessel, wherein each layer of slice image comprises M directional velocity field images, and N and M are positive integers;
based on a first neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of slice images to obtain N template images corresponding to the N layers of slice images;
based on a second neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of slice images to obtain a third type of N layers of images corresponding to the N layers of slice images; wherein the first neighborhood processing algorithm is different from the second neighborhood processing algorithm;
performing dot product operation on the ith template image in the N template images and the speed field images in the M directions of the ith image in the third type of N-layer images to obtain a first type of N-layer images corresponding to the N layers of slice images;
based on a preset image segmentation algorithm, segmenting a target region containing the target blood vessel from each layer of first class N layer images corresponding to the N layers of slice images to obtain second class N layer images corresponding to the N layers of slice images;
and combining the second type N layers of images corresponding to the N layers of slice images based on the image sequence of the N layers of slice images to obtain an initial three-dimensional point cloud model of the target blood vessel.
2. The method according to claim 1, wherein the merging the second type of N-layer images corresponding to the N-layer slice images based on the image sequence of the N-layer slice images to obtain the initial three-dimensional point cloud model of the target blood vessel comprises:
performing morphological corrosion treatment on a target area of each layer of image in a second type N layer of images corresponding to the N layers of sliced images based on a preset morphological algorithm to obtain a corroded second type N layer of image;
and merging the corroded second N layers of images based on the image sequence of the N layers of sliced images to obtain an initial three-dimensional point cloud model of the target blood vessel.
3. The method of claim 1, wherein after obtaining the initial three-dimensional point cloud model of the target vessel, the method further comprises:
slicing the initial three-dimensional point cloud model to obtain N template images corresponding to the initial three-dimensional point cloud model;
performing dot product operation on the ith template image in the N template images and the speed field images in the M directions of the ith image in the third type of N layer images to obtain a first type of N layer images corresponding to the initial three-dimensional point cloud model;
based on a preset image segmentation algorithm, segmenting a target area containing the target blood vessel from each layer of image in the first class of N layers of images corresponding to the initial three-dimensional point cloud model to obtain a second class of N layers of images corresponding to the initial three-dimensional point cloud model;
and combining the second type of N layers of images corresponding to the initial three-dimensional point cloud model based on the image sequence of the N layers of slice images to obtain a final three-dimensional point cloud model of the target blood vessel.
4. The method of claim 3, wherein the slicing the initial three-dimensional point cloud model to obtain N template images corresponding to the initial three-dimensional point cloud model comprises:
slicing the initial three-dimensional point cloud model to obtain N layers of images;
and performing morphological expansion processing on the region containing the target blood vessel in each layer of the N layers of images based on a preset morphological algorithm to obtain N template images.
5. The method according to any one of claims 1 to 4, wherein the obtaining of the first type N layers of images corresponding to the N layers of slice images comprises:
and performing morphological filling operation and/or median filtering on the image subjected to the dot product operation to obtain a first class of N layers of images corresponding to the N layers of sliced images.
6. The method of claim 3, further comprising:
determining a region to be enhanced in the velocity field image in each direction in the N layers of slice images based on user selection information; wherein at least part of the blood vessels of the target blood vessel are included in the region to be enhanced;
based on a first neighborhood processing algorithm, neighborhood processing is carried out on a region to be enhanced in the speed field image in each direction, and a first class N layer image corresponding to the region to be enhanced is obtained;
based on a preset image segmentation algorithm, segmenting a target region containing the target blood vessel from each layer of image in the first class of N layers of images corresponding to the region to be enhanced to obtain a second class of N layers of images corresponding to the region to be enhanced;
and combining the second type N layers of images corresponding to the region to be enhanced based on the image sequence of the N layers of slice images to obtain a three-dimensional point cloud model of the region to be enhanced.
7. The method of claim 6, further comprising:
combining the three-dimensional point cloud model of the region to be enhanced with the initial three-dimensional point cloud model to obtain an enhanced three-dimensional point cloud model of the target blood vessel;
or combining the three-dimensional point cloud model of the region to be enhanced and the final three-dimensional point cloud model to obtain the enhanced three-dimensional point cloud model of the target blood vessel.
8. The method according to claim 1, wherein the segmenting a target region including the target blood vessel from each of the first class N layer images based on a preset image segmentation algorithm to obtain a second class N layer image comprises:
combining the speed field images of each layer of images in the first class of N layers of images in the M directions into one image to obtain N layers of images to be segmented;
determining the optimal threshold value of the N layers of images to be segmented based on the maximum inter-class variance method;
and segmenting a target region containing the target blood vessel from each layer of image in the N layers of images to be segmented based on the optimal threshold value to obtain a second class of N layers of images.
9. A blood vessel extraction device, the device comprising:
the acquisition unit is used for acquiring N layers of slice images of a target blood vessel, wherein each layer of slice image comprises speed field images in M directions, and N and M are positive integers;
the processing unit is used for carrying out neighborhood processing on the speed field image in each direction in the N layers of slice images based on a first neighborhood processing algorithm to obtain N template images corresponding to the N layers of slice images;
based on a second neighborhood processing algorithm, carrying out neighborhood processing on the speed field image in each direction in the N layers of slice images to obtain a third type of N layers of images corresponding to the N layers of slice images; wherein the first neighborhood processing algorithm is different from the second neighborhood processing algorithm;
performing dot product operation on the ith template image in the N template images and the speed field images in the M directions of the ith image in the third type of N-layer images to obtain a first type of N-layer images corresponding to the N layers of slice images;
the processing unit is further configured to segment a target region including the target blood vessel from each of first-class N-layer images corresponding to the N-layer slice images based on a preset image segmentation algorithm, so as to obtain second-class N-layer images corresponding to the N-layer slice images;
and the reconstruction unit is used for merging the second type N layers of images corresponding to the N layers of slice images based on the image sequence of the N layers of slice images to obtain the initial three-dimensional point cloud model of the target blood vessel.
10. The apparatus of claim 9,
the processing unit is further configured to slice the initial three-dimensional point cloud model to obtain N template images corresponding to the initial three-dimensional point cloud model;
performing dot product operation on the ith template image in the N template images and the speed field images in the M directions of the ith image in the third type of N layer images to obtain a first type of N layer images corresponding to the initial three-dimensional point cloud model;
based on a preset image segmentation algorithm, segmenting a target area containing the target blood vessel from each layer of image in the first class of N layers of images corresponding to the initial three-dimensional point cloud model to obtain a second class of N layers of images corresponding to the initial three-dimensional point cloud model;
and combining the second type of N layers of images corresponding to the initial three-dimensional point cloud model based on the image sequence of the N layers of slice images to obtain a final three-dimensional point cloud model of the target blood vessel.
11. A blood vessel extraction apparatus, characterized in that the apparatus comprises a processor and a memory configured to store a computer program executable on the processor,
wherein the processor is configured to perform the steps of the method of any one of claims 1 to 8 when running the computer program.
12. A computer-readable storage medium, on which a computer program is stored which, when being executed by a processor, carries out the steps of the method of any one of claims 1 to 8.
CN201910073353.7A 2019-01-25 2019-01-25 Blood vessel extraction method and device and computer readable storage medium Active CN109886973B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201910073353.7A CN109886973B (en) 2019-01-25 2019-01-25 Blood vessel extraction method and device and computer readable storage medium

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201910073353.7A CN109886973B (en) 2019-01-25 2019-01-25 Blood vessel extraction method and device and computer readable storage medium

Publications (2)

Publication Number Publication Date
CN109886973A CN109886973A (en) 2019-06-14
CN109886973B true CN109886973B (en) 2021-01-08

Family

ID=66927016

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201910073353.7A Active CN109886973B (en) 2019-01-25 2019-01-25 Blood vessel extraction method and device and computer readable storage medium

Country Status (1)

Country Link
CN (1) CN109886973B (en)

Families Citing this family (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN110428431B (en) * 2019-07-12 2022-12-16 广东省人民医院(广东省医学科学院) Method, device and equipment for segmenting cardiac medical image and storage medium
CN110660030B (en) * 2019-09-12 2021-02-05 中实信息(深圳)有限公司 Image processing method and device
CN111260055B (en) * 2020-01-13 2023-09-01 腾讯科技(深圳)有限公司 Model training method based on three-dimensional image recognition, storage medium and device
CN114998291A (en) * 2022-06-21 2022-09-02 北京银河方圆科技有限公司 Medical image processing method and device and storage medium

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101697871A (en) * 2009-11-16 2010-04-28 华中科技大学 Laser imaging method and device for automatically cutting artery blood vessel and vein blood vessel
CN101984916A (en) * 2010-11-17 2011-03-16 哈尔滨工程大学 Blood vessel diameter measuring method based on digital image processing technology
CN106803251A (en) * 2017-01-12 2017-06-06 西安电子科技大学 The apparatus and method of aortic coaractation pressure differential are determined by CT images
CN107749049A (en) * 2017-09-07 2018-03-02 广州中国科学院先进技术研究所 A kind of vein distribution display method and device
US10134127B2 (en) * 2013-12-12 2018-11-20 The Regents Of The University Of California Method for post-processing flow-sensitive phase contrast magnetic resonance images
CN109191468A (en) * 2018-08-16 2019-01-11 杭州晟视科技有限公司 A kind of method, apparatus and storage medium of vessel extraction

Family Cites Families (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102567734B (en) * 2012-01-02 2013-06-12 西安电子科技大学 Specific value based retina thin blood vessel segmentation method
CN102819823B (en) * 2012-01-12 2016-03-09 北京理工大学 A kind of method of full-automatic tracking extraction blood vessel from contrastographic picture
CN105335967B (en) * 2015-10-16 2018-07-03 中国人民解放军国防科学技术大学 Based on local maxima inter-class variance and the morphologic hand back vein lines extracting method of mathematics
CN105427277B (en) * 2015-10-30 2018-01-16 上海联影医疗科技有限公司 Vessel extraction method
US10588523B2 (en) * 2016-04-15 2020-03-17 Siemens Healthcare Gmbh 4D flow measurements of the hepatic vasculatures with two-dimensional excitation
CN109157247B (en) * 2018-08-20 2021-03-26 云南大学 Ultrasonic blood flow velocity field measurement for optimal frame interval tracking estimation

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101697871A (en) * 2009-11-16 2010-04-28 华中科技大学 Laser imaging method and device for automatically cutting artery blood vessel and vein blood vessel
CN101984916A (en) * 2010-11-17 2011-03-16 哈尔滨工程大学 Blood vessel diameter measuring method based on digital image processing technology
US10134127B2 (en) * 2013-12-12 2018-11-20 The Regents Of The University Of California Method for post-processing flow-sensitive phase contrast magnetic resonance images
CN106803251A (en) * 2017-01-12 2017-06-06 西安电子科技大学 The apparatus and method of aortic coaractation pressure differential are determined by CT images
CN107749049A (en) * 2017-09-07 2018-03-02 广州中国科学院先进技术研究所 A kind of vein distribution display method and device
CN109191468A (en) * 2018-08-16 2019-01-11 杭州晟视科技有限公司 A kind of method, apparatus and storage medium of vessel extraction

Non-Patent Citations (5)

* Cited by examiner, † Cited by third party
Title
3D flow visualization and tomographic particle image velocimetry for vortex breakdown over a non-slender delta wing;ChengYue Wang 等;《Experiments in Fluids》;20160524(第57期);全文 *
Reproducibility and inter-observer variability of velocity and 3D wall shear stress derived from 4D flow MRI in the healthy aorta;Pim van Ooij 等;《Journal of Cardiovascular Magnetic Resonance》;20151231(第17期);全文 *
Validation of numerical simulation methods in aortic arch using 4D Flow MRI;Shohei Miyazaki 等;《Heart Vessels》;20171231(第32期);全文 *
基于容积数据的血管提取与重建算法研究;陆存波;《电子技术与软件工程》;20150930;全文 *
基于梯度矢量流snake与多尺度分析的血管内超声图像轮廓提取;张麒 等;《生命科学仪器》;20070831;第5卷;全文 *

Also Published As

Publication number Publication date
CN109886973A (en) 2019-06-14

Similar Documents

Publication Publication Date Title
CN109886973B (en) Blood vessel extraction method and device and computer readable storage medium
US11776216B2 (en) System and method for extracting a region of interest from volume data
Higgins et al. System for analyzing high-resolution three-dimensional coronary angiograms
CN109478327B (en) Method for automatic detection of systemic arteries in Computed Tomography Angiography (CTA) of arbitrary field of view
WO2006024974A1 (en) Feature weighted medical object contouring using distance coordinates
CN110648338B (en) Image segmentation method, readable storage medium, and image processing apparatus
CN107545579B (en) Heart segmentation method, device and storage medium
CN109191468B (en) Blood vessel extraction method, device and storage medium
CN111815663A (en) Hepatic vessel segmentation system based on Hessian matrix and gray scale method
Yan et al. Improved mask R-CNN for lung nodule segmentation
CN111724389B (en) Method, device, storage medium and computer equipment for segmenting CT image of hip joint
CN114170244A (en) Brain glioma segmentation method based on cascade neural network structure
CN105167798A (en) Method for extracting blood vessel information from coronary artery CTA (computed tomographic angiography) image
Kaftan et al. A two-stage approach for fully automatic segmentation of venous vascular structures in liver CT images
Han et al. A fast seed detection using local geometrical feature for automatic tracking of coronary arteries in CTA
Ebrahimdoost et al. Automatic segmentation of pulmonary artery (PA) in 3D pulmonary CTA images
CN112862850A (en) Digital silhouette angiography image processing method and device
Lapeer et al. Active watersheds: Combining 3D watershed segmentation and active contours to extract abdominal organs from MR images
Song et al. Automatic liver segmentation from CT images using adaptive fast marching method
Samet et al. A new methodology for blood vessel segmentation on lung CT images
Engan et al. Automatic segmentation of the epicardium in late gadolinium enhanced cardiac MR images
CN111489434A (en) Medical image three-dimensional reconstruction method based on three-dimensional graph cut
Liu et al. Right ventricle extraction by low level and model-based algorithm
Luo et al. Recent progresses on cerebral vasculature segmentation for 3D quantification and visualization of MRA
CN111047612B (en) Coronary artery CT angiography image segmentation method

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
CB02 Change of applicant information
CB02 Change of applicant information

Address after: Room 707, building 2, Xizi international jinzuo, Nanyuan street, Yuhang District, Hangzhou City, Zhejiang Province

Applicant after: HANGZHOU SHENGSHI TECHNOLOGY Co.,Ltd.

Address before: 311100 Hangzhou, Yuhang, Zhejiang Linping new town Nanyuan street, new far CBC1 block 1502 room.

Applicant before: HANGZHOU SHENGSHI TECHNOLOGY Co.,Ltd.

GR01 Patent grant
GR01 Patent grant
PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: A method, device, and computer-readable storage medium for extracting blood vessels

Effective date of registration: 20231106

Granted publication date: 20210108

Pledgee: Hangzhou United Rural Commercial Bank Limited by Share Ltd. Baoshan Branch

Pledgor: HANGZHOU SHENGSHI TECHNOLOGY Co.,Ltd.

Registration number: Y2023980064059