CN111028201A - Fundus blood vessel image segmentation system and method based on multi-scale level set - Google Patents
Fundus blood vessel image segmentation system and method based on multi-scale level set Download PDFInfo
- Publication number
- CN111028201A CN111028201A CN201911108341.XA CN201911108341A CN111028201A CN 111028201 A CN111028201 A CN 111028201A CN 201911108341 A CN201911108341 A CN 201911108341A CN 111028201 A CN111028201 A CN 111028201A
- Authority
- CN
- China
- Prior art keywords
- image
- level set
- scale
- blood vessel
- segmentation
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
- 210000004204 blood vessel Anatomy 0.000 title claims abstract description 70
- 238000000034 method Methods 0.000 title claims abstract description 26
- 238000003709 image segmentation Methods 0.000 title claims abstract description 19
- 230000011218 segmentation Effects 0.000 claims abstract description 47
- 238000007781 pre-processing Methods 0.000 claims abstract description 13
- 238000010276 construction Methods 0.000 claims abstract description 10
- 239000011159 matrix material Substances 0.000 claims description 9
- 238000009499 grossing Methods 0.000 claims description 8
- 238000005530 etching Methods 0.000 claims description 3
- 230000009191 jumping Effects 0.000 claims description 3
- PCHJSUWPFVWCPO-UHFFFAOYSA-N gold Chemical compound [Au] PCHJSUWPFVWCPO-UHFFFAOYSA-N 0.000 description 2
- 208000002177 Cataract Diseases 0.000 description 1
- 208000010412 Glaucoma Diseases 0.000 description 1
- 206010064930 age-related macular degeneration Diseases 0.000 description 1
- 230000009286 beneficial effect Effects 0.000 description 1
- 238000006243 chemical reaction Methods 0.000 description 1
- 238000010586 diagram Methods 0.000 description 1
- 208000030533 eye disease Diseases 0.000 description 1
- 208000002780 macular degeneration Diseases 0.000 description 1
- 238000012986 modification Methods 0.000 description 1
- 230000004048 modification Effects 0.000 description 1
- 238000012216 screening Methods 0.000 description 1
- 238000006467 substitution reaction Methods 0.000 description 1
Images
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/0002—Inspection of images, e.g. flaw detection
- G06T7/0012—Biomedical image inspection
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/11—Region-based segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/136—Segmentation; Edge detection involving thresholding
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/10—Segmentation; Edge detection
- G06T7/194—Segmentation; Edge detection involving foreground-background segmentation
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T7/00—Image analysis
- G06T7/60—Analysis of geometric attributes
- G06T7/62—Analysis of geometric attributes of area, perimeter, diameter or volume
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30041—Eye; Retina; Ophthalmic
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T2207/00—Indexing scheme for image analysis or image enhancement
- G06T2207/30—Subject of image; Context of image processing
- G06T2207/30004—Biomedical image processing
- G06T2207/30101—Blood vessel; Artery; Vein; Vascular
Abstract
The invention provides a fundus blood vessel image segmentation system and method based on a multi-scale level set, and relates to the technical field of image processing. The invention comprises an input module, a preprocessing module, a scale construction module, a level set module and an output module; the present invention improves upon existing level set methods based on local features. The fundus blood vessels are different in thickness, and the blood vessel segmentation precision is not high due to the fact that the blood vessel segmentation granularity is controlled by a single scale. Based on the characteristic that the blood vessels are different in thickness, the optimal response scale is found for each pixel point, namely the scales of the blood vessels different in thickness are different, and the problems of missing, wrong and the like of the blood vessels with different thicknesses are solved, so that the robustness of the segmentation method is enhanced, and an accurate image segmentation result can be obtained by applying the method.
Description
Technical Field
The invention relates to the technical field of image processing, in particular to a fundus blood vessel image segmentation system and method based on a multi-scale level set.
Background
The eyeground blood vessel image is the basis for screening eye diseases such as cataract, glaucoma, age-related macular degeneration and the like. The problems of complicated structure of the fundus blood vessels and uneven image gray scale cause the problems of insufficient segmentation and the like of a plurality of algorithms at the adjacent blood vessels. On the other hand, the fundus blood vessels are different in thickness, and the blood vessel segmentation precision is not high due to the fact that the blood vessel segmentation granularity is controlled by a single scale in the existing segmentation method. Therefore, the invention provides a fundus blood vessel image segmentation method based on a multi-scale level set. And selecting the optimal scale for each pixel point, and overcoming the problems of missed and wrong division of uneven-thickness blood vessels.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a fundus blood vessel image segmentation system based on a multi-scale level set.
The technical scheme adopted by the invention is as follows: a fundus blood vessel image segmentation system based on a multi-scale level set comprises an input module, a preprocessing module, a scale construction module, a level set module and an output module;
the input module is used for receiving the fundus blood vessel image input by the user and then transmitting the fundus blood vessel image to the preprocessing module;
the preprocessing module is used for expanding the received fundus blood vessel image, and the expanded result is transmitted to the scale construction module;
the scale construction module is used for finding the optimal blood vessel response scale for the blood vessel image at the bottom of the eye, further constructing a Gaussian curve based on the scale, subtracting the original image from the convolution result of the Gaussian curve and the image to obtain an image M, and transmitting the image M to the level set module;
the level set module is used for carrying out blood vessel segmentation on the image M by adopting a level set algorithm and transmitting a segmentation result to the output module;
and the output module is used for outputting and displaying the segmentation result image.
In another aspect, the present invention provides a fundus blood vessel image segmentation method based on a multi-scale level set, which is implemented by the fundus blood vessel image segmentation system based on a multi-scale level set, and includes the following steps:
step 1: the input module receives an image A of fundus blood vessels to be segmented, wherein the width of the image A is W, and the height of the image A is H;
step 2: the preprocessing module constructs the received fundus blood vessel image A to be segmented to generate a fundus blood vessel image I without an edge background, and the resolution of the fundus blood vessel image I is the same as that of the image A; converting the image A into a gray image J, setting all areas of the image J as omega, directly obtaining an image P if the area to be segmented is full of omega, carrying out mirror image expansion on an effective boundary area in the image to cover a black filling area in the whole image if the area to be segmented is not full of omega, setting the expanded image as P, and executing the step 2.1 if I is equal to P; otherwise, executing step 3;
step 2.1: determining a threshold Q to divide the grayscale image J into a foreground R and a background B, where R and B are binary images, R is 1 and B is 0 in the foreground region, R is 0 and B is 1 in the background region;
step 2.2: constructing a foreground region boundary image R2Etching the foreground R to obtain R1,R2=R-R1Wherein the image R2The image is a binary image;
step 2.3: initializing a variable P to 1, wherein P is an initializing abscissa value of a pixel point in the outer loop;
step 2.4: if p is less than or equal to W and the initialized longitudinal coordinate value q of the pixel point in the outer loop is 1, executing the step 2.5, otherwise, executing the step 3;
step 2.5: if q is less than or equal to H, executing step 2.6, otherwise, making p equal to p +1, and executing step 2.4;
step 2.6: if the current point (p, q) satisfies B ═ 1, step 2.7 is performed, otherwise, let q ═ q +1, step 2.5 is performed;
step 2.7: initializing a variable m which is 1 and is an initial abscissa value of a pixel point in the image inner loop, and initializingWherein r is the distance between any two pixels in the initialized image, and the initial coordinates (a, b) are two random positive integers;
step 2.8: if m is less than or equal to W, the variable n is 1, n is the initial value of the vertical coordinate of the pixel point in the inner loop, the step 2.9 is executed, otherwise, the step 2.13 is executed;
step 2.9: if n is less than or equal to H, executing step 2.10, otherwise, making m equal to m +1, and executing step 2.8;
step 2.10: if the point (m, n) satisfies R2Step 2.11 is performed when n is equal to n +1, otherwise step 2.9 is performed;
step 2.11: calculating a distance dist ((p, q), (m, n)) between the point (p, q) and the point (m, n), wherein dist is a distance metric function, and if r < dist ((p, q), (m, n)), then r ═ dist ((p, q), (m, n)), and let a ═ m, b ═ n;
step 2.12: step 2.9 is skipped to by making n equal to n + 1;
step 2.13: the point (p, q) takes the point (a, b) as the center, R is a symmetrical distance, a corresponding pixel point L in R is obtained, and the value of the pixel point L is assigned to the current point Z; wherein L isx=2a-p,Ly2b-q, wherein LxIs the abscissa L of the pixel point LyIs the ordinate of the pixel point L;
step 2.14: q is q +1, and the step 2.5 is skipped;
and step 3: for parameter minimum scale sigmaminMaximum scale σmaxA constant coefficient gamma, a constant coefficient c, a scale step length delta sigma are set, wherein sigma ismin<σmax;
And 4, step 4: for the initial scale sigmaiIs set so that σi=σmin;
And 5: constructing a Hessian matrix of the image I, constructing a Gaussian function through the optimal response scale sigma, and subtracting the image I from the result of convolution operation of the image I and the Gaussian function to obtain an image M, wherein the method comprises the following specific steps:
step 5.1: initialization variable p 1, scale variable k 1, variable vmax=0, wherein vmaxIs the maximum response value variable of the pixel;
step 5.2: if p is less than or equal to W, the variable q is 1, and step 5.3 is executed, otherwise, step 6 is executed;
step 5.3: if q is less than or equal to H, executing step 5.4, otherwise, making p equal to p +1, and executing step 5.2;
step 5.4: judging the current scale sigmaiWhether or not greater than the maximum scale sigmamaxIf it is greater than σmaxIf so, let σi=σminExecuting step 5.12, otherwise, executing step 5.5;
step 5.5: constructing a Hessian matrix for point (p, q):
D=∫∫I(p-u,q-v)×A(u,v)dudv
E=∫∫I(p-u,q-v)×B(u,v)dudv
F=∫∫I(p-u,q-v)×C(u,v)dudv
a (u, v), B (u, v) and C (u, v) are based on the scale σiConstructing a second partial derivative of Gaussian
Wherein D, E, F is the convolution of image I with the corresponding gaussian second order partial derivative A, B, C;
step 5.6: calculating two eigenvalues lambda of the Hessian matrix obtained in step 5.51、λ2, wherein
in the formula ,RBIs the degree of anisotropy of the linear shape, S is the norm;
Step 5.9: constructing a Gaussian kernel based on the scale k to obtain a Gaussian curve gκ;
Step 5.10: step 5.9The resulting Gaussian curve gκPerforming convolution operation with the image I, and subtracting the image I from a convolution result to obtain an image M;
M(p,q)=(gκ*I)(p,q)-I(p,q)
step 5.11: updating the scale sigmai=σi+ Δ σ, Δ σ is the scale step, and step 5.4 is skipped;
step 5.12: updating the coordinate q to be q +1, and jumping to the step 5.3;
step 6, setting an initial zero level set segmentation curve on the image M, and generating a high one-dimensional level set function phi according to the set zero level set0;
The set initial zero level set segmentation curve is a closed curve with a specified shape and is a randomly generated closed curve, and the level set function phi is a high one-dimensional symbol distance function generated according to the set initial level set segmentation curve;
step 7, establishing an energy functional E (phi) of level set segmentation, and setting a weighting coefficient α in the level set method1Weighting factor α2Curve smoothing term coefficient v and area smoothing term coefficient mu;
the energy functional is as follows:
E(φ)=ED+vL(φ)+μP(φ)
wherein ,EDFor the image data item, L (φ) is a length constraint term, P (φ) is an area constraint term, and H (φ (P, q)) is a Heaviside function of φ (P, q);
ED(φ)=α1∫Ω|M(p,q)-c1|2H(φ(p,q))dpdq+α2∫Ω|M(p,q)-c2|2(1-H(φ(p,q)))dpdq
P(φ)=∫H(φ(p,q))dpdq
wherein c1Is the mean value of the gray levels in the zero level set segmentation curve, c2Is the gray average outside the zero level set segmentation curve;
and 8: setting the maximum iteration number J and a convergence threshold epsilon of an energy functional of the image level set;
and step 9: separately updating the image level set function set H (phi)j)、1-H(φj)、Cj、φjObtaining an energy functional E of the j iterationj;
Specifically, the method comprises the following steps:
where at is the step of time in which,for the time partial derivative of the iteratively updated level set function, the time partial derivative formula is as follows:
step 10: judging whether an iteration termination condition is reached: if the current iteration time J reaches the maximum iteration time J or the difference value of the iteration results of two adjacent times of the energy functional E (phi) is smaller than a convergence threshold epsilon which is set in advance, executing the step 11, otherwise, adding 1 to the iteration time, and returning to the step 9;
step 11: according to the current updated image level set function phijAn image, i.e. the segmentation result of the image, is constructed.
Adopt the produced beneficial effect of above-mentioned technical scheme to lie in:
the invention provides a segmentation system and method of fundus blood vessel images based on a multi-scale level set, and improves the existing level set method based on local features. The fundus blood vessels are different in thickness, and the blood vessel segmentation precision is not high due to the fact that the blood vessel segmentation granularity is controlled by a single scale. Based on the characteristic that the blood vessels are different in thickness, the optimal response scale is found for each pixel point, namely the scales of the blood vessels different in thickness are different, and the problems of missing, wrong and the like of the blood vessels with different thicknesses are solved, so that the robustness of the segmentation method is enhanced. By applying the method, an accurate image segmentation result can be obtained.
Drawings
FIG. 1 is a block diagram of a fundus blood vessel image segmentation system;
FIG. 2 is a flowchart of a fundus blood vessel image segmentation method
Fig. 3 shows an original image of fundus blood vessel image input;
FIG. 4 shows the conversion of the original image of the blood vessels in the fundus into a gray scale image;
FIG. 5 is a view after expansion of a fundus blood vessel image;
FIG. 6 shows an enhanced image;
FIG. 7 shows an image after convolution and subtraction of the original image;
FIG. 8 shows an initial level set;
FIG. 9 shows the final segmentation result of the image;
FIG. 10 shows a gold standard for an image;
Detailed Description
The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
A fundus blood vessel image segmentation system based on a multi-scale level set is shown in figure 1 and comprises an input module, a preprocessing module, a scale construction module, a level set module and an output module;
the input module is used for receiving the fundus blood vessel image input by the user and then transmitting the fundus blood vessel image to the preprocessing module;
the preprocessing module is used for expanding the received fundus blood vessel image, and the expanded result is transmitted to the scale construction module;
the scale construction module is used for finding the optimal blood vessel response scale for the blood vessel image at the bottom of the eye, further constructing a Gaussian curve based on the scale, subtracting the original image from the convolution result of the Gaussian curve and the image to obtain an image M, and transmitting the image M to the level set module;
the level set module is used for carrying out blood vessel segmentation on the image M by adopting a level set algorithm and transmitting a segmentation result to the output module;
and the output module is used for outputting and displaying the segmentation result image.
In another aspect, the present invention provides a fundus blood vessel image segmentation method based on a multi-scale level set, which is implemented by the foregoing fundus blood vessel image segmentation system based on a multi-scale level set, as shown in fig. 2, and includes the following steps:
step 1: the input module receives an image A of fundus blood vessels to be segmented, wherein the image A has the width W and the height H as shown in FIG. 3;
step 2: the preprocessing module constructs the received fundus blood vessel image A to be segmented to generate a fundus blood vessel image I without an edge background, and the resolution of the fundus blood vessel image I is the same as that of the image A; converting the image a into a gray image J, as shown in fig. 4, setting all regions of the image J to be Ω, directly obtaining an image P if the region to be segmented is full of Ω, and performing mirror image expansion on an effective boundary region in the image to cover a black filled region in the whole image if the region to be segmented is not full of Ω, and setting the expanded image to be P as shown in fig. 5, and meanwhile, executing step 2.1 if I is equal to P; otherwise, executing step 3;
step 2.1: determining a threshold Q to divide the grayscale image J into a foreground R and a background B, where R and B are binary images, R is 1 and B is 0 in the foreground region, R is 0 and B is 1 in the background region;
step 2.2: constructing a foreground region boundary image R2Etching the foreground R to obtain R1,R2=R-R1Wherein the image R2The image is a binary image;
step 2.3: initializing a variable P to 1, wherein P is an initializing abscissa value of a pixel point in the outer loop;
step 2.4: if p is less than or equal to W and the initialized longitudinal coordinate value q of the pixel point in the outer loop is 1, executing the step 2.5, otherwise, executing the step 3;
step 2.5: if q is less than or equal to H, executing step 2.6, otherwise, making p equal to p +1, and executing step 2.4;
step 2.6: if the current point (p, q) satisfies B ═ 1, step 2.7 is performed, otherwise, let q ═ q +1, step 2.5 is performed;
step 2.7: initializing a variable m which is 1 and is an initial abscissa value of a pixel point in the image inner loop, and initializingWherein r is the distance between any two pixels in the initialized image, and the initial coordinates (a, b) are two random positive integers;
step 2.8: if m is less than or equal to W, the variable n is 1, n is the initial value of the vertical coordinate of the pixel point in the inner loop, the step 2.9 is executed, otherwise, the step 2.13 is executed;
step 2.9: if n is less than or equal to H, executing step 2.10, otherwise, making m equal to m +1, and executing step 2.8;
step 2.10: if the point (m, n) satisfies R2Step 2.11 is performed when n is equal to n +1, otherwise step 2.9 is performed;
step 2.11: calculating a distance dist ((p, q), (m, n)) between the point (p, q) and the point (m, n), wherein dist is a distance metric function, and if r < dist ((p, q), (m, n)), then r ═ dist ((p, q), (m, n)), and let a ═ m, b ═ n;
step 2.12: step 2.9 is skipped to by making n equal to n + 1;
step 2.13: the point (p, q) takes the point (a, b) as the center, R is a symmetrical distance, a corresponding pixel point L in R is obtained, and the value of the pixel point L is assigned to the current point Z; wherein L isx=2a-p,Ly2b-q, wherein LxIs the abscissa L of the pixel point LyIs the ordinate of the pixel point L;
step 2.14: q is q +1, and the step 2.5 is skipped;
and step 3: for parameter minimum scale sigmaminMaximum scale σmaxA constant coefficient gamma, a constant coefficient c, a scale step length delta sigma are set, wherein sigma ismin<σmax;
And 4, step 4: for the initial scale sigmaiIs set so that σi=σmin;
And 5: constructing a Hessian matrix of the image I, constructing a gaussian function through the optimal response scale σ, and subtracting the image I from a result of convolution operation of the image I and the gaussian function to obtain an image M, as shown in fig. 6 and 7, the specific steps are as follows:
step 5.1: initialization variable p 1, scale variable k 1, variable vmax=0, wherein vmaxIs the maximum response value variable of the pixel;
step 5.2: if p is less than or equal to W, the variable q is 1, and step 5.3 is executed, otherwise, step 6 is executed;
step 5.3: if q is less than or equal to H, executing step 5.4, otherwise, making p equal to p +1, and executing step 5.2;
step 5.4: judging the current scale sigmaiWhether or not greater than the maximum scale sigmamaxIf it is greater than σmaxIf so, let σi=σminExecuting step 5.12, otherwise, executing step 5.5;
step 5.5: constructing a Hessian matrix for point (p, q):
D=∫∫I(p-u,q-v)×A(u,v)dudv
E=∫∫I(p-u,q-v)×B(u,v)dudv
F=∫∫I(p-u,q-v)×C(u,v)dudv
a (u, v), B (u, v) and C (u, v) are based on the scale σiConstructing a second-order partial derivative of Gaussian;
wherein D, E, F is the convolution of image I with the corresponding gaussian second order partial derivative A, B, C;
step 5.6: calculating two eigenvalues lambda of the Hessian matrix obtained in step 5.51、λ2, wherein
in the formula ,RBIs the degree of anisotropy of the linear shape, S is the norm;
Step 5.9: constructing a Gaussian kernel based on the scale k to obtain a Gaussian curve gκ;
Step 5.10: the Gaussian curve g obtained in the step 5.9κPerforming convolution operation with the image I, and subtracting the image I from a convolution result to obtain an image M;
M(p,q)=(gκ*I)(p,q)-I(p,q)
step 5.11: updating the scale sigmai=σi+ Δ σ, Δ σ is the scale step, and step 5.4 is skipped;
step 5.12: updating the coordinate q to be q +1, and jumping to the step 5.3;
step 6, setting an initial zero level set segmentation curve on the image M, as shown in FIG. 8, generating a high one-dimensional level set function phi according to the set zero level set0;
The set initial zero level set segmentation curve is a closed curve with a specified shape and is a randomly generated closed curve, and the level set function phi is a high one-dimensional symbol distance function generated according to the set initial level set segmentation curve;
step 7, establishing an energy functional E (phi) of level set segmentation, and setting a weighting coefficient α in the level set method1Weighting factor α2Curve smoothing term coefficient v and area smoothing term coefficient mu;
the energy functional is as follows:
E(φ)=ED+vL(φ)+μP(φ)
wherein ,EDFor the image data item, L (φ) is a length constraint term, P (φ) is an area constraint term, and H (φ (P, q)) is a Heaviside function of φ (P, q);
ED(φ)=α1∫Ω|M(p,q)-c1|2H(φ(p,q))dpdq+α2∫Ω|M(p,q)-c2|2(1-H(φ(p,q)))dpdq
P(φ)=∫H(φ(p,q))dpdq
wherein c1Is the mean value of the gray levels in the zero level set segmentation curve, c2Is the gray average outside the zero level set segmentation curve;
in the embodiment, the larger the image data item coefficient is, the closer the zero level set segmentation curve is to the boundary of the object to be segmented in the image, and the larger the level set segmentation curve length item coefficient is, the smoother the segmentation curve is, so that the weighting coefficient α, which is the control parameter for image level set segmentation, is set according to the image to be segmented11.0, weighting factor α2The coefficient v of the curve smoothing term is 0.001 × 255, and the coefficient μ of the area smoothing term is 2.0.
And 8: setting the maximum iteration number J and a convergence threshold epsilon of an energy functional of the image level set;
in this embodiment, the maximum number of iterations J is set to 50, and the energy functional E (c) of image level set segmentation is set1,c2Phi), the convergence threshold is 0.01.
And step 9: separately updating the image level set function set H (phi)j)、1-H(φj)、Cj、φjObtaining an energy functional E of the j iterationj;
Specifically, the method comprises the following steps:
where at is the step of time in which,for the time partial derivative of the iteratively updated level set function, the time partial derivative formula is as follows:
step 10: judging whether an iteration termination condition is reached: if the current iteration time J reaches the maximum iteration time J or the difference value of the iteration results of two adjacent times of the energy functional E (phi) is smaller than a convergence threshold epsilon which is set in advance, executing the step 11, otherwise, adding 1 to the iteration time, and returning to the step 9;
step 11: according to the current updated image level set function phijAs shown in fig. 9, the constructed image, i.e., the segmentation result of the image, fig. 10 is the gold standard of the image.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions and scope of the present invention as defined in the appended claims.
Claims (2)
1. A fundus blood vessel image segmentation system based on a multi-scale level set is characterized in that: the system comprises an input module, a preprocessing module, a scale construction module, a level set module and an output module;
the input module is used for receiving the fundus blood vessel image input by the user and then transmitting the fundus blood vessel image to the preprocessing module;
the preprocessing module is used for expanding the received fundus blood vessel image, and the expanded result is transmitted to the scale construction module;
the scale construction module is used for finding the optimal blood vessel response scale for the blood vessel image at the bottom of the eye, further constructing a Gaussian curve based on the scale, subtracting the original image from the convolution result of the Gaussian curve and the image to obtain an image M, and transmitting the image M to the level set module;
the level set module is used for carrying out blood vessel segmentation on the image M by adopting a level set algorithm and transmitting a segmentation result to the output module;
and the output module is used for outputting and displaying the segmentation result image.
2. A fundus blood vessel image segmentation method based on a multi-scale level set, which is realized by the fundus blood vessel image segmentation system based on the multi-scale level set of claim 1, and is characterized in that: the method comprises the following steps:
step 1: the input module receives an image A of fundus blood vessels to be segmented, wherein the width of the image A is W, and the height of the image A is H;
step 2: the preprocessing module constructs the received fundus blood vessel image A to be segmented to generate a fundus blood vessel image I without an edge background, and the resolution of the fundus blood vessel image I is the same as that of the image A; converting the image A into a gray image J, setting all areas of the image J as omega, directly obtaining an image P if the area to be segmented is full of omega, carrying out mirror image expansion on an effective boundary area in the image to cover a black filling area in the whole image if the area to be segmented is not full of omega, setting the expanded image as P, and executing the step 2.1 if I is equal to P; otherwise, executing step 3;
step 2.1: determining a threshold Q to divide the grayscale image J into a foreground R and a background B, where R and B are binary images, R is 1 and B is 0 in the foreground region, R is 0 and B is 1 in the background region;
step 2.2: constructing a foreground region boundary image R2Etching the foreground R to obtain R1,R2=R-R1Wherein the image R2The image is a binary image;
step 2.3: initializing a variable P to 1, wherein P is an initializing abscissa value of a pixel point in the outer loop;
step 2.4: if p is less than or equal to W and the initialized longitudinal coordinate value q of the pixel point in the outer loop is 1, executing the step 2.5, otherwise, executing the step 3;
step 2.5: if q is less than or equal to H, executing step 2.6, otherwise, making p equal to p +1, and executing step 2.4;
step 2.6: if the current point (p, q) satisfies B ═ 1, step 2.7 is performed, otherwise, let q ═ q +1, step 2.5 is performed;
step 2.7: initializing a variable m which is 1 and is an initial abscissa value of a pixel point in the image inner loop, and initializingWherein r is the distance between any two pixels in the initialized image, and the initial coordinates (a, b) are two random positive integers;
step 2.8: if m is less than or equal to W, the variable n is 1, n is the initial value of the vertical coordinate of the pixel point in the inner loop, the step 2.9 is executed, otherwise, the step 2.13 is executed;
step 2.9: if n is less than or equal to H, executing step 2.10, otherwise, making m equal to m +1, and executing step 2.8;
step 2.10: if the point (m, n) satisfies R2Step 2.11 is performed when n is equal to n +1, otherwise step 2.9 is performed;
step 2.11: calculating a distance dist ((p, q), (m, n)) between the point (p, q) and the point (m, n), wherein dist is a distance metric function, and if r < dist ((p, q), (m, n)), then r ═ dist ((p, q), (m, n)), and let a ═ m, b ═ n;
step 2.12: step 2.9 is skipped to by making n equal to n + 1;
step 2.13: the point (p, q) takes the point (a, b) as the center, R is a symmetrical distance, a corresponding pixel point L in R is obtained, and the value of the pixel point L is assigned to the current point Z; wherein L isx=2a-p,Ly2b-q, wherein LxIs the abscissa L of the pixel point LyIs the ordinate of the pixel point L;
step 2.14: q is q +1, and the step 2.5 is skipped;
and step 3: for parameter minimum scale sigmaminMaximum scale σmaxA constant coefficient gamma, a constant coefficient c, a scale step length delta sigma are set, wherein sigma ismin<σmax;
And 4, step 4: for the initial scale sigmaiIs set so that σi=σmin;
And 5: constructing a Hessian matrix of the image I, constructing a Gaussian function through the optimal response scale sigma, and subtracting the image I from the result of convolution operation of the image I and the Gaussian function to obtain an image M, wherein the method comprises the following specific steps:
step 5.1: initialization variable p 1, scale variable k 1, variable vmax=0, wherein vmaxIs the maximum response value variable of the pixel;
step 5.2: if p is less than or equal to W, the variable q is 1, and step 5.3 is executed, otherwise, step 6 is executed;
step 5.3: if q is less than or equal to H, executing step 5.4, otherwise, making p equal to p +1, and executing step 5.2;
step 5.4: judging the current scale sigmaiWhether or not greater than the maximum scale sigmamaxIf it is greater than σmaxIf so, let σi=σminExecuting step 5.12, otherwise, executing step 5.5;
step 5.5: constructing a Hessian matrix for point (p, q):
D=∫∫I(p-u,q-v)×A(u,v)dudv
E=∫∫I(p-u,q-v)×B(u,v)dudv
F=∫∫I(p-u,q-v)×C(u,v)dudv
a (u, v), B (u, v) and C (u, v) are based on the scale σiConstructing a second partial derivative of Gaussian
Wherein D, E, F is the convolution of image I with the corresponding gaussian second order partial derivative A, B, C;
step 5.6: calculating two eigenvalues lambda of the Hessian matrix obtained in step 5.51、λ2, wherein
in the formula ,RBIs the degree of anisotropy of the linear shape, S is the norm;
Step 5.9: constructing a Gaussian kernel based on the scale k to obtain a Gaussian curve gκ;
Step 5.10: the Gaussian curve g obtained in the step 5.9κPerforming convolution operation with image ISubtracting the image I from the convolution result to obtain an image M;
M(p,q)=(gκ*I)(p,q)-I(p,q)
step 5.11: updating the scale sigmai=σi+ Δ σ, Δ σ is the scale step, and step 5.4 is skipped;
step 5.12: updating the coordinate q to be q +1, and jumping to the step 5.3;
step 6, setting an initial zero level set segmentation curve on the image M, and generating a high one-dimensional level set function phi according to the set zero level set0;
The set initial zero level set segmentation curve is a closed curve with a specified shape and is a randomly generated closed curve, and the level set function phi is a high one-dimensional symbol distance function generated according to the set initial level set segmentation curve;
step 7, establishing an energy functional E (phi) of level set segmentation, and setting a weighting coefficient α in the level set method1Weighting factor α2Curve smoothing term coefficient v and area smoothing term coefficient mu;
the energy functional is as follows:
E(φ)=ED+vL(φ)+μP(φ)
wherein ,EDFor the image data item, L (φ) is a length constraint term, P (φ) is an area constraint term, and H (φ (P, q)) is a Heaviside function of φ (P, q);
ED(φ)=α1∫Ω|M(p,q)-c1|2H(φ(p,q))dpdq+α2∫Ω|M(p,q)-c2|2(1-H(φ(p,q)))dpdq
P(φ)=∫H(φ(p,q))dpdq
wherein c1Is the mean value of the gray levels in the zero level set segmentation curve, c2Is the gray average outside the zero level set segmentation curve;
and 8: setting a maximum iteration number J and a convergence threshold epsilon of an energy functional E (phi) of an image level set;
and step 9: separately updating the image level set function set H (phi)j)、1-H(φj)、Cj、φjObtaining an energy functional E of the j iterationj;
Specifically, the method comprises the following steps:
where at is the step of time in which,for the time partial derivative of the iteratively updated level set function, the time partial derivative formula is as follows:
step 10: judging whether an iteration termination condition is reached: if the current iteration time J reaches the maximum iteration time J or the difference value of the iteration results of two adjacent times of the energy functional E (phi) is smaller than a convergence threshold epsilon which is set in advance, executing the step 11, otherwise, adding 1 to the iteration time, and returning to the step 9;
step 11: according to the current updated image level set function phijAn image, i.e. the segmentation result of the image, is constructed.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911108341.XA CN111028201B (en) | 2019-11-13 | 2019-11-13 | Fundus blood vessel image segmentation system and method based on multi-scale level set |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
CN201911108341.XA CN111028201B (en) | 2019-11-13 | 2019-11-13 | Fundus blood vessel image segmentation system and method based on multi-scale level set |
Publications (2)
Publication Number | Publication Date |
---|---|
CN111028201A true CN111028201A (en) | 2020-04-17 |
CN111028201B CN111028201B (en) | 2023-10-27 |
Family
ID=70201400
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
CN201911108341.XA Active CN111028201B (en) | 2019-11-13 | 2019-11-13 | Fundus blood vessel image segmentation system and method based on multi-scale level set |
Country Status (1)
Country | Link |
---|---|
CN (1) | CN111028201B (en) |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111899267A (en) * | 2020-07-24 | 2020-11-06 | 哈尔滨理工大学 | Retina blood vessel segmentation algorithm based on level set |
CN111986255A (en) * | 2020-09-07 | 2020-11-24 | 北京凌云光技术集团有限责任公司 | Multi-scale anchor initialization method and device of image detection model |
CN114241186A (en) * | 2021-11-24 | 2022-03-25 | 长春工业大学 | Finger vein image region-of-interest segmentation method based on active contour method |
CN115409765A (en) * | 2021-05-28 | 2022-11-29 | 南京博视医疗科技有限公司 | Blood vessel extraction method and device based on fundus retina image |
Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104616308A (en) * | 2015-02-12 | 2015-05-13 | 大连民族学院 | Multiscale level set image segmenting method based on kernel fuzzy clustering |
CN105427298A (en) * | 2015-11-12 | 2016-03-23 | 西安电子科技大学 | Remote sensing image registration method based on anisotropic gradient dimension space |
US20160275674A1 (en) * | 2015-12-29 | 2016-09-22 | Laboratoires Bodycad Inc. | Method and system for performing multi-bone segmentation in imaging data |
CN106097378A (en) * | 2016-07-24 | 2016-11-09 | 江西理工大学 | A kind of level set retinal vascular images dividing method merging shape prior |
-
2019
- 2019-11-13 CN CN201911108341.XA patent/CN111028201B/en active Active
Patent Citations (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN104616308A (en) * | 2015-02-12 | 2015-05-13 | 大连民族学院 | Multiscale level set image segmenting method based on kernel fuzzy clustering |
CN105427298A (en) * | 2015-11-12 | 2016-03-23 | 西安电子科技大学 | Remote sensing image registration method based on anisotropic gradient dimension space |
US20160275674A1 (en) * | 2015-12-29 | 2016-09-22 | Laboratoires Bodycad Inc. | Method and system for performing multi-bone segmentation in imaging data |
CN106097378A (en) * | 2016-07-24 | 2016-11-09 | 江西理工大学 | A kind of level set retinal vascular images dividing method merging shape prior |
Non-Patent Citations (1)
Title |
---|
赵姝颖 等: "基于多尺度水平集的MR图像海马区分割方法", 仪器仪表学报 * |
Cited By (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
CN111899267A (en) * | 2020-07-24 | 2020-11-06 | 哈尔滨理工大学 | Retina blood vessel segmentation algorithm based on level set |
CN111986255A (en) * | 2020-09-07 | 2020-11-24 | 北京凌云光技术集团有限责任公司 | Multi-scale anchor initialization method and device of image detection model |
CN111986255B (en) * | 2020-09-07 | 2024-04-09 | 凌云光技术股份有限公司 | Multi-scale anchor initializing method and device of image detection model |
CN115409765A (en) * | 2021-05-28 | 2022-11-29 | 南京博视医疗科技有限公司 | Blood vessel extraction method and device based on fundus retina image |
CN115409765B (en) * | 2021-05-28 | 2024-01-09 | 南京博视医疗科技有限公司 | Blood vessel extraction method and device based on fundus retina image |
CN114241186A (en) * | 2021-11-24 | 2022-03-25 | 长春工业大学 | Finger vein image region-of-interest segmentation method based on active contour method |
Also Published As
Publication number | Publication date |
---|---|
CN111028201B (en) | 2023-10-27 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
CN111028201A (en) | Fundus blood vessel image segmentation system and method based on multi-scale level set | |
CN107292887B (en) | Retinal vessel segmentation method based on deep learning adaptive weight | |
Østvik et al. | Myocardial function imaging in echocardiography using deep learning | |
CN107133923B (en) | Fuzzy image non-blind deblurring method based on adaptive gradient sparse model | |
CN112541864A (en) | Image restoration method based on multi-scale generation type confrontation network model | |
JP7353803B2 (en) | Image processing device, image processing method, and program | |
CN111047544B (en) | Saturated image deblurring method based on nonlinear degradation model | |
CN106663315A (en) | Method for denoising noisy image | |
CN113808036B (en) | Low-illumination image enhancement and denoising method based on Retinex model | |
CN108492302B (en) | Neural layer segmentation method and device, electronic device and storage medium | |
CN111179333B (en) | Defocus blur kernel estimation method based on binocular stereo vision | |
CN113344804B (en) | Training method of low-light image enhancement model and low-light image enhancement method | |
Ke et al. | Unsupervised image restoration using partially linear denoisers | |
JP2012185774A (en) | Image processing device, image processing method, image forming apparatus, program, and recording medium | |
CN111028241B (en) | Multi-scale blood vessel enhanced level set segmentation system and method | |
CN115439423B (en) | CT image-based identification method, device, equipment and storage medium | |
CN113963006A (en) | Method and device for constructing retinal vessel vectorization model and storage medium | |
US10460491B2 (en) | Method for real-time deformable fusion of a source multi-dimensional image and a target multi-dimensional image of an object | |
JP4202692B2 (en) | Image processing method and apparatus | |
JP2004118578A (en) | Outline extracting method, image processor and its computer program | |
CN115797186A (en) | Image restoration method and device, electronic equipment and storage medium | |
CN113610767A (en) | Medical image multi-threshold segmentation method based on improved goblet sea squirt group algorithm | |
CN108765432B (en) | Automatic carotid intima-media boundary segmentation method and system | |
WO2021009804A1 (en) | Method for learning threshold value | |
CN112634224A (en) | Focus detection method and device based on target image |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PB01 | Publication | ||
PB01 | Publication | ||
SE01 | Entry into force of request for substantive examination | ||
SE01 | Entry into force of request for substantive examination | ||
GR01 | Patent grant | ||
GR01 | Patent grant |