CN111028201A - Fundus blood vessel image segmentation system and method based on multi-scale level set - Google Patents

Fundus blood vessel image segmentation system and method based on multi-scale level set Download PDF

Info

Publication number
CN111028201A
CN111028201A CN201911108341.XA CN201911108341A CN111028201A CN 111028201 A CN111028201 A CN 111028201A CN 201911108341 A CN201911108341 A CN 201911108341A CN 111028201 A CN111028201 A CN 111028201A
Authority
CN
China
Prior art keywords
image
level set
scale
blood vessel
segmentation
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201911108341.XA
Other languages
Chinese (zh)
Other versions
CN111028201B (en
Inventor
杨金柱
付杰
冯朝璐
曹鹏
谭文军
栗伟
赵大哲
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Northeastern University China
Original Assignee
Northeastern University China
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Northeastern University China filed Critical Northeastern University China
Priority to CN201911108341.XA priority Critical patent/CN111028201B/en
Publication of CN111028201A publication Critical patent/CN111028201A/en
Application granted granted Critical
Publication of CN111028201B publication Critical patent/CN111028201B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/0002Inspection of images, e.g. flaw detection
    • G06T7/0012Biomedical image inspection
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/11Region-based segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/136Segmentation; Edge detection involving thresholding
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/10Segmentation; Edge detection
    • G06T7/194Segmentation; Edge detection involving foreground-background segmentation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/60Analysis of geometric attributes
    • G06T7/62Analysis of geometric attributes of area, perimeter, diameter or volume
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30041Eye; Retina; Ophthalmic
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/30Subject of image; Context of image processing
    • G06T2207/30004Biomedical image processing
    • G06T2207/30101Blood vessel; Artery; Vein; Vascular

Abstract

The invention provides a fundus blood vessel image segmentation system and method based on a multi-scale level set, and relates to the technical field of image processing. The invention comprises an input module, a preprocessing module, a scale construction module, a level set module and an output module; the present invention improves upon existing level set methods based on local features. The fundus blood vessels are different in thickness, and the blood vessel segmentation precision is not high due to the fact that the blood vessel segmentation granularity is controlled by a single scale. Based on the characteristic that the blood vessels are different in thickness, the optimal response scale is found for each pixel point, namely the scales of the blood vessels different in thickness are different, and the problems of missing, wrong and the like of the blood vessels with different thicknesses are solved, so that the robustness of the segmentation method is enhanced, and an accurate image segmentation result can be obtained by applying the method.

Description

Fundus blood vessel image segmentation system and method based on multi-scale level set
Technical Field
The invention relates to the technical field of image processing, in particular to a fundus blood vessel image segmentation system and method based on a multi-scale level set.
Background
The eyeground blood vessel image is the basis for screening eye diseases such as cataract, glaucoma, age-related macular degeneration and the like. The problems of complicated structure of the fundus blood vessels and uneven image gray scale cause the problems of insufficient segmentation and the like of a plurality of algorithms at the adjacent blood vessels. On the other hand, the fundus blood vessels are different in thickness, and the blood vessel segmentation precision is not high due to the fact that the blood vessel segmentation granularity is controlled by a single scale in the existing segmentation method. Therefore, the invention provides a fundus blood vessel image segmentation method based on a multi-scale level set. And selecting the optimal scale for each pixel point, and overcoming the problems of missed and wrong division of uneven-thickness blood vessels.
Disclosure of Invention
Aiming at the problems in the prior art, the invention provides a fundus blood vessel image segmentation system based on a multi-scale level set.
The technical scheme adopted by the invention is as follows: a fundus blood vessel image segmentation system based on a multi-scale level set comprises an input module, a preprocessing module, a scale construction module, a level set module and an output module;
the input module is used for receiving the fundus blood vessel image input by the user and then transmitting the fundus blood vessel image to the preprocessing module;
the preprocessing module is used for expanding the received fundus blood vessel image, and the expanded result is transmitted to the scale construction module;
the scale construction module is used for finding the optimal blood vessel response scale for the blood vessel image at the bottom of the eye, further constructing a Gaussian curve based on the scale, subtracting the original image from the convolution result of the Gaussian curve and the image to obtain an image M, and transmitting the image M to the level set module;
the level set module is used for carrying out blood vessel segmentation on the image M by adopting a level set algorithm and transmitting a segmentation result to the output module;
and the output module is used for outputting and displaying the segmentation result image.
In another aspect, the present invention provides a fundus blood vessel image segmentation method based on a multi-scale level set, which is implemented by the fundus blood vessel image segmentation system based on a multi-scale level set, and includes the following steps:
step 1: the input module receives an image A of fundus blood vessels to be segmented, wherein the width of the image A is W, and the height of the image A is H;
step 2: the preprocessing module constructs the received fundus blood vessel image A to be segmented to generate a fundus blood vessel image I without an edge background, and the resolution of the fundus blood vessel image I is the same as that of the image A; converting the image A into a gray image J, setting all areas of the image J as omega, directly obtaining an image P if the area to be segmented is full of omega, carrying out mirror image expansion on an effective boundary area in the image to cover a black filling area in the whole image if the area to be segmented is not full of omega, setting the expanded image as P, and executing the step 2.1 if I is equal to P; otherwise, executing step 3;
step 2.1: determining a threshold Q to divide the grayscale image J into a foreground R and a background B, where R and B are binary images, R is 1 and B is 0 in the foreground region, R is 0 and B is 1 in the background region;
step 2.2: constructing a foreground region boundary image R2Etching the foreground R to obtain R1,R2=R-R1Wherein the image R2The image is a binary image;
step 2.3: initializing a variable P to 1, wherein P is an initializing abscissa value of a pixel point in the outer loop;
step 2.4: if p is less than or equal to W and the initialized longitudinal coordinate value q of the pixel point in the outer loop is 1, executing the step 2.5, otherwise, executing the step 3;
step 2.5: if q is less than or equal to H, executing step 2.6, otherwise, making p equal to p +1, and executing step 2.4;
step 2.6: if the current point (p, q) satisfies B ═ 1, step 2.7 is performed, otherwise, let q ═ q +1, step 2.5 is performed;
step 2.7: initializing a variable m which is 1 and is an initial abscissa value of a pixel point in the image inner loop, and initializing
Figure BDA0002271983910000021
Wherein r is the distance between any two pixels in the initialized image, and the initial coordinates (a, b) are two random positive integers;
step 2.8: if m is less than or equal to W, the variable n is 1, n is the initial value of the vertical coordinate of the pixel point in the inner loop, the step 2.9 is executed, otherwise, the step 2.13 is executed;
step 2.9: if n is less than or equal to H, executing step 2.10, otherwise, making m equal to m +1, and executing step 2.8;
step 2.10: if the point (m, n) satisfies R2Step 2.11 is performed when n is equal to n +1, otherwise step 2.9 is performed;
step 2.11: calculating a distance dist ((p, q), (m, n)) between the point (p, q) and the point (m, n), wherein dist is a distance metric function, and if r < dist ((p, q), (m, n)), then r ═ dist ((p, q), (m, n)), and let a ═ m, b ═ n;
step 2.12: step 2.9 is skipped to by making n equal to n + 1;
step 2.13: the point (p, q) takes the point (a, b) as the center, R is a symmetrical distance, a corresponding pixel point L in R is obtained, and the value of the pixel point L is assigned to the current point Z; wherein L isx=2a-p,Ly2b-q, wherein LxIs the abscissa L of the pixel point LyIs the ordinate of the pixel point L;
step 2.14: q is q +1, and the step 2.5 is skipped;
and step 3: for parameter minimum scale sigmaminMaximum scale σmaxA constant coefficient gamma, a constant coefficient c, a scale step length delta sigma are set, wherein sigma ismin<σmax
And 4, step 4: for the initial scale sigmaiIs set so that σi=σmin
And 5: constructing a Hessian matrix of the image I, constructing a Gaussian function through the optimal response scale sigma, and subtracting the image I from the result of convolution operation of the image I and the Gaussian function to obtain an image M, wherein the method comprises the following specific steps:
step 5.1: initialization variable p 1, scale variable k 1, variable vmax=0, wherein vmaxIs the maximum response value variable of the pixel;
step 5.2: if p is less than or equal to W, the variable q is 1, and step 5.3 is executed, otherwise, step 6 is executed;
step 5.3: if q is less than or equal to H, executing step 5.4, otherwise, making p equal to p +1, and executing step 5.2;
step 5.4: judging the current scale sigmaiWhether or not greater than the maximum scale sigmamaxIf it is greater than σmaxIf so, let σi=σminExecuting step 5.12, otherwise, executing step 5.5;
step 5.5: constructing a Hessian matrix for point (p, q):
wherein ,
Figure BDA0002271983910000031
D=∫∫I(p-u,q-v)×A(u,v)dudv
E=∫∫I(p-u,q-v)×B(u,v)dudv
F=∫∫I(p-u,q-v)×C(u,v)dudv
a (u, v), B (u, v) and C (u, v) are based on the scale σiConstructing a second partial derivative of Gaussian
Figure BDA0002271983910000032
Figure BDA0002271983910000033
Figure BDA0002271983910000034
Wherein D, E, F is the convolution of image I with the corresponding gaussian second order partial derivative A, B, C;
step 5.6: calculating two eigenvalues lambda of the Hessian matrix obtained in step 5.51、λ2, wherein
Figure BDA0002271983910000035
wherein
Figure BDA0002271983910000041
Step 5.7: calculated at the current scale sigmaiResponse value of pixel (p, q)
Figure BDA0002271983910000042
wherein
Figure BDA0002271983910000043
Figure BDA0002271983910000044
Figure BDA0002271983910000045
in the formula ,RBIs the degree of anisotropy of the linear shape, S is the norm;
step 5.8: if it is
Figure BDA0002271983910000046
Then order
Figure BDA0002271983910000047
And κ ═ σ -i
Step 5.9: constructing a Gaussian kernel based on the scale k to obtain a Gaussian curve gκ
Figure BDA0002271983910000048
Step 5.10: step 5.9The resulting Gaussian curve gκPerforming convolution operation with the image I, and subtracting the image I from a convolution result to obtain an image M;
M(p,q)=(gκ*I)(p,q)-I(p,q)
step 5.11: updating the scale sigmai=σi+ Δ σ, Δ σ is the scale step, and step 5.4 is skipped;
step 5.12: updating the coordinate q to be q +1, and jumping to the step 5.3;
step 6, setting an initial zero level set segmentation curve on the image M, and generating a high one-dimensional level set function phi according to the set zero level set0
The set initial zero level set segmentation curve is a closed curve with a specified shape and is a randomly generated closed curve, and the level set function phi is a high one-dimensional symbol distance function generated according to the set initial level set segmentation curve;
step 7, establishing an energy functional E (phi) of level set segmentation, and setting a weighting coefficient α in the level set method1Weighting factor α2Curve smoothing term coefficient v and area smoothing term coefficient mu;
the energy functional is as follows:
E(φ)=ED+vL(φ)+μP(φ)
wherein ,EDFor the image data item, L (φ) is a length constraint term, P (φ) is an area constraint term, and H (φ (P, q)) is a Heaviside function of φ (P, q);
ED(φ)=α1Ω|M(p,q)-c1|2H(φ(p,q))dpdq+α2Ω|M(p,q)-c2|2(1-H(φ(p,q)))dpdq
Figure BDA0002271983910000051
P(φ)=∫H(φ(p,q))dpdq
wherein c1Is the mean value of the gray levels in the zero level set segmentation curve, c2Is the gray average outside the zero level set segmentation curve;
and 8: setting the maximum iteration number J and a convergence threshold epsilon of an energy functional of the image level set;
and step 9: separately updating the image level set function set H (phi)j)、1-H(φj)、Cj、φjObtaining an energy functional E of the j iterationj
Specifically, the method comprises the following steps:
Figure BDA0002271983910000052
Figure BDA0002271983910000053
Figure BDA0002271983910000054
where at is the step of time in which,
Figure BDA0002271983910000055
for the time partial derivative of the iteratively updated level set function, the time partial derivative formula is as follows:
Figure BDA0002271983910000056
step 10: judging whether an iteration termination condition is reached: if the current iteration time J reaches the maximum iteration time J or the difference value of the iteration results of two adjacent times of the energy functional E (phi) is smaller than a convergence threshold epsilon which is set in advance, executing the step 11, otherwise, adding 1 to the iteration time, and returning to the step 9;
step 11: according to the current updated image level set function phijAn image, i.e. the segmentation result of the image, is constructed.
Adopt the produced beneficial effect of above-mentioned technical scheme to lie in:
the invention provides a segmentation system and method of fundus blood vessel images based on a multi-scale level set, and improves the existing level set method based on local features. The fundus blood vessels are different in thickness, and the blood vessel segmentation precision is not high due to the fact that the blood vessel segmentation granularity is controlled by a single scale. Based on the characteristic that the blood vessels are different in thickness, the optimal response scale is found for each pixel point, namely the scales of the blood vessels different in thickness are different, and the problems of missing, wrong and the like of the blood vessels with different thicknesses are solved, so that the robustness of the segmentation method is enhanced. By applying the method, an accurate image segmentation result can be obtained.
Drawings
FIG. 1 is a block diagram of a fundus blood vessel image segmentation system;
FIG. 2 is a flowchart of a fundus blood vessel image segmentation method
Fig. 3 shows an original image of fundus blood vessel image input;
FIG. 4 shows the conversion of the original image of the blood vessels in the fundus into a gray scale image;
FIG. 5 is a view after expansion of a fundus blood vessel image;
FIG. 6 shows an enhanced image;
FIG. 7 shows an image after convolution and subtraction of the original image;
FIG. 8 shows an initial level set;
FIG. 9 shows the final segmentation result of the image;
FIG. 10 shows a gold standard for an image;
Detailed Description
The following detailed description of embodiments of the present invention is provided in connection with the accompanying drawings and examples. The following examples are intended to illustrate the invention but are not intended to limit the scope of the invention.
A fundus blood vessel image segmentation system based on a multi-scale level set is shown in figure 1 and comprises an input module, a preprocessing module, a scale construction module, a level set module and an output module;
the input module is used for receiving the fundus blood vessel image input by the user and then transmitting the fundus blood vessel image to the preprocessing module;
the preprocessing module is used for expanding the received fundus blood vessel image, and the expanded result is transmitted to the scale construction module;
the scale construction module is used for finding the optimal blood vessel response scale for the blood vessel image at the bottom of the eye, further constructing a Gaussian curve based on the scale, subtracting the original image from the convolution result of the Gaussian curve and the image to obtain an image M, and transmitting the image M to the level set module;
the level set module is used for carrying out blood vessel segmentation on the image M by adopting a level set algorithm and transmitting a segmentation result to the output module;
and the output module is used for outputting and displaying the segmentation result image.
In another aspect, the present invention provides a fundus blood vessel image segmentation method based on a multi-scale level set, which is implemented by the foregoing fundus blood vessel image segmentation system based on a multi-scale level set, as shown in fig. 2, and includes the following steps:
step 1: the input module receives an image A of fundus blood vessels to be segmented, wherein the image A has the width W and the height H as shown in FIG. 3;
step 2: the preprocessing module constructs the received fundus blood vessel image A to be segmented to generate a fundus blood vessel image I without an edge background, and the resolution of the fundus blood vessel image I is the same as that of the image A; converting the image a into a gray image J, as shown in fig. 4, setting all regions of the image J to be Ω, directly obtaining an image P if the region to be segmented is full of Ω, and performing mirror image expansion on an effective boundary region in the image to cover a black filled region in the whole image if the region to be segmented is not full of Ω, and setting the expanded image to be P as shown in fig. 5, and meanwhile, executing step 2.1 if I is equal to P; otherwise, executing step 3;
step 2.1: determining a threshold Q to divide the grayscale image J into a foreground R and a background B, where R and B are binary images, R is 1 and B is 0 in the foreground region, R is 0 and B is 1 in the background region;
step 2.2: constructing a foreground region boundary image R2Etching the foreground R to obtain R1,R2=R-R1Wherein the image R2The image is a binary image;
step 2.3: initializing a variable P to 1, wherein P is an initializing abscissa value of a pixel point in the outer loop;
step 2.4: if p is less than or equal to W and the initialized longitudinal coordinate value q of the pixel point in the outer loop is 1, executing the step 2.5, otherwise, executing the step 3;
step 2.5: if q is less than or equal to H, executing step 2.6, otherwise, making p equal to p +1, and executing step 2.4;
step 2.6: if the current point (p, q) satisfies B ═ 1, step 2.7 is performed, otherwise, let q ═ q +1, step 2.5 is performed;
step 2.7: initializing a variable m which is 1 and is an initial abscissa value of a pixel point in the image inner loop, and initializing
Figure BDA0002271983910000071
Wherein r is the distance between any two pixels in the initialized image, and the initial coordinates (a, b) are two random positive integers;
step 2.8: if m is less than or equal to W, the variable n is 1, n is the initial value of the vertical coordinate of the pixel point in the inner loop, the step 2.9 is executed, otherwise, the step 2.13 is executed;
step 2.9: if n is less than or equal to H, executing step 2.10, otherwise, making m equal to m +1, and executing step 2.8;
step 2.10: if the point (m, n) satisfies R2Step 2.11 is performed when n is equal to n +1, otherwise step 2.9 is performed;
step 2.11: calculating a distance dist ((p, q), (m, n)) between the point (p, q) and the point (m, n), wherein dist is a distance metric function, and if r < dist ((p, q), (m, n)), then r ═ dist ((p, q), (m, n)), and let a ═ m, b ═ n;
step 2.12: step 2.9 is skipped to by making n equal to n + 1;
step 2.13: the point (p, q) takes the point (a, b) as the center, R is a symmetrical distance, a corresponding pixel point L in R is obtained, and the value of the pixel point L is assigned to the current point Z; wherein L isx=2a-p,Ly2b-q, wherein LxIs the abscissa L of the pixel point LyIs the ordinate of the pixel point L;
step 2.14: q is q +1, and the step 2.5 is skipped;
and step 3: for parameter minimum scale sigmaminMaximum scale σmaxA constant coefficient gamma, a constant coefficient c, a scale step length delta sigma are set, wherein sigma ismin<σmax
And 4, step 4: for the initial scale sigmaiIs set so that σi=σmin
And 5: constructing a Hessian matrix of the image I, constructing a gaussian function through the optimal response scale σ, and subtracting the image I from a result of convolution operation of the image I and the gaussian function to obtain an image M, as shown in fig. 6 and 7, the specific steps are as follows:
step 5.1: initialization variable p 1, scale variable k 1, variable vmax=0, wherein vmaxIs the maximum response value variable of the pixel;
step 5.2: if p is less than or equal to W, the variable q is 1, and step 5.3 is executed, otherwise, step 6 is executed;
step 5.3: if q is less than or equal to H, executing step 5.4, otherwise, making p equal to p +1, and executing step 5.2;
step 5.4: judging the current scale sigmaiWhether or not greater than the maximum scale sigmamaxIf it is greater than σmaxIf so, let σi=σminExecuting step 5.12, otherwise, executing step 5.5;
step 5.5: constructing a Hessian matrix for point (p, q):
wherein ,
Figure BDA0002271983910000081
D=∫∫I(p-u,q-v)×A(u,v)dudv
E=∫∫I(p-u,q-v)×B(u,v)dudv
F=∫∫I(p-u,q-v)×C(u,v)dudv
a (u, v), B (u, v) and C (u, v) are based on the scale σiConstructing a second-order partial derivative of Gaussian;
Figure BDA0002271983910000082
Figure BDA0002271983910000083
Figure BDA0002271983910000084
wherein D, E, F is the convolution of image I with the corresponding gaussian second order partial derivative A, B, C;
step 5.6: calculating two eigenvalues lambda of the Hessian matrix obtained in step 5.51、λ2, wherein
Figure BDA0002271983910000085
wherein
Figure BDA0002271983910000091
Step 5.7: calculated at the current scale sigmaiResponse value of pixel (p, q)
Figure BDA0002271983910000092
wherein
Figure BDA0002271983910000093
Figure BDA0002271983910000094
Figure BDA0002271983910000095
in the formula ,RBIs the degree of anisotropy of the linear shape, S is the norm;
step 5.8: if it is
Figure BDA0002271983910000096
Then order
Figure BDA0002271983910000097
And κ ═ σ -i
Step 5.9: constructing a Gaussian kernel based on the scale k to obtain a Gaussian curve gκ
Figure BDA0002271983910000098
Step 5.10: the Gaussian curve g obtained in the step 5.9κPerforming convolution operation with the image I, and subtracting the image I from a convolution result to obtain an image M;
M(p,q)=(gκ*I)(p,q)-I(p,q)
step 5.11: updating the scale sigmai=σi+ Δ σ, Δ σ is the scale step, and step 5.4 is skipped;
step 5.12: updating the coordinate q to be q +1, and jumping to the step 5.3;
step 6, setting an initial zero level set segmentation curve on the image M, as shown in FIG. 8, generating a high one-dimensional level set function phi according to the set zero level set0
The set initial zero level set segmentation curve is a closed curve with a specified shape and is a randomly generated closed curve, and the level set function phi is a high one-dimensional symbol distance function generated according to the set initial level set segmentation curve;
step 7, establishing an energy functional E (phi) of level set segmentation, and setting a weighting coefficient α in the level set method1Weighting factor α2Curve smoothing term coefficient v and area smoothing term coefficient mu;
the energy functional is as follows:
E(φ)=ED+vL(φ)+μP(φ)
wherein ,EDFor the image data item, L (φ) is a length constraint term, P (φ) is an area constraint term, and H (φ (P, q)) is a Heaviside function of φ (P, q);
ED(φ)=α1Ω|M(p,q)-c1|2H(φ(p,q))dpdq+α2Ω|M(p,q)-c2|2(1-H(φ(p,q)))dpdq
Figure BDA0002271983910000101
P(φ)=∫H(φ(p,q))dpdq
wherein c1Is the mean value of the gray levels in the zero level set segmentation curve, c2Is the gray average outside the zero level set segmentation curve;
in the embodiment, the larger the image data item coefficient is, the closer the zero level set segmentation curve is to the boundary of the object to be segmented in the image, and the larger the level set segmentation curve length item coefficient is, the smoother the segmentation curve is, so that the weighting coefficient α, which is the control parameter for image level set segmentation, is set according to the image to be segmented11.0, weighting factor α2The coefficient v of the curve smoothing term is 0.001 × 255, and the coefficient μ of the area smoothing term is 2.0.
And 8: setting the maximum iteration number J and a convergence threshold epsilon of an energy functional of the image level set;
in this embodiment, the maximum number of iterations J is set to 50, and the energy functional E (c) of image level set segmentation is set1,c2Phi), the convergence threshold is 0.01.
And step 9: separately updating the image level set function set H (phi)j)、1-H(φj)、Cj、φjObtaining an energy functional E of the j iterationj
Specifically, the method comprises the following steps:
Figure BDA0002271983910000102
Figure BDA0002271983910000103
Figure BDA0002271983910000104
where at is the step of time in which,
Figure BDA0002271983910000105
for the time partial derivative of the iteratively updated level set function, the time partial derivative formula is as follows:
Figure BDA0002271983910000106
step 10: judging whether an iteration termination condition is reached: if the current iteration time J reaches the maximum iteration time J or the difference value of the iteration results of two adjacent times of the energy functional E (phi) is smaller than a convergence threshold epsilon which is set in advance, executing the step 11, otherwise, adding 1 to the iteration time, and returning to the step 9;
step 11: according to the current updated image level set function phijAs shown in fig. 9, the constructed image, i.e., the segmentation result of the image, fig. 10 is the gold standard of the image.
Finally, it should be noted that: the above embodiments are only used to illustrate the technical solution of the present invention, and not to limit the same; while the invention has been described in detail and with reference to the foregoing embodiments, it will be understood by those skilled in the art that: the technical solutions described in the foregoing embodiments may still be modified, or some or all of the technical features may be equivalently replaced; such modifications and substitutions do not depart from the spirit of the corresponding technical solutions and scope of the present invention as defined in the appended claims.

Claims (2)

1. A fundus blood vessel image segmentation system based on a multi-scale level set is characterized in that: the system comprises an input module, a preprocessing module, a scale construction module, a level set module and an output module;
the input module is used for receiving the fundus blood vessel image input by the user and then transmitting the fundus blood vessel image to the preprocessing module;
the preprocessing module is used for expanding the received fundus blood vessel image, and the expanded result is transmitted to the scale construction module;
the scale construction module is used for finding the optimal blood vessel response scale for the blood vessel image at the bottom of the eye, further constructing a Gaussian curve based on the scale, subtracting the original image from the convolution result of the Gaussian curve and the image to obtain an image M, and transmitting the image M to the level set module;
the level set module is used for carrying out blood vessel segmentation on the image M by adopting a level set algorithm and transmitting a segmentation result to the output module;
and the output module is used for outputting and displaying the segmentation result image.
2. A fundus blood vessel image segmentation method based on a multi-scale level set, which is realized by the fundus blood vessel image segmentation system based on the multi-scale level set of claim 1, and is characterized in that: the method comprises the following steps:
step 1: the input module receives an image A of fundus blood vessels to be segmented, wherein the width of the image A is W, and the height of the image A is H;
step 2: the preprocessing module constructs the received fundus blood vessel image A to be segmented to generate a fundus blood vessel image I without an edge background, and the resolution of the fundus blood vessel image I is the same as that of the image A; converting the image A into a gray image J, setting all areas of the image J as omega, directly obtaining an image P if the area to be segmented is full of omega, carrying out mirror image expansion on an effective boundary area in the image to cover a black filling area in the whole image if the area to be segmented is not full of omega, setting the expanded image as P, and executing the step 2.1 if I is equal to P; otherwise, executing step 3;
step 2.1: determining a threshold Q to divide the grayscale image J into a foreground R and a background B, where R and B are binary images, R is 1 and B is 0 in the foreground region, R is 0 and B is 1 in the background region;
step 2.2: constructing a foreground region boundary image R2Etching the foreground R to obtain R1,R2=R-R1Wherein the image R2The image is a binary image;
step 2.3: initializing a variable P to 1, wherein P is an initializing abscissa value of a pixel point in the outer loop;
step 2.4: if p is less than or equal to W and the initialized longitudinal coordinate value q of the pixel point in the outer loop is 1, executing the step 2.5, otherwise, executing the step 3;
step 2.5: if q is less than or equal to H, executing step 2.6, otherwise, making p equal to p +1, and executing step 2.4;
step 2.6: if the current point (p, q) satisfies B ═ 1, step 2.7 is performed, otherwise, let q ═ q +1, step 2.5 is performed;
step 2.7: initializing a variable m which is 1 and is an initial abscissa value of a pixel point in the image inner loop, and initializing
Figure FDA0002271983900000011
Wherein r is the distance between any two pixels in the initialized image, and the initial coordinates (a, b) are two random positive integers;
step 2.8: if m is less than or equal to W, the variable n is 1, n is the initial value of the vertical coordinate of the pixel point in the inner loop, the step 2.9 is executed, otherwise, the step 2.13 is executed;
step 2.9: if n is less than or equal to H, executing step 2.10, otherwise, making m equal to m +1, and executing step 2.8;
step 2.10: if the point (m, n) satisfies R2Step 2.11 is performed when n is equal to n +1, otherwise step 2.9 is performed;
step 2.11: calculating a distance dist ((p, q), (m, n)) between the point (p, q) and the point (m, n), wherein dist is a distance metric function, and if r < dist ((p, q), (m, n)), then r ═ dist ((p, q), (m, n)), and let a ═ m, b ═ n;
step 2.12: step 2.9 is skipped to by making n equal to n + 1;
step 2.13: the point (p, q) takes the point (a, b) as the center, R is a symmetrical distance, a corresponding pixel point L in R is obtained, and the value of the pixel point L is assigned to the current point Z; wherein L isx=2a-p,Ly2b-q, wherein LxIs the abscissa L of the pixel point LyIs the ordinate of the pixel point L;
step 2.14: q is q +1, and the step 2.5 is skipped;
and step 3: for parameter minimum scale sigmaminMaximum scale σmaxA constant coefficient gamma, a constant coefficient c, a scale step length delta sigma are set, wherein sigma ismin<σmax
And 4, step 4: for the initial scale sigmaiIs set so that σi=σmin
And 5: constructing a Hessian matrix of the image I, constructing a Gaussian function through the optimal response scale sigma, and subtracting the image I from the result of convolution operation of the image I and the Gaussian function to obtain an image M, wherein the method comprises the following specific steps:
step 5.1: initialization variable p 1, scale variable k 1, variable vmax=0, wherein vmaxIs the maximum response value variable of the pixel;
step 5.2: if p is less than or equal to W, the variable q is 1, and step 5.3 is executed, otherwise, step 6 is executed;
step 5.3: if q is less than or equal to H, executing step 5.4, otherwise, making p equal to p +1, and executing step 5.2;
step 5.4: judging the current scale sigmaiWhether or not greater than the maximum scale sigmamaxIf it is greater than σmaxIf so, let σi=σminExecuting step 5.12, otherwise, executing step 5.5;
step 5.5: constructing a Hessian matrix for point (p, q):
wherein ,
Figure FDA0002271983900000021
D=∫∫I(p-u,q-v)×A(u,v)dudv
E=∫∫I(p-u,q-v)×B(u,v)dudv
F=∫∫I(p-u,q-v)×C(u,v)dudv
a (u, v), B (u, v) and C (u, v) are based on the scale σiConstructing a second partial derivative of Gaussian
Figure FDA0002271983900000031
Figure FDA0002271983900000032
Figure FDA0002271983900000033
Wherein D, E, F is the convolution of image I with the corresponding gaussian second order partial derivative A, B, C;
step 5.6: calculating two eigenvalues lambda of the Hessian matrix obtained in step 5.51、λ2, wherein
Figure FDA0002271983900000034
wherein
Figure FDA0002271983900000035
Step 5.7: calculated at the current scale sigmaiResponse value of pixel (p, q)
Figure FDA0002271983900000036
wherein
Figure FDA0002271983900000037
Figure FDA0002271983900000038
Figure FDA0002271983900000039
in the formula ,RBIs the degree of anisotropy of the linear shape, S is the norm;
step 5.8: if it is
Figure FDA00022719839000000310
Then order
Figure FDA00022719839000000311
And κ ═ σ -i
Step 5.9: constructing a Gaussian kernel based on the scale k to obtain a Gaussian curve gκ
Figure FDA00022719839000000312
Step 5.10: the Gaussian curve g obtained in the step 5.9κPerforming convolution operation with image ISubtracting the image I from the convolution result to obtain an image M;
M(p,q)=(gκ*I)(p,q)-I(p,q)
step 5.11: updating the scale sigmai=σi+ Δ σ, Δ σ is the scale step, and step 5.4 is skipped;
step 5.12: updating the coordinate q to be q +1, and jumping to the step 5.3;
step 6, setting an initial zero level set segmentation curve on the image M, and generating a high one-dimensional level set function phi according to the set zero level set0
The set initial zero level set segmentation curve is a closed curve with a specified shape and is a randomly generated closed curve, and the level set function phi is a high one-dimensional symbol distance function generated according to the set initial level set segmentation curve;
step 7, establishing an energy functional E (phi) of level set segmentation, and setting a weighting coefficient α in the level set method1Weighting factor α2Curve smoothing term coefficient v and area smoothing term coefficient mu;
the energy functional is as follows:
E(φ)=ED+vL(φ)+μP(φ)
wherein ,EDFor the image data item, L (φ) is a length constraint term, P (φ) is an area constraint term, and H (φ (P, q)) is a Heaviside function of φ (P, q);
ED(φ)=α1Ω|M(p,q)-c1|2H(φ(p,q))dpdq+α2Ω|M(p,q)-c2|2(1-H(φ(p,q)))dpdq
Figure FDA0002271983900000041
P(φ)=∫H(φ(p,q))dpdq
wherein c1Is the mean value of the gray levels in the zero level set segmentation curve, c2Is the gray average outside the zero level set segmentation curve;
and 8: setting a maximum iteration number J and a convergence threshold epsilon of an energy functional E (phi) of an image level set;
and step 9: separately updating the image level set function set H (phi)j)、1-H(φj)、Cj、φjObtaining an energy functional E of the j iterationj
Specifically, the method comprises the following steps:
Figure FDA0002271983900000042
Figure FDA0002271983900000043
Figure FDA0002271983900000051
where at is the step of time in which,
Figure FDA0002271983900000052
for the time partial derivative of the iteratively updated level set function, the time partial derivative formula is as follows:
Figure FDA0002271983900000053
step 10: judging whether an iteration termination condition is reached: if the current iteration time J reaches the maximum iteration time J or the difference value of the iteration results of two adjacent times of the energy functional E (phi) is smaller than a convergence threshold epsilon which is set in advance, executing the step 11, otherwise, adding 1 to the iteration time, and returning to the step 9;
step 11: according to the current updated image level set function phijAn image, i.e. the segmentation result of the image, is constructed.
CN201911108341.XA 2019-11-13 2019-11-13 Fundus blood vessel image segmentation system and method based on multi-scale level set Active CN111028201B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201911108341.XA CN111028201B (en) 2019-11-13 2019-11-13 Fundus blood vessel image segmentation system and method based on multi-scale level set

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201911108341.XA CN111028201B (en) 2019-11-13 2019-11-13 Fundus blood vessel image segmentation system and method based on multi-scale level set

Publications (2)

Publication Number Publication Date
CN111028201A true CN111028201A (en) 2020-04-17
CN111028201B CN111028201B (en) 2023-10-27

Family

ID=70201400

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201911108341.XA Active CN111028201B (en) 2019-11-13 2019-11-13 Fundus blood vessel image segmentation system and method based on multi-scale level set

Country Status (1)

Country Link
CN (1) CN111028201B (en)

Cited By (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111899267A (en) * 2020-07-24 2020-11-06 哈尔滨理工大学 Retina blood vessel segmentation algorithm based on level set
CN111986255A (en) * 2020-09-07 2020-11-24 北京凌云光技术集团有限责任公司 Multi-scale anchor initialization method and device of image detection model
CN114241186A (en) * 2021-11-24 2022-03-25 长春工业大学 Finger vein image region-of-interest segmentation method based on active contour method
CN115409765A (en) * 2021-05-28 2022-11-29 南京博视医疗科技有限公司 Blood vessel extraction method and device based on fundus retina image

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104616308A (en) * 2015-02-12 2015-05-13 大连民族学院 Multiscale level set image segmenting method based on kernel fuzzy clustering
CN105427298A (en) * 2015-11-12 2016-03-23 西安电子科技大学 Remote sensing image registration method based on anisotropic gradient dimension space
US20160275674A1 (en) * 2015-12-29 2016-09-22 Laboratoires Bodycad Inc. Method and system for performing multi-bone segmentation in imaging data
CN106097378A (en) * 2016-07-24 2016-11-09 江西理工大学 A kind of level set retinal vascular images dividing method merging shape prior

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104616308A (en) * 2015-02-12 2015-05-13 大连民族学院 Multiscale level set image segmenting method based on kernel fuzzy clustering
CN105427298A (en) * 2015-11-12 2016-03-23 西安电子科技大学 Remote sensing image registration method based on anisotropic gradient dimension space
US20160275674A1 (en) * 2015-12-29 2016-09-22 Laboratoires Bodycad Inc. Method and system for performing multi-bone segmentation in imaging data
CN106097378A (en) * 2016-07-24 2016-11-09 江西理工大学 A kind of level set retinal vascular images dividing method merging shape prior

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
赵姝颖 等: "基于多尺度水平集的MR图像海马区分割方法", 仪器仪表学报 *

Cited By (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN111899267A (en) * 2020-07-24 2020-11-06 哈尔滨理工大学 Retina blood vessel segmentation algorithm based on level set
CN111986255A (en) * 2020-09-07 2020-11-24 北京凌云光技术集团有限责任公司 Multi-scale anchor initialization method and device of image detection model
CN111986255B (en) * 2020-09-07 2024-04-09 凌云光技术股份有限公司 Multi-scale anchor initializing method and device of image detection model
CN115409765A (en) * 2021-05-28 2022-11-29 南京博视医疗科技有限公司 Blood vessel extraction method and device based on fundus retina image
CN115409765B (en) * 2021-05-28 2024-01-09 南京博视医疗科技有限公司 Blood vessel extraction method and device based on fundus retina image
CN114241186A (en) * 2021-11-24 2022-03-25 长春工业大学 Finger vein image region-of-interest segmentation method based on active contour method

Also Published As

Publication number Publication date
CN111028201B (en) 2023-10-27

Similar Documents

Publication Publication Date Title
CN111028201A (en) Fundus blood vessel image segmentation system and method based on multi-scale level set
CN107292887B (en) Retinal vessel segmentation method based on deep learning adaptive weight
Østvik et al. Myocardial function imaging in echocardiography using deep learning
CN107133923B (en) Fuzzy image non-blind deblurring method based on adaptive gradient sparse model
CN112541864A (en) Image restoration method based on multi-scale generation type confrontation network model
JP7353803B2 (en) Image processing device, image processing method, and program
CN111047544B (en) Saturated image deblurring method based on nonlinear degradation model
CN106663315A (en) Method for denoising noisy image
CN113808036B (en) Low-illumination image enhancement and denoising method based on Retinex model
CN108492302B (en) Neural layer segmentation method and device, electronic device and storage medium
CN111179333B (en) Defocus blur kernel estimation method based on binocular stereo vision
CN113344804B (en) Training method of low-light image enhancement model and low-light image enhancement method
Ke et al. Unsupervised image restoration using partially linear denoisers
JP2012185774A (en) Image processing device, image processing method, image forming apparatus, program, and recording medium
CN111028241B (en) Multi-scale blood vessel enhanced level set segmentation system and method
CN115439423B (en) CT image-based identification method, device, equipment and storage medium
CN113963006A (en) Method and device for constructing retinal vessel vectorization model and storage medium
US10460491B2 (en) Method for real-time deformable fusion of a source multi-dimensional image and a target multi-dimensional image of an object
JP4202692B2 (en) Image processing method and apparatus
JP2004118578A (en) Outline extracting method, image processor and its computer program
CN115797186A (en) Image restoration method and device, electronic equipment and storage medium
CN113610767A (en) Medical image multi-threshold segmentation method based on improved goblet sea squirt group algorithm
CN108765432B (en) Automatic carotid intima-media boundary segmentation method and system
WO2021009804A1 (en) Method for learning threshold value
CN112634224A (en) Focus detection method and device based on target image

Legal Events

Date Code Title Description
PB01 Publication
PB01 Publication
SE01 Entry into force of request for substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant