CN104573712A - Arteriovenous retinal blood vessel classification method based on eye fundus image - Google Patents

Arteriovenous retinal blood vessel classification method based on eye fundus image Download PDF

Info

Publication number
CN104573712A
CN104573712A CN201410850207.8A CN201410850207A CN104573712A CN 104573712 A CN104573712 A CN 104573712A CN 201410850207 A CN201410850207 A CN 201410850207A CN 104573712 A CN104573712 A CN 104573712A
Authority
CN
China
Prior art keywords
blood vessel
main
fundus image
vessel
eye fundus
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CN201410850207.8A
Other languages
Chinese (zh)
Other versions
CN104573712B (en
Inventor
吴健
黎罗河
邓水光
李莹
尹建伟
吴朝晖
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Hangzhou Qiushi Innovative Health Technology Co Ltd
Original Assignee
Zhejiang University ZJU
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Zhejiang University ZJU filed Critical Zhejiang University ZJU
Priority to CN201410850207.8A priority Critical patent/CN104573712B/en
Publication of CN104573712A publication Critical patent/CN104573712A/en
Application granted granted Critical
Publication of CN104573712B publication Critical patent/CN104573712B/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/23Clustering techniques
    • G06F18/232Non-hierarchical techniques
    • G06F18/2321Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions
    • G06F18/23213Non-hierarchical techniques using statistics or function optimisation, e.g. modelling of probability density functions with fixed number of clusters, e.g. K-means clustering
    • AHUMAN NECESSITIES
    • A61MEDICAL OR VETERINARY SCIENCE; HYGIENE
    • A61BDIAGNOSIS; SURGERY; IDENTIFICATION
    • A61B3/00Apparatus for testing the eyes; Instruments for examining the eyes
    • A61B3/10Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions
    • A61B3/12Objective types, i.e. instruments for examining the eyes independent of the patients' perceptions or reactions for looking at the eye fundus, e.g. ophthalmoscopes
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00Pattern recognition
    • G06F18/20Analysing
    • G06F18/24Classification techniques
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/44Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components
    • G06V10/457Local feature extraction by analysis of parts of the pattern, e.g. by detecting edges, contours, loops, corners, strokes or intersections; Connectivity analysis, e.g. of connected components by analysing connectivity, e.g. edge linking, connected component analysis or slices

Landscapes

  • Engineering & Computer Science (AREA)
  • Life Sciences & Earth Sciences (AREA)
  • Theoretical Computer Science (AREA)
  • Data Mining & Analysis (AREA)
  • Physics & Mathematics (AREA)
  • Computer Vision & Pattern Recognition (AREA)
  • Health & Medical Sciences (AREA)
  • General Physics & Mathematics (AREA)
  • General Engineering & Computer Science (AREA)
  • Evolutionary Biology (AREA)
  • Evolutionary Computation (AREA)
  • Bioinformatics & Computational Biology (AREA)
  • Bioinformatics & Cheminformatics (AREA)
  • Artificial Intelligence (AREA)
  • Heart & Thoracic Surgery (AREA)
  • Probability & Statistics with Applications (AREA)
  • Veterinary Medicine (AREA)
  • Public Health (AREA)
  • General Health & Medical Sciences (AREA)
  • Animal Behavior & Ethology (AREA)
  • Surgery (AREA)
  • Molecular Biology (AREA)
  • Medical Informatics (AREA)
  • Biomedical Technology (AREA)
  • Ophthalmology & Optometry (AREA)
  • Biophysics (AREA)
  • Multimedia (AREA)
  • Eye Examination Apparatus (AREA)

Abstract

The invention discloses an arteriovenous retinal blood vessel classification method based on an eye fundus image. The method includes the steps that first, a global blood vessel set and optic disk positioning information of the fundus image are acquired, the global blood vessel set is a set of all blood vessels in the fundus image, and the optic disk positioning information comprises the optic disk center of the fundus image; second, main blood vessels are determined according to the global blood vessel set and the optic disk positioning information and classified so that main blood vessel classification information can be obtained; third, the main blood vessel classification information is used for classifying the blood vessels in the global blood vessel set through a breadth first-search algorithm based on SAT so that global classification information can be obtained. According to the method, the classification information of the main blood vessels around an optic disk is first obtained, external expansion diffusion is performed from the main blood vessels through the breadth first-search algorithm based on SAT so that all the blood vessels can be obtained, a complete automatic blood vessel classification method is achieved, manual intervention is not needed, and classification precision is high.

Description

Based on the arteriovenous retinal vessel sorting technique of eye fundus image
Technical field
The present invention relates to computer-aided diagnosis technical field, be specifically related to a kind of arteriovenous retinal vessel sorting technique based on eye fundus image.
Background technology
Along with the fast development of the artificial intelligence field in computer technology, computer-aided diagnosis technology also develops gradually.Computer-aided diagnosis technology refers to that in conjunction with the analytical calculation of computer, assisted image section doctor finds focus by iconography, Medical Image Processing and other possible physiology, biochemical apparatus, improves the accuracy rate of diagnosis.
Usual Medical Imaging Computer auxiliary diagnosis is divided into three steps, specific as follows: the first step is that pathological changes is extracted from normal configuration; Second step is the quantification of characteristics of image; 3rd step processes data and reaches a conclusion.
Because computer can carry out accurate quantitative Analysis by full use image information, remove the subjectivity of people, avoid the difference because of personal knowledge and experience and the diagnostic result of " varying " that causes; So its result is unambiguous, determine, it make diagnosis become more accurately, more science.
Along with the development of modern high technology, computer-aided diagnosis will with the technological incorporation such as image procossing and PACS system, become and be easier to operation, be also more tending towards accurate, its clinical application range will expand further.
In medical science detects, eyes are uniquely can Non-Destructive Testing informative organ simultaneously.Research points out blood vessel limitation constriction in retinal vasculopathy, fill the air constriction, arteriovenous crossing compression, blood vessel walking changes, copper wire tremulous pulse, hemorrhage, cotton-wool patches, hard exudate and retinal nerve fibre layer defect and brain finally has significant dependency.And for the prediction of apoplexy, examination of ocular fundus only needs 40 yuan, MRI checks then needs thousands of unit, and carotid ultrasound also needs 140 yuan.The cost performance of examination of ocular fundus is the highest by contrast.The method of the full-automation of eye fundus image computer analysis, comprises the retinopathy classification that can provide instant, and does not need expert opinion, set up and have its certain economic implications with the system of optical fundus blood vessel optic nerve prediction three-hypers complication.Therefore, the lesion detection of retinal vessel has outstanding role to the auxiliary detection of brain soldier.Wherein build the automatic checkout system key component wherein especially of an arteriovenous crossing compression retinal vasculopathy.
Carry out to eye fundus image the basis that blood vessel segmentation, optic disc location and blood vessel classification (arteriovenous division) are the lesion detection of retinal vessel, existing blood vessel segmentation method needs manually to add markup information, and automaticity is not high.
Summary of the invention
For the deficiencies in the prior art, the invention provides a kind of arteriovenous retinal vessel sorting technique based on eye fundus image.
Based on an arteriovenous retinal vessel sorting technique for eye fundus image, comprise the steps:
(1) for described eye fundus image, several different overall blood vessel collection are obtained based on blood vessel segmentation method;
(2) for each overall blood vessel collection, obtain corresponding final convergence region based on fuzzy convergence algorithm, and determine the optic disc center of described eye fundus image according to the overlapping cases of each final convergence region;
(3) select an overall blood vessel collection, determine main blood vessel according to this overall blood vessel collection and optic disc locating information, and classification is carried out to main blood vessel obtain main blood vessel classified information;
(4) the main blood vessel classified information described in utilization adopts the breadth first search method based on SAT to carry out classification to the blood vessel that described overall blood vessel is concentrated and obtains global classification information.
The overall blood vessel collection that in the present invention, the middle pixel quantity selecting to correspond to blood vessel of step (3) is maximum, namely classifies to the overall blood vessel collection of this selection in corresponding step (4).
The object that the present invention obtains several different overall blood vessel collection is by multiple overall blood vessel collection determination convergence region, obtain optic disc center according to the overlapping cases between the convergence region that each overall blood vessel set pair is answered, be conducive to the accuracy at the optic disc center ensureing to obtain.
When described step (1) obtains several different overall blood vessel collection as follows based on blood vessel segmentation method, first set the binary-state threshold that several are different, then proceed as follows for each binary-state threshold:
(1-1) according to current binary-state threshold, binary conversion treatment is carried out to described eye fundus image, and the centrage extracted in the eye fundus image after binary conversion treatment and edge, obtain vascular tree;
(1-2) disconnection process is done to described vascular tree crotch and obtains vessel segment, and to each vessel segment carry out line segmentation obtain blood vessel, obtain primitive vessel collection;
(1-3) determine to split blood vessel by mistake, and concentrate removal namely to obtain overall blood vessel collection from primitive vessel.
In the present invention, binary-state threshold is that usual value is 4 ~ 20% for the pixel number of blood vessel accounts for the pixel ratio of whole eye fundus image after binary conversion treatment.Binary-state threshold is larger, then looser.As preferably, described binary-state threshold is 14%.
Mistake segmentation blood vessel in described step (1-3) comprises and is divided into two classes, and the first kind by mistake segmentation blood vessel is determined based on the background difference of blood vessel both sides, and Equations of The Second Kind is determined based on shape of blood vessel.
The difference of the background difference value background color described in the present invention, determine that the first kind splits blood vessel by mistake as follows in step (1-3):
(a1) for each blood vessel, the characteristic vector of this blood vessel both sides background is extracted;
The characteristic vector of any side background obtains with the color value on RGB tri-passages of all pixels (being namely less than 5 ~ 10 pixels with the distance of centrage) in inner region according to this lateral extent centrage 5 ~ 8 pixels.
The characteristic vector of every side is a three-dimensional vector, represents the color value information on RGB tri-passages of blood vessel both sides background respectively.Obtain this lateral extent centrage during specific implementation be less than color value on R, G, B tri-passages of all pixels in the region of 5 ~ 10 pixels and be averaging on each passage respectively, and then obtain the characteristic vector of this side.
(a2) adopting clustering procedure to be gathered by all blood vessels according to described characteristic vector is two classes, and the group obtained is around optic disc splits blood vessel by mistake.
For each blood vessel, calculate the Euclidean distance of both sides characteristic vector, then corresponding to all blood vessels Euclidean distance carries out cluster, namely completes the cluster to blood vessel.
Because K mean cluster (i.e. K-means algorithm) does not need to adjust parameter, and the speed of service is very fast.As preferably, adopting K means Method to be gathered by all blood vessels in described step (a2) is two classes.
In fact shape of blood vessel described in the present invention refers to the annexation of each blood vessel, determines that Equations of The Second Kind splits blood vessel by mistake as follows in step (1-3):
Determine the circulus marked off in the eye fundus image of primitive vessel collection, for each circulus, if the length of the blood vessel that length is maximum is less than default segmentation length threshold in this circulus, then to think in this circulus that all blood vessels are Equations of The Second Kind and split blood vessel by mistake, proceed as follows further:
Determine the center of this circulus, and calculate this center is more than or equal to the blood vessel of segmentation length threshold beeline (Ji Gai center is more than or equal to the distance of blood vessel splitting length threshold to the length nearest apart from it) to length, think with this center be the center of circle, all blood vessels split blood vessel for Equations of The Second Kind by mistake in the beeline border circular areas that is radius.
The setting of segmentation length threshold is according to the setting of practical experience value, and in the present invention, this ring-type splits length threshold α=x/60 ~ x/45.
Blood vessel segmentation method of the present invention, the background of blood vessel and shape is utilized to determine the blood vessel of segmentation by mistake after obtaining primitive vessel further, effectively can remove because the mistake segmentation blood vessel that causes of the reasons such as the ring-type that causes of taking pictures is reflective, the edge, rank that jumps of non-vascular around optic disc, plaque-like pathological changes and hemorrhage pathological changes, substantially increase the accuracy of vessel segmentation (the overall blood vessel collection namely obtained).
Proceed as follows when obtaining the convergence region that current overall blood vessel set pair answers in described step (2):
(2-1) each blood vessel is concentrated to current overall blood vessel, use fuzzy convergence algorithm to obtain the convergence region of this blood vessel;
(2-2) the ballot value of number as this pixel of the convergence region corresponding to each pixel of eye fundus image is added up;
(2-3) choose ballot and be worth front n large pixel, use the regional connectivity algorithm connected based on eight to obtain several connected regions to n the pixel chosen, and using the maximum connected region of area as final convergence region.
The size of n sets according to the size of eye fundus image, and as preferably, the value of described n is 1000 ~ 3000.
Described step (2) determines the optic disc center of described eye fundus image by the following method according to the overlapping cases of each final convergence region:
Judge whether to exist the overlapping region of at least l final convergence region, wherein l=k/3 ~ k/2, K are the number of binary-state threshold:
If exist, then using the centre coordinate of the maximum overlapping region of area as optic disc locating information;
Otherwise, obtain optic disc locating information to adopt specific template matching method.
Described step (3) determines main blood vessel by the following method:
Region within being several pixels using distance optic disc center is as optic disc adjacent domain, and in described optic disc adjacent domain, length is greater than the blood vessel of default classification length threshold as main blood vessel.
In the present invention with distance optic disc center for the region within R pixel, namely with optic disc center for the center of circle, the region taking R as radius is as optic disc adjacent domain, and in the optic disc adjacent domain determined, length is greater than the blood vessel of default classification length threshold as main blood vessel.
Wherein, the size of radius R and classification length threshold determines according to the size of optical fundus picture and practical situation.As preferably, the value of described R is 100 ~ 150, and described classification length threshold is 50 ~ 65.
Described step (3) is carried out classification to main blood vessel as follows and is obtained main blood vessel classified information:
(3-1) obtain the average caliber of each main blood vessel, the main blood vessel of specifying average caliber maximum is vein blood vessel;
(3-2) each main blood vessel is cut into some fragments, obtains corresponding main Vascular Slice;
(3-3) characteristic vector of each main Vascular Slice is extracted, and adopting clustering procedure based on described characteristic vector, described main Vascular Slice to be gathered be two classes, and using by the class at main Vascular Slice place corresponding for vein blood vessel as vein blood vessel, another kind of as arteries;
(3-4) for each main blood vessel, using the class at more main Vascular Slice place as the classification results of this main blood vessel.
The characteristic vector of each main Vascular Slice is extracted by the following method in described step (3-3):
Obtain the colouring information apart from all pixels in the region within several pixels of blood vessel center of main Vascular Slice, and using the average of the colouring information of all pixels in this region as the characteristic vector of this main Vascular Slice.
As preferably, when extracting the characteristic vector of each main Vascular Slice, obtain the colouring information apart from all pixels in the region within blood vessel center 5 ~ 8 pixels of main Vascular Slice.
Carry out breadth first search to overall blood vessel collection, the breadth first search method based on SAT uses three constraintss to carry out the transmission of blood vessel classification in search procedure: constraints 1: two blood vessels of decussation are labeled as two class blood vessels respectively; Three vascular marker that constraints 2: three is branched off in structure are; Constraints 3: if three blood vessels in three trouble structures are when wherein blood vessel and remaining two blood vessel angle sums are less than or equal to 270 degree, be judged to be three trouble structures of constraints 2, namely three blood vessels are same class blood vessel, otherwise do not do and judge.
Utilize above-mentioned three constraintss can distinguish the leakage segmentation owing to existing during blood vessel segmentation preferably and the intersection erroneous judgement that causes is broken into the situation of trident, improve nicety of grading.On the other hand, the blood vessel with a high credibility based on this constraints first obtains classification results, the mode that blood vessel with a low credibility does correction for the region that blood vessel with a high credibility is not delivered to can make the credibility of the blood vessel mark of the overall situation improve, thus improves classifying quality.
The thicker main blood vessel of the existing appointment of the present invention is vein blood vessel, and therefore thicker at the breadth first search method medium vessels of whole SAT, the credibility of the classification results of this blood vessel obtained is higher.
Compared with prior art, first the present invention obtains the classified information of the main blood vessel around optic disc, and extends out diffusion from main blood vessels open primordium in the breadth first search method of SAT and obtain all blood vessels, achieves a complete automatic blood vessel sorting technique, without the need to manual intervention, and nicety of grading is high.
Accompanying drawing explanation
Fig. 1 is the eye fundus image of the present embodiment;
Fig. 2 is the flow chart of classifying based on the arteriovenous retinal vessel of the eye fundus image of breadth first search method;
Fig. 3 is the flow chart in the present embodiment, eye fundus image being carried out to blood vessel segmentation;
Fig. 4 is the schematic diagram of the primitive vessel collection that blood vessel segmentation obtains;
Fig. 5 is the schematic diagram of the overall blood vessel collection that blood vessel segmentation obtains;
In Fig. 6 the present embodiment, eye fundus image is carried out to the flow chart of optic disc location;
Fig. 7 is the schematic diagram of the global classification information of the arteriovenous retinal vessel classification of the present embodiment eye fundus image.
Detailed description of the invention
Describe the present invention below in conjunction with the drawings and specific embodiments.
The present embodiment is for Benq the eye fundus image shown in Fig. 1 in the arteriovenous retinal vessel sorting technique of eye fundus image, and the size of this eye fundus image is 3000 × 3000.The ring-type caused by taking pictures is reflective, the edge, rank that jumps, the reason such as plaque-like pathological changes and hemorrhage pathological changes of non-vascular around optic disc, there is bright ring in this eye fundus image.
Carry out the classification of arteriovenous retinal vessel to this eye fundus image, classification process as shown in Figure 2, comprises the steps:
(1) obtain overall blood vessel collection (i.e. final blood vessel collection) and the optic disc locating information of eye fundus image, overall blood vessel integrates the set as blood vessels all in eye fundus image, and optic disc locating information comprises the optic disc center of eye fundus image;
Obtain the overall blood vessel collection of eye fundus image in the present embodiment by carrying out blood vessel segmentation to eye fundus image, idiographic flow as shown in Figure 3, comprises the steps:
(1-1) wavelet transformation (IUWT small echo) is carried out to eye fundus image, according to the binary-state threshold preset, binary conversion treatment is carried out to the eye fundus image through wavelet transformation, and the centrage extracted in the eye fundus image after binary conversion treatment and edge, obtain vascular tree;
(1-2) disconnection process is done to vascular tree crotch and obtains vessel segment, and to each vessel segment carry out line segmentation obtain blood vessel, obtain primitive vessel collection.
When disconnection process is done to vascular tree crotch: when many centrages are pooled to a bit in the vessel centerline in vascular tree, remove central point (cross point collected), obtain many independent vessel centerline.
When line segmentation is carried out to each vessel segment: using each root centrage as a vessel segment.Vessel segment is a curve, uses the traditional method of the line segmentation of image procossing, by curve many beeline approaching.The many straight lines obtained, namely every root straight line represents a blood vessel, and the set of all straight lines is primitive vessel collection.
(1-3) determine to split blood vessel by mistake, in the present embodiment, by mistake segmentation blood vessel obtains the first kind segmentation blood vessel and Equations of The Second Kind splits blood vessel by mistake by mistake, delete from primitive vessel set the first kind by mistake segmentation blood vessel and Equations of The Second Kind split blood vessel by mistake, then obtain overall blood vessel collection (i.e. final blood vessel collection).
For the reflective mistake segmentation caused of ring-type, its blood vessel be partitioned into relatively and normal blood vessels there is the construction features of the ring be made up of the blood vessel of segment.
For the mistake segmentation that the edge, rank that jumps around optic disc causes, its blood vessel be partitioned into does not have special feature on rgb color space and structure.Its by mistake segmentation blood vessel be the background composition around optic disc because it is near optic disc, and background color around optic disc has acquaintance away from the conventional vascular color of mediating a settlement of the background around optic disc relatively; From a structural point because it is isolated existence, and mixed in together being also difficult to of optic disc peripheral vessels is distinguished from structure, judges easily to cause a large amount of erroneous judgements if done from structure by force.But the background of its vessel segment both sides on rgb color space there is larger aberration, this is because its both sides background by optic disc in addition while be made up of generic background.Compare general blood vessel, its both sides background is all by generic background or be all made up of optic disc.
For the mistake segmentation that plaque-like pathological changes and hemorrhagic disease alter, its blood vessel be partitioned into is made up of generic background in color, does not have special characteristic.But the relative normal blood vessels of its structure seems mixed and disorderly especially, does not have longer angiopoietic tree, mostly is multiple little circulus and combines with some thin vessels in small, broken bits.
Based on above analysis, the background difference determination first kind based on blood vessel both sides in the present embodiment splits blood vessel by mistake:
(a1) for each blood vessel, the characteristic vector of this blood vessel both sides background is extracted;
The color value of all pixels on R, G, B tri-passages obtained in the region of this lateral extent centrage 10 pixels and so on is also averaging respectively, and then obtains the characteristic vector of this side on each passage.
The characteristic vector of every side is actually a three-dimensional vector, represents the color value information on RGB tri-passages of blood vessel both sides background respectively.
(a2) adopting K means Method characteristic vector to be gathered is two classes, all blood vessels are divided into two classes by the corresponding relation according to characteristic vector and blood vessel, because probability of miscarriage of justice usually can not be too high, the group (blood vessel that namely blood vessel content is less) therefore obtained is the first kind and splits blood vessel by mistake.
By splitting blood vessel based on shape of blood vessel determination Equations of The Second Kind by mistake in the present embodiment:
(b1) circulus marked off in the eye fundus image of primitive vessel collection is determined.
Can build non-directed graph G=(V, E) during specific implementation, V is the set of two end points of all vessel centerline, and E is the set of the centrage of all blood vessels, utilizes this non-directed graph G=(V, E) to determine circulus.
(b2) for each circulus, if the length of the blood vessel that length is maximum is less than default segmentation length threshold α in this circulus, wherein α=x/60 ~ x/45, (in the present embodiment, split length threshold α=x/50, x is the widthwise size of eye fundus image, i.e. x=3000), then all in this circulus blood vessels are that Equations of The Second Kind splits blood vessel by mistake, proceed as follows further:
Determine the center of this circulus, and calculate this center is more than or equal to the blood vessel of α beeline (Ji Gai center is more than or equal to the distance of the blood vessel of α to the length nearest apart from it) to length, with this center be the center of circle, all blood vessels split blood vessel for Equations of The Second Kind by mistake in the beeline border circular areas that is radius.
In the present embodiment, binary-state threshold is that usual value is 4 ~ 20% for the pixel number of blood vessel accounts for the pixel ratio of whole eye fundus image after binary conversion treatment.Binary-state threshold is larger, then looser.
Use the binary-state threshold that six different in the present embodiment, be respectively 4%, 6%, 8%, 10%, 12% and 14%.Step (1-1) ~ (1-3) is all carried out, respectively corresponding 6 overall blood vessel set for each binary-state threshold.
As shown in Figure 4, the schematic diagram of the overall blood vessel collection that correspondence obtains as shown in Figure 5 for the primitive vessel collection obtained when binary-state threshold is 14% in the present embodiment.Can finding out, effectively can eliminating that the ring-type caused by taking pictures is reflective by removing by mistake segmentation blood vessel, interference that the reason such as the edge, rank that jumps of non-vascular around optic disc, plaque-like pathological changes and hemorrhage pathological changes causes, improve the degree of accuracy of blood vessel segmentation.
Obtain optic disc locating information by carrying out optic disc location to eye fundus image in the present embodiment, idiographic flow as shown in Figure 6, proceeds as follows for each overall blood vessel collection:
(1-2) concentrate each blood vessel for current overall blood vessel, use fuzzy convergence algorithm to obtain the convergence region of this blood vessel;
(1-3) the ballot value of number as this pixel of the convergence region belonging to each pixel of eye fundus image is added up, and according to the ballot value structure one of each pixel ballot matrix, carry out mean filter to ballot matrix, the size of the mean filter adopted during mean filter is 6 × 6.
Each element in the ballot matrix built in the present embodiment and the pixel one_to_one corresponding in eye fundus image are the ballot value of the pixel of correspondence.
(1-4) according to matrix of voting after filtering choose ballot value large before n pixel (in the present embodiment n=3000), the regional connectivity algorithm connected based on eight is used to obtain several connected regions to n the pixel chosen, the maximum connected region of the area of answering with each overall blood vessel set pair makes the final convergence region of this overall blood vessel collection, judge whether to exist the overlapping region of at least l final convergence region, wherein l=k/2, k is the number of default binary-state threshold, i.e. l=3:
If exist, then using the centre coordinate of the maximum overlapping region of area as optic disc locating information;
Otherwise, obtain optic disc locating information to adopt specific template matching method.
(2) determine main blood vessel according to the overall blood vessel collection of binary-state threshold maximum (namely the loosest) and optic disc locating information, and classification is carried out to main blood vessel obtain main blood vessel classified information;
Main blood vessel is determined by the following method in the present embodiment:
Using the region within the pixel of distance 100, optic disc center as optic disc adjacent domain, in the optic disc adjacent domain determined, length is greater than the blood vessel of default classification length threshold (the classification length threshold preset in the present embodiment is for 60) as main blood vessel.
In the present embodiment, following steps are carried out classification to main blood vessel and are obtained main blood vessel classified information:
(2-1) obtain the average caliber of each main blood vessel, the main blood vessel of specifying average caliber maximum is vein blood vessel;
(2-2) each main blood vessel is cut into some fragments, obtains corresponding main Vascular Slice;
Along the centrage of main blood vessel when splitting in the present embodiment, each pixel is a section, and then is some fragments by each main blood vessel cutting (i.e. Vascular Slice).
(2-3) colouring information of 5 pixels is obtained respectively along the blood vessel center of this main Vascular Slice to both sides, and the characteristic vector using the average of the colouring information of all pixels as this main Vascular Slice;
The rgb value of this pixel and HSL value in the present embodiment, the characteristic vector namely obtained is 6 dimensional vectors, and each dimension is respectively to should the color value of pixel on R, G, B and H, S, L passage.
Then, it is two classes that feature based vector adopts K means Method all main Vascular Slice to be gathered, and using by the class at main Vascular Slice place corresponding for vein blood vessel as venous blood tubing, another kind of as arterial blood tubing.
(2-4) for each main blood vessel, using the class at more main Vascular Slice place as the classification results of this main blood vessel.
Such as any one main blood vessel, have A% at arteries apoplexy due to endogenous wind in the main Vascular Slice of its correspondence, B% is at vein blood vessel apoplexy due to endogenous wind, if A is greater than B, then thinks that this blood vessel is arteries, if A is less than B, thinks that this blood vessel is vein blood vessel, otherwise, specify arbitrarily.
(3) utilize main blood vessel classified information to adopt the breadth first search method based on SAT to carry out classification to the blood vessel that overall blood vessel is concentrated and obtain global classification information.
Carry out breadth first search to overall blood vessel collection, the breadth first search method based on SAT uses three constraintss to carry out the transmission of blood vessel classification in search procedure: constraints 1: two blood vessels of decussation are labeled as two class blood vessels respectively; Three vascular marker that constraints 2: three is branched off in structure are; Constraints 3: if three blood vessels in three trouble structures are when wherein blood vessel and remaining two blood vessel angle sums are less than or equal to 270 degree, be judged to be three trouble structures of constraints 2, namely three blood vessels are same class blood vessel, otherwise do not do and judge.
Fig. 7 is the global classification information adopting the breadth first search method based on SAT to obtain in the present embodiment, can the blood vessel number of unfiled (i.e. classification then still do not have classified information) less, the blood vessels in the greatly less three trouble structures caused because of blood vessel segmentation are classified situation about cannot carry out.
Do not make specified otherwise, in the present embodiment, in all flow charts, Rounded Box represents the result obtained, and corner rectangle represents operation.
Above-described detailed description of the invention has been described in detail technical scheme of the present invention and beneficial effect; be understood that and the foregoing is only most preferred embodiment of the present invention; be not limited to the present invention; all make in spirit of the present invention any amendment, supplement and equivalent to replace, all should be included within protection scope of the present invention.

Claims (9)

1., based on an arteriovenous retinal vessel sorting technique for eye fundus image, it is characterized in that, comprise the steps:
(1) for described eye fundus image, several different overall blood vessel collection are obtained based on blood vessel segmentation method;
(2) for each overall blood vessel collection, obtain corresponding final convergence region based on fuzzy convergence algorithm, and determine the optic disc center of described eye fundus image according to the overlapping cases of each final convergence region;
(3) select an overall blood vessel collection, determine main blood vessel according to this overall blood vessel collection and optic disc locating information, and classification is carried out to main blood vessel obtain main blood vessel classified information;
(4) the main blood vessel classified information described in utilization adopts the breadth first search method based on SAT to carry out classification to the blood vessel that described overall blood vessel is concentrated and obtains global classification information.
2. as claimed in claim 1 based on the arteriovenous retinal vessel sorting technique of eye fundus image, it is characterized in that, when described step (1) obtains several different overall blood vessel collection as follows based on blood vessel segmentation method, first set the binary-state threshold that several are different, then proceed as follows for each binary-state threshold:
(1-1) according to current binary-state threshold, binary conversion treatment is carried out to described eye fundus image, and the centrage extracted in the eye fundus image after binary conversion treatment and edge, obtain vascular tree;
(1-2) disconnection process is done to described vascular tree crotch and obtains vessel segment, and to each vessel segment carry out line segmentation obtain blood vessel, obtain primitive vessel collection;
(1-3) determine to split blood vessel by mistake, and concentrate removal namely to obtain overall blood vessel collection from primitive vessel.
3. as claimed in claim 1 based on the arteriovenous retinal vessel sorting technique of eye fundus image, it is characterized in that, proceed as follows when obtaining the convergence region that current overall blood vessel set pair answers in described step (2):
(2-1) each blood vessel is concentrated to current overall blood vessel, use fuzzy convergence algorithm to obtain the convergence region of this blood vessel;
(2-2) the ballot value of number as this pixel of the convergence region corresponding to each pixel of eye fundus image is added up;
(2-3) choose ballot and be worth large several pixels front, use the regional connectivity algorithm connected based on eight to obtain several connected regions to several pixels of choosing, and using the maximum connected region of area as final convergence region.
4., as claimed in claim 3 based on the arteriovenous retinal vessel sorting technique of eye fundus image, it is characterized in that, described step (2) determines the optic disc center of described eye fundus image by the following method according to the overlapping cases of each final convergence region:
Judge whether to exist the overlapping region of at least l final convergence region, wherein l=k/3 ~ k/2, K are the number of binary-state threshold:
If exist, then using the centre coordinate of the maximum overlapping region of area as optic disc locating information;
Otherwise, obtain optic disc locating information to adopt specific template matching method.
5., as the arteriovenous retinal vessel sorting technique based on eye fundus image in Claims 1 to 4 as described in any one, it is characterized in that, described step (3) determines main blood vessel by the following method:
Region within being several pixels using distance optic disc center is as optic disc adjacent domain, and in described optic disc adjacent domain, length is greater than the blood vessel of default classification length threshold as main blood vessel.
6., as claimed in claim 5 based on the arteriovenous retinal vessel sorting technique of eye fundus image, it is characterized in that, described classification length threshold is 50 ~ 65.
7., as claimed in claim 6 based on the arteriovenous retinal vessel sorting technique of eye fundus image, it is characterized in that, described step (3) is carried out classification to main blood vessel as follows and is obtained main blood vessel classified information:
(3-1) obtain the average caliber of each main blood vessel, the main blood vessel of specifying average caliber maximum is vein blood vessel;
(3-2) each main blood vessel is cut into some fragments, obtains corresponding main Vascular Slice;
(3-3) characteristic vector of each main Vascular Slice is extracted, and adopting clustering procedure based on described characteristic vector, described main Vascular Slice to be gathered be two classes, and using by the class at main Vascular Slice place corresponding for vein blood vessel as vein blood vessel, another kind of as arteries;
(3-4) for each main blood vessel, using the class at more main Vascular Slice place as the classification results of this main blood vessel.
8., as claimed in claim 7 based on the arteriovenous retinal vessel sorting technique of eye fundus image, it is characterized in that, in described step (3-3), extract the characteristic vector of each main Vascular Slice by the following method:
Obtain the colouring information apart from all pixels in the region within several pixels of blood vessel center of main Vascular Slice, and using the average of the colouring information of all pixels in this region as the characteristic vector of this main Vascular Slice.
9. as claimed in claim 8 based on the arteriovenous retinal vessel sorting technique of eye fundus image, it is characterized in that, when extracting the characteristic vector of each main Vascular Slice, obtain the colouring information apart from all pixels in the region within blood vessel center 5 ~ 8 pixels of main Vascular Slice.
CN201410850207.8A 2014-12-31 2014-12-31 Arteriovenous retinal vessel sorting technique based on eye fundus image Active CN104573712B (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN201410850207.8A CN104573712B (en) 2014-12-31 2014-12-31 Arteriovenous retinal vessel sorting technique based on eye fundus image

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN201410850207.8A CN104573712B (en) 2014-12-31 2014-12-31 Arteriovenous retinal vessel sorting technique based on eye fundus image

Publications (2)

Publication Number Publication Date
CN104573712A true CN104573712A (en) 2015-04-29
CN104573712B CN104573712B (en) 2018-01-16

Family

ID=53089732

Family Applications (1)

Application Number Title Priority Date Filing Date
CN201410850207.8A Active CN104573712B (en) 2014-12-31 2014-12-31 Arteriovenous retinal vessel sorting technique based on eye fundus image

Country Status (1)

Country Link
CN (1) CN104573712B (en)

Cited By (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809480A (en) * 2015-05-21 2015-07-29 中南大学 Retinal vessel segmentation method of fundus image based on classification and regression tree and AdaBoost
CN106204555A (en) * 2016-06-30 2016-12-07 天津工业大学 A kind of combination Gbvs model and the optic disc localization method of phase equalization
CN106529420A (en) * 2016-10-20 2017-03-22 天津大学 Videodisc center positioning method according to fundus image edge information and brightness information
CN106846301A (en) * 2016-12-29 2017-06-13 北京理工大学 Retinal images sorting technique and device
CN106991718A (en) * 2017-03-31 2017-07-28 上海健康医学院 A kind of method based on shading value restoration and reconstruction eyeground three-dimensional structure
CN107203758A (en) * 2017-06-06 2017-09-26 哈尔滨理工大学 Diabetes patient's retinal vascular images dividing method
CN107229937A (en) * 2017-06-13 2017-10-03 瑞达昇科技(大连)有限公司 A kind of retinal vessel sorting technique and device
CN108073918A (en) * 2018-01-26 2018-05-25 浙江大学 The vascular arteriovenous crossing compression feature extracting method of eye ground
CN108182680A (en) * 2017-12-28 2018-06-19 西安中科微光影像技术有限公司 A kind of angle automatic identifying method of the bifurcated vessels based on IVOCT images
CN108230322A (en) * 2018-01-28 2018-06-29 浙江大学 A kind of eyeground feature detection device based on weak sample labeling
CN108764286A (en) * 2018-04-24 2018-11-06 电子科技大学 The classifying identification method of characteristic point in a kind of blood-vessel image based on transfer learning
CN108803994A (en) * 2018-06-14 2018-11-13 四川和生视界医药技术开发有限公司 The management method of retinal vessel and the managing device of retinal vessel
CN109635862A (en) * 2018-12-05 2019-04-16 合肥奥比斯科技有限公司 Retinopathy of prematurity plus lesion classification method
CN110276763A (en) * 2018-03-15 2019-09-24 中南大学 It is a kind of that drawing generating method is divided based on the retinal vessel of confidence level and deep learning
CN111696089A (en) * 2020-06-05 2020-09-22 上海联影医疗科技有限公司 Arteriovenous determining method, device, equipment and storage medium
CN111932554A (en) * 2020-07-31 2020-11-13 青岛海信医疗设备股份有限公司 Pulmonary blood vessel segmentation method, device and storage medium
CN112734785A (en) * 2021-01-28 2021-04-30 依未科技(北京)有限公司 Method, device, medium and equipment for determining sub-pixel-level fundus blood vessel boundary
CN112734828A (en) * 2021-01-28 2021-04-30 依未科技(北京)有限公司 Method, device, medium and equipment for determining center line of fundus blood vessel

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN101393644A (en) * 2008-08-15 2009-03-25 华中科技大学 Hepatic portal vein tree modeling method and system thereof
CN102014731A (en) * 2008-04-08 2011-04-13 新加坡国立大学 Retinal image analysis systems and methods
CN102346911A (en) * 2010-07-28 2012-02-08 北京集翔多维信息技术有限公司 Method for segmenting blood vessel in digital subtraction angiography (DSA) image sequence

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102014731A (en) * 2008-04-08 2011-04-13 新加坡国立大学 Retinal image analysis systems and methods
CN101393644A (en) * 2008-08-15 2009-03-25 华中科技大学 Hepatic portal vein tree modeling method and system thereof
CN102346911A (en) * 2010-07-28 2012-02-08 北京集翔多维信息技术有限公司 Method for segmenting blood vessel in digital subtraction angiography (DSA) image sequence

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
ADAM HOOVER等: "Locating the Optic Nerve in a Retinal Image Using the Fuzzy Convergence of the Blood Vessels", 《IEEE TRANSACTIONS ON MEDICAL IMAGING》 *
CLAUDIA NIEUWENHUIS等: "Blood vessel classification into arteries and veins in retinal images", 《PROCEEDINGS OF SPIE - THE INTERNATIONAL SOCIETY FOR OPTICAL ENGINEERING》 *

Cited By (32)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN104809480A (en) * 2015-05-21 2015-07-29 中南大学 Retinal vessel segmentation method of fundus image based on classification and regression tree and AdaBoost
CN104809480B (en) * 2015-05-21 2018-06-19 中南大学 A kind of eye fundus image Segmentation Method of Retinal Blood Vessels based on post-class processing and AdaBoost
CN106204555A (en) * 2016-06-30 2016-12-07 天津工业大学 A kind of combination Gbvs model and the optic disc localization method of phase equalization
CN106204555B (en) * 2016-06-30 2019-08-16 天津工业大学 A kind of optic disk localization method of combination Gbvs model and phase equalization
CN106529420B (en) * 2016-10-20 2019-07-19 天津大学 The optic disk center positioning method of comprehensive eye fundus image marginal information and luminance information
CN106529420A (en) * 2016-10-20 2017-03-22 天津大学 Videodisc center positioning method according to fundus image edge information and brightness information
CN106846301A (en) * 2016-12-29 2017-06-13 北京理工大学 Retinal images sorting technique and device
CN106846301B (en) * 2016-12-29 2020-06-23 北京理工大学 Retina image classification method and device
CN106991718A (en) * 2017-03-31 2017-07-28 上海健康医学院 A kind of method based on shading value restoration and reconstruction eyeground three-dimensional structure
CN107203758A (en) * 2017-06-06 2017-09-26 哈尔滨理工大学 Diabetes patient's retinal vascular images dividing method
CN107229937A (en) * 2017-06-13 2017-10-03 瑞达昇科技(大连)有限公司 A kind of retinal vessel sorting technique and device
CN108182680A (en) * 2017-12-28 2018-06-19 西安中科微光影像技术有限公司 A kind of angle automatic identifying method of the bifurcated vessels based on IVOCT images
CN108182680B (en) * 2017-12-28 2021-12-28 中科微光医疗研究中心(西安)有限公司 IVOCT image-based angle automatic identification method for bifurcated vessels
CN108073918B (en) * 2018-01-26 2022-04-29 浙江大学 Method for extracting blood vessel arteriovenous cross compression characteristics of fundus retina
CN108073918A (en) * 2018-01-26 2018-05-25 浙江大学 The vascular arteriovenous crossing compression feature extracting method of eye ground
CN108230322B (en) * 2018-01-28 2021-11-09 浙江大学 Eye ground characteristic detection device based on weak sample mark
CN108230322A (en) * 2018-01-28 2018-06-29 浙江大学 A kind of eyeground feature detection device based on weak sample labeling
CN110276763A (en) * 2018-03-15 2019-09-24 中南大学 It is a kind of that drawing generating method is divided based on the retinal vessel of confidence level and deep learning
CN108764286A (en) * 2018-04-24 2018-11-06 电子科技大学 The classifying identification method of characteristic point in a kind of blood-vessel image based on transfer learning
CN108764286B (en) * 2018-04-24 2022-04-19 电子科技大学 Classification and identification method of feature points in blood vessel image based on transfer learning
CN108803994A (en) * 2018-06-14 2018-11-13 四川和生视界医药技术开发有限公司 The management method of retinal vessel and the managing device of retinal vessel
CN109635862A (en) * 2018-12-05 2019-04-16 合肥奥比斯科技有限公司 Retinopathy of prematurity plus lesion classification method
CN109635862B (en) * 2018-12-05 2021-08-24 合肥奥比斯科技有限公司 Sorting method for retinopathy of prematurity plus lesion
WO2021244661A1 (en) * 2020-06-05 2021-12-09 上海联影医疗科技股份有限公司 Method and system for determining blood vessel information in image
CN111696089A (en) * 2020-06-05 2020-09-22 上海联影医疗科技有限公司 Arteriovenous determining method, device, equipment and storage medium
CN111696089B (en) * 2020-06-05 2023-06-16 上海联影医疗科技股份有限公司 Arteriovenous determination method, device, equipment and storage medium
CN111932554A (en) * 2020-07-31 2020-11-13 青岛海信医疗设备股份有限公司 Pulmonary blood vessel segmentation method, device and storage medium
CN111932554B (en) * 2020-07-31 2024-03-22 青岛海信医疗设备股份有限公司 Lung vessel segmentation method, equipment and storage medium
CN112734828A (en) * 2021-01-28 2021-04-30 依未科技(北京)有限公司 Method, device, medium and equipment for determining center line of fundus blood vessel
CN112734785A (en) * 2021-01-28 2021-04-30 依未科技(北京)有限公司 Method, device, medium and equipment for determining sub-pixel-level fundus blood vessel boundary
CN112734828B (en) * 2021-01-28 2023-02-24 依未科技(北京)有限公司 Method, device, medium and equipment for determining center line of fundus blood vessel
CN112734785B (en) * 2021-01-28 2024-06-07 依未科技(北京)有限公司 Method, device, medium and equipment for determining sub-pixel level fundus blood vessel boundary

Also Published As

Publication number Publication date
CN104573712B (en) 2018-01-16

Similar Documents

Publication Publication Date Title
CN104573712A (en) Arteriovenous retinal blood vessel classification method based on eye fundus image
CN104573716A (en) Eye fundus image arteriovenous retinal blood vessel classification method based on breadth first-search algorithm
CN104537669B (en) The arteriovenous Segmentation Method of Retinal Blood Vessels of eye fundus image
CN104545792A (en) Arteriovenous retinal vessel optic disk positioning method of eye fundus image
CN110992382B (en) Fundus image optic cup optic disc segmentation method and system for assisting glaucoma screening
Tian et al. Multi-path convolutional neural network in fundus segmentation of blood vessels
Liu et al. A framework of wound segmentation based on deep convolutional networks
CN108764342B (en) Semantic segmentation method for optic discs and optic cups in fundus image
CN112465772B (en) Fundus colour photographic image blood vessel evaluation method, device, computer equipment and medium
CN111046835A (en) Eyeground illumination multiple disease detection system based on regional feature set neural network
CN108073918B (en) Method for extracting blood vessel arteriovenous cross compression characteristics of fundus retina
WO2022166399A1 (en) Fundus oculi disease auxiliary diagnosis method and apparatus based on bimodal deep learning
WO2021164640A1 (en) Retinal image recognition method and apparatus, electronic device, and storage medium
Li et al. Joint learning of vessel segmentation and artery/vein classification with post-processing
CN111797901A (en) Retinal artery and vein classification method and device based on topological structure estimation
CN112288720A (en) Deep learning-based color fundus image glaucoma screening method and system
SG172159A1 (en) A method and system for determining the position of an optic cup boundary
CN111797900B (en) Artery and vein classification method and device for OCT-A image
Qin et al. Optic disc and cup segmentation based on deep learning
CN107203758A (en) Diabetes patient's retinal vascular images dividing method
CN115206495A (en) Renal cancer pathological image analysis method and system based on CoAtNet deep learning and intelligent microscopic device
Dubey et al. Recent developments on computer aided systems for diagnosis of diabetic retinopathy: a review
CN112330662A (en) Medical image segmentation system and method based on multi-level neural network
Zhou et al. Computer aided diagnosis for diabetic retinopathy based on fundus image
CN114898172B (en) Multi-feature DAG network-based diabetic retinopathy classification modeling method

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
GR01 Patent grant
GR01 Patent grant
TR01 Transfer of patent right
TR01 Transfer of patent right

Effective date of registration: 20191008

Address after: 310000 room 410-2, floor 4, building 3, No. 9, Jiuhuan Road, Jianggan District, Hangzhou City, Zhejiang Province

Patentee after: Hangzhou Qiushi innovative health technology Co., Ltd.

Address before: 310027 Hangzhou, Zhejiang Province, Xihu District, Zhejiang Road, No. 38, No.

Patentee before: Zhejiang University

PE01 Entry into force of the registration of the contract for pledge of patent right
PE01 Entry into force of the registration of the contract for pledge of patent right

Denomination of invention: Classification of arteriovenous retinal vessels based on fundus images

Effective date of registration: 20210423

Granted publication date: 20180116

Pledgee: Xixi sub branch of Bank of Hangzhou Co.,Ltd.

Pledgor: Hangzhou Qiushi innovative health technology Co.,Ltd.

Registration number: Y2021330000329

PC01 Cancellation of the registration of the contract for pledge of patent right
PC01 Cancellation of the registration of the contract for pledge of patent right

Date of cancellation: 20211216

Granted publication date: 20180116

Pledgee: Xixi sub branch of Bank of Hangzhou Co.,Ltd.

Pledgor: Hangzhou Qiushi innovative health technology Co.,Ltd.

Registration number: Y2021330000329